as United States
`a2) Patent Application Publication co) Pub. No.: US 2002/0033795 A1
`(43) Pub. Date: Mar. 21, 2002
`
`Shahoian et al.
`
`US 20020033795A1
`
`(54) HAPTIC INTERFACE FOR LAPTOP
`COMPUTERS AND OTHER PORTABLE
`DEVICES
`
`(76)
`
`Inventors: Erik J. Shahoian, San Ramon, CA
`(US); Bruce M. Schena, Menlo Park,
`CA (US); Louis B. Rosenberg, San
`Jose, CA (US)
`
`Correspondence Address:
`James R.Riegel
`801 Fox Lane
`San Jose, CA 95131 (US)
`
`(21) Appl. No.:
`
`09/917,263
`
`(22)
`
`Filed:
`
`Jul. 26, 2001
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 09/487,737,
`filed on Jan. 19, 2000, which is a non-provisional of
`
`provisional application No. 60/274,444,filed on Mar.
`9, 2001.
`
`Publication Classification
`
`Tinte C07 anceeeeeecscssesnnnteeeesecceececnnnnnnness G09G 5/00
`(SV)
`(52) US. CMe ae eeceeeesessnessneesseeseceseccnseceseesnesansenneees 345/156
`
`ABSTRACT
`(57)
`A haptic feedback touch control used to provide input to a
`computer. A touch input device includes a planar touch
`surface that provides position information to a computer
`based on a location of user contact. The computer can
`position a cursor in a displayed graphical environment based
`at least in part on the position information, or perform a
`different function. Atleast one actuatoris also coupledto the
`touch input device and outputs a force to provide a haptic
`sensation to the user. The actuator can move the touchpad
`laterally, or a separate surface membercan be actuated.A flat
`E-core actuator, piezoelectric actuator, or other types of
`actuators can be used to provide forces. The touch input
`device can include multiple different regions to control
`different computer functions.
`
`
`
`Valve Exhibit 1006
`Valve Exhibit 1006
`Valve v. Immersion
`Valve v. Immersion
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 1 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 2 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 3 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 4 of 18
`
`US 2002/0033795 Al
`
`IYHOSTCOMPUTERSYSTEM14.ts!
`
`1 AUDIO OUTPUT]—|SYSTEM
`
`i
`CLOCK
`DEVICE
`!
`102
`|
`104
`!
`!
`|
`
`1
`
`HOST
`PROCESSOR
`100
`
`"
`
`>|
`
`DISPLAY
`DEVICE
`26
`
`|
`
`I
`
`|
`
`eeee en a ee ee ne ee ee ee ee eee eeee| ~=——
`
`|
`!
`
`
`
`boet fmmeeee eee |
`l
`20 Po|
`HAPTIC FEEDBACK
`!
`INTERFACE DEVICE 12
`
`LOCAL
`SENSOR
`
`
`
`|_s|MICROPROCESSOR INTERFACE !
`ie
`Hp
`
`
`|
`|
`HOUSINGOR
`
`|
`
`|
`iT
`|
`
`CLOCK
`
`OUTPUT
`
`!
`||
`
`| 8 MANIPULANDUM||
`
`!
`MEMORY
`!
`|
`122
`|
`|
`I
`|
`|
`I
`I
`|
`|
`I
`|
`|
`|
`|
`|
`|
`|
`1
`|
`
`|
`
`_—
`
`|
`
`ACTUATOR
`INTERFACE
`116
`
`t
`1
`
`ACTUATOR
`18
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 5 of 18
`
`US 2002/0033795 Al
`
`CSSL
`OLLSOL:
`YWJ|
`
`9
`
`c9L
`
`
`
`

`

`US 2002/0033795 Al
`
`Patent Application Publication Mar. 21,2002 Sheet 6 of 18
`
`

`

`Patent Application Publication
`
`Mar. 21, 2002 Sheet 7 of 18
`
`US 2002/0033795 Al
`
`U3 ™
`
`grb
`
`|
`
`——
`ras
`
`er
`
`“
`
`2
`
`\
`252
`
`|
`
`ONT
`
`sy
`
`Be,
`
`wake
`
`Feed
`
`28
`
`barren sinveett-vumnittenras,
`
`im
`
`eee
`
`sas
`
`Te foCR.
`<<
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 8 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 9 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 10 of 18
`
`US 2002/0033795 Al
`
` ornateNbaNICEAENetttemaretyth
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 11 of 18
`
`US 2002/0033795 Al
`
`zg 330
`
`ae
`
`Span ~
`
`
`
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 12 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 13 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 14 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 15 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 16 of 18
`
`US 2002/0033795 Al
`
`oa-
`
`aeaa
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 17 of 18
`
`US 2002/0033795 Al
`
`
`
`

`

`Patent Application Publication Mar. 21,2002 Sheet 18 of 18
`
`US 2002/0033795 Al
`
`450 ry
`
`

`

`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`HAPTIC INTERFACE FOR LAPTOP COMPUTERS
`AND OTHER PORTABLE DEVICES
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`‘This application is a continuation-in-part of co-
`{0001]
`pending U.S. patent application Ser. No. 09/487,737,
`entitled “Haptic Feedback for Touchpads and Other Touch
`Controls,” filed Jan. 19, 2000 by Rosenberget al., and this
`application claims the benefit of U.S. Provisional Applica-
`tion No. 60/274,444, filed Mar. 9, 2001, entitled, “Haptic
`Interface
`for Laptop Computers
`and Other Portable
`Devices,” and which are incorporated herein byreference in
`their entirety.
`BACKGROUND OF THE INVENTION
`
`[0002] The present invention relates generally to the inter-
`facing with computer and mechanical devices by a user, and
`more particularly to devices used to interface with computer
`systems and electronic devices and which provide haptic
`feedback to the user.
`
`[0003] Humansinterface with electronic and mechanical
`devices in a varicty of applications, and the need for a more
`natural, easy-to-use, and informative interface is a constant
`concern. In the context of the present invention, humans
`interface with computer devicesfor a variety of applications.
`Onesuch applicationis interacting with computer-generated
`environments such as games, simulations, and application
`programs. Computer input devices such as mice and track-
`balls are often used to control a cursor within a graphical
`environment and provide input in these applications.
`
`In someinterface devices, force feedbackortactile
`[0004]
`feedback is also provided to the user, collectively known
`herein as “haptic feedback.” ‘or example, haptic versions of
`joysticks, mice, gamepads, steering wheels, or other types of
`devices can output forces to the user based on events or
`interactions occurring within the graphical environment,
`such as in a gameor other application program.
`[0005]
`In portable computer or electronic devices, such as
`laptop computers, mice typically too large a workspace to be
`practical. As a result, more compact devices such as track-
`balls are often used. Currently, a more popular device for
`portable computers are “touchpads,” which are small rect-
`angular, planar pads provided near the keyboard of the
`computer. The touchpad senses the location of a pointing
`object by any of a variety of sensing technologies, such as
`capacitive sensors or pressure sensors that detect pressure
`applied to the touchpad. The user contacts the touchpad most
`commonly with a fingertip and moveshisorherfinger on the
`pad to move a cursor displayed in the graphical environ-
`ment. In other embodiments, the user can operate a stylus in
`conjunction with the touchpad by pressing the stylus tip on
`the touchpad and movingthe stylus.
`[0006] One problem with existing touchpadsis that there
`is no haptic feedback provided to the user. The user of a
`touchpad is therefore not able to experience haptic sensa-
`tions that assist and inform the user of targeting and other
`control tasks within the graphical environment. The touch-
`pads of the prior art also cannot take advantage of existing
`haptic-enabled software run on the portable computer.
`SUMMARYOF THE INVENTION
`
`[0007] The present invention is directed to a haptic feed-
`back planar touch control used to provide input to a com-
`
`puter system. The control can be a touchpad provided on a
`portable computer, or can be a touch screen found on a
`variety of devices. The haptic sensations output on the touch
`control enhance interactions and manipulations in a dis-
`played graphical environment or when controlling an elec-
`tronic device.
`
`[0008] More specifically, the present invention relates to a
`haptic feedback touch control for inputting signals to a
`computer and for outputting forces to a user of the touch
`control. The control includes a touch input device including
`an approximately planar touch surface operative to input a
`position signal to a processor of said computer based on a
`location of user contact on the touch surface. One or more
`
`actuators are coupled to the touch input device which can
`output a force to laterally move the touch input device
`approximately parallel to its surface to provide a haptic
`sensation to the user contacting it. The computer can posi-
`tion a cursor in a graphical environment displayed on a
`display device based on the position signal. The touch input
`device can be a separate touchpad or included as a touch
`screen. The user can contact the touch surface with a finger
`or other object, such as a stylus. Two actuators can move the
`touch input device in orthogonal directions parallel to the
`touch surface.
`
`In another embodiment, a haptic feedback touch
`[0009]
`control for inputting signals to a computerand for outputting
`forces to a user includes a touch input device including an
`approximately planar touch surface which inputs a position
`signal to a computer processor, a surface member located
`adjacent
`to the touch input device, where the user can
`contact the surface when pressing the touch input device,
`and an actuator coupled to the surface member. The actuator
`outputs a force on the surface member to provide a haptic
`sensation to the user. The surface membercan betranslated
`laterally, approximately in a plane parallel to the surface of
`the touch input device; for example, the surface member can
`be positioned over the touch input device and approximately
`coextensive with the surface of the touch input device. Or,
`the surface member can be positioned to a side of the touch
`input device such that the user touches the touch input
`device with one finger and touches the surface member with
`a differentfinger or palm. For cxamplc, the surface member
`can be positioned over a physical button that is located
`adjacent to said touch input device. Contactorinertial forces
`can be output on the surface member.
`
`invention, an
`In another aspect of the present
`{0010]
`actuator providing a linear force output includes a ferro-
`magnetic piece including a center pole located between two
`side poles, a coil wrapped around the center pole, a magnet
`adjacent to the center pole and side poles, and a backing
`plate coupled to the magnet, where the backing plate and
`magnet move with respect to the ferromagnetic piece when
`current is flowed in the coil. Rollers can be positioned
`between the ferromagnetic piece and backing plate to allow
`the motion. A flexure can reducethe relative motion between
`
`plate and ferromagnetic piece in undesired directions and
`provide a spring centering force.
`
`In another aspect, a haptic touch device includes a
`[0011]
`piezoelectric transducer coupled to a ground and including
`a metal diaphragm coupled to a ceramic element and a
`planar sensing element, such as a touchpad. A spacer is
`provided between the piezoelectric transducer and the planar
`
`

`

`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`sensing element, the metal diaphragm contacting the spacer.
`A spring element provides a spring restoring force to the
`planar sensing element.
`
`[0024] FIG. 9 is a perspective viewof one embodimentof
`a translating surface memberdriven by linear actuators;
`
`[0025] FIG. 10 is a top plan view of another embodiment
`of a translating surface memberdriven by a rotary actuator;
`
`[0026] FIG. 11 is a perspective view of another embodi-
`mentof a translating surface memberdriven by a voice coil
`actuator;
`
`a
`invention,
`In another aspect of the present
`{0012]
`method for providing haptic feedback to a touch input
`device includes receiving a position signal from the touch
`input device indicating a contact location on a surface where
`said useris pressing, and determining in which of a plurality
`of regions on the surface the contact location is positioned.
`Force information is provided to cause an actuator to output
`a force to the user, the force associated with the user moving
`an object on or over the surface of the touch input device. A
`function can be associated with the region in which the
`contact location is positioned, such as rate control function
`of a value or moving a displayed cursor. The can be output
`when the user moves the object over a boundary to the
`[0030] FIGS. 15a and 15b are perspective viewsofafirst
`contacted region from a different region of the touch input
`embodimentofa flat E-core actuator of the present invention
`device.
`suitable for translating a touchpad or a separate surface;
`
`(0027] FIG. 12 is a perspective view of an embodiment of
`a translating surface adjacent to a touchpad;
`
`[0028] FIG. 13is a perspective view of an embodimentof
`a touchpadtranslated in one direction by a rotary actuator;
`
`[0029] FIG. 14 is a perspective view of an embodimentof
`a touchpadtranslated in two directions by rotary actuators;
`
`invention advantageously provides
`[0013] The present
`haptic feedback to a planar touch control device of a
`computer, such as a touchpad or touch screen. The haptic
`feedback can assist and inform the user of interactions and
`
`events within a graphical user interface or other environment
`and ease cursor targeting tasks. Furthermore, the invention
`allows portable computer devices having such touch con-
`trols to take advantage of existing haptic feedback enabled
`software. The haptic touch devices disclosed herein are also
`inexpensive, compact and consume low power, allowing
`them to be easily incorporated into a wide variety of portable
`and desktop computers and electronic devices.
`
`[0014] These and other advantages of the present inven-
`tion will become apparent to those skilled in the art upon a
`reading of the following specification of the invention and a
`study of the several figures of the drawing.
`
`[0031] FIG. 15c is a side view of the actuator of FIGS.
`15a-15b;
`
`[0032] FIG. 15d is a perspective view of the actuator of
`FIGS. 15a-15b coupled to a touchpad;
`
`[0033] FIGS. 16a and 16b are top and bottom perspective
`views of another embodimentof a flat E-core actuator of the
`
`present invention;
`
`[0034] FIGS. 17a-17b are perspective and top views of
`surface-mounted E-core actuators of the present invention;
`
`[0035] FIGS. 17c-17g are perspective and side views of
`the E-core actuators of FIGS. 17a-17b; and
`
`[0036] FIG. 18 is a top plan view of an example of a
`haptic touchpad of the present invention having different
`control regions.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENTS
`[0015] FIG.1is a perspective view of a laptop computer
`device including a haptic touchpad of the present invention;
`
`[0037] FIG. 1 isa perspective view of a portable computer
`10 including a haptic touchpad of the present invention.
`Computer 10 can be a portable or “laptop” computer that can
`be carried or otherwise transported by the user and may be
`powered by batteries or other portable energy source in
`addition to other more stationary power sources. Computer
`10 preferably runs one or more host application programs
`with which a user is interacting via peripherals.
`[0019] FIG.5is a perspective view of one embodiment of
`[0038] Computer 10 may include the various input and
`an actuator assembly suitable for use in an inertial embodi-
`output devices as shown, including a display device 12 for
`ment of the present invention;
`outputting graphical images to the user, a keyboard 14 for
`providing character or toggle input from the user to the
`computer, and a touchpad 16 of the present
`invention.
`Display device 12 can be anyof a variety of types of display
`devices; flat-panel displays are most common on portable
`computers. Display device 12 can display a graphical envi-
`ronment 18 based on application programs and/or operating
`systems thal are running on the CPU of computer 10, such
`as a graphical user interface (GUI), that can include a cursor
`20 that can be moved byuser input, as well as windows 22,
`icons 24, and other graphical objects well known in GUI
`environments. Other graphical environments or images may
`also be displayed, e.g. a game, movie or other presentation,
`spreadsheet or other application program,etc.
`
`[0016] FIG. 2 is a perspective view of a remote control
`device including a touchpad of the present invention;
`
`[0017] FIG. 3 is a top plan view of a haptic touchscreen
`embodiment of the present invention;
`
`[0018] FIG. 4 is a block diagram of a haptic system
`suitable for usc in the present invention;
`
`[0020] FIG.6 is a perspective view of the actuator assem-
`bly of FIG. 5 coupled to a touchpad;
`
`[0021] FIG. 7 is a perspective view of a separate palm
`surface providing inertial tactile sensations adjacent to a
`touchpad;
`
`[0022] FIG. 8a is a perspective view of a piezoelectric
`transducer suitable for use in providing inertial sensations in
`the present invention;
`
`[0023] FIG. 8b isa side elevational view ofa piezoelectric
`transducer and structure of the present invention suitable for
`providing haptic sensations with a touch device;
`
`

`

`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`the cursor is moved a
`her finger quickly across the pad,
`greater distance than if the user moves the fingertip more
`slowly. If the user’s finger reaches the edge of the touchpad
`before the cursor reaches a desired destination in that
`
`[0039] Other devices may also be incorporated or coupled
`to the computer 10, suchas storage devices (hard disk drive,
`DVD-ROM drive, etc.), network server or clients, game
`controllers, etc. In alternate embodiments, the computer 10
`can take a wide variety of forms,
`including computing
`devices that rest on a tabletop or other surface, stand-up
`arcade game machines, other portable devices or devices
`worn on the person, handheld or used with a single hand of
`the user, etc. For example, host computer 10 can be a video
`game console, personal computer, workstation, a television
`“set top box” or a “network computer”, or other computing
`or electronic device.
`
`direction, then the user can simply movehis or her finger off
`the touchpad, reposition the finger away from the edge, and
`continue moving the cursor. This is an “indexing” function
`similar to lifting a mouse off a surface to change the offset
`between mouse position and cursor. Furthermore, many
`touchpads can be provided with particular regions that are
`each assignedto particular functions that can be unrelated to
`cursor positioning. Such an embodiment is described in
`greater detail below with respect
`to FIG. 18.
`In some
`[0040] Touchpad device 16 of the present invention pref-
`embodiments the touchpad 16 mayalso allow a userto “tap”
`erably appears externally to be similar to the touchpads of
`the touchpad (rapidly touch and removethe object from the
`the prior art. In many embodiments disclosed herein, such a
`pad) in a particular location to provide a command. Tor
`pad 16 includesaplanar, rectangular smooth surface that can
`example, the user can tap or “double tap” the pad with a
`be positioned below the keyboard 14 on the housing of the
`finger while the controlled cursor is over an icon to select
`computer 10, as shown, or may be positioned at other areas
`that icon.
`of the housing. When the user operates the computer 10, the
`user may conveniently place a fingertip or other object on
`the touchpad 16 and movethe fingertip to correspondingly
`move cursor 20 in the graphical environment 18.
`
`the touchpad 16 inputs coordinate
`In operation,
`[0041]
`data to the main microprocessor(s) of the computer 10 based
`on the sensedlocation of an object on (or near) the touchpad.
`As with many touchpadsofthe prior art, touchpad 16 can be
`capacitive, resistive, or use a different type of sensing. Some
`existing touchpad embodiments are disclosed, for example,
`in U.S. Pat. Nos. 5,521,336 and 5,943,044. Capacitive
`touchpads typically sense the location of an object on or near
`the surface of the touchpad based on capacitive coupling
`between capacitors in the touchpad and the object. Resistive
`touchpads are typically pressure-sensitive, detecting the
`pressure of a finger, stylus, or other object against the pad,
`where the pressure
`causes conductive layers,
`traces,
`switches, etc.
`in the pad to electrically connect. Some
`resistive or other types of touchpads can detect the amount
`of pressure applied by the user and can use the degree of
`pressure for proportional or variable input to the computer
`10. Resistive touchpads typically are at
`least partially
`deformable, so that when a pressure is applied to a particular
`location, the conductors at that location are brought inta
`electrical contact. Such deformability can be useful in the
`present invention since it can potentially amplify the mag-
`nitude of output forces such as pulses or vibrations on the
`touchpad as used in the present invention. Forces can be
`amplified if a tuned compliant suspension is provided
`between an actuator and the object
`that
`is moved, as
`described in provisional application No. 60/157,206, incor-
`porated herein by reference. Capacitive touchpads and other
`types of touchpads that do not require significant contact
`pressure may be better suited for the present invention in
`some embodiments, since excessive pressure on the touch-
`pad may in some cases interfere with the motion of the
`touchpad for haptic feedback. Other types of sensing tech-
`nologies can also be used in the touchpad. Herein, the term
`“touchpad” preterably includes the surface of the touchpad
`16 as well as any sensing apparatus included in the touchpad
`unit.
`
`[0042] Touchpad 16 can operate similarly to existing
`touchpads, where the speed of the fingertip on the touchpad
`correlates to the distance that the cursor is moved in the
`
`graphical environment. For example, if the user moveshis or
`
`In the present invention, the touchpad 16 is pro-
`[0043]
`vided with the ability to output haptic feedback such as
`tactile sensations to the user whois physically contacting the
`touchpad 16. Various embodiments detailing the structure of
`the haptic feedback touchpad are described in greater detail
`below. Some embodiments may move a device housing or
`separate moving surface, not the touchpad itself.
`[0044] Using one or more actuators coupled to the touch-
`pad 16 or an associated surface, a variety of haptic sensa-
`tions can be output
`to the user who is contacting the
`touchpad (or housing or separate surface). For example,
`jolts, vibrations (varying or constant amplitude), and tex-
`tures can be output. Forces output to the user can beat least
`in part based on the location of the finger on the pad or the
`state of a controlled object in the graphical environment of
`the host computer 10, and/or independentof finger position
`or object state. Such forces output to the user are considered
`“computer-controlled” since a microprocessor or other elec-
`tronic controller is controlling the magnitude and/or direc-
`tion of the force output of the actuator(s) using electronic
`signals.
`the touchpad 16 can be
`In other embodiments,
`[0045]
`provided in a separate housing that is connected to a port of
`the computer 10 via a cable or via wireless transmission and
`which receives force information from and sends position
`information to the computer 10. For example, Universal
`Serial Bus (USB), Firewire, or a standard serial bus can
`connect such a touchpad to the computer 10.
`[0046] One or more buttons 26 can also be provided on the
`housing of the computer 10 to be used in conjunction with
`the touchpad 16. The user’s hands have easy access to the
`buttons, each of which maybepressed by the user to provide
`a distinct input signal to the host computer 12. Typically,
`each button 26 corresponds to a similar button found on a
`mouse input device, so that a left button can be used to select
`a graphical object (click or double click), a right button can
`bring up a context menu,etc. In some embodiments, one or
`more of the buttons 26 can be provided with tactile feedback
`as described in U.S. Pat. No. 6,184,868 and application Ser.
`No. 09/467,309, and both incorporated herein by reference
`in their entirety. Other features of these disclosures may also
`be used with the present invention.
`[0047] Furthermore, in some embodiments, one or more
`moveable portions 28 of the housing of the computer device
`
`

`

`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`10 can be included which is contacted by the user when the
`user operates the touchpad 16 and which can provide haptic
`feedback. Having a moveable portion of a housing for haptic
`feedback is described in U.S. Pat. Nos. 6,184,868 and
`6,088,019, both incorporated herein by reference. In some
`embodiments, both the housing can provide haptic feedback
`(e.g., through the use of an eccentric rotating mass on a
`motor coupled to the housing) and the touchpad 16 can
`provide separate haptic feedback. This can allow the host to
`control two different tactile sensations simultaneouslyto the
`user; for example, a vibration of a low frequency can be
`conveyed through the housing to the user and a higher
`frequency vibration can be conveyedto the user through the
`touchpad 16. Each other button or other control provided
`with haptic feedback can also provide tactile feedback
`independently from the other controls.
`[0048] The host application program(s) and/or operating
`system preferably displays graphical imagesof the environ-
`ment on display device 12. The software and environment
`running on the host computer 12 may be of a wide variety.
`Tor example, the host application program can be a word
`processor, spreadsheet, movie, video or computer game,
`drawing program, operating system, graphical user inter-
`face, simulation, Web page or browser that
`implements
`HTMLor VRMLinstructions, scientific analysis program,
`virtual reality training program or application, or other
`application program that utilizes input from the touchpad 16
`and outputs force feedback commandsto the touchpad 16.
`For example, many gamesandother application programs
`include force feedback functionality and may communicate
`with the touchpad 16 using a standard protocol/drivers such
`as 1-Force®, FEELit®, or Touchsense™available from
`Immersion Corporation of San Jose, Calif.
`[0049] The touchpad 16 can includecircuitry necessary to
`report control signals to the microprocessor of the host
`computer 10 and to process command signals from the
`host’s microprocessor. For example, appropriate sensors
`(and related circuitry) are used to report the position of the
`user’s finger on the touchpad 16. The touchpad device also
`includes circuitry that receives signals from the host and
`outputs tactile sensations in accordance with the host signals
`using one or more actuators. Some touchpads may be
`integrated with a printed circuit board (PCB) that includes
`some of these components and circuitry. In some embodi-
`ments, a separate, local microprocessor can be provided for
`the touchpad 16 to both report touchpad sensor data to the
`host and/or to carry out force commands received from the
`host, such commands including, for example, the type of
`haptic sensation and parameters describing the commanded
`haptic sensation. Alternatively, the touchpad microprocessor
`can simply pass streamed data from the main processor to
`the actuators. The term “force information” can include both
`commands/parameters and/or streamed data. The touchpad
`microprocessor can implement haptic sensations indepen-
`dently after receiving a host command bycontrolling the
`touchpad actuators; or, the host processor can maintain a
`greater degree of control over the haptic sensations by
`controlling the actuators more directly. In other embodi-
`ments, logic circuitry such as state machines provided for
`the touchpad 16 can handle haptic sensations as directed by
`the host main processor. Architectures and control methods
`that can be used for reading sensor signals and providing
`haptic feedback for a device are described in greater detail
`in US. Pat. No. 5,734,373 and copending application Nos.
`
`09/669,029, 09/565,207, 09/376,649, and 09/687,744, all
`incorporated herein by reference in their entirety.
`
`In existing touchpad embodiments, such as those
`[0050]
`manufactured by Synaptics Corp., particular characteristics
`and features are provided. The standard surface material for
`a touchpad is textured Mylar, and typically any non-con-
`ductive object can be used on the touchpad surface and be
`detected, though textured surfaces are better when a user’s
`finger is used to point. The touchpad can also sense through
`thin overlays. There is typically space available for the
`additional of haptic feedback components; for example, on
`a 40x60 touchpad,overhalf of the board can be available for
`haptic circuitry.
`
`[0051] Many touchpads include a “palm check”feature,
`which allows the laptop to sense whether the user is con-
`tacting the touchpad with a finger or with a palm or other
`part of the hand. Since the user mayonly be resting his or
`her palm and not be intending to provide input, the palm
`check feature would ignore input that is determined to be
`provided bya user’s palm. Basically, the palm check feature
`computes the contact area made by the conductive object
`(finger, palm,arm,etc.). If the contact area exceeds a certain
`threshold, the contact is rejected. This feature can be turned
`off in many embodiments.
`
`[0052] FIG. 2 is a perspective view of another embodi-
`ment of a device 30 which can include the active touchpad
`16 of the present invention. The device can be a handheld
`remote control device 30, which the user grasps in one hand
`and manipulates controls to access the functions of ano
`electronic device or appliance remotely by a user (such as a
`television, video cassette recorder or DVD player, audio/
`video receiver, Internet or network computer connected to a
`television, etc.). Kor example, several buttons 32 can be
`included on the remote control device 30 to manipulate
`functionsof the controlled apparatus. A touchpad 16 can also
`be provided to allow the user to provide more sophisticated
`directional input. For example, a controlled apparatus may
`have a selection serecn in which a cursor may be moved,and
`the touchpad 16 can be manipulated to control the cursor in
`two dimensions. The touchpad 16 includes the ability to
`output haptic sensations to the user as described herein,
`based on a controlled value or event. For example, a volume
`level passing a mid-point or reaching a maximum level can
`cause a pulse to be output to the touchpad andto the user.
`
`In one application, the controlled apparatus can be
`[0053]
`a computer system such as Web-TV from Microsoft Corp. or
`other computing device which displays a graphical user
`interface and/or web pages accessed over a network such as
`the Internet. The user can control the direction of the cursor
`by movinga finger(or other object) on the touchpad 16. The
`cursor can be used to select and/or manipulate icons, win-
`dows, menu items, graphical buttons, slider bars,scroll bars,
`or other graphical objects in a graphical user interface or
`desktop interface. The cursor can also be used to select
`and/or manipulate graphical objects on a web page, such as
`links, images,buttons, etc. Other force sensations associated
`with graphical objects are described below with reference to
`FIG. 18.
`
`[0054] FIG. 3 is a top plan view of another computer
`device embodiment 50 that can include any of the embodi-
`ments of haptic devices of the present invention. Device 50
`is in the form of a portable computer device such as
`
`

`

`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`“personal digital assistant” (PDA), a “pen-based” computer,
`“web pad,”“electronic book”, or similar device(collectively
`knownas a “personal digital assistant” (PDA) herein). Those
`devices which allow a user to input information by touching
`a display screen or readout in some fashion are relevant to
`the present invention, as well as devices allowing button
`input. Such devices can include the Palm Pilot from 3Com
`Corp. or similar products, pocket-sized computer devices
`from Casio, Hewlett-Packard, or other manufacturers,
`E-books, cellular phones or pagers having touch screens,
`laptop computers with touch screens, etc.
`
`In one embodimentof a device 50, a display screen
`[0055]
`52 positioned adjacent a housing 54 may cover a large
`portion of the surface of the computer device 50. Screen 52
`is preferably a flat-panel display as is well known to those
`skilled in the art and can display text, images, animations,
`etc.; in some embodiments screen 52 is as functional as any
`personal computer screen. Display screen 52 can be a “touch
`screen” that includes sensors which allow the user to input
`information to the computer device 50 by physically con-
`tacting the screen 50(i.e. it is another form ofplanar “touch
`device” similar to the touchpad 16 of FIG. 1). For example,
`a transparent sensor film can be overlaid on the screen 50,
`wherethe film can detect pressure from an object contacting
`the film. The sensor devices for implementing touch screens
`are well known