111111
`
`(19) United States
`(12) Patent Application Publication
`Shahoian et al.
`
`11111111111111111111111111111111111111111111111111111111111111
`US 20020033795Al
`
`(10) Pub. No.: US 2002/0033795 Al
`Mar. 21, 2002
`(43) Pub. Date:
`
`(54) HAPTIC INTERFACE FOR LAPTOP
`COMPUTERS AND OTHER PORTABLE
`DEVICES
`
`(76)
`
`Inventors: Erik J. Shahoian, San Ramon, CA
`(US); Bruce M. Schena, Menlo Park,
`CA (US); Louis B. Rosenberg, San
`Jose, CA (US)
`
`Correspondence Address:
`James R. Riegel
`801 Fox Lane
`San Jose, CA 95131 (US)
`
`(21)
`
`Appl. No.:
`
`09/917,263
`
`(22)
`
`Filed:
`
`Jul. 26, 2001
`
`Related U.S. Application Data
`
`(63)
`
`Continuation-in-part of application No. 09/487,737,
`filed on Jan. 19, 2000, which is a non-provisional of
`
`provisional application No. 60/274,444, filed on Mar.
`9, 2001.
`
`Publication Classification
`
`Int. Cl? ....................................................... G09G 5/00
`(51)
`(52) U.S. Cl. .............................................................. 345/156
`ABSTRACT
`(57)
`A haptic feedback touch control used to provide input to a
`computer. A touch input device includes a planar touch
`surface that provides position information to a computer
`based on a location of user contact. The computer can
`position a cursor in a displayed graphical environment based
`at least in part on the position information, or perform a
`different function. At least one actuator is also coupled to the
`touch input device and outputs a force to provide a haptic
`sensation to the user. The actuator can move the touchpad
`laterally, or a separate surface member can be actuated. A fiat
`E-core actuator, piezoelectric actuator, or other types of
`actuators can be used to provide forces. The touch input
`device can include multiple different regions to control
`different computer functions.
`
`10
`\
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 1
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 1 of 18
`
`US 2002/0033795 A1
`
`lO
`~
`
`12
`
`I~
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 2
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 2 of 18
`
`US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 3
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 3 of 18
`
`US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 4
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 4 of 18
`
`US 2002/0033795 A1
`
`r-----------------------------~
`
`HOST COMPUTER SYSTEM 14
`
`SYSTEM
`CLOCK
`102
`
`AUDIO OUTPUT
`DEVICE
`104
`
`HOST
`PROCESSOR 1-r----+1
`100
`
`DISPLAY
`DEVICE
`26
`
`A
`
`•
`
`20 "-/"'
`
`~--------
`
`---------T--------------------
`1
`~--------------------I
`----------------------~----
`HAPTIC FEEDBACK
`I
`INTERFACE DEVICE 12.
`. . . - - - - -1 - - - - - , _
`SENSOR
`LOCAL
`,_. MICROPROCESSOR ........ 1-1INTERFACE ~ SENSORS
`ill
`ill
`ill
`
`!
`
`i I
`
`CLOCK
`124
`
`-
`
`OUTPUT
`INPUT
`ill
`
`HOUSING OR
`MANIPULANDUM
`
`MEMORY
`122
`
`r
`l
`ACTUATOR
`INTERFACE 1------+~ ACTUATOR
`18
`11Q
`
`POWER
`SUPPLY
`120
`
`FIG. 4
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 5
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 5 of 18
`
`US 2002/0033795 A1
`
`..0
`~ -J'---:;:;~,.,....>.---l
`
`1..(')
`1..(')
`
`.--
`
`<(----
`
`0 co
`
`X
`
`(.9
`LL.
`
`N c.o
`.--
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 6
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 6 of 18
`
`US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 7
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 7 of 18
`
`US 2002/0033795 A1
`
`/
`- - - - t
`-)
`
`/
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 8
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 8 of 18
`
`US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 9
`
`

`
`P a t e n t A p p l i c a t i o n P u b l i c a t i o n M a r . 21,211112 S h e e t 9 o f 18
`
`US 2 0 0 2 1 0 0 3 3 7 9 5 A l
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 10
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 10 of 18 US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 11
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 11 of 18
`
`US 2002/0033795 A1
`
`I
`I
`l
`
`---- - - -
`
`5'77
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 12
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 12 of 18 US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 13
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 13 of 18 US 2002/0033795 A1
`
`g
`\"")
`-~
`
`~
`()
`
`en
`\
`~7 \
`
`'-..51
`~
`
`'
`
`/
`
`/'
`
`tt;
`rJ>
`
`(,';-
`p<J
`M
`
`\ ,'
`\
`
`~
`
`0
`...._g
`
`-"
`~
`\j_
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 14
`
`

`
`Patent Application Publication Mar. 21,2002 Sheet 14 of 18 US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 15
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 15 of 18 US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 16
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 16 of 18 US 2002/0033795 A1
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 17
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 17 of 18 US 2002/0033795 A1
`
`4Lfo
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 18
`
`

`
`Patent Application Publication Mar. 21, 2002 Sheet 18 of 18 US 2002/0033795 A1
`
`/\
`l
`~ 1
`
`--
`
`r,
`
`r
`
`t
`
`,
`l
`
`'
`\
`l
`
`(
`
`l -=--
`
`"
`•·
`
`I '
`'
`.f-..L}-~,
`
`45Z
`
`~
`
`,J
`
`I
`
`~
`
`L---
`
`/
`::' ~
`\,
`' ?-'
`l
`
`"'-
`
`--
`
`4
`
`-;" ,_,
`.. ..... ~
`.::::., ...
`.,
`-·
`·" ~
`
`,. .....
`c~ ~;-
`•'
`
`•'
`~:::.-..
`'-'
`
`)
`
`(
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 19
`
`

`
`US 2002/0033795 A1
`
`Mar. 21, 2002
`
`1
`
`HAPTIC INTERFACE FOR LAPTOP COMPUTERS
`AND OTHER PORTABLE DEVICES
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`[0001] This application is a continuation-in-part of co(cid:173)
`pending U.S. patent application Ser. No. 09/487,737,
`entitled "Haptic Feedback for Touchpads and Other Touch
`Controls," filed Jan. 19, 2000 by Rosenberg et al., and this
`application claims the benefit of U.S. Provisional Applica(cid:173)
`tion No. 60/274,444, filed Mar. 9, 2001, entitled, "Haptic
`Interface
`for Laptop Computers and Other Portable
`Devices," and which are incorporated herein by reference in
`their entirety.
`
`BACKGROUND OF THE INVENTION
`[0002] The present invention relates generally to the inter(cid:173)
`facing with computer and mechanical devices by a user, and
`more particularly to devices used to interface with computer
`systems and electronic devices and which provide haptic
`feedback to the user.
`[0003] Humans interface with electronic and mechanical
`devices in a variety of applications, and the need for a more
`natural, easy-to-use, and informative interface is a constant
`concern. In the context of the present invention, humans
`interface with computer devices for a variety of applications.
`One such application is interacting with computer-generated
`environments such as games, simulations, and application
`programs. Computer input devices such as mice and track(cid:173)
`balls are often used to control a cursor within a graphical
`environment and provide input in these applications.
`[0004]
`In some interface devices, force feedback or tactile
`feedback is also provided to the user, collectively known
`herein as "haptic feedback." For example, haptic versions of
`joysticks, mice, gamepads, steering wheels, or other types of
`devices can output forces to the user based on events or
`interactions occurring within the graphical environment,
`such as in a game or other application program.
`[0005]
`In portable computer or electronic devices, such as
`laptop computers, mice typically too large a workspace to be
`practical. As a result, more compact devices such as track(cid:173)
`balls are often used. Currently, a more popular device for
`portable computers are "touchpads," which are small rect(cid:173)
`angular, planar pads provided near the keyboard of the
`computer. The touchpad senses the location of a pointing
`object by any of a variety of sensing technologies, such as
`capacitive sensors or pressure sensors that detect pressure
`applied to the touchpad. The user contacts the touchpad most
`commonly with a fingertip and moves his or her finger on the
`pad to move a cursor displayed in the graphical environ(cid:173)
`ment. In other embodiments, the user can operate a stylus in
`conjunction with the touchpad by pressing the stylus tip on
`the touchpad and moving the stylus.
`[0006] One problem with existing touchpads is that there
`is no haptic feedback provided to the user. The user of a
`touchpad is therefore not able to experience haptic sensa(cid:173)
`tions that assist and inform the user of targeting and other
`control tasks within the graphical environment. The touch(cid:173)
`pads of the prior art also cannot take advantage of existing
`haptic-enabled software run on the portable computer.
`
`SUMMARY OF THE INVENTION
`[0007] The present invention is directed to a haptic feed(cid:173)
`back planar touch control used to provide input to a com-
`
`puter system. The control can be a touchpad provided on a
`portable computer, or can be a touch screen found on a
`variety of devices. The haptic sensations output on the touch
`control enhance interactions and manipulations in a dis(cid:173)
`played graphical environment or when controlling an elec(cid:173)
`tronic device.
`
`[0008] More specifically, the present invention relates to a
`haptic feedback touch control for inputting signals to a
`computer and for outputting forces to a user of the touch
`control. The control includes a touch input device including
`an approximately planar touch surface operative to input a
`position signal to a processor of said computer based on a
`location of user contact on the touch surface. One or more
`actuators are coupled to the touch input device which can
`output a force to laterally move the touch input device
`approximately parallel to its surface to provide a haptic
`sensation to the user contacting it. The computer can posi(cid:173)
`tion a cursor in a graphical environment displayed on a
`display device based on the position signal. The touch input
`device can be a separate touchpad or included as a touch
`screen. The user can contact the touch surface with a finger
`or other object, such as a stylus. Two actuators can move the
`touch input device in orthogonal directions parallel to the
`touch surface.
`
`[0009]
`In another embodiment, a haptic feedback touch
`control for inputting signals to a computer and for outputting
`forces to a user includes a touch input device including an
`approximately planar touch surface which inputs a position
`signal to a computer processor, a surface member located
`adjacent to the touch input device, where the user can
`contact the surface when pressing the touch input device,
`and an actuator coupled to the surface member. The actuator
`outputs a force on the surface member to provide a haptic
`sensation to the user. The surface member can be translated
`laterally, approximately in a plane parallel to the surface of
`the touch input device; for example, the surface member can
`be positioned over the touch input device and approximately
`coextensive with the surface of the touch input device. Or,
`the surface member can be positioned to a side of the touch
`input device such that the user touches the touch input
`device with one finger and touches the surface member with
`a different finger or palm. For example, the surface member
`can be positioned over a physical button that is located
`adjacent to said touch input device. Contact or inertial forces
`can be output on the surface member.
`
`[0010]
`In another aspect of the present invention, an
`actuator providing a linear force output includes a ferro(cid:173)
`magnetic piece including a center pole located between two
`side poles, a coil wrapped around the center pole, a magnet
`adjacent to the center pole and side poles, and a backing
`plate coupled to the magnet, where the backing plate and
`magnet move with respect to the ferromagnetic piece when
`current is flowed in the coil. Rollers can be positioned
`between the ferromagnetic piece and backing plate to allow
`the motion. A flexure can reduce the relative motion between
`plate and ferromagnetic piece in undesired directions and
`provide a spring centering force.
`
`[0011]
`In another aspect, a haptic touch device includes a
`piezoelectric transducer coupled to a ground and including
`a metal diaphragm coupled to a ceramic element and a
`planar sensing element, such as a touchpad. A spacer is
`provided between the piezoelectric transducer and the planar
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 20
`
`

`
`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`2
`
`sensing element, the metal diaphragm contacting the spacer.
`A spring element provides a spring restoring force to the
`planar sensing element.
`
`[0012]
`In another aspect of the present invention, a
`method for providing haptic feedback to a touch input
`device includes receiving a position signal from the touch
`input device indicating a contact location on a surface where
`said user is pressing, and determining in which of a plurality
`of regions on the surface the contact location is positioned.
`Force information is provided to cause an actuator to output
`a force to the user, the force associated with the user moving
`an object on or over the surface of the touch input device. A
`function can be associated with the region in which the
`contact location is positioned, such as rate control function
`of a value or moving a displayed cursor. The can be output
`when the user moves the object over a boundary to the
`contacted region from a different region of the touch input
`device.
`
`[0013] The present invention advantageously provides
`haptic feedback to a planar touch control device of a
`computer, such as a touchpad or touch screen. The haptic
`feedback can assist and inform the user of interactions and
`events within a graphical user interface or other environment
`and ease cursor targeting tasks. Furthermore, the invention
`allows portable computer devices having such touch con(cid:173)
`trols to take advantage of existing haptic feedback enabled
`software. The haptic touch devices disclosed herein are also
`inexpensive, compact and consume low power, allowing
`them to be easily incorporated into a wide variety of portable
`and desktop computers and electronic devices.
`
`[0014] These and other advantages of the present inven(cid:173)
`tion will become apparent to those skilled in the art upon a
`reading of the following specification of the invention and a
`study of the several figures of the drawing.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0015] FIG. 1 is a perspective view of a laptop computer
`device including a haptic touchpad of the present invention;
`
`[0016] FIG. 2 is a perspective view of a remote control
`device including a touchpad of the present invention;
`
`[0017] FIG. 3 is a top plan view of a haptic touchscreen
`embodiment of the present invention;
`
`[0018] FIG. 4 is a block diagram of a haptic system
`suitable for use in the present invention;
`
`[0019] FIG. 5 is a perspective view of one embodiment of
`an actuator assembly suitable for use in an inertial embodi(cid:173)
`ment of the present invention;
`
`[0020] FIG. 6 is a perspective view of the actuator assem(cid:173)
`bly of FIG. 5 coupled to a touchpad;
`
`[0021] FIG. 7 is a perspective view of a separate palm
`surface providing inertial tactile sensations adjacent to a
`touchpad;
`
`[0022] FIG. Sa is a perspective view of a piezoelectric
`transducer suitable for use in providing inertial sensations in
`the present invention;
`
`[0023] FIG. Sb is a side elevational view of a piezoelectric
`transducer and structure of the present invention suitable for
`providing haptic sensations with a touch device;
`
`[0024] FIG. 9 is a perspective view of one embodiment of
`a translating surface member driven by linear actuators;
`
`[0025] FIG. 10 is a top plan view of another embodiment
`of a translating surface member driven by a rotary actuator;
`
`[0026] FIG. 11 is a perspective view of another embodi(cid:173)
`ment of a translating surface member driven by a voice coil
`actuator;
`
`[0027] FIG. 12 is a perspective view of an embodiment of
`a translating surface adjacent to a touchpad;
`
`[0028] FIG. 13 is a perspective view of an embodiment of
`a touchpad translated in one direction by a rotary actuator;
`
`[0029] FIG. 14 is a perspective view of an embodiment of
`a touchpad translated in two directions by rotary actuators;
`
`[0030] FIGS. 15a and 15b are perspective views of a first
`embodiment of a fiat E-core actuator of the present invention
`suitable for translating a touchpad or a separate surface;
`
`[0031] FIG. 15c is a side view of the actuator of FIGS.
`15a-15b;
`
`[0032] FIG. 15d is a perspective view of the actuator of
`FIGS. 15a-15b coupled to a touchpad;
`
`[0033] FIGS. 16a and 16b are top and bottom perspective
`views of another embodiment of a fiat E-core actuator of the
`present invention;
`
`[0034] FIGS. 17a-17b are perspective and top views of
`surface-mounted E-core actuators of the present invention;
`
`[0035] FIGS. 17c-17g are perspective and side views of
`theE-core actuators of FIGS. 17a-17b; and
`
`[0036] FIG. 18 is a top plan view of an example of a
`haptic touchpad of the present invention having different
`control regions.
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENTS
`
`[0037] FIG. 1 is a perspective view of a portable computer
`10 including a haptic touchpad of the present invention.
`Computer 10 can be a portable or "laptop" computer that can
`be carried or otherwise transported by the user and may be
`powered by batteries or other portable energy source in
`addition to other more stationary power sources. Computer
`10 preferably runs one or more host application programs
`with which a user is interacting via peripherals.
`
`[0038] Computer 10 may include the various input and
`output devices as shown, including a display device 12 for
`outputting graphical images to the user, a keyboard 14 for
`providing character or toggle input from the user to the
`computer, and a touchpad 16 of the present invention.
`Display device 12 can be any of a variety of types of display
`devices; fiat-panel displays are most common on portable
`computers. Display device 12 can display a graphical envi(cid:173)
`ronment 18 based on application programs and/or operating
`systems that are running on the CPU of computer 10, such
`as a graphical user interface (GUI), that can include a cursor
`20 that can be moved by user input, as well as windows 22,
`icons 24, and other graphical objects well known in GUI
`environments. Other graphical environments or images may
`also be displayed, e.g. a game, movie or other presentation,
`spreadsheet or other application program, etc.
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 21
`
`

`
`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`3
`
`[0039] Other devices may also be incorporated or coupled
`to the computer 10, such as storage devices (hard disk drive,
`DVD-ROM drive, etc.), network server or clients, game
`controllers, etc. In alternate embodiments, the computer 10
`can take a wide variety of forms, including computing
`devices that rest on a tabletop or other surface, stand-up
`arcade game machines, other portable devices or devices
`worn on the person, handheld or used with a single hand of
`the user, etc. For example, host computer 10 can be a video
`game console, personal computer, workstation, a television
`"set top box" or a "network computer", or other computing
`or electronic device.
`[0040] Touchpad device 16 of the present invention pref(cid:173)
`erably appears externally to be similar to the touchpads of
`the prior art. In many embodiments disclosed herein, such a
`pad 16 includes a planar, rectangular smooth surface that can
`be positioned below the keyboard 14 on the housing of the
`computer 10, as shown, or may be positioned at other areas
`of the housing. When the user operates the computer 10, the
`user may conveniently place a fingertip or other object on
`the touchpad 16 and move the fingertip to correspondingly
`move cursor 20 in the graphical environment 18.
`
`In operation, the touchpad 16 inputs coordinate
`[0041]
`data to the main microprocessor(s) of the computer 10 based
`on the sensed location of an object on (or near) the touchpad.
`As with many touchpads of the prior art, touchpad 16 can be
`capacitive, resistive, or use a different type of sensing. Some
`existing touchpad embodiments are disclosed, for example,
`in U.S. Pat. Nos. 5,521,336 and 5,943,044. Capacitive
`touchpads typically sense the location of an object on or near
`the surface of the touchpad based on capacitive coupling
`between capacitors in the touchpad and the object. Resistive
`touchpads are typically pressure-sensitive, detecting the
`pressure of a finger, stylus, or other object against the pad,
`where
`the pressure causes conductive
`layers,
`traces,
`switches, etc. in the pad to electrically connect. Some
`resistive or other types of touchpads can detect the amount
`of pressure applied by the user and can use the degree of
`pressure for proportional or variable input to the computer
`10. Resistive touchpads typically are at least partially
`deformable, so that when a pressure is applied to a particular
`location, the conductors at that location are brought into
`electrical contact. Such deformability can be useful in the
`present invention since it can potentially amplify the mag(cid:173)
`nitude of output forces such as pulses or vibrations on the
`touchpad as used in the present invention. Forces can be
`amplified if a tuned compliant suspension is provided
`between an actuator and the object that is moved, as
`described in provisional application No. 60/157,206, incor(cid:173)
`porated herein by reference. Capacitive touchpads and other
`types of touchpads that do not require significant contact
`pressure may be better suited for the present invention in
`some embodiments, since excessive pressure on the touch(cid:173)
`pad may in some cases interfere with the motion of the
`touchpad for haptic feedback. Other types of sensing tech(cid:173)
`nologies can also be used in the touchpad. Herein, the term
`"touchpad" preferably includes the surface of the touchpad
`16 as well as any sensing apparatus included in the touchpad
`unit.
`
`[0042] Touchpad 16 can operate similarly to existing
`touchpads, where the speed of the fingertip on the touchpad
`correlates to the distance that the cursor is moved in the
`graphical environment. For example, if the user moves his or
`
`her finger quickly across the pad, the cursor is moved a
`greater distance than if the user moves the fingertip more
`slowly. If the user's finger reaches the edge of the touchpad
`before the cursor reaches a desired destination in that
`direction, then the user can simply move his or her finger off
`the touchpad, reposition the finger away from the edge, and
`continue moving the cursor. This is an "indexing" function
`similar to lifting a mouse off a surface to change the offset
`between mouse position and cursor. Furthermore, many
`touchpads can be provided with particular regions that are
`each assigned to particular functions that can be unrelated to
`cursor positioning. Such an embodiment is described in
`greater detail below with respect to FIG. 18. In some
`embodiments the touchpad 16 may also allow a user to "tap"
`the touchpad (rapidly touch and remove the object from the
`pad) in a particular location to provide a command. For
`example, the user can tap or "double tap" the pad with a
`finger while the controlled cursor is over an icon to select
`that icon.
`[0043]
`In the present invention, the touchpad 16 is pro(cid:173)
`vided with the ability to output haptic feedback such as
`tactile sensations to the user who is physically contacting the
`touchpad 16. Various embodiments detailing the structure of
`the haptic feedback touchpad are described in greater detail
`below. Some embodiments may move a device housing or
`separate moving surface, not the touchpad itself.
`[0044] Using one or more actuators coupled to the touch(cid:173)
`pad 16 or an associated surface, a variety of haptic sensa(cid:173)
`tions can be output to the user who is contacting the
`touchpad (or housing or separate surface). For example,
`jolts, vibrations (varying or constant amplitude), and tex(cid:173)
`tures can be output. Forces output to the user can be at least
`in part based on the location of the finger on the pad or the
`state of a controlled object in the graphical environment of
`the host computer 10, and/or independent of finger position
`or object state. Such forces output to the user are considered
`"computer-controlled" since a microprocessor or other elec(cid:173)
`tronic controller is controlling the magnitude and/or direc(cid:173)
`tion of the force output of the actuator(s) using electronic
`signals.
`In other embodiments, the touchpad 16 can be
`[0045]
`provided in a separate housing that is connected to a port of
`the computer 10 via a cable or via wireless transmission and
`which receives force information from and sends position
`information to the computer 10. For example, Universal
`Serial Bus (USB), Firewire, or a standard serial bus can
`connect such a touchpad to the computer 10.
`[0046] One or more buttons 26 can also be provided on the
`housing of the computer 10 to be used in conjunction with
`the touchpad 16. The user's hands have easy access to the
`buttons, each of which may be pressed by the user to provide
`a distinct input signal to the host computer 12. Typically,
`each button 26 corresponds to a similar button found on a
`mouse input device, so that a left button can be used to select
`a graphical object (click or double click), a right button can
`bring up a context menu, etc. In some embodiments, one or
`more of the buttons 26 can be provided with tactile feedback
`as described in U.S. Pat. No. 6,184,868 and application Ser.
`No. 09/467,309, and both incorporated herein by reference
`in their entirety. Other features of these disclosures may also
`be used with the present invention.
`[0047] Furthermore, in some embodiments, one or more
`moveable portions 28 of the housing of the computer device
`
`APPLE INC.
`EXHIBIT 1004 - PAGE 22
`
`

`
`US 2002/0033795 Al
`
`Mar. 21, 2002
`
`4
`
`10 can be included which is contacted by the user when the
`user operates the touchpad 16 and which can provide haptic
`feedback. Having a moveable portion of a housing for haptic
`feedback is described in U.S. Pat. Nos. 6,184,868 and
`6,088,019, both incorporated herein by reference. In some
`embodiments, both the housing can provide haptic feedback
`(e.g., through the use of an eccentric rotating mass on a
`motor coupled to the housing) and the touchpad 16 can
`provide separate haptic feedback. This can allow the host to
`control two different tactile sensations simultaneously to the
`user; for example, a vibration of a low frequency can be
`conveyed through the housing to the user and a higher
`frequency vibration can be conveyed to the user through the
`touchpad 16. Each other button or other control provided
`with haptic feedback can also provide tactile feedback
`independently from the other controls.
`[0048] The host application program(s) and/or operating
`system preferably displays graphical images of the environ(cid:173)
`ment on display device 12. The software and environment
`running on the host computer 12 may be of a wide variety.
`For example, the host application program can be a word
`processor, spreadsheet, movie, video or computer game,
`drawing program, operating system, graphical user inter(cid:173)
`face, simulation, Web page or browser that implements
`HTML or VRML instructions, scientific analysis program,
`virtual reality training program or application, or other
`application program that utilizes input from the touchpad 16
`and outputs force feedback commands to the touchpad 16.
`For example, many games and other application programs
`include force feedback functionality and may communicate
`with the touchpad 16 using a standard protocol/drivers such
`as 1-Force®, FEELit®, or Touchsense™ available from
`Immersion Corporation of San Jose, Calif.
`[0049] The touchpad 16 can include circuitry necessary to
`report control signals to the microprocessor of the host
`computer 10 and to process command signals from the
`host's microprocessor. For example, appropriate sensors
`(and related circuitry) are used to report the position of the
`user's finger on the touchpad 16. The touchpad device also
`includes circuitry that receives signals from the host and
`outputs tactile sensations in accordance with the host signals
`using one or more actuators. Some touchpads may be
`integrated with a printed circuit board (PCB) that includes
`some of these components and circuitry. In some embodi(cid:173)
`ments, a separate, local microprocessor can be provided for
`the touchpad 16 to both report touchpad sensor data to the
`host and/or to carry out force commands received from the
`host, such commands including, for example, the type of
`haptic sensation and parameters describing the commanded
`haptic sensation. Alternatively, the touchpad microprocessor
`can simply pass streamed data from the main processor to
`the actuators. The term "force information" can include both
`commands/parameters and/or streamed data. The touchpad
`microprocessor can implement haptic sensations indepen(cid:173)
`dently after receiving a host command by controlling the
`touchpad actuators; or, the host processor can maintain a
`greater degree of control over the haptic sensations by
`controlling the actuators more directly. In other embodi(cid:173)
`ments, logic circuitry such as state machines provided for
`the touchpad 16 can handle haptic sensations as directed by
`the host main processor. Architectures and control methods
`that can be used for reading sensor signals and providing
`haptic feedback for a device are described in greater detail
`in U.S. Pat. No. 5,734,373 and copending application Nos.
`
`09!669,029, 09/565,207, 09/376,649, and 09/687,744, all
`incorporated herein by reference in their entirety.
`[0050]
`In existing touchpad embodiments, such as those
`manufactured by Synaptics Corp., particular characteristics
`and features are provided. The standard surface material for
`a touchpad is textured Mylar, and typically any non-con(cid:173)
`ductive object can be used on the touchpad surface and be
`detected, though textured surfaces are better when a user's
`finger is used to point. The touchpad can also sense through
`thin overlays. There is typically space available for the
`additional of haptic feedback components; for example, on
`a 40x60 touchpad, over half of the board can be available for
`haptic circuitry.
`[0051] Many touchpads include a "palm check" feature,
`which allows the laptop to sense whether the user is con(cid:173)
`tacting the touchpad with a finger or with a palm or other
`part of the hand. Since the user may only be resting his or
`her palm and not be intending to provide input, the palm
`check feature would ignore input that is determined to be
`provided by a user's palm. Basically, the palm check feature
`computes the contact area made by the conductive object
`(finger, palm, arm, etc.). If the contact area exceeds a certain
`threshold, the contact is rejected. This feature can be turned
`off in many embodiments.
`[0052] FIG. 2 is a perspective view of another embodi(cid:173)
`ment of a device 30 which can include the active touchpad
`16 of the present invention. The device can be a handheld
`remote control device 30, which the user grasps in one hand
`and manipulates controls to access the functions of an
`electronic device or appliance remotely by a user (such as a
`television, video cassette recorder or DVD player, audio/
`video receiver, Internet or network computer connected to a
`television, etc.). For example, several buttons 32 can be
`included on the remote control device 30 to manipulate
`functions of the controlled apparatus. A touchpad 16 can also
`be provided to allow the user to provide more sophisticated
`directional input. For example, a controlled apparatus may
`have a selection screen in which a cursor may be moved, and
`the touchpad 16 can be manipulated to control the cursor in
`two dimensions. The touchpad 16 includes the ability to
`output haptic sensations to the user as described herein,
`based on a controlled value or event. For example, a volume
`level passing a mid-point or reaching a maximum level can
`cause a pulse to be output to the touchpad and to the user.
`
`[0053]
`In one application, the controlled apparatus can be
`a computer system such as Web-TV from Microsoft Corp. or
`other computing device which displays a graphical user
`interface and/or web pages accessed over a network such as
`the Internet. The user can control the direction of the cursor
`by moving a finger (or other object) on the touchpad 16. The
`cursor can be used to select and/or ma