ge CUee pe
`gon ee
`ary ORS gp yt
`—- &
`Jie AISCS AL ia WV ‘
`+f
`—.
`oh-o1-6
`|
`o> 3
`/
`—J SS
`>=—-*
`PROVISIONAL APPLICATION COVER SHEET
`e ———=—_
`At
`Docket No.: IMM1
`CERTIFICATE OF EXPRESS MAILING
`o>:
`~Secathe that thispaperand thedocuments and/orfees referred to
`torney
`™
`49P
`:
`.
`*
`=meawathed therein are being deposited with the United States Postal
`
`=Seaqupon July 31, 2002 in an envelope as “Express Mail Post Office to
`First Named Inventor: Kenneth M. Martin
`Addressee” service under 37 CFR §1 10, Express Mail No.
`EK860305602US, addressed to the Commissioner for Patents,
`Washington, DC 20231.
`
`;
`
`Paul M. Thyfault
`
`=
`
`Commissioner for Patents
`Box Provisional Patent Application
`Washington, DC 20231
`
`‘Sir:
`
`This isa requestfor filing a PROVISIONAL APPLICATIONunder 37 CFR 1.53(c).
`
`=
`=—
`a
`an —
`ao a
`. =
`aR =o
`223 =r=~
`qa=~,
`wo =r.
`an —_o
`v0 —
`mM
`—=—
`
`INVENTOR(S)/APPLICANT(S)
`
`RESIDENCE(CITY AND
`LAST NAME
` FIRST NAME
`MIDDLEINITIAL
`EITHER STATE OR FOREIGN
`COUNTRY
`
`
`
`
`
`
`
`
`
`
`Los Gatos, CA
`
`
`
`
`
` Redwood City, CA
`
` TITLE OF INVENTION (280 characters max
`
`TACTILE FEEDBACK FOR ELECTRONIC DEVICES
`
`CORRESPONDENCE ADDRESS
`
`
`
`IMMERSION CORPORATION
`801 Fox Lane
`San Jose, CA 95131
`(408) 467-1900
`
`Docket No. IMM149P
`
`1
`
`APPLEINC.
`EXHIBIT 1106 - PAGE 1
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 1
`
`

`

`Saphy eo Tey
`att,
`i
`1
`adhe
`HeaAch 8
`
`von qd
`
`enaa
`se lle HaHo.
`
`ENCLOSED APPLICATION PARTS (checkall that a
`
`Specification, Numberof Pages
`
`14
`
`CI
`
`Small Entity Statement Drawings Numberof Pages
`
`
`
`6 Other (specify): Cover Sheet &
`
`
`
`KY
`
`Provisional Filing Fee Amount ($)160.00
`A check or moneyorderis enclosed to cover the Provisionalfiling fees.
`The commissioner is hereby authorized to charge any additional fees that may be required or credit any overpayment to
`Deposit Account No. 50-1815 (Order No. IMM149P).
`
`At least some of the inventions were made undera contract with an agency of the United States Government.
`
`XJ] No
`
`[TYes, the name of the U.S. Government agency and the contract numberare:
`
`
`Respectfully Submitted,
`
`
`
`SIGNATURELandDh.hagfanGg—DATE 7/31/02
`
`TYPED NAME
`
`Paul M. Thyfault
`
`REGISTRATION NO. 40,204
`
`PROVISIONAL APPLICATION FILING ONLY
`
`Docket No. IMM149P
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 2
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 2
`
`

`

`34
`aasees
`#
`5t
`-
`ag
`TIT ge
`he,
`ar
`featl OG Loe page ES a
`Vieath ts add ge ete ee ae Ae
`
`va
`whe
`
`~ oygoof
`nat Aha
`
`“logtha 4b
`
`TACTILE FEEDBACK FOR ELECTRONIC DEVICES
`
`BY INVENTORS
`
`Kenneth M. Martin
`Alex S. Goldenberg
`Alex Jasso
`Steven P. Vassallo
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates generally to computer interface devices
`
`that allow the user to experience haptic feedback.
`
`A user can interact with an environment displayed by a computer to
`
`perform functions and tasks on the computer, such as playing a game,
`
`experiencing a simulation or virtual reality environment, using a computer
`
`aided design system, operating a graphical user
`
`interface (GUI), etc.
`
`Common human-computerinterface devices used for such interaction include
`
`a mouse, joystick, trackball, steering wheel, stylus, tablet, pressure-sensitive
`
`sphere, or the like, that is connected to the computer system controlling the
`
`displayed environment.
`
`(PDA's), and other
`Cellular phones, personal digital assistants
`electronic devices are commonly used by a large number of people. The
`
`physical feedback provided in standard passive buttons on cell-phones and
`
`PDA's of the prior art is limited to the mechanical feedback of the switches,
`
`e.g., the switch closure force-displacement profile. As the same mechanical
`
`switch is usually used for each button, the buttons all feel the same when they
`
`are pressed.
`
`In addition, the physical feedback that the buttons provide is
`
`delivered only in the process of pressing the button. Some cellphones and
`
`PDA’s have raised bumps on the center key to help orient the user as to the
`
`center of
`
`the pattern, and some buttons are arranged in unique or
`
`characteristic ways to allow the user to determine which button is which by
`
`feel without having to look at the buttons.
`
`In general, however, users typically
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 3
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 3
`
`

`

`it “He “a Pp Ft eH Poly te
`ha.
`ag) Sy Bah Wa eh eM ott
`
`a y aeda =f r 4 2ath
`ae Had ae
`the cd, Hb ae
`
`must look at the dialpad on their cellphone or PDA to ensure that they are
`
`entering the right numbers or characters.
`
`In
`
`summary, passive buttons have a_
`
`single characteristic feel
`
`generated by the mechanical design and do not have the ability to provide
`
`feedback to the user regarding displacement or position. This is similar for
`
`buttons or keypads provided on other electronic devices.
`
`In other embodiments, a flat touchpad used on a cell-phone or other
`
`electronic device for sensing a user’s touch can beintegrated with an LCD or
`
`other flat panel display screen.
`
`In some embodiments, “soft” or graphical
`
`buttons (“softkeys’) are displayed on the screen and are receptive to the
`
`users touch to allow the command of device functions similar to normal
`
`mechanical buttons. However, the smooth touchpad/LCD module has no
`
`existing mechanism or method of providing the user any kind of feedback as
`
`to the graphical button they are about to press.
`
`Thus, the shortcomings of the conventional approach include:
`
`if the
`
`user attempts to select specific buttons in a distracting environment to perform
`
`a primary task or function of the device, the user’s attention will be severely
`
`divided between the primary task they are trying to complete, and the
`
`secondary task of pressing the correct buttons on the device.
`
`If the primary
`
`task involves looking at objects far from themselves (as, say,
`
`in a driving
`
`environmentin a vehicle), then there is the additional challenge of needing to
`
`dramatically change the users focus point
`
`from somewhere far
`
`from
`
`themselves to the device he or she is manipulating in hand or closeby.
`
`In those devices including a touch-pad,
`
`the user does not get any
`
`tactile feedback as to which graphical button he or she is going to press.
`
`In
`
`fact, for the “soft-keys” in an integral touchpad/LCD screen, the user may
`
`press between displayed buttons, not realizing that his or her finger is bridging
`
`two ‘valid’ button locations, and leading in some cases to an undesired key
`
`being pressed and thus an undesired commandsentto the electronic device.
`
`Docket No. IMM149P
`
`2
`
`APPLEINC.
`EXHIBIT 1106 - PAGE 4
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 4
`
`

`

`My oe MF
`‘
`APT OU FR
`wy
`G7b a owedT,
`qi, Gog Chie ls a ioe woe Nat
`{ ab Sop Ge Na ato
`
`Ht
`qed!
`ane
`
`SUMMARYOF INVENTION
`
`The present
`mechanical buttons,
`
`to providing tactile feedback for
`invention relates
`rocker switches, scroll wheels and the like used on
`
`electronic devices such as cell-phones, remote controls, and the like. The
`invention also relates to embodiments for providing tactile feedback for a
`
`touchpad having an integral display such as an LCD screen, and buttons
`
`displayed thereon.
`
`Haptic feedback interface devices can provide physical sensations
`which are felt by the user manipulating the interface device. One or more
`motors or other actuators are used in the device to output
`the haptic
`
`sensations.
`
`The present invention provides an actuator to output tactile sensations
`on a set of buttons or keys of an electronic device. The buttons preferably
`can detect multiple levels of pressure or user selection (variable or analog
`input devices-- e.g., analog in, analog out) to determine whether the useris
`desiring to press a button to activate its function (heavier pressure), or is
`running his or her fingers over the buttons to locate a particular button (lighter
`pressure). Tactile sensations can be outputif lighter pressure is detected to
`allow the userto locate a particular button more easily.
`
`In the touchpad/integrated display embodiments, the tactile effects of
`the present invention allow the user to press the desired key or button more
`accurately. For example, a confirming tactile sensation can confirm that a
`particular key will be pressed, and a different sensation can confirm the actual
`press/selection of the desired key.
`In one example,
`if the user ignored the
`absenceof a confirming sensation overa valid button and tried to press down
`, a ‘not-valid’ tactile sensation can be output indicating to the user that his or
`
`her finger was bridging two valid button locations.
`
`Benefits of the tactile button confirmation with a single actuator include:
`
`Docket No.IMM149P
`
`3
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 5
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 5
`
`

`

`ay Beh
`myotp tae ad
`ma, TE SBhb ce uc abtote
`Leee
`
`e Allows selections or entries to be made on a keypad with less user
`
`distraction
`
`e Allows customized tactile responses in a keypad with a single
`
`actuator
`
`e Allows modes and other non-visible features in the controlled
`
`device to be more obvious and intuitive to a user
`
`e Allows highly configurable displays like LCD's to be used to present
`a changeable user interface to a user while still retaining a tactile
`
`feel.
`
`e Allows a single button to potentially deliver multiple
`selections/characters based on how hard the user presses.
`
`Docket No. IMM149P
`
`4
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 6
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 6
`
`

`

`yin at ataenath ay :
`
`
`
`
`oafo. te Woy hor
`frog Pe
`EH dt an an ae age he
`Lae ©
`Heed! Pastel
`fa Hat ddl va agatha hoa had
`
`DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
`
`Haptic feedback technology, also called force feedback or tactile
`feedback technology, has been usedin a variety of applications to enhance
`the realism of computer simulation environments. The present
`invention
`describes embodiments for providing tactile sensations associated with
`
`buttons, both mechanical and displayed on a screen. The present invention
`
`can be implemented for a variety of types of electronic devices, such as
`cellular telephones, remote controls, gamepads, joystick handles, automotive
`controls (for
`radios, CD players, automobile functions, etc.), consumer
`electronics devices, PDA’s, laptop computers, portable game devices, etc.
`
`One embodiment of a hand-held device including features of the
`presentinvention is shown in Fig. 1. A cell phone 10 can include a numberof
`buttons 12 in a keypad 14. A display 16 can also be included to display
`various features and functions of the device 10. The present
`invention
`
`includes a single vibrotactile actuator 20 coupled to the buttons in the cellular
`phone device, where the actuator is coupled either to the buttons,
`to the
`printed circuit board (PCB) to which the buttons are coupled, or to the case or
`housing of the device. For example, Fig. 2 is a side elevational view of the
`buttons, a button PCB 22 to which the buttons are coupled, and a piezo-
`
`electric actuator 20 which is coupled to the PCB 22. Whenthe piezoelectric
`actuator is energized with a current, the motion or force form the piezo-electric
`actuator transfers to the PCB and to all the buttons 12 coupled thereto. One
`
`example of the control of a piezo-electric actuator is described in copending
`application no. 09/917 ,263, incorporated herein by referencein its entirety.
`
`The actuator 20 used can be a variety of types; for example,
`
`the
`
`actuator can be piezo-electric (some embodiments described in copending
`application no. 09/917,263), a voice-coil, moving magnet actuator, using the
`integral speaker in a device that uses a spinning mass actuator, or a flexure
`coupled to a motor
`(as described in copending U.S. application no.
`
`Docket No. IMM149P
`
`5
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 7
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 7
`
`

`

`Bp Beta
`tis
`i
`=
`Oy
`wR ar
`fe
`F
`pe
`at
`te HK “a f Aett F ap apne 3
`ead Tae
`“Al dade ae ome abi at
`
`iy
`
`incorporated herein by reference in its entirety). To allow for
`09/585,741,
`simple construction and low cost, the actuator can output a force on all the
`buttons of the device simultaneously (or on all the buttons in a particular
`group on the device, e.g., buttons that are closely spaced in a matrix).
`
`The present invention includes switches or buttons or a touchpad that
`has more resolution than a simple on-off switch closure; rather,
`it requires
`some notion of “levels” of pressure on the switch or touchpad (e.g., three or
`more levels of detection or pressure sensing as opposedto two levels in an
`on-off switch). Examples of these kinds of variable switches include the
`analog buttons found on Sony Playstation 2 gamepads, capacitive touch
`switches, force sensing resistors, or strain-gauge based sensors.
`In the
`present invention, the user can move his or her finger(s) over the various
`buttons or switches, and when exerting a very light pressure, along the level
`of ‘touching’ a button (but not quite pressingit, e.g. a level of sensed pressure
`under a predetermined threshold pressure or level),
`the switch or sensor
`detects the light touch and the actuator is controlled to deliver in response a
`brief sensation to the various buttons, delivering a specific frequencyortactile
`sensation that signals that that particular button had been touched. As the
`user touches other buttons (e.g.,
`in a matrix), other tactile effects unique to
`those other buttons can be delivered registering that touch. With a short
`amount of use, the user can quickly become used to these sensations and
`can identify and press buttons by touch alone. Because in this scenario it
`would be unusual for the user to be pressing or contacting more than one
`button at a time, the fact that the single actuator is outputting sensations onall
`of the buttons simultaneouslyis of little consequence. When the user presses
`morefirmly, with a pressure or to a level that is greater than or further than the
`predetermined threshold level, then the button’s function is activated by the
`device (or the command associated with the button is delivered to the device’s
`controller) as if the user pressed the button normally.
`
`if the useris lightly moving his finger over the 9 key, a
`For example,
`high frequency vibration can be output on all the keys. When the user’s light
`finger pressure is detected at the 6 key, a lower-frequency vibration can be
`output, allowing the user to determine which key is presently under his finger
`
`Docket No. IMM149P
`
`6
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 8
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 8
`
`

`

`solely through the sense of touch. The fact that the 6-key sensation is being
`output on all the keys is irrelevant since the user’s finger is only touching the 6
`key.
`In an alternate, more expensive embodiment, each button can be
`associated with its own actuator so that a sensation is output on a particular
`
`key when thelighter or heavier touch is detected on that key.
`
`In addition to these ‘touch confirmations’, the actuator can also deliver
`
`other sensations, e.g. a confirmation click, pulse, or othertactile effect when a
`button had actually been pressed, confirming its selection.
`If the device has
`‘modes’, e.g. a 1-button short-cut dialing feature on a cell-phone, then this
`usage mode could have associated with it a unique tactile sensation that
`informs the user when that feature has been activated and/oris active.
`
`A controller, such as a microprocessor, ASIC, state machines, or other
`processor, can be usedto receive the sensedlevel of touch or pressure, and
`to control the actuator output. This controller can be the main processorof
`the device, or can be a separate dedicated processor for touch sensation
`control. A variety of tactile sensations can be output, in which the frequency
`and/or magnitude of vibrations or pulses can be varied.
`
`Another embodiment uses the pressure or level capability of analog
`buttons (or a touchpad) with tactile feedback to allow a single button to
`perform multiple functions based on how hard the user presses. One
`example is the telephone dialpad on which many of the number keys also
`correspond to 3 or 4 letters of the alphabet.
`In this example, the user can
`press a button downpart ofits full range of motion toafirst level and receive
`a distinctive tactile feedback that corresponds to the first alphanumeric
`
`character associated with that button, which is input to the device. The user
`can press the button further down (e.g. without stopping at the first level) to a
`second, intermediate pressure level, and receive a different tactile cue as well
`as select the middle alphanumeric character associated with the button. Or,
`the user can press the button hard to the maximum ‘depth’ (third level) of the
`key, which selects the third alphanumeric character for input, and causes the
`corresponding tactile cue for that
`letter to be output on the button. This
`embodiment mayinclude a feature of ‘dwell to select’, i.e. holding a consistent
`pressure level would be equivalent
`to having selected, and again the
`
`Docket No. IMM149P
`
`7
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 9
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 9
`
`

`

`ety on
`Sy
`ot, Hut dea ge
`cueye
`
`Bey Gt AE Sy hep poeehow Balle
`
`a sat cnt
`wilt aE Hadl
`i
`Lat
`
`confirmation of the selection could be signified by a distinctive, different tactile
`
`cue. Other embodiments mayincorporate less or fewerlevels of selection.
`
`The present invention can also be used with a touchpad/integratedflat
`display overlay, and the benefits may be even more compelling. A LCD (or
`other type of display) panel overlaid on a pressure-sensitive touchpad, and
`coupled to an actuator (such as actuator 20) can allow the user to move his or
`her finger over a software-generated grid of displayed buttons or keys which
`is provided in place of the mechanical buttons 12 shownin Fig. 1. Fig. 3
`depicts an integrated display and actuator. Fig. 4 shows an elevation view of
`such. (Some embodiments may provide such “soft” buttons on a display 16 in
`addition to a mechanical set of buttons 12 to allow more functions to be
`commanded by the user-- such an embodiment can provide another
`dedicated actuator coupled to the display 16 in addition to the actuator
`coupled to the buttons 12, or a single actuator may output force on both
`buttons and display). Tactile feedback is output on the touchpad/display from
`the coupled actuator for a variety of interactions. How hard a useris pressing
`is detected by reading the size of the contact patch of the user’s finger. By
`differentiating between lowerlevels of pressure, effects are played to the user
`helping them orient
`themselves and understand where they are on the
`keypad, without requiring the user to look at the keypad.
`If it is sensed that
`the user’s contact patch/pressure is changing at a sufficiently large level, it is
`concluded that the user is trying to push a button, and a different effect
`signaling that a keypress has been madeis played. A distinct effect is played
`when the user’s finger is on the 5 key as a sort of ‘home’ key. Keys on the
`center axis have a single pop, keys on the left and right sides have two pops.
`Because the user will generally know if they are on the left or right,
`this
`
`doesn’t cause any confusion.
`
`Another embodiment uses dynamic thresholds and looks at how fast
`the user’s pressure is changing. There are a numberof challenging things
`trying to use the touchpad as a keypad. There are big differences in different
`user’s finger geometry, which effects how large a contact patch they have.
`Also, different users use the device differently.. some will glide their finger
`around looking for a button, then will smoothly increase pressure to try to
`
`Docket No.IMM149P
`
`8
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 10
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 10
`
`

`

`<n yy
`arta
`php
`a
`+
`+k
`Pe, 4 i f ah Ry aed a Bait
`oy ae
`aa
`
`ar
`
`‘press’. Others will explore, then will release and ‘stab’ the button to make a
`selection. Two different thresholds for these two user scenarios and can
`
`detecteither.
`
`‘
`
`In a further example, a tactile sensation can be output indicating when
`the user’s finger is over a valid key selection and whenit is not (when the
`“lighter” pressure is sensed).
`The value of the tactile feedback in this
`embodiment is that it can make a displayed key matrix significantly more
`useable in a consumerelectronic device. For example, when the user’s finger
`is positioned between two displayed buttons so that it would not be known
`which button the user desired to select, no tactile sensation is output on the
`touchpad. Whenthe user's finger is moved to a position on the touchpadthat
`is unambiguous as to which button would be activated if the user pressed
`harder, then a tactile pulse, vibration, or other “confirming sensation” can be
`outputto indicate that the user’s finger is in a key-pressing position.
`In some |
`embodiments, if the user ignored the absence of a confirming sensation over
`a valid button and tried to press down, a ‘not-valid’ tactile sensation can be
`outputindicating to the user that his or her finger was bridging two valid button
`locations or was otherwise not in a correct position to press a button.
`
`tactile sensations can distinguish different
`Furthermore, different
`buttons, as in the mechanical button embodiment described above. When the
`user actually presses the keytoinitiate its function or sendits command with
`a heavier pressure,
`then a different tactile sensation (or, alternatively, the
`same sensation) can be output on the touchpad to indicate this action has
`been successfully completed.
`
`The further value in this embodiment is that the same software that
`allows the number, placement and purposes/functions of displayed buttons to
`change as the device modeor feature set changes, can also control the tactile
`feedback. While the clear LCD overlay as a display medium is emphasized
`here, other embodiments can employ a Thin Film Transistor or other flat
`displays such as are found in laptops and color personaldigital assistants
`
`(PDA's).
`
`Docket No. IMM149P
`
`9
`
`APPLE INC
`EXHIBIT 1106 - PAGE 11
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 11
`
`

`

`“pe UR ay 2k
`i, PCy CEE LSyonarte ce
`Hw LAE Ss Faee a ACRa OP Was
`
`Although handheld consumer products in the PDA/cell phone markets
`are described above,
`the present
`invention can be equally useful
`in
`
`automotive controls, home appliances, and white goods.
`
`In addition, the actuator 20 used for outputting tactile sensations based
`on sensed user touch of the buttons or a touchpad can also be used to output
`
`tactile sensations on the buttons, touchpad, or housing based on events or
`interactions performed on the device. For example, if a call is received on a
`cell phone, the buttons or housing can bevibrated,orif the player is playing a
`game or viewing an animation displayed on a display screen of the device,
`tactile sensations can be output synchronized with events, interactions, and
`
`commands occurring during the gameor animation.
`
`Fig. 5 showsa pivoting rocker switch that can be used on an electronic
`device. The rocker switch depresses rubber switches with conductive pads.
`Vibrotactile actuation is through a Token multiactor acting at the end of a
`cantilevered beam attached to the pivoting rocker, essentially amplifying the
`effective forces of the actuator felt by the user. A key element of this
`embodiment is a switch that would allow the userto still feel a substantial
`vibration or force through the switch when the user had fully depressed the
`switch. This is facilitated through the use of the rubber conductive pad
`switches.
`If a conventional switch were used, then when the user pressed a
`switch, the rocker would be grounded and the Vibrotactile sensations would
`be significantly attenuated. The switch shownin Fig. 5 enables only 2-way
`functionality, but many of the concepts are also applicable to 4-way (d-pad) or
`5-way (d-pad with pushto select function) devices.
`
`In one embodiment, the rocker switch is used with a cell phone screen,
`with a typical menustructure of a used by cell phones. The basic concept is
`to allow the user to navigate throughout the menustructure without referring
`to the visual display. To enable this concept, distinct sensations are created
`to represent high level menus. At the top level of the menustructure, each of
`the main menu topics, such as messages, address book, calendar, or profiles
`were given a distinct Vibrotactile sensation that varied in pitch.
`In addition the
`variation in pitch, alternating topics were given a different numberof pulses.
`
`Docket No. IMM149P
`
`10
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 12
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 12
`
`

`

`Bae " "H aad ge OH aptepg tet
`ie es Bop Bad ea eel
`eo
`
`ta ~“hy
`he yp OR x
`we Hab eH all
`AOE? ED es
`
`Somewhat analogousto a general ledgerthat uses alternating light and dark
`lines to facilitate tracking numbers across a page,the alternating number of
`pops, along with the varying pitch is quickly learned by a user, and these
`distinct sensations easily associated with their associated function. Alternate
`embodiments include having a numberof pops that correspond with the ‘index
`number’ of the item.
`In addition to the effects described, many of the menu
`
`structures use the conceptofa ‘rollover effect’, which signals when a menu
`which cycles had rolled over from the bottom,to the top, signaling to the user
`that they were cycling through the menu items again.
`
`In addition to the high level menu structure, an embodiment allows an
`address bookto be navigated more easily. A numberof interesting haptic
`concepts are usedin this menu item. These include:
`e Abrief haptic effect plays with each new menu item underthe
`cursor
`
`e Aslightly different effect plays when a name with a newfirst
`letter is under the cursor.. (alerting the user that they've entered
`a new portion of the address book.. i.e. from the B's, to the C’s)
`e The ability to associate more distinct, or ‘special’ effects to
`designated favorites in the address book.
`e Whenthe up or downrocker switch is held down, items are
`scrolled at a fixed rate, and a haptic effect plays with each item
`
`that appears under the cursor
`e Arate based scrolling is used in which the rate the list scrolls
`increases with the amountof time the key is held down. The rate
`
`the list is scrolling is communicated to the user by a
`corresponding increasein the rate of haptic events played on
`the rocker.
`
`e Ananalog switch under the rocker key can provide an analog
`signal roughly in proportion to the pressure registered on that
`key. This allows the addresslist to be scolled at a rate that can
`be controllable with the amount of pressure applied, and which
`
`is communicated to the user by a corresponding increasein the
`
`rate of haptic events played on the rocker.
`
`Docket No. IMM149P
`
`11
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 13
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 13
`
`

`

`woh ae a
`ga, Hg TP aha Te ath ye
`ieeeCeA By
`
`e Analternate embodiment might be a ‘3-way’ switch, which
`could control up-down menus, and whenpressedin the center,
`would act as a select switch. For this kind of 3-way switch, a
`
`special haptic effect could be played to confirm selections.
`e A 4-wayor 5-way d-pad switch can provide subtle haptic effects
`indicating the direction that the switch was being pressed. This
`could be useful for users to avoid accidentally pressing in an
`unintendeddirection, or in inadvertently selecting an unwanted
`
`diagonal direction.
`
`e Another embodiment uses an existing eccentric rotating mass
`motor(for vibrating ringer) to produce the haptic excitation
`instead of the cantilevered voicecoil (Token multiactor).
`
`A futher embodimentincorporates one or two Token multiactors into
`the back panel of a one or two-handedcell phone. Thetactile responsiveness
`of this arrangementis quite strong. When two actuators are driven in series,
`effectively doubling the amplitude, and the user's fingers rest on the back
`panel of the phone case, and do nottend to attenuate the Vibrotactile
`sensation signal. A two-handed phoneis well suited to this ‘back-panel’ type
`implementation because the way that productis held is fairly tightly dictated
`based on the form factor of the phone.
`
`Although the preferred embodiments were used with a cell phone
`device, other electronic devices such as PDAs, handheld games or game
`controllers could use any of the embodiments described herein.
`
`A further embodiment uses a custom electromagnetic actuator
`configured as a friction brake rubbing against a steel
`shaft
`(passive
`scrollwheel) as shown in Figs. 6 and 7. This device can enable a ‘press to
`select’ functionality (not shown)to provide for user selection of menu items.
`
`The embodiment consists of a long list containing over 50 names.
`Only 5 of these namesfit on the screen of the cell phone at one time. When
`the userrolls the scrollwheel up and down with their thumb, a cursor would
`highlights these items oneat a time, and the userfeels a very noticeable
`
`Docket No. IMM149P
`
`12
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 14
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 14
`
`

`

`ae Se
`iT aay we Ee
`Teac Pad et ed inh at
`
`Pofy
`zg
`qo
`ate
`fo LP Tae ad
`mH He AM WLth ow
`
`detentprofile that resists his motion. Because the actuatoris passive in
`nature and can only restrain the user’s motion, algorithms to make these
`effects feel convincing require significant modification from those used in
`
`active actuator implementations.
`
`The detents that are played on the device corresponding to these on-
`screen items are comparatively ‘large’ vs. the effects/detents played foroff-
`screen events. Whenthe userscrolls the cursor past the top or the bottom of
`the screen,the feeling of the scrollwhee! changesto muchfiner detents. The
`concept dictated that each detent corresponded to one name,and so the
`effect for the user is to suddenly be able to scroll through items much faster
`since, a much smaller range of motion corresponded to one name.
`If/when
`the user scrolls back downinto the visible portion of thelist, the larger detents
`are again ‘displayed’ onthe scrollwheel, allowing more precision in zeroing in
`on the desired name and making the final selection. When the user reaches
`the absolute top or bottom ofthelist, a hard ‘end-stop’or barrier effect is
`displayed that restrains further motion of the scrollwheel, and communicates
`very clearly to the userthat the end of the list has been reached.
`
`In addition embodimentslisted above,the lists can have ‘preferential’
`positions that could be usedto display ‘favorite’ items in a phonelist, or which
`could represent imtermediate positions in a volumeor tone control setting.
`Thesepreferential positions could be displayed by making a detent that was
`either larger, stronger, used a different detent profile, or some combination of
`these variables.
`
`A few operating modalities of the passive scrollwheel have been
`described here. The effects that were used to create these modalities include
`
`Detents, Barriers, and Chatter.
`
`Detents: Using active detent force profiles with a passive actuator yields
`sensations that were too weak or asymmetric (unpleasant). To create
`symmetrical and strongerdetents, the passive detent algorithms take
`advantageof the sign of the scroll wheel’s velocity. When exploring a
`
`Docket No. IMM149P
`
`13
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 15
`
`
`
`APPLE INC.
`EXHIBIT 1106 - PAGE 15
`
`

`

`oy ak Spe a Pee
`in HR OUR en acy neh pep tah
`ae saeee a a add ae
`
`directional detent, the user would encounter a zero force value when entering
`
`the detent from left to right, followed by increasing force values, up to a high
`force value when exiting the detent (a discontinuity form high to zero force).
`Whenthe user movesfrom rightto left, he will encounter a zero force value
`whenentering the detent, followed by increasing force values up to a high
`force whenexiting. Reversing the force profile (user encounters a high force
`value when entering the detent, followed by a decreasing force up to zero
`when exiting the detent) produces a different sensation than the detent
`described in the previous sentence, making each detentprofile unique.
`
`Barriers: Barriers are also directional and include a timerto turn off the wall
`
`after 1 second has elapsed without user movement. Barriers also rely on
`device direction (sign of velocity). Ultimately, the conceptof turning off forces
`in a barrier after a period of time can be extendedtoall effects, not just
`barriers. This is important for controlling both heat and powerdissipation.
`
`Chatter: An importantdistinction regarding the passive scrollwheelis thatit
`can only conveyinformation whenit is moving. This meansit cannot play
`popsorotherVibrotactile effects like its ‘active’ counterpart. One embodiment
`implements a ‘chatter’ effect, which is functionally similar to a periodic effect,
`but since the user only feels the effect when the device is moving, has the
`unexpected effect of generating a pseudo-random sensation. Another
`embodimentuses the scrollwheel’s velocity signal to modulate the frequency
`of this chatter effect, to provide an altern