flyzaififivi
`PROVISIONAL APPLICA T10/V COVER SHEET
`
`-%"“'§n ’
`
`iii‘ E3
`
`‘£33 iiiifll ‘siiiffl Elli
`
`1
`
`,., 533 53"’ xii? .' I. “i.
`
`-Lu?
`
`‘
`
`
`
`'S'flSIIDTE‘
`
`80/It/LU
`
`CERTIFICATE OF EXPRESS MAILING
` y certify that this paper and the documents and/or fees referred to
` ed therein are being deposited with the United States Postal
` n July 31, 2002 In an envelope as “Express Mail Post Office to
`Addressee” service under 37 CFR §l 10, Express Mail N0.
`EK86030S602US, addressed to the Commissioner for Patents,
`Washingtnn, DC 2023].
`
`Attorney Docket No.:
`
`I1VIM149P
`
`First Named Inventor: Kenneth M. Martin
`
`/
`
`no' 3
`
`j°%iJ73"9'9Se'e|||Illl[!|l7llfl||3|l1Nli|l!JlIlJlllHI!(Ill
`
`Paul M. Thyfau t
`
`.
`
`Commissioner for Patents
`
`Box Provisional Patent Application
`Washington, DC 20231
`
`’Sir:
`
`This is a request for filing a PROVISIONAL APPLICATION under 37 CFR 1.53(c).
`
`INVENTOR(S)/APPLICANT(S)
`
`
`RESIDENCE (CITY AND
`LAST NAME
` FIRST NAME
`MIDDLE INITIAL
`EITHER STATE OR FOREIGN
`
`COUNTRY
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TITLE OF INVENTION 280 characters max
`
`CORRESPONDENCE ADDRESS
`
`IMMERSION CORPORATION
`801 Fox Lane
`
`San Jose, CA 95131
`(408) 467-1900
`
`
`
`Docket No. IMM149P
`
`1
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 1
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 1
`
`

`
`
`
`ENCLOSED APPLICATION PARTS check all that a
`
`Small Entity Statement
`
`Specification, Number ofPages
`
`Drawings Number of Pages
`
`14
`
`6
`
`I:]
`
`E
`
`Other (specify): Cover Sheet
`
`[XE
`
`A check or money order is enclosed to cover the Provisional filing fees.
`
`Provisional Filing Fee Amount ($)160.00
`
`The commissioner is hereby authorized to charge any additional fees that may be required or credit any overpayment to
`Deposit Account No. 50-1815 (Order No. IMM149P).
`
`At least some of the inventions were made under a contract with an agency of the United States Government.
`
`X] No
`
`[:IYes, the name of the U.S. Government agency and the contract number are:
`
`
`Respectfully Submitted,
`
`SIGNATURE DATE 7/31/02
`
`TYPED NAME
`
`Paul M. Thyfault
`
`REGISTRATION No. 40,204
`
`PRO VISIONAL APPLICA TION FILING ONL Y
`
`Docket No. IMM149P
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 2
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 2
`
`

`
`TACTILE FEEDBACK FOR ELECTRONIC DEVICES
`
`BY INVENTORS
`
`Kenneth M. Martin
`
`Alex S. Goldenberg
`Alex Jasso
`Steven P. Vassallo
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates generally to computer interface devices
`
`that allow the user to experience haptic feedback.
`
`A user can interact with an environment displayed by a computer to
`
`perform functions and tasks on the computer, such as playing a game,
`
`experiencing a simulation or virtual reality environment, using a computer
`
`aided design system, operating a graphical user
`
`interface (GUI), etc.
`
`Common human—computer interface devices used for such interaction include
`
`a mouse, joystick, trackball, steering wheel, stylus, tablet, pressure-sensitive
`
`sphere, or the like, that is connected to the computer system controlling the
`
`displayed environment.
`
`Cellular phones, personal digital assistants
`
`(PDA's), and other
`
`electronic devices are commonly used by a large number of people. The
`
`physical feedback provided in standard passive buttons on cell-phones and
`
`PDA’s of the prior art is limited to the mechanical feedback of the switches,
`
`eg, the switch closure force-displacement profile. As the same mechanical
`
`switch is usually used for each button, the buttons all feel the same when they
`
`are pressed.
`
`In addition, the physical feedback that the buttons provide is
`
`delivered only in the process of pressing the button. Some cellphones and
`
`PDA’s have raised bumps on the center key to help orient the user as to the
`
`center of
`
`the pattern, and some buttons are arranged in unique or
`
`characteristic ways to allow the user to determine which button is which by
`
`feel without having to look at the buttons.
`
`In general, however, users typically
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 3
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 3
`
`

`
`-1:1 “,*-
`~ r:,.
`..
`" .53 Ii, .11 1: ,.,§fi'
`
`.="::" =1
`.‘“I
`in :i...i3 tr] mix‘
`
`:3‘ 4121:.
`u,.3r 11.. 3,
`
`must look at the dialpad on their cellphone or PDA to ensure that they are
`
`entering the right numbers or characters.
`
`In
`
`summary, passive buttons have a
`
`single characteristic feel
`
`generated by the mechanical design and do not have the ability to provide
`
`feedback to the user regarding displacement or position. This is similar for
`
`buttons or keypads provided on other electronic devices.
`
`In other embodiments, a flat touchpad used on a celI—phone or other
`
`electronic device for sensing a user's touch can be integrated with an LCD or
`
`other flat panel display screen.
`
`In some embodiments, “soft" or graphical
`
`buttons (“softkeys") are displayed on the screen and are receptive to the
`
`user's touch to allow the command of device functions similar to normal
`
`mechanical buttons. However, the smooth touchpad/LCD module has no
`
`existing mechanism or method of providing the user any kind of feedback as
`
`to the graphical button they are about to press.
`
`Thus, the shortcomings of the conventional approach include:
`
`if the
`
`user attempts to select specific buttons in a distracting environment to perform
`
`a primary task or function of the device, the user's attention will be severely
`
`divided between the primary task they are trying to complete, and the
`
`secondary task of pressing the correct buttons on the device.
`
`If the primary
`
`task involves looking at objects far from themselves (as, say,
`
`in a driving
`
`environment in a vehicle), then there is the additional challenge of needing to
`
`dramatically change the user's focus point
`
`from somewhere far
`
`from
`
`themselves to the device he or she is manipulating in hand or closeby.
`
`In those devices including a touch-pad,
`
`the user does not get any
`
`tactile feedback as to which graphical button he or she is going to press.
`
`In
`
`fact, for the “soft-keys” in an integral touchpad/LCD screen, the user may
`
`press between displayed buttons, not realizing that his or her finger is bridging
`
`two ‘valid’ button locations, and leading in some cases to an undesired key
`
`being pressed and thus an undesired command sent to the electronic device.
`
`Docket No. IMM149P
`
`2
`
`APPLE WC
`EXHIBIT 1006 - PAGE 4
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 4
`
`

`
`1::
`flu}.
`
`zrz:
`'1 .1! “ii:
`
`‘:”"
`:i‘.‘:i il';l* w12.:' iii?!
`in “-5 ml! AL?! milav
`
`< "Zr ‘
`«fl, 5 V’.
`
`~c
`
`“*"'
`“ix
`
`--'5
`:1
`
`“‘
`ll 321"}:
`
`55.
`
`SUMMARY OF INVENTION
`
`The present
`
`invention relates
`
`to providing tactile feedback for
`
`mechanical buttons,
`
`rocker switches, scroll wheels and the like used on
`
`electronic devices such as cell-phones, remote controls, and the like. The
`
`invention also relates to embodiments for providing tactile feedback for a
`
`touchpad having an integral display such as an LCD screen, and buttons
`
`displayed thereon.
`
`Haptic feedback interface devices can provide physical sensations
`
`which are felt by the user manipulating the interface device. One or more
`
`motors or other actuators are used in the device to output
`
`the haptic
`
`sensations.
`
`The present invention provides an actuator to output tactile sensations
`
`on a set of buttons or keys of an electronic device. The buttons preferably
`
`can detect multiple levels of pressure or user selection (variable or analog
`
`input devices-- e.g., analog in, analog out) to determine whether the user is
`
`desiring to press a button to activate its function (heavier pressure), or is
`
`running his or her fingers over the buttons to locate a particular button (lighter
`
`pressure). Tactile sensations can be output if lighter pressure is detected to
`
`allow the user to locate a particular button more easily.
`
`In the touchpad/integrated display embodiments, the tactile effects of
`
`the present invention allow the user to press the desired key or button more
`
`accurately. For example, a confirming tactile sensation can confirm that a
`
`particular key will be pressed, and a different sensation can confirm the actual
`
`press/selection of the desired key.
`
`In one example,
`
`if the user ignored the
`
`absence of a confirming sensation over a valid button and tried to press down
`
`, a ‘not—va|id’ tactile sensation can be output indicating to the user that his or
`
`her finger was bridging two valid button locations.
`
`Benefits of the tactile button confirmation with a single actuator include:
`
`‘
`
`Docket No. IMM149P
`
`3
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 5
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 5
`
`

`
`if I»: ~:;=.: -In“ 3 .
`,3;
`‘mi Ll: ....i-- “av
`
`.rx«ag
`",1, #1:...
`ri.'IZv ai;:l. gill.
`
`.. ,1,
`._
`M5 i-=‘
`
`1‘-11.5‘ x:_,l
`,_.,_ ufi
`..:‘L» 1.flu"\4’:{§‘;-:
`
`o Allows selections or entries to be made on a keypad with less user
`
`distraction
`
`- Allows customized tactile responses in a keypad with a single
`
`actuator
`
`o Allows modes and other non—visible features in the controlled
`
`device to be more obvious and intuitive to a user
`
`- Allows highly configurable displays like LCD's to be used to present
`
`a changeable user interface to a user while still retaining a tactile
`
`feel.
`
`o Allows a single button to potentially deliver multiple
`
`selections/characters based on how hard the user presses.
`
`Docket No. IMM149P
`
`4
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 6
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 6
`
`

`
`r...‘.
`9
`
`‘'‘“'l
`I‘
`In
`
`’-LA‘
`’l3L‘I‘
`."‘_’
`'Z"" '!.‘.l'
`..'I
`‘ gs‘ "_.lII‘u.-u nimn
`
`"‘ l‘ "'3" "'
`II,..II MI
`..§I2ir
`
`‘
`'
`’“
`‘II II 37$
`
`1:3»
`
`us
`
`DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
`
`Haptic feedback technology, also called force feedback or tactile
`
`feedback technology, has been used in a variety of applications to enhance
`
`the realism of computer simulation environments. The present
`
`invention
`
`describes embodiments for providing tactile sensations associated with
`
`buttons, both mechanical and displayed on a screen. The present invention
`
`can be implemented for a variety of types of electronic devices, such as
`
`cellular telephones, remote controls, gamepads, joystick handles, automotive
`
`controls (for
`
`radios, CD players, automobile functions, etc.), consumer
`
`electronics devices, PDA’s, laptop computers, portable game devices, etc.
`
`One embodiment of a hand-held device including features of the
`
`present invention is shown in Fig. 1. A cell phone 10 can include a number of
`
`buttons 12 in a keypad 14. A display 16 can also be included to display
`
`various features and functions of the device 10. The present
`
`invention
`
`includes a single vibrotactile actuator 20 coupled to the buttons in the cellular
`
`phone device, where the actuator is coupled either to the buttons,
`
`to the
`
`printed circuit board (PCB) to which the buttons are coupled, or to the case or
`
`housing of the device. For example, Fig. 2 is a side elevational view of the
`
`buttons, a button PCB 22 to which the buttons are coupled, and a piezo-
`
`electric actuator 20 which is coupled to the PCB 22. When the piezo electric
`
`actuator is energized with a current, the motion or force form the piezo-electric
`
`actuator transfers to the PCB and to all the buttons 12 coupled thereto. One
`
`example of the control of a piezo-electric actuator is described in copending
`
`application no. 09/917,263, incorporated herein by reference in its entirety.
`
`The actuator 20 used can be a variety of types; for example,
`
`the
`
`actuator can be piezo-electric (some embodiments described in copending
`
`application no. 09/917,263), a voice-coil, moving magnet actuator, using the
`
`integral speaker in a device that uses a spinning mass actuator, or a flexure
`
`coupled to a motor
`
`(as described in copending U.S. application no.
`
`Docket No. IMM149P
`
`5
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 7
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 7
`
`

`
`x -"3; 4"": “W
`3131,». "V13 Ti!“ 1? j‘-1]‘ 7,1
`mt 4 ‘I
`am ‘:.x==
`”.i1'|',Z}5I 41:23»
`..:‘lu
`
`1‘ ma. rm.
`‘ii 5.};
`ii“
`
`1:‘
`.7.‘
`,.ll..ti.,~rl 3:"?
`
`09/585,741,
`
`incorporated herein by reference in its entirety). To allow for
`
`simple construction and low cost, the actuator can output a force on all the
`
`buttons of the device simultaneously (or on all the buttons in a particular
`
`group on the device, e.g., buttons that are closely spaced in a matrix).
`
`The present invention includes switches or buttons or a touchpad that
`
`has more resolution than a simple on-off switch closure; rather,
`
`it requires
`
`some notion of ‘‘levels’' of pressure on the switch or touchpad (e.g., three or
`
`more levels of detection or pressure sensing as opposed to two levels in an
`
`on-off switch). Examples of these kinds of variable switches include the
`
`analog buttons found on Sony Playstation 2 gamepads, capacitive touch
`
`switches, force sensing resistors, or strain—gauge based sensors.
`
`In the
`
`present invention, the user can move his or her finger(s) over the various
`
`buttons or switches, and when exerting a very light pressure, along the level
`
`of ‘touching’ a button (but not quite pressing it, e.g. a level of sensed pressure
`
`under a predetermined threshold pressure or level),
`
`the switch or sensor
`
`detects the light touch and the actuator is controlled to deliver in response a
`
`brief sensation to the various buttons, delivering a specific frequency or tactile
`
`sensation that signals that that particular button had been touched. As the
`
`user touches other buttons (e.g.,
`
`in a matrix), other tactile effects unique to
`
`those other buttons can be delivered registering that touch. With a short
`
`amount of use, the user can quickly become used to these sensations and
`
`can identify and press buttons by touch alone. Because in this scenario it
`
`would be unusual for the user to be pressing or contacting more than one
`
`button at a time, the fact that the single actuator is outputting sensations on all
`
`of the buttons simultaneously is of little consequence. When the user presses
`
`more firmly, with a pressure or to a level that is greater than or further than the
`
`predetermined threshold level, then the button’s function is activated by the
`
`device (or the command associated with the button is delivered to the device's
`
`controller) as if the user pressed the button normally.
`
`For example,
`
`if the user is lightly moving his finger over the 9 key, a
`
`high frequency vibration can be output on all the keys. When the user's light
`
`finger pressure is detected at the 6 key, a lower-frequency vibration can be
`
`output, allowing the user to determine which key is presently under his finger
`
`Docket No. IMM149P
`
`6
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 8
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 8
`
`

`
`solely through the sense of touch. The fact that the 6—key sensation is being
`
`output on all the keys is irrelevant since the user's finger is only touching the 6
`
`key.
`
`In an alternate, more expensive embodiment, each button can be
`
`associated with its own actuator so that a sensation is output on a particular
`
`key when the lighter or heavier touch is detected on that key.
`
`In addition to these ‘touch confirmations’, the actuator can also deliver
`
`other sensations, e.g. a confirmation click, pulse, or other tactile effect when a
`
`button had actually been pressed, confirming its selection.
`
`If the device has
`
`‘modes’, e.g. a 1-button short-cut dialing feature on a cell-phone, then this
`
`usage mode could have associated with it a unique tactile sensation that
`
`informs the user when that feature has been activated and/or is active.
`
`A controller, such as a microprocessor, ASIC, state machines, or other
`
`processor, can be used to receive the sensed level of touch or pressure, and
`
`to control the actuator output. This controller can be the main processor of
`
`the device, or can be a separate dedicated processor for touch sensation
`
`control. A variety of tactile sensations can be output, in which the frequency
`
`and/or magnitude of vibrations or pulses can be varied.
`
`Another embodiment uses the pressure or level capability of analog
`
`buttons (or a touchpad) with tactile feedback to allow a single button to
`
`perform multiple functions based on how hard the user presses. One
`
`example is the telephone dialpad on which many of the number keys also
`
`correspond to 3 or 4 letters of the alphabet.
`
`In this example, the user can
`
`press a button down part of its full range of motion to a first level and receive
`
`a distinctive tactile feedback that corresponds to the first alphanumeric
`
`character associated with that button, which is input to the device. The user
`
`can press the button further down (e.g. without stopping at the first level) to a
`
`second, intermediate pressure level, and receive a different tactile cue as well
`
`as select the middle alphanumeric character associated with the button. Or,
`
`the user can press the button hard to the maximum ‘depth’ (third level) of the
`
`key, which selects the third alphanumeric character for input, and causes the
`
`corresponding tactile cue for that
`
`letter to be output on the button. This
`
`embodiment may include a feature of ‘dwell to select’, i.e. holding a consistent
`
`pressure level would be equivalent
`
`to having selected, and again the
`
`Docket No. IMM149P
`
`7
`
`.
`
`APPLE WC
`EXHIBIT 1006 - PAGE 9
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 9
`
`

`
`....,._
`3. n u ,[x Hm,
`..
`21 ‘UL.
`;;__A 4;
`»
`-rv II: 1‘
`ll.
`ft L3»
`=1 uI....»» -
`wt
`«"3
`'*
`
`m_,.
`W.
`;,,,Il_.,='
`
`V
`_;:: ,. ..
`
`,.,
`
`confirmation of the selection could be signified by a distinctive, different tactile
`
`cue. Other embodiments may incorporate less or fewer levels of selection.
`
`The present invention can also be used with a touchpad/integrated flat
`
`display overlay, and the benefits may be even more compelling. A LCD (or
`
`other type of display) panel overlaid on a pressure-sensitive touchpad, and
`
`coupled to an actuator (such as actuator 20) can allow the user to move his or
`
`her finger over a software-generated grid of displayed buttons or keys which
`
`is provided in place of the mechanical buttons 12 shown in Fig. 1. Fig. 3
`
`depicts an integrated display and actuator. Fig. 4 shows an elevation view of
`
`such. (Some embodiments may provide such “soft” buttons on a display 16 in
`
`addition to a mechanical set of buttons 12 to allow more functions to be
`
`commanded by the user—— such an embodiment can provide another
`
`dedicated actuator coupled to the display 16 in addition to the actuator
`
`coupled to the buttons 12, or a single actuator may output force on both
`
`buttons and display). Tactile feedback is output on the touchpad/display from
`
`the coupled actuator for a variety of interactions. How hard a user is pressing
`
`is detected by reading the size of the contact patch of the user’s finger. By
`
`differentiating between lower levels of pressure, effects are played to the user
`
`helping them orient
`
`themselves and understand where they are on the
`
`keypad, without requiring the user to look at the keypad.
`
`If it is sensed that
`
`the user’s contact patch/pressure is changing at a sufficiently large level, it is
`
`concluded that the user is trying to push a button, and a different effect
`
`signaling that a keypress has been made is played. A distinct effect is played
`
`when the user’s finger is on the 5 key as a sort of ‘home’ key. Keys on the
`
`center axis have a single pop, keys on the left and right sides have two pops.
`
`Because the user will generally know if they are on the left or right,
`
`this
`
`doesn't cause any confusion.
`
`Another embodiment uses dynamic thresholds and looks at how fast
`
`the user's pressure is changing. There are a number of challenging things
`
`trying to use the touchpad as a keypad. There are big differences in different
`
`user's finger geometry, which effects how large a contact patch they have.
`
`Also, different users use the device differently.. some will glide their finger
`
`around looking for a button. then will smoothly increase pressure to try to
`
`Docket No. IMM149P
`
`8
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 10
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 10
`
`

`
`I2
`-
`II“t‘=» Il.,:’:
`
`.x
`15:.
`.
`-
`“*3 ‘TI ”~.lI l;;:Il 33}? 333,,
`
`,
`
`‘press’. Others will explore, then will release and ‘stab’ the button to make a
`
`selection. Two different thresholds for these two user scenarios and can
`
`detect either.
`
`In a further example, a tactile sensation can be output indicating when
`
`the user’s finger is over a valid key selection and when it is not (when the
`The value of the tactile feedback in this
`
`“lighter" pressure is sensed).
`
`embodiment is that it can make a displayed key matrix significantly more
`
`useable in a consumer electronic device. For example, when the user’s finger
`
`is positioned between two displayed buttons so that it would not be known
`
`which button the user desired to select, no tactile sensation is output on the
`
`touchpad. When the user’s finger is moved to a position on the touchpad that
`
`is unambiguous as to which button would be activated if the user pressed
`
`harder, then a tactile pulse, vibration, or other “confirming sensation” can be
`
`output to indicate that the user’s finger is in a key—pressing position.
`
`In some _
`
`embodiments, if the user ignored the absence of a confirming sensation over
`
`a valid button and tried to press down, a ‘not-valid’ tactile sensation can be
`
`output indicating to the user that his or her finger was bridging two valid button
`
`locations or was otherwise not in a correct position to press a button.
`
`Furthermore, different
`
`tactile sensations can distinguish different
`
`buttons, as in the mechanical button embodiment described above. When the
`
`user actually presses the key to initiate its function or send its command with
`
`a heavier pressure,
`
`then a different tactile sensation (or, alternatively, the
`
`same sensation) can be output on the touchpad to indicate this action has
`
`been successfully completed.
`
`The further value in this embodiment is that the same software that
`
`allows the number, placement and purposes/functions of displayed buttons to
`
`change as the device mode or feature set changes, can also control the tactile
`
`feedback. While the clear LCD overlay as a display medium is emphasized
`
`here, other embodiments can employ a Thin Film Transistor or other flat
`
`displays such as are found in laptops and color personal digital assistants
`
`(PDA’s).
`
`Docket No. IMM149P
`
`9
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 11
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 11
`
`

`
`as 3.1:
`
`ass:
`
`it‘
`
`222%: zizzziz 22%;:
`
`,. is :9"
`
`Although handheld consumer products in the PDA/cell phone markets
`
`are described above,
`
`the present
`
`invention can be equally useful
`
`in
`
`automotive controls, home appliances, and white goods.
`
`In addition, the actuator 20 used for outputting tactile sensations based
`
`on sensed user touch of the buttons or a touchpad can also be used to output
`
`tactile sensations on the buttons, touchpad, or housing based on events or
`
`interactions performed on the device. For example, if a call is received on a
`
`cell phone, the buttons or housing can be vibrated, or if the player is playing a
`
`game or viewing an animation displayed on a display screen of the device,
`
`tactile sensations can be output synchronized with events, interactions, and
`
`commands occurring during the game or animation.
`
`Fig. 5 shows a pivoting rocker switch that can be used on an electronic
`
`device. The rocker switch depresses rubber switches with conductive pads.
`
`Vibrotactile actuation is through a Token multiactor acting at the end of a
`
`cantilevered beam attached to the pivoting rocker, essentially amplifying the
`
`effective forces of the actuator felt by the user. A key element of this
`
`embodiment is a switch that would allow the user to still feel a substantial
`
`vibration or force through the switch when the user had fully depressed the
`
`switch. This is facilitated through the use of the rubber conductive pad
`
`switches.
`
`If a conventional switch were used, then when the user pressed a
`
`switch, the rocker would be grounded and the Vibrotactile sensations would
`
`be significantly attenuated. The switch shown in Fig. 5 enables only 2-way
`
`functionality, but many of the concepts are also applicable to 4-way (d-pad) or
`
`5-way (d-pad with push to select function) devices.
`
`In one embodiment, the rocker switch is used with a cell phone screen,
`
`with a typical menu structure of a used by cell phones. The basic concept is
`
`to allow the user to navigate throughout the menu structure without referring
`
`to the visual display. To enable this concept, distinct sensations are created
`
`to represent high level menus. At the top level of the menu structure, each of
`
`the main menu topics, such as messages, address book, calendar, or profiles
`
`were given a distinct Vibrotactile sensation that varied in pitch.
`
`In addition the
`
`variation in pitch, alternating topics were given a different number of pulses.
`
`Docket No. IMM149P
`
`10
`
`APPLE INC.
`EXHIBIT 1006
`- PAGE 12
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 12
`
`

`
`Somewhat analogous to a general ledger that uses alternating light and dark
`
`lines to facilitate tracking numbers across a page, the alternating number of
`
`pops, along with the varying pitch is quickly learned by a user, and these
`
`distinct sensations easily associated with their associated function. Alternate
`
`embodiments include having a number of pops that correspond with the ‘index
`
`number’ of the item.
`
`In addition to the effects described, many of the menu
`
`structures use the concept of a ‘rollover effect’, which signals when a menu
`which cycles had rolled over from the bottom, to the top, signaling to the user
`
`that they were cycling through the menu items again.
`
`In addition to the high level menu structure, an embodiment allows an
`
`address book to be navigated more easily. A number of interesting haptic
`
`concepts are used in this menu item. These include:
`
`o A brief haptic effect plays with each new menu item under the
`cursor
`
`A slightly different effect plays when a name with a new first
`
`letter is under the cursor.. (alerting the user that they've entered
`
`a new portion of the address book.. i.e. from the B's, to the C's)
`
`The ability to associate more distinct, or ‘special’ effects to
`
`designated favorites in the address book.
`
`When the up or down rocker switch is held down, items are
`
`scrolled at a fixed rate, and a haptic effect plays with each item
`
`that appears under the cursor
`
`A rate based scrolling is used in which the rate the list scrolls
`
`increases with the amount of time the key is held down. The rate
`
`the list is scrolling is communicated to the user by a
`
`corresponding increase in the rate of haptic events played on
`
`the rocker.
`
`An analog switch under the rocker key can provide an analog
`
`signal roughly in proportion to the pressure registered on that
`
`key. This allows the address list to be scolled at a rate that can
`
`be controllable with the amount of pressure applied, and which
`
`is communicated to the user by a corresponding increase in the
`
`rate of haptic events played on the rocker.
`
`Docket No. IMM149P
`
`11
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 13
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 13
`
`

`
`o
`
`An alternate embodiment might be a ‘3-way’ switch, which
`
`could control up-down menus, and when pressed in the center,
`
`would act as a select switch. For this kind of 3-way switch, a
`
`special haptic effect could be played to confirm selections.
`
`o A 4-way or 5-way d-pad switch can provide subtle haptic effects
`
`indicating the direction that the switch was being pressed. This
`
`could beguseful for users to avoid accidentally pressing in an
`unintended direction, or in inadvertently selecting an unwanted
`
`diagonal direction.
`
`0 Another embodiment uses an existing eccentric rotating mass
`
`motor (for vibrating ringer) to produce the haptic excitation
`
`instead of the cantilevered voicecoil (Token multiactor).
`
`A futher embodiment incorporates one or two Token multiactors into
`
`the back panel of a one or two-handed cell phone. The tactile responsiveness
`
`of this arrangement is quite strong. When two actuators are driven in series,
`
`effectively doubling the amplitude, and the user’s fingers rest on the back
`
`panel of the phone case, and do not tend to attenuate the Vibrotactile
`
`sensation signal. A two-handed phone is well suited to this ‘back—panel’ type
`
`implementation because the way that product is held is fairly tightly dictated
`
`based on the form factor of the phone.
`
`Although the preferred embodiments were used with a cell phone
`
`device, other electronic devices such as PDAs, handheld games or game
`
`controllers could use any of the embodiments described herein.
`
`A further embodiment uses a custom electromagnetic actuator
`
`configured as a friction brake rubbing against a steel
`
`shaft
`
`(passive
`
`scrollwheel) as shown in Figs. 6 and 7. This device can enable a ‘press to
`
`select’ functionality (not shown) to provide for user selection of menu items.
`
`The embodiment consists of a long list containing over 50 names.
`
`Only 5 of these names fit on the screen of the cell phone at one time. When
`
`the user rolls the scrollwheel up and down with their thumb, a cursor would
`
`highlights these items one at a time, and the user feels a very noticeable
`
`Docket No. IMMl 49P
`
`12
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 14
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 14
`
`

`
`,::., ,,x.
`.5 4,? : ~-,. “in,
`"3; “ya:
`i...i» ._f!i«
`??‘::i:‘-l._II .2f:- "mi "+32 ;;';§3 “
`
`1,1‘
`ii
`.31
`
`Ill
`
`-1.
`
`.9; 4'1. = :3;
`' fie
`.. H 4\"H‘:!._x,;
`
`detent profile that resists his motion. Because the actuator is passive in
`
`nature and can only restrain the user's motion, algorithms to make these
`
`effects feel convincing require significant modification from those used in
`
`active actuator implementations.
`
`The detents that are played on the device corresponding to these on-
`
`screen items are comparatively ‘large’ vs. the effects/detents played for off-
`
`screen events. When the user scrolls the cursor past the top or the bottom of
`the screen, the feeling of the scrollwheel changes to much finer detents. The
`
`concept dictated that each detent corresponded to one name, and so the
`
`effect for the user is to suddenly be able to scroll through items much faster
`
`since, a much smaller range of motion corresponded to one name.
`
`If/when
`
`the user scrolls back down into the visible portion of the list, the larger detents
`
`are again ‘displayed’ on the scrollwheel, allowing more precision in zeroing in
`
`on the desired name and making the final selection. When the user reaches
`
`the absolute top or bottom of the list, a hard ‘end-stop’ or barrier effect is
`
`displayed that restrains further motion of the scrollwheel, and communicates
`
`very clearly to the user that the end of the list has been reached.
`
`In addition embodiments listed above, the lists can have ‘preferential’
`
`positions that could be used to display ‘favorite’ items in a phone list, or which
`
`could represent imtermediate positions in a volume or tone control setting.
`
`These preferential positions could be displayed by making a detent that was
`
`either larger, stronger, used a different detent profile, or some combination of
`
`these variables.
`
`A few operating modalities of the passive scrollwheel have been
`
`described here. The effects that were used to create these modalities include
`
`Detents, Barriers. and Chatter.
`
`Detents: Using active detent force profiles with a passive actuator yields
`
`sensations that were too weak or asymmetric (unpleasant). To create
`
`symmetrical and stronger detents, the passive detent algorithms take
`
`advantage of the sign of the scroll wheel's velocity. When exploring a
`
`Docket No. IMM149P
`
`13
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 15
`
`
`
`APPLE INC.
`EXHIBIT 1006 - PAGE 15
`
`

`
`.,.,..,,,.‘.,H,
`,.;n T.
`=- n :,,.E .3.»
`
`,.,,,,
`.,
`;::l.l:::‘« =iZ’ilv
`
`.33:
`
`33,31
`
`.,
`,,
`.::!.. ,,‘%l.,«';,.!i
`
`directional detent, the user would encounter a zero force value when entering
`
`the detent from left to right, followed by increasing force values, up to a high
`
`force value when exiting the detent (a discontinuity form high to zero force).
`
`When the user moves from right to left, he will encounter a zero force value
`
`when entering the detent, followed by increasing force values up to a high
`
`force when exiting. Reversing the force profile (user encounters a high force
`
`value when entering the detent, followed by a decreasing force up to zero
`when exiting the detent) produces a different sensation than the detent
`
`described in the previous sentence, making each detent profile unique.
`
`Barriers: Barriers are also directional and include a timer to turn off the wall
`
`after 1 second has elapsed without user movement. Barriers also rely on
`
`device direction (sign of velocity). Ultimately, the concept of turning off forces
`
`in a barrier after a period of time can be extended to all effects, not just
`
`barriers. This is important for controlling both heat and power dissipation.
`
`Chatter: An important distinction regarding the passive scrollwheel is that it
`
`can only convey information when it is moving. This means it cannot play
`
`pops or other Vibrotactile eff