USOO8169421B2
`
`(12) United States Patent
`Wright et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,169,421 B2
`May 1, 2012
`
`(54) APPARATUS AND METHOD FOR
`DETECTING ATOUCH-SENSOR PAD
`GESTURE
`
`(75) Inventors: David G. Wright, San Diego, CA (US);
`Els L. E'S By PMN
`(US); Ronald H. Sartore, Poway,
`(US)
`(73) Assignee: Cypress Semiconductor Corporation,
`San Jose, CA (US)
`s
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 828 days.
`
`- r
`(*) Notice:
`
`(21) Appl. No.: 11/471,100
`(22) Filed:
`Jun. 19, 2006
`O
`O
`Prior Publication Data
`US 2007/O29.1009 A1
`Dec. 20, 2007
`
`(65)
`
`(51) Int. Cl.
`(2006.01)
`G06F 3/033
`(52) U.S. Cl. ..................... 345/179; 34.5/173; 178/1803;
`178/19.01715/863
`(58) Field of Classification Search ................... 345/173
`See application file for complete search history.
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`Logan ........................... 345,156
`7, 1993
`5,231,380
`ck
`Gerpheide
`4, 1994
`5,305,017
`Agulnicket al. ............. 345,156
`9, 1994
`5,347,295
`Mead et al. ......
`... 178.18.06
`1, 1996
`5.488.204
`Gillespie et al. ........... 178/1803
`8, 1996
`5,543,591
`Stephan et al.
`5, 1998
`5,748,185
`Oishi et al. .................... 345,173
`5, 1998
`5,757,363
`Della Bona et al. .......... 345,157
`6, 1998
`5,764,218
`Allen et al.
`8, 1999
`5,943,052
`
`S. I 7.
`365, A :
`an et al.
`6,005,549 A * 12/1999 Forest ........................... 345,157
`6,028,271 A
`2/2000 Gillespie et al.
`6,057.830 A * 5/2000 Chan et al. .................... 345,157
`6,061,051 A *
`5/2000 Chan et al. .................... 345,173
`6,188,391 B1
`2/2001 Seely et al.
`6,380,931 B1
`4/2002 Gillespie et al.
`6,414,671 B1
`7/2002 Gillespie et al.
`6,590,567 B1 *
`7/2003 Nagao et al. .................. 345,173
`6,704,005 B2
`3/2004 Kato et al.
`6.825,890 B2 11/2004 Matsufusa
`7,030,860 B1
`4/2006 Hsu et al.
`7,084,860 B1* 8/2006 Jaeger et al. .................. 345,173
`7,190,348 B2 * 3/2007 Kennedy et al. ...
`... 345,168
`7,307.485 B1* 12/2007 Snyder et al. ......
`... 331,150
`7,665,042 B2 *
`2/2010 Katayama ......
`T15,863
`2002/0057263 A1* 5/2002 Keely et al. ...
`... 345,179
`2003/0043174 A1* 3/2003 Hinckley et al. .............. 345,684
`(Continued)
`OTHER PUBLICATIONS
`A Switched-capacitor interface for capacitive sensors based on relax
`ation oscillators, Cichocki, A.; Unbehauen, R.; Instrumentation and
`Measurement, IEEE Transactions on, vol.39, Issue 5. Oct. 1990 pp.
`797-799.*
`
`(Continued)
`Primary Examiner — Nitin Patel
`Assistant Exami
`Dorothy Harri
`ssistant Examiner — LJorouny Harris
`(57)
`ABSTRACT
`An apparatus and method for distinguishing a particular ges
`ture from among multiple gestures, performed by a conduc
`tive object on the sensing device, using fewer than three time
`intervals. The apparatus may include a sensing device to
`detect a presence of a conductive object, and a processing
`device, coupled to the sensing device, to distinguish the mul
`tiple gestures. The method may include distinguishing
`between a tap gesture, a double tap gesture, a drag gesture,
`and a motion gesture.
`
`38 Claims, 14 Drawing Sheets
`
`00
`
`Ps 0.
`
`
`
`Qualcomm, Exh. 2017, p. 1
`Apple v. Qualcomm, 2018-01277
`
`

`

`US 8,169.421 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`2005/0179646 A1* 8, 2005 Lin et al. ....................... 345,156
`2006/0007166 A1
`1/2006 Lin et al. ....................... 345,173
`2006/0066582 A1
`3/2006 Lyon et al.
`2006/0097991 A1
`5/2006 Hotelling et al.
`2007/0229466 A1* 10/2007 Peng et al. .................... 345,173
`OTHER PUBLICATIONS
`A voltage-controlled Switched-capacitor relaxation oscillator, Mar
`tin, K.; Solid-State Circuits, IEEE Journal of vol. 16, Issue 4. Aug.
`1981 pp. 412–414.*
`
`Ryan Seguine, et al., “Layout Guidelines for PSoCTM CapSenseTM”,
`Cypress Application Note AN2292, Revision B, Oct. 31, 2005, pp.
`1-15.
`Dennis Seguine, "Capacitive Switch Scan’, Cypress Application
`Note AN2233a, Revision B, Apr. 14, 2005, pp. 1-6.
`Chapweske, Adam, “The PS/2 Mouse Interface'. PS/2 Mouse Inter
`facing, 2001, 10 pages.
`“Touchscreen'. Wikipedia, the free encyclopedia, Dowloaded: Jun.
`15, 2006, 3 pages, http://en.wikipedia.org/wiki/Touch screen.
`* cited by examiner
`
`Qualcomm, Exh. 2017, p. 2
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 1 of 14
`
`US 8,169,421 B2
`
`1OO Y
`
`
`
`101
`
`103
`
`102
`
`FIG. 1A
`(Prior Art)
`
`FIG. 1B
`(Prior Art)
`
`Qualcomm, Exh. 2017, p. 3
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 2 of 14
`
`US 8,169,421 B2
`
`A GES RE
`.
`I
`
`Finger
`
`Pressure
`11 1 \u
`
`112
`
`RAG GES
`Fi
`1nger
`Pressure
`11
`Output
`Signal C
`12
`
`or
`113
`
`r
`
`115
`
`so-> Y
`114
`W. Tap Gesture
`116
`FIG. 1 C
`(Prior Art)
`
`.
`
`-
`|
`127 west
`ritish-
`aaaaaaaaaaaaaaaaaaaaaaaa-x-x-xx-acre
`w Drag Gesture
`128
`
`FIG 1 D
`(Prior Art)
`
`Finger
`Pressure
`l l l
`Output
`Signal
`12
`
`
`
`DOSE A
`I
`|
`Piri
`l 19 120
`i 118
`
`s
`
`DoubleTap
`Gesture 123
`
`7
`
`121
`
`.
`h. 22
`
`FIG. 1E
`(Prior Art)
`
`Qualcomm, Exh. 2017, p. 4
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 3 of 14
`
`US 8,169.421 B2
`
`Z 'OIH
`
`
`
`
`
`
`
`
`
`
`
`Qualcomm, Exh. 2017, p. 5
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 4 of 14
`
`US 8,169,421 B2
`
`300 Y
`
`Waying Switch Capacitance
`Finger
`
`303
`
`Adjacent Plate
`Capacitor with Shunt
`
`FIG. 3A
`
`Capacitive Switch
`307
`
`\
`
`Finger
`3O3
`
`)
`
`
`
`Capacitance
`
`Dielectric
`304
`
`
`
`Metal
`305
`
`
`
`
`
`FIG. 3B
`
`Qualcomm, Exh. 2017, p. 6
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 5 of 14
`
`US 8,169,421 B2
`
`Relaxation Oscillator
`
`
`
`FIG. 3C
`
`Qualcomm, Exh. 2017, p. 7
`Apple v. Qualcomm, 2018-01277
`
`

`

`US. Patent
`
`May 1, 2012
`
`Sheet 6 of 14
`
`US 8,169,421 B2
`
`Uwuficmm
`
`a“3:803&5
`
`v.05
`
`505000,
`
`:35
`
`o?
`
`hag830m
`
`_m82amoogfionamo
`
`
`
`x020Eopmzm
`
`Re
`
`
`
`“93:80cogxfiom
`
`95mo_m=<
`
`1SV
`
`Qualcomm, Exh. 2017, p. 8
`Apple v. Qualcomm, 2018-01277
`
`Qualcomm, Exh. 2017, p. 8
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 7 of 14
`
`US 8,169,421 B2
`
`Sensor
`Elenent
`
`
`
`Sensor
`Element
`501(1)
`
`Sensor
`Element
`503(K)
`
`Row 1
`
`504(1)
`
`Sensor Array 500
`
`D SO, SO) & SO, (O) (O) s
`citive
`XXXXXXX6ke
`XXXXXXXX)
`XXXXXXXX)
`XXXXXXXX)
`XXXXXXXX)
`is XXXXXXXX
`
`Column 1
`
`Column M
`505(M)
`
`FIG. 5A
`
`Qualcomm, Exh. 2017, p. 9
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 8 of 14
`
`US 8,169,421 B2
`
`"NQ () () (><><>() (> city
`(> K> K> K> K>{>G)€1
`50
`() {O) {O {O KO (OKO KO
`(O KO (OKO KOKO KO) {O
`{O (O) () {X {O {O KOKO
`{O {O) {O {O KO) {O {O {O
`KOKO KO (O KXKO) {O {O
`
`E.
`
`501(L)
`
`
`
`FIG.SB
`
`Qualcomm, Exh. 2017, p. 10
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 9 of 14
`
`
`
`
`
`§ | ||
`
`FIG.
`
`FIG. 5D
`
`Qualcomm, Exh. 2017, p. 11
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 10 of 14
`
`US 8,169,421 B2
`
`uo?OWN
`
`809
`
`
`
`? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?* - ) --? ? ? ? ? ? ? ? ? ? ? = æ æ æ æ æ æ æ æ æ æ æ Œ œ <=* = * * * * * * * * * * * * * * * * ± • • • • • • • • • • • • • • • • • • • • • • • •
`
`
`
`
`
`* * * * * • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • += <=> • • • • • • • • • • • •~~~~ ~~~~--------------------------------- »
`
`V9 ‘OIH
`
`Qualcomm, Exh. 2017, p. 12
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`US 8,169.421 B2
`
`
`
`
`
`Tap 607(1)
`DoubleTap
`
`Drag 607(3)
`
`Other Gestures
`607(4)
`
`FIG. 6B
`
`Qualcomm, Exh. 2017, p. 13
`Apple v. Qualcomm, 2018-01277
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 12 of 14
`
`US 8,169,421 B2
`
`700
`A1
`
`Motion Gesture 608
`
`Finger
`detected
`
`701
`
`Wait for time
`tl (613),
`counting Ups
`and Downs
`
`702
`
`703
`
`705
`
`706
`
`N
`
`finger up?
`
`Wait for time
`t2 (614),
`continuing
`counting Ups
`and Downs
`
`
`
`
`
`Tap Gesture 607(1)
`
`DoubleTap Gesture 607(2
`
`Y
`
`Drag Gesture 607(3
`
`708
`
`FIG. 7
`
`Qualcomm, Exh. 2017, p. 14
`Apple v. Qualcomm, 2018-01277
`
`

`

`US. Patent
`
`May 1, 2012
`
`Sheet 13 0f 14
`
`US 8,169,421 B2
`
`wow852?
`
`
`
`
`
` mom3:0on>/mom>/8w
`
`€33508¢288m3335BEEBEE
`
`
`
`BEEF988m
`
`38ngEE2::ts;
`
`as:02:ms85NS
`
`w.OE
`
`3883$_S8:35
`
`o;8:8?8w8:3..2380931Epsom
`
`€25
`
`wowUUGUwD<
`
`oow85858w853$H€25233w«5
`
`mow8:805
`
`35“me93on$3
`
`5802530men
`
`Qualcomm, Exh. 2017, p. 15
`Apple v. Qualcomm, 2018-01277
`
`
`
`
`
`wooaha—gooS0502
`
`Qualcomm, Exh. 2017, p. 15
`Apple v. Qualcomm, 2018-01277
`
`
`
`
`

`

`U.S. Patent
`
`May 1, 2012
`
`Sheet 14 of 14
`
`US 8,169.421 B2
`
`
`
`Sdn suwoq
`
`logº
`
`
`
`
`
`
`
`
`
`
`
`
`6 "OIH
`
`
`
`9uu? uens
`
`
`
`(01) ZI9
`
`Qualcomm, Exh. 2017, p. 16
`Apple v. Qualcomm, 2018-01277
`
`

`

`US 8,169,421 B2
`
`1.
`APPARATUS AND METHOD FOR
`DETECTINGA TOUCH-SENSOR PAD
`GESTURE
`
`TECHNICAL FIELD
`
`This invention relates to the field of user interface devices
`and, in particular, to touch-sensor devices.
`
`BACKGROUND
`
`10
`
`2
`traces. Each trace may be connected between a conductive
`line and a ground. By being in contact or in proximity on a
`particular portion of the slider structure, the capacitance
`between the conductive lines and ground varies and can be
`detected. The capacitance variation may be sent as a signal on
`the conductive line to a processing device. For example, by
`detecting the capacitance variation of each sensor element,
`the position of the changing capacitance can be pinpointed. In
`other words, it can be determined which sensor element has
`detected the presence of the conductive object, and it can also
`be determined the motion and/or the position of the conduc
`tive object over multiple sensor elements.
`One difference between touch-sensor sliders and touch
`sensorpads may be how the signals are processed after detect
`ing the conductive objects. Another difference is that the
`touch-sensor slider is not necessarily used to convey absolute
`positional information of a conducting object (e.g., to emulate
`a mouse in controlling cursor positioning on a display) but,
`rather, may be used to actuate one or more functions associ
`ated with the sensing elements of the sensing device.
`In addition to detecting motion of the conductive object in
`one or two axes to control cursor movement, these conven
`tional touch-sensor pads have been designed to recognize
`gesture features. One conventional touch-sensorpad includes
`methods for recognizing gestures made by a conductive
`object on a touch-sensor pad, as taught by U.S. Pat. No.
`6,380.931 to Gillespie et al. This conventional touch-sensor
`pad recognizes tapping, pushing, hopping, and ZigZag ges
`tures by analyzing the position, pressure, and movement of
`the conductive object on the sensor pad during the time of a
`Suspected gesture, and sends signals to a host indicating the
`occurrence of these gestures.
`This conventional touch-sensor pad includes a capacitive
`position sensing system, which determines the position of the
`conductive object, such as a finger, that is proximate to or
`touching a sensing Surface. This conventional touch-sensor
`pad also obtains the finger pressure by Summing the capaci
`tances measured on sense lines. A finger is present if the
`pressure exceeds a suitable threshold value. The basic “tap'
`gesture is a quick tap of the finger on the pad. Such a tap, of
`short duration, involving little or no X or Y finger motion
`during the tap, is presented to the host as a brief click of the
`mouse button. If a multi-button mouse is simulated, the tap
`gesture may simulate a click of the “primary mouse button,
`or the button to be simulated may be user-selectable using a
`shift key, control panel, or other known means. Two taps in
`rapid succession are presented to the host as a double click of
`the button. In general, multiple taps translate into multiple
`clicks.
`In addition, because it is impossible to tell whether a finger
`stroke will be a valid tap while the finger is still down (as
`opposed to a cursor motion), this conventional touch-sensor
`pad, does not report a button click until the finger is lifted.
`This delay is not generally noticeable to the user since taps by
`definition are very brief strokes.
`As described above, conventional touch-sensor pads use
`qualifiers, such as time, pressure, and motion, to determine
`gestures on the touch-sensor pad. For example, the conven
`tional touch-sensor pad of U.S. Pat. No. 6,380,931 uses time,
`pressure, and motion to determine a tap gesture. If a finger
`stroke is less than a specified amount of time (e.g., TapTime),
`does not move outside a specified radius (e.g., TapRadius),
`and is applied Such that the measured pressures is above a
`specified threshold (e.g., Ztap threshold) for at least some part
`of the stroke, a tap gesture is recognized. The conventional
`touch-sensor pad discerns the difference between normal
`track-sensor pad motion and a tap gesture using timing. A tap
`
`Computing devices, such as notebook computers, personal
`data assistants (PDAs), and mobile handsets, have user inter
`face devices, which are also known as human interface device
`(HID). One user interface device that has become more com
`15
`mon is a touch-sensor pad. A basic notebook touch-sensor
`pad emulates the function of a personal computer (PC)
`mouse. A touch-sensor pad is typically embedded into a PC
`notebook for built-in portability. A touch-sensor pad repli
`cates mouse X/y movement by using two defined axes which
`containa collection of sensorelements that detect the position
`of a conductive object, such as a finger. Mouse right/left
`button clicks can be replicated by two mechanical buttons,
`located in the vicinity of the touchpad, or by tapping com
`mands on the touch-sensor pad itself. The touch-sensor pad
`25
`provides a user interface device for performing Such func
`tions as positioning a cursor, or selecting an item on a display.
`These touch-sensorpads may include multi-dimensional sen
`sor arrays for detecting movement in multiple axes. The sen
`sor array may include a one-dimensional sensor array, detect
`ing movement in one axis. The sensor array may also be two
`dimensional, detecting movements in two axes.
`Another user interface device that has become more com
`mon is a touch screen. Touch screens, also known as touch
`screens, touchpanels, or touchscreen panels are display over
`lays which are typically either pressure-sensitive (resistive),
`electrically-sensitive
`(capacitive), acoustically-sensitive
`(SAW surface acoustic wave) or photo-sensitive (infra
`red). The effect of such overlays allows a display to be used as
`an input device, removing the keyboard and/or the mouse as
`the primary input device for interacting with the displays
`content. Such displays can be attached to computers or, as
`terminals, to networks. There are a number of types of touch
`screen technology, Such as optical imaging, resistive, Surface
`wave, capacitive, infrared, dispersive signal, and strain gauge
`technologies. Touch screens have become familiar in retail
`settings, on point of sale systems, on ATMs, on mobile hand
`sets, on game consoles, and on PDAS where a stylus is some
`times used to manipulate the graphical user interface (GUI)
`and to enter data.
`FIG. 1A illustrates a conventional touch-sensor pad. The
`touch-sensorpad 100 includes a sensing surface 101 on which
`a conductive object may be used to position a cursor in the X
`andy-axes, or to select an item on a display. Touch-sensorpad
`100 may also include two buttons, left and right buttons 102
`and 103, respectively. These buttons are typically mechanical
`buttons, and operate much like a left and right button on a
`mouse. These buttons permit a user to select items on a
`display or send other commands to the computing device.
`FIG. 1B illustrates a conventional linear touch-sensor
`slider. The linear touch-sensor slider 110 includes a surface
`area on which a conductive object may be used to position a
`cursor in the X axis (or alternatively in the y-axis). The con
`struct of touch-sensor slider 110 may be the same as that of
`touch-sensorpad 100. Touch-sensor slider 110 may include a
`one-dimensional sensor array. The slider structure may
`include one or more sensor elements that may be conductive
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Qualcomm, Exh. 2017, p. 17
`Apple v. Qualcomm, 2018-01277
`
`

`

`3
`gesture is recognized when the time the conductive object is
`present on the touch-sensor pad is less than a reference
`amount of time; and conversely, a motion gesture is recog
`nized (e.g., no tap gesture is recognized) when the time the
`conductive object is present on the touch-sensor pad is more
`than the reference amount of time.
`FIG. 1C illustrates the timing of a tap gesture, as recog
`nized by a conventional touch-sensor pad. As the conductive
`object is detected, the finger pressure 111 (e.g., Ztap)
`increases. The conductive object is present for time 113,
`which is less than the reference amount of time. Accordingly,
`the output signal 112, which represents the virtual button
`press signal, asserts a tap gesture 116 for a specified amount
`of time, time 114. FIG. 1C also illustrates the timing of a
`motion gesture. As the conductive object is detected, the
`finger pressure 111 increases. The conductive object is
`present for time 115, which is more than the reference amount
`of time. Accordingly, the output signal 112 does not send a tap
`gesture. Since no tap gesture is detected, and assuming that no
`other gesture is recognized, the touch-sensor pad recognizes
`the presence as a motion gesture.
`FIG. 1D illustrates the timing of a draggesture, as recog
`nized by the conventional touch-sensor pad. To perform a
`drag gesture, the user taps once, quickly brining the finger
`back in contact with the touch-sensor pad, then moves the
`finger in a desired direction in the x/y plane of the pad. The
`drag gesture begins with a tap gesture, of which the finger
`pressure 111 is detected for an amount of time, time 124,
`which is less than a specified amount of time (e.g., TapTime).
`The output signal 112 goes high in response to this tap ges
`ture. The finger is removed, and remains away from the touch
`sensorpad for an amount of time, time 125, which is less than
`a second specified amount of time (e.g., DragTime). Then the
`finger returns to the touch-sensorpad and remains present for
`an amount of time, time 126, which is greater than a specified
`amount of time (e.g., TapTime). The output signal 112
`remains high until the finger is removed from the touch
`sensor pad at time 127.
`FIG. 1E illustrates the timing of a double tap gesture, as
`recognized by the conventional touch-sensorpad. The double
`tap gesture starts out the same as the draggestures of FIG. 1D
`with the time 118 that finger pressure 111 is present, being
`less than a specified amount of time (e.g., TapTime). The
`finger is removed for time 119, which is less than the than a
`second specified amount of time (e.g., DragTime), and then
`the finger returns to the touch-sensor pad and remains present
`for an amount of time, time 120, which is less than a specified
`amount of time (e.g., TapTime). Accordingly, the output sig
`nal 112 outputs a double tap gesture 123, which includes an
`extended time interval 122. The double tap gesture 123 may
`include a brief time period 121 after recognition of the tap, to
`allow two distinct clicks, rather than one long, run-together
`click to be seen by the host.
`As mentioned above, the timing of the finger presence?
`absence is one of several factors which are used to discern the
`difference between normal motion gestures and the other
`gestures, such as tap, double tap, or draggestures. As illus
`trated above with respect to FIGS. 1C-1E three or more time
`intervals are used to distinguish one type of gesture from
`another, and typical implementations use three or more sepa
`rate times to measure these intervals. The states of the con
`ventional touch-sensor pad change upon detection of pres
`ence or absence of the finger. For example, first time interval
`is started when the finger pressure 111 is above a certain
`threshold (e.g., Ztap), the second time interval starts when the
`finger is removed from the touch-sensor pad, and the third
`time interval starts when the finger returns to the touch-sensor
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 8,169,421 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`4
`pad (if at all). All of the time intervals start and stop upon
`detection of the presence or absence of the finger.
`The use of three or more time periods in gesture recogni
`tion requires more timers in a circuit, such as a microcontrol
`ler unit, that implements the touch-sensorpad. In addition, the
`user is able to configure the touch-sensorpad to Suit the user's
`preferences. Having three or more variables to adjust in tun
`ing the function of the touch-sensor pad may be confusing,
`rendering the configuration feature less useful.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The present invention is illustrated by way of example, and
`not by way of limitation, in the figures of the accompanying
`drawings.
`FIG. 1A illustrates a conventional touch-sensor pad.
`FIG. 1B illustrates a conventional linear touch-sensor
`slider.
`FIG. 1C illustrates the timing of a tap gesture, as recog
`nized by a conventional touch-sensor pad.
`FIG. 1D illustrates the timing of a draggesture, as recog
`nized by the conventional touch-sensor pad.
`FIG. 1E illustrates the timing of a double tap gesture, as
`recognized by the conventional touch-sensor pad.
`FIG. 2 illustrates a block diagram of one embodiment of an
`electronic system having a processing device for detecting a
`presence of a conductive object.
`FIG. 3A illustrates a varying Switch capacitance.
`FIG. 3B illustrates one embodiment of a sensing device
`coupled to a processing device.
`FIG. 3C illustrates one embodiment of a relaxation oscil
`lator.
`FIG. 4 illustrates a block diagram of one embodiment of a
`capacitance sensor including a relaxation oscillator and digi
`tal counter.
`FIG. 5A illustrates a top-side view of one embodiment of a
`sensor array of sensor elements for detecting a presence of a
`conductive object on the sensor array of a touch-sensor pad.
`FIG. 5B illustrates a top-side view of one embodiment of a
`sensor array of sensor elements for detecting a presence of a
`conductive object on the sensor array of a touch-sensor slider.
`FIG.5C illustrates a top-side view of one embodiment of a
`two-layer touch-sensor pad.
`FIG.5D illustrates a side view of one embodiment of the
`two-layer touch-sensor pad of FIG. 5C.
`FIG. 6A illustrates a block diagram of one embodiment of
`processing device having gesture and motion detection
`blocks.
`FIG. 6B illustrates a block diagram of one embodiment of
`the gesture detection block.
`FIG. 7 illustrates a flowchart of one embodiment of a
`method for distinguishing gestures on a sensing device.
`FIG. 8 illustrates a graphical representation of one embodi
`ment of the timing of multiple gestures performed by the
`conductive object on the sensing device during two time
`intervals.
`FIG.9 illustrates a graphical representation of one embodi
`ment of the timing of multiple gestures performed by the
`conductive object on the sensing device during one time
`interval.
`
`DETAILED DESCRIPTION
`
`Described herein is a method and apparatus for distin
`guishing a particular gesture from among multiple gestures,
`performed by a conductive object on the sensing device, using
`fewer than three time intervals. The following description sets
`
`Qualcomm, Exh. 2017, p. 18
`Apple v. Qualcomm, 2018-01277
`
`

`

`US 8,169,421 B2
`
`10
`
`15
`
`30
`
`40
`
`5
`forth numerous specific details such as examples of specific
`systems, components, methods, and so forth, in order to pro
`vide a good understanding of several embodiments of the
`present invention. It will be apparent to one skilled in the art,
`however, that at least some embodiments of the present inven
`tion may be practiced without these specific details. In other
`instances, well-known components or methods are not
`described in detail or are presented in simple block diagram
`format in order to avoid unnecessarily obscuring the present
`invention. Thus, the specific details set forth are merely exem
`plary. Particular implementations may vary from these exem
`plary details and still be contemplated to be within the spirit
`and scope of the present invention.
`Embodiments of a method and apparatus are described to
`distinguish a particular gesture from among multiple ges
`tures, performed by a conductive object on the sensing device,
`using fewer than three time intervals. In one embodiment, the
`method may include distinguishing between a tap gesture, a
`double tap gesture, a drag gesture, and a motion gesture.
`Alternatively, other gestures may be distinguished. In one
`embodiment, the apparatus may include a sensing device to
`detect a presence of a conductive object, and a processing
`device, coupled to the sensing device, to distinguish a par
`ticular gesture from among multiple gestures, using fewer
`than three time intervals.
`25
`The embodiments herein describe an improved method of
`distinguishing touch-sensor pad gestures that uses only two
`time intervals. This may be done using a single timer, or
`alternatively, two timers. When a finger (or other conductive
`object) first touches the touchpad (tO), a timer is started. If the
`finger remains on the touchpad after a first timeout period
`(t1), then no gesture is detected, and the touch-sensor pad or
`touch-sensor pad system begins using the movement of the
`finger across the touch-sensor pad to provide as input posi
`tioning data, Such as to control a cursor on a display. When
`35
`motion is detected and no other gesture is detected, it can be
`said that the touch-sensor pad detects a motion gesture. If the
`finger moves away from the touchpad before the first timeout,
`and does not touch the touch-sensor pad by the end of a
`second timeout period (t2) then a single "tap' gesture is
`detected. Conventionally, a single tap gesture is used to mimic
`the behavior of a left mouse click. If the finger moves away
`from the touchpad before the first timeout, then touches the
`touch-sensorpad again, and then moves away from the touch
`pad by the end of a second timeout period (t2) then a "double
`tap” gesture is detected. Conventionally, a double tap gesture
`is used to mimic the behavior of a double left mouse click. If
`the finger moves away from the touchpad before the first
`timeout, and then touches the touch-sensorpad again and then
`remains on the touchpad at the end of a second timeout period
`(t2) then a "draggesture (also referred to as a "tap and drag'
`gesture) is detected. Conventionally, a draggesture is used to
`mimic the behavior of a holding down the left button of a
`mouse, while moving the mouse.
`As described above, in the conventional touch-sensor pad,
`the timing offinger touches of the touch-sensor pad is one of
`several criteria used to distinguish between various gestures
`and normal X/y touchpad movement. Similarly, the embodi
`ments described herein may be used as one of several criteria
`for detecting gestures, or as the Sole criterion for detecting a
`gestures (and distinguishing between different gestures).
`FIG. 2 illustrates a block diagram of one embodiment of an
`electronic system having a processing device for detecting a
`presence of a conductive object. Electronic system 200
`includes processing device 210, touch-sensorpad 220, touch
`sensor slider 230, touch-sensor buttons 240, host processor
`250, embedded controller 260, and non-capacitance sensor
`
`6
`elements 270. The processing device 210 may include analog
`and/or digital general purpose input/output (“GPIO) ports
`207. GPIO ports 207 may be programmable. GPIO ports 207
`may be coupled to a Programmable Interconnect and Logic
`(“PIL), which acts as an interconnect between GPIO ports
`207 and a digital blockarray of the processing device 210 (not
`illustrated). The digital block array may be configured to
`implement a variety of digital logic circuits (e.g., DAC, digi
`tal filters, digital control systems, etc.) using, in one embodi
`ment, configurable user modules (“UMs). The digital block
`array may be coupled to a system bus. Processing device 210
`may also include memory, such as random access memory
`(RAM) 205 and program flash 204. RAM 205 may be static
`RAM (SRAM), and program flash 204 may be a non-volatile
`storage, which may be used to store firmware (e.g., control
`algorithms executable by processing core 202 to implement
`operations described herein). Processing device 210 may also
`include a memory controller unit (MCU) 203 coupled to
`memory and the processing core 202.
`The processing device 210 may also include an analog
`block array (not illustrated). The analog block array is also
`coupled to the system bus. Analog block array also may be
`configured to implement a variety of analog circuits (e.g.,
`ADC, analog filters, etc.) using, in one embodiment, config
`urable UMs. The analog block array may also be coupled to
`the GPIO 207.
`As illustrated, capacitance sensor 201 may be integrated
`into processing device 210. Capacitance sensor 201 may
`include analog I/O for coupling to an external component,
`such as touch-sensorpad 220, touch-sensor slider 230, touch
`sensor buttons 240, and/or other devices. Capacitance sensor
`201 and processing device 202 are described in more detail
`below.
`It should be noted that the embodiments described herein
`are not limited to touch-sensor pads for notebook implemen
`tations, but can be used in other capacitive sensing implemen
`tations, for example, the sensing device may be a touch
`screen, a touch-sensor slider 230, or a touch-sensor button
`240 (e.g., capacitance sensing button). It should also be noted
`that the embodiments described herein may be implemented
`in other sensing technologies than capacitive sensing, Such as
`resistive, optical imaging, Surface wave, infrared, dispersive
`signal, and strain gauge technologies. Similarly, the opera
`tions described herein are not limited to notebook cursor
`operations, but can include other operations. Such as lighting
`control (dimmer), Volume control, graphic equalizer control,
`speed control, or other control operations requiring gradual
`adjustments. It should also be noted that these embodiments
`of capacitive sensing implementations may be used in con
`50 junction with non-capacitive sensing elements, including but
`not limited to pick buttons, sliders (ex. display brightness and
`contrast), Scroll-wheels, multi-media control (ex. Volume,
`track advance, etc) handwriting recognition and numerickey
`pad operation.
`In one embodiment, the electronic system 200 includes a
`touch-sensor pad 220 coupled to the processing device 210
`via bus 221. Touch-sensor pad 220 may include a multi
`dimension sensor array. The multi-dimension sensor array
`includes multiple sensor elements, organized as rows and
`columns. In another embodiment, the electronic system 200
`includes a touch-sensor slider 230 coupled to the processing
`device 210 via bus 231. Touch-sensor slider 230 may include
`a single-dimension sensor array. The single-dimension sen
`sor array includes multiple sensor elements, organized as
`rows, or alternatively, as columns. In another embodiment,
`the electronic system 200 includes a touch-sensor button 240
`coupled to the processing device 210 via bus 241. Touch
`
`45
`
`55
`
`60
`
`65
`
`Qualcomm, Exh. 2017, p. 19
`Apple v. Qualcomm, 2018-01277
`
`

`

`US 8,169,421 B2
`
`7
`sensor button 240 may include a single-dimension or multi
`dimension sensor array. The single- or multi-dimension sen
`sor array includes multiple sensor elements. For a touch
`sensor button, the sensorelements may be coupled togetherto
`detect a presence of a conductive object over the entire Sur
`face of the sensing device. Alternatively, the touch-sensor
`button 240 has a single sensor element to detect the presence
`of the conductive object. In one embodiment, the touch-sen
`Sorbutton 240 may be a capacitance sensor element. Capaci
`tance sensor elements may be used as non-contact Switches.
`These Switches, when protected by an insulating layer, offer
`resistance to severe environments.
`The electronic system 200 may include any combination of
`one or more of the touch-sensor pad 220, touch-sensor slider
`230, and/or touch-sensor button 240. In another embodiment,
`the electronic system 200 may be used in a touch screen
`display. In another embodiment, the electronic system 200
`may also include non-capacitance sensor elements 270
`coupled to the processing device 210 via bus 271. The non