5,880,411
`[11] Patent Number:
`[19]
`United States Patent
`
`Gillespie et al.
`[45] Date of Patent:
`Mar. 9, 1999
`
`U8005880411A
`
`[54] OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`[75]
`
`Inventors: David W. Gillespie, Palo Alto;
`Timothy P. Allen LOS Gatos Ralph C.
`Wolf Santa Clara" Shawn P.,Day San
`Jose, all of Calif.
`
`[73] Assignee: Synaptics, Incorporated, San Jose,
`Cahf.
`
`[21] APPL N05 6233483
`[22] Filed
`Mar. 28, 1996
`
`Related US. Application Data
`
`[63]
`
`Continuation—in—part of Ser. No. 320,158, Oct. 7, 1994, Pat.
`No. 5,543,591, which is a continuation—in—part of .Ser. No.
`§£Ofr§76fs§§f %39?f§a73a3nfiflled’3‘fhf§g§s13501115131115”;in—
`78?, which i; a éontifiuafigndipmi of Sgt. N}, 895:934:
`Jun. 8, 1992, abandoned.
`5
`
`.
`.
`............................ G08C 21/00, ?:9%55/?§6
`Int. Cl.
`[51]
`.
`.
`[52] US CL """"""""""""""""545/115‘778g3521’59172Q159/f713’
`[58] Field of Search
`’ 178/1801 19 01
`178/2001; 345/157, 159, 160, 173, 174;
`382/119, 186, 187, 316
`
`0 609 021
`2 662 528
`60—205625
`62—126429
`63973415
`2 040614
`4 015725
`
`8/1994 European Pat. Off.
`....... 606K 11/16
`France ........................... 606K 11/16
`5/1990
`
`10/1985
`Japan
`G06F 3/03
`. G06F 3/033
`6/1987
`Japan
`
`
`“988 Japan
`GOGF 3/033
`
`2/1990
`Japan
`G02G 1/133
`1/1992
`Japan
`G06F 3/033
`(List continued on next page.)
`
`OTHER PUBLICATIONS
`“Pressure—Sensitive Icons”, IBM Technical Disclosure Bul-
`PP
`letin, Jun. 1990, vol. 33, No. 1B,
`. 277—278.
`“Scroll Control Box”, IBM Technical Disclosure Bulletin,
`Apr. 1993, V01. 36, No.4, pp. 399—403.
`Wilton, Microsoft Windows 3 Developer’s Workshop, 1991,
`PP~ 229—230
`Tiburtius, “Transparente Folientastaturen”, Feinwerktechnik
`& Messtechnik 97, N0. 7, Munchen, DE, Jul. 1989, pp.
`299—300.
`“Double—Click Generation Method for Pen Operations”,
`IBM Technical Disclosure Bulletin, Nov. 1992, vol. 35, No.
`6, p. 3.
`“Three—Axis Touch—Sensitive Pad”, IBM Technical Disclo-
`sure Bulletin, Jan. 1987, vol. 29’ No. 8, pp. 3451_3453.
`Chun, et al., “A High—Performance Silicon Tactile Imager
`Based on a Capacitive Cell”, IEEE Transactions on Electron
`Devices, Jul. 1985, vol. ED—32, No. 7, pp. 1196—1201.
`Primary Examiner—Vijay Shankar
`Attorney, Agent, or Firm—D'Alessandro & Ritchie
`
`[56]
`
`References Cited
`
`[57]
`
`ABSTRACT
`
`U.S. PATENT DOCUMENTS
`
`8/1948 Holt -
`Re~ 23,030
`272197497 10/1940 SteVenS 6t a1~ -
`371287458
`4/1964 Romem‘
`(List continued on next page)
`'
`FOREIGN PATENT DOCUMENTS
`
`8 $3: iii 131333 Eumpean 11:21? 83 """""($233375?
`uropean a .
`.
`........
`0 490 001
`6/1992 European Pat. on.
`........ GOGF 3/033
`0 574 213
`12/1993 European Pat. Off.
`....... G06K 11/16
`0 589 498
`3/1994 European Pat. Off.
`....... 606K 11/16
`
`Methods for recognizing gestures made by a conductive
`object on a touch-sensor pad and for cursor motion are
`disclosed. Tapping, drags, pushes, extended drags and vari-
`able drags gestures are recognized by analyzing the position,
`pressure, and movement of the conductive object on the
`sensor pad during the time of a suspected gesture, and
`signals are sent to a host indicating the occurrence of these
`gestures. Signals indicating the position of a conductive
`object and distinguishing between the peripheral portion and
`an inner portion of the touch-sensor pad are also sent to the
`hOSt‘
`
`64 Claims, 28 Drawing Sheets
`
`8
`
`\
`
`X INPUT
`PROCESSING
`
`MOTION
`UNIT
`
`
`
`
`
`
`
`
`
`
`14
`
`Y INPUT
`PROCESSING
`
`
`
`
`
`
`GESTURE
`UNIT
`
`VIRTUAL
`BU‘I‘I’ONS
`
`PETITIONERS
`
`Exhibit 1007, Page ’I
`
`PETITIONERS
`Exhibit 1007, Page 1
`
`

`

`949“ Bray;
`372079905
`“966 NaSSImbene'
`392449369
`9/1968 Gan’“ ‘
`3401470
`“969 Kulllan ‘
`3’437’795
`12/1969 Johnson .
`3,482,241
`“1970 Cerbone et al.
`3,492,440
`2/1970 Adelson et al.
`3 493 791
`2/1970 Ellis et a1.
`.
`3:497:617
`3/1970 Gaven .
`3,497,966
`.
`6/1970 Cleary et al.
`3,516,176
`8/1970 Lambright et a],
`3,522,664
`9/1970 Adelson et al.
`,
`3,530,310
`11/1970 Klein .
`3,543,056
`........................ 307/252
`12/1970 Adelson et al.
`3,549,909
`7/1971 Dym et al.
`................................ 323/93
`3,593,115
`8/1971 Johnson et al.
`178/18
`3,598,903
`
`.. 340/347 DD
`5/1972 MacArthur
`3,662,378
`
`7/1972 Ackerman et a ,
`,,,,, 340/365
`3,675,239
`
`8/1972 Holz ..............
`.. 340/365
`3,683,371
`
`10/1972 Braaten
`.. 340/365
`3,696,409
`200/167 A
`5/1973 Kaelin et al.
`3,732,389
`
`6/1973 Larson ............. 307/116
`3,737,670
`
`9/1973 Barkan et a].
`. 340/365 C
`3,757,322
`
`9/1973 Stich ............. 340/200
`3,760,392
`
`11/1973 Hacon .....
`200/52 R
`3,773,989
`
`4/1975 Halsenbalg .
`178/19
`3,875,331
`
`11/1975 Volpe .........
`.. 340/365 C
`3,921,166
`
`.. 340/172.5
`1/1976 Marin et al.
`3,931,610
`. 340/324 M
`1/1976 Graven
`3,932,862
`8/1976 Abe et a].
`178/18
`3,974,332
`11/1976 Dym et al.
`, 178/18
`3,992,579
`3,999,012 12/1976 Dym
`178/18
`4,056,699
`11/1977 Jordan ...........
`.. 200/5 A
`
`4,058,765
`11/1977 Richardson et al.
`324/61 R
`4,071,691
`1/1978 Pepper, Jr.
`178/19
`.
`4,087,625
`5/1978 Dym et al.
`, 178/19
`4,103,252
`7/1978 Bobick .......
`. 331/48
`4,129,747 12/1978 Pepper, Jr.
`.
`178/19
`4,148,014
`4/1979 Burson
`.. 340/709
`4,177,354 12/1979 Mathews
`178/18
`4,177,421
`12/1979 Thornburg .
`324/61 R
`4,198,539
`4/1980 Pepper, Jr.
`178/18
`4,221,975
`9/1980 Lednicki et al.
`.. 307/116
`4,224,615
`9/1980 Penz
`.. 340/712
`4,246,452
`1/1981 Chandler .
`.. 200/5 A
`4,257,117
`3/1981 Besson
`368/69
`4,264,903
`4/1981 Bigelow .....
`.. 340/365 C
`
`7/1981 Burnett et a]. ............ 340/712
`4,281,323
`9/1981 Eichelberger et al.
`340/365 C
`4,290,052
`
`4,290,061
`9/1981 Serrano ......
`.. 340/712
`4,291,303
`9/1981 Cutler et al.
`.. 340/711
`4,293,734 10/1981 Pepper, Jr.
`178/18
`4,302,011
`11/1981 Pepper, Jr.
`273/85
`4,310,839
`1/1982 Schwerdt
`.. 340/712
`4,313,113
`1/1982 Thornburg .
`.. 345/159
`4,334,219
`6/1982 Paiilus et al.
`.. 340/712
`4,371,746
`2/1983 Pepper, Jr.
`178/18
`4,398,181
`8/1983 Yamamoto .
`340/365 S
`4,423,286
`12/1983 Bergeron
`178/19
`.
`4,430,917
`2/1984 Pepper, Jr.
`84/1.01
`4,442,317
`4/1984 Jandrell
`..................................... 178/18
`
`
`
`
`..
`
`.
`.
`
`,
`
`
`
`
`
`
`
`.
`.
`
`5,880,411
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`
`
`6/1984 Schuyler
`................................... 178/18
`4,455,452
`10/1984 Graham ..
`
`382/3
`4,475,235
`
`10/1984 Ng et al.
`.. 340/712
`4,476,463
`4/1985 Garwin et al.
`178/18
`4,511,760
`
`5/1985 Chen ....................................... 340/365
`4,516,112
`7/1985 B ‘
`t
`1
`73/862 04
`4 526 043
`ore e a .
`...........................
`.
`,
`,
`10/1985 Mabusth ........
`178/18
`4,550,221
`4,550,310 10/1985 Yamaguchi et al.
`.. 340/365
`4,554,409
`11/1985 Mitsui et al.
`.....
`178/19
`4,570,149
`2/1986 Thornburg et al.
`..................... 338/114
`4,582,955
`4/1986 Blesser ...................................... 178/19
`4,595,913
`6/1986 Aubuchon ............................... 340/365
`4,616,107 10/1986 Abe et al.
`................................. 178/18
`
`.. 340/712
`4,639,720
`1/1987 Rympalski et al.
`.......................... 178/19
`4,672,154
`6/1987 Rodgers et al.
`4,680,430
`7/1987 Yoshikawa et al.
`...................... 178/19
`
`4,686,332
`8/1987 Greanias et al.
`.....
`. 178/19
`........................ 178/19
`4,698,461
`10/1987 Meadows et al.
`4,733,222
`3/1988 Evans .................................. 340/365 C
`
`...... 340/710
`4,734,685
`3/1988 Watanabe
`4/1988 MatZke et al.
`...................... 340/365 C
`4,736,191
`4,758,690
`7/1988 Kimura ..................................... 178/19
`
`.. 340/709
`4,766,423
`8/1988 Ono et al.
`11/1988 Kimura ..................................... 178/19
`4,788,385
`4,794,208 12/1988 Watson ...................................... 178/19
`
`4,820,886
`4/1989 Watson .......
`. 178/19
`8/1989 Meadows et al.
`........................ 178/19
`4,853,498
`4,914,624
`4/1990 Dunthorn ................................ 364/900
`. 178/18
`4,918,262
`4/1990 Flowers et al.
`
`4,922,061
`5/1990 Meadows et al.
`178/19
`6/1990 Key ......................................... 340/709
`4,935,728
`
`.. 345/173
`4,988,982
`1/1991 Rayner et al
`.............................. 341/33
`5,016,008
`5/1991 Gruaz et al.
`5,117,071
`5/1992 Greanias et al.
`.......................... 178/19
`
`5,120,907
`6/1992 Shinbori et al.
`..
`. 478/18
`.......................... 178/19
`5,149,919
`9/1992 Greanias et al.
`5,153,572 10/1992 Caldwell et al.
`....................... 340/712
`
`5,194,862
`3/1993 Edwards .....
`341/20
`7/1993 Daniels ..................................... 355/27
`5,231,450
`5,239,140
`8/1993 Kuroda et al.
`............................ 178/18
`
`5,270,711
`12/1993 Knapp ........
`341/34
`............................ 345/157
`5,327,161
`7/1994 Logan et al.
`5,365,254
`11/1994 Kawamoto .............................. 345/157
`. 178/18
`5,369,227
`11/1994 Stone
`
`5,373,118 12/1994 Watson ...................................... 178/19
`5,374,787 12/1994 Miller et al.
`.............................. 178/18
`
`.. 345/174
`5,386,219
`1/1995 Greanias et al.
`........................... 395/122
`5,408,593
`4/1995 Kotaki et al.
`5,488,204
`1/1996 Mead et al.
`............................. 345/179
`
`FOREIGN PATENT DOCUMENTS
`
`06 139022
`07 072 976
`2 139 762
`2 266 038
`2 288 665
`91/03039
`91/05327
`96/07966
`96/11435
`96/18179
`
`Japan .............................. GO6F 3/033
`5/1994
`Japan
`.. GO6F 3/033
`3/1995
`11/1984 United Kingdom
`.. GO6F 3/033
`10/1993 United Kingdom
`.. GO6F 3/033
`4/1995 United Kingdom
`. G06K 11/12
`
`3/1991 WIPO ..............
`609G 3/02
`4/1991 WIPO
`609G 3/02
`3/1996 WIPO
`.. GO6F 3/033
`4/1996 WIPO
`.. GO6F 3/033
`6/1996 WIPO ............................ GO8C 21/00
`
`
`
`
`PETITIONERS
`
`Exhibit 1007, Page 2
`
`PETITIONERS
`Exhibit 1007, Page 2
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 1 0f 28
`
`5,880,411
`
`._<D._.m_>
`
`wZO._.._.Dm
`55ImmzhmmoI
`
`X4
`
`><
`
`ZOFOE
`
`._._23
`
`3
`
`a .
`
`523—.I._._m<
`
`or
`
`._.Dn_z_x
`
`02_mwm00mn_
`
`N_.~
`
`._.Dn_z_>
`
`Oz_mmm_00m_n_
`
`FGE
`
`PETITIONERS
`
`Exhibit 1007, Page 3
`
`PETITIONERS
`Exhibit 1007, Page 3
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 2 0f 28
`
`5,880,411
`
`30 30 3O 30 3O 30 30 30 30 30 30 30 30 30 30
`
`
`
`
`24
`
`FIG. 2A
`
`24
`
`3
`
`
`
`22/
`
`
`
`26
`
`26
`
`26
`
`26
`26
`26
`
`26
`
`26
`
`26
`
`26
`26
`
`26
`
`26
`
`26
`
`26
`
`FIG. 23
`
`PETITIONERS
`
`Exhibit 1007, Page 4
`
`PETITIONERS
`Exhibit 1007, Page 4
`
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 3 0f 28
`
`5,880,411
`
`30
`34
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`22
`
`
`
`
`
`
`/'
`
`FIG. 20
`
`3°
`
`PETITIONERS
`
`Exhibit 1007, Page 5
`
`PETITIONERS
`Exhibit 1007, Page 5
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 4 0f 28
`
`5,880,411
`
`40
`
`I
`
`43-1
`
`50-1
`
`52
`
`16
`
`FILTER
`S/H
`
`
`FILTER
`S/H ‘
`
`VMAX VMIN
`
`
`
`FILTER
`S/H
`
`FILTER
`S/H
`
`48'leN
`
`FILTER
`
`
`
`
`
`
`
`
`
`
`
`S/H
`
`
`
` 44'VMAX
`
`44'VMIN
`
`
`
`
`
`
`
`BIAS
`
`CONTROL
`
`56
`
`46
`
`FIG. 3
`
`PETITIONERS
`
`Exhibit 1007, Page 6
`
`PETITIONERS
`Exhibit 1007, Page 6
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 5 0f 28
`
`5,880,411
`
`44
`
`76
`
`OUT
`
`/84
`
`
`
`FIG. 4A
`
`
`
`PETITIONERS
`
`Exhibit 1007, Page 7
`
`PETITIONERS
`Exhibit 1007, Page 7
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 6 0f 28
`
`5,880,411
`
`I
`
`/
`
`/
`
`\
`
`/
`
`\
`
`EN
`
`I
`
`RESET UP
`
`RESET DN
`
`STEP UP
`
`STEP DN
`
`\
`
`/
`
`\
`
`SUP
`
`/
`
`\
`
`SDN ____J——k__
`
`CHUP
`
`/
`
`CHDN _____/__—_\__
`
`SHARE
`
`OUT \
`
`/
`
`\
`
`r—
`
`‘<——¥ SCAN CYCLE -——-{
`
`FIG. 5
`
`SAMPLE
`
`48
`
`j
`
`125
`
`120
`
`12/2
`
`T\124
`
`J:-
`
`F/G. 6
`
`PETITIONERS
`
`Exhibit 1007, Page 8
`
`PETITIONERS
`Exhibit 1007, Page 8
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 7 0f 28
`
`5,880,411
`
`50-1
`22::
`50-4
`
`50-5
`22::
`50-8
`
`50-9
`:21
`50-12
`
`50-13
`
`50-15
`
`50-17
`50—18
`50-19
`50-20
`
`50-21
`50-22
`
`50-23
`
`1
`
`:
`E
`1
`
`:
`E
`:
`
`:
`3
`1
`
`E
`
`:
`132-12
`E
`
`E
`132-2':
`:
`
`:
`132-35
`E
`
`:
`1
`2
`:
`1
`1
`i
`'
`
`:
`'1
`5
`1
`1
`1
`132-5i
`3
`.
`
`
`50-24
`
`52-1
`
`52-2
`
`52-3
`
`52-4
`
`138-5
`
`138-6
`
`FIG. 7
`
`PETITIONERS
`
`Exhibit 1007, Page 9
`
`PETITIONERS
`Exhibit 1007, Page 9
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 8 0f 28
`
`5,880,411
`
`150
`
`E
`
`166
`
`x
`
`.
`
`
`
`ZiXi
`i
`
`X
`DENOMINATOR
`
`
`
`ZXi
`i
`
`154
`
`Y
`NUMERATOR
`
`2M
`
`174
`
`XPOS
`
`168
`
`v
`
`178
`
`170 I
`
`Z
`
`Z
`
`ONX
`REG.
`
`ODX
`REG.
`
`160
`
`ONY
`
`156
`
`YPos
`
`Y
`
`:Yi
`
`
`DENOMINATOR I"
`I
`
`ODY
`
`II REG. I
`
`
`CALIBRATION UNIT
`
`RECAL
`
`FIG. 8
`
`PETITIONERS
`
`Exhibit 1007, Page 10
`
`PETITIONERS
`Exhibit 1007, Page 10
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 9 0f 28
`
`5,880,411
`
`184
`
`REWIND
`
`
`
`
`IflSTORY
`BUFFER
`
`CONTROL
`
`180
`
`j
`
`186
`
`HNGER
`
`
`
`
`UPDATE
`
`mm
`
`
`
`
`
`
`
`HNGER
`
`PETITIONERS
`
`Exhibit 1007, Page 11
`
`PETITIONERS
`Exhibit 1007, Page 11
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 10 0f 28
`
`5,880,411
`
`VBIASOUT
`
`FIG.10
`
`
`
`PETITIONERS
`
`Exhibit 1007, Page 12
`
`PETITIONERS
`Exhibit 1007, Page 12
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 11 0f 28
`
`5,880,411
`
`X CENTER
`
`240
`
`‘ Y CENTER
`
`
`FIG. 11
`
`FIG. 12A
`
`PETITIONERS
`
`Exhibit 1007, Page 13
`
`PETITIONERS
`Exhibit 1007, Page 13
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 12 0f 28
`
`5,880,411
`
`X FingerOuter b
`
`Yo I}
`
`- Y FingerOuter
`
`FIG. 12B
`
`PETITIONERS
`
`Exhibit 1007, Page 14
`
`PETITIONERS
`Exhibit 1007, Page 14
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 13 0f 28
`
`5,880,411
`
`Enable
`
`
`
`FingerOuterMotion
`
`PETITIONERS
`
`Exhibit 1007, Page 15
`
`cc
`
`3OX
`
`262
`
`FIG.13
`
`274
`
`PETITIONERS
`Exhibit 1007, Page 15
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 14 0f 28
`
`5,880,411
`
`20
`
`w>
`
`286
`
`11::-
`
`N-<><
`
`I- TAPUNIT
`
`
`
`
` BUTTON
`CONTROL
`
`UNIT
`
`
`I ZIG-ZAG
`UNIT
`I
`
`PUSH UNIT
`
`FIG. 14
`
`TAP GESTURE
`2
`
`2+
`
`TAP\{fi
`
`r—‘fl
`
`FIG. 15A
`
`DRAG GESTURE
`
`OUT
`
`t4
`
`t5
`
`t6
`
`I
`
`t7+l+
`l
`
`FIG. 15B
`
`PETITIONERS
`
`Exhibit 1007, Page 16
`
`PETITIONERS
`Exhibit 1007, Page 16
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 15 0f 28
`
`5,880,411
`
`TAP GESTURE WITH VARIABLE DRAG TIME
`
`EXPERT TAP
`
`OUT
`
`I
`
`I
`
`tea
`
`t2b
`
`FIG. 15C
`
`LOCKING DRAG GESTU RE
`
`mm
`t8
`t9
`t1o
`t11
`W t13
`
`OUT
`
`I
`
`FIG. 15D
`
`I
`
`PETITIONERS
`
`Exhibit 1007, Page 17
`
`PETITIONERS
`Exhibit 1007, Page 17
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 16 0f 28
`
`5,880,411
`
`DRAG EXTENSIONS GESTURE
`
`mm
`It14
`t15
`t16
`t17
`t18
`I
`
`I
`
`OUT
`
`FIG. 15E
`
`DOUBLE TAP
`
`2+
`
`OUT
`
`IIII
`It19
`t20
`t21
`
`I
`
`I
`I
`I
`t22+I‘I:_,I23
`
`FIG. 15F
`
`HOP GESTURE
`
`2+_l—_—\_1_k—_
`t24
`t25
`
`OUT (L)
`
`OUT(R)
`
`I
`
`I
`I
`
`t2e
`
`FIG. 15G
`
`PETITIONERS
`
`Exhibit 1007, Page 18
`
`PETITIONERS
`Exhibit 1007, Page 18
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 17 0f 28
`
`5,880,411
`
`288
`
`290
`
`292
`
`
`
`FIG. 16A
`
`294
`
`296
`
`CornerX
`
`FIG. 163
`
`PETITIONERS
`
`Exhibit 1007, Page 19
`
`PETITIONERS
`Exhibit 1007, Page 19
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 18 of 28
`
`5,880,411
`
`300
`
`START
`
`302
`
`N 0
`
`Y
`
`304
`
`7
`
`
`
`
`PRE-
`
`VIOUSLY
`DOWN
`
`320
`
`TAPOKAY (— TRUE
`
`
`
`
`
`N
`
`306
`
`TAP@LOCKED
`
`308
`
`DIST >
`DRAGRADIUS
`?
`
`
`
`NONE
`
`314
`
`DIST>
`Y I RAG EXTRADIU
`?
`
`
`
`
`
`316
`
`DRAG-
`LOCK ENABLED
`?
`
`
`
`
`
`310
`
`TAPSTATE (— NONE
`
`
`
`312
`
`DOWNPOS (— CURPOS
`DOWNTIME <— CURTIME
`
`318
`
`TAPOKAY (— FALSE
`SUPPRESS <— FALSE
`
`FIG. 17A
`
`PETITIONERS
`
`Exhibit
`
`1007, Page 20
`
`PETITIONERS
`Exhibit 1007, Page 20
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 19 0f 28
`
`5,880,411
`
`324
`
`
` PRE-
`VIOUSLY
`
`UP
`'7
`
`326
`
`
`TAP
`QUALIFIED
`?
`
`
`
`N
`
`Y
`
`328
`
`REVERSE MOTION
`
`330
`
`TAP
`
`LOCKED
`
`NONE
`
`TAPSTATE <— TAP
`
`336
`
`334
`
`USE LONG DRAG TIME
`SUPPRESS (— TRUE
`
` N
`
`FIG. 17B
`
`PETITIONERS
`
`Exhibit 1007, Page 21
`
`PETITIONERS
`Exhibit 1007, Page 21
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 20 0f 28
`
`5,880,411
`
`
`
`34o
`
`LEFT
`
`338
`Y
`
`
`
`HOP
`DIRECTION
`
`
`
`
`HOP
`QUALIFIED
`
`?
`
`
`
`N
`
`RIGHT
`
`342
`
`344
`
`TAPBUTTON (— MIDDLE
`
`TAPBUTTON (— RIGHT
`
`
`
`
`
`343
`
`N
`
`CORNER
`TAP?
`
`Y
`
`348
`
`350
`
`TAPBUTTON <— LEFT
`
`TAPBUTTON <— RIGHT
`
`UPPOS (— CURPOS
`
`352
`
`TAPSTATE (— TAP
`
` 354
`
`FIG. 17C
`
`PETITIONERS
`
`Exhibit 1007, Page 22
`
`PETITIONERS
`Exhibit 1007, Page 22
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 21 0f 28
`
`5,880,411
`
`(CD
`
`356
`
`TAP
`?
`
` TAPSTATE =
`
`
`358
`DRAG-
`
`LOCK
`ENABLED
`
`?
`
`360
`
`
`
`DRAG-EXT
`ENABLED
`
`?
`
`
`?
`
`
`
`364
`
` DRAGEXTSPEED
`
`
`TAPSTATE <— LOCKED
`
`TAPSTATE (— NONE
`
`368
`
`UPPOS (— CURPOS
`
`FIG. 17D
`
`PETITIONERS
`
`Exhibit 1007, Page 23
`
`PETITIONERS
`Exhibit 1007, Page 23
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 22 0f 28
`
`5,880,411
`
`
`
`370
`
`
`
`UPTIME (— CURTIME
`
`
`
`
`
`372
`
`LOCKED
`
`374
`
`TIME >
`DRAGTIME
`
`
`
`?
`
`
`
`
`376
`
`TAPSTATE (— NONE
`
`378
`
`
`
`S
`
`
`END
`UPPRESSION
`
`?
`
`
`
`
`384
`
`
`
`SUPPRESS (— FALSE
`
`
`
`FIG. 17E
`
`PETITIONERS
`
`Exhibit 1007, Page 24
`
`380
`
`382
`
`DRAG—LOCK
`ENABLED
`?
`
` TIME >
`DRAGEXTTIME
`?
`
`
`
`PETITIONERS
`Exhibit 1007, Page 24
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 23 0f 28
`
`5,880,411
`
`
`
`388
`
`OUT (— NONE
`
`
`
`
`
` TAPSTATE
`?
`
`= NONE
`
`OUT <— TAPBU'ITON
`
`394
`
`OUT <— NONE
`
`396
`
`FIG. 17F
`
`PETITIONERS
`
`Exhibit 1007, Page 25
`
`PETITIONERS
`Exhibit 1007, Page 25
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 24 0f 28
`
`5,880,411
`
`402
`
`
`ZIGZ (— “X"
`ZIGZ' <— “X”
`
`
`400
`WAIT ~3 SAMPLES
`
` 404
`WAIT 1 SAMPLE
` ZIGPOS (— ZIGPOS'
`
` 412
`
`ZIGPOS' (— CURPOS
`
`ZIGZ <— ZIGZ'
`ZIGZ' <— Z
`
`
`
`FIG. 18A
`
`PETITIONERS
`
`Exhibit 1007, Page 26
`
`PETITIONERS
`Exhibit 1007, Page 26
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 25 0f 28
`
`5,880,411
`
`*
`
`ZIGTIME (— CURTIME
`
`ZIGLEFT (— FALSE
`ZIGRIGHT (— FALSE
`
`WAIT 1—2 SAMPLES
`
`414
`
`415
`
`418
`
`420
`
`N 09
`
`422
`
`29
`
`424
`
`Y
`
`ZIGLEFT <— TRUE
`
`428
`
`Y
`
`ZIGRIGHT (— TRUE
`
`430
`
`4 W
`
`AIT 1 SAMPLE
`
`@—<6
`
`42
`
`43
`
`FIG. 18B
`
`PETITIONERS
`
`Exhibit 1007, Page 27
`
`PETITIONERS
`Exhibit 1007, Page 27
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 26 0f 28
`
`5,880,411
`
`WAIT 1—2 SAMPLES
`
`434
`
`436
` ZAG
`QUALIFIED
`
`?
`
`REVERSE MOTION
`
`438
`
`44o
`
`TRUE@FALSE
`
`442
`
`444
`
`OUT <— LEFT
`
`OUT (— RIGHT
`
`PAUSE
`
`OUT (— NONE
`
`446
`
`448
`
`FIG. 180
`
`PETITIONERS
`
`Exhibit 1007, Page 28
`
`PETITIONERS
`Exhibit 1007, Page 28
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 27 0f 28
`
`5,880,411
`
`PUSH GESTURE
`
`ZPUSHDOWN
`
`2TH
`
`2+
`
`OUT
`
`l
`
`FIG. 19
`
`ZPUSHUP
`
`450
`
`45
`
`6
`
`4
`
`60
`
`OUT (— LEFT
`
`OUT (— NONE
`
`
`
`FIG. 20
`
`PETITIONERS
`
`Exhibit 1007, Page 29
`
`PETITIONERS
`Exhibit 1007, Page 29
`
`

`

`US. Patent
`
`Mar. 9, 1999
`
`Sheet 28 0f 28
`
`5,880,411
`
`,SUPPRESSMOTION
`
`496
`
`1%LIFTJUMP
`
`
` FIG
`DELAY
`DELAY
`
`21
`
`480
`
`482
`
`6ABS DIFF
`
`47
`
`DELAY
`
`DELAY
`
`474
`
`ABS. DIFF.
`
`472
`
`470
`
`
`
`PETITIONERS
`
`Exhibit 1007, Page 30
`
`PETITIONERS
`Exhibit 1007, Page 30
`
`

`

`5,880,411
`
`1
`OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`RELATED APPLICATIONS
`
`This application is a continuation-in-part of co-pending
`application Ser. No. 08/320,158, filed Oct. 7, 1994, which is
`a continuation-in-part of application Ser. No. 08/300,387,
`filed Sep. 2, 1994, now abandoned which is a continuation-
`in-part of application Ser. No. 08/115,743, filed Aug. 31,
`1993, now US. Pat. No. 5,374,787, which is a continuation-
`in-part of application Ser. No. 07/895,934, filed Jun. 8, 1992,
`now abandoned.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to object position sensing
`transducers and systems. More particularly,
`the present
`invention relates to object position recognition useful in
`applications such as cursor movement
`for computing
`devices and other applications, and especially to cursor
`movement with enhanced edge-motion and gesture-
`recognition features.
`2. The Prior Art
`
`Numerous devices are available or have been proposed
`for use as object position detectors for use in computer
`systems and other applications. The most familiar of such
`devices is the computer “mouse”. While extremely popular
`as a position indicating device, a mouse has mechanical
`parts and requires a surface upon which to roll its position
`ball. Furthermore, a mouse usually needs to be moved over
`long distances for reasonable resolution. Finally, a mouse
`requires the user to lift a hand from the keyboard to make the
`cursor movement,
`thereby upsetting the prime purpose,
`which is usually typing on the computer.
`Trackball devices are similar to mouse devices. A major
`difference, however is that, unlike a mouse device, a track-
`ball device does not require a surface across which it must
`be rolled. Trackball devices are still expensive, have moving
`parts, and require a relatively heavy touch as do the mouse
`devices. They are also large in size and doe not fit well in a
`volume-sensitive application like a laptop computer.
`There are several available touch-sense technologies
`which may be employed for use as a position indicator.
`Resistive-membrane position sensors are known and used in
`several applications. However, they generally suffer from
`poor resolution, the sensor surface is exposed to the user and
`is thus subject
`to wear. In addition, resistive-membrane
`touch sensors are relatively expensive. A one-surface
`approach requires a user to be grounded to the sensor for
`reliable operation. This cannot be guaranteed in portable
`computers. An example of a one-surface approach is the
`UnMouse product by MicroTouch, of Wilmington, Mass. A
`two-surface approach has poorer resolution and potentially
`will wear out very quickly in time.
`Resistive tablets are taught by US. Pat. No. 4,680,430 to
`Yoshikawa, US. Pat. No. 3,497,617 to Ellis and many
`others. The drawback of all such approaches is the high
`power consumption and the high cost of the resistive mem-
`brane employed.
`Surface Acoustic Wave (SAW) devices have potential use
`as position indicators. However, this sensor technology is
`expensive and is not sensitive to light touch. In addition,
`SAW devices are sensitive to residue buildup on the touch
`surfaces and generally have poor resolution.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`Strain gauge or pressure plate approaches are an interest-
`ing position sensing technology, but suffer from several
`drawbacks. This approach may employ piezo-electric trans-
`ducers. One drawback is that the piezo phenomena is an AC
`phenomena and may be sensitive to the user’s rate of
`movement.
`In addition, strain gauge or pressure plate
`approaches are somewhat expensive because special sensors
`are required.
`Optical approaches are also possible but are somewhat
`limited for several reasons. All would require light genera-
`tion which will require external components and increase
`cost and power drain. For example, a “finger-breaking”
`infra-red matrix position detector consumes high power and
`suffers from relatively poor resolution.
`There have been numerous attempts to provide a device
`for sensing the position of a thumb or other finger for use as
`a pointing device to replace a mouse or trackball. Desirable
`attributes of such a device are low power, low profile, high
`resolution, low cost, fast response, and ability to operate
`reliably when the finger carries electrical noise, or when the
`touch surface is contaminated with dirt or moisture.
`
`Because of the drawbacks of resistive devices, many
`attempts have been made to provide pointing capability
`based on capacitively sensing the position of the finger. US.
`Pat. No. 3,921,166 to Volpe teaches a capacitive matrix in
`which the finger changes the transcapacitance between row
`and column electrodes. US. Pat. No. 4,103,252 to Bobick
`employs four oscillating signals to interpolate x and y
`positions between four capacitive electrodes. US. Pat. No.
`4,455,452 to Schuyler teaches a capacitive tablet wherein
`the finger attenuates the capacitive coupling between elec-
`trodes.
`
`US. Pat. No. 4,550,221 to Mabusth teaches a capacitive
`tablet wherein the effective capacitance to “virtual ground”
`is measured by an oscillating signal. Each row or column is
`polled sequentially, and a rudimentary form of interpolation
`is applied to resolve the position between two rows or
`columns. An attempt is made to address the problem of
`electrical interference by averaging over many cycles of the
`oscillating waveform. The problem of contamination is
`addressed by sensing when no finger was present, and
`applying a periodic calibration during such no-finger-present
`periods. US. Pat. No. 4,639,720 to Rympalski teaches a
`tablet for sensing the position of a stylus. The stylus alters
`the transcapacitance coupling between row and column
`electrodes, which are scanned sequentially. US. Pat. No.
`4,736,191 to Matzke teaches a radial electrode arrangement
`under the space bar of a keyboard,
`to be activated by
`touching with a thumb. This patent teaches the use of total
`touch capacitance, as an indication of the touch pressure, to
`control the velocity of cursor motion. Pulsed sequential
`polling is employed to address the effects of electrical
`interference.
`
`to Greanias,
`US. Pat. Nos. 4,686,332 and 5,149,919,
`teaches a stylus and finger detection system meant to be
`mounted on a CRT. As a finger detection system, its X/Y
`sensor matrix is used to locate the two matrix wires carrying
`the maximum signal. With a coding scheme these two wires
`uniquely determine the location of the finger position to the
`resolution of the wire stepping. For stylus detection, Gre-
`anias first coarsely locates it, then develops a virtual dipole
`by driving all lines on one side of the object in one direction
`and all lines on the opposite side in the opposite direction.
`This is done three times with different dipole phases and
`signal polarities. Assuming a predetermined matrix response
`to the object,
`the three measurements present a set of
`simultaneous equations that can be solved for position.
`
`PETITIONERS
`
`Exhibit 1007, Page 31
`
`PETITIONERS
`Exhibit 1007, Page 31
`
`

`

`5,880,411
`
`3
`US. Pat. No. 4,733,222 to Evans is the first to teach a
`capacitance touch measurement system that interpolates to a
`high degree. Evans teaches a three terminal measurement
`system that uses a drive, sense and electrode signal set (3
`signals) in its matrix, and bases the measurement on the
`attenuation effect of a finger on the electrode node signal
`(uses a capacitive divider phenomena). Evans sequentially
`scans through each drive set to measure the capacitance.
`From the three largest responses an interpolation routine is
`applied to determine finger position. Evans also teaches a
`zeroing technique that allows “no-finger” levels to be can-
`celed out as part of the measurement.
`US. Pat. No. 5,016,008 to Gruaz describes a touch
`sensitive pad that also uses interpolation. Gruaz uses a drive
`and sense signal set (2 signals) in the touch matrix and like
`Evans relies on the attenuation effect of a finger to modulate
`the drive signal. The touch matrix is sequentially scanned to
`read the response of each matrix line. An interpolation
`program then selects the two largest adjacent signals in both
`dimensions to determine the finger location, and ratiometri-
`cally determines the effective position from those 4 num-
`bers.
`
`Gerpheide, PCT application US90/04584, publication No.
`W091/03039, US. Pat. No. 5,305,017 applies to a touch pad
`system a variation of the virtual dipole approach of Grean-
`ias. Gerpheide teaches the application of an oscillating
`potential of a given frequency and phase to all electrodes on
`one side of the virtual dipole, and an oscillating potential of
`the same frequency and opposite phase to those on the other
`side. Electronic circuits develop a “balance signal” which is
`zero when no finger is present, and which has one polarity
`if a finger is on one side of the center of the virtual dipole,
`and the opposite polarity if the finger is on the opposite side.
`To acquire the position of the finger initially, the virtual
`dipole is scanned sequentially across the tablet. Once the
`finger is located, it is “tracked” by moving the virtual dipole
`toward the finger once the finger has moved more than one
`row or column.
`
`Because the virtual dipole method operates by generating
`a balance signal that is zero when the capacitance does not
`vary with distance, it only senses the perimeter of the finger
`contact area, rather than the entire contact area. Because the
`method relies on synchronous detection of the exciting
`signal, it must average for long periods to reject electrical
`interference, and hence it
`is slow. The averaging time
`required by this method,
`together with the necessity to
`search sequentially for a new finger contact once a previous
`contact is lost, makes this method, like those before it, fall
`short of the requirements for a fast pointing device that is not
`affected by electrical interference.
`It should also be noted that all previous touch pad
`inventions that used interpolation placed rigorous design
`requirements on their sensing pad. Greanias and Evans use
`a complicated and expensive drive, sense and electrode line
`scheme to develop their signal. Gruaz and Gerpheide use a
`two signal drive and sense set. In the present invention the
`driving and sensing is done on the same line. This allows the
`row and column sections to be symmetric and equivalent.
`This in turn allows independent calibration of all signal
`paths, which makes board layout simpler and less
`constraining, and allows for more unique sensor topologies.
`The shortcomings of the inventions and techniques
`described in the prior art can also be traced to the use of only
`one set of driving and sensing electronics, which was
`multiplexed sequentially over the electrodes in the tablet.
`This arrangement was cost effective in the days of discrete
`components, and avoided offset and scale differences among
`circuits.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`The sequential scanning approach of previous systems
`also made them more susceptible to noise. Noise levels
`could change between successive measurements,
`thus
`changing the measured signal and the assumptions used in
`interpolation routines.
`Finally, all previous approaches assumed a particular
`signal response for finger position versus matrix position.
`Because the transfer curve is very sensitive to many param-
`eters and is not a smooth linear curve as Greanias and
`
`Gerpheide assume, such approaches are limited in the
`amount of interpolation they can perform.
`In prior co-pending application Ser. No. 08/115,743, filed
`Aug. 31,1993, now US. Pat. No. 5,734,787, a two-
`dimensional capacitive sensing system equipped with a
`separate set of drive/sense electronics for each row and for
`each column of a capacitive tablet is disclosed. All row
`electrodes are sensed simultaneously, and all column elec-
`trodes are sensed simultaneously. The sensed signals are
`processed by analog circuitry.
`Of the touchpad devices currently available, only the
`Alps/Cirque GlidePoint includes gesture recognition. The
`GlidePoint supports basic tap, double-tap, and drag gestures
`to simulate actions on a primary mouse button. It does not
`support multiple-finger gestures, nor are there gestures for
`simulating secondary button clicks. No information is
`known about the implementation methods employed in the
`GlidePoint. However,
`the GlidePoint
`is known to have
`difficulty with double-taps, one of the problems addressed
`by the present invention. The GlidePoint exhibits a hesita-
`tion on each finger-motion stroke which may be an attempt
`to stabilize the cursor during tap gestures. Also, the Glide-
`Point must rely on physical switches or extremely high gain
`or acceleration in order to allow drags over long distances.
`One touchpad product, the UnMouse, mounts a switch
`underneath its resistive sensor so that the user simply presses
`down on the pad to activate the button. Aside from requiring
`fragile and complex mechanical mounting, this device also
`is reported to be very tiring to the user.
`Graphics tablets operated by a pressure sensitive stylus
`instead of a finger are well known in the art. These devices
`typically use a mechanism like the “push” gesture of the
`present invention to simulate actuator switches. No other
`gestures of the sort described herein have been seen in stylus
`operated tablets.
`It is thus an object of the present invention to provide a
`two-dimensional capacitive sensing system equipped with a
`separate set of drive/sense electronics for each row and for
`each column of a capacitive tablet, wherein all row elec-
`trodes are sensed simultaneously, and all column electrodes
`are sensed simultaneously.
`It is a further object of the present invention to provide an
`electronic system that
`is sensitive to the entire area of
`contact of a finger or other conductive object with a capaci-
`tive tablet, and to provide as output the coordinates of some
`measure of the center of this contact area while remaining
`insensitive to the characteristic profile of the object being
`detected.
`
`It is a further object of the present invention to provide an
`electronic system that provides as output some measure of
`area of contact of a finger or other conductive object with a
`capacitive tablet.
`Yet another object of the present invention is to provide a
`two-dimensional capacitive sensing system equipped with a
`separate set of drive/sense electronics for each row and for
`each column of a capacitive tablet, wherein all row elec-
`trodes are sensed simultaneously, and all column electrodes
`
`PETITIONERS
`
`Exhibit 1007, Page 32
`
`PETITIONERS
`Exhibit 1007, Page 32
`
`

`

`5,880,411
`
`5
`are sensed simultaneously and wherein the information
`defining the location of a finger or other conductive object
`is processed in digital form.
`It is a further object of the present invention to provide a
`two-dimensional capacitive sensing system wherein all row
`electrodes are sensed simultaneously, and all column elec-
`trodes are sensed simultaneously and wherein the location of
`a finger or other conductive object within a peripheral region
`of a sensing plane can optionally cause cursor “edge
`motion” on a display screen allowing control of large cursor
`excursions from a small sensing plane with a single gesture.
`A further object of the invention is to provide for the
`recognition of a drag extension gesture m