United States Patent (19)
`Gillespie et al.
`
`USOO5880411A
`Patent Number:
`11
`(45) Date of Patent:
`
`5,880,411
`Mar. 9, 1999
`
`54) OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`O 609 021 8/1994 European Pat. Off. ....... GO6K 11/16
`2 662 528 5/1990 France ........................... GO6K 11/16
`60-205625 10/1985 Japan .....
`... GO6F 3/03
`62-126429 6/1987 Japan.
`... GO6F 3/033
`
`63-073415 4/1988 Japan - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - G06F 3/033
`
`(75) Inventors: David W. Gillespie, Palo Alto;
`
`Timothy P. Allen, Los Gatos; Ralph C.
`Wolf. Santa Clara. Shawn PDay San
`Jose, all of Calif.
`73 Assignee: Synaptics, Incorporated, San Jose,
`Calif.
`
`Appl. No.: 623,483
`21
`22 Filed:
`Mar. 28, 1996
`
`Related U.S. Application Data
`
`2040614 2/1990 Japan ............................. GO2G 1/133
`4015725 1/1992 Japan .............................. G06F 3/033
`(List continued on next page.)
`OTHER PUBLICATIONS
`“Pressure-Sensitive Icons', IBM Technical Disclosure Bul
`letin, Jun. 1990, vol. 33, No. 1B, pp. 277–278.
`“Scroll Control Box”, IBM Technical Disclosure Bulletin,
`Apr. 1993, vol. 36, No. 4, pp. 399-403.
`Wilton, Microsoft Windows 3 Developer's Workshop, 1991,
`pp. 229–230.
`Tiburtius, “Transparente Folientastaturen, Feinwerktechnik
`& Messtechnik 97, No. 7, Munchen, DE, Jul. 1989, pp.
`63 Continuation-in-part of Ser. No. 320,158, Oct. 7, 1994, Pat.
`299-300.
`No. 5,543,591, which is a continuation-in-part of Ser. No.
`ES alysis, asy “Double-Click Generation Method for Pen Operations”,
`YSE which is a Contificatio trait of S.No. 805934.
`IBM Technical Disclosure Bulletin, Nov. 1992, vol. 35, No.
`Jun. 8, 1992, abandoned.
`6, p. 3.
`6
`“Three-Axis Touch-Sensitive Pad', IBM Technical Disclo
`Int. Cl. ............................ G08C 21/00; 'g'. sure Bulletin, Jan. 1987, vol. 29, No. 8, pp. 3451–3453.
`Chun, et al., “A High-Performance Silicon Tactile Imager
`TI's...} Based on a Capacitive Cell, IEEE Transactions on Electron
`52 U.S. Cl. .............................
`s 178/18 o 1901
`Devices, Jul. 1985, vol. ED-32, No. 7, pp. 1196–1201.
`58) Field of Search
`178/2001; 34.5/157, 159, 160, 173, 174;
`Primary Examiner Vijay Shankar
`382/119, 186, 187, 316
`Attorney, Agent, or Firm-D’Alessandro & Ritchie
`References Cited
`57
`ABSTRACT
`U.S. PATENT DOCUMENTS
`Methods for recognizing gestures made by a conductive
`object on a touch-Sensor pad and for cursor motion are
`disclosed. Tapping, drags, pushes, extended drags and Vari
`able drags gestures are recognized by analyzing the position,
`preSSure, and movement of the conductive object on the
`Sensor pad during the time of a Suspected gesture, and
`Signals are Sent to a host indicating the occurrence of these
`gestures. Signals indicating the position of a conductive
`object and distinguishing between the peripheral portion and
`s 5. .. 6. E. Eas s - - - - - - - - - - (Go an inner portion of the touch-Sensor pad are also sent to the
`O 490 001 6/1992 European Pat. Off. ........
`host.
`0574 213 12/1993 European Pat. Off. ....... GO6K 11/16
`O 589 498 3/1994 European Pat. Off. ....... GO6K 11/16
`
`51
`
`56)
`
`Re. 23,030 8/1948 Holt.
`2,219,497 10/1940 Stevens et al..
`3,128,458 4/1964 Romero.
`(List continued on next page.)
`FOREIGN PATENT DOCUMENTS
`
`uropean Pat.
`
`-
`
`- - - - - - - -
`
`64 Claims, 28 Drawing Sheets
`
`
`
`
`
`
`
`XNPUT
`PROCESSING
`
`14
`
`Y INPUT
`PROCESSING
`
`
`
`
`
`MOTION
`UNIT
`
`GESTURE
`UNIT
`
`WRTUAL
`BUTTONS
`
`PANASONIC EX1007, page 001
` IPR2021-01115
`
`

`

`5,880,411
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`3,207,905 9/1965 Bray.
`3.244,369 4/1966 Nassimbene.
`3,401,470 9/1968 Gaven.
`3,437,795 4/1969 Kuljian.
`3,482,241 12/1969 Johnson.
`3,492,440
`1/1970 Cerbone et al..
`3,493.791
`2/1970 Adelson et al. .
`3.497,617 2/1970 Ellis et al. .
`3,497,966 3/1970 Gaven.
`3,516,176 6/1970 Cleary et al..
`3,522,664 8/1970 Lambright et al..
`3,530,310 9/1970 Adelson et al..
`3,543,056 11/1970 Klein.
`3,549,909 12/1970 Adelson et al. ........................ 307/252
`3.593,115
`7/1971 Dym et al. .....
`... 323/93
`3,598.903
`8/1971 Johnson et al.
`... 178/18
`3,662,378 5/1972 MacArthur .....
`... 340/347 DD
`3,675,239 7/1972 Ackerman et al. ..................... 340/365
`3,683,371
`8/1972 Holz ...............
`... 340/365
`3,696,409 10/1972 Braaten ......
`... 340/365
`3,732,389 5/1973 Kaelin et al.
`200/167 A
`3,737,670 6/1973 Larson .................................... 307/116
`3,757,322 9/1973 Barkan et al. .
`340/365 C
`3,760,392 9/1973 Stich ....................................... 340/200
`3,773,989 11/1973 Hacon .....
`200/52 R
`3,875,331
`4/1975 Halsenbalg.
`... 178/19
`3,921,166 11/1975 Volpe .........
`340/365 C
`3,931,610
`1/1976 Marinet al.
`... 340/172.5
`3,932,862
`1/1976 Graven ...
`340/324 M
`3,974,332 8/1976 Abe et al.
`178/18
`3,992.579 11/1976 Dym et al.
`178/18
`3,999,012 12/1976 Dym .....
`... 178/18
`4,056,699 11/1977 Jordan ............
`... 200/5 A
`4,058,765 11/1977 Richardson et al. .................. 324/61, R
`4,071,691
`1/1978 Pepper, Jr. ................................ 178/19
`4,087.625 5/1978 Dym et al.
`178/19
`4,103,252 7/1978 Bobick ...................................... 331/48
`4,129,747 12/1978 Pepper, Jr. ................................ 178/19
`4,148,014 4/1979 Burson ...
`... 340/709
`4,177.354 12/1979 Mathews ................................... 178/18
`4,177,421 12/1979 Thornburg ............................ 324/61, R
`4,198,539 4/1980 Pepper, Jr. .....
`... 178/18
`4,221,975 9/1980 Lednicki et al. ........................ 307/116
`4,224,615 9/1980 Penz ........................................ 340/712
`4,246,452
`1/1981 Chandler .
`... 200/5 A
`4,257,117 3/1981 Besson ...................................... 368/69
`4.264,903 4/1981 Bigelow .............................. 340/365 C
`4,281,323
`7/1981 Burnett et al. .......................... 340/712
`4,290,052 9/1981 Eichelberger et al. ............. 340/365 C
`4,290,061
`9/1981 Serrano ................................... 340/712
`4,291.303
`9/1981 Cutler et al.
`... 340/711
`4.293,734 10/1981 Pepper, Jr. ................................ 178/18
`4,302,011 11/1981 Pepper, Jr. ................................ 273/85
`4,310,839
`1/1982 Schwerdt ...
`... 340/712
`4,313,113
`1/1982 Thornburg .............................. 34.5/159
`4,334,219 6/1982 Patilus et al. ........................... 340/712
`4,371,746 2/1983 Pepper, Jr. .
`... 178/18
`4,398,181 8/1983 Yamamoto .......................... 340/365 S
`4,423,286 12/1983 Bergeron ................................... 178/19
`4,430,917 2/1984 Pepper, Jr.
`84/1.01
`4,442,317 4/1984 Jandrell ..................................... 178/18
`
`4,455,452 6/1984 Schuyler ................................... 178/18
`4,475,235 10/1984 Graham ....................................... 382/3
`4,476.463 10/1984 Ng et al. ................................. 340/712
`4,511,760
`4/1985 Garwin et al
`... 178/18
`4,516,112
`5/1985 Chen ....................................... 340/365
`4,526,043
`7/1985 Boie et all
`73/862.04
`2 - 1 - 2
`Ole C al. . . . . . . . . . . . . . . . . . . . . . . . . . . .
`4.550,221 10/1985 Mabusth .................................... 178/18
`4.550,310 10/1985 Yamaguchi et al. .................... 340/365
`4,554,409 11/1985 Mitsui et al. .....
`... 178/19
`4,570,149 2/1986 Thornburg et al.
`... 338/114
`4,582.955
`4/1986 Blesser ..........
`... 178/19
`4.595,913
`6/1986 Aubuchon ............................... 340/365
`4,616,107 10/1986 Abe et al. ................................. 178/18
`4,639,720
`1/1987 Rympalski et al.
`... 340/712
`4,672,154 6/1987 Rodgers et al. .......................... 178/19
`4,680,430 7/1987 Yoshikawa et al. ...................... 178/19
`4,686,332 8/1987 Greanias et al...
`... 178/19
`4,698,461 10/1987 Meadows et al. ........................ 178/19
`4,733,222 3/1988 Evans .................................. 340/365 C
`4,734,685
`3/1988 Watanabe ................................ 340/710
`4,736,191
`4/1988 Matzke et al. ...................... 340/365 C
`4,758,690 7/1988 Kimura ..................................... 178/19
`4,766.423
`8/1988 Ono et al.
`... 340/709
`4,788,385 11/1988 Kimura ..................................... 178/19
`4,794.208 12/1988 Watson ...................................... 178/19
`4,820,886
`4/1989 Watson .......
`... 178/19
`4,853,498 8/1989 Meadows et al. ........................ 178/19
`4.914,624 4/1990 Dunthorn ................................ 364/900
`4,918.262 4/1990 Flowers et al.
`... 178/18
`4,922,061
`5/1990 Meadows et al. ........................ 178/19
`4.935,728 6/1990 Key ......................................... 340/709
`4,988.982
`1/1991 Rayner et al.
`... 345/173
`5,016,008 5/1991 Gruaz et al. .............................. 341/33
`5,117,071
`5/1992 Greanias et al. .......................... 178/19
`5,120,907 6/1992 Shinbori et al. ..
`... 478/18
`5,149,919 9/1992 Greanias et al...
`... 178/19
`5,153,572 10/1992 Caldwell et al. .
`... 340/712
`5,194,862 3/1993 Edwards .....
`... 341/20
`5,231,450 7/1993 Daniels ...
`... 355/27
`5,239,140 8/1993 Kuroda et al
`... 178/18
`5,270,711 12/1993 Knapp ........
`... 341/34
`5,327,161
`7/1994 Logan et al.
`... 34.5/157
`5,365,254 11/1994 Kawamoto .
`... 34.5/157
`5,369.227 11/1994 Stone ......
`... 178/18
`5,373,118 12/1994 Watson
`... 178/19
`5,374,787 12/1994 Miller et al...
`... 178/18
`5,386.219
`1/1995 Greanias et al.
`... 34.5/174
`5,408.593
`4/1995 Kotaki et al. ..
`... 395/122
`5,488,204
`1/1996 Mead et al. ............................. 345/179
`
`FOREIGN PATENT DOCUMENTS
`
`06 139022 5/1994 Japan .............................. G06F 3/033
`07 072 976 3/1995 Japan .............................. G06F 3/033
`2 139762 11/1984 United Kingdom
`... GO6F 3/033
`2 266 038 10/1993 United Kingdom ............ G06F 3/033
`2 288 665 4/1995 United Kingdom ........... GO6K 11/12
`91/03039 3/1991 WIPO ..............
`... G09G 3/02
`91/05327 4/1991 WIPO .............................. G09G 3/02
`96/07966 3/1996 WIPO ............................. G06F 3/033
`96/11435 4/1996 WIPO ...
`... GO6F 3/033
`96/18179
`6/1996 WIPO ............................ GO8C 21/OO
`
`
`
`PANASONIC EX1007, page 002
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 1 of 28
`
`5,880,411
`
`NOI_LOW
`
`LINT)
`
`
`
`EHTI LSE|5)
`
`||NTU
`
`|-"H_LIEV/
`
`|
`LINT)
`
`9 |
`
`
`
`
`
`SONISSE OOHc]
`
`PANASONIC EX1007, page 003
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar 9, 1999
`
`Sheet 2 of 28
`
`5,880,411
`
`
`
`24
`
`24
`
`FIG. 2A
`
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`
`22
`
`FIG. 2B
`
`PANASONIC EX1007, page 004
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar 9, 1999
`
`Sheet 3 of 28
`
`5,880,411
`
`
`
`?
`
`FIG. 2D
`
`30
`
`PANASONIC EX1007, page 005
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar 9, 1999
`
`Sheet 4 of 28
`
`5,880,411
`
`48-1
`
`50-1
`
`52
`
`16
`
`FILTER
`S/H
`
`FILTER
`S/H
`
`FILTER
`S/H
`
`FILTER
`S/H
`
`FILTER
`S/H
`
`VMAX VMIN
`
`50-VMIN
`
`56
`
`
`
`
`
`
`
`
`
`
`
`PANASONIC EX1007, page 006
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet S of 28
`
`5,880,411
`
`FIG. 4A
`
`
`
`44
`
`76
`
`OUT
`
`-84
`
`g
`CHDN
`
`SHARE
`
`PANASONIC EX1007, page 007
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`Sheet 6 of 28
`5,880,411
`IN N- u-/
`EN
`RESETUP
`
`\
`
`|
`
`RESET DN
`
`STEPUP
`
`|
`
`\
`
`|
`
`\
`
`STEP DN
`
`|
`
`\
`
`SUP
`SDN
`CHUP
`CHDN
`SHARE
`
`OUT
`
`/
`
`\
`
`?
`
`?
`
`\
`
`\
`
`|
`
`| \
`
`N.
`-
`— SCAN CYCLE —
`FIG. 5
`
`48
`
`SAMPLE
`
`126
`
`120
`
`12.
`
`T-12
`-L-
`
`FIG. 6
`
`PANASONIC EX1007, page 008
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 7 of 28
`
`5,880,411
`
`I
`
`AVD
`
`REG.
`
`138-1
`
`52
`
`52-2
`
`52-3
`
`52-4
`
`38-2
`
`138-3
`
`1
`
`132-1
`
`132-2
`
`s
`
`132-3
`
`132-5
`
`5O-1
`50-2
`50-3
`50-4
`
`50-5
`50-6
`50-7
`50-8
`
`50-9
`5O-O
`50-11
`50-12
`
`50-13
`50-14
`50-15
`50-16
`
`50-17
`50-18
`50-19
`50-20
`
`
`
`50-21
`50-22
`50-23
`50-24
`
`FIG. 7
`
`PANASONIC EX1007, page 009
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 8 of 28
`
`5,880,411
`
`150
`
`-
`
`166
`
`
`
`
`
`
`
`
`
`
`
`X
`NUMERATOR
`XiXi
`
`152
`
`X
`DENOMINATOR
`XXi
`
`154
`
`Y
`NUMERATOR
`XYi
`
`156
`
`Y
`DENOMINATOR
`XY
`
`18O
`
`PANASONIC EX1007, page 010
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 9 of 28
`
`5,880,411
`
`18O
`
`184
`
`
`
`
`
`
`
`REWIND
`
`CONTROL
`
`186
`
`FINGER
`
`HISTORY
`BUFFER
`
`
`
`FILTER
`
`UPDATE
`
`FINGER
`
`
`
`
`
`PANASONIC EX1007, page 011
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 10 0f 28
`
`5,880,411
`
`
`
`PANASONIC EX1007, page 012
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar 9, 1999
`
`Sheet 11 of 28
`
`5,880,411
`
`XMIN-Xo
`
`Xo XMAX
`
`- Y CENTER
`
`X CENTER
`
`FIG. 11
`
`240
`
`
`
`FIG. 12A
`
`PANASONIC EX1007, page 013
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 12 of 28
`
`5,880,411
`
`
`
`D
`D
`
`X FingerOuter
`
`260
`D
`
`Y FingerOuter
`
`FIG. 12B
`
`PANASONIC EX1007, page 014
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 13 of 28
`
`5,880,411
`
`
`
`292
`
`HELNEOx
`
`Hnox
`
`PANASONIC EX1007, page 015
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 14 of 28
`
`5,880,411
`
`20
`
`
`
`
`
`
`
`
`
`BUTTON
`CONTROL
`UNIT
`
`:
`
`FIG. 14
`
`TAP GESTURE
`Z
`ZA
`TAP- —
`
`DRAG GESTURE
`
`FIG. 15A
`
`FIG. 15B
`
`PANASONIC EX1007, page 016
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 15 of 28
`
`5,880,411
`
`TAP GESTURE WITH VARIABLE DRAG TIME
`EXPERT TAP
`ZA
`
`|
`
`OUT
`
`NOVICE TAP
`
`t2
`
`OUT
`
`z
`
`OUT
`
`FIG. 15C
`
`LOCKING DRAGGESTURE
`
`?
`
`t10
`
`ts
`
`tig
`
`\
`
`?
`
`t
`
`\
`
`? \
`t12
`
`t13
`
`.
`
`FIG. 15D
`
`PANASONIC EX1007, page 017
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 16 of 28
`
`5,880,411
`
`DRAG EXTENSIONS GESTURE
`
`z
`
`OUT
`
`| titsi to
`
`t17
`
`t18
`
`FIG. 15E
`
`DOUBLE TAP
`
`*—
`| titoit,
`
`OUT
`
`t22
`
`23
`
`FIG. 15F
`
`HOP GESTURE
`
`OUT (L)
`
`OUT(R)
`
`tes
`
`FIG. 15G
`
`PANASONIC EX1007, page 018
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 17 of 28
`
`5,880,411
`
`288
`
`290
`
`292
`
`FIG. f6A
`
`
`
`294
`
`296
`
`CornerX
`
`FIG. 16B
`
`PANASONIC EX1007, page 019
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 18 of 28
`
`5,880,411
`
`32O
`
`TAPOKAY & TRUE
`
`GF)
`
`N
`
`-(a)
`
`300
`
`START
`
`3O2
`
`304
`
`
`
`306
`
`Y
`
`PRE
`VIOUSLY
`DOWN
`?
`N
`
`TAP 3Dr.
`
`314
`
`308
`
`DST
`DRAGRADUS
`?
`
`Y
`
`NONE
`N Y
`
`
`
`DST
`DRAGEXTRADIU
`
`
`
`N
`
`
`
`316
`
`
`
`DRAG
`LOCKENABLED
`?
`
`31 O
`
`TAPSTATE & NONE
`
`312
`
`DOWNPOS & CURPOS
`DOWNTIME ( - CURTIME
`
`318
`
`TAPOKAY - FALSE
`SUPPRESS & FALSE
`
`FIG. 17A
`
`PANASONIC EX1007, page 020
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 19 of 28
`
`5,880,411
`
`324
`
`
`
`326
`
`PRE
`VIOUSLY
`UP
`
`TAP
`OUALIFIED
`2
`
`Y
`
`328
`
`REVERSE MOTION
`
`330
`TAP
`
`LOCKED
`
`NONE
`
`TAPSTATE - TAP
`
`336
`
`334
`
`
`
`USE LONG DRAG TIME
`SUPPRESS - TRUE
`
`N
`
`FIG. 17B
`
`PANASONIC EX1007, page 021
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 20 of 28
`
`5,880,411
`
`
`
`
`
`HOP
`OUALIFIED
`?
`
`340
`LEFT
`
`HOP
`DIRECTION
`
`RIGHT
`
`342
`\
`
`344
`
`TAPBUTTON & MDDLE
`
`TAPBUTTON - RIGHT
`
`346
`N
`
`CORNER
`TAP2
`
`Y
`
`348
`
`350
`
`TAPBUTTON - LEFT
`
`TAPBUTTON & RIGHT
`
`UPPOS - CURPOS
`
`352
`
`
`
`TAPSTATE { ... TAP
`
`354
`
`FIG. 17C
`
`PANASONIC EX1007, page 022
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 21 of 28
`
`5,880,411
`
`(c)
`
`356
`
`TAPSTATE -
`TAP
`p
`
`358
`Y
`
`DRAG
`LOCK
`ENABLED
`?
`
`360
`
`DRAG-EXT
`ENABLED
`?
`
`
`
`DRAGEXTSPEED
`
`
`
`364
`
`TAPSTATE c. LOCKED
`
`TAPSTATE - NONE
`
`368
`
`UPPOS - CURPOS
`
`FIG. 17D
`
`PANASONIC EX1007, page 023
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 22 of 28
`
`5,880,411
`
`
`
`370
`
`UPTIME & CURTIME
`
`
`
`
`
`372
`TAP
`
`TIME >
`
`DRAGTIME
`
`
`
`
`
`
`
`376
`
`TAPSTATE & NONE
`
`LOCKED
`
`
`
`-
`
`DESSK
`
`382
`
`TIME >
`DRAGEXTTIME
`2
`
`378
`
`END
`SUPPRESSION
`?
`
`
`
`384
`
`SUPPRESS & FALSE
`
`
`
`FIG. 17E
`
`PANASONIC EX1007, page 024
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 23 of 28
`
`5,880,411
`
`
`
`
`
`
`
`388
`
`OUT (-NONE
`
`TAPSTATE
`= NONE
`?
`
`OUT & - APBUTTON
`
`
`
`394
`
`OUT e-NONE
`
`
`
`396
`
`FIG 17F
`
`PANASONIC EX1007, page 025
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 24 of 28
`
`5,880,411
`
`START
`
`400
`
`WAT-3 SAMPLES
`
`402
`
`ZGZ ( - "X"
`ZIGZ" (- "X"
`
`404
`
`WAIT 1 SAMPLE
`
`406
`
`
`
`ZIGPOS - ZIGPOS
`ZIGPOS' & CURPOS
`
`41 O
`
`ZIGZ - ZIGZ"
`ZGZ' (-Z
`
`412
`
`FIG. 18A
`
`PANASONIC EX1007, page 026
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 25 of 28
`
`5,880,411
`
`ZGTIME - CURTME
`
`414
`
`ZIGLEFT - FALSE
`ZGRIGHT - FALSE
`
`46
`
`WAIT 1-2 SAMPLES
`
`418
`
`420
`
`42
`
`426
`
`N
`
`424
`Y-ZIGLEFT - TRUE
`
`428
`
`Y
`
`ZGRIGHT - TRUE
`
`WAIT 1 SAMPLE
`
`430
`
`43 s FIG. 18B
`
`PANASONIC EX1007, page 027
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 26 of 28
`
`5,880,411
`
`WAT 1-2 SAMPLES
`
`434
`
`436
`
`
`
`ZAG
`OUALIFIED
`
`REVERSE MOTION
`
`438
`
`440
`
`TRUE <>"
`
`442
`
`444
`
`OUT & LEFT
`
`OUT - RIGHT
`
`PAUSE
`
`OUT & NONE
`
`446
`
`448
`
`FIG. 18C
`
`PANASONIC EX1007, page 028
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 27 of 28
`
`5,880,411
`
`PUSH GESTURE
`
`ZPUSHDOWN
`
`ZTH
`
`ZA
`
`OUT
`
`ZPUSHUP
`
`FIG. 19
`
`450
`
`Y
`
`45
`6
`
`60
`4
`
`OUT & LEFT
`
`OUT (-NONE
`
`
`
`FIG. 20
`
`PANASONIC EX1007, page 029
` IPR2021-01115
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 28 of 28
`
`5,880,411
`
`
`
`SSE HddTIS,
`
`
`
`PANASONIC EX1007, page 030
` IPR2021-01115
`
`

`

`5,880,411
`
`1
`OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`RELATED APPLICATIONS
`This application is a continuation-in-part of co-pending
`application Ser. No. 08/320,158, filed Oct. 7, 1994, which is
`a continuation-in-part of application Ser. No. 08/300,387,
`filed Sep. 2, 1994, now abandoned which is a continuation
`in-part of application Ser. No. 08/115,743, filed Aug. 31,
`1993, now U.S. Pat. No. 5,374,787, which is a continuation
`in-part of application Ser. No. 07/895,934, filed Jun. 8, 1992,
`now abandoned.
`
`BACKGROUND OF THE INVENTION
`
`1O
`
`15
`
`2
`Strain gauge or pressure plate approaches are an interest
`ing position Sensing technology, but Suffer from Several
`drawbacks. This approach may employ piezo-electric trans
`ducers. One drawback is that the piezo phenomena is an AC
`phenomena and may be Sensitive to the user's rate of
`movement. In addition, Strain gauge or pressure plate
`approaches are Somewhat expensive because special Sensors
`are required.
`Optical approaches are also possible but are Somewhat
`limited for Several reasons. All would require light genera
`tion which will require external components and increase
`cost and power drain. For example, a "finger-breaking”
`infra-red matrix position detector consumes high power and
`suffers from relatively poor resolution.
`There have been numerous attempts to provide a device
`for Sensing the position of a thumb or other finger for use as
`a pointing device to replace a mouse or trackball. Desirable
`attributes of Such a device are low power, low profile, high
`resolution, low cost, fast response, and ability to operate
`reliably when the finger carries electrical noise, or when the
`touch Surface is contaminated with dirt or moisture.
`Because of the drawbacks of resistive devices, many
`attempts have been made to provide pointing capability
`based on capacitively Sensing the position of the finger. U.S.
`Pat. No. 3,921,166 to Volpe teaches a capacitive matrix in
`which the finger changes the transcapacitance between row
`and column electrodes. U.S. Pat. No. 4,103,252 to Bobick
`employs four oscillating Signals to interpolate X and y
`positions between four capacitive electrodes. U.S. Pat. No.
`4,455,452 to Schuyler teaches a capacitive tablet wherein
`the finger attenuates the capacitive coupling between elec
`trodes.
`U.S. Pat. No. 4,550,221 to Mabusth teaches a capacitive
`tablet wherein the effective capacitance to “virtual ground”
`is measured by an oscillating Signal. Each row or column is
`polled Sequentially, and a rudimentary form of interpolation
`is applied to resolve the position between two rows or
`columns. An attempt is made to address the problem of
`electrical interference by averaging over many cycles of the
`oscillating waveform. The problem of contamination is
`addressed by Sensing when no finger was present, and
`applying a periodic calibration during Such no-finger-present
`periods. U.S. Pat. No. 4,639,720 to Rympalski teaches a
`tablet for Sensing the position of a Stylus. The Stylus alters
`the transcapacitance coupling between row and column
`electrodes, which are scanned sequentially. U.S. Pat. No.
`4,736,191 to Matzke teaches a radial electrode arrangement
`under the Space bar of a keyboard, to be activated by
`touching with a thumb. This patent teaches the use of total
`touch capacitance, as an indication of the touch pressure, to
`control the Velocity of cursor motion. Pulsed Sequential
`polling is employed to address the effects of electrical
`interference.
`U.S. Pat. Nos. 4,686,332 and 5,149,919, to Greanias,
`teaches a Stylus and finger detection System meant to be
`mounted on a CRT. As a finger detection system, its X/Y
`Sensor matrix is used to locate the two matrix wires carrying
`the maximum signal. With a coding Scheme these two wires
`uniquely determine the location of the finger position to the
`resolution of the wire Stepping. For Stylus detection, Gre
`anias first coarsely locates it, then develops a virtual dipole
`by driving all lines on one side of the object in one direction
`and all lines on the opposite Side in the opposite direction.
`This is done three times with different dipole phases and
`Signal polarities. ASSuming a predetermined matrix response
`to the object, the three measurements present a Set of
`Simultaneous equations that can be Solved for position.
`
`25
`
`35
`
`40
`
`1. Field of the Invention
`The present invention relates to object position Sensing
`transducers and Systems. More particularly, the present
`invention relates to object position recognition useful in
`applications Such as cursor movement for computing
`devices and other applications, and especially to cursor
`movement with enhanced edge-motion and gesture
`recognition features.
`2. The Prior Art
`Numerous devices are available or have been proposed
`for use as object position detectors for use in computer
`Systems and other applications. The most familiar of Such
`devices is the computer “mouse”. While extremely popular
`as a position indicating device, a mouse has mechanical
`parts and requires a Surface upon which to roll its position
`ball. Furthermore, a mouse usually needs to be moved over
`long distances for reasonable resolution. Finally, a mouse
`requires the user to lift a hand from the keyboard to make the
`cursor movement, thereby upsetting the prime purpose,
`which is usually typing on the computer.
`Trackball devices are similar to mouse devices. A major
`difference, however is that, unlike a mouse device, a track
`ball device does not require a Surface acroSS which it must
`be rolled. Trackball devices are still expensive, have moving
`parts, and require a relatively heavy touch as do the mouse
`devices. They are also large in size and doe not fit well in a
`Volume-Sensitive application like a laptop computer.
`There are Several available touch-Sense technologies
`which may be employed for use as a position indicator.
`Resistive-membrane position Sensors are known and used in
`Several applications. However, they generally Suffer from
`poor resolution, the Sensor Surface is exposed to the user and
`is thus Subject to wear. In addition, resistive-membrane
`touch Sensors are relatively expensive. A one-Surface
`approach requires a user to be grounded to the Sensor for
`reliable operation. This cannot be guaranteed in portable
`computers. An example of a one-Surface approach is the
`UnMouse product by MicroTouch, of Wilmington, Mass. A
`55
`two-Surface approach has poorer resolution and potentially
`will wear out very quickly in time.
`Resistive tablets are taught by U.S. Pat. No. 4,680,430 to
`Yoshikawa, U.S. Pat. No. 3,497,617 to Ellis and many
`others. The drawback of all Such approaches is the high
`60
`power consumption and the high cost of the resistive mem
`brane employed.
`Surface Acoustic Wave (SAW) devices have potential use
`as position indicators. However, this Sensor technology is
`expensive and is not Sensitive to light touch. In addition,
`SAW devices are sensitive to residue buildup on the touch
`Surfaces and generally have poor resolution.
`
`45
`
`50
`
`65
`
`PANASONIC EX1007, page 031
` IPR2021-01115
`
`

`

`3
`U.S. Pat. No. 4,733,222 to Evans is the first to teach a
`capacitance touch measurement System that interpolates to a
`high degree. Evans teaches a three terminal measurement
`System that uses a drive, Sense and electrode signal Set (3
`Signals) in its matrix, and bases the measurement on the
`attenuation effect of a finger on the electrode node Signal
`(uses a capacitive divider phenomena). Evans sequentially
`Scans through each drive Set to measure the capacitance.
`From the three largest responses an interpolation routine is
`applied to determine finger position. Evans also teaches a
`Zeroing technique that allows “no-finger levels to be can
`celed out as part of the measurement.
`U.S. Pat. No. 5,016,008 to Gruaz describes a touch
`Sensitive pad that also uses interpolation. Gruaz uses a drive
`and Sense signal Set (2 Signals) in the touch matrix and like
`Evans relies on the attenuation effect of a finger to modulate
`the drive Signal. The touch matrix is Sequentially Scanned to
`read the response of each matrix line. An interpolation
`program then Selects the two largest adjacent Signals in both
`dimensions to determine the finger location, and rationmetri
`cally determines the effective position from those 4 num
`bers.
`Gerpheide, PCT application US90/04584, publication No.
`W091/03039, U.S. Pat. No. 5,305,017 applies to a touchpad
`System a variation of the virtual dipole approach of Grean
`ias. Gerpheide teaches the application of an oscillating
`potential of a given frequency and phase to all electrodes on
`one side of the Virtual dipole, and an oscillating potential of
`the same frequency and opposite phase to those on the other
`Side. Electronic circuits develop a “balance Signal” which is
`Zero when no finger is present, and which has one polarity
`if a finger is on one side of the center of the virtual dipole,
`and the opposite polarity if the finger is on the opposite Side.
`To acquire the position of the finger initially, the Virtual
`dipole is Scanned Sequentially acroSS the tablet. Once the
`finger is located, it is “tracked' by moving the virtual dipole
`toward the finger once the finger has moved more than one
`row or column.
`Because the Virtual dipole method operates by generating
`a balance Signal that is Zero when the capacitance does not
`vary with distance, it only Senses the perimeter of the finger
`contact area, rather than the entire contact area. Because the
`method relies on Synchronous detection of the exciting
`Signal, it must average for long periods to reject electrical
`interference, and hence it is slow. The averaging time
`required by this method, together with the necessity to
`Search Sequentially for a new finger contact once a previous
`contact is lost, makes this method, like those before it, fall
`Short of the requirements for a fast pointing device that is not
`affected by electrical interference.
`It should also be noted that all previous touch pad
`inventions that used interpolation placed rigorous design
`requirements on their Sensing pad. Greanias and Evans use
`a complicated and expensive drive, Sense and electrode line
`Scheme to develop their signal. Gruaz and Gerpheide use a
`two signal drive and Sense Set. In the present invention the
`driving and Sensing is done on the same line. This allows the
`row and column Sections to be Symmetric and equivalent.
`This in turn allows independent calibration of all signal
`paths, which makes board layout Simpler and less
`constraining, and allows for more unique Sensor topologies.
`The shortcomings of the inventions and techniques
`described in the prior art can also be traced to the use of only
`one Set of driving and Sensing electronics, which was
`multiplexed Sequentially over the electrodes in the tablet.
`This arrangement was cost effective in the days of discrete
`components, and avoided offset and Scale differences among
`circuits.
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`5,880,411
`
`15
`
`25
`
`4
`The Sequential Scanning approach of previous Systems
`also made them more Susceptible to noise. Noise levels
`could change between Successive measurements, thus
`changing the measured signal and the assumptions used in
`interpolation routines.
`Finally, all previous approaches assumed a particular
`Signal response for finger position verSuS matrix position.
`Because the transfer curve is very Sensitive to many param
`eters and is not a Smooth linear curve as Greanias and
`Gerpheide assume, Such approaches are limited in the
`amount of interpolation they can perform.
`In prior co-pending application Ser. No. 08/115,743, filed
`Aug. 31, 1993, now U.S. Pat. No. 5,734,787, a two
`dimensional capacitive Sensing System equipped with a
`Separate Set of drive/Sense electronics for each row and for
`each column of a capacitive tablet is disclosed. All row
`electrodes are Sensed simultaneously, and all column elec
`trodes are Sensed Simultaneously. The Sensed signals are
`processed by analog circuitry.
`Of the touchpad devices currently available, only the
`AlpS/Cirque GlidePoint includes gesture recognition. The
`GlidePoint Supports basic tap, double-tap, and draggestures
`to Simulate actions on a primary mouse button. It does not
`Support multiple-finger gestures, nor are there gestures for
`Simulating Secondary button clickS. No information is
`known about the implementation methods employed in the
`GlidePoint. However, the GlidePoint is known to have
`difficulty with double-taps, one of the problems addressed
`by the present invention. The GlidePoint exhibits a hesita
`tion on each finger-motion Stroke which may be an attempt
`to Stabilize the cursor during tap gestures. Also, the Glide
`Point must rely on physical Switches or extremely high gain
`or acceleration in order to allow drags over long distances.
`One touchpad product, the UnMouse, mounts a Switch
`underneath its resistive Sensor So that the user Simply presses
`down on the pad to activate the button. Aside from requiring
`fragile and complex mechanical mounting, this device also
`is reported to be very tiring to the user.
`Graphics tablets operated by a pressure Sensitive Stylus
`instead of a finger are well known in the art. These devices
`typically use a mechanism like the “push” gesture of the
`present invention to Simulate actuator Switches. No other
`gestures of the Sort described herein have been seen in Stylus
`operated tablets.
`It is thus an object of the present invention to provide a
`two-dimensional capacitive Sensing System equipped with a
`Separate Set of drive/Sense electronics for each row and for
`each column of a capacitive tablet, wherein all row elec
`trodes are Sensed simultaneously, and all column electrodes
`are Sensed Simultaneously.
`It is a further object of the present invention to provide an
`electronic System that is Sensitive to the entire area of
`contact of a finger or other conductive object with a capaci
`tive tablet, and to provide as output the coordinates of Some
`measure of the center of this contact area while remaining
`insensitive to the characteristic profile of the object being
`detected.
`It is a further object of the present invention to provide an
`electronic System that provides as output Some measure of
`area of contact of a finger or other conductive object with a
`capacitive tablet.
`Yet another object of the present invention is to provide a
`two-dimensional capacitive Sensing System equipped with a
`Separate Set of drive/Sense electronics for each row and for
`each column of a capacitive tablet, wherein all row elec
`trodes are Sensed simultaneously, and all column electrodes
`
`PANASONIC EX1007, page 032
` IPR2021-01115
`
`

`

`S
`are Sensed simultaneously and wherein the information
`defining the location of a finger or other conductive object
`is processed in digital form.
`It is a further object of the present invention to provide a
`two-dimensional capacitive Sensing System wherein all row
`electrodes are Sensed simultaneously, and all column elec
`trodes are Sensed simultaneously and wherein the location of
`a finger or other conductive object within a peripheral region
`of a Sensing plane can optionally cause cursor "edge
`motion' on a display Screen allowing control of large cursor
`excursions from a Small Sensi