United States Patent [19J
`Gillespie et al.
`
`[54]
`
`[75]
`
`OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`Inventors: David W. Gillespie, Palo Alto;
`Timothy P. Allen, Los Gatos; Ralph C.
`Wolf, Santa Clara; Shawn P. Day, San
`Jose, all of Calif.
`
`[73] Assignee: Synaptics, Incorporated, San Jose,
`Calif.
`
`[21] Appl. No.: 623,483
`
`[22] Filed:
`
`Mar. 28, 1996
`
`Related U.S. Application Data
`
`[51]
`
`[63] Continuation-in-part of Ser. No. 320,158, Oct. 7, 1994, Pat.
`No. 5,543,591, which is a continuation-in-part of Ser. No.
`300,387, Sep. 2, 1994, abandoned, which is a continuation(cid:173)
`in-part of Ser. No. 115,743, Aug. 31, 1993, Pat. No. 5,374,
`787, which is a continuation-in-part of Ser. No. 895,934,
`Jun. 8, 1992, abandoned.
`Int. Cl.6
`............................ G08C 21/00; G09G 5/08;
`G09G 5/00
`[52] U.S. Cl. ..................................... 178/18.01; 178/19.01;
`345/157; 345/159; 345/173
`[58] Field of Search .............................. 178/18.01, 19.01,
`178/20.01; 345/157, 159, 160, 173, 174;
`382/119, 186, 187, 316
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/1948 Holt .
`Re. 23,030
`2,219,497 10/1940 Stevens et al. .
`3,128,458
`4/1964 Romero .
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`0 187 372
`0 394 614
`0 490 001
`0 574 213
`0 589 498
`
`12/1985
`10/1990
`6/1992
`12/1993
`3/1994
`
`European Pat. Off.
`European Pat. Off.
`European Pat. Off.
`European Pat. Off.
`European Pat. Off.
`
`.......... GOlB 7/00
`........ G06F 3/033
`........ G06F 3/033
`G06K 11/16
`....... G06K 11/16
`
`I lllll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111
`US005880411A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,880,411
`Mar. 9, 1999
`
`0 609 021
`2 662 528
`60-205625
`62-126429
`63-073415
`2 040614
`4 015725
`
`8/1994 European Pat. Off ........ G06K 11/16
`5/1990 France ........................... G06K 11/16
`10/1985
`Japan ................................ G06F 3/03
`6/1987
`Japan .............................. G06F 3/033
`4/1988
`Japan .............................. G06F 3/033
`Japan ............................. G02G 1/133
`2/1990
`1/1992
`Japan .............................. G06F 3/033
`
`(List continued on next page.)
`
`OTHER PUBLICATIONS
`
`"Pressure-Sensitive Icons", IBM Technical Disclosure Bul(cid:173)
`letin, Jun. 1990, vol. 33, No. lB, pp. 277-278.
`"Scroll Control Box", IBM Technical Disclosure Bulletin,
`Apr. 1993, vol. 36, No. 4, pp. 399-403.
`Wilton, Microsoft Windows 3 Developer's Workshop, 1991,
`pp. 229-230.
`Tiburtius, "Transparente Folientastaturen", Feinwerktechnik
`& Messtechnik 97, No. 7, Munchen, DE, Jul. 1989, pp.
`299-300.
`"Double-Click Generation Method for Pen Operations",
`IBM Technical Disclosure Bulletin, Nov. 1992, vol. 35, No.
`6, p. 3.
`"Three-Axis Touch-Sensitive Pad", IBM Technical Disclo(cid:173)
`sure Bulletin, Jan. 1987, vol. 29, No. 8, pp. 3451-3453.
`Chun, et al., "A High-Performance Silicon Tactile Imager
`Based on a Capacitive Cell", IEEE Transactions on Electron
`Devices, Jul. 1985, vol. ED-32, No. 7, pp. 1196-1201.
`
`Primary Examiner-Vijay Shankar
`Attorney, Agent, or Firm--D' Alessandro & Ritchie
`
`[57]
`
`ABSTRACT
`
`Methods for recognizing gestures made by a conductive
`object on a touch-sensor pad and for cursor motion are
`disclosed. Tapping, drags, pushes, extended drags and vari(cid:173)
`able drags gestures are recognized by analyzing the position,
`pressure, and movement of the conductive object on the
`sensor pad during the time of a suspected gesture, and
`signals are sent to a host indicating the occurrence of these
`gestures. Signals indicating the position of a conductive
`object and distinguishing between the peripheral portion and
`an inner portion of the touch-sensor pad are also sent to the
`host.
`
`64 Claims, 28 Drawing Sheets
`
`6
`
`J
`
`12
`
`XINPUT
`PROCESSING
`
`16
`
`ARITH.
`UNIT
`
`Y INPUT
`PROCESSING
`
`18
`
`MOTION
`UNIT
`
`-LIX
`
`LIY
`
`20
`
`VIRTUAL
`BUTTONS
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 1 of 66
`
`

`

`5,880,411
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`3,207,905
`3,244,369
`3,401,470
`3,437,795
`3,482,241
`3,492,440
`3,493,791
`3,497,617
`3,497,966
`3,516,176
`3,522,664
`3,530,310
`3,543,056
`3,549,909
`3,593,115
`3,598,903
`3,662,378
`3,675,239
`3,683,371
`3,696,409
`3,732,389
`3,737,670
`3,757,322
`3,760,392
`3,773,989
`3,875,331
`3,921,166
`3,931,610
`3,932,862
`3,974,332
`3,992,579
`3,999,012
`4,056,699
`4,058,765
`4,071,691
`4,087,625
`4,103,252
`4,129,747
`4,148,014
`4,177,354
`4,177,421
`4,198,539
`4,221,975
`4,224,615
`4,246,452
`4,257,117
`4,264,903
`4,281,323
`4,290,052
`4,290,061
`4,291,303
`4,293,734
`4,302,011
`4,310,839
`4,313,113
`4,334,219
`4,371,746
`4,398,181
`4,423,286
`4,430,917
`4,442,317
`
`9/1965 Bray .
`4/1966 Nassimbene .
`9/1968 Gaven .
`4/1969 Kuljian .
`12/1969 Johnson .
`1/1970 Cerbone et al. .
`2/1970 Adelson et al. .
`2/1970 Ellis et al. .
`3/1970 Gaven .
`6/1970 Cleary et al. .
`8/1970 Lambright et al. .
`9/1970 Adelson et al. .
`11/1970 Klein .
`........................ 307/252
`12/1970 Adelson et al.
`7/1971 Dym et al. ................................ 323/93
`8/1971 Johnson et al. ........................... 178/18
`5/1972 MacArthur ....................... 340/347 DD
`7/1972 Ackerman et al. ..................... 340/365
`8/1972 Holz ........................................ 340/365
`10/1972 Braaten . ... ... ... .... ... ... ... ... ... .... .. 340/365
`5/1973 Kaelin et al. ....................... 200/167 A
`6/1973 Larson .................................... 307/116
`9/1973 Barkan et al. ...................... 340/365 C
`9 /1973 Stich .. ... ... ... ... .... ... ... ... ... ... .... .. 340/200
`11/1973 Hacon ................................... 200/52 R
`4/1975 Halsenbalg ................................ 178/19
`11/1975 Volpe .................................. 340/365 C
`1/1976 Marin et al. ... ... ... ... ... .... ... ... 340/172.5
`1/1976 Graven ............................... 340/324 M
`8/1976 Abe et al. ................................. 178/18
`11/1976 Dym et al. ................................ 178/18
`12/1976 Dym .......................................... 178/18
`11/1977 Jordan ..................................... 200/5 A
`11/1977 Richardson et al. .................. 324/61 R
`1/1978 Pepper, Jr.
`. ............................... 178/19
`5/1978 Dym et al. ................................ 178/19
`7/1978 Bobick ...................................... 331/48
`12/1978 Pepper, Jr.
`. ............................... 178/19
`4/1979 Burson .. ... ... ... .... ... ... ... ... ... .... .. 340/709
`12/1979 Mathews ................................... 178/18
`12/1979 Thornburg ............................ 324/61 R
`4/1980 Pepper, Jr.
`. ............................... 178/18
`9/1980 Lednicki et al. ........................ 307/116
`9 /1980 Penz ... ... ... ... ... .... ... ... ... ... ... .... .. 340/712
`1/1981 Chandler ................................. 200/5 A
`3/1981 Besson ...................................... 368/69
`4/1981 Bigelow .............................. 340/365 C
`7 /1981 Burnett et al. . ... ... ... ... .... ... ... ... 340/712
`. ... ... .... .. 340/365 C
`9 /1981 Eichelberger et al.
`9/1981 Serrano ................................... 340/712
`9/1981 Cutler et al. ............................ 340/711
`10/1981 Pepper, Jr.
`. ............................... 178/18
`11/1981 Pepper, Jr.
`. ............................... 273/85
`1/1982 Schwerdt ................................ 340/712
`1/1982 Thornburg .............................. 345/159
`6/1982 Paiilus et al. ........................... 340/712
`2/1983 Pepper, Jr.
`. ............................... 178/18
`8/1983 Yamamoto .......................... 340/365 S
`12/1983 Bergeron ................................... 178/19
`2/1984 Pepper, Jr.
`. .............................. 84/1.01
`4/1984 Jandrell ..................................... 178/18
`
`4,455,452
`4,475,235
`4,476,463
`4,511,760
`4,516,112
`4,526,043
`4,550,221
`4,550,310
`4,554,409
`4,570,149
`4,582,955
`4,595,913
`4,616,107
`4,639,720
`4,672,154
`4,680,430
`4,686,332
`4,698,461
`4,733,222
`4,734,685
`4,736,191
`4,758,690
`4,766,423
`4,788,385
`4,794,208
`4,820,886
`4,853,498
`4,914,624
`4,918,262
`4,922,061
`4,935,728
`4,988,982
`5,016,008
`5,117,071
`5,120,907
`5,149,919
`5,153,572
`5,194,862
`5,231,450
`5,239,140
`5,270,711
`5,327,161
`5,365,254
`5,369,227
`5,373,118
`5,374,787
`5,386,219
`5,408,593
`5,488,204
`
`6/1984 Schuyler ................................... 178/18
`10/1984 Graham ....................................... 382/3
`10/1984 Ng et al. ................................. 340/712
`4/1985 Garwin et al. ............................ 178/18
`5/1985 Chen ....................................... 340/365
`7/1985 Boie et al. ........................... 73/862.04
`10/1985 Mabusth .................................... 178/18
`10/1985 Yamaguchi et al. .................... 340/365
`. ... .... ... ... ... ... ... .... .. 178/19
`11/1985 Mitsui et al.
`2/1986 Thornburg et al. ..................... 338/114
`4/1986 Blesser . .... ... ... ... ... ... .... ... ... ... ... .. 178/19
`6/1986 Aubuchon ............................... 340/365
`10/1986 Abe et al. ................................. 178/18
`1/1987 Rympalski et al. ..................... 340/712
`. ... .... ... ... ... ... .... .. 178/19
`6/1987 Rodgers et al.
`7 /1987 Yoshikawa et al.
`.... ... ... ... ... ... ... 178/19
`8/1987 Greanias et al. . ... .... ... ... ... ... ... ... 178/19
`10/1987 Meadows et al.
`........................ 178/19
`3/1988 Evans .................................. 340/365 C
`3/1988 Watanabe ................................ 340/710
`4/1988 Matzke et al. ...................... 340/365 C
`7/1988 Kimura ..................................... 178/19
`8/1988 Ono et al. ............................... 340/709
`11/1988 Kimura .... ... ... ... ... ... .... ... ... ... ... .. 178/19
`12/1988 Watson ...................................... 178/19
`4/1989 Watson ...................................... 178/19
`8/1989 Meadows et al.
`........................ 178/19
`4/1990 Dunthorn ................................ 364/900
`4/1990 Flowers et al. ........................... 178/18
`5/1990 Meadows et al.
`........................ 178/19
`6/1990 Key ......................................... 340/709
`1/1991 Rayner et al.
`.......................... 345/173
`5/1991 Gruaz et al. .............................. 341/33
`5/1992 Greanias et al. .......................... 178/19
`6/1992 Shinbori et al. .......................... 478/18
`9/1992 Greanias et al. .......................... 178/19
`10/1992 Caldwell et al.
`....................... 340/712
`3/1993 Edwards .. .... ... ... ... ... .... ... ... ... ... .. 341/20
`7 /1993 Daniels .... ... ... ... ... ... .... ... ... ... ... .. 355 /27
`8/1993 Kuroda et al. ............................ 178/18
`12/1993 Knapp ....................................... 341/34
`7/1994 Logan et al. ............................ 345/157
`11/1994 Kawamoto .............................. 345/157
`11/1994 Stone ........................................ 178/18
`12/1994 Watson ...................................... 178/19
`12/1994 Miller et al. .............................. 178/18
`1/1995 Greanias et al. ........................ 345/174
`4/1995 Kotaki et al. ........................... 395/122
`1/1996 Mead et al. ............................. 345/179
`
`FOREIGN PATENT DOCUMENTS
`
`06 139022
`07 072 976
`2 139 762
`2 266 038
`2 288 665
`91/03039
`91/05327
`96/07966
`96/11435
`96/18179
`
`5/1994
`3/1995
`11/1984
`10/1993
`4/1995
`3/1991
`4/1991
`3/1996
`4/1996
`6/1996
`
`Japan .. .... ... ... ... ... ... .... ... .. G06F 3/033
`Japan .. .... ... ... ... ... ... .... ... .. G06F 3/033
`United Kingdom ............ G06F 3/033
`United Kingdom ............ G06F 3/033
`United Kingdom ........... G06K 11/12
`WIPO .............................. G09G 3/02
`WIPO .............................. G09G 3/02
`WIPO . ... .... ... ... ... ... .... ... .. G06F 3/033
`WIPO . ... .... ... ... ... ... .... ... .. G06F 3/033
`WIPO . ... .... ... ... ... ... .... ... . G08C 21/00
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 2 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 1of28
`
`5,880,411
`
`><
`<l
`
`>-
`<l
`
`z
`01-
`i=z
`0 '.:)
`~
`
`co
`.....
`
`(.0
`
`.....
`
`C\I
`.....
`
`0
`C\I
`
`><
`
`>-
`
`N
`
`II-
`1---z
`er:=>
`<.(
`
`CJ
`I-~
`=> (/)
`a_(/)
`zW
`-CJ
`><0 er:
`
`a_
`
`...J (/)
`<.( z
`'.:) ~
`l-1-
`er: '.:)
`>CO
`
`'.:) _
`w
`er: I-
`1-Z
`(/) '.:) w
`CJ
`
`CJ
`1-z
`=> (/)
`a_(/)
`zW
`-U >-0 er:
`
`a..
`
`)
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 3 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 2 of 28
`
`5,880,411
`
`30 30 30 30 30 30 30 30 30 30 30 30 30 30 30
`
`34
`
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • • 32
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`• • • • • • • • • • • • • •
`
`FIG. 2A
`
`28
`
`34
`
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`26
`
`FIG. 28
`
`2 2 /
`
`24
`
`24
`
`2 2 /
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 4 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 3 of 28
`
`5,880,411
`
`24
`
`FIG. 2C
`
`2::8
`24~~----~~~~-~-~-~-~-~~~~~
`I
`22
`
`FIG. 20
`
`36
`
`30
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 5 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 4 of 28
`
`5,880,411
`
`40 l
`
`44-1
`
`~
`
`~I>---~ FILTER,______ _
`
`48-1
`\
`
`S/H
`I
`
`50-1
`\
`
`____, S/H ,___
`
`52
`\
`
`16
`\
`
`I
`
`- -
`
`44-2
`
`l
`
`50-2
`\
`_,_,___,.,~1>----+----i FILTER ~-+-----1 S/H ,___
`S/H
`"><
`
`48-2
`\
`
`AID
`
`_ARITH.
`UNIT
`
`I
`
`~
`
`I
`.
`:
`48-n
`50-n
`\
`\
`--l-l---<l:lcl'>-----+---1 FILTER ,_____-+---____. S/H ~
`S/H
`VMAX VMIN
`
`44-n
`
`1 t><
`
`42-n/T
`__L_
`-=-
`-
`
`•t--~
`
`,.____
`
`I
`
`I
`
`48-VMAX
`
`50-VMAX
`
`\
`\
`~
`Fl L TE R ,__________,_______. S/H 1---------'
`42-ei-.+-+----<1><~----+----l S/H
`l
`
`-
`
`I
`
`•t--~ ·--
`--L-1----"'~ 1>-----+---i Fl L TER I---+-----' S/H 1 - - - -_ __ J
`42-'t:_I
`i
`
`44-VMJN
`
`"b<
`
`..... ' - -
`,.______
`
`-
`
`48-VMIN
`\
`
`50-VMIN
`\
`
`S/H
`I
`
`I
`
`I
`
`BIAS
`
`I I
`V 56
`CONTROL
`
`/
`
`46
`
`FIG. 3
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 6 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 5 of 28
`
`5,880,411
`
`Voo
`
`___,,.-- 62
`
`IN
`
`60
`
`I~ 1 72
`gr70
`
`-
`-
`
`-
`-
`
`44
`
`j
`
`66
`
`76
`
`\
`
`78 JBS ___,.--84
`
`OUT
`
`\
`86
`
`80___,.-
`
`~82
`--
`
`FIG. 4A
`
`Voo
`
`RESETUP
`
`94
`
`110 74---..___
`
`98---..___
`
`104
`\______
`
`IN
`
`60
`
`RES ETON
`
`___,,.-- 92
`
`Vs1AS
`STEPDN ~
`___,.--100
`
`112
`
`CHON ? SHARE
`
`116-=
`
`76
`
`OUT
`
`FIG. 48
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 7 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 6 of 28
`
`5,880,411
`
`IN
`
`ENl
`
`I
`
`RESET UP
`
`RESET ON
`
`STEP UP
`
`STEP ON
`
`SUP
`
`SON
`
`CHUP
`
`CHON
`
`SHARE
`
`OUT
`
`l
`
`120
`
`SCAN CYCLE
`
`FIG. 5
`
`48
`
`SAMPLE 5
`~
`I
`(
`122
`
`T~124
`
`126
`
`i
`
`_J_
`--
`
`FIG. 6
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 8 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 7 of 28
`
`5,880,411
`
`50-1-----1
`
`50-2 - - : -1 MUX ,____---<
`50-3----l
`50-4-----1
`
`132-1
`
`AID 1 - - - - - J
`
`REG.
`
`138-1
`
`52-1
`
`50-5--1----i
`50-5 --1----i1 MUX 1--+----1 AID 1------1
`50-7 -----i----i
`50-8 ----+--1
`
`52-2
`
`REG.
`
`138-2
`
`132-2
`
`50-9---
`
`50-10-----1MUX1-----<
`50-11 ----I
`50-12 - - - - ' - I
`
`132-3
`
`AID 1-----l
`
`REG.
`
`138-3
`
`52-3
`
`50-13 ---+-I
`50-14 ---+1--1 MUX 1---+---l AID 1-----l
`50-15 ---+---i
`50-16 ---+--I
`
`52-4
`
`REG.
`
`138-4
`
`132-4
`
`50-17----<
`50-18 ------'---1 MU X 1 - - - - - 1 AID 1------1
`50-19 _ _ ___..
`50-20 ------'--I
`
`52-5
`
`REG.
`
`138-5
`
`132-5
`
`50-21 ----+----<
`50-22 ---+-__. MUX l -+ - - : -1 AID 1 - - - - - J
`50-23 ---+---I
`50-24 ---+---I
`
`52-6
`
`REG.
`
`138-6
`
`I
`132-6 I
`
`I
`
`:to-~1,34
`
`136
`
`FIG. 7
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 9 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 8 of 28
`
`5,880,411
`
`174
`
`+
`
`Xpos
`
`178
`
`z
`
`z
`
`176
`
`..,...
`
`Ypos
`
`150
`
`x
`NUMERATOR
`
`Li Xi
`
`152
`
`x
`DENOMINATOR
`
`LXi
`
`154
`
`y
`NUMERATOR
`
`Li Yi
`
`156
`
`y
`DENOMINATOR
`
`LYi
`
`20
`
`ONx
`REG.
`
`158
`
`Oox
`REG.
`
`160
`
`170
`
`+
`
`0Nv
`REG.
`
`162
`
`Oov
`REG.
`
`164
`
`180
`
`Oz
`Z
`CALIBRATION UNIT REGAL
`
`FIG. 8
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 10 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 9 of 28
`
`5,880,411
`
`184
`
`REWIND
`
`HISTORY-~ ENABLE
`BUFFER
`
`CONTROL
`
`186
`
`180
`
`5
`
`182
`z
`
`FILTER
`
`Fz
`
`FINGER
`
`192
`
`UPDATE
`
`200
`
`Oz
`
`FORCE LOGIC REGAL
`
`198
`
`FINGER
`
`FIG. 9
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 11 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 10 of 28
`
`5,880,411
`
`.-::
`
`c >
`
`(.!)
`"<:t~
`
`C\I
`T""
`C\I
`
`(.!)
`T""
`C\I
`
`I(cid:173)=>
`0
`(/)
`<(
`iii
`>
`
`0
`C\I
`C\I
`
`\~111
`
`C\I
`C\I
`C\I
`
`a:>
`T""
`C\I
`
`\~111
`
`"<:t
`T""
`C\I
`
`111
`
`0
`T""
`C\I
`
`(.!)
`0
`C\I
`
`a
`
`'T-
`
`Qj
`G:
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 12 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 11 of 28
`
`5,880,411
`
`------------ ------------~--Yo
`
`I
`
`242
`
`______ L __ -y CENTER
`
`10
`
`- - - - -
`
`-Yo
`
`I
`
`X CENTER
`
`FIG. 11
`
`240
`
`XcuR
`
`Xo - - - t - - - -1
`
`246
`
`244
`
`J
`
`254
`~~~~~~~[J __ Finger
`Outer
`
`1
`
`Yo--+-----1
`
`-Yo--+-----1
`
`252
`
`YcuR
`
`FIG. 12A
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 13 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 12 of 28
`
`5,880,411
`
`XcuR
`
`Xo
`
`-Xo
`
`Yo
`
`-Yo-+----1
`
`YcuR
`
`246
`
`248
`
`250
`
`252
`
`256
`
`5 258
`
`X FingerOuter
`
`260
`
`Y FingerOuter
`
`FIG. 128
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 14 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 13 of 28
`
`5,880,411
`
`C\I co
`C\I
`~
`
`0
`a:
`w
`N
`
`<t:
`
`C\I
`r-..
`C\J
`
`~
`::)
`~
`
`(/)
`
`x
`
`"O
`
`~
`::)
`~
`
`co co
`
`C\J
`
`~ _J w
`
`0
`
`a:
`::>
`() x
`
`a:
`w
`1-z
`w -ii
`
`...... Q)
`Q)(cid:173)-.o
`:J ct!
`Oc
`..... w
`Q) c
`oio
`C--
`i.L 0
`~
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 15 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 14 of 28
`
`5,880,411
`
`A
`B
`
`x
`y
`z
`
`20
`
`~
`
`-
`
`280
`I
`
`TAP UNIT
`
`282
`I
`
`>---- >----
`
`•t--
`
`ZIG-ZAG
`UNIT
`
`284
`I
`PUSH UNIT
`
`-
`
`286
`\
`
`BUTTON
`CONTROL
`UNIT
`
`r - -
`
`r - -
`
`L
`M
`R
`
`~
`
`FIG. 14
`
`TAP GESTURE
`zrAP~
`zt
`1·
`
`OUT
`
`/
`\
`• 11~ ~~~~~~1-f---c-t3---i·1
`
`t1
`
`L
`
`DRAG GESTURE
`
`OUT
`
`FIG. 15A
`
`FIG. 158
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 16 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 15 of 28
`
`5,880,411
`
`TAP GESTURE WITH VARIABLE DRAG TIME
`
`EXPERT TAP
`\______
`z+
`
`I"'
`
`OUT
`
`NOVICE TAP
`\______
`z+
`
`1·
`
`OUT
`
`·1
`
`t1
`
`1·
`
`t 1
`
`·1
`
`FIG. 15C
`
`LOCKING DRAG GESTURE
`
`OUT __ __.
`
`\...__/
`
`14-1"' -1-11-· 1
`
`FIG. 150
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 17 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 16 of 28
`
`5,880,411
`
`DRAG EXTENSIONS GESTURE
`
`OUT
`
`--~
`
`DOUBLE TAP
`z+
`
`OUT
`
`HOP GESTURE
`z+
`
`I
`
`\
`1·
`
`I
`·1
`
`t11
`
`\
`
`I
`
`FIG. 15E
`
`FIG. 15F
`
`FIG. 15G
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 18 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 17 of 28
`
`5,880,411
`
`288
`
`290
`
`292
`
`L
`
`M
`
`R
`
`FIG. 16A
`
`294
`
`CornerY
`
`296
`
`R
`
`---------- CornerX
`
`L
`
`FIG. 168
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 19 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 18 of 28
`
`5,880,411
`
`300
`
`START
`
`N
`
`322
`
`NONE
`
`314
`
`TAPOKAY f- TRUE
`
`310
`
`TAPSTATE f- NONE
`
`312
`
`DOWNPOS f- CURPOS
`DOWNTIME f- CURTIME
`
`318
`
`TAPOKAY f- FALSE
`SUPPRESS f- FALSE
`
`FIG. 17A
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 20 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 19 of 28
`
`5,880,411
`
`y
`
`N
`
`y
`
`328
`
`REVERSE MOTION
`
`LOCKED
`
`NONE
`
`TAPSTATE f-- TAP
`
`336
`
`334
`
`332
`y
`
`USE LONG DRAG TIME
`SUPPRESS f-- TRUE
`
`N
`
`FIG. 178
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 21 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 20 of 28
`
`5,880,411
`
`LEFT
`
`RIGHT
`
`342
`
`344
`
`TAPBUTTON ~MIDDLE
`
`TAPBUTTON ~ RIGHT
`
`y
`
`348
`
`350
`
`TAPBUTTON ~ LEFT
`
`TAPBUTTON ~ RIGHT
`
`UPPOS ~ CURPOS
`
`352
`
`TAPSTATE ~TAP
`
`354
`
`FIG. 17C
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 22 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 21 of 28
`
`5,880,411
`
`N
`
`N
`
`N
`
`N
`
`362
`y
`
`364
`
`TAPSTATE f- LOCKED
`
`TAPSTATE f- NONE
`
`366
`
`368
`
`UPPOS f- CURPOS
`
`FIG. 170
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 23 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 22 of 28
`
`5,880,411
`
`370
`
`UPTIME ~ CURTIME
`
`LOCKED
`
`N
`
`NONE
`
`y
`
`y
`
`376
`
`TAPSTATE ~ NONE
`
`N
`
`N
`
`y
`
`384
`
`SUPPRESS~ FALSE
`
`FIG. 17E
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 24 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 23 of 28
`
`5,880,411
`
`y
`
`388
`
`OUT f- NONE
`
`392
`
`N
`>---- OUT f- TAPBUTTON ,______,
`
`y
`
`394
`
`OUT f- NONE
`
`396
`
`END
`
`FIG. 17F
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 25 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 24 of 28
`
`5,880,411
`
`START
`
`400
`
`WAIT -3 SAMPLES
`
`402
`
`ZIGZ f- "X"
`ZIGZ' f- "X"
`
`404
`
`WAIT 1 SAMPLE
`
`406
`
`410
`
`412
`
`ZIGPOS f- ZIGPOS'
`ZIGPOS' f- CURPOS
`
`ZIGZ f- ZIGZ'
`ZIGZ' f-Z
`
`FIG. 18A
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 26 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 25 of 28
`
`5,880,411
`
`ZIGTIME f- CURTIME
`
`ZIGLEFT f- FALSE
`ZIGRIGHT f- FALSE
`
`WAIT 1-2 SAMPLES
`
`414
`
`416
`
`418
`
`y
`
`cb
`
`FIG. 188
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 27 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 26 of 28
`
`5,880,411
`
`WAIT 1-2 SAMPLES
`
`434
`
`REVERSE MOTION
`
`438
`
`TRUE
`
`FALSE
`
`442
`
`444
`
`OUT f-- LEFT
`
`OUT f-- RIGHT
`
`PAUSE
`
`OUT f-- NONE
`
`446
`
`448
`
`FIG. 18C
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 28 of 66
`
`

`

`U.S. Patent
`
`Mar. 9, 1999
`
`Sheet 27 of 28
`
`5,880,411
`
`PUSH GESTURE
`
`ZPLJSHDOWN
`
`zt
`
`OUT
`
`ZPUSHUP
`
`FIG. 19
`
`START
`
`450
`
`NONE
`
`LEFT
`
`N
`
`N
`
`y
`
`y
`
`OUT~ LEFT
`
`OUT~ NONE
`
`462
`
`END
`
`FIG. 20
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 29 of 66
`
`

`

`x
`
`y
`
`LIFT JUMP
`
`s
`
`482
`
`FIG. 21
`
`d •
`\JJ.
`•
`~
`~ ......
`~ = ......
`
`~
`~
`!""l
`~~
`'"""' ~
`
`~
`~
`
`'Jl =(cid:173)~
`~ .....
`N
`00
`0 .....,
`N
`00
`
`. SUPPRESS
`MOTION
`
`Ul
`....
`00
`
`00 =
`
`....
`~
`~
`~
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 30 of 66
`
`

`

`5,880,411
`
`1
`OBJECT POSITION DETECTOR WITH
`EDGE MOTION FEATURE AND GESTURE
`RECOGNITION
`
`RELATED APPLICATIONS
`
`This application is a continuation-in-part of co-pending
`application Ser. No. 08/320,158, filed Oct. 7, 1994, which is
`a continuation-in-part of application Ser. No. 08/300,387,
`filed Sep. 2, 1994, now abandoned which is a continuation(cid:173)
`in-part of application Ser. No. 08/115,743, filed Aug. 31,
`1993, now U.S. Pat. No. 5,374,787, which is a continuation(cid:173)
`in-part of application Ser. No. 07/895,934, filed Jun. 8, 1992,
`now abandoned.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`The present invention relates to object position sensing
`transducers and systems. More particularly, the present
`invention relates to object position recognition useful in
`applications such as cursor movement for computing
`devices and other applications, and especially to cursor
`movement with enhanced edge-motion and gesture(cid:173)
`recognition features.
`2. The Prior Art
`Numerous devices are available or have been proposed
`for use as object position detectors for use in computer
`systems and other applications. The most familiar of such
`devices is the computer "mouse". While extremely popular
`as a position indicating device, a mouse has mechanical
`parts and requires a surface upon which to roll its position
`ball. Furthermore, a mouse usually needs to be moved over
`long distances for reasonable resolution. Finally, a mouse
`requires the user to lift a hand from the keyboard to make the
`cursor movement, thereby upsetting the prime purpose,
`which is usually typing on the computer.
`Trackball devices are similar to mouse devices. A major
`difference, however is that, unlike a mouse device, a track(cid:173)
`ball device does not require a surface across which it must
`be rolled. Trackball devices are still expensive, have moving
`parts, and require a relatively heavy touch as do the mouse
`devices. They are also large in size and doe not fit well in a
`volume-sensitive application like a laptop computer.
`There are several available touch-sense technologies
`which may be employed for use as a position indicator.
`Resistive-membrane position sensors are known and used in
`several applications. However, they generally suffer from
`poor resolution, the sensor surface is exposed to the user and
`is thus subject to wear. In addition, resistive-membrane
`touch sensors are relatively expensive. A one-surface
`approach requires a user to be grounded to the sensor for
`reliable operation. This cannot be guaranteed in portable
`computers. An example of a one-surface approach is the
`UnMouse product by Micro Touch, of Wilmington, Mass. A
`two-surface approach has poorer resolution and potentially
`will wear out very quickly in time.
`Resistive tablets are taught by U.S. Pat. No. 4,680,430 to
`Yoshikawa, U.S. Pat. No. 3,497,617 to Ellis and many
`others. The drawback of all such approaches is the high
`power consumption and the high cost of the resistive mem(cid:173)
`brane employed.
`Surface Acoustic Wave (SAW) devices have potential use
`as position indicators. However, this sensor technology is
`expensive and is not sensitive to light touch. In addition,
`SAW devices are sensitive to residue buildup on the touch
`surfaces and generally have poor resolution.
`
`15
`
`2
`Strain gauge or pressure plate approaches are an interest(cid:173)
`ing position sensing technology, but suffer from several
`drawbacks. This approach may employ piezo-electric trans(cid:173)
`ducers. One drawback is that the piezo phenomena is an AC
`5 phenomena and may be sensitive to the user's rate of
`movement. In addition, strain gauge or pressure plate
`approaches are somewhat expensive because special sensors
`are required.
`Optical approaches are also possible but are somewhat
`10 limited for several reasons. All would require light genera(cid:173)
`tion which will require external components and increase
`cost and power drain. For example, a "finger-breaking"
`infra-red matrix position detector consumes high power and
`suffers from relatively poor resolution.
`There have been numerous attempts to provide a device
`for sensing the position of a thumb or other finger for use as
`a pointing device to replace a mouse or trackball. Desirable
`attributes of such a device are low power, low profile, high
`resolution, low cost, fast response, and ability to operate
`20 reliably when the finger carries electrical noise, or when the
`touch surface is contaminated with dirt or moisture.
`Because of the drawbacks of resistive devices, many
`attempts have been made to provide pointing capability
`based on capacitively sensing the position of the finger. U.S.
`25 Pat. No. 3,921,166 to Volpe teaches a capacitive matrix in
`which the finger changes the transcapacitance between row
`and column electrodes. U.S. Pat. No. 4,103,252 to Babick
`employs four oscillating signals to interpolate x and y
`positions between four capacitive electrodes. U.S. Pat. No.
`30 4,455,452 to Schuyler teaches a capacitive tablet wherein
`the finger attenuates the capacitive coupling between elec(cid:173)
`trodes.
`U.S. Pat. No. 4,550,221 to Mabusth teaches a capacitive
`tablet wherein the effective capacitance to "virtual ground"
`35 is measured by an oscillating signal. Each row or column is
`polled sequentially, and a rudimentary form of interpolation
`is applied to resolve the position between two rows or
`columns. An attempt is made to address the problem of
`electrical interference by averaging over many cycles of the
`40 oscillating waveform. The problem of contamination is
`addressed by sensing when no finger was present, and
`applying a periodic calibration during such no-finger-present
`periods. U.S. Pat. No. 4,639,720 to Rympalski teaches a
`tablet for sensing the position of a stylus. The stylus alters
`45 the transcapacitance coupling between row and column
`electrodes, which are scanned sequentially. U.S. Pat. No.
`4,736,191 to Matzke teaches a radial electrode arrangement
`under the space bar of a keyboard, to be activated by
`touching with a thumb. This patent teaches the use of total
`50 touch capacitance, as an indication of the touch pressure, to
`control the velocity of cursor motion. Pulsed sequential
`polling is employed to address the effects of electrical
`interference.
`U.S. Pat. Nos. 4,686,332 and 5,149,919, to Greanias,
`55 teaches a stylus and finger detection system meant to be
`mounted on a CRT. As a finger detection system, its X/Y
`sensor matrix is used to locate the two matrix wires carrying
`the maximum signal. With a coding scheme these two wires
`uniquely determine the location of the finger position to the
`60 resolution of the wire stepping. For stylus detection, Gre(cid:173)
`anias first coarsely locates it, then develops a virtual dipole
`by driving all lines on one side of the object in one direction
`and all lines on the opposite side in the opposite direction.
`This is done three times with different dipole phases and
`65 signal polarities. Assuming a predetermined matrix response
`to the object, the three measurements present a set of
`simultaneous equations that can be solved for position.
`
`Microsoft Ex. 1018
`Microsoft v. Philips - IPR2018-00025
`Page 31 of 66
`
`

`

`5,880,411
`
`5
`
`3
`U.S. Pat. No. 4,733,222 to Evans is the first to teach a
`capacitance touch measurement system that interpolates to a
`high degree. Evans teaches a three terminal measurement
`system that uses a drive, sense and electrode signal set (3
`signals) in its matrix, and bases the measurement on the
`attenuation effect of a finger on the electrode node signal
`(uses a capacitive divider phenomena). Evans sequentially
`scans through each drive set to measure the capacitance.
`From the three largest responses an interpolation routine is
`applied to determine finger position. Evans also teaches a
`zeroing technique that allows "no-finger" levels to be can(cid:173)
`celed out as part of the measurement.
`U.S. Pat. No. 5,016,008 to Gruaz describes a touch
`sensitive pad that also uses interpolation. Gruaz uses a drive
`and sense signal set (2 signals) in the touch matrix and like
`Evans relies on the attenuation effect of a finger to modulate
`the drive signal. The touch matrix is sequentially scanned to
`read the response of each matrix line. An interpolation
`program then selects the two largest adjacent signals in both
`dimensions to determine the finger location, and ratiometri(cid:173)
`cally determines the effective position from those 4 num- 20
`be rs.
`Gerpheide, PCT application US90/04584, publication No.
`W091/03039, U.S. Pat. No. 5,305,017 applies to a touch pad
`system a variation of the virtual dipole approach of Grean(cid:173)
`ias. Gerpheide teaches the application of an oscillating
`potential of a given frequency and phase to all electrodes on
`one side of the virtual dipole, and an oscillating potential of
`the same frequency and opposite phase to those on the other
`side. Electronic circuits develop a "balance signal" which is
`zero when no finger is present, and which has one polarity
`if a finger is on one side of the center of the virtual dipole,
`and the opposite polarity if the finger is on the opposite side.
`To acquire the position of the finger initially, the virtual
`dipole is scanned sequentially across the tablet. Once the
`finger is located, it is "tracked" by moving the virtual dipole
`toward the finger once the finger has moved more than one
`row or column.
`Because the virtual dipole method operates by generating
`a balance signal that is zero when the capacitance does not
`vary with distance, it only senses the perimeter of the finger
`contact area, rather than the entire contact area. Because the
`method relies on synchronous detection of the exciting
`signal, it must average for long periods to reject electrical
`interference, and hence it is slow. The averaging time
`required by thi