[19]
`United States Patent
`6,005,549
`[11] Patent Number:
`[45] Date of Patent: *Dec. 21, 1999
`Forest
`
`
`
`USOO6005549A
`
`[54] USER INTERFACE METHOD AND
`APPARATUS
`
`[76]
`
`Inventor: Donald K. Forest, 209 Croydon Ave.,
`Rockville, Md. 20850-4145
`
`[*l
`
`NOtiCCI
`
`This patent issued on a continued pros-
`ecution application filed under 37 CFR
`1.53(d), and is subject to the twenty year
`patent
`term provisions of 35 U.S.C.
`154(a)(2).
`This patent is subject to a terminal dis-
`claimer.
`
`[21] Appl. No.: 08/506,445
`
`[22]
`
`Filed:
`
`Jul. 24, 1995
`
`Related US. Application Data
`
`[63]
`
`Continuation—in—part of application No. PCT/US95/03591,
`Mar. 27, 1995.
`
`Int. Cl.6 ....................................................... G09G 5/08
`[51]
`[52] US. Cl.
`.......................... 345/157; 345/146; 345/171;
`345/902
`
`[58] Field of Search ................................ 345/173, 7, 146,
`345/902, 157, 158, 145, 156, 171, 395/352,
`353, 354, 355, 751, 758
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`3,541,521
`4,109,145
`
`11/1970 Koster.
`8/1978 Graf.
`
`(List continued on next page.)
`FOREIGN PATENT DOCUMENTS
`
`PCHY
`AU8500324
`0324306 A2
`
`7/1986 Australia .
`7/1989 European Pat. Off.
`
`.
`
`OTHER PUBLICATIONS
`
`Jacob, Robert J .K., “What you look at is what you get,”
`Computer, vol. 26, No. 7, Jul. 1993, Los Alamitos, CA. pp.
`65 & 66.
`
`Bryan, R.E.; Chang , F.C.; Hempel, B.C., Iida, Y.; “Pre—se-
`lection highlighting,” IBM Technical Disclosure Bulletin,
`vol. 32, No. 8b, Jan. 1990, New York, NY, XP 000082441.
`pp. 231 & 232.
`
`(List continued on next page.)
`
`Primary Examiner—Regina Liang
`
`[57]
`
`ABSTRACT
`
`The apparatus and method of the invention relate to data
`entry and menu selection. Applications include: (a) data
`entry for ideographic languages, including Chinese, Japa-
`nese and Korean; (b) fast food ordering; (c) correction of
`documents generated by optical character recognition; and
`(d) computer access and speech synthesis by persons tem-
`porarily or permanently lacking normal motor capabilities.
`In a preferred embodiment, each option of a menu is
`associated respectively with a selectable region displayed
`adjacent an edge of a display, forming a perimeter menu and
`leaving a region in the center of the perimeter menu for the
`output of an application program. Selectable regions may be
`on the display, outside the display, or both. A menu option
`may be selected by clicking on the associated selectable
`region, by dwelling on it for a selection threshold period or
`by a cursor path toward the selectable region, or by a
`combination thereof. Remaining dwell
`time required to
`select a selectable region is preferably indicated by the
`brightness of the selectable region. Submenus of a perimeter
`menu may also be perimeter menus and the location of a
`submenu option may be foretold by the appearance of its
`parent menu option. Menu options may be ideographs
`sharing a sound, a structure or another characteristic.
`Ideographs, which may be homophones of one another, may
`be associated with colored indicating regions and selection
`of an ideograph may be made by speaking the name of the
`associated color.
`
`(List continued on next page.)
`
`128 Claims, 67 Drawing Sheets
`
`3606
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`3646
`
`3626
`
`3644
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`6,005,549
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`2173023
`94003887
`
`10/1986 United Kingdom.
`2/1994 WIPO .................................... 345/173
`
`OTHER PUBLICATIONS
`
`Becker, Joseph D., “User Firendly Design for Japanese
`Typing,” Xerox Office Systems Division Publication No.
`T8301, Xerox Corp., Palo Alto, CA, Aug. 1983. pp. 14 & 15.
`“Drawing Gallery,” In The Graphics Gallery Release 3.0
`User Manual, Hewlett—Packard
`Co.,
`Boise,
`ID:
`Hewlett—Packard Co., 1988, pp. 2—6 & 2—7.
`CTI Electronics Corporation, “Model M80XX Industrial
`Mouse” product flyer, CTI Electronics Corporation, Strat-
`ford, CT.
`CTI Electronics Corporation, “Joysticks, Touchscreens, &
`Trackballs”, product flyer, CTI Electronics Corporation,
`Stratford, CT.
`Don Johnston Developmental Equipment, Inc., “Conriter”
`product brochure, Don Johnston Developmental Equipment,
`Inc., Wauconda, IL.
`Downing, Andrew; Martin, Byron; Stern, Loon, “Methods
`for Measuring the Characteristics of Movements of Motor-
`—Impaired Children”, Assistive Technology, vol. 2, pp.
`131—141, Resna Press, Washington, DC, 1990.
`Hamann, Gil, “Two Switchless Selection Techniques Using
`a Headpointing Device for Graphical User Interfaces” in
`Proceedings of the 13th Annual Resna Conference, pp.
`439—440, Resna Press, Washington, DC, 1990.
`LC Technologies, Inc. “The Eyegaze System” product bro-
`chure, LC Technologies, Inc., Fairfax, VA.
`Lin, Mei Li; Radwin, Robert G.; Vanderheiden, Gregg C.,
`Gain Effects on Performance Using a Head—Controlled
`Computer Input Device, Ergonomics, vol. 35, N0. 2, pp.
`159—175, 1992.
`Mayer—Johnson Company, “Non—Speech Communication
`Products 1992” catalog, Mayer—Johnson Company, Solana,
`Beach, CA.
`Origin Instruments Corporation, “HeadMouse Manual”,
`Origin Instruments Corporation, Grand Prairie, TX.
`Perricos, Costi; Jackson, Robin D., “A Head Gesture Rec-
`ognition System for Computer Access” in Proceedings ofthe
`Resna ’94 Annual Conference, Resna Press, Washington,
`DC, pp. 92—94, 1994.
`Prentke Romich Company, “1994—1995 Catalog”, Prentke
`Romich Company, Wooster, OH.
`Prentke Romich Company, “AlphaTalkerTM” product bro-
`chure, Prentke Romich Company, Wooster, OH.
`Prentke Romich Company, “DeltaTalkerTM” product bro-
`chure, Prentke Romich Company, Wooster, OH.
`Prentke Romich Company, “LiberatorTM” reference manual,
`version 1.03, Prentke Romich Company, Wooster, OH,
`1992.
`
`Prentke Romich Company, “Operator’s Manual for Remote
`HeadMaster Mouse Emulator”, Prentke Romich Company,
`Wooster, OH.
`Quartet Technologies, Inc., “Switch Activated Environment
`Control Units, Simplicity Series 7 and Series 7M” product
`flyer, Quartet Technology, Inc., Chelmsford, MA.
`Quartet Technologies, Inc., “Voice and Switch Activated
`All—In—One Environmental Control Unit” product flyer,
`Quartet Technology, Inc., Chelmsford, MA.
`Quartet Technologies, Inc., “Voice Activated Environmental
`Control Units, Simplicity Series 5,6 & 6 Plus!” product flyer,
`Quartet Technology, Inc., Chelmsford, MA.
`Quartet Technologies, Inc., “Mouse/Keyboard Controller”,
`product flyer, Quartet Technology, Inc., Chelmsford, MA.
`
`SAMSUNG EX. 1007
`
`4/1979
`4,149,716
`1/1980
`4,181,813
`9/1981
`4,291,198
`1/1982
`4,310,839
`6/1982
`4,336,421
`8/1982
`4,345,313
`4,354,184 10/1982
`4,354,185
`10/1982
`4,386,346
`5/1983
`4,393,271
`7/1983
`4,531,119
`7/1985
`4,555,193
`11/1985
`4,559,598 12/1985
`4,586,035
`4/1986
`4,587,520
`5/1986
`4,591,841
`5/1986
`4,595,990
`6/1986
`4,638,312
`1/1987
`4,648,028
`3/1987
`4,651,145
`3/1987
`4,665,402
`5/1987
`4,679,951
`7/1987
`4,720,189
`1/1988
`4,748,502
`5/1988
`4,751,503
`6/1988
`4,788,649
`11/1988
`4,829,576
`5/1989
`4,931,783
`6/1990
`4,979,094 12/1990
`4,987,411
`1/1991
`5,012,231
`4/1991
`5,020,107
`5/1991
`5,027,109
`6/1991
`5,027,406
`6/1991
`5,122,951
`6/1992
`5,146,210
`9/1992
`5,164,900
`11/1992
`5,175,688 12/1992
`5,177,328
`1/1993
`5,195,179
`3/1993
`5,220,361
`6/1993
`5,223,828
`6/1993
`5,233,662
`8/1993
`5,254,983
`10/1993
`5,257,314 10/1993
`5,266,931
`11/1993
`5,285,265
`2/1994
`5,287,119
`2/1994
`5,289,168
`2/1994
`5,300,943
`4/1994
`5,305,435
`4/1994
`5,329,609
`7/1994
`5,387,896
`2/1995
`5,396,264
`3/1995
`5,408,582
`4/1995
`5,428,707
`6/1995
`5,429,513
`7/1995
`5,454,062
`9/1995
`5,586,198 12/1996
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`Scudder .
`Marley .
`.
`Anderson et al.
`Schwerdt
`................................ 345/1 73
`Welch et al.
`.
`Knox .
`Worborschil .
`Worborschil .
`Levine .
`.
`Fujinami et al.
`Nakayama et al.
`Stone .
`Goldwasser et al.
`Baker et al.
`.
`Astle ....................................... 345/1 45
`Gunderson et al.
`.
`Carwin et al.
`.
`.
`Quinn et al.
`DeKlotz et al.
`Sutter .
`Young .
`.
`King et al.
`.
`Heynen et al.
`Friedman et al.
`Kermisch .
`Shea et al.
`Porter .
`Atkinson .
`Gemmell et al.
`Ishigami .
`Felsenstein .
`.
`Rohani et al.
`Donovan et al.
`Roberts et al.
`.
`Kamiya .
`Heberle .
`Bernath .
`Sasaki et al.
`Ito et al.
`.
`Tokunaga .
`Lehmer et al.
`McKiel, Jr.
`.
`Christensen .
`Long et al.
`.
`Kimura .
`Tanaka .................................... 345/1 73
`Choi .
`Drumm .
`Freeman .
`Jakobs et al.
`Bronson .
`Sanada et al.
`Allapat et al.
`Falcone et al.
`Colier .
`Gould et al.
`Diaz—Plaza .
`LaRue .
`Lakritz .
`
`........................... 345/173
`
`.
`.
`
`.
`
`.
`
`FOREIGN PATENT DOCUMENTS
`
`9300231
`54—19618
`357059241
`357073453
`61—121185
`6—149338
`920303807
`7—295784
`2116341
`
`8/1993
`2/1979
`4/1982
`5/1982
`6/1986
`5/1994
`5/1995
`11/1995
`9/1983
`
`Germany .
`Japan .
`Japan .
`Japan .
`Japan .
`Japan .
`Japan .
`Japan .
`United Kingdom .
`
`SAMSUNG EX. 1007
`
`

`

`6,005,549
`Page 3
`
`Sentient Systems Technology, Inc., “DynaVox” product bro-
`chure, Sentient Systems Technology, Inc., Pittsburg, PA.
`Sentient Systems Technology, Inc., “DigiVox” product bro-
`chure, Sentient Systems Technology, Inc., Pittsburg, PA.
`Treviranus, Jutta, “Quartering, Halving, Gesturing: Com-
`puter Access Using Imprecise Pointing” in Proceedings of
`the Resna International Conference ’92, Resna Press, Wash-
`ington, DC, pp. 374—376, 1992.
`Vanderheiden, Gregg C.; Kelso, D.P., “Comparative Analy-
`sis of Fixed—Vocabulary Communication Techniques”,
`Trace Center, University of Wisconsin, Madison, WI, 1987.
`Callahan, Jack; Hopkins, Don; Weiser, Mark; Schneider-
`man, Ben, “An Empirical Comparison of Pie vs. Linear
`Menus,” Computer Science Technical Report Series
`CS—TR—1919, College Park, MD: University of Maryland,
`Sep. 1987. p. 1 only. This page was inadvertently omitted
`from an earlier filed Information Disclosure Statement.
`
`“Discrete and continuous control using stable speech
`sounds”, IBM Technical Disclosure Bulletin, vol. 33, No.
`10a, Mar. 1991, New York, NY, XP 000110092, p. 378. See
`the entire document.
`
`PCT International Search Report, International Application
`No. PCT/US95/03591, dated Mar. 28, 1996. This Interna-
`tional Application is the parent of the present Application.
`Yamada, Mitsuho; Fukada, Tadahiko, “Eye word processor
`(EWP) and peripheral controller for
`the ALS patient”,
`I.E.E.E. Proceedings A Physical Scinece, Measurement &
`Instrumentation, Management & Education, Apr. 1987, vol.
`134, No. 4, Part A, Stevenage & Herts, Great Britain, pp.
`328—330. See the entire document.
`
`Callahan, Jack; Hopkins, Don; Weiser, Mark; Schneider-
`man, Ben, “An Empirical Comparison of Pie vs. Linear
`Menus,” Computer Science Technical Report Series
`CS—TR—1919, College Park, MD: University of Maryland,
`Sep. 1987. See p. 5.
`“Darci Too Product Description,” WesTest Engineering
`Corp., Bountiful, UT: WesTest Engineering Corp., 1992. See
`pp. 1 & 3.
`
`Goosens, Carol; Crain, Sharon Sapp, “Overview of Cur-
`rently Used Eye—Gaze Communication Approaches,” In
`Augmentative Communication Intervention Resources,
`1986. See pp. 189—193.
`
`WiViK2, Visual Keyboard for Windows 3.] User’s Guide,
`Prentke Romich Co., Wooster, OH: Prentke Romich Co.,
`1992. See pp. 27 & 68.
`
`“DragonDictate, The Premier PC Dictation System,”
`Dragon Systems, Inc., Newton, MA, 1994. See p. 4.
`
`Johnson, Frank, “Communications system for speechless
`quadriplegics”, Design Product News, Jan. 1994. See entire
`document which consists of one page.
`
`Fitts, P.M., “The information capacity of the human motor
`system in controlling the amplitude of movement”, Journal
`of Experimental Psychology, 1954, vol. 47, pp. 381—391.
`
`Fitts, PM and Peterson, J.R., “Information capacity of
`discrete motor responses”, Journal of Experimental Psy-
`chology, 1964, vol. 67, pp. 103—112.
`
`Pointer Systems ’92/’93 Catalog, Pointer Systems, Inc.,
`Burlington, VT: Pointer Systems, Inc., 1992.
`
`Barnett, C.J.; Dynche, M.P.; Golding, V.G.; Ng, Y.H.; Tay-
`lor, G.D.; “Speech Output Display Terminal,” IBM Techni-
`cal Disclosure Bulletin, vol. 26, No. 10A, Mar. 1984, pp.
`4950—4951.
`
`Callahan, Jack; Hopkins, Don; Weiser, Mark; Shneiderman,
`Ben; “An Empirical Comparison of Pie vs. Linear Menus,”
`Human Factors in Computing Systems: CHI ’88, Confer-
`ence Proceedings, pp. 95—100.
`
`Golding, V.G.; Heneghan, M.J.; “Audio Response Termi-
`nal,” IBM Technical Disclosure Bulletin, vol. 26, No. 10B,
`Mar. 1984, pp. 5633—5636.
`
`Lazzaro, Joseph J ., “Computers for the Disabled,” Byte, Jun.
`1993, pp. 59—64.
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 1 0f 67
`
`6,005,549
`
`.5:m0Hmm
`
`aAil
`
`
`
`.Baa®®@-n-@-—fln-
`
`-a--@@S-©-@-EB
`
`V5:
`
`Baggaagagfl
`
`Baas
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`

`

`US. Patent
`
`99w
`
`76f02whS
`
`945a500a6
`
`ENG
`
`nMONO.693998009::0EOmOQQmwb9:EMmmsogSocog:
`
`
`0.39:9:93069::m93
`LJ_
`
`25>:0csm2:>9LmEEjm96:06962
`
`Hm<KOHmm
`
`(\J
`
`CD
`F—l
`
`«an»
`
`$59502030:0SE;9:m_>>OZ
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 3 0f 67
`
`6,005,549
`
`PR1ORART
`
`FIG.3
`
`
`
`
`
`
`
`
`
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 4 0f 67
`
`6,005,549
`
`PR10RART
`
`FIG.4
`
`CD
`C\|
`("’3
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 5 0f 67
`
`6,005,549
`
`PRIORART
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`94.¢50fl,6
`
`Hm<KOHmm
`
`©.QHu
`
`”chcgm:mgom:w.BE888%9:Em,Esgm85%:mE:25209:__mE<w*.xoopmcoi
`
`msocommmD.In_U2EmEoom630B5E;9:m.262
`Lweesm
`
`
`9%5385mm:39m
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 7 0f 67
`
`6,005,549
`
`I—
`q:
`
`< a
`
`: oi
`
`—-1
`
`SAMSUNG EX. 1007
`
`(\l
`
`O «
`
`,2
`
`8 Q
`
`V O ,
`
`9
`
`[\
`
`0 I
`
`—I
`
`L
`
`3:
`fl
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 8 0f 67
`
`6,005,549
`
`PR10RART
`
`FIG.8
`
`.Q..0;’0’i-4
`
`‘4 g Q‘0
`O o o
`.090
`b O ¢,*¢
`.
`
`6354
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 9 0f 67
`
`6,005,549
`
`mowv
`
`EOHIQ
`
` Hm<
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`m,meowmmoaq
`
`fiomv
`
`mNow?
`
`945:q00,m
`
`IOHEQ
`
` Fm<
`
`
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 11 0f 67
`
`6,005,549
`
`FIG. 11
`
`PRIOR ART
`
`Picture
`
`Communication
`
`Meaning
`
`Symbols
`
`Rebus
`
`Pic Sym
`
`Blissymbol
`
`_. a
`
`@—
`
`[E
`
`y
`
`fé
`
`C513
`
`('7)
`
`é
`
`"‘
`.2.
`
`h.
`
`0:
`
`><
`
`-.
`
`53
`
`C27
`
`a, a
`' Q?
`
`g
`
`@Hi’l
`
`g
`
`Bi
`
`'9'
`
`Q '
`
`0'!
`
`want
`
`eat
`
`think
`where
`
`friend
`
`_Q_
`M)
`
`%
`
`>;’\/
`
`H
`
`wheelchair a
`
`television
`
`:1
`
`yesterday
`
`no
`
`not, un
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 12 0f 67
`
`6,005,549
`
`PRIOR ART
`
`FIG. 12(3)
`
`FIG. 12(b)
`
`4' garden
`
`hO‘O‘
`(NH
`091'"
`\/\1 \l \l \l
`
`FIG. 12(c)
`
`FIG. 12(d)
`
`
`
` sad
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 13 0f 67
`
`6,005,549
`
`PRIOR ART
`
`FIG. 13(a)
`
`FIG. 13(b)
`
`FIG. 13(c)
`
`FIG. 13(d)
`
`
`
`pretzel
`
`potato stick
`
`tidbit
`
`FIG. 13(e)
`
`FIG. 13(f)
`
`FIG. 13(g)
`
`FIG. 13(h)
`
`
`
`gumdrop
`
`cereal
`
`peanut
`
`FIG. 13(i)
`
` butterscotch
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 14 0f 67
`
`6,005,549
`
`,EBQmE39503OJ9a
`
`mEm$6me
`
`
`
`vofm53805 NormES023805
`
`me3:856:80
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 15 0f 67
`
`6,005,549
`
`
`
`9mm:55?ESQEOQ308353%
`
`
`
`
`
`Q,OE
`
`/
`
`3mm83805
`
`55m®£c>m
`
`89m?
`
`gem
`
`£88m559:8
`
`llllll'il
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet16 0f67
`
`6,005,549
`
`mwwoom Q.QE
`
`mtg/:8
`
`526
`
`mom?
`
`Emaoa
`
`wow?
`
`ocEmEQo
`
`:55?
`
`wow?
`
`.nc8505_"magmas_
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`m,m
`
`N©fio
`mmfiow
`
`945,500,6
`
`nm
`
`m
`
`9mmamh
`
`0mg
`
`s090
`
`Mwma
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 18 0f 67
`
`6,005,549
`
`N©fi©
`mmflow
`
`omeo
`
`wmro
`
`@NE
`
`v90
`
` Onwfio
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 19 0f 67
`
`6,005,549
`
`
`
`(3V
`8%
`©©
`
`9
`N
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 20 0f 67
`
`6,005,549
`
`FIG.20
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 21 0f 67
`
`6,005,549
`
`F16.21
`
`/0502
`
`0508
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 22 0f 67
`
`6,005,549
`
`FIG.22
`
`4002
`
`4008
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 23 0f 67
`
`6,005,549
`
`3504
`
`3514
`
`3512
`
`FIG.23
`
`LO
`
`0L
`
`O
`(‘0
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 24 0f 67
`
`6,005,549
`
`0mm@
`
`@mwOEQ
` vm.OHL
`
`w©©©
`
`m:m
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`945:w00(w
`
`momaw
`
`mmwww“gag
` mm.OHu
`
`moa@
`
`m:m
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 26 0f 67
`
`6,005,549
`
`mvmo
`
`ovmo
`
`wmmo
`
`wmmo
`
`//////
`
`
`
`4% ©N.QHu
`//////////gigggggg
`
`
`fligé/
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`6,005,549
`
` Km.QHL
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 28 0f 67
`
`6,005,549
`
`F1028
`
`0701J
`
`
`
`0703
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 29 0f 67
`
`6,005,549
`
`
`
`-4
`
`7-
`
`ST_DECAY
`
`ST_DWELL
`
`SAMSUNG EX. 1007
`
`HEr-ldOH:
`
`E V
`
`M O V E M E N T
`
`E v § T E P I
`
`? P
`
`
`
`F<>OEEJUI<11]
`
`rrmfim<31
`
`drama”:
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 30 0f 67
`
`6,005,549
`
`I—_
`
`
`
`EV_NULL
`
`EV.RESET
`
`EV_DECAY
`
`EV_DWELL
`
`EV_CRoss_0UT
`
`EV_STEP_DOWN
`
`Iflflflfl
`W ”In“
`
`
`
`m ST_IDLE
`n ST_SELECTED_SEQ_
`
`ST EBB_TIDE
`
`ST BEGIN_TO_LOCK
`
`
`
`nEV_STEP_UP5
`
`mmmmummm"5.IDLE_TIMEOUTEEMEMMEE[5MOVEMENT
`
`
`
`
`”5$12.2nnmmmmflm
`
`11
`
`3Human“
`
`11111
`
`2557111
`
`11I
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 31 0f 67
`
`6,005,549
`
`in:mm?
`
`
`om:.w.n.n..w.om:
`
`
`amt
`
`vmt
`
`98
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 32 0f 67
`
`6,005,549
`
`NBC
`
`Qwoo
`
`0E0
`
` mm.QHu
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 33 0f 67
`
`6,005,549
`
`900
`
`ommo
`
`wvmo
`
`macM$8
`
`
`gmao
`
`SE
`
`SAMSUNG EX. 1007
`
`wm®©
`
`ommo
`
`mmmo
`
`@000
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 34 0f 67
`
`6,005,549
`
`LO
`T‘
`‘—
`(Y)
`
`N
`T_
`0‘?
`
`<53
`7—
`“
`(*7
`
`K]
`<17)
`
`U7
`N
`,_
`O?
`
`xxxxxxxxxx
`xxxxxxxxxx xx
`xxxxxxxxxx xx
`xxxxxxxxxx xx
`xxx/////// xx
`xxxxxxxxxx xx
`xxxxxxx/xx xx
`xxx/xxx/xx xx
`xxxxxxxx xx
`xxxxxxxxxx x/
`T_
`T_ xxxxxxxxxx
`T— xxxxxxxxxx
`CO xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxx
`xxxxxxxxxx
`xxxx/xxxxx
`xxx/xxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`
`
`
`<<T
`(Y3
`
`°
`
`(I)
`,
`r—fi
`
`,
`
`x xxxx
`x
`xxx
`xxxxxx
`xxx/xx
`xxx/xx
`xxxxxx
`xxx/xx
`xxx/xx
`xxxxxx
`xxxxxx
`
`
`
`
`
`
`
`
`
`xxxxxxxxx
`xxxxxxxxx
`xxx/xxxxx
`xxxxxxxxx,
`b\
`xxxxxxxx
`xxxxxxxxxx Cd
`xxxxxxxxx
`xxxxxxxxxfi T.
`xxxxxxxxx
`O7
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxx/xxxxxx
`xxxxxxxxxx
`
`cg
`CU
`V—
`03
`
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxx
`xxxxx/xxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`
`4
`
`*—
`07
`T—
`03
`
`“7
`03
`r—
`(q
`
`
`
`xxxxxxxxxx
`0‘
`r— xxxxxxxxxx
`C)
`xxxxxxxxxx
`03
`xxxxxxxxxx
`xxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxx
`xxxxxxxxxx
`h\
`xxxxxxxxx/
`<3 xxxxxxxxxx
`xxxx/xxxx
`T_
`xxxxxxxxxx
`xxxxxxxxx
`xxxxxxxxxx
`xxxxxxxx
`07
`xxxxxxxx
`07
`xxxxxxxxxx
`xxxxxxxxxx
`07
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx T.
`xxxxxxxxxx
`xxxxxxxxx .
`xxx/xxxxxx
`xxxxxxxxx
`(0
`xxxxxxxxxx
`xxxxxxxxx
`xxxxxxxxxx
`“7
`xxxxxxxxxx
`(3 xxxxxxxxxx
`xxxxxxxxx
`T— 'xxxxxxxxxx
`xxxxxxxxx
`03
`x xxxxxxxx
`xxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`'xxxxxxxxxx
`xxxxx/xxx
`xxxxxxxxxx
`xxxxxxxxx
`xxxxxxxxxx
`xxx/xxxxx
`xxxxxxxxxx
`03
`xxx/xx xxx/xxx xxx/xxx xxxxxxxxx
`xxxxxxxxxx
`C)
`xxxxxx xxx/xxx xxxxxxx xxxxxxxxxx
`r— xxxxxxxxx
`xxx/xx xxx/xxx xxx/xxx xxxxxxxxxx
`03
`xxxxxxxx x
`xxx/xx xxxxxxx xxx/xxx xxxxxxxxx
`xxxxxxxxxx
`xxx/xx xxx/xxx xxx/xxx xxxxxxxxx
`xxxxxxx xx
`xxx/xx xxx/xx xxx/xxx xxxxxxx xxxxxxxx
`xxxxxx-xxx
`x xxxxxxxx xxx/xxx xxx/xx xxx/xxx xxx/xxx xxxxxxxxx
`xxxx xxxx xxx xxx xxxxxx xxx/xxx xxx/xxx xxxxxxxxx
`xxxx xxx/x xxx xxx xx
`xx xxx
`xx xxx
`xx xxxxxxxxxx
`
`xxxxxxxxx
`xxxx xx xxx xx xxx
`xx xxxx
`x xxxxxxxxx
`
`1—
`
`CW
`
`m 1—
`m
`
`‘—
`m
`
`1__
`m
`
`m
`
`‘—
`0’)
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 35 0f 67
`
`6,005,549
`
`:
`0.1
`a)
`
`E
`m LO
`‘—
`V“
`a)
`
`‘—
`a
`6*)
`
`‘—
`m
`E
`(:1
`0.! ®
`(‘0 t
`1—-
`(Y7 :
`1—
`m
`0’)
`”7
`
`
`l!)
`a
`m
`
`x
`x
`x
`x
`xxx
`xxx
`
`
`
`
`
`
`
`
`"
`
`"
`
`xxxx x xxxxx x xxxx'x xxxxx'xx xxxx xxx/xx xx
`xxxxxx x/xx x xxxxx xxxx xx xxxx xxx/xx xx
`xxxx xx xxxxxxxxx/ xx xxxx xxxx
`xx
`xxxx
`xxxxxxxxxxxx xxxxxxxxxxx
`xx
`xxxx
`xxxxxxxxxxxx
`xxxxxxxxxx
`x
`xxxx
`xxx/xx xxx/xx
`x/xxxx xxxx
`xx
`xxxx
`xxx/x
`xxxxxx
`xxx
`xx
`xxxx
`xxxxx
`xxxxxx
`xxx
`xx
`xxxx
`xxxxx
`xxxxx
`xxx.
`xx
`xxxxx xxxx
`xxxx
`xxxx
`xxx
`xxx
`“3 xxxxxxqu
`’
`xx
`(17)
`xxxxxxxxxx
`xxx
`xx
`xx
`xxxxxxxxxx
`xxxxxx
`x
`xxxxxxxx
`x xxx/xxx
`xxx/xxxxx
`xxxx‘xx/xxx
`xxx/xxxx A
`
`xxxxxxxxxx
`xxxxxx
`x
`xxxxxxxxxx
`xxxx
`
`xxxxxxxxxx
`- xxxxxxxxx
`
`xxxxxxxxxx
`xxxxxxxxx
`.
`
`xxxxxxxxx
`xxxxxxxxx
`
`xxxxxxxxxx
`xxxxxxxxx
`
`xxxxxxxx
`
`
`xxxxxxxxx
`xxxxxxxxx
`
`
`xxx
`xxxxxxxxxx
`
`xxxxxxxxx
`
`xxx x x
`
`
`xxxxxxxxx
`xxxxxxxxx
`
`xxxxxxxx
`
`xxxxxxx
`
`xxxxxxxxx
`
`. xxxxxxxxx
`-
`xxxxxxx
`
`0
`
`O xxxxxxxxxx
`w x
`x
`m
`xxxxxxxx
`xxxxxxxxxx
`xxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`N xxxxxxxxxx
`9 x
`xx
`xx
`m xxx/xxx
`x
`xxxxxxxxx
`x xxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`
`LC)
`o xxxx
`\—
`xx xxxxxx
`m
`xxxxxxxxx
`x xxxxxxxx
`xxxxxxxxxx
`xxxxxxxxxx
`
`x
`
`LO
`(Y)
`
`-
`0
`,_'
`
`LL.
`
`03
`O
`N
`(*7
`
`5
`N
`m
`
`L0
`0
`(\J
`m
`
`LO
`cu‘_
`
`m
`
`r\
`(\j
`\—
`0’)
`
`r\
`N
`(\1
`or)
`on
`(\1
`‘_.
`m
`
`9
`N
`00
`
`f
`(*7
`(17)
`
`0’)
`{2
`
`r—
`(‘0
`(\1
`(*7
`
`0’)
`(*7
`(\J
`(*7
`
`LO
`0’7
`‘_
`m
`
`
`
`.
`
`
`
`
`
`
`
`
`.- xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`xxxxxxxxx
`
`
`xxxxxx
`xxxxxx
`xxx/xx
`
`A
`
`1
`
`1
`
`
`
`m
`xxxxxxxxxx
`Q
`xxx/xx
`x
`(\j
`x'/
`mm mm
`
`
`xxxxxxxxxx xxxxxx‘ xxxx
`xxxxxxxxxx xxx/xxx xxxxx
`(*7
`x
`xxxxxxxxxx xxxxxxxflxxxxxx
`xx
`xxxxxxxxxx xxxxxxx xxxxxx
`xxxxxx
`xxxxxxxxxx xxxxxxx
`xxxx/
`xxxxxx
`xxxxxxxxxx xxx/xxx
`xxxxx
`xxxxxx
`x xxxxxxxx xxxxxxx
`xxxxx
`xxxxxxxxxx xxx xxx
`xxxxx x xxxxx
`
`xxxxxxxxxx xxx
`xx
`x
`xx x x
`xx
`xxxxuxx
`xxxx xx x x xx x xx xx
`
`O P
`
`r
`0
`C\J
`(Y)
`
`‘—
`Q
`m
`
`LO
`q-
`‘—
`m
`
`:2
`LO
`v
`‘—
`m m
`(V)
`
`‘_
`0’) v
`‘T f
`m m
`m
`
`0‘
`C3
`‘_
`v m m
`f
`(\1 m (\J
`(Y)
`(Y)
`
`I!)
`m
`N0")
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 36 0f 67
`
`6,005,549
`
`
`' //////
`
`'l/f/ -
`/////-
`'////////
`////////
`
`/////
`‘////////
`////////
`
`
`'////////
`l/l/l-
`I/l/l/l/
`
`
`////////
`////fl
`////////
`
`
`
`/////////
`////////
`////////
`////////////
`
`
`
`////////
`////////
`/////////
`////////////
`
`
`
`////////
`////////
`/////////
`////////////
`
`
`
`//
`/////////
`////////
`////////
`////////////
`
`
`
`////////////
`////////
`////////
`////////////
`
`
`
`////////////
`l/l/l/l/
`////////
`/////////f//
`
`
`
`////////////
`////////
`////////
`////////////
`
`
`
`'////////
`////
`'////////
`
`
`////
`
`\\\
`////
`
`/////
`
`
`///////////
`
`///////////
`
`///////////
`
`III/Illl/
`//
`//
`I/
`//
`I!
`//
`l/
`I/
`////////
`//
`
`///////////
`///////////
`Ill/f/f/ll/
`///////////
`///////////
`///////////
`
`
`
`
`
`////
`/I/
`
`/I//II//
`
`/////////
`////////l
`////////l
`////////I
`I l/
`//
`////////
`////////
`////////
`////////
`,
`////////
`/
`////////////
`////////////
`////////////
`/////
`////
`
`//////
`\\\\
`\\\\\\\\'
`\\\\\\\\‘
`
`
`
`
`
`
`36
`
`F10.
`
`3303
`
`3301
`
`\\ \\ \\ \\ \\ \\ \\ \\ \\
`Ill/Ill!
`
`'l/l/
`
`////
`////
`
`/////
`/////////
`//////////
`/
`\ \ \ \ \ \ \
`
`f/f/f/l/
`
`/////////
`/////////
`/////////
`/////////
`////
`_
`I
`/////
`////////
`
`3350
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SAMSUNG EX. 1007
`
`\\ \\\ \\\ ////////
`
`Ill/Il/l\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`\\\\
`
`
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`\\\\\\\
`-////////
` ////////'
`
`///////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`ll/f/l/l/l/
`///////////
`////
`‘////
`///////
`////
`‘////
`Ill/Ill
`l/l/
`‘////
`-
`///////
`l/I/
`////
`“"
`////
`////////
`
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// //////// ///////// ///////////
`//////////// //////// //////// /////// / ///////// ///////////
`- UI/ II!!!-JI/l/l/l/l/l III/Ill Ill/MU! (I!
`
`
`
`
`
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 37 0f 67
`
`6,005,549
`
`///////////
`////////
`///////
`
`
`
`\\\\\\\\\\\\
`
`
`
`\\\\\\\\\\\\
`
`
`
`\\\\\\\\\\\\\\\\\\\\\\
`
`\\\\\\\\
`
`\\\\\\\\
`
`//
`///////
`//
`///////
`//
`////////
`///////////
`///////////
`///////////
`///////////
`///////////
`
`\\\\\\\\
`
`\\\\\\\\
`
`\\\\\\\\\\\
`
`/////////
`/////////
`
`///////////
`///////////
`///////////
`/////////
`l/
`/////////
`//
`/////////
`//
`////////
`//
`I/f/ll/Il/
`/////////
`/////////
`/////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`
`//I/l//f/// //
`
`//
`//
`l/
`//
`//
`//
`//
`f/
`//
`//
`//
`
`///
`///
`///
`///
`///
`///
`///
`///
`
`\\\\\\\\
`
`\\\\\\\\\\
`
`\\\\\\\\\\
`
`\\\\\\\\\\
`
`\\\\\\\\\
`
`\\\\\\\\\
`
`\/
`
`////
`/
`/////////
`
`
`\\\\\\\\\\\\\\\\\\\\\\\
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`///////////
`
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`//////// \\\\\\\\\\\\\
`
`\\\\\\\\\\\\\
`\\\\\\\\
`\\\\\\\\
`\\\\\\\\
`\\\\\\\\
`
`////7//////
`///////////
`f/
`/////////
`l/
`////////
`//
`////////
`// ////////
`l/
`//
`//
`
`//
`//
`//
`//
`/////
`//
`//////
`//
`/
`//
`///////
`///////////
`///////////
`///////////
`///////////
`/////////
`/////////
`/////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`
`/////////
`/////////
`
`/I////
`
`////////
`////////
`////////
`////////
`/////////
`/////////
`/////////
`/////////
`/////////
`/////////
`/////////
`/////////
`/
`////////
`
`\\\\\\\\
`\\\\\\\\
`
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`/////////
`/////////
`/////////
`
`///
`////////
`///
`////////
`////////
`///
`///////////
`///////////
`///////////
`///////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`///////////
`/////////
`/////////
`/////////
`
`37
`
`FIG.
`
`l//////////
`///////////
`///////////
`///////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`/////////
`///////////
`///////////
`///////////
`/////////
`/////////
`
`///////////
`///////////
`///////////
`///////////
`///////////
`///
`//
`/////////
`///////////
`
`///////////
`///////////
`/////////
`/////////
`///////////
`///////////
`///////////
`///////////
`///////////
`, ////////
`///////////
`///////////
`/////////
`/////////
`/////////
`
`///////////
`
`401QQ
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`94
`
`7ImI.wI-all%fin
`lulumll
`1,IIaI.mfifi
`
`IIii
`
`6,50.II\.II
`mifi.._.1.A.W023
`
`33
`
`meow
`
`5mm
`
`mBm
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 39 0f 67
`
`6,005,549
`
`ommm
`
`wvmm
`
`womm
`
`womm
`
`wvmm
`
`9mm
`
`mvmm
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 40 0f 67
`
`6,005,549
`
`omom
`
`woom
`
`woom
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 41 0f 67
`
`6,005,549
`
`2404
`
`4112
`
`4114
`
`
`
`
`
`
`
`2402 4106
`
`2112
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 42 0f 67
`
`6,005,549
`
`wovm
`
`wowm
`
`NIVN
`
` NV.OHA
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 43 0f 67
`
`6,005,549
`
`0406
`
`FIG.43
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`m
`
`9
`
`%
`
`4
`
`n,aowm
`
`mvogm
`
`m0¢m
`
`wmmwm
`
`m©m©mnvmwm
`
`945,500,6
`
`.mVH.¢
`
` //z.mm@m
`
`///.¢m@m
`
`9am
`
`Sam
`
`mEm
`
`m:m
`
`mmmm
`
`vmwm
`
`©m©m
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 45 0f 67
`
`6,005,549
`
`wowm
`
`vowm
`
`Noam
`
`vmmwm
`
`wmwm
`
`maknge_
`
`
`
`
`
`...fiwufimuwwufin...HWH
`
`
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 46 0f 67
`
`6,005,549
`
`mowm
`
`
`vmfiwmvmem
`wowmme
`
`wmwm@mom
`vowm
`
`3}.imm
`
`mmammmmwm
`
`m:m
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 47 0f 67
`
`6,005,549
`
`1402
`
`2112
`
`k0
`
`Qq,
`
`_
`
`FIG.47
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 48 0f 67
`
`6,005,549
`
`1502
`
`2112
`
`LO
`
`0<
`
`1-
`
`48
`
`FIG.
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 49 0f 67
`
`6,005,549
`
`\
`
`FIG.49
`
`2112~
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 50 0f 67
`
`6,005,549
`
`FIG,50
`
`QHZ
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 51 0f 67
`
`6,005,549
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`mD
`
`A,
`
`mrmv
`
`”
`
`m
`
`mMa
`
`6
`
`wmwmv
`
`s_wmq
`
`a:mw
`
`mwmv
`
`94:w50
`
`nwmomq
`
`Jcmbs
`
`
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`m.D
`
`35
`
`m
`
`MES
`
`00,6
`
`94
`
`5,89V5..
`
`mmmv
`
`SAMSUNG EX. 1007
`
`m.5m
`
`
`
`
`Bi“
`
`
`
`9E!——-938.5Qmwmg.
`
`
`
`n,8%
`
`VO @Y
`
`T
`
`SAMSUNG EX. 1007
`
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 54 0f 67
`
`6,005,549
`
`3901
`
`3902
`
`3904
`
`a? Y‘I‘m' 47V 1’7”
`.gtz3:§9 v v vac/4%?
`4
`49% s:/ /
`
`'
`VJ/I / I
`
`'
`
`<1—
`
`LO
`
`CD
`1—1
`
`LL
`
`(\1
`(\J
`E
`v 0")
`(\J
`C?
`Q) 0')
`0.1
`CD
`(*3
`
`OO
`(\1
`Cfi
`0’)
`
`Om0(
`
`*7
`
`LO
`g
`m
`
`r\
`
`O0m
`
`-
`
`
`
`7, /
`
`/,
`
`3911
`
`9
`N
`
`OO
`3%
`0’)
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 55 0f 67
`
`6,005,549
`
`3904
`
`00s.9009.O O..0.0.0:O’90..$00.00
`
`//////
`
`//////,
`
`//////,
`////
`xxx/xx,
`xxx/xx,
`//////,
`xxx/xx.
`
`
`/»F9//.
`
`
`//////.
`
`
`xxx/xx.
`
`
`xxx/xx.
`
`
`x/xzxx.
`
`//////;
`(III/I
`
`
`
`
`
`3908
`
`2112
`
`Q0
`
`—3
`m
`
`3911
`
`SAMSUNG EX. 1007
`
`55
`
`F10.
`
`//l
`
`
`
`
`
`
`3901
`
`<
`'¢:Q:§:O:O:§:O:§:O:¢:O:OIOIOI‘O’
`/ ooooooov¢oo¢
`000009069000
`6‘.
`/ / o c Q o
`o o o
`O.0.9
`
`O..;.OO 0
`00
`
`O
`
`.0
`
`9.0.{90. 00C’O‘fl
`
`O
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 56 0f 67
`
`6,005,549
`
`4715
`
`4713
`
`47H
`
`FIG.56
`
`
`
`
`
`4701
`
`4703
`
`4705
`
`4770
`
`4707
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 57 0f 67
`
`6,005,549
`
`////////////// /
`////////////// /
`////////////// /
`////////////// /
`////////////// /
`////////////// /
`/
`
`\ \
`
`\\\\\\
`
`\\\\\\
`
`\\\\\\
`
`\\\\\\
`
`\\\\\\mas
`
`\\\\\\
`
`\\\\\\\\\\\\\\\\\\
`
`\\\\\\
`
`//////////
`I/l/G‘ ///
`/////
`///
`///
`////
`///
`////
`Ill!
`////
`//////
`//////
`//////
`///
`
`//////
`///
`/
`///
`/
`///
`I
`///
`/
`///
`/
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`Ill/If
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`//////
`///
`/
`//;‘///
`//
`ll
`//////
`//////
`
`I/I/
`
`57
`
`FIG.
`
`/////
`
`/////\\\\\\\\\\\\\\\\\\/
`
`/////
`
`x110 /
`x/zoa /x
`/
`//
`//////
`
`\\\\\\\\\\\\
`
`\\\\\\\\\\\\
`
`\\\\\\\\\\\\
`
`\\\\\\\\\\\
`
`\\\\\\\
`\\\\\\\
`\\\\ \\\\
`
`\ \ \ \ \ \
`
`\\\\\\\\\\\
`
`\\\\\\\\\\\
`
`//
`
`\\\\\\\
`
`\\\\\\\
`
`\\\\\\
`
`\\\\\\
`
`\ \ \ \ \ \
`III/II
`//////
`//////
`//////
`
`\\ \\ \\ \\ \\ \\
`
`\\\\\\\\\\
`
`\\\\\\\\\\
`
`\\\\\\\\\\\\\\
`
`\\\\\\\\\\\\\\
`
`\\\\\\\\\\\\\\
`
`/ ///
`/ /
`
`SAMSUNG EX. 1007
`
`
`
`
`
`
`
`
`//////////\\\\\\\\\\\\\\\\/
`
`/
`/
`///////////
`/
`//////////
`/
`/////////
`/
`I /// //////////
`//// /////////
`//// /////////
`
`///
`
`//
`//////////////
`//
`//////////////
`//
`//////////////
`////////////// //
`//
`//////////////
`//
`//////////////
`////
`//
`
`\\\\\
`
`/
`/
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`99911:
`
`76f085teehS
`
`945,500,6
`
`.//../
`
`W/{a.///
`
`2A.
`ooo¢6boo».oooooaW7,c.,z;//333.w.....“¢.,..w.wannagD9o.9000099009009.999.909.999:
`.
`
`.......
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 59 0f 67
`
`6,005,549
`
`m 0 C
`
`?
`LO
`
`FIG,59
`
`2112
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 60 0f 67
`
`6,005,549
`
`
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 61 0f 67
`
`6,005,549
`
`FIG,61 m
`
`w—
`k0
`
`LO
`
`W"
`RD
`
`2112
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 62 0f 67
`
`6,005,549
`
`F1662
`
`6001
`
`2H6
`
`
`
`f
`
`
`
`
`22m
`
`
`
`6007/////6009////
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 63 0f 67
`
`6,005,549
`
`6107
`
`1204
`
`___________
`
`
`
`
`
`6101
`
`m 9L
`
`C
`
`6105
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 64 0f 67
`
`6,005,549
`
`Newm,
`
`ooom/9w,
`
`wmwm
`
`wmwm/{Lx
`
`vmom&.
`mmem/Mwn,
`
`
`
`O©©m..H.Hw...
`
`wwomooom
`
`///v©©mvoom
`
`oqomomwm....
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`

`

`US. Patent
`
`9
`
`
`
`..................3R8%mtm:Kmm©OHM.8%ohmEm©on
`
`mmwm
`
`
`
`
`
`mmNM/LVFwfim
`
`
`
`
`
` vmwmHa.”me%memfmu.WKmEmwwmwm..3mmwoon/LVFwowmmmgmEm
`
`
`
`
`
`Hm\\\lvm&mma.MKQSmmELMNsm%BR.3mi
`m............................
`
`M@me
`
`pm,ommm0memmm?
`
`
`
`
`09QVNMvamvmxm©NMM6TEM.fiO/Em..A/NMEMvmxm
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 66 0f 67
`
`6,005,549
`
`3809
`
`3807
`
`
`
`FIG,66
`
`|\
`
`g0
`00
`m
`
`'112r) 4
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`US. Patent
`
`Dec. 21, 1999
`
`Sheet 67 0f 67
`
`6,005,549
`
`$2
`{\
`©
`
`FIG.67
`
`SAMSUNG EX. 1007
`
`SAMSUNG EX. 1007
`
`

`

`6,005,549
`
`1
`USER INTERFACE METHOD AND
`APPARATUS
`
`This is a continuation-in-part application of pending
`prior international application Number PCT/US95/03591
`filed Mar. 27, 1995 entitled “Method of and Apparatus for
`Data Entry” which designated the United States, as amended
`Apr. 25, 1995 and May 26, 1995. Two continuing applica-
`tions of the above international application are copending
`with this application. They are, respectively, a continuation-
`in-part application entitled “Sound Operated Menu Method
`and Apparatus” and a continuation-in-part application
`entitled “Data Entry Method and Apparatus.” This applica-
`tion and both copending applications were filed on the same
`date.
`
`TECHNICAL FIELD
`
`invention relates generally to interactive
`The present
`display terminals and interactive display methods, and more
`particularly to interactive display terminals and interactive
`display methods f