United States Patent
`
`[19]
`
`[11]
`
`Patent Number:
`
`5,347,295
`
`Agulnick et al.
`
`[45] Date of Patent:
`
`Sep. 13, 1994
`
`1IlllllillllllllllllllllllllllllHlllllllllllll|l|||lllllllllllllllllllllll
`USOO5347295A
`
`[75]
`
`[54] CONTROL OF A COMYUTER THROUGI—I A
`posrnoN.sENsE1) sTy1,Us
`Inventors: Todd Agulnick, Newton Centre,
`Mass.; Robert Carr, San Francisco,
`Calif.; Tony Hoeber, Woodside,
`Califi; S_ Jen-old Kaplan’ San
`Francisco, Calif.; David R. Low
`Oakland, Calif‘; Michael Onye’ ’Pa1o
`Alto, Cafif,
`_
`,
`_
`,
`[73] Assigneez G0 Corporation, Foster Clty, Cahf.
`21 A _
`_: 610
`1
`’23
`1
`pp} NC’
`[
`*
`0°‘ 31’ 199°
`[22] Filed:
`51
`Int. Cl.5 ............................................. .. G09G 5 00
`[
`]
`,
`/
`
`[52] U.S. Cl. ............
`345/156, 345/179
`_[58] Field of Search ....................... 332/13, 14, 57, 59,
`382/40 178/18 19- 340/706 707, 709»
`’
`’
`’
`343/156 179’
`’
`
`[56]
`
`References Gted
`U.S. PATENT DOCUMENTS
`3,699,439 10/1972 Turner ............................... 324/71.1
`3,832,693
`8/1974 Ishizaki etal
`364/900
`4,016,542 4/1977 Azure ..........
`. 364/900
`4,055,726 10/1977 Turner et a1.
`178/18
`4,071,691
`1/1978 Pepper, Jr. ..
`178/19
`4:112r"*15
`9/1973 Hflbfink ------
`332/13
`4,129,747 12/1978 Pepper, Jr. ..
`178/18
`4,177,354 12/1979 Mathews
`178/19
`4,184,147
`I/1980 Seelbach
`382/13
`4,198,539 4/1980 P
`, J . ..
`7
`4,262,281
`4/1981 935$ etral
`4,293,734 lo/1981 Pepper, IL __
`4,302,011 “/1981 pepper, hp ____._
`4,318,096 3/1982 Thomburg et a1.
`4,353,552 10/1982 Pepper, Jr.
`4,365,235 12/1982 Greanias et a1.
`4,371,746 2/1983 Pepper. Jr.
`--
`4—455»737 5/1934 SCNOSSCY 8‘ 31-
`lg; ‘(’;‘s‘t:;:m5d°tn1a‘1
`.
`,
`,
`IT)’ 8
`..
`4,641,354 2/1987 Fukunaga et a1.
`4,672,677 6/1987 Yamakawa
`4,679,241 7/1987 Lukis ..................
`4,680,430 7/1987 Yoshikawa et 31.
`4,680,804 7/1987 Kuzunuki et al.
`4,764,885
`8/1988 Greanias et a1.
`
`
`
`178/13
`178/19
`. 360/706
`382/13
`382/13
`178/18
`173/19
`
`.
`
`................... 173/19
`4,786,765 11/1988 Yamanami et al.
`:,:g;,2§:
`I‘Odo11o ....;1............................. 364/521
`,
`,
`ore et
`.
`.
`4,972,496 11/1990 Sklarew ................................ 382/13
`5,050,105
`9/1991 Peters ..... .. . ..
`. . ... 340/734
`
`5,053,758 10/1991 Comett et al. ...................... 340/712
`5,151,950 9/1992 Hullender .
`
`FOREIGN PATENT DOCUMENTS
`822333: 132386 European 11:at.
`.
`.
`2 25
`87
`uropean at.
`.
`0254551
`1/1933 European pat Qff_ _
`2117154 10/1983 United Kingdom .
`2193023
`1/1988 United Kingdom .................. 382/13
`OTHER PUBLICATIONS
`IBM Technical Disclosure Bulletin, “Object-Picking
`M h
`_
`hi 81 H d
`.
`,,
`I
`et °d by Hm-'° °
`3“ ‘M39938’ V-°- 30» N°-
`9’PP' 3“3‘35°’F°‘?- 1938.(N"“’ Y°¥“)-
`GR1D Systems Corporation, “GR1DPAD Computer
`Owner’s Guide” (1989-1990, California).
`Wacom Co., Ltd., “User Manual for SD—510 A5 Type
`E.‘8i‘iz,‘f" g1“1i 19.339 1I’1"°e
`“;‘.k“°‘{’,“)'r,
`mus
`ec oo es, nc.,
`n e— 0
`se s
`Guide (1937 v,,§,,ia)_
`P
`'
`4‘
`'
`'
`'
`'
`‘
`'
`§EsiI:,1raf:z‘,:§’bD§%‘§znmf £?::}:S€;§3’3t5§t1:e)way to
`9
`Y
`‘
`'
`'
`‘
`‘
`Primary Examiner.—~Jeffery Brier
`Attorney, Agent, or Firm—Matthew C. Rainey; Amir H.
`Raubvogel
`[57]
`ABSTRACT
`-
`-
`A notebook computer which is controlled by a stylus
`executmg gestures on the computer screen. The stylus
`and the computer rncludecomplementary electromc
`circuitry by which the proximity of the stylus up to the
`computer Is sensed. The proximity sonsmg 18 used to
`detect to approach of the stylus tip to the computer
`screen, and gestural commands are then entered on the
`screen by moving the stylus. The entry of a command is
`terminated by removing the stylus tip from proximity
`'
`'
`'
`wit?‘ the s°’°'.3"’ Whmh ‘S detected by the °°mp“t.er’
`winch then unplements the command. Altematrve
`hod
`f .
`1
`.
`h
`d .
`1
`.
`me‘
`5 ° “P °‘“°“‘“‘_3 1 F °°"1ma“ 5 W’ “de ‘"115’
`01118 and command 1C8I'III.1I1atlOIl b1lT1OI1S.
`
`46 Claims, 73 Drawing Sheets
`
`382/13
`382/13
`382/13
`_'__ 178/19
`. 382/13
`.................... 364/571
`
`___
`
`
`
`EXHIBIT
`Petitioner - Kyocera
`
`
`
`PX 1007
`
`Kyocera PX 1007_1
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 1 of 73
`
`5,347,295
`
`Fig. 1
`
`Kyocera PX 1007_2
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 2 of 73
`
`5,347,295
`
`0 ...
`
`C\1
`9
`LL.
`
`\
`
`"" C\1
`
`Kyocera PX 1007_3
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 3 of 73
`
`5,347,295
`
`LCD
`
`Display -10
`
`Pen
`Sensor
`20
`
`Display
`Controller
`80
`
`Co-
`processor
`90
`I
`
`CPU
`50
`
`Static
`RAM
`70
`
`Custom
`ASIC
`104
`
`~
`
`EEPROM
`60
`
`SCSI
`100
`
`Serial
`Controller
`108
`
`I
`
`Base
`Station
`Port 116
`
`r.::::=l ::;::::::::1 =il E
`·
`II
`xpanslon I' I
`lit
`Slot 112 11
`11
`
`I
`
`II
`
`Fig. 3
`
`Base
`Station
`118
`
`FAX/Data
`Modem
`114
`
`Kyocera PX 1007_4
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 4 of 73
`
`5,347,295
`
`I
`
`[ )
`
`I
`
`0
`
`0
`~
`N
`
`p Notebook: contents
`1
`··6<> .. u·me·rit······Ed~·····c·r:eaie······VieW·····ShOW······s;it······i7o·r··· ........... .
`'"""'"~::::::::;::;:;:;:;:;:;:;:::;:;;:;;:;;;:;:::::::;:;;:;::::;:::::::::;::::,,;:;;;;:;::::::::::'::';;';;:,;:,;:;;:;::::;:::'::'"""'"""'""'""""""'""""'""
`2 Name
`~
`340
`2
`r-
`· · · · · · · · · · · · · · · · · · · · t>
`Ftrst Exr:enence
`Cl Samples'!'"" . ........................... C> 3
`---310
`D Application~ ~~ · · .. · .... · · .. · · .. C> 6
`D Reports~ -~20 · · · · · · · · · · · · · · · · · · · t> 1
`300} t 290
`l270 \.. 280
`
`n
`o
`::3 a:-
`::3
`\::
`
`10
`
`190
`
`0 -
`
`0
`
`N -
`
`Kyocera PX 1007_5
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 5 of 73
`
`5,347,295
`
`-- 1-
`.sample Notebook: contents
`....................................................................................................................................................................................
`Document Edit Create View Show SOrt
`
`:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::~:::::::::::::
`
`~
`~~
`· · · · · t> 2
`· · · ·
`[) First Ex~rience · · · · · ·
`[) samples · · · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 3
`D Application .............. · .. · .... · · · · t> 6
`D Reports · · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 1
`
`~ ............................................ ~.~~~-.. ~~~~ ............................. = ... ~ ... = .. .
`
`::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
`
`Document Edit create View Show sort
`10
`~~
`~
`D Using Help
`· · · · · · · · · · · · · · · t> 2
`D PenPolnt Help
`· · t> 10
`D Appf~eations · · · · · · · · · · · · · · · · · t> 155
`
`-()
`
`0
`::J
`~
`::J
`c;(cid:173)
`~ ..,
`!a
`
`340
`
`Fig. 5
`
`Kyocera PX 1007_6
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 6 of 73
`
`5,347,295
`
`-1 -
`
`:::::::::::::::::::::::::::::::::::::::::::;::::::::::::::::::::::::::::::::::::::::::::::j::::::::::::::::::::::::::::;:;;;;;:::::::::::::::::::::::::::::::::::::::::::::::::::
`
`sample Notebook: contents
`Document Edit create View Show Sort
`eage
`Name
`'-350
`D First Exp2rience · · · · · · · · · · · · · · · · · · · · · t> 2
`310-- D .samples· · · · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 3
`fD New Uses for Eggplant · · · · · · · · · · · · · · t> 4
`360tD Bottle Design Needed· · · · · · · · · · · · · · · t> 5
`D Application · · · · · · · · · · · · · · · · · · · · · · · · · · t> 6
`32o -r-D Reports
`· · · · · · · · · · · · · · · · · · · · · · · · · · · t> 7
`c;70
`[j August 2nd · · · · · · · · · · · · · · · · · · · · · · t> 8
`
`~~---~---i~-~-~J-----------~--------------~1~
`
`Fig. 6
`
`Kyocera PX 1007_7
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 7 of 73
`
`5,347,295
`
`••••••••••••••• u . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . u . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
`
`-- 1 -
`
`::;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::.::::::::::::::::::::.;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::~:::::::::::::::::::::::;::::.
`
`.sample Notebook: COntents
`Document Edit Create View Show SOrt
`~~
`~~
`· · · t> 2
`[) First Ex~rience · · · · · · · · · · ·
`[) samples · · · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 3
`D Application · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 6
`() Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . [> 1
`r440
`390 ~---~----Ap_plic_atio __ ~~--' -.............. -........... ~--
`Document Edit Insert case Format
`... ..... -h"
`aa .... ~...
`_.. ............. _....
`The present invent.ion describes
`·'=1.i"·
`methods and apparatus for a stylus-driven
`,,
`computer. Said computer presents the
`~~
`behavior of a multi-pa~e notebook indudin~ jj
`visible pa~es, paRe-tum effects, tabbed
`~j
`bookmarks alonR one or mo~ ed~e,
`~~
`•ftoatin~· pa~es temporarily removed from
`~j
`380) their notebook location, a table-of-contents, 1~
`l.. and contents of sub-sections. Each pa~e in ~~
`the notebook contains one document which 1~
`jj
`may contain many physical pa~es when
`printed. These pa~es are analo~ous to data l~
`files in other computers and may contain
`1~
`different types of documents such as text,
`11
`drawinRS, FAX imaRes, or specialized forms. ll
`Some information C such as the •H elp
`ll
`Information")_ is ~:~ in separate
`
`....... -;~ .. ~~-.-.";~:;:·:·
`
`3
`
`400
`
`--~ .. ··:.::::;;··--E· ~=;===~-:::::::~:::::.=>--==-===··--=·-::::::::"·"·:::::: ...... ,..<:.:.-=:::::::-=:::::::.::::>."::-:~~::::::::=..,:.:::-:::::::::::wn
`~-.......... -.......... "_ .. _______________________________ _
`(proximity)
`"D~
`[]]~®~~
`
`Fig. 7
`
`Kyocera PX 1007_8
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 8 of 73
`
`5,347,295
`
`390
`
`440
`
`::::::::::::::::::::::::::;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::.::::::::::;:.;
`
`6
`
`..
`
`380
`L...
`
`Document Edit Insert case Format
`The present invention desaibes methods and
`apparatus for a stylus-driven computer. Said computer
`presents the behavior of a multi-PaRe notebook inctudinQ
`visible paQes, PaRe-tum effeds, tabbed bookmarks sJonQ
`one or more edQe, llfloatinQ• PaRes temporarily removed
`from their notebook location, a table-of-contents, and
`contents of sub-sedions. Each paQe in the notebook
`contains one document which may contain me.ny physical
`paQes when printed. These pe.Qes are e.naloQous to data
`files in other computers e.nd may contain different types of
`documents such as text. drawinQs, FAX imSQes. or
`specialized forms. Some information (such as the •H elp
`Information") is contained in separate notebooks with sJI of
`the features listed above. The primary means of control of
`the computer is a rich set of Q&stures with the stylus over
`almost any objed visible on the display. Gestures with a
`stylus offer a more concise vocabulary than tradition
`pointinQ devices because they combine both seledion (by
`their location) and meaninQ (the specific Qesture) in one
`movement. A common set of Qestures can delete. move.
`copy, or edit diverse objeds such as text fraQments,
`buttons. documents. or entire notebooks. Gestures can
`..
`initiate the insertion of hand-written text, the editinQ of
`,
`e)(istinQ text, paQe-tuminQ, saollinQ within a window,
`· zoominQ or shrinkinQ of entire paQes, seledion, summoninQ '!
`of windows conta.ininQ operator Quidance. or the creation of :]
`links (•Qoto• buttons) to other Pe.Qes.
`..
`
`The proximity of the stylus to the display's front.
`surface is used to anticipate e.nd terminate stylus input
`events. 8y sensinQ both the proximity of the stylus tip to,
`e.nd contact with, the display surface the user-interface
`software can more accurately discern the vertical
`movement of the stylus, provide a richer vocabulary of
`stylus movements for control of the computer. and offer
`better feedback to the user.
`
`..
`
`When usinQ the stylus for selection. movements into
`pro)(imity can triQQer display events which Qive the user a
`preview of what display objeds are understood to be
`tarQeted by the computer. For example the compu~er ~an ,4
`Fig. 8
`4ooJ
`410
`
`··
`
`Kyocera PX 1007_9
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 9 of 73
`
`5,347,295
`
`::;::::::::::::::::::::::;:;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;::;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
`
`••••ooooooooooooooooo•ooooooooooooooo•&uuooooooooooouooooooooooooooo•oooooooooooooOOOOOUoOoooooooouoooo•oOOO•OOOoooOooooooo•o•O•oo••••''''"''"""'""''"'' ••·•••·••••••··• •••••
`
`- 1-
`
`sample N01ebook: contents
`Document Edit create View Show Sort
`Page
`Name
`[j First Ex~rience · · · · · · · · · · · · · · · · · · · · · · t> 2
`CJ samples· · · · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 3
`CJ Application · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 6
`CJ Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . t> 1
`
`::::::::::::::::::::::::::::-.:::::::::::::::::::::::::::::::::·::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::~f:
`
`r44o
`,-3eo
`[39o
`~ ......................................... ~~~~~ .............. : .. ~ ............................ ~ .. .
`Document Edit Insert case Format
`I
`The present invention describes
`,,
`methods and apparatus for a stylus-driven
`computer. Said computer presents the
`11
`behavior of a multi-paRe notebook includinR ~~
`visible paRes, paRe-tum effects, tabbed
`~~
`bookmarks alonR one or more edQe,
`~j
`"ffoatinR• paRes temporarily removed from
`11
`their notebook location, a table-of-contents, H
`and contents of sub-sections. Each pa~e 1n
`11
`the notebook contains one document which ll L420
`may contain many physical paRes when
`l~
`printed. These pa~es are analoRous to data 1t
`files in other computers and may contain
`11
`n
`different types of documents such as text,
`drawinRs, FAX imaRes. or specialized forms. 1l
`ll
`Some information (such as the •H elp
`'""~~:n:tion"l. is :~g1::::::~::="·=·=~~~~~''''
`41~-------....
`~~.~])
`~ [.,~tt,XP!ri¥~ ~ ~ ~
`~ ~ r11.tl~t®~
`
`)
`
`Fig. 9
`
`Kyocera PX 1007_10
`
`

`

`U.S. Patent
`
`Sep. 13t 1994
`
`Sheet 10 of 73
`
`5,347,295
`
`........ 1--
`
`:;;::;;:::::::::::::::::::.::::::::::::::::::;::::::::::::::::::::::::::::::;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;:::::::::::::::::::::::::::::
`
`.sample Notebook: Contents
`Document Edit Create View .show sort
`~~
`~~
`D First Experience · · · · · · · · · · · · · · · · · · · · · · t> 2
`D samples······················ · · · · · · · e> 3
`D Application · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 6
`[) Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . [> 1
`
`390
`
`440
`
`:::::::::-.:::::=:::::::::::::::::::::::-.::::::::.-::::::::::::::::::;:::::::::=:::::::::::::::::::::::::::;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
`
`Application
`Document Edit Insert case Format
`The present invention describes methods and ·1:=(cid:173)
`apparatus for a stylus-driven computer. Said
`computer presents the behavior of a multi-PaRe
`notebook includinR visible paRes, paQe-tum effects,
`tabbed bookmarks alonR one or more edQe,
`"floatinR• paRes temporarily removed from their
`notebook location, a table-of-contents, and contents
`
`...
`
`380
`
`430
`
`.:::::"::::.::::::::"""''"'''"''::"::.::;:::::·
`
`''F':::·:;:·· ·~·--·~··--·=-·~--·===-··-··-··-···-=··· ==·-:::::::-.:;:::·,,._..,.,,--.. -
`(prc»<lmlty)
`·······---"'
`~-----------------~----------------~
`~D~
`~ tFi(stgi~~ij
`r)tl~~~
`
`Fig. 10
`
`Kyocera PX 1007_11
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 11 of 73
`
`5,347,295
`
`:::::::::::::::::::::::::::::::;;;::;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
`
`5ample Noteboo~: Con1ents
`..-- 1 -
`.................................................................................................................................................................................
`Document Edit Create View .show .sort
`~~
`~~
`D First Ex~rience · · · · · · · · · · · · · · · · · -· · · t> 2
`D samples······················ · · · · · · t> 3
`D Application · · · · · · · · · · · · · · · · · · · · · · · · · · · t> 6
`D Reports · · · · · · · · · · · · · · · · · · · · · · · · · · ·t> 1
`440
`380
`Application
`
`6
`
`"'"
`i4
`
`'~~~'-
`The present invention describes
`,,
`methods and apparatus for a stylus-driv n
`computer. Said computer presents the
`~~
`behavior of a multi-paRe notebook indu nR 1j
`visible paqes, paqe-tum effects, tabbed
`~~
`bookmarks alonq one or more edqe,
`ll
`-tloatinq• paRes temporarily removed fro
`1~
`their notebook location, a table-of-conte ts, ~l
`and contents of sub-sedions. Each pa!=f
`in 11
`the notebook contains one document wh ch il
`ll
`may contain many physical pa~es when
`printed. These paqes are analo!=fous to ata 11
`il
`files in other computers and may contain
`jj
`different types of documents such as tex ,
`drawin~s. FAX ima~es, or specialized for s. ~1
`Some information (such as the •H elp
`ll
`Information, is contained in separate
`)l_, .. 1
`---------·~~-~------------~-~ 445
`... ::::;;;:--:=-··=.;-:=·========= =-=-----· .···
`. --· ... _ ...
`(proximity)
`~~-----------------------aza----------------~
`~ [fi(s(Elijrifued "
`~ ~
`~ ~ [Jtl~~~
`
`::;;_::::~"'··=
`
`Fig. 11
`
`Kyocera PX 1007_12
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 12 of 73
`
`5,347,295
`
`. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . h . . . . . . . . _ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . u . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
`
`-
`
`1 --
`
`:::::::::::::::::::::;::;::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;::::::::::::::::::::::::;::::::::::::::::::::::::;:::::
`
`.sample Notebook: contents
`Document Edit create View Show sort
`~~
`D First Experience
`D 5arnples ·
`D Application
`D Reports
`·
`
`·
`·
`
`· ·
`
`·
`
`·
`
`·
`
`·
`
`M~
`t> 2
`· t> 3
`t> 6
`t> 1
`
`5445
`
`:::::::::::::::::::::::::~.::::::::::::::---.:::::::::::::::::::::::::::=::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::!!
`
`"'~;·;.
`
`I
`
`/'"440
`[380
`~--··--·-·-····!.········-··········~~~~~~ ............................................... ~ .. .
`Document Edit Insert case Format
`The present invention describes
`methods and apparatus for a stylus-driven
`computer. Said computer presents the
`behavior of a multi-paRe notebook includin~
`visible paQes~ paRe-tum effects~ tabbed
`bookmarks alonR one or more edRe,
`"floatinR• paRes temporarily removed from
`their notebook location~ a table-of-contents,
`and contents of sub-sections. Each paQe in
`the notebook contains one document which
`..
`may contain many physical pf1Res when
`printed. These paRes are analoRous to data 11
`files in other computers and may contain
`~~
`different types of documents such as text,
`l~
`drawinRs~ FAX ime.Res, or specialized forms. ~1
`jj
`Some information (such as the •Help
`Jl 1
`Information, is contained in separate
`...... _ ... __ ,.
`~----~--~-----,.-------------~
`···~···~:;;;;·--·=··-==~===·~-======-.,-,:::-.. -::::::=-...:.".::::-:::=:==-="""'''·
`{proximity)
`~-----------------~-----------------
`~ ff~fsJ Eifii¥¢1
`
`Fig. 12
`
`Kyocera PX 1007_13
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 13 of 73
`
`5,347,295
`
`•••••••••oooooooooooooo•o•••••••••••••••••••••••oooouooooooooouoooooooooooo•••••o•oo•u••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••·
`
`..-. 26•
`
`Expense Report
`Insert Case
`
`Document Edit
`Undo
`Select All
`Move
`Copy
`X
`Delete
`Options ... · .t
`0
`Edit Pcd
`Spe11...
`S
`Proof....
`P
`Find....
`F
`
`•. •.• ~ • ~:-':-':o~·!-!·!·~·!·!·!·:-:.:-:-~-:-:
`
`• :-·:: : ~--·.; :-:-: !-7·!-~-:-!.;-:.;.•.;.•.;.:.•:: :-· ·.:: : :.: •• •.•.: •••• •.•• : :.·.: : ••• : :-: : : '.· •• •.• •.••.••
`
`n
`0 :::s ,_
`:::s ... en
`
`ftl
`
`n
`
`:::s
`Q.
`
`0 -ftl
`0 .,
`n -
`
`-i
`0
`X
`"T1
`
`0 .,
`3
`en
`
`"0
`
`ftl .,
`en
`0 :::s
`0
`
`450/
`
`Fig. 13
`
`Kyocera PX 1007_14
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 14 of 73
`
`5,347,295
`
`Help: Title Line Gestures
`
`CJ)
`c
`3
`3
`0 ..,
`
`c Create new document
`Find
`F
`Home
`H
`p
`Print
`Send
`3
`.{ Opt1ons
`
`460
`
`-- Next document
`-.... Previous document
`-... F1rst document (notebook TOC)
`..
`-- Lost document
`
`Fig. 14
`
`Kyocera PX 1007_15
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 15 of 73
`
`5,347,295
`
`462
`Application
`-6--
`Document Edit Insert case Format
`464 ~
`::::::::::::::::;::;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;::::;::::::::::::::·::::::::
`The present invention desaibes methods and
`·::
`apparatus for e. stylus-driven computer. Said computer
`::
`presents the behavior of a multi-paRe notebook includinR 11
`visible paRes, PaRe-tum effects, tabbed bookmarks
`11
`aJonR one or more edRe, 'floe.tinR• paRes temporarily
`1~
`removed from their notebook location, e.
`"
`table-of-contents, and contents of sub-sections. Each
`..
`paRe in the notebook contains one dorument which may 11
`jj
`contain many physical paRes when printed. These
`pe.Res are e.ne.IOROUs to date. files in other computers
`~~
`and may contain different types of documents such as
`11
`text, drawinRS, FAX ime.ReS, or specialized forms. Some 11
`information (sudl e.s the •Help Information") is contained ;;
`ii
`in separate notebooks with all of the features listed
`above. The primary means of control of the computer is jj
`a rich set of Restures with the
`er almost
`~~
`obiect visible on the display. Gestures wit a stylus offer ll
`a more concise vocabulary t an tra itton pointinR
`1~
`devices because they combine both selection (by their
`11
`jj
`location) and meaninR (the specific RBsture) in one
`movement. A common set of Restures can delete,
`jj 3
`move, copy, or edit diverse objects such as text
`j~ ~
`~l "'
`fraRments, buttons, documents, or entire notebooks.
`Gestures can initiate the insertion of hand-written text.
`the editinR of existinR text, pe.Re-tuminR. scrollinR within
`a window, zoomin~=& or shrinkinR of entire pa~=&es,
`selection, summoninR of windows containinR operator
`!=IUidance, or the creation of links c·Roto• buttons) to
`
`11
`11
`~~
`ii
`H
`
`other ~~:~ximity of the stylus to the display's front I
`
`II
`surface is used to anticipate and terminate stylus input
`events. By sensinR both the proximity of the stylus tip to, ll
`and conte.ct with, the display surface the user-interface
`j)
`plliWi~liilillllliillliillliiiiliilliliillllilliiiiiii~iiW &:ai:i
`.
`,_:·_
`
`~ rfi(s(Eii¥~ J!J D ~
`~ It] [J~~r®~
`Fig. 15
`
`490
`
`470
`
`510
`
`500
`
`Kyocera PX 1007_16
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 16 of 73
`
`5,347,295
`
`:::::.~::::;::::::;:.::::::.c::::::::::::::::::::::::~:::::::::;:;:::::::::::::::::.::.::::;:;::::::::;:::::::::::.:o::::::::::::::::::::::::::::::::::::::;:::::::::::::::::::::::.::;
`
`--6-
`
`Application
`Document Edit Insert case Format
`object visible on the display. Gestures with a stylus offer .. (
`a more concise vocabulary than tradition pointin~
`~1
`devices because they combine both selection (by their
`l\
`location) and mecnin~ (the specific ~esture) in one
`l~
`movement. A common set of Qestures can delete.
`~~
`move, copy, or edit diverse objects such as text
`11
`fraRments, buttons, doruments, or entire notebooks.
`~~
`Gestures can initiate the insertion of hand-written te)(t,
`~j f--.
`11 ~
`the editinR of existinQ text, paRe-tuminQ, scrollinR within
`11 a
`a window, zoominR or shrink inA of entire paRes,
`ll ~
`selection, summonin~ of windows conteinin~ operator
`jj ,E
`RUidance, or the creation of links (•Qoto• buttons) to
`other pa~es.
`~~
`:::!:!.
`::
`!a
`'' 5P
`The proximity of the stylus to the display's front
`!l -v
`surface is used to anticipate and terminate stylus input
`events. By sensinR both the proximity of the stylus tip to, 11 ~-
`jj ~
`and contact with. the display su~ce the user~interface
`software can more accurately d1scem the vertical
`1~
`movement of the stylus, provide a richer vocabulary of 11lf
`stylus movements for control of the computer, and offer
`~~ 3
`better feedback to the user.
`11 ~
`:: "'
`.. ~
`.. r--- 470
`~enity. usin~ tt~e styfdu~ fo
`r selection, mh_ohover:nenths
`. t
`1
`1n o prox1m
`can n~Qer 1sp ay events w 1 ~IVe t e
`H
`user a preview of what display objects are understood to 11
`be tarReted by the computer. For example the computer H
`can expand or alter the appearance of a button in
`H
`anticipation of its selection. This solution overcomes the ji
`problems of selectin~ displayed objects due to ti~ht
`11
`II
`spacinR and parallax effects in prior art.
`
`52.0
`
`(Ol
`
`In the entry of multi-stroke Qre.phical objects the
`1l
`sensinR of the departure of the stytus tip from the vicinity H
`,._,
`,.., tl-.o :..-~
`~· .~ .... ,.,. •11.-.u. .. tho
`· 1 ·
`1for t ... rlit.-t"orn fho ,,_::_,.·
`
`~ !fif##PforP#J ~ D ~
`~ ~ [I~~~~
`
`Fig. 16
`
`Kyocera PX 1007_17
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 17 of 73
`
`5,347,295
`
`:::::::::::::::::::::::::::::::::;:::::;:u::::::::::::::::::::::::::::::::::::::::::::::::z::::::::u:::z::;::::::::::::::::::::::::::::::::::::::;:::::::::::::::::::::::::::::::::
`
`--6-
`
`Application
`Document Edit Insert case Format
`·r
`The present invention desaibes methods and
`,
`apparatus for a stylus-driven computer. Said computer
`presents the behavior of a multi-pa~e notebook includin~ ii
`visible pa~es, PaRe-tum effects, tabbed bookmarks
`U
`alonR one or more edRe. lfloatinR• paRes temporarily
`j~
`ii
`removed from their notebook location, a
`table-of-contents, and contents of sub-sections. Each
`11
`paRe in the notebook contains one document which may i!
`contain many physical paRes when printed. These
`11
`ii
`paRes are anaiOROUs to data files in other computers
`jj
`and may contain different types of documents such as
`text, drawinRS, FAX imaRes, or specialized forms. Some 1!
`information (such as the •Help Information") is contained ii
`in separate notebooks with all of the features listed
`11
`above. The primary means of control of the computer is
`1!
`a rich set of Restures with the
`us over almos
`~i
`object visible on the display. Gestures w1 a stylus offer 11
`a more concise vocabulary than tra it1on pointinR
`;;
`devices because they combine both selection (by their
`1i
`location) and meaninR (the specific Resture) in one
`11
`movement. A common set of Restures can delete,
`H 3
`move, copy, or edit diverse objects such as text
`~j ~
`jj
`'""
`fraRments, buttons, documents, or entire notebooks.
`Gestures can initiate the insertion of hand-written text,
`li
`ii
`the editinR of existinR text, paRe-tuminR. scrollinR within
`ii
`a window, zoominR or shrinkinR of entire paRes,
`ii
`selection, summoninR of windows containinR operator
`ll
`RUidance, or the creation of links (•Roto• buttons) to
`
`other ~:::ximity of the stylus to the display's front
`
`~
`ll
`surface is used to anticipate and terminate stylus input
`events. By sensinR both the proximity of the stylus tip to, 1i
`ii
`and contact with, the display surface the user-interface
`~~~:a.la.I~~~IU.QD~
`•
`"·''·'·
`
`~ [l(sff##!J ~ D ~
`~ a ti1tl®~~
`
`Fig. 17
`
`510
`
`530
`
`Kyocera PX 1007_18
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 18 of 73
`
`5,347,295
`
`--6--
`
`::::::::::.:::::::m;:.:.::::::::::;:::::::::~::::::::::::::~m.:::::~::::::::::::::::::;;::::::::::::::::::::::::::::::::::::::::::::::::~:::::::::::::::::::::::c::::::::::::.:::
`
`·r
`
`Application
`Document Edit Insert case Format
`The present invention describes methods and
`,
`apparatus for a stylus-driven computer. Said computer
`presents the behavior of a multi-pa~e notebook includin~ l~
`visible paRes, paRe-tum effects, tabbed bookmarks
`1~
`alonR one or more edRe, 8floatinR• paRes temporarily
`11
`ll
`removed from their notebook location, a
`jj
`table-of-contents, and contents of sub-sections. Each
`paRe in the notebook contains one document which may jl
`jj
`contain many physical pa~es when printed. These
`paRes are e~naloROUs to data files in other computers
`~~
`end may contain different types of documents such as
`j[
`text, drawinRS, FAX imaReS, or speciaJized forms. Some ~j
`..,
`information (such as the •Help Information") is contained ~~
`ll [
`in separate notebooks with aU of the features listed
`jj ~
`above. The primary means of control of the computer is
`a rich set of R&Stures with th
`n
`jj \l
`ffer ll ~-
`object visible. on the display. Gestures with a st Ius
`ii
`a more conase vocabulary t an tra it1on poJntJnR
`devices because they combine both selection (by their
`··
`location) and meeninR (the specific R&sture) in one
`movement. A common set of Restures can delete,
`move, copy, or edit diverse objects such as text
`fraRments, buttons, documents, or entire notebooks.
`Gestures can initiate the insertion of hand-written text,
`the editinR of existinR text, pa~e-tuminR, scrollinR within
`a window, zoominR or shrinkinR of entire paQes,
`selection, summonin~ of windows containinR operator
`j:~Uidence, or the aeation of links (•j:~oto• buttons) to
`other paRes.
`
`::J
`
`540
`
`The proximity of the stylus to the display's front
`jj
`surface is used to anticipate and terminate stylus input
`events. By sensinR both the proximity of the stylus tip to, j~
`and contact with~ the display surface the user-interface
`1!
`~~iiii.Qiala.Q~ ...... .a~~
`~.''.:··
`
`~ [IJ(Sj;!Xijiliji£SJ ~ ~ ~
`[Jtl~~~
`
`Fig. 18
`
`Kyocera PX 1007_19
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 19 of 73
`
`5,347,295
`
`···~~~,...,·················································································································································
`
`::::::::::::::::;:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;::::::::::::::::::::::::::.:.:.
`
`l
`
`.-!
`
`Application
`~.Doctiirieritl Edit Insert case Format
`.
`545 ... ~About...
`nt invention desaibes methods and
`Print
`,
`stylus-driven computer. Said computer
`...
`havior of a multi-paQe notebook includin~ ~[
`Print .setup... ~Qe-tum effect~. tabbed bookmarks_
`11
`.send...
`,eir notebook location, a
`s, and contents of sub-sections. Each
`Ex~rt...
`- - - - - ~book contains one document which may
`t"'":"
`Revert
`,ysical paQes when printed. These
`~
`a
`QOUS to data files in other computers
`and may contain different types of documents such as
`~
`ct
`text, drawin~s. FAX ima~es, or specialized forms. Some
`information (such as the •Help Information'} is contained ~
`in separate notebooks with all of the features listed
`~
`ab~e. The primary m~ans of control of the computer is ~! 5P
`ll \:S
`a nch set of ~estures with the stylus over almost any
`obiect visible on the display. Gestures with a stylus offer " ~-
`;; ~
`a more concise vocabulary than tradition pointinQ
`ii !
`devi~s because th~y combine ~oth selectio":l (by their
`locataon) and meamnR (the specific Qesture) 1n one
`movement. A common set of Restures can delete,
`move, copy, or edit diverse obiects such as text
`fra~ments, buttons, documents, or entire notebooks.
`Gestures can initiate the insertion of hand-written text,
`the editinR of existinR text, paRe-tumin~, scrollinR within
`a window, zoominQ or shrinkinQ of entire paqes,
`selection, summoninR of windows containinQ operator
`quidance, or the creation of links ("Qoto" buttons) to
`·
`otherpaRe~
`
`'' ~
`H 3
`~~ ~
`!! ~-
`··
`
`The proximity of the stylus to the display's front
`ll
`surface is used to anticipate and terminate stylus input
`events. By sensin~ both the proximity of the stylus tip to, lj
`and contact with, the display surface the user-interface 1ll
`,...,. ... l"'l"lnro ,..,..,...~&:z2:ii,..or,... tho •orti,..,..l
`
`,.. .A
`
`y····
`
`~[i~f,E,i#[fo@ ~ ~ D ~
`~ m liGD~~~
`
`Fig. 19
`
`Kyocera PX 1007_20
`
`

`

`U.S. Patent
`
`Sep. 13, 1994
`
`Sheet 20 of 73
`
`5,347,295
`
`547
`Application
`
`- 6 -
`
`::;:::::::;z::::::.:::.::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::;;::::::::::::;
`
`550
`560
`570
`5SO
`
`l
`ion describes methods and
`::
`· en computer. Said computer
`a multi-pa~e notebook includin~ jj
`effects, tabbed bookmarks
`jj
`, 'floatinQ• pa~es temporarily
`11
`ook loC8tion, a
`l1
`~1
`ntents of sub-sections. Each
`tains one document which may jj
`ii
`J:.JSS when printed. These
`ii
`data files in other computers
`590 "'1"":5~~~~r..:..r-%~.,f~- t type