(12) United States Patent
`Tarpenning et al.
`
`I 1111111111111111 11111 111111111111111 1111111111 lllll 111111111111111 11111111
`US006181344Bl
`US 6,181,344 Bl
`Jan.30,2001
`
`(10) Patent No.:
`(45) Date of Patent:
`
`(54) DRAG-AND-RELEASE METHOD FOR
`CONFIGURING USER-DEFINABLE
`FUNCTION KEY OF HAND-HELD
`COMPUTING DEVICE
`
`(75)
`
`Inventors: Marc E. Tarpenning, Palo Alto;
`Martin F. Eberhard, Woodside; Lance
`Uyehara, Fremont, all of CA (US)
`
`(73) Assignee: NuvoMedia, Inc., Palo Alto, CA (US)
`
`( *) Notice:
`
`Under 35 U.S.C. 154(b), the term of this
`patent shall be extended for O days.
`
`(21) Appl. No.: 09/086,096
`
`(22) Filed:
`
`May 28, 1998
`
`Related U.S. Application Data
`(60) Provisional application No. 60/078,782, filed on Mar. 20,
`1998.
`Int. Cl.7 ...................................................... G06F 15/00
`(51)
`(52) U.S. Cl. ............................................. 345/358; 345/146
`(58) Field of Search ..................................... 395/358, 398,
`395/352-354, 355, 356-357, 340-347,
`339,145,146,433,435,349
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/1993 Randall .
`5,237,651
`2/1994 Knowlton .
`5,283,864
`9/1994 Agulnick et al. .
`5,347,295
`10/1995 Henckel et al. .
`5,463,725
`3/1997 Allard et al. .
`5,615,384
`9/1997 Huffman et al. .
`5,663,748
`5,774,119 * 6/1998 Alimpich et al. .................... 345/340
`5,821,930 * 10/1998 Hansen ................................. 345/340
`5,889,516 * 3/1999 Hickey et al. ....................... 345/333
`5,914,718 * 6/1999 Chiu et al. ........................... 345/358
`5,986,655 * 11/1999 Chiu et al. ........................... 345/349
`5,990,865 * 11/1999 Gard ..................................... 345/156
`5,990,893 * 11/1999 Numazaki ............................ 345/358
`6,014,135 * 1/2000 Fernandes ............................ 345/331
`6,037,937 * 3/2000 Beaton et al.
`....................... 345/339
`6,057,844 * 5/2000 Strauss ................................. 345/358
`
`FOREIGN PATENT DOCUMENTS
`
`WO 97/20274
`WO 98/08344
`
`6/1997 (WO) .
`2/1998 (WO) .
`
`OTHER PUBLICATIONS
`
`14 page copy of Interactive Distributed Multimedia Systems
`and Telecommunication Services, 4th International Work(cid:173)
`shop, dated Sep. 10---12, 1997 pertaining to Multimedia
`Client Implementation on Personal Digital Assistants, pp.
`283 through 295.
`* cited by examiner
`
`Primary Examiner-Steven Sax
`(74) Attorney, Agent, or Firm-Townsend and Townsend
`and Crew LLP
`
`(57)
`
`ABSTRACT
`
`An electronic reading system is disclosed which allows
`users to download books and other types of content to a
`hand-held reader device for viewing. Using software which
`runs on a personal computer (PC), the user can download
`titles from Internet sites to the PC. Titles are then automati(cid:173)
`cally transferred to the device when the device is placed in
`a cradle which is connected to the PC. Using the device's
`touch-sensitive display and graphical user interface, the user
`can access various software-implemented features associ(cid:173)
`ated with the display and management of the content. One
`feature is a user-definable hotkey that can be "dragged and
`dropped" onto a menu item to create a shortcut to that item.
`Another feature allows the user to tap twice on a displayed
`word to cause the device to look the word up in a prespeci(cid:173)
`fied or default reference title, such as a dictionary or an
`encyclopedia. Another feature allows the user to block a
`passage on the touch-sensitive display and then specify one
`or more destinations ( email addresses, file folders, fax
`numbers, printers, etc.) for routing the passage; when the
`device is subsequently placed in the cradle, the passage is
`automatically retrieved by the PC and routed to the specified
`destination(s). The device also implements a user interface
`feature for allowing the user to rapidly and conveniently
`adjust the orientation of the displayed title.
`
`20 Claims, 15 Drawing Sheets
`
`92
`
`84
`
`Page 1 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 1 of 15
`
`US 6,181,344 Bl
`
`-1~-- : -
`~-
`: ,o~~~
`I ~ /
`~
`
`j
`
`'
`
`'
`
`;
`
`- -
`
`'
`
`Page 2 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 2 of 15
`
`US 6,181,344 Bl
`
`I
`
`\__
`
`-
`
`-- -
`
`J
`
`Page 3 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 3 of 15
`
`US 6,181,344 Bl
`
`READER DEVICE
`
`GRAPHICAL USER
`INTERFACE
`
`APPLICATION LAYER
`SEARCH, SELECTION, etc.
`
`DECRYPTION/
`DECOMPRESSION
`
`FILE SYSTEM
`
`PROGRAM ON PC
`
`GRAPHICAL USER
`INTERFACE
`
`APPLICATION LAYER
`TITLE ADD, DELETE
`
`SERIAL COMMUNICATIONS
`
`-
`
`SERIAL COMMUNICATIONS
`
`INTERNET
`COMMUNICATIONS
`
`-
`
`PUBLISHER SERVER
`
`TITLE DATABASE
`
`ENCRYPTION/
`COMPRESSION
`
`INTERNET
`COMMUNICATIONS
`
`KEY ADMINISTRATION AUTHORITY
`SERVER
`
`ENCRYPTION KEY
`DATABASE
`
`INTERNET
`COMMUNICATIONS
`
`~
`
`RETAIL SERVER
`
`RETAIL STOREFRONT
`
`-
`
`-
`
`INTERNET
`COMMUNICATIONS
`
`1-4---
`
`FIG 4
`
`Page 4 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`'""""
`~
`,I;;..
`,I;;..
`'"""" ~
`'"""" ~
`_,.a-...
`r.,J.
`e
`
`'"""' Ul
`0 ....,
`~ ....
`'JJ. =(cid:173)~
`
`,i;;..
`
`~ ~=
`?
`~
`~
`
`'"""'
`0
`0
`N
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`BATTERY
`
`NiMH
`
`51-
`
`BUTTON
`POWER
`
`36
`
`Vee
`
`SENSORS
`& VOLTAGE
`CHARGER
`BATTERY
`70 I SUPPLIES
`
`POWER
`
`ARRAY
`FLASH
`
`CONNECTOR
`
`OPTION
`
`I
`
`CONTROL
`A-BUS
`
`PORT
`
`ARRAY
`DRAM
`
`EPROM
`
`66
`
`J:
`CD
`=>
`ff)
`
`::::;;
`w
`::::;;
`0
`a::
`a::
`
`>(cid:173)
`
`CD
`=>
`ff)
`
`CONTROL
`
`PORT
`
`MISC.
`
`SCREEN
`TOUCH
`
`-
`
`INTERFACE
`
`SCREEN
`TOUCH
`
`76
`
`DISPLAY
`
`LCD
`
`'""'J
`
`44
`
`~------,
`FILTER/AMP
`
`PWM 2 1------1~
`LCD I/F
`PWM O
`
`AUDIO
`
`1----~
`
`LH77790
`
`73
`
`5
`
`FIG,
`
`CONNECTOR
`
`CRADLE
`
`40
`
`PORT B .., __ ,__ ________ __,
`
`I I
`
`,..
`
`!
`REAL-TIME
`
`CLOCK
`
`INT(1: 3], 5 ..,,____ ________ __,
`
`INT O I~
`
`PARALLEL PORT
`
`UART 0
`
`TRANCIEVER
`
`RS-232
`
`INT 4 I•
`
`UART 1
`
`CONNECTOR
`
`DEBUG
`
`UART 2
`
`TRAN Cl EVER
`
`lrDA
`
`46
`
`INT
`
`BUTTONS
`SCROLL
`
`38
`
`SYSTEM BUS
`
`PORT B
`
`XCLOCK
`
`MHz CLOCK
`
`16.5888
`
`Page 5 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`i,-
`~
`,I;;.,
`,I;;.,
`~
`i,-
`~
`i,(cid:173)
`-..a-...
`rJ'J.
`e
`
`'""" Ul
`0 ....,
`Ul
`~ ....
`rF.J. =(cid:173)~
`
`~ ~=
`?
`~
`~
`
`'"""
`0
`0
`N
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`86
`
`7
`
`FIG
`
`84
`
`~
`
`~
`I
`
`85 ----1-1------
`
`86
`
`FIG 6
`
`--:::::::::;:;._...:=:::;;
`
`84
`
`92
`
`Set References
`
`Search ... ,,
`
`Goto Bookmarks
`
`Set Bookmark
`
`Add Note
`
`'
`
`Set References
`
`Search,, ...
`
`riendly.
`al seek lo
`1we've seen
`
`Goto Bookmarks
`
`Set Bookmark Here
`
`0
`
`90
`
`e, even
`any people
`
`Add Note
`
`Lorge Text
`
`Highlight
`
`other groupware framework.
`used by more people than any
`particulary Lotus Notes, which is
`work; hence the rise of groupware,
`efficiently share their ideas and
`These teams need a way to
`small, highly goal-oriented teams.
`Work today increasingly involves
`
`85 -------u--
`
`90----...h--
`
`0
`0
`
`other groupware'-,fram_ework. V
`used by more 'Peo)le than a~ >,
`particule.ry l>Qlu¼-Notes, whi_\:h '\II
`work; henc,: the rise of grou11ware,
`efficient!'~ sl:!are their icl,eas,,, and
`These t);o,e,me need a "(,"Y -to
`small, ~ly goal-°'-lent_ed teams.
`Work ~oday incr~~~ involves
`
`'
`
`' '
`
`\
`
`Work today
`
`74
`
`82
`
`7
`
`-,
`74
`
`82
`
`~-
`
`7
`
`'
`'Work today
`
`Page 6 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 6 of 15
`
`US 6,181,344 Bl
`
`USER TOUCHES
`HOTKEY
`
`100
`
`IS A
`U CURREN
`
`NO
`
`102
`
`106
`
`YES
`
`WAIT FOR
`USER TO LIFT
`UP ON SCREEN
`
`104
`
`NO
`
`110
`
`IS
`TOUCHED AREA
`OVER A MENU
`ITEM
`
`EXECUTE ASSIGNED
`HOTKEY FUNCTION
`
`108
`
`YES
`
`IF CURRENT HOTKEY
`ITEM IS NOT MARKED,
`.---IF-TO_U_C_H......_E_D_M_.E_N_U--.
`MOVE H OTKEY ICON
`ITEM IS DIFFERENT
`TO CURRENT
`.___H_O_T_K_E~Y_I_TE_M _ __. FROM MARKED ITEM,
`MOVE HOTKEY ICON
`TO TOUCHED ITEM
`
`HAS
`USER LIFTED
`NO
`' - - - - - - - - - - - -1 UP ON SCREEN
`
`112
`
`YES
`
`114
`
`RECORD MARKED MENU
`ITEM AS CURRENT
`HOTKEY ITEM; CLEAR
`MENU(S) FROM SCREEN
`
`FIG 8
`
`Page 7 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`i,-
`~
`,I;;.,
`,I;;.,
`~
`i,-
`~
`i,(cid:173)
`-..a-...
`
`e r,r;.
`
`'"""' Ul
`0 ....,
`-..J
`~ ....
`rF.J. =(cid:173)~
`
`~ ~=
`?
`~
`~
`
`'"""'
`0
`0
`N
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`F/C, 10
`
`-----=:;;;:;; ;;:---=;;:;;:;;:;;;...,;;;:;:;;;:=====~_;;;;====-
`
`~
`
`F/C, g
`
`-----=:;;;:;;.-;;;;;.---=;:;:--::;;:;;;:;;:;==-===-
`
`~
`
`!JO
`
`qu'il'
`70 jusqu'aux problems
`popularite dons 1fs o~nees 60 et
`aux Etats-Unis.~M,":Ja grande
`la condition du cin~ma etronger
`anglais, Ken Korn nous parlera de
`Lors de cette conference en
`
`'1,'1~
`
`-,
`
`7
`
`-,
`
`0
`0
`
`~
`
`Club. $5.00 pour le public general.
`membres du Camera Cinema
`etudiants ainsi que pour les
`Gratuit pour les membres et les
`
`rencontrer!
`surtout pas l'occasion de le
`cinematographiques. Ne manquez
`de plusieurs festivals
`Cinequest et o fait partie du jury
`cinema, ii a participe au festival
`Cinema Club. Passionne de
`Ken Korn est directeur du Camera
`
`qu 'ii rencontre de nos jours.
`70 jusqu'oux problems
`populorite dons le'; o~nees 60 et
`aux Etots-Unis,ta~~o gronde
`lo condition du cin~mo etronger
`onglois, Ken Korn nous porlero de
`Lors de cette conf~rence en
`
`0
`0
`
`~
`
`I~'
`
`~'
`
`Club, $5.00 pour le public general.
`membres du Camera Cinema
`etudiants ainsi que pour les
`Gratuit pour les membres et les
`
`rencontrer!
`surtout pas !'occasion de le
`cinemotographiques. Ne manquez
`de plusieurs festivals
`Cinequest et a foit partie du jury
`cinema, ii a participe au festival
`Cine
`
`since
`
`Ken I .
`
`e de
`~u Camera
`
`Page 8 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 8 of 15
`
`US 6,181,344 Bl
`
`USER HAS
`SELECTED WORD
`AND TAPPED
`ONCE
`
`140
`
`SPECIAL
`REFERENCE TITLE
`DESIGNATED FOR THIS ..... Y_ES ___ -,
`TITLE AND PRESENT
`ON DEVICE
`
`NO SPECIFIC REFERENCE)
`SET; TRY TO FIND A
`DEFAULT REFERENCE
`
`(
`
`142
`
`DOES
`DEFAULT REFERENCE 1-Y_ES __ ~
`EXIST FOR TITLE'S
`CATEGORY
`
`144
`
`DOES
`DEFAULT REFERENCE
`EXIST FOR TITLE'S
`LANGUAGE
`
`154
`
`DISPLAY ERROR
`MESSAGE
`
`~Y_ES __ _
`
`148
`
`OPEN REFERENCE
`DOCUMENT AND
`SEARCH FOR WORD
`AS REFERENCE KEYWORD
`
`150
`
`152
`
`DISPLAY SEARCH
`RESULTS IN POP-UP
`WINDOW
`
`REMOVE POP-UP
`WINDOW UPON ANY
`USER ACTIVITY
`
`11
`
`Page 9 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`i,-
`~
`,I;;..
`,I;;..
`~
`i,-
`~
`i,(cid:173)
`_,.a-..,
`rJ'J.
`
`e
`
`'""" Ul
`0 ....,
`\0
`~ ....
`rF.J. =(cid:173)~
`
`~ ~=
`?
`~
`~
`
`'"""
`0
`0
`N
`
`~ = ......
`~ ......
`~
`•
`r:JJ.
`d •
`
`162
`
`FIG 13
`~ .---= ~
`',
`
`'I ~ ,¾J
`
`'I
`
`•:~
`
`T--!-1--160
`
`One such product ......
`moke Notes more user friendly.
`o stream of products that seek to
`This is one reason why we've seen
`
`Add Annotation
`
`To Fax, ..
`To Email. ..
`To Filecabinet...
`
`oth
`use
`port,
`woe
`effid File passage where? I
`These teams need o w oy to
`small, highly goal-oriented teams.
`Work today increasingly involves
`
`✓ To Printer ...
`
`1
`
`0
`0
`
`FIG 12
`
`~ ----=::;;;;;
`
`1/,
`
`1,
`
`One such product.. ....
`make Notes more user friendly.
`a streom of products that seek to
`This is one reason why we've seen
`
`I
`. /-., ~A,/·,./
`ffkuf
`pulonty" m~-.,
`'T'VY~
`
`other groupware framework.
`used by more people than any
`particularly Lotus Notes, which is
`work; hence the rise of groupwore,
`efficien ti y shore their ideas ond
`These teoms need o woy to
`smoll, highly goo\-oriented teoms.
`Work todoy increasingly involves
`
`.,.Ji
`
`~
`
`'1 ~J
`
`1,,
`
`~---0--
`
`I
`I
`
`)
`\
`
`160-----r
`
`-,
`
`r
`
`-,
`
`c..---_
`
`r
`
`Page 10 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 10 of 15
`
`US 6,181,344 Bl
`
`CITATION AND
`DESTINATION( S)
`SELECTED
`
`CREATE CITATION
`FILE
`
`GENERA TE AND
`INSERT HEADER
`WITH DESTINATION
`INFORMATION
`
`ADD HTML
`START TAGS
`
`INSERT ANY
`ANNOTATION TYPED
`IN BY USER
`
`170
`
`172
`
`174
`
`175
`
`ADD HTML FORMATTING
`TAGS IN EFFECT AT
`START OF SELECTION
`
`176
`
`ADD POINTERS TO
`START ANO END
`OF SELECTION
`
`ADD TAGS:
`TITLE
`AUTHOR
`PUBLISHER
`CHAPTER
`VERSE
`DATE
`
`ADD HTML
`END TAGS
`
`CLOSE CITATION
`FILE
`
`178
`
`180
`
`182
`
`184
`
`F/C, 14
`
`Page 11 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 11 of 15
`
`US 6,181,344 Bl
`
`REQUEST TO TRANSFER
`CITATION FILES
`RECEIVED FROM PC
`
`INSERT CONTENT INTO
`CITATION FILE(S) USING
`REFERENCE POINTERS
`
`TRANSFER CITATION
`FILE(S) TO PC
`
`WAIT FOR ROUTING
`CONFIRMATIONS FROM PC
`
`196
`
`190
`
`192
`
`194
`
`ITATI
`CONF
`? .
`
`NO
`} - - - - - - - ,
`
`( 202
`
`DELETE CONFIRMED
`CITATION FILES
`AND DISPLAY ERROR
`MESSAGE
`
`200
`
`YES
`
`DELETE ALL
`CITATION
`FILES
`
`F/C, 15
`
`Page 12 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 12 of 15
`
`US 6,181,344 Bl
`
`HAND-HELD
`DEVICE IN
`CRADLE
`?
`
`212
`
`READ CITATION
`TRANSFER INFORMATION
`FROM DEVICE
`
`214
`
`228
`
`DO
`ITATION FILE
`
`DO OTHER
`i.;....N...::.O _ _ -i HOUSEKEEPING TASKS---~
`WHILE DEVICE IS
`IN CRADLE
`
`216
`
`TRANSFER ALL
`CITATION FILES
`FROM DEVICE
`TO PC
`
`220
`
`STRIP-OFF AND
`PROCESS DESTINATION
`HEADER
`
`222
`
`224
`
`SEND ROUTE
`CONFIRMATION
`TO DEVICE
`
`226
`
`YES
`
`MORE
`CITATION FILES
`TO PROCESS
`
`COPY TO
`FILE FOLDER
`
`SEND USING
`OS PRINTER
`API
`
`SEND USING
`OS FAX IMAGE
`API
`
`SEND USING
`OS EMAIL
`API
`
`222A
`
`222B
`
`F/C, 16
`
`222C
`
`2220
`
`Page 13 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 13 of 15
`
`US 6,181,344 Bl
`
`,-..Jo
`
`80
`
`240
`
`246
`
`242
`
`to efficiently shore thier ideas and work:
`
`hence the rise of groupwore, particularly
`
`Lotus Notes, which is used by more
`
`people than any other groupware
`
`rk. Despite its popularity,
`
`md Notes difficult to use,
`
`ing
`
`is is one reason why we'
`
`of products that seek to
`
`Notes more user friendly. One such
`
`product is Places for Project Teams from
`
`Taligent, on IBM subsidiary that
`
`develops software components for IBM
`
`development tools.
`
`Places is built
`
`f a
`
`the
`
`0
`
`244
`
`FIG 17
`
`Page 14 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan.30,2001
`
`Sheet 14 of 15
`
`US 6,181,344 Bl
`
`~
`
`~ -
`
`11
`
`I
`
`~
`I I ~
`
`I
`
`I
`/2
`
`Work today increasingly involves small,
`highly goal-oriented teams. These teams need o way to
`effciently shore their ideas and work: hence the rise of
`groupwore, porticulory Lotus Notes, which is used by more
`people than any other groupwore framework. Despite its
`popularity, many people find Notes difficult to use, even
`intimidating
`This is one reason why we've seen a stream of products that
`seek to make Notes more user friendly. One such product is
`Places for Project Teams from Toligent, on IBM subsidiary that
`
`develops software components from IBM development tools.
`Places is built upon the idea of o virtual meeting place -
`space on the desktop where users con shore information and
`
`o
`
`~ - -
`
`FIG 18
`
`Page 15 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`U.S. Patent
`
`Jan. 30, 2001
`
`Sheet 15 of 15
`
`US 6,181,344 Bl
`
`USER PRESSES
`ORIENTATION BUTTON
`
`I
`
`SUPERIMPOSE ORIENTATION
`MARKERS ON DISPLA YEO
`TEXT, WITH MARKER FOR
`CURRENT SETTING HIGHLIGHTED
`
`I
`
`252
`
`WAIT FOR USER
`TO DEPRESS ONE
`OF THE MARKERS
`
`II
`
`256
`
`CLEAR DISPLAY;
`REPAINT DISPLAY
`USING SELECTED
`ORIENTATION
`
`,
`/258
`.-------------.
`RECORD ORIENTATION
`SETTING
`
`FIG, 19
`
`Page 16 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`US 6,181,344 Bl
`
`1
`DRAG-AND-RELEASE METHOD FOR
`CONFIGURING USER-DEFINABLE
`FUNCTION KEY OF HAND-HELD
`COMPUTING DEVICE
`
`RELATED APPLICATIONS
`
`This application claims the benefit of provisional patent
`application Ser. No. 60/078,782, filed Mar. 20, 1998 pend(cid:173)
`ing.
`
`FIELD OF THE INVENTION
`
`10
`
`The present invention relates to hand-held computing
`devices. More particularly, the present invention relates to
`user interface and other software features for facilitating the
`viewing and management of informational content using a 15
`touch-sensitive display.
`
`BACKGROUND OF THE INVENTION
`
`U.S. patent application Ser. No. 09/034,720, filed Mar. 4,
`1998, discloses a secure content distribution system which
`enables users to securely download literary titles and other
`types of content to a hand-held reader device. Using the
`reader device's control buttons and touch-sensitive display,
`users can perform such tasks as selecting, viewing and
`deleting titles, adjusting the font size and orientation of
`displayed text, and adding notes to selected passages.
`Because the titles are disseminated and stored in digital
`form, many of the costs associated with the sale and distri(cid:173)
`bution of books and other types of printed publications are
`eliminated, including the costs associated with printing,
`storing and shipping of such publications.
`In order for such a system to appeal to the mass public, it
`is important that the reader device have a user interface
`which is simple and intuitive to use. In addition, the device
`should provide functions which take advantage of the con(cid:173)
`tent's digital form, so that users have the incentive to use the
`system in place of printed publications. Further, the device
`should be comfortable to hold during prolonged viewing
`sess10n.
`The present invention addresses these and other problems.
`
`SUMMARY
`
`2
`In accordance with another aspect of the invention, the
`touch-sensitive display has a fixed icon displayed thereon
`which represents a user-definable function key or "hotkey."
`Using the hotkey, the user can execute a commonly-used
`5 menu or sub-menu item (function), such as a "Set Bookmark
`Here" function, with a single touch of the display. To assign
`a function to the hotkey, the user initially brings up one of
`the device's menus on the display, such as by touching a
`"book menu" or "library menu" key. The user then performs
`an intuitive drag-and-release operation from the hotkey to
`the target menu item, or vice versa. Thereafter (until a
`subsequent reassignment), the target menu item is executed
`immediately whenever the user touches and releases the
`hotkey with no menu displayed on the screen.
`In accordance with another aspect of the invention, the
`device supports a citation routing feature which allows a
`user to select a passage on the touch-sensitive display and
`then designate a destination for the subsequent routing of the
`passage by the general purpose computer. In a preferred
`20 embodiment, the user initially highlights the passage on the
`display and then taps once on the passage to bring up a menu
`of routing options. From this menu, the user can select one
`or more routing addresses, including email addresses, fax
`numbers, file folders and printers. In addition, the user can
`25 type-in an optional annotation using a pop-up keyboard.
`Once this process is complete, the device preferably
`creates a citation file which indicates the passage and
`destination(s) selected by the user. When a communications
`link is subsequently established between the device and the
`30 general purpose computer (such as by placing the device in
`the cradle), the citation file is automatically transferred to the
`computer (together with any other citation files that have
`been created but not yet transferred). A software application
`running on the general purpose computer in-turn routes the
`35 passage and optional annotation to the user-specified
`destination(s).
`In accordance with another aspect of the invention, the
`device includes an orientation key which can be torched by
`the user to bring up four orientation markers on the screen,
`40 each of which corresponds respectively to one of the four
`possible display orientation settings (0, 90, 180 or 270
`degrees relative to a base or gripping portion of the device).
`Each of the markers is preferably in the form of an arrow
`which points to one of the four edges of the display. To select
`45 a display orientation, the user simply touches the arrow that
`points to the desired top of the display. When the user places
`the device in the cradle, the device automatically resets the
`orientation to the base (zero degrees) setting to facilitate the
`viewing of content while the device is in the cradle.
`
`The present invention comprises a hand-held computing
`device that is adapted to be used as a reading device for the
`reading of literary titles and other types of content. The
`device includes a touch-sensitive display and a graphical
`user interface that provide various functions associated with
`the viewing of titles stored in the device's memory. In a
`preferred embodiment, the device is adapted to communi- 50
`cate with a PC or other general purpose computer via a
`cradle.
`In accordance with one aspect of the invention, the device
`implements an automatic look-up feature which can be
`invoked by the user to look up a word of a displayed title.
`Using this feature, the user can, for example, bring up a
`definition, language-to-language translation, audible
`pronunciation, encyclopedia listing, picture, or other type
`reference listing associated with the displayed term. In one
`embodiment, the user looks up the word by tapping the word 60
`twice-once to select the word and a second time to initiate
`the look-up process. The device responds by searching for
`the word in a pre-specified or default reference title
`( dictionary, encyclopedia, etc.) and displaying the results on
`the display. The reference titles can be downloaded to the 65
`device by the user, and can be designated for use with
`specific literary titles using the device's user interface.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`These and other features will now be described with
`reference to the drawings summarized below. These draw(cid:173)
`ings and the associated description are provided to illustrate
`55 a preferred embodiment of the invention, and not to limit the
`scope of the invention.
`FIG. 1 illustrates the physical user components of a
`content distribution and display system in accordance with
`the present invention.
`FIG. 2 is a perspective view of the hand-held reader
`device of FIG. 1.
`FIG. 3 is a side view of the device, illustrating an
`expanded base portion that may be used to conveniently
`hold the device in one of four supported orientations.
`FIG. 4 illustrates the general software architecture of the
`system, including components that may be used to securely
`distribute literary titles to users.
`
`Page 17 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`US 6,181,344 Bl
`
`5
`
`3
`FIG. 5 illustrates the general hardware architecture of the
`device.
`FIGS. 6 and 7 illustrate, in example form, a hotkey
`assignment feature of the device's user interface.
`FIG. 8 illustrates a sequence of program steps that are
`performed by the device to implement the hotkey assign(cid:173)
`ment feature.
`FIGS. 9 and 10 illustrate, in example form, a reference
`titles feature that enables users to look up selected terms
`within a pre-specified or default reference title.
`FIG. 11 illustrates a sequence of program steps that are
`performed to implement the reference titles feature.
`FIGS. 12 and 13 illustrate, in example form, a citations
`feature that can be used to route a selected passage to one or
`more destinations.
`FIG. 14 illustrates a sequence of program steps that are
`performed by the device to build a citation file.
`FIG. 15 illustrates a sequence of program steps that are
`performed by the device to transfer the citation files to the 20
`PC.
`FIG. 16 illustrates a sequence of program steps that are
`performed by the PC to retrieve, process and route the
`citation files.
`FIGS. 17 and 18 illustrate, in example form, a screen
`orientation feature of the device.
`FIG. 19 illustrates a sequence of program steps that are
`performed by the device to implement the screen orientation
`feature.
`
`10
`
`4
`sensitive display 34, an ON/OFF button 36, and UP and
`DOWN scroll buttons 38. The back of the housing (not
`shown) has an opening formed therein for holding a stylus,
`and includes a multi-pin connector 40 (FIG. 5) for connec-
`tion to the cradle 32. The device 30 also includes an audio
`speaker 44 (FIG. 5) for outputting digital audio signals, and
`includes an infrared (IrDA) transceiver 46 (FIG. 5) for
`communicating with kiosks, PC's, other infrared devices, or
`another hand-held device.
`As illustrated by FIGS. 2 and 3, the housing 33 has an
`increased width and depth and a rounded configuration
`along its base to form an extended gripping area 50 for
`holding the device. The gripping area 50 is sized to corre(cid:173)
`spond generally to a typical user's hand, and includes a
`15 curved portion which extends along the back side of the
`device to accommodate the user's fingers. As described
`below, the gripping portion is adapted to be used to hold the
`device in multiple difference device orientations.
`The gripping portion 50 houses one or more elongated,
`rechargeable batteries 51 (FIG. 6) that are used to power the
`device 30, and is thus heavily weighted in comparison to the
`remaining portions of the device. An important advantage of
`this device configuration and weight distribution is that it
`reduces stress on the user's hands and wrist during pro-
`25 longed reading sessions. This feature, combined with the
`ability to change this display orientation ( discussed below),
`facilitates the ability for the user to find a comfortable
`reading position.
`As depicted by FIGS. 1 and 4, the reader device 30 is
`30 adapted to be used as part of a secure content distribution
`system which includes the PC 31, the cradle 32, and various
`software components. The cradle 32 plugs into the serial
`port (not shown) on the PC, and also plugs into a standard
`power outlet. Included within the content distribution sys-
`35 tern are one or more client applications which run on the PC
`31. Using these applications, the user can purchase and
`download literary titles (novels, textbooks, journal articles,
`etc.) from Internet and other network sites to the PC, and
`subsequently transfer these titles to the device 30 for view-
`40 ing. The device 30 may additionally or alternatively be
`provided with browser software and a modem for allowing
`the user to download titles to the device directly. Titles may
`additionally or alternatively be retrieved by the PC from a
`physical storage medium, such as CD-ROM or a DVD disk.
`One type of PC application, which may be in the form of
`a browser plug-in, provides functionally for allowing a user
`to interactively purchase and download titles from Web
`sites. The PC 31 may also run a client application which
`retrieves free and/or subscription titles automatically (such
`50 as by implementing a "push" protocol) from network sites
`based on pre-specified preferences or subscription profiles of
`the user.
`Regardless of the type of title retrieval method used, the
`titles that are stored on the PC 31 are preferably automati-
`55 cally transferred to the device 30 when the device is placed
`in the cradle 52. The software running on the PC may
`additionally or alternatively be configured to allow the user
`to initiate title transfers manually. The cradle 52 also acts as
`a charging station for automatically charging the device's
`60 batteries.
`In one implementation, the device's software supports
`both the US ASCII and the Unicode character encoding
`standards. The use of Unicode allows the device to be used
`to display titles of multiple different written languages. The
`65 device is also capable of displaying graphics images, and
`playing sound clips, that are embedded within the titles. The
`system software also supports standard markup languages
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENTS
`Throughout the following description, reference will be
`made to various implementation-specific details, including,
`for example, specific standards that are used in the computer
`industry. These details are provided in order to fully set forth
`a preferred embodiment of the invention, and not to limit the
`scope of the invention. The scope of the invention is set forth
`in the appended claims.
`I. System Overview
`FIGS. 1-5 illustrate a content distribution and display
`system which incorporates the various features of the inven(cid:173)
`tion. They system includes a hand-held computing device 30
`that is adapted to be used as a portable reading device for 45
`allowing a user to read literary titles (books, journal articles,
`newspapers, memoranda, emails, etc.) and other types of
`content via a touch sensitive display 34. The titles are
`preferably downloaded to the device 30 in digital form from
`a Personal Computer (PC) 31 (FIG. 1) using a docking
`station or "cradle" 32. Using the device's user interface
`(described below), a user of the device can perform such
`tasks as selecting titles to view, adjusting the font size and
`orientation of the displayed text, deleting titles from
`memory, and attaching notes and bookmarks to the dis(cid:173)
`played text.
`In accordance with the invention, various software fea(cid:173)
`tures are provided for facilitating the management and
`display of content using the device's touch sensitive display
`34. Prior to describing these features, an overview will be
`provided of the general construction and operation of the
`hand-held device 30 and related components. As will be
`apparent from the following disclosure, the features of the
`invention may be incorporated into other types of hand-held
`computing devices that have touch-sensitive displays.
`As illustrated by FIG. 2, the reader device 30 includes a
`housing 33 which has respective openings for a touch-
`
`Page 18 of 24
`
`GOOGLE EXHIBIT 1009
`
`

`

`US 6,181,344 Bl
`
`10
`
`6
`mounted on top of an LCD display 76 (the perimeter of
`which is denoted by 76A in FIG. 2). The LCD display 76 is
`equipped with a backlight (not shown) which can be turned
`ON and OFF using the power button 36. The touch screen
`5 74 extends to or slightly beyond the inward-facing edge 78
`of the device's bezel. In one implementation, the touch
`screen 74 is a Panasonic EMU-601A2N400 device.
`II. Overview of User Interface
`As illustrated by FIG. 2, the portion of the touch screen 74
`which extends beyond the perimeter 76Aof the LCD display
`76 has four fixed icons displayed thereon to form four
`respective function keys: an orientation key 80, a user(cid:173)
`definable "hotkey" 82, a book menu key 84, and a library
`menu key 86. Each icon is in the form of an orientation(cid:173)
`independent image that conveys meaning regardless of the
`orientation in which the device is being held. For example,
`in any of the four possible device the orientations, the
`orientation icon 80 appears as a page of text that is being
`rotated.
`When the orientation key 80 is touched, the device
`displays four arrows (FIG. 27), each of which can be
`touched to select one of four possible display orientations (0,
`90, 180 or 270 degrees relative to the base 50 of the device).
`Using this feature, the user can select a text orientation
`which corresponds to the user's preferred device orientation
`and gripping method. For example, a left-handed user may
`choose the device/text orientation in which the gripping area
`50 falls on the left-hand side of the device (as in FIG. 6), and
`a right-handed user may choose the opposite orientation.
`30 The combination of the weight-concentrated gripping area
`50 and the ability to change the display orientation allows
`the device to be used in multiple different orientations
`without sacrificing comfort. The screen orientation features
`of the device are discussed further below.
`When the user touches the hotkey 82, the device 30
`performs a function (the "hotkey function") that is currently
`assigned to the hotkey 82. As described separately below
`with reference to FIGS. 6---8, one aspect of the invention is
`a user interface feature which allows a user to rapidly and
`40 intuitively designate the hotkey function.
`When the user presses the book menu key 84 or the library
`menu key 86, the device 30 displays a book menu 85 (FIG.
`6) or a library menu (not shown), respectively. The book
`45 menu 85 includes various menu items which pertain gener(cid:173)
`ally to the title that is currently being viewed. The library
`menu contains menu items which pertain generally to the
`library of literary titles that are currently stored within the
`device 30. The menu and sub-menu items of the book and
`50 library menus are listed and summarized in Table 1.
`
`TABLE 1
`
`Menu Item
`
`Description
`
`5
`such as HTML (HyperText Markup Language), and supports
`the use of hyperlinks to navigate within and between titles.
`In one embodiment, the device includes a speech synthe(cid:173)
`sizer application which converts encoded test (ASCII,
`Unicode, etc.) into audible speech. Using this application, a
`user can listen to a selected title. The speech synthesizer
`application is preferably configured to automatically scroll
`and highli