1111111111111111 IIIIII IIIII 11111 1111111111 111111111111111 IIIII IIIII IIIII IIIIII IIII 11111111
`US 20020149569Al
`
`(19) United States
`(12) Patent Application Publication
`Dutta et al.
`
`(10) Pub. No.: US 2002/0149569 Al
`Oct. 17, 2002
`( 43) Pub. Date:
`
`(54) TOUCHSCREEN USER INTERFACE
`
`(52) U.S. Cl. ............................................ 345/173; 345/168
`
`(75)
`
`Inventors: Rabindranath Dutta, Austin, TX (US);
`Robert J. Kamper, Round Rock, TX
`(US)
`
`(57)
`
`ABSTRACT
`
`Correspondence Address:
`Duke W. Yee
`Carstens, Yee & Cahoon, LLP
`P.O. Box 802334
`Dallas, TX 75380 (US)
`
`(73) Assignee: International Business Machines Cor(cid:173)
`poration, Armonk, NY (US)
`
`(21) Appl. No.:
`
`09/833,341
`
`(22) Filed:
`
`Apr. 12, 2001
`
`Publication Classification
`
`(51)
`
`Int. Cl.7 ....................................................... G09G 5/00
`
`A customizable touchscreen keyboard, and method, system,
`and computer program product for customizing the touch(cid:173)
`screen keyboard is provided. In one embodiment, a data
`processing system receives customization characteristics
`from a user through the touchscreen interface. The data
`processing system then creates a customized touchscreen
`keyboard layout based on the customization characteristics
`and presents the customized touchscreen keyboard layout to
`a user. For example, the user may customize the keyboard
`such that the letters are presented in a U-shape with the
`letters arranged in alphabetical order, thus aiding a user in
`finding a desired letter. The user may later recustomize the
`keyboard if desired. Furthermore, the data processing sys(cid:173)
`tem may reconfigure the keyboard based on past usage by
`the user.
`
`108
`
`106
`
`100
`
`110
`
`102
`
`□□□ o
`□□□
`
`104
`
`GOOGLE EXHIBIT 1011
`
`Page 1 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 1 of 8
`
`US 2002/0149569 Al
`
`108
`
`106
`
`100
`
`110
`
`102
`
`Figure 1
`
`□□□ o
`□□□
`
`104
`
`Processor
`204
`
`Main
`Memory
`206
`
`Display
`Adapter
`208
`
`Keypad
`Adapter
`210
`
`Bus 202
`
`Storage
`212
`
`Audio
`Adapter
`214
`
`Navigation Device
`200
`
`Figure 2
`
`Cradle
`Link
`216
`
`GOOGLE EXHIBIT 1011
`
`Page 2 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 2 of 8
`
`US 2002/0149569 Al
`
`Figure 3
`
`302
`
`300
`
`GOOGLE EXHIBIT 1011
`
`Page 3 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 3 of 8
`Figure 4
`
`US 2002/0149569 Al
`
`402
`
`302
`
`304
`
`300
`
`GOOGLE EXHIBIT 1011
`
`Page 4 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 4 of 8
`Figure 5
`
`US 2002/0149569 Al
`
`506
`
`502
`
`504
`
`500
`
`GOOGLE EXHIBIT 1011
`
`Page 5 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 5 of 8
`
`US 2002/0149569 Al
`
`NO
`
`Present default keyboard.
`612
`
`Begin
`
`Prompt user to select default or customized
`keyboard.
`602
`
`YES
`
`Present user with keyboard options.
`606
`
`Receive user keyboard selection.
`608
`
`Present user selected customized keyboard.
`610
`
`End
`
`Figure 6
`
`GOOGLE EXHIBIT 1011
`
`Page 6 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 6 of 8
`
`US 2002/0149569 Al
`
`Figure 7
`
`706
`
`708
`
`702
`
`704
`
`700
`
`GOOGLE EXHIBIT 1011
`
`Page 7 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 7 of 8
`
`US 2002/0149569 Al
`
`806
`
`812
`
`814
`
`816
`
`804
`
`800
`
`Figure 8
`
`GOOGLE EXHIBIT 1011
`
`Page 8 of 15
`
`

`

`Patent Application Publication Oct. 17, 2002 Sheet 8 of 8
`
`US 2002/0149569 Al
`
`Begin
`
`Receive user input.
`902
`
`Predict potential candidates for the next entry.
`904
`
`Present predicted candidates to user in a
`prominent area of the display.
`906
`
`Receive additional user input.
`908
`
`Did
`user select one of
`
`YES
`
`>---NO
`
`Perform requested function.
`914
`
`Enter selected candidate in a position following
`previously entered user data.
`912
`
`End
`
`Figure 9
`
`GOOGLE EXHIBIT 1011
`
`Page 9 of 15
`
`

`

`US 2002/0149569 Al
`
`Oct. 17, 2002
`
`1
`
`TOUCHSCREEN USER INTERFACE
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`BACKGROUND OF THE INVENTION
`
`[0001] 1. Technical Field
`[0002] The present invention relates to an improved touch(cid:173)
`screen keyboard for use with a data processing system.
`[0003] 2. Description of Related Art
`[0004] Computers over the last quarter century have infil(cid:173)
`trated almost every aspect of modern life. Computers are
`used by large corporations and universities to perform very
`complex functions as well as by individuals in their homes
`to manage personal business or for personal enjoyment. As
`circuits have become smaller and cheaper, computers have
`become smaller and have begun to be used for more mun(cid:173)
`dane tasks such as managing a personal calendar or contact
`list on a portable device such as a personal digital assistant
`or digital wireless telephone.
`[0005] A Personal Digital Assistant (PDA) is a handheld
`computer that serves as an organizer for personal informa(cid:173)
`tion. It generally includes at least a name and address
`database, to-do list and note taker. PDAs are pen based and
`use a stylus to tap selections on menus and to enter printed
`characters. The unit may also include a small on-screen
`keyboard which is tapped with the pen. Data is synchronized
`between the PDA and desktop computer via cable or wire(cid:173)
`less transmission.
`[0006] A PDA is like a palmtop computer except that the
`PDA typically uses a pen whereas the palmtop uses a small
`keyboard. Apple's MessagePad, more commonly known as
`the "Newton," was the first to popularize the concept.
`[0007] However, devices such as PDAs have limited data
`input options because of their size. As discussed above,
`many of these devices utilize touchscreen keyboards with
`data entries selected with a stylus by touching the screen
`over the desired character. The power and speed of small
`devices such as PDAs is increasing rapidly. Thus, the range
`of functions that may conceivably be performed by such
`devices is approaching that of personal computers. The
`limitations on speed and ease of data entry inhibit users from
`actually using their PDAs in any manner more complex than
`calendar or contact management. It would be desirable
`therefore, to have an improved touchscreen keyboard that
`facilitated greater speed and ease in user input.
`
`SUMMARY OF THE INVENTION
`
`[0008] The present invention provides a customizable
`touchscreen keyboard, and method, system, and computer
`program product for customizing the touchscreen keyboard.
`In one embodiment, a data processing system receives
`customization characteristics from a user through the touch(cid:173)
`screen interface. The data processing system then creates a
`customized touchscreen keyboard layout based on the cus(cid:173)
`tomization characteristics and presents the customized
`touchscreen keyboard layout to a user. For example, the user
`may customize the keyboard such that the letters are pre(cid:173)
`sented in a U-shape with the letters arranged in alphabetical
`order, thus aiding a user in finding a desired letter. The user
`may later recustomize the keyboard if desired. Furthermore,
`the data processing system may reconfigure the keyboard
`based on past usage by the user.
`
`[0009] The novel features believed characteristic of the
`invention are set forth in the appended claims. The invention
`itself, however, as well as a preferred mode of use, further
`objectives and advantages thereof, will best be understood
`by reference to the following detailed description of an
`illustrative embodiment when read in conjunction with the
`accompanying drawings, wherein:
`
`[0010] FIG. 1 depicts a diagram of a personal digital
`assistant (PDA) in accordance with a preferred embodiment
`of the present invention;
`
`[0011] FIG. 2 depicts a block diagram of a PDA in
`accordance with a preferred embodiment of the present
`invention;
`
`[0012] FIG. 3 depicts a pictorial diagram illustrating a
`touchscreen keyboard for use in a PDA in accordance with
`the prior art;
`
`[0013] FIG. 4 depicts a pictorial diagram of the PDA in
`FIG. 3 after the entry of a few characters;
`
`[0014] FIG. 5 depicts a pictorial diagram of a PDA
`illustrating a customizable keyboard in accordance with the
`present invention;
`
`[0015] FIG. 6 depicts a process flow and program func(cid:173)
`tion for customizing keyboard presentation for a customiz(cid:173)
`able touchscreen keyboard in accordance with the present
`invention;
`
`[0016] FIG. 7 depicts a pictorial diagram of a PDA with
`an improved touchscreen keyboard with predictive technol(cid:173)
`ogy in accordance with one embodiment of the present
`invention;
`
`[0017] FIG. 8 depicts a pictorial diagram illustrating
`another embodiment of an improved customizable touch(cid:173)
`screen keyboard with predictive technology according to the
`present invention; and
`
`[0018] FIG. 9 depicts a process flow and program func(cid:173)
`tion for identifying predicted characters and presenting
`predicted characters to a user in accordance with the present
`invention.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`
`[0019] With reference now to the figures and, in particular,
`with reference to FIG. 1, a diagram of a personal digital
`assistant (PDA) is depicted in accordance with a preferred
`embodiment of the present invention. PDA 100 includes a
`display 102 for presenting textual and graphical information.
`Display 102 may be a known display device, such as a liquid
`crystal display (LCD) device. The display may be used to
`present a map or directions, calendar information, a tele(cid:173)
`phone directory, an electronic mail message, or any other
`data. In these examples, screen 102 may receive user input
`using an input device such as, for example, stylus 110.
`
`[0020] PDA 100 may also include keypad 104, speaker
`106, and antenna 108. Keypad 104 may be used to receive
`user input in addition to using screen 102. Speaker 106
`provides a mechanism for audio output, such as presentation
`of an audio file. Antenna 108 provides a mechanism used in
`
`GOOGLE EXHIBIT 1011
`
`Page 10 of 15
`
`

`

`US 2002/0149569 Al
`
`Oct. 17, 2002
`
`2
`
`establishing a wireless communications link between PDA
`100 and a network, such as network 202 in FIG. 2.
`[0021] PDA 100 also preferably includes a graphical user
`interface that may be implemented by means of systems
`software residing in computer readable media in operation
`within PDA 100.
`[0022] Turning now to FIG. 2, a block diagram of a PDA
`is shown in accordance with a preferred embodiment of the
`present invention. PDA 200 is an example of a PDA, such
`as PDA 100 in FIG. 1, in which code or instructions
`implementing the processes of the present invention may be
`located. PDA200 includes a bus 202 to which processor 204
`and main memory 206 are connected. Display adapter 208,
`keypad adapter 210, storage 212, and audio adapter 214 also
`are connected to bus 202. Cradle link 216 provides a
`mechanism to connect PDA 200 to a cradle used in syn(cid:173)
`chronizing data in PDA 200 with another data processing
`system. Further, display adapter 208 also includes a mecha(cid:173)
`nism to receive user input from a stylus when a touchscreen
`display is employed.
`[0023] An operating system runs on processor 204 and is
`used to coordinate and provide control of various compo(cid:173)
`nents within PDA200 in FIG. 2. The operating system may
`be, for example, a commercially available operating system
`such as Windows CE, which is available from Microsoft
`Corporation. Instructions for the operating system and appli(cid:173)
`cations or programs are located on storage devices, such as
`storage 212, and may be loaded into main memory 206 for
`execution by processor 204.
`[0024] Those of ordinary skill in the art will appreciate
`that the hardware in FIG. 2 may vary depending on the
`implementation. Other internal hardware or peripheral
`devices, such as flash ROM (or equivalent nonvolatile
`memory) or optical disk drives and the like, may be used in
`addition to or in place of the hardware depicted in FIG. 2.
`[0025] With reference now to FIG. 3, a pictorial diagram
`illustrating a touchscreen keyboard for use in a PDA in
`accordance with the prior art is shown. PDA 300 includes a
`display 302 and a touchscreen keyboard 304. Characters are
`entered by using a stylus (not shown) to select characters
`from the touchscreen keyboard 304. However, one problem
`with the current system is that data entry is very time
`consuming since a user is required to use a stylus and search
`and pick letters one at a time. This entry method is much
`slower than typing at a conventional keyboard. However, a
`conventional keyboard is not a realistic option for PDAs
`since the size of the keyboard necessary to fit into the
`confined space of a PDA is too small for the size of a typical
`person's hand to use efficiently.
`
`[0026] With reference now to FIG. 4, a pictorial diagram
`of the PDA in FIG. 3 is depicted after the entry of a few
`characters. The letters "pat"402 have been entered into PDA
`300. With the conventional prior art touchscreen keyboard,
`the user would have to continue to search and peck with a
`stylus to complete the word or phrase desired to be entered.
`A new touchscreen keyboard providing a quicker entry
`method is desirable and provided by the present invention.
`
`[0027] With reference now to FIG. 5, a pictorial diagram
`of a PDA illustrating a customizable keyboard is depicted in
`accordance with the present invention. PDA 500 may be
`implemented as, for example, PDA 200 in FIG. 2 and
`
`includes a display 502, a customizable keyboard 504, and a
`data entry area 506. In this embodiment, in order to facilitate
`user input, the user may customize the keyboard 504 in a
`fashion that facilitates input into PDA 500. In the depicted
`example, keyboard 504 has been dynamically customized by
`the user to present the letters in a "U" -shaped format with
`other characters and function keys presented in the middle or
`below. In the depicted example, the letters are arranged in
`alphabetical sequence around the "U" -shaped keyboard.
`However, other arrangements of letters are possible, such as
`arranging the letters according to their frequency of use in
`the chosen language. Furthermore, although the letters are
`arranged in a clock wise fashion, the letters may be arranged
`in a counter clock wise fashion as selected by a user. Thus,
`right handed and left handed users may select a direction that
`is most suitable for their use.
`
`[0028] By presenting the letters in a "U" -shaped pattern,
`the user, particularly users not familiar with the placement of
`keys on a standard keyboard, may more easily locate the
`letters desired for entry. Furthermore, by arranging the
`letters in a "U" -shape or circular shape, the user can use a
`circular motion with the user's hand in selecting the appro(cid:173)
`priate letters using a stylus. Such a motion may be more
`convenient to some users since it does not require as much
`altering directions of movement as some other arrangements
`might require.
`
`[0029]
`In other embodiments, the user might specifically
`choose the placement of each letter, in for example, a
`conventional keyboard layout or choose the order of letters
`in some shape, such as the depicted "U" -shape. For example,
`the letters may be initially displayed perhaps at the bottom
`of display 502 and the user use a stylus or other entry method
`to drag and drop the keys in an arrangement desired by the
`user. Also, the customization of the keyboard may be
`performed an indefinite number of times as desired by the
`user. Thus, the user could customize the keyboard to a
`desired arrangement that the user desires for one type of data
`entry and then recustomize the keyboard to a different
`arrangement that the user believes more desirable for a
`different type of data entry. Furthermore, different users
`could use the same device and each customize the keyboard
`differently for their own desires and needs.
`
`[0030]
`In other embodiments, the user could emphasize
`certain keys, such as all the vowel keys, by, for example,
`enlarging the size of the certain keys, changing the shape of
`certain keys, changing the color of certain keys, changing
`the font size or style of certain keys, or animating certain
`keys. Thus, for example, the user could choose to animate all
`the vowels as they are used more frequently. The user could
`also make the keys for the numbers bigger if numbers are
`used often by the user.
`
`[0031] Furthermore, rather than merely providing the user
`with means to rearrange the keyboard in a manner suitable
`for the user, in other embodiments, the customizable key(cid:173)
`board includes functionality which provides the use with
`hints as to which keyboard characters are used most or that
`might be used next, such as described in further detail below.
`Furthermore, in other embodiments, the keyboard may be
`periodically reconfigured depending upon, for example,
`frequent typing errors of the user or upon the keys that the
`user actually types more often. Thus, the reconfigurable
`keyboard may be reconfigured to enlarge or emphasize keys
`
`GOOGLE EXHIBIT 1011
`
`Page 11 of 15
`
`

`

`US 2002/0149569 Al
`
`Oct. 17, 2002
`
`3
`
`that are more often typed. Or, in other embodiments, fre(cid:173)
`quently mistyped keys may be enlarged or emphasized, thus
`reducing the number of misspelled words typed by the user.
`
`[0032] Also, in other embodiments, appropriate distin(cid:173)
`guishing sounds could be generated by the PDA 500 when
`a key is typed. For example, when "a" is typed, "a" could be
`spoken by a speech synthesizer within PDA 500. this would
`help people who frequently mistype or cannot see the
`keyboard well.
`
`[0033]
`In other examples, the user may wish to resize the
`keyboard layout to accommodate the hand motion and target
`acquisition dexterity of the user. For example, older and
`younger users with lower levels of fine motor control may
`choose or be provided with a larger keyboard while users
`with higher levels of fine motor control may choose a
`smaller layout that reduces total motion distance but requires
`a more accurate "hit" of the target letter area.
`
`[0034] Additionally, the customizable keyboard 504 may
`be used in conjunction with entry prediction technology as
`described in more detail below to aid further in the entry of
`data by a user.
`
`[0035] With reference now to FIG. 6, a process flow and
`program function for customizing keyboard presentation for
`a customizable touchscreen keyboard is depicted in accor(cid:173)
`dance with the present invention. To begin, the PDA may
`prompt the user to select either a default or customized
`keyboard (step 602). The default keyboard may be, for
`example, a keyboard with an appearance similar to a stan(cid:173)
`dard keyboard as may be used on typewriters. The PDA then
`determines whether the user opted for a customizable key(cid:173)
`board or a default keyboard (step 604). If the user opted for
`the default keyboard, then the PDA presents the user the
`default keyboard on the PDA display (step 612).
`
`[0036]
`If the user opted for the customizable keyboard,
`then the PDA presents the user with keyboard customization
`options (step 606). The customization options may merely
`be a selection of several predetermined keyboard formats or
`may allow the user to choose from a number of options in
`creating a customized keyboard. Such other options may
`include selecting a shape, size of the "keys" and arrange(cid:173)
`ment of the keys on the chosen shape. Once the PDA
`receives a customization selection from the user (step 608),
`the PDA presents the customized keyboard layout to the user
`(step 610) and awaits user input.
`
`[0037] With reference now to FIG. 7, a pictorial diagram
`of a PDA with an improved touchscreen keyboard with
`predictive technology is depicted in accordance with one
`embodiment of the present invention. PDA 700 may be
`implemented as PDA 200 in FIG. 2 and includes an
`improved customizable touchscreen keyboard with word or
`letter prediction technology. PDA 700 is similar to PDA300
`in FIG. 3. PDA 700 includes a display 702 and touchscreen
`keyboard 704 with entry area 706. However, unlike prior art
`touchscreen keyboards, after a user has entered a one or
`more characters, the PDA 700 determines which letter or
`letters are likely to be entered next and highlights these
`letters or characters 708-714.
`
`[0038] Thus, in the present example, the user has entered
`the letters "pat" into entry area 706. Based on this, PDA 700
`emphasizes letters "e"708, "t"710, "o"712, and "h"714.
`These letters may be chosen by reference to a library of
`
`words, identifying words that start with the letters previ(cid:173)
`ously entered by the user, and highlighting the letter or
`letters that would be needed next to complete each of the
`identified words. The PDA could identify all possible words
`and highlight the letters needed for each word. Alternatively,
`the PDA could identify a subset of all possible words, where
`the words chosen to have highlighted letters necessary to
`complete the words are words that the PDA has identified as
`words that have a higher probability of use. This probability
`may be based on the likelihood of occurrence in the lan(cid:173)
`guage, such as, for example, English, generally, or may be
`based on the learned likelihood of occurrence based on the
`particular user's use of particular words. Thus, a word that
`may be very common in ordinary English use may be less
`common for a particular user and therefore, the letter nec(cid:173)
`essary to complete the word not presented to this particular
`user.
`
`[0039] The method of emphasizing the
`letters may
`include, for example, increasing the font size of the empha(cid:173)
`sized letters, highlighting the emphasized letters as depicted
`in FIG. 7, changing the color of the emphasized letters, or
`animating the emphasized letters, such as, for example, by
`having the emphasized letters blink. Other methods of
`emphasizing the selected letters may be used as well. For
`example, the emphasized letters may be moved or copied to
`a position of more prominence on the display 702, such as,
`near or below the entry area 706. By identifying potential
`letters that the user may wish to enter next, the user's eye is
`drawn to those letters enabling the user to select the next
`letter more readily than if the user needed to look across
`every letter on the keyboard to locate the next letter for entry.
`
`[0040]
`In the depicted example, the user has selected a
`default "normal" keyboard. However, the predictive tech(cid:173)
`nology is applicable to other choices of customized key(cid:173)
`boards as well such as discussed above.
`
`[0041] With reference now to FIG. 8, a pictorial diagram
`illustrating another embodiment of an improved customiz(cid:173)
`able touchscreen keyboard with predictive technology is
`depicted according to the present invention. Again, as with
`PDA 700, PDA 800 may be implemented as, for example,
`PDA 200 in FIG. 2. PDA 800 includes a display 802, a
`touchscreen keyboard 804, and entry area 806. However, in
`this embodiment, rather than identifying potential candi(cid:173)
`dates for the next letter or character to be entered by the user
`and emphasizing those letters or characters, words starting
`with the characters that the user has entered into display area
`806 are identified and the endings 808-816 necessary to
`form these words are presented to the user in a conspicuous
`area of display 802. Again, these endings 808-816 may be
`the endings of every word identified by PDA 800 as potential
`candidates or the endings 808-816 may only be those
`endings that PDA 800 has identified as being the endings of
`the most probable words. The identity of words as being a
`more or most probable word may be performed based on
`their frequency of occurrence in the language, such as, for
`example, English, French, or Spanish, utilized by the PDA
`display or, alternatively, may be the words identified by the
`PDA 800 as the most common words used by the particular
`user based on past usage.
`
`[0042]
`In the depicted example, the user has entered the
`letters "pat" into entry area 806. PDA 800 has identified five
`potential candidates for the word that the user wishes to
`
`GOOGLE EXHIBIT 1011
`
`Page 12 of 15
`
`

`

`US 2002/0149569 Al
`
`Oct. 17, 2002
`
`4
`
`enter. These candidate words are "patent,""patter,""patient,
`""patios", and "pathos." Thus, the suggested endings of
`"ent"808, "ter"810, "ient"812, "ois"814, and "hos"816 are
`presented to the user. The user may select one of these
`suggestions, for example, by tapping or double tapping the
`display 802 over the area of the desired ending 808-816.
`However, if none of these endings forms the word desired by
`the user, the user may use the keyboard 804 to continue
`entering characters until the desired word, phrase, or char(cid:173)
`acter string is entered.
`
`[0043] By presenting potential word endings to the user in
`a prominent place on display 802, the user may finish
`entering a word or phrase more quickly since the remaining
`letters of the word or phrase do not need to be entered
`individually. Thus, the data entry apparatus provided by
`PDA 800 allows a user to enter data more quickly than with
`prior art keyboards.
`
`[0044] Additionally, PDA 800 may be modified such that
`rather than presenting predicted word ending options to the
`user to complete the word, PDA 800 may present predicted
`letters that may be entered after the last letter displayed in
`the entry area 806 or may present predicted phonemes or
`syllables that the user may wish to place next in the entry
`area 806. (A phoneme is any of the abstract units of the
`phonetic system of a language that correspond to a set of
`similar speech sounds which are perceived to be a single
`distinctive sound in the language.) Alternatively, the PDA
`800 may present several of the above possibilities to the
`user. For example, PDA 800 may present both predicted
`word endings and predicted next letters to the user, perhaps
`on different lines of display 802. Thus, the user would be
`presented with the option of completing the word with one
`of the optional endings or using one of the predicted letters
`that are presented in a more prominent area of display 802
`than are the rest of the letters of the alphabet, thus allowing
`the user to more quickly locate these letters. Although it is
`possible to present the user with an almost unlimited range
`of possibilities, it is desirable to limit the amount of pre(cid:173)
`dicted endings, letters, syllables, or phonemes to some rather
`small number smaller at least than the number of characters
`in the alphabet, otherwise the user will again face the
`problem of searching a rather large range of possibilities for
`the desired entry.
`
`[0045] An additional alternative provides a temporary
`display of the letter of group of letters pointed to after a
`single tap, and entering the input on a double or second tap
`of the stylus. Thus, for example, the display may, after a
`stylus tap of the letter "e", display the following with an "e"
`placed in the fourth letter place of the word as shown below:
`
`[0046] pate _ _
`
`[0047] e/tioh
`
`[0048] Then after a stylus tap of "t", the "e" in the fourth
`letter place is replaced with a "t" as the following depicts:
`
`[0049] patt _ _
`
`[0050] et/ioh
`
`[0051] The"/" represents single stylus tap, and after each
`tap, the preceding letter is replaced by the current letter
`tapped. After a second tap on a letter enters the letter
`"semi-permanently" and moves the input point to the right
`
`one space. Thus, the display, after double clicking the letter
`"e" would show the following:
`
`[0052] pate __ _
`
`[0053] e/tioh
`
`[0054] Thus, the second tap on the letter "e" enters it
`"semi-permanently" and moves the input point to the right
`one space. The term "semi-permanently" is used to indicate
`that a back arrow or delete key may be used to delete a letter
`inadvertently double clicked and entered into the field.
`
`[0055] The same approach may be extended to groups of
`letters which would be entered temporarily or "semi-perma(cid:173)
`nently" on one or two taps, respectively.
`
`[0056] With reference now to FIG. 9, a process flow and
`program function for identifying predicted characters and
`presenting predicted characters to a user is depicted in
`accordance with the present invention. To begin, the PDA
`receives user input (step 902). Based on the received user
`input, the PDA predicts potential candidates for the next
`entry (step 904). The predicted candidates could be, for
`example, predictions of the next letter or the remaining
`letters needed to form a word. The prediction could also be
`based on probability of occurrence either based on the
`frequency of occurrence in the language or on the frequency
`that the particular user has used the words in the past.
`
`[0057] Once the predicted candidates have been identified,
`the PDA presents the predicted candidates to the user in a
`prominent fashion (step 906). The presentation could be, for
`example, emphasizing certain letters on the keyboard, or
`presenting predicted letters or endings in a prominent area of
`the display. The PDA then receives further user input (step
`908) and determines whether the user has selected one of the
`predicted candidates or some other option (step 910). If
`some other option has been selected, then the PDA performs
`the requested function, such as, for example, merely entering
`a character as selected from the main keyboard that was not
`one of the predicted candidates. If the user did select one of
`the predicted candidates, the PDA enters the selected can(cid:173)
`didate in a position following the previously entered user
`data (step 912).
`
`[0058] Although the present invention has been described
`in primarily in terms of a personal digital assistant, it will be
`apparent to one skilled in the art, the present invention may
`be applied to other types of touchscreen displays as well,
`whether or not such touchscreens are presented on a PDA or
`some other type of data processing system. For example, the
`present invention could be implemented on a wireless phone
`having a touchscreen interface.
`
`[0059] Furthermore, it is important to note that while the
`present invention has been described in the context of a fully
`functioning data processing system, those of ordinary skill
`in the art will appreciate that the processes of the present
`invention are capable of being distributed in the form of a
`computer readable medium of instructions and a variety of
`forms and that the present invention applies equally regard(cid:173)
`less of the particular type of signal bearing media actually
`used to carry out the distribution. Examples of computer
`readable media include recordable-type media such a floppy
`disc, a hard disk drive, a RAM, and CD-ROMs and trans(cid:173)
`mission-type media such as digital and analog communica(cid:173)
`tions links.
`
`GOOGLE EXHIBIT 1011
`
`Page 13 of 15
`
`

`

`US 2002/0149569 Al
`
`Oct. 17, 2002
`
`5
`
`[0060] The description of the present invention has been
`presented for purposes of illustration and description, but is
`not intended to be exhaustive or limited to the invention in
`the form disclosed. Many modifications and variations will
`be apparent to those of ordinary skill in the art. The
`embodiment was chosen and described in order to best
`explain the principles of the invention, the practical appli(cid:173)
`cation, and to enable others of ordinary skill in the art to
`understand the invention for various embodiments with
`various modifications as are suited to the particular use
`contemplated.
`
`What is claimed is:
`1. A method of customizing a touchscreen keyboard, the
`method comprising:
`
`receiving customization characteristics;
`
`creating a customized touchscreen keyboard layout from
`the customization characteristics; and
`
`presenting the customized touchscreen keyboard layout to
`a user.
`2. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics include a shape of the keyboard.
`3. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics include an arrangement of characters.
`4. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics include a size of keys.
`5. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics include a shape of keys.
`6. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics are chosen from a menu.
`7. The method as recited in claim 1, wherein the customi(cid:173)
`zation characteristics are selected