(12) United States Patent
`H0ekSma
`
`USOO6271835B1
`(10) Patent No.:
`US 6,271,835 B1
`(45) Date of Patent:
`Aug. 7, 2001
`
`(54) TOUCH-SCREEN INPUT DEVICE
`(75) Inventor: Henry HoekSma, Kinburn (CA)
`(73) Assignee: Nortel Networks Limited, Montreal
`(CA)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(*) Notice:
`
`7
`
`(21) Appl. No.: 09/146,232
`(22) Filed:
`Sep. 3, 1998
`3.
`345/168;
`
`2/1994 Matias.
`5,288,158
`1/1995 Clough et al..
`5,379,057
`11/1996 Niemeier.
`5,574,482
`12/1996 Hankes.
`5,583,497
`9/1999 Kubota et al. ....................... 345/179
`5,956,021
`* cited by examiner
`Primary Examiner Richard Hjerpe
`ASSistant Examiner-Duc Dinh
`74Y A
`y, Ag
`Fi
`Jeff M
`ttorney, Agent, Or Firm Jeff Measures
`ABSTRACT
`(57)
`A touch Screen input device for improving the input of
`alphanumeric data in an area of limited Space. The input
`"5" device employ
`lti-touch method of input which i
`intuitive to a first time user. The device maps a plurality of
`345/179
`characters to each of its input keys and upon Selection of a
`key Subsequently re-labels the input keys with the characters
`(58) Field of Search ..................................... 345/168, 169,
`34.5/171, 172, 179
`displayed on the Selected key. The device is intuitive to a
`first time user Since the input keys are re-labeled in manner
`which corresponds to their relative position within the
`Selected input key. In comparison to Single Stroke input
`devices this device reduces the number of keys required for
`data input. Alternatively a user could Select a Single char
`acter without employing the multi-touch method by Select
`ing a pre-defined element of a particular input key.
`
`O
`
`-1 - O
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`4,333,097
`4,680,728
`4,725,694
`5,003,503
`5,006,001
`5,258,748
`
`6/1982 Buric et al..
`7/1987 Davis, II et al..
`2/1988 Auer et al. .
`3/1991 Lapeyre.
`4/1991 Vulcano .
`11/1993 Jones.
`
`
`
`eVice emploVS a multi-touch method Of Input Which IS
`
`14 Claims, 6 Drawing Sheets
`
`M
`P
`
`Apple Inc.
`Exhibit 1012
`Page 001
`
`

`

`U.S. Patent
`
`Aug. 7, 2001
`
`Sheet 1 of 6
`
`US 6,271,835 B1
`
`- 50
`
`SOFTWARE
`
`ON-SCREEN KEYBOARD
`
`TOUCH INPUT TO
`KEY MAPPNG
`
`KEY TO ACTION
`MAPPNG
`
`TOUCH POSITION
`RECOGNITION
`
`DRAW DIFFERENT
`KEYBOARD
`
`ch,
`
`ERFrom
`KEY
`
`RECTANGLE
`DRAWING
`
`TEXT STREAM
`INSERTION
`
`TEXT DRAWING
`
`
`
`
`
`HARDWARE
`
`4O
`
`CONTROLLER
`
`2O
`
`STORAGE
`
`DISPLAY
`
`TOUCH SCREEN
`DIGITIZER
`
`FIG. 1
`
`Apple Inc.
`Exhibit 1012
`Page 002
`
`

`

`U.S. Patent
`
`Aug. 7, 2001
`
`Sheet 2 of 6
`
`US 6,271,835 B1
`
`
`
`Apple Inc.
`Exhibit 1012
`Page 003
`
`

`

`U.S. Patent
`
`Aug. 7, 2001
`
`Sheet 3 of 6
`
`US 6,271,835 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`MAP SINGLE
`CHARACTERS TO
`KEYS
`
`REQUEST
`KEYBOARD?
`
`
`
`SELECT DEFAULT
`CHARACTER
`ARRAY
`
`MAP CHARACTERS
`OF SELECTED
`CHARACTER
`ARRAY TO
`CHARACTER KEY
`ELEMENTS
`
`510
`
`520
`
`
`
`
`
`
`
`
`
`
`
`540
`
`WAIT FOR INPUT
`
`ON
`SCREEN KEY
`TOUCHED
`
`
`
`DONE KEY
`TOUCHED
`
`SELECT
`ASSIGNMENNYES APPROPRIATE
`KEY TOUCHED
`CHARACTER
`ARRAY
`
`
`
`
`
`WITH SINGLE
`CHARACTER
`
`INSERT
`CHARACTER IN
`TEXT STREAM OR
`PERFORM
`FUNCTION
`
`
`
`
`
`INSERT
`CHARACTER IN
`TEXT STREAM OR
`PERFORM
`FUNCTION
`
`FIG. 3
`
`Apple Inc.
`Exhibit 1012
`Page 004
`
`

`

`U.S. Patent
`US. Patent
`
`Aug. 7, 2001
`
`Sheet 4 0f 6
`
`US 6,271,835 B1
`US 6,271,835 B1
`
`
`
`ÅEX CJ
`
`
`
`=10=T?s ZZZ
`
` \R‘wxxxxm‘g“
`
`Ø
`
`Z
`
`000 ||
`
`Apple Inc.
`Exhibit 1012
`Page 005
`
`

`

`U.S. Patent
`
`Aug. 7, 2001
`
`Sheet 5 of 6
`
`US 6,271,835 B1
`
`
`
`
`
`
`
`C19 "5)||-||LNBWETE GELOBTES Ø.
`
`0 || 0 ||
`
`000 || J. 090||
`
`»
`
`Apple Inc.
`Exhibit 1012
`Page 006
`
`

`

`U.S. Patent
`
`Aug. 7, 2001
`
`Sheet 6 of 6
`
`US 6,271,835 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`REO UEST
`KEYBOARD?
`
`
`
`
`
`
`
`SELECT DEFAULT
`CHARACTER
`ARRAY
`
`WAT FOR INPUT
`
`st-
`
`ON
`SCREEN KEY
`TOUCHED
`
`DONE KEY
`TOUCHED
`
`MAP SUB-ARRAY
`OF ONE ORDER
`LESS TO
`cHARACTERKEYs 2080
`ASSIGNMENT
`KEY TOUCHED
`
`MAP BASE
`SUB-ARRAYS OF
`SELECTED
`
`CHARACTER
`
`
`
`ARRAY TO
`CHARACTER KEYS
`
`YES
`
`SELECT
`APPROPRIATE
`CHARACTER
`ARRAY
`
`
`
`
`
`
`
`INSERT
`CHARACTER IN
`TEXT STREAM OR
`PERFORM
`FUNCTION
`
`1ST ORDER
`SUB-ARRAY O
`KEY
`
`MAP SINGLE
`CHARACTERS TO
`KEYS
`
`1ST ORDER
`SUB-ARRAY
`ON KEY
`
`INSERT
`YES CHARACTER IN
`TEXT STREAM OR
`PERFORM
`FUNCTION
`
`MAP SINGLE
`CHARACTERS TO
`KEYS
`
`2ND ORDER
`SUB-ARRAY
`ON KEY
`
`MAP SUB-ARRAY OF TWO
`ORDERS LESS TO
`CHARACTER KEYS
`
`FIG. 6
`
`Apple Inc.
`Exhibit 1012
`Page 007
`
`

`

`US 6,271,835 B1
`
`15
`
`25
`
`35
`
`40
`
`1
`TOUCH-SCREEN INPUT DEVICE
`FIELD OF THE INVENTION
`The present invention relates to touch-Screen devices for
`the input of alphanumeric data generally, and Specifically to
`touch-Screen devices with limited input Space. In particular,
`the invention relates to methods and apparatus for inputting
`Said data.
`BACKGROUND OF THE INVENTION
`It is well known to input alphanumeric data using a single
`Stroke keyboard, for example, to a personal computer. A
`“OWERTY' keyboard is a well known keyboard wherein
`each key represents a particular character, the first Six being
`labelled QWERTY from left to right. Disadvantages of Such
`an input device include the amount of Space required for the
`keyboard and the non-intuitive arrangement of the keys
`therein. The required Space for a keyboard is typically
`limited by the number of keys necessary for the characters
`to be made available and the key Space necessary to maintain
`reliable data input, i.e. to avoid multiple keys being
`depressed.
`It is possible, however, to reduce the size of an input
`device, i.e. a keyboard, without reducing the number of
`characters which can be Selected. This can be accomplished
`either by (i) reducing the size of the keys themselves or (ii)
`decreasing the number of keys and increasing the number of
`keystrokes. Reducing the size of the keys, however, is not a
`practical Solution due to the aforementioned problem of
`multiple key depression. A“QWERTY' keyboard employed
`in a wireleSS handset, for example, would require the user to
`exhibit considerable accuracy in Selecting the desired char
`acter. Therefore, in order to meet both requirements, one
`must use an input device that requires multiple keystrokes.
`Prior art devices take advantage of the fact that the same
`number of characters on a Single Stroke keyboard can be
`made available on a keyboard with fewer keys by incorpo
`rating multiple keystrokes.
`AS an example of Such a prior art device, the reader is
`directed to U.S. Pat. No. 5,003,503, issued Mar. 26, 1991,
`naming Lapeyre as inventor, the disclosure of which is
`hereby incorporated by reference. The Lapeyre patent pro
`vides for a 7 and 12 key input device that works on the
`general premise that a first key Stroke identifies a group of
`characters from which a character is Selected by a Second
`key Stroke. The drawbacks of Such an arrangement are
`twofold.
`First, the location of a character within its respective
`group of characters does not determine the Second keystroke
`key which must be pressed to Select the character. This
`arrangement, similar to the “QWERTY' keyboard, results in
`a non-intuitive method of data input in which the user must
`Search for the appropriate Selection key. Such a device
`therefore requires extensive use in order for a user to become
`familiar with its input arrangement, thus making the device
`cumberSome for a first time or periodic user.
`Second, as a result of all available characters and their
`corresponding Secondary keystroke number being labelled
`on the keys, the Lapeyre device is very cluttered and difficult
`to read. Again, this increases the input difficulty for a first
`time or periodic user.
`There exists, therefore, a need for providing a clear and
`intuitive method of data input in an area of limited Space.
`SUMMARY OF THE INVENTION
`It is an object of the present invention to provide a
`touch-Screen device for the input of alphanumeric data in a
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`manner which is intuitive to a first time or periodic user
`without requiring a separate key for every character. Accord
`ing to one aspect of the invention this objective is met by
`mapping Sub-arrayS or groups of characters to input keys
`wherein Successive keystrokes can uniquely identify every
`character therein. Said input keys are not mechanical as are
`those on a traditional keyboard but are rather input Surfaces
`Selectable by pressing a pre-defined area of the touch-Screen
`with one's finger. The characters mapped to Said keys
`include alphanumeric characters, Symbols and function
`characters, a function character being a character which
`represents a function Such as backSpace, tab or done for
`example.
`One application of Said touch-Screen input device is for
`use in a wireleSS handset where there exists an obvious Space
`limitation given the recent trend towards Smaller handsets.
`In Said application the keys necessary for the input of
`alphanumeric data must be large enough to be reliably
`Selected by a user's finger. A touch-Screen device utilizing a
`multi-stroke input Sequence with a minimal number of keys
`is thus required-a typical 92 key keyboard being imprac
`tical in Said application.
`According to one embodiment, the input keys displayed
`on Said touch-Screen input device are divided into a plurality
`of elements, wherein the number of elements per key is leSS
`than or equal to the total number of input keys. Said
`elements are positioned within their respective input key to
`correspond to the relative position of the input keys within
`the input area of the touch Screen. Individual characters are
`mapped to each individual element. Said characters include
`alphanumeric data, Symbols and characters representing a
`function. To Select a character a user would first Select an
`input key displaying a group of characters, one of which is
`the desired character. Such a Selection occurs when the user
`touches a plurality of elements on the Same input key.
`Responsive to Selecting a desired key, each input key is
`Subsequently re-mapped with the characters contained
`within Said Selected key. The re-mapping proceSS occurs
`Such that each character is re-mapped to the key whose
`relative position within the input area corresponds to the
`relative position of Said characters within the Selected input
`key. The user then Selects, with a Subsequent keystroke, the
`desired character from the input keys re-mapped with the
`individual characters. This re-mapping provides a user
`friendly interface to first time and periodic users as the
`appropriate key is always labelled with the desired charac
`ters from each keystroke.
`Preferably a second method of data input can be offered
`to the user. In addition to the two keystroke method previ
`ously discussed a single Stroke method can also be
`employed. With respect to Said Single keystroke method a
`user can input a Single character directly by touching only
`the individual element to which the desired character has
`been mapped without touching any other elements on the
`key. Given the size of the elements within the keys, Such a
`Single keystroke would typically require fine control by the
`user. This can be facilitated by means of a finely tipped
`instrument, for example a stylus.
`First time and periodic users are further benefited by the
`present invention given that the character layout and the
`input Sequence are intuitive i.e. user friendly.
`One aspect of the invention provides for a touch-Screen
`device comprising: a touch Screen; means for displaying on
`Said touch-Screen a plurality of input keys, means for
`mapping a plurality of characters to each input key; means
`for determining whether an input designates a Single char
`
`Apple Inc.
`Exhibit 1012
`Page 008
`
`

`

`3
`acter or a re-map command; means for re-mapping Said
`input keys responsive to a re-map command input, means
`for Selecting a character responsive to an input designating
`a particular character.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The present invention, together with further objects and
`advantages thereof will be further understood from the
`following description of the preferred embodiments with
`reference to the drawings in which:
`FIG. 1 is a block diagram showing the hardware and
`Software components of a touch-Screen input device accord
`ing to a preferred embodiment of the invention.
`FIG. 2 is a Schematic diagram showing a touch-Screen
`input device display layout according to a preferred embodi
`ment of the invention.
`FIG. 3 is a flow diagram illustrating the proceSS carried
`out by the touch-Screen input device Software according to
`a preferred embodiment of the invention.
`FIG. 4 is a Series of Schematic diagrams illustrating the
`input Sequence, as the result of character key inputs, of a
`touch-Screen input device according to an alternate embodi
`ment of the invention.
`FIG. 5 is a Series of Schematic diagrams illustrating the
`input Sequence, as the result of element inputs, of a touch
`Screen input device according to an alternate embodiment of
`the invention.
`FIG. 6 is a flow diagram illustrating the proceSS carried
`out by the touch-Screen input device Software according to
`an alternate embodiment of the invention.
`
`15
`
`25
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`The present invention will be described with respect to a
`preferred embodiment used in a wireless handset. It should
`appreciated by a perSon Skilled in the art that the invention
`can also be utilized in other devices, for example, a personal
`organizer, a wrist watch, a pager, etc. which require periodic
`data input given a limited amount of Space.
`By way of example, FIG. 1 illustrates a touch-Screen input
`device according to a preferred embodiment of the inven
`tion. Said device includes hardware 10 comprising a display
`20, a touch screen digitizer 30, and a controller 40. Said
`controller further comprises a micro-processor 42, and asso
`ciated memory 44, for example, operating memory (eg.
`RAM), and software storage 46. The function of said con
`troller 40 is to control the touch screen digitizer 30 and the
`display 20, responsive to the Software 50. Said software
`comprises eight Sub-routines, five of which are used for
`operating the on-screen keyboard 60. The five sub-routines
`employed in the on-Screen keyboard include: touch input to
`key mapping 62-which translates the location of a touch on
`the Screen into an identification of which on-screen element
`(S) were pressed; key to action mapping 64-which, respon
`Sive to on-screen element(s) being pressed, performs the
`associated action; draw different keyboard 66 which
`re-displays the on-screen keys with new labels as deter
`mined by the key to action mapping Sub-routine 64; generate
`character from key 68 which determine which particular
`character has been Selected; and text Stream insertion
`70-which inserts the selected character into the devices
`keyboard input Stream So that other Software recognizes the
`character as coming from a regular keyboard. The remaining
`three Sub-routines are part of the System Software which is
`necessary to Support the On-Screen keyboard. These remain
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,271,835 B1
`
`4
`ing Sub-routines include: touch position recognition
`72-which translates inputs to the touch-Screen digitizer
`into Screen co-ordinates, rectangle drawing 74-which
`draws the rectangles use to represent the various keys on the
`touch-screen; and text drawing 76-which draws the text
`characters onto the Screen.
`With further reference to FIG. 2, a preferred embodiment
`of the method Steps expected by Said controller as directed
`by said software will be described in detail.
`An example of a touch screen input device layout 100
`according to a preferred embodiment of the invention is
`shown in FIG. 2. Said input device is comprised of a text
`display area 110 and an on-screen keyboard 200 wherein
`Said keyboard is divided into a plurality of keys. Said keys
`include four assignment keys 210, 212, 214, and 216; six
`character keys 220, 221, 223, 225, 227, and 229; and a
`“done' key 230 for terminating data input capabilities. With
`respect to the character keys, Said keys are further divided
`into six elements each of which can preferably be individu
`ally selected. For example character key 220 is divided into
`elements 240, 242, 244, 246, 248, and 249 and is initially
`mapped with the characters A, B, C, D, E, and F respec
`tively. The position of the elements within their respective
`character key corresponding to the relative positioning of the
`character keys themselves.
`In operation the character keys are capable of being
`re-mapped either as a result of an assignment key being
`input or the input of more than one element of a specific
`character key when individual characters are mapped to the
`character elements. Assignment keys 210, 212, 214,and 216
`determine which of the alternative character arrays 250,252,
`254 or 256 are mapped to the character keys. This results in
`a new group of six characterS Specific to the chosen character
`array 250 being displayed on each of the character keyS.
`Note that in FIG. 2, the character array designated by
`assignment key 210 is shown mapped to the character keyS.
`However, if assignment key 212 is pressed, a re-map com
`mand is issued to re-map the character keys with the lower
`case character array 252. Responsive to an input of a
`character key 223 wherein individual characters are mapped
`to each of the elements, Said character keys are re-mapped
`with the individual characters included within said selected
`character key 223. In this example, key 223, the upper right
`most character key, will be re-mapped with the letter 'O'
`290, the character which was mapped to the element of the
`Selected key 223 whose position corresponds to Said char
`acter keys, i.e. the upper right most element. This
`re-mapping results from the input of multiple elements on
`the same character key 220. Once re-mapped in this manner
`a user could then Select an individual character by the input
`of any number of elements on the character key 225 which
`has the desired individual character mapped to it.
`Preferably, a user could alternatively Select a specific
`character directly without a re-mapping Step by limiting the
`input to a single element containing the desired character.
`This would occur at the Stage when individual characters are
`mapped to Said character key elements 240 and would by
`accomplished, for example, by means of a stylus which can
`be used to press a Single element only.
`FIG. 3 is a flow diagram outlining the data input Steps
`implemented by the controller 40. With reference to FIG. 3,
`once the touch-Screen input device is notified in a Suitable
`manner that data input is requested by the user, the initial
`ization sequence begins 500. The controller displays the
`touch-screen keyboard 510 and selects a default array of
`characters 520 which are mapped to the character key
`
`Apple Inc.
`Exhibit 1012
`Page 009
`
`

`

`S
`elements 530. At this stage the input Sequence begins with
`the controller waiting for a user input 540. Upon receiving
`an input of any kind, i.e. the Screen is touched, the micro
`controller identifies the position of Said input, via the touch
`Screen digitizer and the touch position recognition Software
`described in FIG. 2. From this the controller determines
`whether an on-screen key has been touched 550. If the
`position of the input, i.e. the user's finger or Stylus, does not
`correspond to the position of a key, the waiting proceSS 540
`is re-initiated. Otherwise, the controller proceeds to deter
`mine whether the command key “done” was touched 560. If
`Said determination is positive the data input Sequence ter
`minates 570. If said determination is negative the controller
`determines whether an assignment key was touched 580.
`Responsive to an assignment key being touched, controller
`Selects the appropriate character array 590, and re-maps the
`characters included in Said array to the elements of the
`character keys 530 and re-starts the input Sequence by
`waiting for an input 540. An input of a key other than an
`assignment key will prompt the controller to inquire whether
`a key with a single character on it was input 600. If a key
`with a Single character on it was input, the controller inserts
`that character into the text Stream or performs the function
`asSociated with Said character 610 and, after resetting the
`original mapping of the characters of the appropriate array
`to the input key elements 530, re-starts the input Sequence
`540. If the key input did not have a single character
`displayed on it, the controller determines whether a single
`element of a character key was input 620. If a Single element
`was input the controller inserts that character into the text
`Stream or performs the function associated with that char
`acter 630 and, after re-labelling 530 has occurred, re-starts
`the input Sequence 540. If a Single element was not input, the
`micro-controller maps Single characters to the input keys
`640 and restarts the input Sequence by waiting for an input
`540.
`One should note that the assignment keys are not neces
`sary for the functionality of the described invention. Said
`assignment keys merely offer the user an expanded number
`of available characters, analogous to a “shift key on a
`“OWERTY' keyboard. Said keys could also be included as
`characters within the character keys as opposed to being
`distinct. One should also note that much like the assignment
`keys the “done' key shown in the aforementioned embodi
`ment could be easily represented by a character mapped to
`a character key.
`A perSon Skilled in the art should appreciate that there are
`many ways of accomplishing the above described method of
`data input.
`The description of the preferred embodiment disclosed
`above can easily be extended to include a multiple layer
`input method. This is beneficial where the constraint of
`Space is greater than that previously discussed. For example,
`in Small devices Such as a pager, six keys may require more
`Space then is available. A Solution to this problem is
`achieved by increasing the number of input layers. Instead
`of having individual characters mapped to Specific elements,
`arrays of characters could be used. For example, by using a
`four stroke touch-Screen input device (two stroke if indi
`vidual elements chosen) as shown in FIG. 4, three keys
`could provide 3' or 81 characters. Although said keyboard
`is shown without the assignment keys as mentioned in the
`previous embodiment, Said keys could be easily added to
`offer a greater number of available characters.
`With respect to this alternate embodiment the hardware
`described previously in FIG. 1 would be the same. The
`Software would contain Similar Sub-routines as those dis
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,271,835 B1
`
`6
`cussed previously but would be modified accordingly to
`implement the method that follows. A person skilled in the
`art should appreciate that the number of keys (and elements
`therein) and input layers chosen are for the purposes of
`example only. One could reduce the number of keys and
`increase the number of input layerS or reduce the number of
`layerS and increase the number of keys to obtain the opti
`mum balance between key Strokes and the number of
`keys—while maintaining a similar number of available
`characters.
`FIGS. 4a, 4b, 4c, and 4d show four on-screen keyboards
`and demonstrate the input Sequence as the result of character
`key inputs. One should recall that an input of a character key
`results from an input of a plurality of elements on the same
`character key. Each keyboard shown in FIGS. 4a, 4b, 4c and
`4d comprise of a set of 3 character keys 1000, 1010, and
`1020, wherein each character key is comprised of 3 ele
`ments. For example character key 1000 in FIG. 4a is divided
`into 3 elements 1030, 1040 and 1050, which are mapped
`with character Sub-arrays A-I, J-R and S- respectively.
`Each Set of character keys shown displays a different map
`ping of character to the character keys, each mapping
`representing a different input layer or order. FIG. 4a shows
`a keyboard displaying 3" order character Sub-arrays mapped
`to Said character keys. The order of the Sub-array refers to
`the number of Successive character key input steps (as
`opposed to element inputs) a user would have to perform in
`order to have single characters displayed on Said character
`keys. FIG. 4b, 4c and 4d show b 2" order sub-arrays, 1
`order Sub-arrayS and particular characters mapped to the
`character keys respectively. FIGS. 4a through 4d show the
`re-mapping and Selection process which occurs as the result
`of successively inputting character key 1000. Referring to
`FIG. 4a responsive to an input of character key 1000 to
`which a 3" order Sub-array is mapped, the character keys are
`re-mapped with the corresponding 2" order Sub-arrays as
`shown in FIG. 4b. Note that the characters mapped to the
`keys in FIG. 4b are, A-I, J-R and S- , are those characters
`which were included in the 3' order sub-array of the
`selected character key 1000. At this stage, an input of the
`same character key 1000, which has the 2" order sub-array
`A-I mapped to it, results in a re-mapping of Said character
`keys with the corresponding first order Sub-arrays as shown
`in FIG. 4c. Yet another input of the same character key 1000,
`now mapped with the first order Sub-array A-C, results in the
`corresponding individual characters being mapped to Said
`character keys. The proceSS ends with the input of character
`key 1000 which has the individual character A mapped to
`it. Responsive to Said input the character A is inserted into
`the text stream. After the Selection of an individual character
`said character keys are re-mapped with the default 3" order
`Sub-arrays shown in FIG. 4a and the process begins again.
`FIGS. 5a, 5b, 5c, and 5d show the same key layout as
`described in FIG. 4, but differ in that they demonstrate the
`method of re-mapping character keys as the result of a Single
`element being input. Starting with 3' order sub-arrays
`mapped to the character keys as shown in FIG. 5a, an input
`of the single element 1030 results in the re-mapping of said
`character keys with the 1' order Sub-arrays which corre
`spond to the selected element input. This is shown in FIG.
`5c. Notice that the characters mapped to the Selected char
`acter element 1030 in FIG. 5a (A-I) are now mapped to the
`character keys in FIG. 5c. At this Stage an input of the same
`character element 1030 results in the selection of the char
`acter mapped to the Selected element, which in this example
`is the letter A. Said selected character is then inserted into
`the text Stream.
`
`Apple Inc.
`Exhibit 1012
`Page 010
`
`

`

`7
`The character keys are then re-mapped with the default 3"
`order sub-arrays as shown in FIG. 5a.
`FIG. 6 is a flow diagram outlining the input Steps for the
`multiple layer input of data. Similar to the discussion of FIG.
`3, once the input device is notified that data input facilities
`are desired 2000, a keyboard is requested 2010, a default
`character array is selected 2020, and the base sub-arrays of
`the Selected character array (default array initially) are
`mapped to the character keys 2030. At this point the micro
`controller waits for a user input 2040. Upon receiving an
`input, i.e. the Screen is touched, the micro-controller deter
`mines if the position of Said input corresponds to the position
`of an on screen key 2050. If the screen was touched in a
`position which does not represent an on Screen key, the
`micro-controller begins waiting for another user input 2040.
`However, once a key is Selected, the micro-controller pro
`ceeds to the next Step of determining whether said key which
`was input was the “done” key 2060. If said key input was the
`“done' key, the input sequence terminates 2070. Otherwise,
`the micro-controller must determine whether an assignment
`key was input 2080. If an assignment key was input, the
`appropriate character array is selected 2090 and the base
`Sub-arrays of Said character array are re-mapped to the
`character keys 2030. At this stage the input Sequence Starts
`over by waiting for a user input 2040. An input of a key other
`than an assignment key, prompts the micro-controller to
`determine whether a key with a particular character dis
`played on it is input 2100. If said determination proves
`positive, the character displayed on Said key is inserted into
`the character text Stream or the function associated with Said
`character is performed 2110. Said character keys are then
`re-mapped with the base Sub-arrays of the Selected character
`array 2030. At this point the input sequence would re-initiate
`2040. If particular characters were not displayed on said
`character keys, the next stage determines whether a single
`element was input 2120. If this determination is negative,
`i.e. multiple elements on the same character key were input,
`the micro-controller then determines whether the displayed
`sub-arrays were of 1 order 2130. If the sub-arrays were of
`1' order the characters within said Sub-array are mapped to
`the particular character keys 2150. If the sub-arrays were not
`of 1' order, Sub-arrays of one order less are mapped to the
`character keys 2140. Referring back to the single element
`determination Step 2120, if a single element was Selected,
`the micro-controller must then determine if 1 order Sub
`arrays were displayed on said character keys 2160. If said 1
`order Sub-arrays were displayed on Said keys, the character
`displayed on Said Selected element is inserted into the text
`Stream or the function associated with Said character is
`performed 2170. The character keys are then re-mapped
`with the selected base sub-arrays 2030, and the input
`sequence re-initiates 2040. If the sub-arrays were not of 1
`order the micro-controller determines whether they were of
`2' order 2180. If said sub-arrays were of 2' order, the
`characters within Said input elements are mapped to the
`particular character keys 2190. If said sub-arrays were not of
`2" order, i.e. of an order greater than 2", the sub-arrays
`within the input element (two orders less) are mapped to the
`character keyS 2200, and the input Sequence Starts over
`2040.
`Again one should note that the assignment keys are not
`necessary to the functionality of the invention, but are
`merely for providing a greater number of available charac
`ters. Also as mentioned previously Said assignment keys,
`and said “done' key need not be distinct keys but could be
`easily represented by a character within the character arrayS.
`Numerous modifications, variations and adaptations may
`be made to the particular embodiments of the invention
`
`5
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,271,835 B1
`
`8
`described above without departing from then Scope of the
`invention, which is defined in the claims.
`What is claimed is:
`1. A method for operating a touch-Screen input device
`including a touch Sensitive Screen comprising the Steps of
`displaying a plurality of input keys on Said touchSensitive
`Screen,
`mapping a plurality of characters to each input key;
`receiving a user input;
`determining whether Said user input designates a Single
`character;
`determining whether said user input designates a re-map
`command;
`Selecting Said Single character responsive to Said input
`designating Said Single character, and
`re-mapping Said keys responsive to Said input designating
`a re-map command; wherein the Step of Selecting Said
`Single character includes:
`inserting an alphanumeric character or Symbol into the
`teXt Stream, or
`performing the function represented by the Selected char
`acter representing Said function;
`wherein Said input keys are divided into a plurality of
`elements, and wherein Said mapping Step includes
`initially mapping Single characters to particular ele
`ments, and wherein Said re-map command includes
`receiving an input of a plurality of elements when
`Single characters are mapped to individual elements,
`and wherein Said re-mapping Step includes mapping
`Single characters to input keys, and wherein Said input
`designating a Single character includes an input of a
`particular element when a s