Ulllted States Patent [19]
`Heikkinen et al.
`
`US006073036A
`[11] Patent Number:
`[45] Date of Patent:
`
`6,073,036
`*Jun. 6, 2000
`
`[54] MOBILE STATION WITH TOUCH INPUT
`HAVING AUTOMATIC SYMBOL
`
`4,790,028 12/1988 Ramage .................................. .. 382/47
`5,016,002
`5/1991 Levanto .... ..
`.. 340/756
`
`MAGNIFICATION FUNCTION
`
`Inventors: Teuv0 Heikkinen, Oulu; Petri piippo, Karkk?a_ Harri Wikberg Helsinld
`
`..
`.’
`.’ .
`’
`Mllka sllfverbergqHelsmlfl; If?“
`Korhonem Helslnkl; Ham Klllandeh
`Espoo, all Of Finland
`
`[73] Assignee: Nokia Mobile Phones Limited, Espoo,
`Finland
`
`5,119,079
`5,201,034
`
`6/1992 Hube et al. . . . . .
`4/1993 Matsuura et al.
`
`. . . .. 340/712
`. 395/155
`
`ROSSI ....................................... .. 8/1994 Thompson et al. ................... .. 455/558
`
`5,335,276
`8/1994 Perlin et al.
`395/139
`5,341,466
`4/1995 Muurinen
`200/314
`5,408,060
`6/1995 Allard et al.
`345/173
`5,422,656
`5,465,401 11/1995 Thompson
`455/566
`5,568,536 10/1996 Tiller et al. .
`379/58
`5,615,384
`3/1997 Allard et al.
`395/800
`5,815,142
`9/1998 Allard et al. .......................... .. 345/173
`
`[*] Notice:
`
`This‘ patent issued on a continued pros-
`ecution application ?led under 37 CFR
`.
`.
`1.53(d), and 1s subJect to the tWenty year
`patent term provisions of 35 U.S.C.
`154(a)(2).
`
`'r?sltlltz
`.
`.
`Attorney, Agent, or Fzrm—Ohlandt, Greeley, Ruggiero &
`Perle L L P
`’
`'
`'
`'
`
`[57]
`
`ABSTRACT
`
`_
`[21] Appl' NO" 08/847’796
`[22] Filed;
`Apr, 28, 1997
`
`7
`""""""""""""" " H04B 1/38
`Int‘ Cl‘ "
`[51]
`- 455/575; 455/566; 379/354
`[52] U-S- Cl- ~~~~~~~~~~~~~~~~ ~~
`[58] Field Of Search ................................... .. 455/575, 425,
`455/566, 567; 345/63, 147, 173, 121, 130,
`156; 379/93-19, 93-23, 354; 382/298, 451
`
`[56]
`
`References Cited
`Us‘ PATENT DOCUMENTS
`
`AWireless user station 10 , such as a cellular telephone, is
`provided With a touch( se)nsitive input device, such as a
`touch-sensitive display (20) or a touchpad (23). A display
`device displays a plurality of symbols. A ?rst location of a
`tactile input is detected and displayed symbols in the vicinity
`of the ?rst location of the tactile input are magni?ed to
`occupy a larger display area_ Subsequently, a Second loca
`tion of the tactile input is detected, thereby identifying a neW
`position of the user’s ?ngertip. After the second location on
`the touch sensitive screen remains constant, or after the user
`lifts the ?ngertip, the second location of the tactile input is
`reported and associated With the selected symbol.
`
`4,755,811
`
`7/1988 Slavin et al. .......................... .. 340/731
`
`19 Claims, 8 Drawing Sheets
`
`\/ 200
`
`(D U1 N
`
`(O O) (N
`
`040506000
`1
`
`Y
`
`ABC...
`
`Space Options
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 1 of 15
`
`

`

`Jun. 6,2000
`U.S. Patent
`"w
`12w
`TRANSMITTER,14 )4A
`
`Sheet 1 0f8
`
`6,073,036
`
`CONTFOLLER'w /DlSPLAY,2O
`
`% MOD =
`\l
`16A
`
`DEMOD
`
`=
`
`,
`V
`(X'Y)
`
`<
`
`22o
`‘5G Q/ZZb
`
`/
`KEYPAD,22
`
`___/26
`T
`
`RECEIVER,16
`
`FIG.
`
`/
`
`SPEAKER,17
`
`A
`
`A
`
`M|CROPHONE,19
`
`"
`DISPLAY/
`SYMBOLMAP
`
`/
`MEMORY,24
`
`TRANSMITTER,14 )4A
`)4 MOD :
`\l
`16A
`l\ XDEMOD
`fl/
`RECEIVER,16
`
`FIG. 1B
`
`A
`, *
`
`CONRROLLERJB /D|SPLAY,2O
`V
`
`*
`
`‘
`(xx)
`/
`TOUCHPAD,23
`
`SPEAKER,17
`
`A
`
`A
`
`M|CROPHONE,19
`
`‘I
`DISPLAY/
`SYMBOL MAP
`
`/
`MEMORY,24
`
`__/26
`%
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 2 of 15
`
`

`

`U.S. Patent
`
`Jun. 6, 2000
`
`6,073,036
`
`~
`
`~ M30
`
`\34/
`
`SE
`BMI
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 3 of 15
`
`

`

`US. Patent
`
`Jun. 6, 2000
`
`Sheet 3 0f 8
`
`6,073,036
`
`1
`
`2
`
`3
`
`4
`
`5
`
`7
`
`8
`
`1IA§BECEDEEI
`
`éGIHIIéJ
`
`2§K§L§MIN§OEP§Q§R§S§T
`
`3UVWXYZ
`
`43
`
`i
`
`i
`
`I
`
`INITIAL STATE
`
`.‘........._.. .............___...........“......._....,.,_-..._........__.._.,..........,....,................
`
`9551i
`-+----'
`105m:-
`
`548586875889
`- ---------
`----------I----------
`-§R4§R5IR6§R7§R8§R9§
`
`--------
`
`__..
`
`.._.--._......A....._-...-.._ o.._..-..._.....___._.__.4..._.‘_.._.._..._....._.....................
`
`MAGNIFIED
`(ZOOM)
`
`_....._..._._....__.V......_.._...........
`
`.....................,..........................................
`
`Microsoft Ex. 1025
`
`Microsoft v. Philips -
`
`|PR2018—00025
`Page4 of15
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 4 of 15
`
`

`

`U.S. Patent
`
`Jun. 6, 2000
`
`Sheet 4 0f 8
`
`6,073,036
`
`400\
`
`START
`
`‘
`
`I
`
`ACTIVATE DETECTED
`ELEMENT 0N DISPLAY
`
`“
`
`\416
`
`IS DISPLAY
`BEING TOUCHED'?
`
`404w
`
`IDENTIFY ELEMENT
`POSITION
`
`414\
`
`IDENTIFIED
`REPORT DETECTED _, SYMBOL
`ELEMENT
`TO MAIN
`ROUTINE
`
`406x
`
`V
`
`“
`
`MAGNIFY
`CHARACTERS AROUND
`ELEMENT POSITION
`
`/420
`
`DETBSIIDJTNISEAEEI-AY
`(
`I
`
`408\
`
`7
`
`YES
`
`7 DETECT NEw ELEMENT N0
`POSITION
`
`412
`
`HA5 ELEMENT
`POSITION
`CHANGED?
`
`410
`
`STORE ELEMENT 418
`POSITION
`
`FIG. 4A
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 5 of 15
`
`

`

`U.S. Patent
`
`Jun. 6,2000
`
`Sheet 5 0f8
`
`6,073,036
`
`4°°\
`
`START
`
`‘
`
`I
`
`ACTIVATE DETECTED
`ELEMENT ON DISPLAY
`
`‘
`
`\41e
`
`IS DISPLAY
`BEING TOUCHED'?
`
`No
`
`404\
`
`414\
`
`IDENTIFY ELEMENT
`POSITION
`
`REPORT DETECTED
`ELEMENT
`
`IDENTIFIED
`SYMBOL
`' TO MAIN
`ROUTINE
`
`406\
`
`‘I
`MAGNIFY
`CHARACTERS AROUND
`ELEMENT POSITION
`
`“
`
`/420
`
`‘DE-BOUNCE DELAY
`(OPT'ONAL)
`
`40%
`
`"
`
`YES
`
`7 DETECT NEw ELEMENT N0
`POSITION
`
`4120
`
`HAS ELEMENT
`POSITION
`CHANGED?
`
`410
`
`STORE ELEMENT [418
`POSITION
`
`FIG. 4B
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 6 of 15
`
`

`

`U.S. Patent
`
`Jun. 6, 2000
`
`Sheet 6 of 8
`
`6,073,036
`
`m
`/\
`
`FLRX@mu
`
`.m
`
`E K Q W “O M.
`
`D H A
`
`C l O U ..A AW G.
`
`EBHNTZM F m a P A G M S Y 1
`
`JDIVAMS
`
`ABCDEF
`
`YZAK6@
`Options
`123...
`Space
`
`FIG. 5B
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 7 of 15
`
`

`

`U.S. Patent
`
`Jun. 6,2000
`
`Sheet 7 0f8
`
`6,073,036
`
`A B C D E F
`
`Y2A'Al6@
`Options
`Space
`123...
`
`FIG. 5C
`
`200
`ABCDEF
`JKL
`H
`G
`MNOPQR
`STUVWX
`YZAA6@
`Options
`Space
`123...
`
`FIG. 5D
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 8 of 15
`
`

`

`m
`
`m n m 47.m
`
`O A
`
`p S
`
`e
`
`580M.V
`
`69n=um
`
`p 0
`
`S n
`
`U.S. Patent
`
`Jun. 6, 2000
`
`Sheet 8 of 8
`
`6,073,036
`
`0 w
`/_
`
`FIG. 5E
`
`i
`
`123...
`
`Space
`
`Options
`
`F6. 5F
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 9 of 15
`
`

`

`1
`MOBILE STATION WITH TOUCH INPUT
`HAVING AUTOMATIC SYMBOL
`MAGNIFICATION FUNCTION
`
`FIELD OF THE INVENTION
`
`This invention relates generally to radiotelephones and, in
`particular, to radiotelephones or mobile stations, such as
`those capable of operation With a cellular netWork, having a
`touch sensitive input for the detection of user inputs.
`
`BACKGROUND OF THE INVENTION
`
`Portable radiotelephones for use in cellular netWorks are
`sometimes equipped With touch sensitive displays, or touch
`screens. The concept behind a touch screen is to facilitate the
`selection of a symbol by the simple act of pointing to, and
`touching a displayed symbol, rather than typing a particular
`keystroke on a keyboard.
`Because of the relatively small siZe of a telephone display
`that is a result of the tendency to miniaturiZe portable
`equipment, there is generally not enough room on the face
`of a display to: (a) depict all the symbols available to the user
`for the operation of the telephone; and/or (b) address each
`symbol by human ?ngertip means.
`As an eXample of the former, all symbols such as
`numerals, alphanumerics, menu items, special icons, etc.
`that are related to telephone functions that may be available
`for use on a portable telephone cannot generally be allocated
`enough display piXels on the touch sensitive part of the
`display to visually distinguish and uniquely de?ne each
`symbol. One approach of the prior art to accommodate large
`numbers of symbols on a single display Was to allocate a
`?xed, small number of display piXels for each telephone
`function on a touch sensitive screen. The dif?culty With this
`approach is that sometimes the number of piXels allocated is
`insuf?cient to alloW the easy identi?cation of the character
`or function to be activated by touching the speci?c area. That
`is, With a limited number of piXels it may be dif?cult to
`create a sufficient number of visual features of a symbol to
`alloW its unambiguous identi?cation.
`Another problem stems from the small amount of display
`area allocated to each symbol, legend, and/or related func
`tion on a touch sensitive screen for its activation. This
`limitation arises because the total area necessary to accom
`modate suf?cient space to accommodate the tip of the human
`?nger, for each symbol, Would typically eXceed the total area
`of the display itself. When the symbols are made smaller and
`spaced closer together, the user’s ?ngertip Will typically
`cover one or more adjacent symbols.
`With ?ngertip usage the displayed symbols or touch areas
`are required to be relatively large (e.g., 7 mm><7 mm for
`indeX ?nger use With a 2% error rate). In the past this has
`forced the use of a stylus, instead of the more natural ?nger,
`to achieve acceptable error rates.
`That is, using the small area allocated in a touch sensitive
`display for a multitude of symbols cannot readily accom
`modate the dimensions of a human ?ngertip, generally
`requiring the user to operate the interface using a pointing
`device, such as a stylus, pencil, pen, etc., that must be placed
`precisely over the desired character or function to be used to
`uniquely identify the desired input to the telephone. At
`times, the precision required in placing the stylus may
`challenge the coordination skills of the user, especially in a
`moving train, plane, or automobile Where the motion of the
`vehicle makes it difficult to control the relative position of
`the stylus With respect to the touch screen. Furthermore, the
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`6,073,036
`
`2
`use of a stylus may be objectionable to some users, and in
`some situations may present a safety issue.
`The foregoing problems Will also arise if one Were to
`employ some means other than a touch sensitive display to
`provide a tactile, non-keypad input to a mobile telephone,
`especially if a small display device is used.
`
`OBJECTS OF THE INVENTION
`
`It is thus a ?rst object of this invention to provide an
`improved method for depicting various symbols on a touch
`sensitive display of a radio telephone, thereby alloWing a
`user to visually distinguish among a number of symbols on
`the display.
`Another object of the invention is to facilitate the manual
`designation of a symbol on a display, such as numerals,
`alphanumerics, menu items or other special icons related to
`telephone functions or other user generated data or instruc
`tions.
`Another object of the invention is to provide an improved
`method for designating symbols that offers a large input area
`on a display for designating a desired symbol, thereby
`facilitating ?ngertip control in a high vibration environment
`Where the accuracy of the ?ngertip designation of a symbol
`is limited because of relative motion betWeen the ?ngertip
`and the surface of a tactile input device such as, but not
`limited to, a touch screen.
`
`SUMMARY OF THE INVENTION
`
`The foregoing and other problems are overcome and the
`objects of the invention are realiZed by methods and appa
`ratus in accordance With embodiments of this invention. A
`method and apparatus of this invention is disclosed for
`operating a Wireless mobile or user station having a touch
`sensitive input device and a display, the display being
`capable of displaying a plurality of symbols. Each of the
`symbols may have a display attribute. The method com
`prises a series of steps. A ?rst step detects a ?rst location of
`a tactile input on the touch sensitive input device, the tactile
`input generally being created by applying ?ngertip pressure
`to the face of the display for a touch screen embodiment or
`to a surface of touch pad. Next, the displayed symbols in the
`vicinity of the ?rst location corresponding to the tactile input
`are automatically magni?ed. The magni?cation gives more
`area on the display for the symbol(s), thereby facilitating
`manual symbol designation, as Well as improving the visual
`representation of the symbol on the display. As the ?ngertip
`moves to designate the desired symbol on the magni?ed area
`of the display, a second location of the ?ngertip-induced
`tactile input is detected. The detection of the tactile input at
`the second location is made after the originally displayed
`character is magni?ed. In one embodiment, as soon as the
`tactile input remains constant for a predetermined period of
`time, the second location, Which is indicative of the selected
`symbol, is reported, In another embodiment the second
`location is reported When the ?ngertip is lifted from the
`touch sensitive surface. Also, concurrently With reporting
`the detected second location, the attribute of the symbol
`displayed at the second location may be changed to inform
`the user of the selection of the ?ngertip-designated symbol.
`In this invention the magnifying step magni?es the sym
`bols by a factor of typically betWeen 1.1 and 10. The time
`interval betWeen the time a tactile input is detected at the
`second location and the time the position of the second
`location is reported (and the attribute of the display at the
`second location is changed), can be from some fraction of a
`second to several seconds. Also, the magnifying step can be
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 10 of 15
`
`

`

`3
`performed more than once to accommodate situations
`Wherein a particular symbol cannot be uniquely identi?ed
`after only a single magni?cation step is performed. In
`general, if after a ?rst magni?cation the ?ngertip is located
`on a boundary of tWo or more symbols, another one or more
`magni?cation steps can be performed.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The above set forth and other features of the invention are
`made more apparent in the ensuing Detailed Description of
`the Invention When read in conjunction With the attached
`DraWings, Wherein:
`FIG. 1A is a block diagram of a mobile station that is
`constructed and operated in accordance With a ?rst embodi
`ment of this invention;
`FIG. 1B is a block diagram of a mobile station that is
`constructed and operated in accordance With a second
`embodiment of this invention;
`FIG. 2 is an elevational vieW of the mobile station shoWn
`in FIG. 1A, and Which further illustrates a cellular commu
`nication system to Which the mobile station is bidirectionally
`coupled through Wireless RF links;
`FIG. 3 is a detail of the display used in FIG. 1A shoWing
`the display in its initial state and in its magni?ed state, as
`described in the preferred embodiment;
`FIG. 4A shoWs a logic ?oW diagram of one embodiment
`of this invention, Wherein a symbol is selected after a period
`Wherein the ?ngertip remains stationary on the touch sen
`sitive surface;
`FIG. 4B shoWs a logic ?oW diagram of another embodi
`ment of this invention, Wherein a symbol is selected after the
`?ngertip is lifted from the touch sensitive surface; and
`FIGS. 5A—5F illustrate exemplary displays useful in
`explaining the operation of this invention, as Well as illus
`trating a presently preferred “?sheye” display magni?cation
`function.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`Reference is made to FIGS. 1A and 2 for illustrating a
`Wireless user terminal or mobile station 10, such as, but not
`limited to, a cellular radiotelephone or a personal
`communicator, that is suitable for practicing this invention.
`The mobile station 10 includes an antenna 12 for transmit
`ting signals to, and for receiving signals from, a base site or
`base station 30. The base station 30 is a part of a cellular
`netWork comprising a Base Station/Mobile SWitching
`Center/InterWorking function (BMI) 32 that includes a
`mobile sWitching center (MSC) 34. The MSC 34 provides a
`connection to landline trunks When the mobile station 10 is
`involved in a call.
`The mobile station includes a modulator (MOD) 14A, a
`transmitter 14, a receiver 16, a demodulator (DEMOD) 16A,
`and a controller 18 that provides signals to and receives
`signals from the transmitter 14 and receiver 16, respectively.
`These signals include signalling information in accordance
`With the air interface standard of the applicable cellular
`system, and also user speech and/or user generated data.
`It is understood that the controller 18 also includes the
`circuitry required for implementing the audio and logic
`functions of the mobile station. By example, the controller
`18 may be comprised of a digital signal processor device, a
`microprocessor device, and various analog to digital
`converters, digital to analog converters, and other support
`circuits. The control and signal processing functions of the
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`6,073,036
`
`4
`mobile station are allocated betWeen these devices according
`to their respective capabilities.
`A user interface includes a conventional earphone or
`speaker 17, a conventional microphone 19, a touch sensitive
`display 20, and possibly a second user input device, typi
`cally a keypad 22, all of Which are coupled to the controller
`18. The keypad 22, although optional for use in this inven
`tion as some of its functions may be included in the display
`20, may include the conventional numeric (0—9) and related
`keys (#,*) 22a, and other keys 22b used for operating the
`mobile station 10. These other keys 22b may include, by
`example, a SEND key, and various menu scrolling and soft
`keys. When the keypad 22 is not included as part of the
`mobile station 10, the touch sensitive display screen 20
`provides an equivalent user interface function as the keypad
`22. The mobile station 10 also includes a battery 26 for
`poWering the various circuits that are required to operate the
`mobile station.
`The mobile station 10 also includes various memories,
`shoWn collectively as the memory 24, Wherein are stored a
`plurality of constants and variables that are used by the
`controller 18 during the operation of the mobile station. For
`example, the memory 24 stores the values of various cellular
`system parameters and the number assignment module
`(NAM). An operating program for controlling the operation
`of controller 18 is also stored in the memory 24 (typically in
`a ROM device). The memory 24 may also store data,
`including user messages, that is received from the BMI 32
`prior to the display of the messages to the user. Symbols
`entered from the display 20 are buffered in the memory 24.
`A portion of the memory 24 may also used as a display
`screen buffer.
`It should be understood that the mobile station 10 can be
`a vehicle mounted or a handheld device. It should further be
`appreciated that the mobile station 10 can be capable of
`operating With one or more air interface standards, modu
`lation types, and access types. By example, the mobile
`station may be capable of operating With any of a number of
`air interface standards, such as IS-136, GSM and IS-95.
`Conventional AMPS mobile stations can also bene?t from
`the teaching of this invention. It should thus be clear that the
`teaching of this invention is not to be construed to be limited
`to any one particular type of mobile station or air interface
`standard.
`The operating program in the memory 24 includes rou
`tines to present messages and message-related functions to
`the user on the display 20, typically as various menu items.
`The memory 24 also includes softWare routines for execu
`tion by controller 18 for implementing the method of this
`invention, described beloW in relation to FIG. 3 and FIGS.
`4A, 4B, and 5A—5E.
`In this embodiment of the invention, display 20 is a touch
`sensitive display Where the location of, for example, a
`pressure disturbance or tactile input, such as the presence of
`a ?ngertip placed on the display, Will send to controller 18
`the (X,Y) display coordinates identifying Where display 20
`is touched. The X,Y resolution is a function of the display
`20. This determination of the position can be cyclical, at
`regular intervals, for example every 10 milliseconds. For
`example, if the display 20 is touched in the left upper most
`corner, display 20 Will send tWo numbers, for example, 1, 1,
`identifying the X=1, Y=1 element position of the display
`area Where the presence of a tactile input, such as a ?ngertip
`or some other pointing means, has been sensed.
`While tactile input detection is described herein as one
`embodiment of the invention, it is only one possible method
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 11 of 15
`
`

`

`6,073,036
`
`5
`for detecting the presence of a ?ngertip on a touch sensitive
`screen. Other methods could be employed, such as sensing
`a presence/absence, and/or an amount of pressure applied by
`a ?ngertip or stylus.
`One suitable type of touch screen is manufactured by
`Nissha Printing Co., Ltd., Electronics Division, and is
`knoWn as a “Fine Touch” touch screen. This particular
`analog touch screen uses a transparent resistive membrane.
`The use of digital touch screens having a transparent sWitch
`matrix is also Within the scope of this invention.
`It should be appreciated that the position resolution of a
`tactile input on the touch sensitive screen cannot be more
`accurate than one area of resolution, or element, herein for
`example about 5 mm by 5 mm (25 millimeters square). By
`example, and assuming the analog touch screen
`embodiment, if tWo, four bit analog to digital converters are
`used to encode the location of the tactile input, the resulting
`position resolution is 16 by 16 resolvable locations.
`As shoWn in FIG. 3, for example, in a touch sensitive
`display of 50 mm by 50 mm dimensions, 100 areas of
`resolution or elements, shoWn as a 10 by 10 matrix, is
`capable of reporting the occurrence of tactile inputs and the
`related positions referenced to the display’s X-Y coordinate
`frame. The ?ngertip activation (tactile input) positions from
`display 20 to controller 18 are reported, for example, as tWo
`numbers X,Y corresponding to the X,Y position Within the
`10 by 10 matrix. The reported position of the ?ngertip
`activation, corresponds to the one 5 mm by 5 mm element,
`Within the exemplary 50 mm by 50 mm touch sensitive
`screen (having 100 resolvable positions).
`As further shoWn in FIG. 3., in its initial state, each of the
`100 areas of resolution, or (sensing) elements, of the display
`shoWs a particular symbol, such as, for example, upper case
`ASCII characters A,B,C, .
`.
`. Z, icons, functions etc. The
`cited examples of symbols are only an example of the type
`of characters that may be displayed, in this case to substitute,
`or supplement, the character-based keypad 22. Other sym
`bols that can be contained Within an area of display resolu
`tion are, for example, Kanji, Turkish, Arabic, Russian or
`other language speci?c characters, or any other icon,
`numeric, or legend that Will ?t, in abbreviated or complete
`form, on the surface de?ned by each pressure sensing
`element of the 10 by 10 matrix. Each displayed symbol is
`composed of a number of pixels of display 20 and ?ts Within
`one of the 100 pressure sensing elements present in display
`20.
`In FIG. 3 it is shoWn that a ?ngertip FT is initially placed
`at the intersection of characters S2, S3, R2, and R3. S2 is
`displayed in (sensing) element roW 9, column 2 (9,2), While
`S3 is displayed in element roW 9, col 3 (9,3). Similarly,
`character R2 is displayed in element (10,2) While R3 is
`displayed in element (10,3). Upon sensing the presence of a
`tactile input in one of, or in more than one, or at the
`intersection of, elements (9,2), (9,3), (10,2), and (10,3),
`controller 18 refreshes and updates touch sensitive display
`20 so that element S2 is noW re-displayed in a magni?ed
`(Zoom) fashion in an area corresponding to four display
`elements (7,1), (7,2), (8,1) and (8,2). Similarly characters
`S3, R2 and R3 are also magni?ed, as shoWn in the magni?ed
`portion of FIG. 3, to occupy a display area, for example, four
`times their original siZe. It is noW evident that since the
`original characters displayed in one element have been
`magni?ed to occupy the area of four elements each, the
`display area of the character itself is four times larger than
`the original, hence making it more readable and easier for
`the user to identify. Furthermore, since the area occupied by
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`6
`the magni?ed character is larger, comprising four resolvable
`sensing elements, it has become easier to designate by
`?ngertip, since the center of the ?ngertip can be placed more
`readily over the symbol Without accidentally activating
`another adjacent symbol.
`The controller 18 is assumed to store in the memory 24 a
`mapping betWeen display coordinates and displayed
`symbols, and changes the mapping as a function of magni
`?cation level.
`The magni?cation ratio is not limited to a factor of 2 as
`described. The ratio can be from as little as 1.1 to, by
`example, a factor of 10. Afactor of 10 is applicable When the
`display having 100 elements has to be ?lled With, for
`example, a single symbol requesting the immediate action of
`the user. An alert or visual alarm function can thus be shoWn
`in conjunction With, for example, an audible alert or alarm.
`Referring to FIG. 4A, a ?rst method for operating the
`display 20 comprises a series of steps as described beloW.
`Upon poWer up of the mobile station 10, a softWare sub
`routine starts as shoWn at step 400 in controller 18. Con
`troller 18 receives periodic reports, for example, every 10
`msec, from display 20 as to the presence or absence of tactile
`input indicative of the presence of a ?ngertip on the display.
`In other embodiments of this invention the controller 18 may
`receive a report only When the display 20 is actually
`touched. In a further embodiment of the invention it may be
`the controller’s responsibility to periodically poll the display
`20 to determine if and Where a tactile input has been sensed.
`Thus, although the invention is described in the context of
`a display that regularly outputs a signal to the controller 18,
`those skilled in the art Will recogniZe that this is only one
`possible mode of operation.
`In step 402, if no input is detected on the touch sensitive
`display 20, the routine returns to start 400. If hoWever, a
`tactile input is detected on display 20 by step 402, the
`corresponding display element(s) are identi?ed in step 404.
`As discussed above With regard to the example shoWn in
`FIG. 3, step 404 may detect ?ngertip pressure at display
`element positions (9,2), (9,3), (10,2) and (10,3). In response
`to the results from step 404, in step 406, the symbols
`displayed in display element positions (9,2), (9,3), (10,2)
`and (10,3) are magni?ed (Zoomed) to, for example, double
`the siZe of each of the four originally displayed symbols.
`This magni?cation causes the originally displayed four
`symbols to be redraWn, and magni?ed by controller 18 over
`a 16 display element area, as shoWn in FIG. 3. As further
`shoWn in the example in FIG. 3, the information originally
`displayed at location (9,2) is noW magni?ed to cover display
`element positions (7,1), (7,2), (8,1) and (8,2). FolloWing
`magni?cation step 406, the display is as shoWn in FIG. 3 in
`the magni?ed position for the ?ngertip location shoWn at FT.
`The magni?cation of the original display gives the user
`immediate visual feedback that the presence of the ?ngertip
`has been detected at a particular, ?rst position, and a larger
`area is displayed for the ?ngertip to move to and designate
`a character at a second position.
`It should be realiZed that if the controller 18 is capable of
`unambiguously identifying a selected symbol (e. g., a symbol
`displayed in isolation), then the magnifying and subsequent
`steps need not necessarily be performed. In this case Block
`404 is modi?ed accordingly to determine if the location of
`the ?ngertip can be unambiguously correlated With one
`displayed symbol. If yes, control can pass immediately to
`Block 414 to report the user-designated symbol. HoWever, it
`may be desirable When the symbols are displayed in an
`unmagni?ed form to alWays employ the Zoom function,
`
`Microsoft Ex. 1025
`Microsoft v. Philips - IPR2018-00025
`Page 12 of 15
`
`

`

`6,073,036
`
`7
`even When only one selected symbol is unambiguously
`identi?ed, in order to avoid the possibility that the user has
`indicated the Wrong symbol.
`It is assumed that the user noW repositions or slides the
`?ngertip in the magni?ed area to a second position, until the
`desired character to be input into the mobile station 10 is
`reached. The movement of the ?ngertip to a second position
`is detected in step 408 Wherein the position of the ?ngertip
`is detected Within one of the 100 (10 by 10 matrix) touch
`sensitive elements of display 20. If the location of the
`?ngertip is no longer changing, as sensed in the 10 by 10
`matrix, it is assumed the ?ngertip is no longer moving over
`the display 20 and that the user has selected the desired
`character. Step 410 identi?es a change in element position
`by comparing the previous value of the position of the tactile
`input With the latest value of the position of the tactile input.
`If the tWo positions are not the same, the method returns to
`step 408 to detect the neW element on the display being
`activated. Conversely if the position has not changed, step
`410 directs the display element containing the last tactile
`input detection to be stored in memory 24, as shoWn in step
`418. It is understood that the search for a change in ?ngertip
`position, as reported by the display 20, Will continue for as
`long as there is a variation betWeen successive ?ngertip
`locations determinations, as indicated by the loop formed by
`step 412, 408, 410 and 418. This provision assures that if the
`user momentarily stops moving the ?ngertip on the display,
`and then continues moving again Without lifting the ?ngertip
`off the display, a false reading is avoided.
`In this embodiment of the invention, as soon as the
`location of the tactile input on the display 20 stays constant
`for some predetermined period of time (step 412), for
`example, 2 seconds, it can be assumed that the user has
`completed the selection of the desired symbol and that the
`last location (stored in memory 24) indicates the desired
`symbol. After a short delay, of, for example, one to 500
`milliseconds, as shoWn in optional step 420, to provide
`“de-bouncing” of ?ngertip motion, the element position
`Where the tactile input Was detected last is reported, as
`shoWn in step 414, to a routine that identi?es the manually
`designated symbol based on the last reported ?ngertip
`position and the current mapping betWeen the display screen
`coordinates and the displayed symbols.
`In step 412, a sequence of tactile input reports from step
`410 are compared for a time duration of, for example, 2
`seconds. The ?nal position reported from step 412 to step
`414 is made only after a sequence of successive ?ngertip
`location reports are equal in value. As Was indicated above,
`the de-bounce delay step 420 is optional.
`Next, in optional step 416, the symbol and associated
`display element(s), Where the user input Was reported in step
`414, can be made to change in attribute, as for example, to
`?ash repeatedly, or change background, to inform the user of
`the selection of that symbol. The user, having visual feed
`back as to the symbol recogniZed by controller 18 as an input
`from touch sensitive display 20, can then proceed to desig
`nate the next symbol, such as a character, legend, icon or
`other screen displayed detail. Typically, the display Will ?rst
`be automatically returned to the unmagni?ed format (as in
`FIG. 3).
`FIG. 4B illustrates a further embodiment of this invention,
`Wherein the Block 412 is modi?ed to be a Block 412a. In
`this embodiment the controller 18 detects that the user’s
`?ngertip has been lifted from the touch sensitive display 20.
`The detection of the user lifting his or her ?nger is inter
`preted as the user selecting the symbol at the corresponding
`display position.
`
`10
`
`15
`
`35
`
`45
`
`55
`
`65
`
`8
`It can be appreciated that this invention facilitates the
`selection of numbers When originating a phone call, or When
`it is desired to store a phone number in the mobile station 10.
`This invention is particularly advantageous When the user
`Wishes to compose (or respond to) an alphanumeric text
`message, such as one to be sent from the mobile station 10
`us