I 1111111111111111 11111 lllll lllll 111111111111111 11111 11111 1111111111 11111111
`
`US006727892Bl
`
`
`(12)United States Patent
`Murphy
`
`(10)Patent No.:US 6,727,892 Bl
`
`(45)Date of Patent:
`*Apr. 27, 2004
`
`(54)METHOD OF FACILITATING THE
`
`SELECTION OF FEATURES AT EDGES OF
`
`COMPUTER TOUCH SCREENS
`
`MicroTouch Systems, Inc., TouchWare for Macintosh
`
`
`
`
`
`
`
`User's Guide. Document No. 19-210, Version 2.2. 1994,
`1996-97.
`MicroTouch Systems, Inc., Touch Ware User's Guide. Docu­
`
`
`
`
`
`
`Inventor: Stephen C. Murphy, Meridian, ID
`(75)
`
`
`ment No. 19-207, Version 3.5. 1994--95, 1997-98.
`(US)
`
`
`
`MicroTouch Systems, Inc., TouchWare Software for Win­
`
`
`dows User's Guide. Document No. 19-224, Version 2.6.
`(73) Assignee: Micron Technology, Inc., Boise, ID
`
`
`
`1997-2002.
`(US)
`MicroTouch Systems, Inc., Touch Ware for Macintosh (USE
`
`
`
`
`
`
`controllers) User's Guide. Document No. 19-233, Version
`( *)
`
`
`Notice: Subject to any disclaimer, the term of this
`2.0. 1999.
`
`
`
`patent is extended or adjusted under 35
`
`U.S.C. 154(b) by O days.
`
`Primary Examiner-Richard Hjerpe
`
`
`
`Assistant Examiner-Abbas I Abdulselam
`
`
`
`
`This patent is subject to a terminal dis­
`
`(74)Attorney, Agent, or Firm-Dorsey & Whitney LLP
`claimer.
`
`(57)
`
`ABSTRACT
`
`(21) Appl. No.: 09/316,075
`
`
`
`(22)Filed:May 20, 1999
`
`(56)
`
`
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`
`
`(List continued on next page.)
`
`OIBER PUBLICATIONS
`
`In one embodiment of the invention, a hot spot is normally
`
`
`
`
`
`
`
`centered in an area of contact between a user's finger and a
`
`
`
`touch screen to position the hot spot on an icon or other
`
`
`
`
`
`feature thereby selecting a program or function correspond­
`
`(51) Int. Cl.7 .................................................. G09G 5/00
`
`
`ing to the icon or feature. When the contact area is near an
`edge, the hot spot is offset toward the edge so that it
`
`
`
`
`(52)U.S. Cl. ....................... 345/173; 345/157; 345/179;
`
`
`
`
`
`coincides more closely to the center of the users finger, thus
`
`
`345/180; 345/856; 345/901; 178/18.01;
`
`
`
`
`allowing an icon or other feature adjacent the edge of the
`
`178/19.01; 178/19.04
`
`
`
`
`
`screen to be more easily selected. In another embodiment, a
`
`
`
`
`cursor is displayed on a touch screen at a location that is
`(58)Field of Search .................................
`
`345/173, 179,
`
`
`
`offset from the contact area between a finger and the screen.
`
`
`
`345/157, 180, 901, 856; 178/18.01, 19.04,
`
`
`
`The cursor, which is used as the hot spot of the computer, is
`19.01
`
`
`
`normally offset above the contact area except when the
`
`
`
`contact area is close to the bottom of the screen. The cursor
`
`
`
`is then offset to the left or right of the contact area depending
`
`
`
`on whether the contact are is to the left or right of the screen,
`
`
`
`4,723,211 A * 2/1988 Barker et al. ............... 707/514
`
`
`
`respectively, so that icons or features adjacent the left or
`
`
`
`4,903,012 A 2/1990 Ohuchi ....................... 340/709
`
`
`
`
`right edges of the screen can be selected. Similarly, when the
`
`
`
`5,119,079 A 6/1992 Hube et al. ................. 340/712
`
`
`
`
`contact area is very close to the bottom of the screen, the
`
`
`
`cursor is offset downwardly and to the right or left so that
`
`
`icons or features adjacent the bottom edge of the screen can
`
`
`
`be selected. Alternatively, a touch sensitive area incapable of
`
`
`
`displaying an image may be provided beneath a display area
`MicroTouch Systems, Inc., TouchWare for Windows NT
`
`
`
`
`
`of the touch screen to allow icons or features adjacent the
`
`
`
`
`User's Guide. Document No. 19-217, Version 2.2. 1996,
`bottom edge of the display area to be selected.
`1998.
`
`
`
`MicroTouch Systems, Inc., TouchWare for OS/2 User's
`
`
`Guide. Document No. 19-222, Version 2.0. 1998.
`
`
`
`86 Claims, 13 Drawing Sheets
`
`12
`
`F'
`
`IPR2020-00778
`Apple EX1017 Page 1
`
`

`

`US 6,727,892 Bl
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,854,988 A * 12/1998 Davidson et al. ............. 701/50
`
`
`
`
`
`RE36,137 E * 3/1999 Nakama et al. ............. 708/141
`5,177,328 A 1/1993 Ito et al. ....................... 178/18
`
`
`
`
`
`
`5,914,702 A 6/1999 Derocher et al. ........... 345/157
`
`
`
`5,386,219 A * 1/1995 Greanias ..................... 345/174
`
`
`
`5,956,019 A 9/1999 Bang et al. ................. 345/173
`
`
`
`5,452,414 A * 9/1995 Rosendahl et al. ......... 345/174
`
`
`5,956,020 A * 9/1999 D' Amico .................... 345/173
`5,459,831 A * 10/1995 Brewer et al. .............. 345/853
`
`
`6,040,824 A 3/2000 Maekawa et al. ........... 345/173
`
`
`
`5,510,813 A * 4/1996 Makinawa et al. ......... 345/173
`
`
`6,157,379 A * 12/2000 Singh ......................... 345/333
`
`
`
`5,642,490 A * 6/1997 Morgan et al. ............. 345/173
`
`
`
`6,184,860 Bl * 2/2001 Yamakawa .................. 345/146
`
`
`
`
`5,754,178 A * 5/1998 Johnston, Jr. et al. ...... 345/343
`
`
`6,211,856 Bl * 4/2001 Choi et al. .................. 345/173
`
`
`
`5,757,368 A 5/1998 Gerpheide et al. .......... 345/339
`
`
`
`6,225,985 Bl * 5/2001 Armstrong et al. ......... 345/177
`
`
`
`5,761,681 A 6/1998 Huffman et al. ............ 707/500
`
`
`6,232,960 Bl * 5/2001 Goldman .................... 345/168
`
`
`
`
`
`5,777,605 A 7/1998 Yoshinobu et al. ......... 345/173
`
`
`6,411,283 Bl * 6/2002 Murphy ...................... 345/173
`
`
`
`5,821,930 A * 10/1998 Hanson ...................... 345/173
`
`
`
`
`
`5,825,352 A 10/1998 Bisset et al. ................ 345/173 * cited by examiner
`
`IPR2020-00778
`Apple EX1017 Page 2
`
`

`

`
`U.S. Patent Apr. 27, 2004
`Sheet 1 of 13
`
`US 6,727,892 Bl
`
`fjg, 1
`
`(Prior Art}
`
`IPR2020-00778
`Apple EX1017 Page 3
`
`

`

`U.S. Patent
`
`
`Apr. 27, 2004 Sheet 2 of 13
`
`
`US 6,727,892 Bl
`
`10
`
`/
`
`20
`
`PROCESSOR
`
`22
`
`28
`
`26
`
`24
`
`SYSTEM SYSTEM
`CONTROLLER MEMORY
`
`
`
`PERIPHERAL BUS
`
`30
`
`32
`
`34
`
`36
`
`38
`
`ROM
`
`12
`
`TOUCH
`
`TOUCH
`KEYPAD
`SCREEN SCREEN
`CONTROLLER
`INPUT
`DRIVER
`CIRCUIT
`
`14
`
`DISPLAY
`
`KEYS
`
`Fig. 2
`
`(Prior Art)
`
`IPR2020-00778
`Apple EX1017 Page 4
`
`

`

`
`U.S. Patent Apr. 27, 2004
`
`Sheet 3 of 13 US 6,727,892 Bl
`
`F
`
`A ./
`
`Fig. 3
`
`12
`
`F'
`
`Fig. 4
`
`IPR2020-00778
`Apple EX1017 Page 5
`
`

`

`
`Sheet 4 of 13
`U.S. Patent Apr. 27, 2004
`
`US 6,727,892 Bl
`
`52
`
`52
`
`54
`
`50
`
`56
`
`58
`
`fjg. 5A
`
`54
`
`Fs
`
`I
`I
`I
`I
`
`I
`I
`I
`I
`
`-1
`
`56
`
`50
`
`58
`
`fjg. 5B
`
`IPR2020-00778
`Apple EX1017 Page 6
`
`

`

`
`U.S. Patent Apr. 27, 2004
`
`Sheet 5 of 13 US 6,727,892 Bl
`
`54
`
`Fe I
`He
`
`I
`I
`I
`
`\
`
`Ac
`
`1-
`I
`I
`I
`I
`
`52
`
`50
`
`58
`
`Fig. 5C
`
`54
`
`52
`
`58
`
`Fig. 5IJ
`
`56
`
`50
`
`56
`
`IPR2020-00778
`Apple EX1017 Page 7
`
`

`

`
`U.S. Patent
`
`
`Apr. 27, 2004 Sheet 6 of 13
`
`US 6,727,892 Bl
`
`54
`
`52
`
`50
`
`56
`
`✓-HE'
`
`·-- _,60[
`
`.....,____
`
`___
`58
`
`FE
`
`Fig. SE
`
`Fr
`
`I
`-r
`
`'
`\
`
`Af: Hr·
`
`I
`I
`I
`I
`
`52
`
`54
`
`50
`
`56
`
`58
`
`Fig. SF
`
`IPR2020-00778
`Apple EX1017 Page 8
`
`

`

`
`U.S. Patent Apr. 27, 2004
`
`Sheet 7 of 13 US 6,727,892 Bl
`
`START
`
`60
`TOUCH PAD INPUT
`
`62
`SENSE LOCATION
`AND AREA OF INPUT
`
`64
`POSITION HOT SPOT
`
`AT CENTER OF INPUT
`
`70
`
`72
`
`OFFSET HOT SPOT
`TO RIGHT OF CENTER
`
`IS
`
`LOCATION NEAR
`LEFT EDGE
`
`80
`
`NO
`
`OFFSET HOT SPOT
`TO LEFT OF CENTER
`
`76
`
`IS
`NEAR >Y_ES _ _ _ _ _ �
`LOCATION
`TOP EDGE
`?
`
`84
`
`OFFSET HOT SPOT
`ABOVE CENTER
`
`90
`
`NO
`
`OFFSET HOT SPOT
`BELOW CENTER
`
`96
`REGISTER CURRENT
`
`
`POSITION OF HOT SPOT
`
`IPR2020-00778
`Apple EX1017 Page 9
`
`

`

`
`U.S. Patent Apr. 27, 2004
`
`Sheet 8 of 13 US 6,727,892 Bl
`
`100
`
`114
`
`-�
`
`116
`
`-�
`
`F
`
`Fig. 7
`
`102
`
`I
`-1-
`
`�0
`0 FA
`A[
`-
`
`100
`
`Fig. BA
`
`IPR2020-00778
`Apple EX1017 Page 10
`
`

`

`Sheet 9
`of 13
`U.S. Patent Apr. 27, 2004
`
`US 6,727,892
`Bl
`
`100
`
`124
`
`120
`
`Fig. BB
`
`�0
`
`102c
`
`Fe O \_Ac,,.,-
`
`-
`
`124
`
`122
`
`100
`
`122
`
`120
`
`Fig. BC
`
`IPR2020-00778
`Apple EX1017 Page 11
`
`

`

`
`Sheet 10 of 13
`U.S. Patent Apr. 27, 2004
`
`US 6,727,892 Bl
`
`100
`
`124
`
`122
`
`1020 □ Fo
`t �-Ao
`
`1----.....--
`
`--1
`
`------=-
`
`100
`
`122
`
`120
`
`Fig. BD
`
`124
`
`120
`
`Fig. BE
`
`IPR2020-00778
`Apple EX1017 Page 12
`
`

`

`U.S. Patent Apr. 27, 2004
`Sheet 11 of 13
`
`
`US 6,727,892 Bl
`
`START
`
`140
`TOUCH PAD INPUT
`
`142
`SENSE LOCATION
`OF CONTACT
`
`144
`SELECT CENTER OF
`
`CONTACT AS INPUT
`
`146
`
`NO
`
`148
`
`POSITION CURSOR
`
`ABOVE INPUT
`
`162
`
`YES
`
`164
`
`POSITION CURSOR
`
`TO LEFT OF INPUT
`
`POSITION CURSOR
`
`TO RIGHT OF INPUT
`
`110
`
`IS
`INPUT
`MOVING FROM
`LEFT TO
`RIGHT?
`
`180
`
`IS
`INPUT
`NO
`MOVING FROM
`RIGHT TO
`LEFT?
`
`174
`
`REPOSITION CURSOR
`REPOSITION CURSOR
`TO RIGHT OF INPUT
`TO LEFT OF INPUT
`
`Fig. 9A
`
`IPR2020-00778
`Apple EX1017 Page 13
`
`

`

`U.S. Patent Apr. 27, 2004
`
`Sheet 12 of 13
`
`US 6,727,892 Bl
`
`190
`
`IS
`NO
`INPUT NEAR
`BOTTOM EDGE
`
`192
`OFFSET CURSOR
`DOWNWARDLY
`
`196
`REGISTER AND DISPLAY
`
`CURRENT POSITION
`OF CURSOR
`
`Fig. 9B
`
`IPR2020-00778
`Apple EX1017 Page 14
`
`

`

`
`Sheet 13 of 13
`U.S. Patent Apr. 27, 2004
`
`US 6,727,892 Bl
`
`/210
`f
`
`214
`
`-----�-K-0__, /
`
`I
`I
`I
`I
`L ___ _
`
`Fig. 10
`
`IPR2020-00778
`Apple EX1017 Page 15
`
`

`

`
`
`US 6,727,892 Bl
`
`1
`
`TECHNICAL FIELD
`
`2
`To avoid the inconvenience of using a stylus, many
`
`
`
`METHOD OF FACILITATING THE
`
`
`
`
`
`operators use their fingers to select icons 18 on the screen 12
`
`SELECTION OF FEATURES AT EDGES OF
`
`
`
`of the computer 10. While being more convenient, the use of
`COMPUTER TOUCH SCREENS
`
`
`
`a finger to select icons 18 creates other problems. Any finger
`
`
`
`
`
`larger than the point of a 5 is several orders of magnitude
`
`
`
`
`stylus. It can therefore be difficult to select fine and/or
`
`
`
`closely spaced icons or features on the screen 12 using a
`
`
`This invention relates to computer displays, and, more
`
`
`
`
`
`finger. The location on the screen 12 that is selected by a
`
`
`
`
`particularly to a method of allowing relatively small features
`
`
`
`finger is generally a point at the center of the area of the
`
`
`
`displayed on the touch screen, particularly at the edges of the
`
`finger that is in contact with the screen. This point is
`
`screen, to be selected more easily.
`10
`
`
`
`
`sometimes known as the "hot spot". With reference to FIG.
`BACKGROUND OF THE INVENTION
`
`
`3, a finger F is shown touching the screen 12. The area A of
`
`
`contact between the finger F and screen 12 is somewhat
`
`
`FIG. 1 shows a conventional computer 10 of the type that
`
`
`
`smaller than the size of the finger F. The computer 10 then
`
`
`
`
`is adapted to be held in the hand H of an operator during use.
`
`
`
`
`calculates a hot spot H at the center of the area of contact A.
`
`
`
`Such computers 10, known as "palmtop" computers, include
`
`
`15 The hot spot H is small enough to be capable of accurately
`
`
`a relatively large display screen 12, and a few manually
`
`
`selecting even the finest and most closely spaced of icons 18
`
`
`
`
`actuated keys, generally indicated as 14. The display screen
`
`
`
`or other features displayed on the screen 12. However, this
`
`
`
`12 is preferably a touch screen that primarily controls the
`
`
`
`
`
`capability is not realized in practice because the hot spot is
`
`
`operation of the computer 10. More particularly, several
`
`
`not displayed on the screen 12 as a cursor or other indicator.
`
`
`
`icons 18 are displayed on the screen 12, and programs or
`
`
`
`
`20 Further, even if a cursor was displayed on the screen 12 to
`
`
`
`other functions are selected by touching the screen 12 on the
`
`
`
`designate the hot spot, the cursor would be beneath the
`
`
`
`icon 18 corresponding to the program or function to be
`
`
`
`
`finger F and thus not visible to the operator. Thus, in
`selected.
`
`
`
`
`
`practice, it is often not possible to select fine and/or closely
`
`
`
`The basic components of the computer
`spaced icons 18 or features 10 are shown in on the screen 12 using a finger
`25 F.
`
`the system block diagram of FIG. 2. The computer 10
`
`
`One approach that has been used to allow icons to be
`
`
`
`includes a processor 20 of conventional design that is
`
`
`
`easily selected on touch screens is to display substantially
`
`
`coupled through a processor bus 22 to a system controller
`
`
`larger icons 18 and features so that there is no ambiguity
`
`
`
`24.The processor bus 22 generally includes a set of bidi­
`
`
`
`about which icon 18 or feature is being selected. While this
`
`
`rectional data bus lines coupling data to and from the
`
`
`
`
`approach does make it easier to select icons and features, it
`
`
`processor 20, a set of unidirectional address bus lines 30
`
`
`
`has the disadvantages of requiring that the operation of the
`
`
`
`coupling addresses from the processor 20, and a set of
`
`
`
`computer 10 be altered and reducing the number of icons 18
`
`
`
`
`unidirectional control/status bus lines coupling control sig­
`
`
`
`
`and features that can be displayed on the screen 12 at the
`
`
`
`
`nals from the processor 20 and status signals to the processor
`same time.
`
`
`
`20.The system controller 24 performs two basic functions.
`icons 18 and limitation of using a finger to select Another First, it couples signals between the processor 20 and a 35
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`system memory 26 via a memory bus 28. The systemfeatures on computer touch screens 12 is the difficulty of
`
`
`
`
`
`
`memory 26 is normally a dynamic random access memoryselecting icons or features that are near the edges of the
`("DRAM"),
`
`
`
`
`but it may also be a static random access screen 12. With reference to FIG. 4, a finger F' is attempting
`
`
`
`
`
`
`memory ("SRAM"). Second, the system controller 24 to select an icon 18' that is adjacent to one edge 40 of the
`
`
`
`
`
`
`
`couples signals between the processor 20 and a peripheral screen 12. The finger F' is centered over the icon 18', but is
`40
`
`
`overlapping the edge 40 of the screen 12. As a result, the area
`
`
`
`bus 30. The peripheral bus 30 is, in turn, coupled to a read
`
`
`
`only memory ("ROM") 32, a touch screen driver 34, a touch
`
`
`of contact A' between the finger F' and the screen 12 is offset
`
`
`
`to the left of the center of the finger F' and so is the hot spot
`
`
`screen input circuit 36, and a keypad controller 38.
`
`
`
`
`The ROM 32 stores a software program (described below)
`
`
`H'. Therefore, even though the user has centered his or her
`
`
`finger F' over the icon 18', the hot spot H' is offset from the
`
`
`
`for controlling the operation of the computer 10, although
`45
`
`the program may be transferred from the ROM 32 to the
`
`
`
`icon 18'. For this reason, a program or function correspond­
`
`
`
`
`ing to the icon 18' will not be selected. This problem may
`
`
`system memory 26 and executed by the processor 20 from
`
`
`
`
`continue even if the finger F' is moved further to the right of
`
`
`
`the system memory 26. The touch screen driver 34 receives
`
`
`
`
`its position as shown in FIG. 4 because the hot spot H' will
`
`
`
`
`information from the processor 20 and applies appropriate
`
`
`
`
`always be located midway between the left edge of the area
`
`
`
`
`
`signals to the display 12 through the touch screen driver 34. 50
`
`
`
`A' of contact between the finger F' and the screen 12 and the
`
`
`
`
`The touch screen input circuit 36 provides signals indicating
`
`edge 40 of the screen 12. As a result, it may not be possible
`
`
`
`that an action has been taken to select a program or function
`
`
`to position the hot spot H' at or very close to the edge 40 of
`
`
`by touching the screen 12 on a corresponding icon 18 (FIG.
`
`the screen 12. While the problem is shown in FIG. 4 in the
`
`
`
`1). Finally, the keypad controller 38 interrogates the keys 14
`
`
`
`context of selecting an icon 18' adjacent the right edge 40 of
`
`
`
`
`
`to provide signals to the processor 20 corresponding to a key 55
`
`
`the screen 12, it will be understood that the same problem
`
`14 selected by an operator.
`
`
`
`Returning, now, to FIG. 1, most palm computers, such as
`
`
`
`
`occurs when selecting an icon that is positioned adjacent the
`
`
`
`left edge, the top edge, the bottom edge, or a corner of the
`
`
`
`
`the computer 10, include a stylus (not shown) adapted to
`screen 12.
`
`
`
`
`select the icons 18 displayed on the screen 12. The stylus has
`While the foregoing discussion has centered around the
`
`
`
`
`
`
`a relatively small point thereby allowing icons 18 displayed
`60
`
`
`
`
`problem of selecting icons and features on a touch screen
`
`
`
`on the screen 12 to be selected even though the icons 18 may
`
`
`
`displays for palmtop computers like the computer 10 shown
`
`
`
`
`be relatively small and/or positioned close to either other
`
`
`in FIG. 1, the problem may also exist to some extent with
`
`
`
`icons 18 or the edges of the screen. However, the use of a
`
`
`
`
`selecting icons and features on full size touch screen com­
`
`
`
`
`
`stylus can be inconvenient because it is necessary to obtain
`puter displays.
`
`
`
`
`the stylus, such as by removing it from a receptacle at the
`65
`There is therefore a need for a method that allows a finger
`
`
`
`
`
`
`back of the computer 10, before any function can be
`
`
`
`to accurately select icons and other features even where the
`selected.
`
`IPR2020-00778
`Apple EX1017 Page 16
`
`

`

`
`
`US 6,727,892 Bl
`
`4
`3
`icons or features are small and closely spaced, and even in FIGS. 5A-5F. As shown in FIG. SA, a touch screen 50 has
`
`
`
`
`
`
`
`
`where they are at or very close to the edges of the screen.
`a left edge 52, a top edge 54, a right edge 56, and a bottom
`
`over an edge 58. A finger FA is in contact with the screen 50
`
`SUMMARY OF THE INVENTION
`
`
`
`display 12 shown in FIG. 4,
`area AA. As in the conventional
`
`
`
`
`A method of facilitating the use of touch screen alters the
`
`
`5 the computer 10 calculates a hot spot H (FIG. 3), HA (FIG.
`
`
`
`
`operation of the touch screen when an area of contact is
`
`
`
`SA) at the center of the area of contact A(FIG. 3), AA (FIG.
`
`
`
`
`within a predetermined distance of an edge of the touch
`
`SA). Icons and features positioned
`at the hot spot HA are
`
`
`
`screen. The position of the contact area on the touch screen
`
`
`selected in the same manner as with the conventional
`
`
`
`
`is first determined. If the contact area is at a first location on
`
`computer touch screen 12 explained above.
`
`
`
`
`
`the touch screen, such as within a predetermined distance of
`10
`
`
`The embodiment shown in FIGS. 5A-5F differs from the
`
`
`
`an edge of the screen, a user input is registered at a first
`
`
`
`prior art touch screen 12 in the manner in which the hot spot
`
`
`
`
`position relative to the contact area. Otherwise, user input is
`
`
`
`
`registered at a second position relative to the contact area.
`
`
`
`
`H is determined when the area of contact A is adjacent an
`
`
`The first position is preferably offset from the second
`
`
`
`edge of the screen 50. With reference to FIG. SB, a finger F B
`
`
`
`position toward an edge adjacent the contact area. The
`
`
`
`
`the is shown attempting to select an icon 60s by placing
`
`
`registered user input may be, for example, a hot spot 15
`
`
`
`finger F B adjacent the right edge 56 of the screen 50 in
`
`
`
`
`
`positioned within the contact area or a cursor displayed at a
`with the screen 50 over an area As. Using the
`contact
`
`
`location offset from the contact area. The operation of the
`
`
`
`
`conventional approach, the computer would calculate the
`
`
`
`
`
`touch screen is preferably altered adjacent the bottom edge
`
`
`
`
`of contact center of the area position of a hot spot Hs, at the
`
`
`
`of the screen. The user input may be registered at a location
`
`
`60s· In accordance
`As, which would fail to select the icon
`
`
`
`
`offset to either side of the contact area. Alternatively, the 20
`
`
`
`with one embodiment of the invention, the computer calcu­
`
`
`touch sensitive portion of the screen may be extended
`
`edge 56 of the
`
`offset toward the lates a hot spot Hs that is
`
`
`
`
`
`beneath a display area of the screen so that a user input may
`As is near the edge 56.
`
`
`
`screen whenever the area of contact
`
`
`
`
`
`be registered adjacent the bottom edge of the display area by
`
`
`
`centered beneath As a result, the hot spot Hs is substantially
`
`
`a contact area positioned below the lower edge of the display
`
`
`
`
`the finger F B rather than centered in the area of contact As.
`area.
`
`
`25 The finger F B is thus able to select
`the icon 60s even though
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`50.
`
`along an edge of the screen the icon 60s is positioned
`
`
`
`
`FIG. 1 is an isometric view of a conventional palmtop
`
`
`
`In a similar manner, and as shown in FIGS. SC, SD, and
`
`
`
`computer being held by a user of the type that can be
`
`
`SE, the computer calculates hot spots He, H
`D, and HE that
`
`
`
`
`operated in accordance with the embodiments of the inven-
`
`are offset toward the respective edges 52, 54, and 58 of the
`tion.
`
`
`screen 50 whenever the respective
`areas of contact Ac, AD,
`30
`and AE are near the edges 52, 54, and 58. As a result,
`
`
`
`FIG. 2 is a system block diagram of the palmtop computer
`icons 600 60D, and 60£ can be selected
`respective
`by
`of FIG. 1.
`
`
`
`icons centering the finger F c, FD, and FE over the respective
`
`
`
`FIG. 3 is a schematic drawing illustrating the manner in
`60c, 60D, and 60£ even though the respective
`areas of
`
`
`
`which a position of a hot spot is conventionally determined
`35 contact Ac, AD, and AE are not centered
`
`over the icons 60c,
`
`
`in the palmtop computer of FIG. 1.
`60D, and 60£.
`
`
`
`
`FIG. 4 is a schematic drawing illustrating the manner in
`When the icon to be selected is positioned at one corner
`
`
`
`
`
`
`which a position of a hot spot is conventionally determined
`
`
`
`
`of the screen 50, the computer treats the finger F as being
`
`
`
`in the palmtop computer of FIG. 1 when attempting to select
`
`
`sufficient close to two adjacent edges of the screen 50, and
`
`
`
`
`
`and icon or other feature that is positioned near the edge of 40
`
`
`
`alters the calculation of the hot spot H. The calculation is
`
`
`a screen of the computer.
`
`
`
`
`similar to the calculation described above but including
`
`
`FIGS. 5A-5F are schematic drawings illustrating the
`
`adjustments toward two edges. As shown in FIG. SF, a finger
`
`
`
`
`
`
`
`operation of an improved palmtop computer in accordance
`
`
`
`FF is attempting to select an icon 60F at the upper left corner
`
`
`with one embodiment of the invention.
`
`
`
`of the screen 50 at the intersection of the edges 52 and 54.
`
`
`FIG. 6 is a flow chart of a method for controlling
`the 45
`
`
`The area of contact AF between the finger FF and the screen
`
`
`
`operation of the palmtop computer of FIG. 1 in accordance
`
`
`
`50 is also positioned in the corner, but its center does not
`
`with the embodiment of the invention shown in FIGS.
`
`
`
`overlie the icon 60r As a result, the finger FF would fail to
`5A-5F.
`
`
`
`approach of select the icon 60F using the conventional
`
`
`
`
`FIG. 7 is a schematic drawing illustrating the operation of
`
`
`
`
`calculating the location of the hot spot at the center of the
`the palmtop computer of FIG. 1 in accordance with another
`
`
`
`50
`
`
`
`area of contact Ar The conventional hot spot is designated
`
`embodiment of the invention.
`Hp' in FIG. SF. Instead,
`
`in accordance with one embodiment
`
`
`
`
`FIGS. 8A-8E are schematic drawings illustrating the
`
`
`
`of of the invention, the hot spot HF is offset from the center
`
`
`
`operation of the palmtop computer of FIG. 1 in accordance
`
`the area AF toward the edge 54 because the area AF is close
`
`with the embodiment of FIG. 7.
`
`
`
`to the edge 54, and it is also offset from the center of the area
`FIGS. 9A and 9B are flow charts of a method for
`55
`
`
`edge 52 because the area Athe
`AF toward the
`F is close to
`
`
`controlling the operation of the palmtop computer of FIG. 1
`
`edge 52.
`
`in accordance with the embodiment of the invention shown
`
`
`
`The finger FF is thus able to select the icon 60F by
`
`
`
`
`in FIGS. 8A-8E.
`
`
`area centering the finger FF over icon 60F even though the
`
`
`
`
`FIG. 10 is a schematic drawing illustrating the operation
`
`
`
`
`over the icon 60 of contact centered AF is not 60F and even
`
`
`
`of an improved palmtop computer to register a user input
`
`50.
`
`
`of the display in the corner though the icon 60F is located
`
`
`
`
`
`adjacent a bottom edge of the computer's display screen in
`
`A method of determining the location of the hot spot H in
`
`
`accordance with one embodiment of the invention.
`
`
`accordance with the embodiment of FIGS. 5A-5F is shown
`
`DETAILED DESCRIPTION OF THE
`
`
`
`
`
`
`in FIG. 6. The program is preferably stored in the ROM 32
`INVENTION
`
`65 and transferred to the system memory 26 at power on so that
`
`
`it can be executed out of the system memory 26. The ROM
`
`
`
`The operation of one embodiment of a method of oper­
`
`
`
`
`
`32 also contains a large amount of other operating system
`
`
`
`
`ating a touch screen according to the invention is illustrated
`
`IPR2020-00778
`Apple EX1017 Page 17
`
`

`

`
`
`US 6,727,892 Bl
`
`6
`5
`and applications software that will not be explained herein
`
`
`
`at 76 to be not near the top edge 54, the method determines
`
`
`
`
`
`
`
`because it is somewhat peripheral to the embodiment of
`
`
`
`at 88 if the area of contact, or alternatively, the calculated
`FIGS. 5A-5F.
`
`
`position of the hot spot, is near the bottom edge 58 of the
`
`As shown in FIG. 6, the method is entered at step 60 in
`
`
`screen 50, as shown in FIG. SE. If the.hot spot H is
`
`
`which the existence of a touch pad input is detected. The
`
`5 determined at 88 to be near the bottom edge 58, the
`
`
`
`
`computer then senses the location and area of the touch pad
`
`
`
`computer offsets the hot spot H in step 90 below the center
`
`
`
`input at 62. In embodiments of the invention, a stylus as well
`
`
`
`
`of the area of contact A between the finger F and the screen
`
`
`
`as an operator's finger may be used to provide touchpad
`
`
`50, i.e., toward the bottom edge 58. After offsetting the hot
`
`input. By reading the amount of area of the touch pad input
`
`
`
`
`spot at 84, the method proceeds to 96, as it does if a
`
`and comparing that area to known amount of area, it may be
`
`
`
`
`10 determination is made at 88 that the hot spot H is not near
`
`
`
`
`determined whether a stylus or an operator's finger is being
`the bottom edge 58.
`
`
`
`used to input data. If the operator's finger is being used,
`As mentioned above, if the determination is made at 70 or
`
`
`
`
`
`
`offset processing as illustrated in FIGS. 5B-5F may be
`
`
`78 and at 76 or 88 that the position of the hot spot initially
`
`
`
`
`
`accomplished. If a stylus is being used, offset processing is
`
`
`calculated at 64 is sufficiently near an edge, the initially
`
`
`
`
`not needed. Processing may nonetheless be accomplished in 15
`
`
`
`
`calculated hot spot must then be in a corner of the display 50
`
`
`
`
`at least two ways. First the offsets of the routine may be
`
`
`as shown in FIG. SF. Thus, as explained above with refer­
`
`
`made proportional to the area of the touch pad input.
`
`
`
`ence to FIG. SF, the initially calculated hot spot is offset both
`
`
`
`
`Because a stylus has a very small area, a proportionally
`horizontally and vertically.
`
`
`small offset would result. A small offset would enable use of
`
`
`After the location of the hot spot is determined as
`
`
`
`
`a stylus without potentially distracting jumps near screen
`20 explained
`
`
`
`
`above, the current position of the hot spot H is
`
`
`
`
`edges. Second, the offset routines might simply be bypassed
`
`
`
`
`registered at 96. A program or other function is then selected
`
`
`if the area of touch pad input is less then a given area.
`
`
`
`
`in the same manner that it would have been selected if the
`
`
`
`Continuing with FIG. 6, the position of the hot spot H is then
`
`
`
`position of the hot spot initially calculated at 60 was used.
`
`
`
`
`calculated at the center of the area of contact at 64 in a
`
`
`
`The operation of another embodiment of a method
`
`
`
`conventional manner as described above with reference to 25
`
`
`according.to the invention is illustrated in FIG. 7. As shown
`
`FIGS. 3 and 4.
`
`
`in FIG. 7, a finger F is placed on a touch screen 100 so that
`
`
`
`After the customary position of the hot spot is calculated
`
`it contacts the screen 100 over an area A. In one embodiment
`in step 64, a determination is made at 70 whether the area of
`
`
`
`
`
`
`
`a computer, similar the palmtop computer of FIG. 1, gen­
`contact, or alternatively, the calculated position of the hot
`
`
`
`
`
`
`
`
`erates a cursor 102 directly above the area A at an offset
`spot, is near the right edge 56 of the screen 50 as shown in
`
`
`
`30
`
`
`
`distance R from its center C. The magnitude of the offset
`
`FIG. SB. The particular location constituting "near the right
`
`
`
`
`distance R is selected so that the cursor is positioned above
`
`
`
`
`edge", or "near" any of the other edges, can be determined
`
`
`the finger F and is thus visible to the user. Although the
`
`
`
`empirically, and it might even be user selected so that it
`
`
`
`cursor 102 is shown as a cross, it will be understood that
`
`
`
`
`could be varied depending on such factors a finger size and
`
`
`
`other varieties of cursors may be used, such as a pointer or
`
`
`
`user preference. If the hot spot H is determined at 70 to be
`
`35 a pointing hand.
`
`
`
`near the right edge 56, the computer offsets the hot spot H
`In operation, a program or other function (not shown in
`
`
`
`
`
`
`
`
`to the right of the center of the area of contact A between the
`
`
`
`
`FIG. 3) is selected by placing the cursor 102 above an icon
`
`
`finger F and the screen 50 at 72. Offsetting the hot spot H to
`
`
`
`
`or other feature corresponding to the program or function.
`
`the right offsets it toward the right edge 56, as explained
`
`
`
`the selection,40 The user then takes some action to validate
`
`
`above with reference to FIG. SB. The method then proceeds
`
`
`such as by tapping the screen 100 or pressing a key 14.
`
`
`
`to decision 76, which will be described below.
`
`In other embodiments, also illustrated in FIG. 7, cursors
`
`
`If a determination is made at 70 that the hot spot H is not
`
`110, 114, and 116 are positioned at other locations about the
`
`
`near the right edge 56, a determination is made at 78 whether
`
`
`area of contact A and at a sufficient distance that they are not
`
`
`
`
`the area of contact, or alternatively, the calculated position
`
`
`covered by the finger F.
`
`
`of the hot spot, is near the left edge 52 of the screen 50 as 45
`The embodiment illustrated in FIG. 7 would initially
`
`
`
`
`
`shown in FIG. SC. If the hot spot H is determined at 78 to
`
`
`
`be near the left edge 52, the computer offsets H
`
`
`
`
`appear the hot spot to solve many of the problems incurred in using prior
`
`
`to the left of the center of the area of contact
`
`
`art computer A between the touch screens as explained above with refer­
`
`
`
`
`finger F and the screen 50 at 80. Offsetting
`
`
`ence to FIG. the hot spot H to 4. However, on further reflection it apparently
`
`
`the left offsets it toward the left edge 52, as explained above
`
`
`
`50 suffers from some of the same problems as the prior art
`
`
`
`with reference to FIG. SC. After offsetting the hot spot at 80,
`
`
`
`touch screens. More specifically, the cursor 102 shown in
`
`
`
`the method proceeds to decision 76, as it does if a determi­
`
`
`
`
`FIG. 7 would appear to be incapable of selecting an icon or
`
`
`nation is made at 78 that the hot spot H is not near the left
`
`
`other feature positioned near the side or bottom edges of the
`edge 52.
`
`
`
`
`touch screen 100 because the Finger F would then have to
`
`
`
`
`problems would appear to 55 be off the screen 100. Similar
`
`The forgoing portion of the method of FIG. 6 deals with
`
`
`
`exist in using any of the other cursors 110, 112, 114, and 116
`
`the area of contact A being near the left edge 52 or the right
`
`
`shown in FIG. 7. For example, using the cursor 110 would
`
`
`
`edge 56. The remainder of the method of FIG. 6 deals with
`
`
`appear to make it impossible to select an icon or other
`
`
`
`the situation in which the area of contact A is alternatively
`
`
`
`feature that is adjacent the top or right edges of the screen
`
`
`or additionally near the top edge 54, the bottom edge 58, or
`
`
`
`of the 60 100. To solve this apparent problem, the position
`
`
`
`a corner, as shown in FIGS. 5D, SE, and SF. At decision 76,
`
`
`
`cursor is altered when the area of contact A is near the edges
`
`
`
`
`a determination is made whether the area of contact, or
`
`
`
`
`
`of the screen, as explained below with reference to FIGS.
`
`alternatively, the calculated position of the hot spot, is near
`
`
`
`8A-8E.
`the top edge 54 of the screen 50 as shown in FIG. 5D. If the
`
`With reference to FIG. SA, the cursor 102 is normally
`
`hot spot His determined at 76 to be near the top edge 54, the
`
`
`
`
`
`
`
`
`
`
`
`
`computer offsets the hot spot H at 84 above of the center of 65 positioned above an area of contact AA of a finger FA as
`
`
`
`
`
`
`the area of contact A between the finger F and the screen 50, shown in FIGS. 7 and SA However, it will be understood
`
`
`
`
`
`
`i.e., toward the top edge 54. If the hot spot H is determinedthat the cursor may alternatively be positioned at other
`
`IPR2020-00778
`Apple EX1017 Page 18
`
`

`

`
`
`US 6,727,892 Bl
`
`7
`8
`locations relative to the area A of contact, such as the
`
`
`
`location and area of the touch pad contact at 142. The center
`
`
`
`
`
`positions of the cursors 110, 112, 114 and 116 shown in FIG.
`
`
`