(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
`
`(19) World Intellectual Property Organization
`International Bureau
`
`lllll 11111111111111111111111
`1111111111111111 IIIIII IIIII IIII I II Ill 111111111111111
`
`
`
`(43) International Publication Date
`4 April 2002 (04.04.2002)
`
`PCT
`
`(10) International Publication Number
`WO 02/27455 Al
`
`(51) International Patent Classification 7:
`H04M 1/247
`
`G06F 3/00,
`
`(21) International Application Number: PCT/NO0l/00385
`
`(72) Inventor; and
`(75) Inventor/Applicant (for US only): MATHIASSEN,
`Camilla [NO/NO]; Homansbyveien 4, N-1389 Heggedal
`(NO).
`
`(22) International Filing Date:
`20 September 2001 (20.09.2001)
`
`(74) Agent: ABC-PATENT, SIVILING. ROLF CHR. B.
`LARSEN A.S; Brynsveien 5, N-0667 Oslo (NO).
`
`(25) Filing Language:
`
`(26) Publication Language:
`
`English
`
`English
`
`(30) Priority Data:
`20004864
`
`27 September 2000 (27.09.2000) NO
`
`(71) Applicant (for all designated States except US): BIO(cid:173)
`PRINT AS [NO/NO]; Gaupeveien 21, N-8515 Narvik
`(NO).
`
`(81) Designated States (national): AE, AG, AL, AM, AT, AU,
`AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU,
`CZ, DE, DK, DM, DZ, EC, EE, ES, Fl, GB, GD, GE, GH,
`GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC,
`LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW,
`MX, MZ, NO, NZ, PH, PL, PT, RO, RU, SD, SE, SG, SI,
`SK, SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU,
`ZA, ZW.
`
`(84) Designated States (regional): ARIPO patent (GH, GM,
`KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian
`
`[Continued on next page]
`
`(54) Title: METHOD AND GENERATOR FOR INPUTTING CHARACTERS
`
`---iiiiiiiiiiii
`-------------------------------------------
`iiiiiiiiiiii -iiiiiiiiiiii ---iiiiiiiiiiii
`
`iiiiiiiiiiii
`iiiiiiiiiiii
`
`!!!!!!!!!!!!!!!
`
`~
`I
`i
`
`(57) Abstract: Sign generator for information or communication devices comprising
`at least one touch and/or pressure activated sensor and a display, the sensor being ca(cid:173)
`pable of measuring movements in two dimensions, analysing means connected to said
`sensor for categorising two dimensional movements sensed by the sensor according
`to a chosen set of categories, translating means including a predetermined table of
`categories of two dimensional movements corresponding to a chosen set of signs and
`indicating the chosen sign or signs on the display.
`
`!!!!!!!!!!!!!!! -iiiiiiiiiiii
`
`iiiiiiiiiiii
`
`5
`
`IPR2022-00602
`Apple EX1033 Page 1
`
`

`

`WO 02/27455 Al
`
`IIIIII IIIII IIII I II Ill 111111111111111
`1111111111111111
`lllll 11111111111111111111111
`
`patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European
`patent (AT, BE, CH, CY, DE, DK, ES, Fl, FR, GB, GR, IE,
`IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF,
`CG, Cl, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD,
`TG).
`
`Published:
`-
`with international search report
`
`before the expiration of the time limit for amending the
`claims and to be republished in the event of receipt of
`amendments
`
`For two-letter codes and other abbreviations, refer to the "Guid(cid:173)
`ance Notes on Codes and Abbreviations" appearing at the begin(cid:173)
`ning of each regular issue of the PCT Gazette.
`
`IPR2022-00602
`Apple EX1033 Page 2
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`Method and generator
`
`for
`
`inputting
`
`characters
`
`1
`
`35
`
`the
`
`two largest
`
`5
`
`25
`
`30
`
`generator
`to a sign/character
`relates
`invention
`This
`sensor with navigation means,
`by a fingerprint
`represented
`input
`for communication
`and information
`for
`text/sign
`devices with displays,
`such as cellular
`phones,
`palmtop PCs,
`PDAs, etc.
`the
`has reduced
`size of such devices
`The compact
`dimensions
`of
`their
`keyboards.
`Such devices
`are
`therefore
`10 normally
`equipped with a keyboard as
`illustrated
`in fig.
`where
`the number of keys are
`far
`less
`than
`the standard
`letters
`a user needs
`to
`input meaningful
`text.
`The solution
`for present
`cellular
`phones
`is
`to
`let
`each number key
`represent
`3 or 4 subsequent
`letters
`as per
`fig.
`1. For
`15 example
`the key usually
`giving number 6 will
`in
`the alpha(cid:173)
`numeric mode define
`one of the
`letters
`m, nor
`o, pending
`the number of
`times
`the key is pressed.
`Thus the word
`key
`"hello" may be written
`by pressing
`key number 4 twice,
`and
`number 3 twice,
`key number 5 thrice,
`key number 5 thrice
`20 key number 6 thrice,
`thus pressing
`the keys a total
`of 13
`times. The user needs
`to memorise
`the positions
`of these
`alphanumeric
`keys, or
`look up their
`positions
`and shift
`finger
`position
`from key to key, as per
`the above example.
`This makes text
`input by reduced keyboards
`a cumbersome and
`time-consuming
`effort.
`trend of such handheld
`There
`is a strong development
`smaller,
`lighter
`and yet
`devices
`to make them increasingly
`continuously
`increases
`as
`cheaper. Yet their
`functionality
`they offer more
`information
`and data
`to
`the user,
`and there-
`fore would benefit
`from larger
`displays.
`However, such
`increased
`displays
`should preferably
`not
`increase
`the
`overall
`dimensions
`of the already
`compact
`information/communication
`devices.
`Presently
`elements
`of
`the
`front panel of such
`and the
`the display
`information/communication
`devices
`are
`the
`reduced
`reduced keyboard,
`as per
`fig.
`1, where generally
`keyboard
`still
`occupies more space
`than
`the display.
`The
`only efficient
`way to
`increase
`the display
`size without
`
`IPR2022-00602
`Apple EX1033 Page 3
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`2
`
`1.
`
`and
`
`in
`by
`
`5
`
`15
`
`to reduce
`is
`of the device
`dimensions
`the overall
`increasing
`as
`indicated
`in fig.
`the keyboard
`to a minimum size,
`2
`without
`loosing
`versatility
`and convenience
`of
`the
`text
`input process.
`text
`to make the
`known solutions
`There are several
`types
`as per
`fig.
`input process
`based on current
`keyboard
`One manufacturer,
`Ericsson,
`provides
`an external
`QWERTY
`keyboard
`as a plug-in
`device
`to
`their
`cellular
`phones. This
`solution
`has, however,
`the disadvantages
`of extra
`size,
`10 weight and costs,
`being directly
`contrary
`to user
`requirements
`for
`increasingly
`smaller,
`lighter,
`cheaper
`more versatile
`cell
`phones.
`the Nokia Naviroller™
`is
`Another known solution
`on the
`front panel
`is
`rolled
`which a mechanical
`barrel
`the
`finger,
`bringing
`up a vertical
`column of signs
`and
`characters
`on the display.
`Selection
`of a particular
`sign or
`character
`is performed
`by mechanically
`pressing
`down the
`barrel.
`In practice
`this
`is not a faster
`solu~ion
`than
`moving the
`finger
`from key to key and pressing
`the selected
`20 key one or multiple
`times. The Naviroller™
`solution
`also
`imposes a serious
`constrain
`on the cursor movements as
`it
`limits
`cursor movements
`to one dimension;
`<UP> and <down>,
`except
`for pressing
`the barrel
`for character
`selection.
`Tegic Communications
`has developed
`a system called T9™
`25 whereby software
`logic
`search
`for
`legal
`letter
`combinations
`of a particular
`language,
`thereby minimising
`the multiple
`presses
`of any key representing
`multiple
`characters,
`as
`shown in fig.
`1. This
`is an elegant
`solution
`as the number
`of finger
`taps
`is presumably
`significantly
`reduced,
`but
`the
`30 negative
`aspect
`is
`that
`it
`requires
`a translation
`program
`for each
`language,
`and that
`these must be stored
`in the
`phone memory. Motorola
`is said
`to have developed
`a similar
`solution,
`called
`iTap™, thus having
`the same problems.
`Generating
`text/character
`input on such reduced
`even
`35 keyboards
`is
`therefore
`a slow and cumbersome process,
`for alphabetic
`languages
`like
`the Latin
`language. However, a
`large part of
`the world's
`population
`uses sign-based
`languages,
`such as Chinese,
`Japanese, Korean,
`etc. Sign(cid:173)
`based
`languages may comprise hundreds of thousands
`of signs,
`
`IPR2022-00602
`Apple EX1033 Page 4
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`3
`
`the problem of text
`
`input by keyboards
`
`are
`
`in
`
`by
`
`aggravating
`considerably.
`languages
`input by sign-based
`text
`for
`A known solution
`by ZiCorp,
`aimed at simplifying
`the Zia™ provided
`is
`5 character
`input by Chinese
`signs
`through
`a limited
`keyboard
`as shown in fig.
`1. It
`is based on the
`fact
`that Chinese
`signs are composed of so-called
`basic
`strokes,
`which
`sequence defines
`a particular
`sign. These basic
`strokes
`assigned
`to
`the keys, much in a similar.way
`as alphabet
`letters
`are assigned
`to
`the number keys,
`as illustrated
`fig.
`1. This solution
`enables
`input of Chinese characters
`a reduced keyboard
`as per
`fig.
`1, but does not
`resolve
`the
`main problems. A keyboard of considerable
`size
`is still
`required,
`but due to size
`limitations
`it normally
`contains
`far
`less keys
`than
`the characters/signs
`required
`to compose
`a meaningful message. The finger
`therefore
`has
`to be moved
`around
`the keyboard,
`and each key may need
`to be pressed
`down mechanically
`multiple
`times
`to select
`a message.
`US 5,982,303
`describes
`a joystick
`to feed characters,
`20 numbers and function
`categories
`into a processor.
`The
`method according
`to
`this publication
`may be use
`to write
`non-latin
`signs
`and to control
`a cursor.
`The publication
`mentions
`the use of eight keys for providing
`the control
`signals
`and represents
`a large
`and complicated
`solution.
`similar
`solution
`is described
`in US 4,680,577.
`It
`is an object
`of this
`invention
`to provide
`solution
`for
`feeding
`information
`into a small unit,
`cellular
`phone, by using
`sensors which have already
`provided
`for other purposes.
`dedicated
`the use of several
`US 5,088,070
`describes
`switches
`on a wrist watch. Although
`it
`is more compact
`the abovementioned
`solution
`it
`still
`represents
`an
`unnecessary
`large
`structure
`on the
`limited
`available
`US 6,057,540
`describes
`an optical
`sensor with
`35 navigation
`utilities.
`It's
`dimensions
`and complexity,
`however, makes unsuitable
`for usse
`in mobile phones and
`similar.
`Also,
`as the sensor described
`here preferably
`a 16x16 pixel matrix
`it
`is not suitable
`for use as a
`fingerprint
`sensor,
`since
`the resolution
`is unsufficient.
`
`10
`
`15
`
`25
`
`30
`
`A
`
`a simple
`e.g.
`a
`been
`
`than
`
`space.
`
`uses
`
`IPR2022-00602
`Apple EX1033 Page 5
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`4
`
`to a
`key connected
`a telegraph
`describes
`US 5,608,395
`are organized
`in
`The characters
`computer
`for writing
`text.
`a hierarchy
`for demanding a minimum memory for choosing
`each
`character.
`This
`solution
`is also
`to complicated
`and large
`5 and does not have
`the advantage
`of using existing
`sensors
`modile phones or similar.
`for e.g.
`situation
`the present
`The above
`illustrates
`cellular
`phones, where complex
`text
`input
`is cumbersome as
`such
`input has
`to be generated
`through
`reduced keyboards
`as
`10 per
`fig.
`1. The next generation
`of cellular
`phones comprises
`so-called WAP phones with
`Internet
`access.
`In general
`this
`development
`calls
`for
`increased
`displays,
`for better
`reada(cid:173)
`bility
`of more complex
`information.
`Preferably
`increased
`display
`size
`should not
`increase
`the cell phone size. The
`15 most viable way to
`increase
`display
`size without
`increasing
`the phone size will be to reduce
`the keyboard
`size,
`pre(cid:173)
`ferably
`to a one-button
`size,
`but still
`enabling
`complex
`text
`input
`to
`the cellular
`phone. None of the above
`solutions
`will
`function
`satisfactorily
`with such a single
`20 button
`"keyboard 11
`a
`to provide
`invention
`of this
`Thus
`it
`is an objective
`sign generator
`system
`for said
`information
`and communication
`devices.
`Such system
`shall
`enable
`complex
`text
`input
`in a
`fast
`and convenient way without
`requiring
`extensive
`program
`code
`loaded down in
`the device's memory, even for devices
`where
`the keyboard
`is replaced
`by a single
`button
`for
`character/sign
`entry. This objective
`is obtained
`by a sign
`generator
`based on combining a fingerprint
`sensor having
`navigation means, with analysing/interpreting
`means and
`translation
`means as described
`in claim 1.
`The invention will be described
`below by way of example
`and with
`reference
`to
`the accompanying drawings.
`Figure
`l
`illustrates
`a traditional
`reduced keyboard
`cellular
`phones, with multiple-character
`keys.
`Figure
`2 exemplifies
`the
`front panel of a new
`generation
`of
`information
`and communication
`devices with a
`large display,
`obtained
`through
`a minimised keyboard.
`Figure
`3 illustrates
`the
`invention
`schematically.
`Figure
`4 illustrates
`categories
`of finger movements
`
`in
`
`for
`
`in
`
`•
`
`25
`
`30
`
`e.g.
`
`35
`
`IPR2022-00602
`Apple EX1033 Page 6
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`5
`
`two dimensions.
`text
`Figure
`5 illustrates
`languages,
`by the
`invention.
`Figure
`6 illustrates
`how mathematical
`5 handled on a palmtop PC by the
`invention.
`Figure
`7 illustrates
`schematically
`strokes,
`components
`and Chinese
`signs
`solution,
`and how their Zia™ reduced
`represented
`on a reduced keyboard.
`Figure
`8 tabulates
`stroke/sign
`
`input
`
`for alphabetic
`
`operations
`
`can be
`
`the hierarchy
`as per ZiCorp's
`strokes
`can be
`
`of
`known
`
`10
`
`signs.
`
`hierarchy
`
`of Chinese
`
`15
`
`20
`
`30
`
`finger
`form typical
`for Morse
`program,
`phone.
`the cellular
`finger
`interfacing
`with
`
`the
`
`in
`
`in tabular
`9 illustrates
`Figure
`the analysing/interpretation
`commands of
`Mode and Display Mode text
`input
`to
`Figure
`10 illustrates
`typical
`the cellular
`phone.
`illustrated
`is
`invention
`of the
`The principle
`schematically
`in fig.
`3. A touch sensitive
`in
`switch 1,
`is
`form of a fingerprint
`sensor with navigation means,
`coupled
`to analysing means 2. The analysing means measures
`the duration,
`direction
`and speed of finger moves on the
`switch,
`and categorises
`the signal
`from the switch
`into
`categories.
`The classified
`categories
`of data are stored
`a memory 3 and are compared by a translation
`means 4 with
`25 predefined
`tables
`relating
`categories
`of finger moves and
`sequences
`thereof
`to readable
`characters/signs.
`The signs
`corresponding
`to
`these
`categories
`and sequences
`are
`then
`shown in
`the display
`5 in a known manner. The form in which
`the data are presented
`on the screen,
`and how text
`input
`is
`interacted
`by the user
`is controlled
`by the
`translation
`means 4.
`simplest
`its
`1 may in
`The switch
`form be a simple
`case
`the system will
`In this
`on/off
`touch-sensitive
`switch.
`finger
`touches,
`as well as
`register
`the duration
`of the
`to distinguish
`between periods
`35 disconnect
`periods
`in order
`between complete
`between
`the signals,
`periods
`between words.
`characters/signs
`and periods
`by measuring
`The connection
`categories may be selected
`the connection
`period
`tm and comparing
`them tmoff with
`
`IPR2022-00602
`Apple EX1033 Page 7
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`6
`
`sets of finger
`to defined
`according
`limits
`predefined
`for
`commands. The system comprises
`lower and upper
`limits
`than
`being
`registered
`as a signal.
`Signals
`being
`shorter
`lowest
`limit
`defined
`as treg may be ignored
`to avoid errors
`5 caused by accidental
`touches of
`the switch 1 e.g. due to
`handling
`of
`the
`information/communication
`device. Connection
`periods
`longer
`than
`the predefined
`limits may also be
`ignored,
`or may be classified
`as a separate
`code,
`for
`example "End of message".
`In addition
`long disconnects may
`Table 1 defines
`10 be registered
`as periods
`between signs.
`typical
`time
`limits.
`
`the
`
`Time Ranges
`< tReg< 0,100s
`0,001S
`
`15
`
`1,5
`
`tReg< toff< 50,0
`
`tReg
`
`toff = 0,25S
`tRea tshort = 0,25s
`1,5
`tRea< tshort< 50,0
`tLoncr = 0,50s
`tshort< tLoncr< 5,0
`1,5
`tshort
`tLong< tExtra< 10,0
`1,5
`tExtra > 0,75S
`tLoncr
`
`Table 1
`Norn. Values Meaning
`tReg = 0,0lS
`Reg.
`limit
`Sign
`Sep.
`Dot
`Dash
`Period
`
`Type
`Basic/Non-
`adapt
`Adaptive
`
`Adaptive
`Adaptive
`Adaptive
`
`20
`
`25
`
`30
`
`of Table 1 above may of course be
`limits
`The time
`chosen otherwise.
`A particular
`embodiment of
`the
`invention
`is
`to set
`the above ranges dynamically
`to adapt
`to the
`user's
`skills
`and his
`learning
`curve
`in using
`the
`invention.
`This may be done by registering
`the e.g.
`50 last
`commands of
`each
`type,
`and calculating
`the arithmetic
`mean and standard
`deviation.
`The statistics
`may be based upon any written
`text
`to
`or a predetermined
`learning
`sequence,
`and may be used
`the
`shift
`the category
`definitions
`according
`to
`the speed of
`user,
`and thus also adapt as the user
`learns
`the system and
`increases
`his
`input
`speed.
`simplest
`its
`switch 1 in
`Although
`the
`touch-sensitive
`switch,
`it would be
`form could be a simple on and off
`insufficient
`compared
`to
`the objective
`of the
`invention.
`provide
`combined user authentication
`by finger
`print
`35 biometrics,
`accurate
`cursor
`control
`and fast,
`versatile
`flexible
`text
`input,
`all
`served by the very same single(cid:173)
`button
`sensor,
`requires
`a sensor
`that
`can register
`lateral
`finger movements. The preferred
`embodiment of the
`invention
`
`To
`
`and
`
`IPR2022-00602
`Apple EX1033 Page 8
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`7
`
`the
`
`are
`
`the
`
`of
`is
`
`sensor with navigation
`a fingerprint
`provide
`therefore
`must
`capability
`also
`to register
`lateral
`finger
`means comprising
`movements on the switch.
`Patent publication
`EP 735.502
`describes
`a line-shaped
`fingerprint
`sensor.
`This
`fingerprint
`sensor
`scans
`the
`fingerprint,
`and in order
`to analyse
`the
`finger
`print,
`is able
`to detect
`the
`finger movement across
`the sensor
`in one dimension;
`<UP> and <Down>. Such one(cid:173)
`to
`dimensional
`finger movement detection may be expanded
`two-dimensional
`finger
`registering
`by arranging
`some of
`sensor
`elements
`as per fig.
`4. This may for example be
`obtained
`by using
`two orthogonal
`sensors
`of the
`type shown
`in
`the EP publication
`mentioned
`above. The figure
`that
`illustrates
`categories
`of
`lateral
`finger movements
`used
`to build
`finger
`commands, either
`by basic
`finger
`15 movements, or combinations
`thereof.
`Fig. 4 defines
`ten
`lateral
`finger movement categories
`(in addition
`to vertical
`taps);
`eight
`directions
`of movements and two circular
`movements
`(clockwise
`and counter-clockwise).
`These may also
`be combined with
`time measurements
`to calculate
`the velocity
`20 of a movement,
`thus providing
`a number of differing
`categories
`from one single
`finger movement. All
`finger
`the
`movements
`(on/off
`sensor,
`vertical
`taps,
`lateral
`linear
`and
`circular
`movements),
`their
`duration
`and speed are
`categorised
`in
`the analysing/interpretation
`means 2.
`print
`Such a touch-sensitive
`switch
`comprising
`a finger
`sensor with navigation means enables
`the
`invention
`to use
`comprehensive
`and intuitive
`sets of finger
`commands in
`the
`interpretation/translation
`means 4. Combined finger
`commands
`can be made from sequences
`of basic
`finger movements.
`As the
`touch-sensitive
`switch will
`serve multiple
`purposes
`in a combined
`function,
`as per
`the objective
`invention,
`a finger
`command structure
`is
`required
`that
`applicable
`to all
`functions
`.to be served,
`including
`command
`versatility
`of
`the
`input modes. Moreover
`the
`finger
`structure
`must be intuitive
`within
`each mode,
`to avoid
`the
`need for memorising
`complex finger
`commands. Such a finger
`command structure
`is exemplified
`in Table 2 below. This
`finger
`command structure
`is a key element of the
`invention,
`and represents
`a basis
`for
`the
`translation
`means.
`
`5
`
`10
`
`25
`
`30
`
`35
`
`IPR2022-00602
`Apple EX1033 Page 9
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`8
`
`a single-
`
`in
`
`commands· to
`The analysing means can be set by finger
`alternative
`modes, where the default
`is Display Mode,
`input
`(e.g. Chinese
`another will be Sign-based
`language
`signs),
`etc.
`comprising
`invention,·
`This embodiment of the
`button
`input device
`for multiple
`input modes uses
`"universally
`defined"
`finger
`command structures
`embedded
`the
`translation
`means, ensuring
`that
`the sign generator
`provides
`the
`required
`input
`type
`in
`the
`respective
`input
`10 modes of
`the
`information/communication
`devices.
`The input
`modes are arranged
`in a hierarchy.
`Level 1 is shown in Table
`3a. This
`is
`the overall mode level, where
`input mode
`alternative
`is set by the
`information/communication
`device.
`There
`is a fourth mode in addition
`to
`the
`three modes shown
`in Table 3a, namely Sleep Mode for minimum power consumption
`while
`sensor
`do not need to be active.
`
`5
`
`15
`
`20
`
`25
`
`30
`
`Vertical
`
`Table 2 Finger Command St~ucture
`Display Mode Commands
`Input
`Screen
`Horizontal
`Commands
`high Command Fields
`(One-line
`or Option Fields)
`Select
`<Double Tap>
`Command/option
`One line down <Finger Down>
`
`<Finger Down>
`
`Input
`
`Scroll
`
`down <Finger Down -
`Hold>
`One line up <Finger Up>
`
`Scroll
`
`up <Finger Up -
`Hold>
`
`Screen
`Commands
`(One-character
`wide vertical
`Selection
`Fields)
`Select
`<Double Tap>
`Character
`One position
`down
`down <Finger Down -
`Hold>
`<Finger Up>
`
`Scroll
`
`One position
`up
`up <Finger Up -
`Hold>
`
`Scroll
`
`IPR2022-00602
`Apple EX1033 Page 10
`
`

`

`5
`
`10
`
`15
`
`20
`
`WO 02/27455
`
`PCT/NO0l/00385
`
`9
`
`Screen Manipulation Commands
`to <Slanted Down
`Shift
`vertical
`Left>
`fields
`
`<Finger
`Right/Left>
`
`<Finger
`Up/Down>
`
`Toggle
`horizontal
`fields
`Toggle
`to <Slanted Up
`Shift
`horizontal
`vertical
`Right>
`fields
`fields
`to/from Edit Text Mode <Extra Long Tap> - <Finger
`Down>
`
`Toggle
`
`End of Text <Slanted Down
`Field Right>
`
`Edit Text Commands
`Toggle
`to/from
`Home of Text <Slanted Up
`See Screen
`Field Left>
`Edit Mode Manip.
`Commands
`Mark n <Long Tap> + n
`characters
`<Short Taps>
`left
`Mark n words <Long Tap>+ n
`left
`<Finger Left>
`Shift marked <Long Tap>
`letters'
`case
`Delete marked <Extra Long
`character(s)
`Tap>
`
`Move one <Finger Left>
`position
`left
`Scroll
`left
`
`-
`
`<Finger Left
`Hold>
`Move one <Finger Right>
`position
`right
`right
`
`Scroll
`
`One line
`
`Scroll
`
`<Finger Right
`Hold>
`up <Finger Up>
`
`-
`
`up <Finger Up -
`Hold>
`
`One line
`
`Scroll
`
`down <Finger Down> Write
`
`down <Finger Down -
`Hold>
`
`Copy marked <Double Tap>
`character(s)
`Paste marked Two <Double
`character(s)
`Taps>
`Insert
`space <Short Tap>
`right
`of
`cursor
`to right Exit Edit
`to
`of cursor
`Input Mode
`
`IPR2022-00602
`Apple EX1033 Page 11
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`10
`
`Shift
`
`Global Commands
`Input
`<Circular
`Mode
`Finger Move>
`
`Toggle Edit
`Text
`End of Text
`Input
`
`See Screen
`Commands
`Two <Extra Long
`Tap>
`
`Sign Language Commands
`<Circular
`Finger Move> brings
`up Command Field w/ Sign
`Language Mode. <Double Tap>
`to select.
`Then use <Finger
`Down/Up> for Chinese,
`Japanese
`or Korean signs
`
`Table 3a
`MODE LEVEL 1
`·Device
`Automatically
`set by the
`ACCESS CONTROL MODE TEXT INPUT MODES CURSOR CONTROL
`MODE
`For cursor
`navigation
`display
`
`5
`
`10
`
`15
`
`sensor
`Fingerprint
`for
`used
`User Authentication
`
`See Table 3b
`"Mode Level 2"
`
`on
`
`Table 3b
`MODE LEVEL 2
`Text
`Input Modes,
`User-selected
`by Finger Commands
`Input Categories
`Alphabetic
`Languages
`
`20
`
`Input
`Device
`
`On Display
`by Finger
`Commands
`
`Draw on
`Sensor
`directly
`
`Latin
`alphabet
`Greek
`
`NA
`
`Special
`Operations
`
`Mathematics
`
`Sign-
`based
`Languages
`Chinese
`Japanese
`Korean
`
`Chinese
`Japanese
`Korean
`
`benefit
`An important
`significantly
`increased
`applications)
`as per
`fig.
`1 is
`replaced
`by a single
`by e.g.
`two function
`keys.
`The most
`important
`benefit
`
`25
`
`invention
`the
`of
`size
`(e.g.
`display
`the
`larger
`2, as
`sign-generator
`
`it allows
`that
`is
`for WAP
`keyboard of fig.
`button
`supplemented
`
`from the
`
`invention
`
`is,
`
`IPR2022-00602
`Apple EX1033 Page 12
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`11
`
`of
`
`the
`
`and flexibility
`full versatility
`it provides
`that
`however,
`device. This
`multiple-function
`of
`input by a single-button
`a sensor with.navigation
`means
`is achieved
`by supporting
`(due to
`its
`capability
`to register
`lateral
`finger movements
`5 as per
`fig.
`4) with Finger Movement Categories
`defined
`in
`Table 1 combined with
`the Finger Command Structure
`per Table
`2 and the
`Input Modes & Categories
`as per Tables 3a & 3b.
`This versatility
`and flexibility
`of
`input by such a
`single-button
`key will be described
`by two examples. The
`first
`example comprises
`text
`input by Latin
`letters
`to e.g.
`a cellular
`phone with a large display
`and a minimum
`switch
`keyboard,
`as shown in fig.
`2. The cellular
`phone will
`the single-button
`sign-generator
`system
`the
`text
`input
`to
`mode (Level 1 in Table 3a) as response
`to user
`selection
`15 e.g. SMS (Short Message system).
`Thereby
`the
`translation
`Sa
`means 4 arranges
`the display
`5 typically
`as shown in fig.
`comprising
`vertical
`selection
`field
`8 and horizontal
`command
`field
`9. The user may conveniently
`shift
`between
`the
`vertical
`and horizontal
`fields
`by finger
`commands <Slanted
`20 Down Left>
`and <Slanted Up Right> 10, as per
`the embedded
`Finger Command Structure
`in
`the
`translation
`means 4.
`In this
`example
`the user will use Latin
`letters
`and Arab numbers
`for
`the
`text
`input.
`This
`is
`the default
`text
`input mode, and the
`user does
`therefore
`not need
`to shift
`to
`the horizontal
`command field
`for change of
`input mode, but he can directly
`start
`generating
`text by finger
`commands to
`the vertical
`selection
`field
`8. Fig. Sb illustrates
`a number of
`this
`in
`alternative
`character
`sets of the selection
`field
`is
`set
`mode. When he starts
`generating
`text
`the default
`capital
`Latin
`letters,
`displaying
`letter A in the marked
`middle position
`of the vertical
`selection
`field.
`Say the
`user
`first wants
`to
`input an E as
`the
`first
`character.
`He
`then moves his
`finger
`down and keeps
`it
`still
`on the switch
`1. This
`starts
`scrolling
`the vertical
`s~lection
`field. When
`E has been brought
`to
`the marked middle
`the character
`position
`the user <Double Taps> on the switch,
`selecting
`required
`letter
`E and printing
`it
`in
`the display
`5. This
`selection
`automatically
`switches
`the character
`set of the
`vertical
`selection
`field
`to minor
`letters.
`The user
`then
`
`10
`
`25
`
`30
`
`35
`
`IPR2022-00602
`Apple EX1033 Page 13
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`12
`
`10
`
`20
`
`to
`according
`the sensor,
`up or down over
`finger
`wipes his
`the next
`required
`character.
`the position
`in the alphabet
`of
`If he wants
`to move a single
`character,
`or
`just
`a few
`characters,
`he moves his
`finger
`once or several
`times up or
`5 down. If
`the next character
`is a larger
`number of positions
`in
`away, he moves his
`finger
`the desired
`direction
`and then
`holds
`the
`finger
`still
`on the switch
`to start
`scrolling
`in
`the desired
`direction.
`The scrolling
`halts when he lifts
`his
`finger
`from the switch 1. If
`the user needs other
`character
`sets,
`he simply gives
`finger
`commands 14 <Finger Left> or
`<Finger Right>,
`e.g.
`to
`insert
`numbers,
`special
`characters
`or
`to use capital
`letters
`again
`(e.g.
`for a name). Word
`separation
`may be done by finger
`command <Long Tap> and
`period
`( ''punctum") may be entered
`as two consecutive
`<Long
`15 Taps>,
`etc. The user may at any time
`toggle
`to Edit Text
`Mode by finger
`command sequence <Extra
`long Tap> - <Finger
`Down> as per Table 2. End of Message may be given by finger
`command sequence
`comprising
`two consecutive
`<Extra Long
`Taps>.
`is switched
`(when the device
`input
`text
`this
`to
`Prior
`sets
`the switch 1 to authenti(cid:173)
`automatically
`ON) the device
`to
`the cellular
`phone. The
`cation mode for access
`control
`user
`is
`then asked by text on the display
`to wipe his
`finger
`down over
`the sensor. When authentication
`by finger
`print
`25 biometrics
`is completed,
`the cellular
`phone sets
`the sign(cid:173)
`generator
`to sleep mode, for energy
`saving. The sign(cid:173)
`generator
`is
`then waked up e.g. when a request
`for
`the sign(cid:173)
`generator
`is called
`for,
`e.g. by SMS input as per
`the above
`example.
`If
`the user wants
`to play a game on the device,
`its
`control
`system sets
`the switch 1 to Cursor Control Mode as
`per Table 3a. Two-dimensional
`finger moves combined with
`combined
`finger
`command sequences
`(such as taps,
`etc.)
`thereby
`gives
`an accurate
`cursor
`control
`combined with
`numerous command functions
`for quite
`complex games. This
`example demonstrates
`that
`the
`invention
`is capable of
`rendering
`full
`input versatility
`and flexibility
`even
`through
`a single-button
`sign-generator,
`thereby
`enabling
`use of a large display
`as exemplified
`in fig.
`2 still
`maintaining
`full
`functionality.
`
`30
`
`35
`
`the
`
`IPR2022-00602
`Apple EX1033 Page 14
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`13
`
`5
`
`10
`
`15
`
`invention
`the
`of
`the versatility
`example of
`Yet another
`to mathe(cid:173)
`in fig.
`6. This example pertains
`illustrated
`is
`matical
`calculation
`on a palmtop PC, but may as well be
`embodied
`in cellular
`phones or PDAs. For such calculations
`the applicable
`Finger Command Structure
`set will
`be limited
`to
`taps on multiple
`selection
`fields
`as per Table 1, while
`lateral
`finger movements
`is
`reserved
`for cursor
`control.
`Fig.
`6a illustrates
`a palmtop PC set
`to Calculation
`Mode
`(arithmetic)
`in which mode the display
`5 contains
`another
`type of vertical
`selection
`field
`16 and another
`horizontal
`selection
`field
`17. The vertical
`selection
`field
`16 contains
`all
`numbers
`from Oto
`9, plus decimal point
`(,) as
`illu(cid:173)
`strated
`in
`fig.
`6b. The horizontal
`selection
`field
`17
`comprises
`in
`this mode the arithmetic
`operators
`(+,
`-, * ,
`/) plus Clear All
`(CA11 ), Clear Memory (McieaiJ, add to memory
`(M+), subtract
`from memory (M-), square
`root
`(v) and n th power
`(n),
`etc as
`illustrated
`in fig.
`6c.
`In this mode the
`lateral
`finger
`commands are mainly
`reserved
`for cursor
`control.
`This
`means
`that when the
`finger
`is moved laterally
`over
`the
`5. An
`sensor
`1,
`the cursor moves accordingly
`on the display
`on the
`arithmetic
`formula
`such as "972 * 3 = ?"
`is generated
`the
`display
`5 by moving
`the cursor
`by finger movements
`to
`number "9"
`in
`the vertical
`selection
`field
`16 and <Double
`selection,
`Tap> for
`cursor
`is
`then moved to "7" and
`selected,
`the cursor
`then moved to "2" and selected.
`The
`the"*"
`cursor
`then moved by lateral
`finger
`command to
`is
`sign of
`the horizontal
`field
`17 and selected
`by <Double
`Tap>,
`then back
`to
`the vertical
`selection
`field
`16 over
`by <Double Tap>. The user
`then
`number
`"3" and selected
`30 presses
`<Extra Long Tap> which produces"="
`on the display,
`starts
`the calculation
`and prints
`the
`result
`"2.916"
`on the
`display.
`Other character
`subsets
`of
`the vertical
`selection
`field
`16 may be incorporated.
`Navigation
`by fingerprints
`inside
`the
`selection
`fields may be initiated
`by finger
`command <Short Tap> when cursor
`the
`is positioned
`within
`vertical
`selection
`field
`to
`temporarily
`disengage
`the cursor
`control
`by finger
`commands. Then the user may shift
`character
`sets of
`the vertical
`selection
`field
`16 by <Finger
`Left> or <Finger Right>
`commands
`(as per
`fig.
`Sb). When the
`
`20
`
`25
`
`35
`
`IPR2022-00602
`Apple EX1033 Page 15
`
`

`

`WO 02/27455
`
`PCT/NO0l/00385
`
`14
`
`to
`
`can
`
`to
`
`by
`control
`the cursor
`set has been activated
`new character
`by
`commands on the switch 1·can be re-engaged
`lateral
`finger
`pressing
`another <Short Tap>. The horizontal
`selection
`field
`may in
`the same way be changed
`to other
`subsets
`of
`s mathematical
`operators.
`This
`is done by placing
`the cursor
`in
`the horizontal
`selection
`field,
`pressing
`<Short Tap> to
`disengage
`the cursor
`control,
`use finger
`commands <Finger
`Up> or <Finger Down> to select
`other
`subsets,
`and finally
`re-engage
`the cursor
`control
`by pressing
`<Short Tap>. This
`embodiment of
`the
`invention
`enables
`a versatile
`and flexible
`handling
`of calculation
`mode on the display,
`still
`operated
`by a single-button
`switch 1.
`around 30 standard
`contains
`While
`the Latin
`alphabet
`letters,
`sign
`languages
`are composed of hundreds of
`used.
`thousands
`of signs
`though
`some of them may be rarely
`The large
`number of such signs
`compared
`to
`the number of
`standard
`alphabetic
`letters
`represents
`q major problem of
`representing
`such signs