(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
`
`(19) World Intellectual Property Organization
`International Bureau
`
`1111111111111111 IIIIII IIIII IIII I 111111111111111111111111111111111111111111111111
`
`(43) International Publication Date
`4 April 2002 (04.04.2002)
`
`PCT
`
`(10) International Publication Number
`WO 02/28067 At
`
`(51) International Patent Classification 7:
`G06F 3/00
`
`H04M 1/247,
`
`(21) International Application Number: PCT/NO0l/00384
`
`(72) Inventor; and
`(75) Inventor/Applicant (for US only): MATHIASSEN,
`Camilla [NO/NO]; Homansbyveien 4, N-1389 Heggedal
`(NO).
`
`(22) International Filing Date:
`20 September 2001 (20.09.2001)
`
`(74) Agent: ABC-PATENT, SIVILING. ROLF CHR. B.
`LARSEN A.S; Brynsveien 5, N-0667 Oslo (NO).
`
`(25) Filing Language:
`
`(26) Publication Language:
`
`English
`
`English
`
`(30) Priority Data:
`20004863
`
`27 September 2000 (27.09.2000) NO
`
`(81) Designated States (national): AE, AG, AL, AM, AT, AU,
`AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU,
`CZ, DE, DK, DM, DZ, EC, EE, ES, Fl, GB, GD, GE, GH,
`GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC,
`LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW,
`MX, MZ, NO, NZ, PH, PL, PT, RO, RU, SD, SE, SG, SI,
`SK, SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU,
`ZA, ZW.
`
`(71) Applicant (for all designated States except US): BIO(cid:173)
`PRINT AS [NO/NO]; Gaupeveien 21, N-8515 Narvik
`(NO).
`
`(84) Designated States (regional): ARIPO patent (GH, GM,
`KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian
`
`[Continued on next page]
`
`iiiiiiiiiiiiii
`iiiiiiiiiiiiii
`
`== (54) Title: METHOD AND SYSTEM FOR INPUTTING CHARACTERS
`iiiiiiiiiiiiii ==
`iiiiiiiiiiiiii -==
`!!!!!!!! --
`
`(57) Abstract: Method and system for generating complex text input by sequences
`of finger touches on a single sign generator in cellular phones including a display
`and a sign generator, the sign generator including a finger touch sensitive sensor
`being adapted to sense movements in at least one dimension, analysing means, and
`translation means, measuring omni-directional finger movements across the sen(cid:173)
`sor in two dimensions, using the analysing means for categorising omni-directional
`finger movements across the sign generator according to predefined sets of finger
`movement sequences including directional and touch/no-touch finger movement
`sequences, using the translating means including uniquely defined command table
`for translating the categorised finger movements into signals controlling the display
`as results of the finger movements on the sensor.
`
`iiiiiiiiiiiiii
`
`iiiiiiiiiiiiii =
`
`5
`
`ASSA ABLOY Ex. 1004 - Page 1
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067 Al
`
`1111111111111111 IIIIII IIIII IIII I 111111111111111111111111111111111111111111111111
`
`patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European
`patent (AT, BE, CH, CY, DE, DK, ES, Fl, FR, GB, GR, IE,
`IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF,
`CG, CI, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD,
`TG).
`
`Published:
`with international search report
`
`before the expiration of the time limit for amending the
`claims and to be republished in the event of receipt of
`amendments
`
`For two-letter codes and other abbreviations, refer to the "Guid(cid:173)
`ance Notes on Codes and Abbreviations" appearing at the begin(cid:173)
`ning of each regular issue of the PCT Gazette.
`
`ASSA ABLOY Ex. 1004 - Page 2
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`Method and system for inputting characters
`
`5
`
`This invention relates to a sign/character generator
`represented by a fingerprint sensor with navigation means,
`for text/sign input to information and communication devices
`with displays, like set-top boxes, cellular phones, palmtop
`PCs, PDAs, etc.
`The present information society provides the users with
`an increasing number of information and communication
`10 devices for numerous purposes, and the use of such
`information and communication devices are expected to
`accelerate both in types of devices and the number of users
`of the respective devices.
`Most of these information and communication devices
`15 contains, or give access to privileged and/or sensitive
`information. This accentuates the need for access control by
`identity verification of the user. This has traditionally
`been handled by passwords or PIN codes. However, these are
`not personal as they can be given to other persons by the
`owner, or stolen from the owner. Accordingly there is a
`strong trend to base access control on biometrics which is
`mathematical description of characteristic elements of the
`owner's body or behaviour that can not be separated from
`this person, and which describes him uniquely. Many forms of
`25 biometrics for identity verification is available, but the
`dominating type of biometrics appear to be fingerprints as
`it uniquely defines the person, is easy to scan and is not
`feel to intrude the user's privacy. Hence many types of
`fingerprint sensors have been made. One such fingerprint
`sensor is described in EP 735.502.
`Implementation of such sensors in information and
`communication devices on an industrial scale with large
`volumes is in most cases pending the benefits established
`through a cost versus benefit analysis. It is also in many
`35 cases a question of available space on the device. The
`utilisation of such identity verification devices as e.g.
`fingerprint sensors will therefore be significantly enhanced
`if it can be combined with other functionality, and
`
`20
`
`30
`
`ASSA ABLOY Ex. 1004 - Page 3
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`2
`
`5
`
`especially if it thereby can replace other devices. These
`two aspects will be illustrated for some typical information
`and communication devices below.
`Cellular phones normally contain a reduced keyboard,
`typically as shown in fig. 1. Such reduced keyboards have
`far less keys than the letters, characters and signs
`required to input complex text messages. This is partly
`resolved by assigning several characters to each key, as
`illustrated in fig. 1. However, even with a multiple
`10 character representation on such reduced keyboards, the
`number of keys are so limited that it poses a significant
`constrain on available characters/signs that can be
`represented on such reduced keyboard.
`Some solutions have been introduced, but they generally
`15 do not provide sufficient cost/benefit ratio and
`functionality to effectively penetrate the market. One
`example is a full QWERTY keyboard provided by the cellular
`phone manufacturer Ericsson. However, this external keyboard
`is large and expensive and counteracts the general trend to
`20 make cellular phones increasingly more compact, lighter and
`cheaper.
`Another known solution is the Nokia Naviroller™ in
`which a mechanical barrel on the front panel is rolled by
`the finger, bringing up a vertical column of signs and
`25 characters on the display. Selection of a particular sign or
`character is performed by mechanically pressing down the
`barrel. In practice this is not a faster solution than
`moving the finger from key to key and pressing the selected
`key one or multiple times. The Naviroller™ solution also
`imposes a serious constrain on cursor movements as it limits
`cursor control to one dimension; <UP> and <down>, except for
`pressing the barrel for character selection.
`Tegic Communications has developed a system called T9™
`whereby software logic search for legal letter combinations
`35 of a particular language, thereby minimising the multiple
`presses of any key representing multiple characters, as
`shown in fig. 1. This is an elegant solution as the number
`of finger taps is presumably significantly reduced, but the
`negative aspect is that it requires a translation program
`
`30
`
`ASSA ABLOY Ex. 1004 - Page 4
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`3
`
`for each language, and that these must be stored in the
`phone memory. Motorola is said to have developed a similar
`solution, called iTap™, thus having the same problems.
`Sign handling of another known type is the Zia™
`5 provided by ZiCorp, to facilitate character input by Chinese
`signs through a reduced keyboard as per fig. 1. The zi a™
`solution is based on the fact that Chinese signs are
`composed of so-called basic strokes, which sequence defines
`a particular sign. These basic strokes are assigned to the
`10 keys, much in a similar way as the letters are assigned to
`the number keys, as shown in fig. 1. This solution enables
`input of Chinese characters by a regular cellular phone
`keyboard, as per fig. 1, but does not resolve the main
`problems of using a keyboard for sign/character input to a
`15 cellular phone. A keyboard is still required, and due to
`size limitations it normally contains far less keys than the
`characters/s~gns required to compose a meaningful message.
`The finger therefore has to be moved around the keyboard,
`and each key may need to be pressed down mechanically
`20 multiple times to select a message.
`us 5,982,303 describes a joystick to feed characters,
`numbers and function categories into a processor. The
`method according to this publication may be use to write
`non-latin signs and to control a cursor. The publication
`25 mentions the use of eight keys for providing the control
`signals and represents a large and complicated solution. A
`·similar solution is described in US 4,680,577.
`It is an object of this invention to provide a simple
`solution for feeding information into a small unit, e.g. a
`30 cellular phone, by using sensors which have already been
`provided for other purposes.
`US 5,088,070 describes the use of several dedicated
`switches on a wrist watch. Although it is more compact than
`the abovementioned solution it still represents an
`35 unnecessary large structure on the limited available space.
`us 6,057,540 describes an optical sensor with
`navigation utilities.
`It 1 s dimensions and complexity,
`however, makes unsuitable for usse in mobile phones and
`similar. Also, as the sensor described here preferably uses
`
`ASSA ABLOY Ex. 1004 - Page 5
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`4
`
`10
`
`a 16x16 pixel matrix it is not suitable for use as a
`fingerprint sensor, since the resolution is unsufficient.
`US 5,608,395 describes a telegraph key connected to a
`computer for writing text. The characters are organized in
`5 a hierarchy for demanding a minimum memory for choosing each
`character. This solution is also to complicated and large
`and does not have the advantage of usin~ existing sensors in
`modile phones or similar.
`The above illustrates the present situation for
`information/communication devices (such as cellular phones),
`where complex text input is cumbersome as such input has to
`be generated through the limited keyboard of fig. 1. The
`next generation of cellular phones comprises so-called WAP
`phones with Internet access. In general this development
`15 calls for increased displays, for better readability of more
`complex information. Preferably increased display size
`should not increase the cell phone size. The most viable way
`to increase display size without increasing the phone size
`will be to reduce the keyboard size to maximum one row of
`20 keys, but still enabling complex text input to the cellular
`phone. None of the above solutions will function
`satisfactorily with such a minimal "keyboard", as
`illustrated in fig.2.
`Identical problems are encountered for small handheld
`25 PCs (so-called palmtops) and for PDAs. Also for these
`devices it is a general desire to increase the display size,
`without increasing the overall dimensions of the device.
`This can only be achieved by using minimum keyboard size.
`Various solutions have been implemented to eliminate the
`30 keyboard, but they are all associated with serious negative
`effects. One solution is to provide the palmtop or PDA with
`a touch-screen, but such screens are more expensive than
`regular displays. Another known solution is to provide the
`palmtop or PDA with a special pen to write on
`the screen.
`35 However, such pens are expensive, they may easily be lost,
`and they generally require that writing is done according to
`predefined sequences of sign elements that must be drawn
`within fairly narrow boundaries of shap~.
`Similar problems are also encountered for set-top boxes
`
`ASSA ABLOY Ex. 1004 - Page 6
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`5
`
`for television sets connected to cable TV for pay-per-view
`applications. For such set-top boxes the TV screen may be
`used as communication interface (e.g. for search for infor(cid:173)
`mation and ordering of films) but this requires a keyboard.
`5 Such an extra keyboard for the TV increases the costs, and
`represents yet another external device that normally clashes
`with the design of the TV, and needs to be stored nearby the
`TV. The ideal solution would be to have a single-button
`keyboard incorporated in the set-top box, which may be used
`10 both for input of complex text and for identity
`verification, e.g. if minors shall be barred from ordering
`X-rated movies, etc.
`Similar problems are also encountered for automobiles
`increasingly being equipped with computers for navigation
`15 purposes, for selection of entertainment, etc. Such
`applications require communication interface between the
`driver and the on-board computer. In a car the use of a
`keyboard is not tempting as its use will distract the
`driver's attention from the traffic situation, and may be
`20 hazardous. Apparently voice control could be an elegant
`solution, but this seems to be impractical due to the
`general noise level in a car. It will also require
`implementation of voice commands in many languages, as most
`car models are made for the international market, thereby
`requiring extensive memory capacity in the onboard computer,
`which in turn adds logistics requirements and costs.
`For laptop PCs the problem is different, as they
`normally have integrated full-fledged QWERTY keyboard. As
`one of their primary functions is to enable fast and complex
`text input, replacing the keyboard with single-button text
`input device would be counterproductive. However, such
`laptops are normally furnished with a cursor navigation
`control in the form of a touch-pad. It is highly desirable
`to provide these laptops with fingerprint sensor for access
`35 control, both for securing sensitive information contents
`and to discourage theft of such expensive devices. In this
`context it will be desirable to combine such a touch-pad and
`fingerprint sensor, if technically possible, for cost and
`space reasons.
`
`30
`
`25
`
`ASSA ABLOY Ex. 1004 - Page 7
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`6
`
`5
`
`Thus it is an objective of this invention to provide a
`sign generator for information and comm~nication devices
`equipped with a display, as outlined above. such sign
`generator shall be capable of generating complex text input
`in a fast and convenient way through a single-button
`"keyboard". It shall further be able to execute accurate
`cursor control on the display providing full touch-pad
`functionality, and shall incorporate fingerprint scanning
`for authentication. This objective is obtained by a sign
`10 generator based on combining a fingerprint sensor having
`navigation means, with analysing/interpreting means and
`translation means as described in claims 1 and 9.
`The invention will be described below by way of
`examples and with reference to the accompanying drawings.
`Figure 1 illustrates a traditional reduced keyboard for
`cellular phones, with multi-character keys.
`Figure 2 illustrates schematically an information/(cid:173)
`communication device, equipped with a large display and a
`single sign-generator key as part of a minimum "keyboard".
`Figure 3 illustrates the invention schematically.
`Figure 4 illustrates categories of finger movements in
`two dimensions.
`Figure 5 illustrates how to operate text input by
`selecting characters on the display, by finger commands.
`Figure 6 illustrates. the stroke hierarchy for Chinese
`signs, and the representation of reduced strokes on a small
`keyboard.
`Figure 7 tabulates stroke/sign hierarchy of Chinese
`signs.
`Figure 8 illustrates how to operate in calculation mode
`by finger commands on a palmtop PC.
`Figure 9 illustrates a typical example of embodiment in
`set-top boxes.
`Figure 10 illustrates a typical example of embodiment
`in automobiles.
`First the principle of the invention will be described,
`followed by description of some typical applications. The
`principle of the invention is illustrated schematically in
`fig. 3. A touch sensitive switch 1, in the form of a
`
`15
`
`20
`
`25
`
`30
`
`35
`
`ASSA ABLOY Ex. 1004 - Page 8
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`7
`
`10
`
`fingerprint sensor with navigation means, is coupled to
`analysing means 2. The analysing means measures the
`duration, direction and speed of finger moves on the switch,
`and categorises the signal from the switch into categories.
`5 The classified categories of data are stored in a memory 3
`and are compared by a translation means 4 with predefined
`tables relating categories of finger moves and sequences
`thereof to readable characters/signs. The signs
`corresponding to these categories and sequences are then
`shown in the display 5 in a known manner. The form in which
`the data are presented on the screen, and how text input is
`interacted by the user is controlled by the translation
`means 4.
`The touch sensitive switch 1 may in its simplest form
`15 be a simple on/off touch sensitive switch. In this case the
`system will register the duration of the finger touches, as
`well as the disconnection periods in order to distinguish
`between periods between the signals, periods between
`complete characters/signs and periods between words.
`The connection categories may be selected by measuring
`the connection period tm and comparing them tmoff with
`predefined limits according to defined sets of finger
`commands. The system comprises lower and upper limits for
`being registered as a signal. Signals being shorter than the
`lowest limit defined as treg may be ignored to avoid errors
`caused by accidental touches of the switch 1 e.g. due to
`handling of the information/communication device. Connection
`periods longer than the predefined limits may also be
`ignored, or may be classified as a separate code, for
`example "End of message". In addition long disconnects may
`be registered as periods between signs. Table 1 defines
`typical time limits.
`
`20
`
`25
`
`30
`
`ASSA ABLOY Ex. 1004 - Page 9
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`8
`
`Time Ranges
`O,OOls < tReg< 0,100S
`
`1,5 tReg < toff < 50, OtReg
`
`5
`
`1, 5 tRea< tshort < 50, OtRea
`1, Stshort< tLona < 5, Otshort
`1, 5tr,n~N<
`lQ I OtT,nnN
`t'O'v!-~~<
`
`Table 1
`Norn. Values Meaning
`tReg: 0,01s
`Reg.
`limit
`Sign
`Sep.
`Dot
`Dash
`Period
`
`toff = 0,25s
`tshort = o,2ss
`tLona = o,50s
`tn .. ~-- > 0,75s
`
`Type
`Basic/Non-
`adapt
`Adaptive
`
`Adaptive
`Adaptive
`Aa.aptive
`
`10
`
`The time limits of Table 1 above may of course be
`chosen otherwise. A particular embodiment of the invention
`is to set the above ranges dynamically to adapt to the
`user's skills and his learning curve in using the invention.
`This may be done by registering the e.g~ SO last commands of
`each type, and calculating the arithmetic mean and standard
`deviation. The statistics may be based upon any written text
`15 or a predetermined learning sequence, and may be used to
`shift the category definitions according to the speed of the
`user, and thus also adapt as the user learns the system and
`increases his input speed.
`The touch-sensitive switch 1 may in its simplest form
`20 be a simple on and off touch sensitive switch. However, th.is
`is insufficient relative to the objective of the invention
`to provide combined user authentication by finger print
`biometrics, accurate cursor control and fast, versatile and
`flexible text input, all served by the very same single-
`25 button sensor. The preferred embodiment of the invention
`must therefore provide a fingerprint sensor with navigation
`means where the switch is also capable of registering
`lateral finger movements on the switch. A known sensor is
`described in EP 735.502, which describes a line shaped
`fingerprint sensor. The fingerprint sensor described in this
`patent publication scans the fingerprint, and in order to be
`able to analyse the finger print, is able to detect the
`finger movement across the sensor in one dimension; <Up> and
`<Down>. Such one-dimensional finger movement detection may
`35 be expanded to two-dimensional finger registering by
`arranging some of the sensor elements as per fig. 4. This
`may for example be obtained by using two orthogonal sensors
`of the type shown in the EP publication mentioned above. The
`
`30
`
`ASSA ABLOY Ex. 1004 - Page 10
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`9
`
`5
`
`15
`
`figure illustrates categories of lateral finger movements
`that are used to build finger commands, either by basic
`finger moves, or combinations thereof. Fig. 4 defines ten
`lateral finger movement categories (in addition to vertical
`taps); eight directions of movements and two circular
`movements (clockwise and counter-clockwise). These may also
`be combined with time measurements to calculate the velocity
`of a movement, thus providing a number of differing
`categories from one single finger movement. All the finger
`10 movements (on/off sensor, vertical taps, lateral linear and
`circular movements), their duration and speed are
`categorised in the analysing/interpretation means 2.
`Such a touch-sensitive switch comprising a finger print
`sensor with navigation means enables the invention to use
`comprehensive and intuitive sets of finger commands in the
`interpretation/translation means 4. Combined finger commands
`can be made from sequences of basic finger movements.
`As the touch-sensitive switch will.serve m~ltiple
`purposes in a combined function, as per the objective of the
`invention above, a finger command structure is required that
`is applicable to all functions to be served, including
`versatility of the input modes. Moreover the finger command
`structure must be intuitive within each mode, to avoid the
`need for memorising complex finger commands. Such a finger
`command structure is exemplified in Table 2 below. This
`finger command structure is a key element of the invention,
`and represents a basic element of the translation means.
`The analysing means can be set by finger commands to
`alternative modes, where the default is Display Mode,
`30 another may be Sign-based language input (e.g. Chinese
`signs), etc. The Input Modes are shown schematically in
`fig. 4.
`
`20
`
`25
`
`ASSA ABLOY Ex. 1004 - Page 11
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`10
`
`Table 2 Finger Command Structure
`Di.SDlay MoQe CommanQs
`Verti.cal Screen Input
`Horizontal Screen Input
`Commands
`Commands
`(One-character wide vertical (One-line high Command Fields
`selection Fields)
`or Ootion Fields)
`Select <Double Tap>
`Select <Double Tap>
`Character
`Command/option
`One position <Finger Down>
`One 1ine aown <Finger Down>
`down
`Scroll down <Finger Down
`- Hold>
`One position <Finger Up>
`up
`Scroll up <Finger Up -
`Hold>
`
`Scroll down <Finger Down
`- Hold>
`One line up <Finger Up>
`
`Scroll up <Finger Up -
`Hold>
`
`Screen Mani.DU Lation Commands
`Togg.Le to <Slanted Down Shirt vertical <Finger
`horizontal Left>
`fields Right/Left>
`fields
`Toggle to <Slanted Up
`vertical Right>
`fields
`Toggle to/from Edit Text
`Mode
`
`Shirt <Finger
`horizontal Up/Down>
`fields
`<Extra Long Tap> - <Finger
`Down>
`
`5
`
`10
`
`15
`
`20
`
`ASSA ABLOY Ex. 1004 - Page 12
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`11
`
`End ot Text <S.Lanted Down
`Field Right>
`
`Edit Text CommanCLs
`Home of Text <S.Lanted Up
`Togg.Le to/trom See Screen
`Field Left>
`Edit Mode Manip.
`Commands
`Mark n <Long Tap> + n
`characters <Short Taps>
`left
`Mark n words <Long Tap>+ n
`left <Finger Left>
`Shift marked <Long Tap>
`letters' case
`De.Lete marked <Extra Long
`character(s} Tap>
`
`Move one <Finger Left>
`position left
`scroll lett <Finger Lett
`- Hold>
`Move one <Finger
`position Right>
`right
`Scroll right <Finger Right
`- Hold>
`one line up <Finger Up>
`
`5
`
`10
`
`Copy marked <Double Tap>
`character(s)
`Paste marked Two <DOUD.Le
`character(s) Taps>
`Insert space <Short Tap>
`right of
`cursor
`Write to right Exit Edit to
`of cursor Input Mode
`
`rings
`Move>
`<Circ
`up Command Field w/ Sign
`Language Mode. <Double Tap>
`to select. Then use <Finger
`Down/Up> for Chinese,
`Japanese or Korean signs
`
`Scroll up <Finger Up -
`Hold>
`
`15
`
`One line down <Finger Down>
`
`Scrol.L down <Finger Down
`- Hold>
`
`Input <Circu ar
`Mode Finger Move>
`
`20
`
`See Screen
`Commands
`Two <Extra
`
`ASSA ABLOY Ex. 1004 - Page 13
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`12
`
`This embodiment of the invention, comprising a single(cid:173)
`button input device for multiple input modes uses
`"universally defined" finger command structures embedded in
`the translation means, ensuring that the sign generator
`5 provides the required input type in the respective input
`modes of the information/communication devices. The input
`modes are arranged in a hierarchy. Level 1 is shown in Table
`3a. This is the overall mode level, where input mode
`alternative is set by the information/communication device.
`10 There is a fourth mode in addition to the three modes shown
`in Table 3a, namely Sleep Mode for minimum power consumption
`while sensor do not need to be active.
`
`Table 3a
`15 MODE LEVEL 1
`Automatically set by the Device
`TEXT INPUT MODES
`ACCESS CONTROL
`MODE
`Fingerprint
`sensor used for,
`User
`Authentication
`
`See Ta.ble 3.b
`"Mode Level 2"
`
`20
`
`CURSOR CONTROL MODE
`
`For cursor
`navigation on
`display
`
`Table 3b
`MODE LEVEL 2
`25 User selected by Finger Commands from Text Input Modes
`In~ut Cateaories
`Alphabetic
`Languages
`
`Special
`Operations
`
`Input
`Device
`
`Sign-
`based
`Lanauaaes
`On Display Latin alphabet Chinese Matnematics
`by Finger Greek alphabet Japanese
`Korean
`Commands
`Arabic
`cninese Alternative
`Japanese
`codes
`Korean
`
`Draw on
`Sensor
`directly
`
`NA
`
`30
`
`The Finger Movement Categories defined in Table 1
`combined with the sensor element configuration as per fig. 4
`and the Finger Command Structure per Table 2 and the Input
`
`ASSA ABLOY Ex. 1004 - Page 14
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`13
`
`15
`
`Modes & Categories as per Tables 3a & 3b allows full
`versatility and flexibility of input by a single-button
`multi-function device.
`The utilisation of this functionality of the single-
`s button sensor will be demonstrated by two examples of text
`input generation; generating text input by Latin letters by
`the display, controlled by Finger Commands and generating
`text input by Chinese signs by drawing basic strokes
`directly on the sensor. These examples will be followed by
`10 description of the invention used for some typical
`applications.
`The first example comprises text input by Latin letters
`to e.g. a cellular phone with a large display and a minimum
`keyboard, as shown in fig. 2. The cellular phone will switch
`the single-button sign-generator system to the text input
`mode (Level 1 in Table 3a) as response to user selection of
`e.g. SMS (Short Message system). Thereby the translation
`means 4 arranges the display 5 typically as shown in fig. Sa
`comprising vertical selection field 8 and horizontal command
`field 9. The user may conveniently shift between the
`vertical and horizontal fields by finger commands <Slanted
`Down Left> and <Slanted Up Right> 10, as per the embedded
`Finger Command Structure in the translation means 4. In this
`example the user will use Latin letters and Arab numbers for
`the text input. This is the default text input mode, and the
`user does therefore not need to shift to the horizontal
`command field for change of input mode, but he can directly
`start generating text by finger commands to the vertical
`selection field 8. Fig. Sb illustrates a number of
`30 alternative character sets of the selection field in this
`mode. When he starts generating text the default set is
`capital Latin letters, displaying letter A in the marked
`middle position of the vertical selection field. Say the
`user first wants to input an E as the f~rst character. He
`then moves his finger down and keeps it still on the switch
`1. This starts scrolling the vertical selection field. When
`the character E has been brought to the marked middle
`position the user <Double Taps> on the switch, selecting the
`required letter E and displaying it in the display 5. This
`
`20
`
`25
`
`35
`
`ASSA ABLOY Ex. 1004 - Page 15
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`14
`
`5
`
`10
`
`selection automatically switches the character set of the
`vertical selection field to minor letters. The user then
`wipes his finger up or down over the sensor, according to
`the position in the alphabet of the next required character.
`If he wants to move a single character, or just a few
`characters, he moves his finger once or several times up or
`down. If the next character is a larger number of positions
`away, he moves his finger in the desired direction and then
`holds the finger still on the switch to.start scrolling in
`the desired direction. The scrolling halts when he lifts his
`finger from the switch 1. If the user needs other character
`sets, he simply gives finger commands 14 <Finger Left> or
`<Finger Right>, e.g. to insert numbers, special characters
`or to use capital letters again (e.g. for a name). Word
`15 separation may be done by finger command <Long Tap> and
`period ("punctum") may be entered as two consecutive <Long
`Taps>, etc. The user may at any time toggle to Edit Text
`Mode by finger command sequence <Extra long Tap> - <Finger
`Down> as per Table 2. End of Message may be given by finger
`command sequence comprising two consecutive <Extra Long
`Taps>.
`Prior to this text input (when the cellular phone is
`switched ON)
`the cellular phone has automatically set the
`switch 1 to authentication mode for access control to the
`25 cellular phone. The user is then asked by text on the
`display to wipe his finger down over the sensor. When
`authentication by finger print biometrics is completed, the
`cellular phone sets the sign-generator to sleep mode, for
`energy saving. The sign-generator is then waked up e.g. when
`a request for the sign-generator is called for, e.g. by SMS
`input as per above. If the user wants to play a game on the
`cellular phone its control system sets the switch 1 to
`Cursor Control Mode as per Table 3a. Two-dimensional finger
`moves combined with combined finger command sequences (such
`35 as taps, etc.) thereby gives an accurate cursor control
`combined with numerous command functions for quite complex
`games. This example demonstrates that the invention is
`capable of rendering full input versatility and flexibility
`even through a single-button sign-generator, thereby
`
`20
`
`30
`
`ASSA ABLOY Ex. 1004 - Page 16
`ASSA ABLOY AB v. CPC Patent Technologies Pty Ltd.
`IPR2022-01006 - U.S. Patent No. 9,665,705
`
`

`

`WO 02/28067
`
`PCT/NO0l/00384
`
`15
`
`enabling the use of a large display as exemplified in fig. 2
`still maintaining full functionality.
`The next example of this embodiment of the invention,
`demonstrates text