US00702027OB1
`
`(12) United States Patent
`Ghassabian
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,020,270 B1
`Mar. 28, 2006
`
`(54) INTEGRATED KEYPAD SYSTEM
`(76) Inventor: Firooz Ghassabian, 11 Locust Cove
`La., Great Neck, NY (US) 11024
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 232 days.
`
`(21) Appl. No.:
`
`10/111888
`
`(22) PCT Filed:
`
`Oct. 27, 2000
`
`(86). PCT No.:
`S 371 (c)(1),
`(2), (4) Date: Sep. 5, 2002
`
`PCT/USOO/29647
`
`(87) PCT Pub. No.: WO01/31788
`PCT Pub. Date: May 3, 2001
`
`Related U.S. Application Data
`(60) Provisional application No. 60/220,578, filed on Jul.
`25, 2000, provisional application No. 60/208,619.
`filed on Jun. 1, 2000, provisional application No.
`60/194,767, filed on Apr. 3, 2000, provisional appli-
`cation No. 60/169,149, filed on Dec. 6, 1999, provi-
`sional application No. 60/164,597, filed on Nov. 10,
`1999, provisional application No. 60/164,656, filed
`on Nov. 4, 1999, provisional application No. 60/163,
`996, filed on Oct. 27, 1999.
`
`(51) Int. Cl.
`(2006.01)
`H03M II/04
`(52) U.S. Cl. .......................... 379/368; 341/22: 341/23;
`345/168; 34.5/169; 34.5/173: 345/175
`
`(58) Field of Classification Search .................. 341/22,
`341/23: 345/168, 169,173, 175; 704/270-278
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`4,531,119 A
`7/1985 Nakayama et al. ......... 340,712
`4,769,845 A
`9, 1988 Nakamura .................. TO4,231
`5,790, 103 A
`8, 1998 Willner .....
`... 345,168
`5,867,149 A
`2/1999 Jaeger ....
`... 345,172
`5,982,302 A * 11/1999 Ure ...........
`... 341/22
`6,011,554 A *
`1/2000 King et al. ...
`... 345,811
`6,295,052 B1
`9/2001 Kato et al. ........
`... 345,179
`6,326,952 B1
`12/2001 Amro et al. ...
`... 345,168
`6,445,381
`9/2002 Chou ..................
`... 345,168
`6,587,818 B1
`7/2003 Kanevsky et al. .......... TO4/251
`* cited by examiner
`Primary Examiner Sinh Tran
`Assistant Examiner Walter F Briney, III
`(74) Attorney, Agent, or Firm—Sofer & Haroun, LLP
`(57)
`ABSTRACT
`A data entry system comprising a group of data symbols
`comprising at least one of alphabetical symbols, numeric
`symbols, and commands (128-136), divided into subgroups.
`Each Subgroup is associated with at least a portion of the
`user's finger (102-120). The system also comprises a key
`pad (126) defining a plurality of keys, wherein each key
`contains at least one of the symbols. At least one finger
`recognition system (100) is configured to recognize the
`portion of the finger when it touches a key, and to select the
`Subgroup symbols associated with that portion of the finger
`interacting with that key.
`
`80 Claims, 34 Drawing Sheets
`
`
`
`
`
`
`
`
`
`ALPA
`PROCEDURE
`
`332O
`
`3322
`
`3334
`
`Wolce
`LP
`cosmon
`
`33
`DEFAULT
`ACTION
`
`3.338
`
`ERROR2
`
`YES
`
`BK SP
`
`N
`
`EXT
`
`334-O
`
`IPR2022-00602
`Apple EX1031 Page 1
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 1 of 34
`
`US 7,020,270 B1
`
`12O
`
`112
`
`CNX.
`5
`
`118
`
`
`
`16
`
`
`
`4. 11
`
`10 10
`8
`
`1 O2
`
`104.
`
`106
`
`1 OO
`
`FC.
`
`1
`
`IPR2022-00602
`Apple EX1031 Page 2
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 2 of 34
`
`US 7,020,270 B1
`
`
`
`N
`
`
`
`
`
`
`
`JOHT5) HOW/Te! NI CITOH CHVI ET800C] d\/| HT50NIS XEGNIINIHdH30NH
`
`
`
`
`
`
`
`
`
`
`
`IPR2022-00602
`Apple EX1031 Page 3
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 3 of 34
`
`US 7,020,270 B1
`
`3O4.
`
`JSO2
`
`FG3
`
`FG. 4
`
`
`
`402
`
`4O6
`
`IPR2022-00602
`Apple EX1031 Page 4
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 4 of 34
`
`US 7,020,270 B1
`
`
`
`506
`
`F.C. 5
`
`IPR2022-00602
`Apple EX1031 Page 5
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet S of 34
`
`US 7,020,270 B1
`
`
`
`FG 6A
`
`IPR2022-00602
`Apple EX1031 Page 6
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 6 of 34
`
`US 7,020,270 B1
`
`
`
`F.G. 6B
`
`IPR2022-00602
`Apple EX1031 Page 7
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 7 of 34
`
`US 7,020,270 B1
`
`
`
`704
`
`FIG 7
`
`IPR2022-00602
`Apple EX1031 Page 8
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 8 of 34
`
`US 7,020,270 B1
`
`
`
`G. 3
`
`IPR2022-00602
`Apple EX1031 Page 9
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 9 of 34
`
`US 7,020,270 B1
`
`
`
`
`
`1 OOO
`
`1 O2O
`
`IPR2022-00602
`Apple EX1031 Page 10
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 10 of 34
`
`US 7,020,270 B1
`
`an
`
`11 OO
`TRADITIONAL KEYBOARD /
`Farris referrorfarescusses ar.
`.
`.
`.
`.
`.
`.
`.
`.
`. as
`to
`of
`: on
`E
`.
`.
`. . It be
`sca
`v.
`
`-
`
`
`
`
`
`e
`.
`As
`In
`
`.
`
`.
`
`.
`
`.
`
`.
`
`"
`
`FIG 11
`
`12OO
`
`TELEPHONE KEYPAD -1
`f |
`Th;
`
`12O2
`
`F.G. 12
`
`IPR2022-00602
`Apple EX1031 Page 11
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 11 of 34
`
`US 7,020,270 B1
`
`
`
`F.G. 1 1A
`
`IPR2022-00602
`Apple EX1031 Page 12
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 12 of 34
`
`US 7,020,270 B1
`
`1302
`
`1504
`
`13OS
`
`PC CMNDS
`
`ALPHA 2
`
`ALPHA 1
`
`CH
`
`ha fe
`r
`
`R5 TW
`
`g
`
`o
`
`F1
`
`F.
`
`FB
`
`P
`
`F7
`
`
`
`MULTI FUNCTION KEYFAD
`
`F.C. 13
`
`IPR2022-00602
`Apple EX1031 Page 13
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 13 of 34
`
`US 7,020,270 B1
`
`s HAVNUM
`
`FG. 1 3A
`
`IPR2022-00602
`Apple EX1031 Page 14
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 14 of 34
`
`US 7,020,270 B1
`
`1428
`
`
`
`1 4-OO
`
`1404
`
`1412
`
`SEND/END
`
`1414
`
`1 403
`
`FG. 14
`
`IPR2022-00602
`Apple EX1031 Page 15
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 15 of 34
`
`US 7,020,270 B1
`
`
`
`1432
`
`F.G. 14A
`
`IPR2022-00602
`Apple EX1031 Page 16
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 16 of 34
`
`US 7,020,270 B1
`
`1460
`
`1455
`
`SEND/END
`
`
`
`1470
`
`IPR2022-00602
`Apple EX1031 Page 17
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 17 of 34
`
`US 7,020,270 B1
`
`Sri
`
`GH
`
`FIG. 14D
`
`ALPHA/NUM
`
`FG. 4 E
`
`IPR2022-00602
`Apple EX1031 Page 18
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 18 of 34
`
`US 7,020,270 B1
`
`-1 15OO
`
`1504
`
`1506
`
`2 s. ss, as
`
`1552
`
`FG 15B N 1550
`
`
`
`FG 15C
`
`IPR2022-00602
`Apple EX1031 Page 19
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 19 of 34
`
`US 7,020,270 B1
`
`BACK
`
`1500
`
`
`
`161 O
`
`CLOSED POSTION
`FG 16
`
`IPR2022-00602
`Apple EX1031 Page 20
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 20 of 34
`
`US 7,020,270 B1
`
`ABCDEFGHIJKLMNOPQRS
`TUV
`
`FG 16A
`
`ABCDEFGHIJKLMNOPQRSTUVWXYZ 1234567890ABCDE
`FGHIJKLMNOPQRSTUVWXYZ 123456789
`
`FG 16B
`
`
`
`ABCDEFGHIJKLMNOPQRSTUVWXYZ 123456789 OABCDE
`FGHIJKLMNOPQRSTUVWXYZ,123456789
`
`XYZ 1234567890ABCDE
`ABCDEFGHIJKLMNOPORS
`FGHIJKLMNOPORSTUVWXYZ 123456789
`ABCDEFGHIJKLMNOPQRSTUVWXYZ 1234567890ABCDE
`FGHIJKLMNOPQRSTUVWXYZ 123456789
`
`DISPLAY
`
`FG 16C
`
`IPR2022-00602
`Apple EX1031 Page 21
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 21 of 34
`
`US 7,020,270 B1
`
`XYZ 1234567890ABCDE
`ABCDEFGHIJKLMNOPQRST
`Z123456789
`
`16D
`
`
`
`ABCDEFGHIJKLMNOPQRSTUMWXYZ 1234567890ABCDE
`FGHIJKLMNOPQRSTUWXYZ 123456789
`
`IPR2022-00602
`Apple EX1031 Page 22
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 22 of 34
`
`US 7,020,270 B1
`
`ABCDEFGHIJKLMNOPOR
`FGHIJKLMNOPORSTUVW
`
`WXYZ123456789DABCDE
`123456789
`
`
`
`
`
`
`
`CREDT CARD SIZE
`COMPUTER TELEPHONE
`
`MOUSE/FINGER DIALING PAD
`
`FG 16 G
`
`IPR2022-00602
`Apple EX1031 Page 23
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 23 of 34
`
`US 7,020,270 B1
`
`17O6
`
`
`
`aS
`-
`-N
`-
`-
`L
`-
`-
`
`IPR2022-00602
`Apple EX1031 Page 24
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 24 of 34
`
`US 7,020,270 B1
`
`18OO
`
`1806
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`is
`air is
`:::E
`
`N
`
`-1
`
`18O2
`
`F.G. 18
`
`IPR2022-00602
`Apple EX1031 Page 25
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 25 of 34
`
`US 7,020,270 B1
`
`9 O2
`
`
`
`1904
`
`1908
`
`IPR2022-00602
`Apple EX1031 Page 26
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 26 of 34
`
`US 7,020,270 B1
`
`O
`
`2010
`
`EARPIECE
`
`
`
`CAMERA MC
`
`FG. 2O
`
`IPR2022-00602
`Apple EX1031 Page 27
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 27 of 34
`
`US 7,020,270 B1
`
`2O2
`
`21 O2 \
`
`?
`
`
`
`EARPIECE
`
`HANDSET FOR
`WRITEPHONE
`
`2O4
`-N-1
`
`CAMERA MC
`
`IPR2022-00602
`Apple EX1031 Page 28
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 28 of 34
`
`US 7,020,270 B1
`
`22O4
`
`22O2
`
`22O4.
`
`FG. 22
`
`IPR2022-00602
`Apple EX1031 Page 29
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 29 of 34
`
`US 7,020,270 B1
`
`53CO
`
`
`
`SELECT MODE
`WTH FLNGERS
`11
`
`
`
`COMMAND
`PROCEDURE
`
`WHFCH
`MODE
`SELECTED?
`
`ALPHA
`PROCEDURE
`
`
`
`
`
`
`
`NUMERC
`PROCEDURE
`
`YES
`
`
`
`FG.23
`
`IPR2022-00602
`Apple EX1031 Page 30
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 30 of 34
`
`US 7,020,270 B1
`
`
`
`
`
`
`
`
`
`
`APHA
`PROCEDURE
`
`332O
`
`3,322
`
`3334
`
`WOICE
`LP/
`ClMAN
`
`33
`DEFAULT
`ACTION
`
`3.338
`
`RO
`ERROR2
`
`YES
`
`BK SP
`
`O 1.
`
`N
`
`T
`
`3340
`
`FG.24
`
`IPR2022-00602
`Apple EX1031 Page 31
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 31 of 34
`
`US 7,020,270 B1
`
`NUMERC
`PROCEDURE
`
`335O
`
`coRSPNN
`f
`FUNCTO
`
`
`
`
`
`DEFAULT
`ACTION
`
`3362
`
`ERRORP
`
`YES
`
`BK SP
`
`3.364
`
`FC 25
`
`IPR2022-00602
`Apple EX1031 Page 32
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 32 of 34
`
`US 7,020,270 B1
`
`COMMAND
`PROCEDURE
`
`
`
`55
`DEFAULT
`ACTION
`
`358O
`
`FG.26
`
`IPR2022-00602
`Apple EX1031 Page 33
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 33 of 34
`
`US 7,020,270 B1
`
`24-12
`N
`"K",
`
`2404
`
`9+c 2402
`
`FG 27A
`
`24.12
`N
`"Kr.
`
`24O4.
`
`9+E- 24O2
`
`FC 27B
`
`ABC
`
`FC 28
`
`IPR2022-00602
`Apple EX1031 Page 34
`
`

`

`U.S. Patent
`
`Mar. 28, 2006
`
`Sheet 34 of 34
`
`US 7,020,270 B1
`
`
`
`EARPIECE/COM
`
`CD
`
`
`
`MCROPHONE
`
`IPR2022-00602
`Apple EX1031 Page 35
`
`

`

`1.
`INTEGRATED KEYPAD SYSTEM
`
`US 7,020,270 B1
`
`2
`has more than eighty keys, while some of those keys are
`used for two characters, symbols, or functions.
`Because the telephone keypad has an insufficient number
`of keys (e.g. mobile phone keypad), each key of a standard
`telephone keypad contains a group of characters and usually
`one number. Usage of the Internet or even entering a short
`message, engages a lot of complexity for the consumer.
`Proposals have been put forward to solve this fundamen
`tal man-machine-interface problem of how to quickly and
`easily enter text and functions using Small communication
`devices.
`One solution is to provide multiple presses of a single key
`for selecting a letter or symbol among those represented by
`a key. This system is currently used in most mobile phone
`keypads. This is a time consuming method and it frustrates
`the user.
`To improve that system, word disambiguating software
`products are developed. A dictionary database and language
`model are used to scan and present possible words according
`to keys pressed. Later the user selects the desired word
`among presented possibilities. Such approach engages a lot
`of problems such as out-of-vocabulary words or obliging the
`user to concentrate for selecting a desired word. In addition,
`entering numbers or single characters are again time con
`Suming procedures.
`External miniaturized keyboards are also produced to
`overcome the problem but they oblige the user to carry two
`different instruments, interfering with the basic idea of small
`electronic products, which is their easy portability.
`One recent technology that has attempted to overcome
`Such limitations is voice/speech-recognition technology.
`Voice recognition is the process of recognizing one or more
`Voice patterns from an individual’s voice as a corresponding
`computer input command, word, or function. For example,
`rather than typing a letter on a keyboard a user speaks that
`letter, wherein the recognition device associates the Voice
`pattern of that letter with the corresponding computer input
`character of that letter. Thus, individuals may operate
`devices in this manner without an input device since the
`user's voice provides all of the input. Unfortunately, con
`sidering the many complex aspects of an individual’s Voice,
`there is yet a recognition device that can accurately recog
`nize voice patterns at a sufficient level where input devices
`can be completely replaced.
`Additionally, several letters such as “B” and “P”, or “D”
`and “T”, can easily be confused by a speech engine. This is
`not necessarily a shortcoming of the engine as these letters
`can easily be confused by the humans as well. Hereafter, a
`list of Some of the problems and disadvantages concerning
`Voice/speech recognition systems;
`Only for language, mostly English
`Recognizing only one person's voice
`Outside noise disturbance (especially when using mobile
`telecommunication instruments)
`Not good for devices with small displays because of
`correction inconvenience (especially when using
`instruments with small LCDs, such as mobile phones)
`Many mistakes may occur when speaking single words
`(discontinuous speaking)
`Similar pronunciation for different words (e.g. two, to,
`too)
`Not predicting the user intention when writing numbers
`(e.g. twenty four, 24)
`Not predicting the user intention when writing mixture of
`numbers and symbols (e.g. six by four, 6 by 4, 6x4)
`Difficulty to distinguish between letters (e.g. B. P)
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`This application is based on, and claims the benefit of
`priority to, Applicant’s co-pending U.S. Provisional Patent
`Application Ser. No. 60/163,996 (filed on Oct. 27, 1999),
`Ser. No. 60/164,656 (filed on Nov. 4, 1999), Ser. No.
`60/164,597 (filed on Nov. 10, 1999), Ser. No. 60/169,149
`(filed on Dec. 6, 1999), Ser. No. 60/194,767 (filed on Apr. 3,
`2000), Ser. No. 60/208,619 (filed on Jun. 1, 2000), Ser. No.
`60/220,578 (filed on Jul. 25, 2000). The entire disclosure of
`all of the above-mentioned applications are hereby incorpo
`rated by reference herein as fully as if set forth in their
`entirety.
`
`5
`
`10
`
`15
`
`FIELD OF THE INVENTION
`
`This invention relates to keypad, finger, hand, speech,
`lips, face and other detection systems, and more specifically
`to a keypad (e.g. standard telephone keypad), having a finger
`pad recognition device which may be used in combination
`with the above-mentioned recognition systems, in order that
`full text and functions input can be provided in a natural,
`easy and quick manner.
`
`25
`
`BACKGROUND OF THE INVENTION
`
`30
`
`40
`
`Miniaturization has been a key component to recent
`technological advancement, enabling production of many
`devices that would otherwise be impracticable for reasons of
`size alone. Thus, we now have desktop computers that are
`more powerful and much smaller than their ancestor main
`frames. Also, digital clocks, video games and common
`35
`appliances farther illustrate the profit of miniaturization. In
`fact, the very essence of, for example, portable computers
`and cellular phones is their size as a primary feature.
`Yet, primarily because of human constraints, there are
`many obstacles to the growth of miniaturization in several
`areas. For example, it may be desirable to have a portable
`computer that fits in one's wallet, but such a computer would
`not be useable without a large input device that enables
`human interaction with the computer. In other words, com
`plex miniature computers and devices, such as cellular
`45
`phones (now, also used for the Internet, email, m-commerce,
`SMS (Short Massage Services), etc.), notebooks and PDAs,
`require keyboards, numeric pads or other input devices to
`allow the user to enter a phone number, send e-mail or
`transcribe a letter, etc. Thus, as advanced as miniaturization
`technology may get, there are other human factors involved
`that prevent certain devices from realizing a truly miniature
`State.
`As is well known, the key feature for a successful
`technological product, is its easily manipulations. For
`above-mentioned instruments and similar devices, a quickly,
`easily and most importantly, naturally, full text and function
`entry system is vital.
`The telephone-type keypad, that people are familiar with,
`is the most common input device for Small electronic and
`telecommunications instruments. It is integrated in many
`electronic devices such as mobile and wired telephones,
`PDAs, notebooks, laptops, faxes, remote controllers of TVs
`or other electronic devices, cameras, etc. This keypad usu
`ally has twelve keys, while the number of characters and
`functions keys used for writing texts or messages may be
`seven times this number. For example a computer keyboard
`
`50
`
`55
`
`60
`
`65
`
`IPR2022-00602
`Apple EX1031 Page 36
`
`

`

`US 7,020,270 B1
`
`3
`Moreover, notwithstanding the miniaturization issue, por
`table and other electronic devices have many security and
`efficiency problems. For example, an individual who mis
`places or loses a cellular phone must rush to disconnect his
`or her communications service before a thief or other person
`uses the phone to generate unauthorized charges. One
`known method for preventing Such unauthorized use is to
`lock the cellular phone or other device with a code system.
`Although, effective in many cases, this system is painstaking
`and inefficient for the true owner, who must activate the
`phone via a lengthy process before dialing. Similarly, there
`is no simple method for preventing unauthorized use of
`many electronic devices without first locking the device with
`a code system or other time consuming and inefficient
`process.
`Therefore, what is needed is a technology that resolves the
`human constraint Dilemma mentioned above, so that min
`iaturization can continue to realize its true potential. Fur
`thermore. Such a technology should also provide means for
`a more secure and efficient mechanism that can prevent
`unauthorized use of devices, among other things, as com
`pared with the prior art. In addition, a technology that
`improves the reliability of Voice recognition technology is
`desirable as well. What is needed, is preferably, a character
`by character data entry method, using familiar input devices
`with limited number of keys (e.g. telephone keypad),
`wherein each key contains a group of characters, symbols
`and commands existing on computer keyboards or similar
`devices, combined with some of other recognition systems
`Such as finger, voice, speech, lip, eye, face, etc., to enable the
`identification of individual characters from individual key
`entry actions.
`
`SUMMARY OF THE INVENTION
`
`A fingerprint detection device is provided, comprising one
`or more electronic pads that are configured to recognize
`pattern differences in each of a user's fingers. Such patterns
`relate to finger characteristics (such as size, shape, color,
`etc.), of entire fingers or portions of them. The patterns also
`relate to other information such as characteristics of the
`Surface of the fingertips (fingerprint, size, shape), nails
`(shape, size, brilliance), etc. Such pattern differences can in
`turn be utilized communicatively so that human input can be
`transmitted to an electronic device via the process of touch
`ing one's fingers to the fingerprint detection device. Thus, an
`individual can use one's fingers in conjunction with a
`fingerprint detection device in order to input a phone number
`to a phone device, enter characters to a computer, trigger
`various macros or functions with a PDA, etc.
`Initially, the fingerprint detection device must be pro
`grammed or taught so that it maps a particular finger with
`a corresponding symbol or function, such as a number, letter,
`macro or other activity. Thus, for example, one can use this
`method to map a distinct number to each of one's fingers
`(e.g. the numbers 0 to 9 comprise 10 Arabic digits, which
`may correspond to each one of a person’s ten fingers) and
`then be able to dial phone numbers solely with one's hands
`and a fingerpad. This saves space, by requiring only one pad
`as opposed to many numeric keys.
`Notably, more than one symbol or function can be
`mapped to each finger. For example, the fingerprint detec
`tion device is configured, according to one embodiment of
`the invention, to interpret a double tap with a particular
`finger to correspond to one number, while at the same time
`a single tap with the same finger can correspond to another
`number.
`
`4
`Illustratively, using an index finger with one tap can
`correspond to the number 2 and the same finger used with
`two taps can correspond to the number 7. In turn, all ten
`Arabic digits can be inputted with one hand and one fin
`gerprint pad. Similarly, one can expand on this method to
`input letters, symbols or other functions.
`In alternative embodiments, each finger is mapped to a
`different symbol or function based on the location of the
`finger, such as a different corner of the electronic pad. Thus,
`a tap in the upper right hand corner of the electronic pad will
`be interpreted differently than the lower right hand corner,
`etc. Also, more than one pad can be provided, if desired, to
`accomplish the same purpose.
`One main advantage of this fingerprint detection device is
`its size. Rather than having a large numeric keypad for a
`phone, one can use a smaller fingerprint pad, using the
`methods discussed above. Similarly, computer keyboards
`can be replaced or modified, as well as PDA input devices,
`etc.
`According to one embodiment, the fingerprint detection
`device is configured to distinguish between fingers based on
`their fingerprints. As such, this provides the user with a
`security advantage since the fingerpad would only operate
`based on a particular finger and is rendered useless in the
`hands of an unauthorized user.
`According to yet another embodiment, the finger detec
`tion device detects biological differences between charac
`teristics of fingers via a method other than fingerprint
`detection. These biological differences include, size, shape,
`position, temperature, etc. Thus, for example, the finger
`detection device can be configured to quickly distinguish
`one finger from another based on its size and shape. This
`process avoids the lengthy and complex task of Scanning a
`full or partial fingerprint. It is understood that for finger print
`or finger biological recognition, different detection systems
`and devices such as sensitive touchpads of any kind, touch
`screens, thermal, optical or other recognition means may be
`used.
`According to yet another embodiment of the invention,
`the detection device is configured to accept multiple forms
`of input to enhance accuracy and ease of use. For example,
`the detection device can be configured as both a finger
`detection and Voice-recognition device, wherein the detec
`tion device identifies a corresponding character or function
`based on input from both an individual’s finger and voice
`patterns.
`Not only does this method enhance accuracy, but it also
`enables individuals to more easily and quickly input distinct
`characters, words, and/or functions. Illustratively, without
`this method, an individual who wishes to use his or her
`fingers to input alphanumeric characters must assign three or
`more letters or symbols to each finger since there are many
`more letters and numbers than human fingers. It is thereafter
`not sufficient to merely tap one’s finger when entering a
`character since the input device still needs to distinguish
`between the several characters assigned to that finger. Thus,
`providing multiple forms of input resolves this problem. As
`an individual places one’s finger on the detection pad he or
`she may also speak the desired letter or function. The voice
`of the individual enables the detection device to distinguish
`between the many characters assigned to a particular finger.
`In addition, the limitations of Voice recognition are avoided
`since the finger detection device narrows down the Voice
`recognition to one of a few letters or symbols rather than a
`much larger scope. For example, by using this system
`combined with telephone keypad character arrangement,
`letters “B” and “P” will not be misrecognized by the voice
`
`5
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`IPR2022-00602
`Apple EX1031 Page 37
`
`

`

`US 7,020,270 B1
`
`5
`recognition engine, since they are separately located on two
`different groups (e.g. keys) 2, and 7. The same is true for the
`letters “D” and “T”, which are located on the keys 3, and 8.
`respectively.
`It is understood that the above-described embodiment can 5
`be configured to utilize voice-recognition with any of the
`finger detection devices described herein. For example,
`Voice 6) recognition can be combined to operate with
`fingerprint detection. Further, Voice recognition can also be
`combined to operate with finger detection based on biologi- 10
`cal characteristics other than fingerprints. It can also be
`configured to operate with the optical scanning devices,
`described herein, etc.
`The above description sets forth rather broadly the more
`important features of the present invention in order that the 15
`detailed description thereof that follows may be understood,
`and in order that the present contributions to the art may be
`better appreciated. Other objects and features of the present
`invention will become apparent from the following detailed
`description considered in conjunction with the accompany
`ing drawings. It is to be understood, however, that the
`drawings are designed solely for the purposes of illustration
`and not as a definition of the limits of the invention, for
`which reference should be made to the appended claims.
`
`25
`
`DETAILED DESCRIPTION OF THE DRAWINGS
`
`6
`FIG. 10 shows a telephone keypad having a voice recog
`nition device, according to one embodiment of this inven
`tion;
`FIG. 11 shows a front view of a traditional keyboard;
`FIG. 11a shows the finger pad detection device of one
`embodiment of this invention configured as an enhanced
`keyboard and/or display device:
`FIG. 12 shows a front view of a telephone keypad;
`FIG. 13 shows an enhanced keypad device according to
`one embodiment of this invention, having multiple configu
`rations;
`FIG. 13a shows an illustration of the enhanced keypad of
`FIG. 13 used according to one embodiment of the invention;
`FIG. 14 shows an enhanced keypad according to one
`embodiment of this invention having lip, Voice and other
`input and recognition means;
`FIG. 14a shows an enhanced keypad according to another
`embodiment of this invention having lip, Voice and other
`input and recognition means;
`FIG. 14b shows an enhanced keypad according to another
`embodiment of this invention having lip, Voice and other
`input and recognition means;
`FIG. 14c shows an enhanced keypad according to another
`embodiment of this invention having lip, Voice and other
`input and recognition means;
`FIG.14d shows an arrangement of keys for structuring an
`enhanced keypad, according to one embodiment of this
`invention, utilizing the recognition technique of FIG. 14b,
`FIG. 14e shows an arrangement of keys for structuring an
`enhanced keypad, according to one embodiment of this
`invention, utilizing the recognition technique of FIG. 14b,
`FIG. 15 shows an enhanced keypad according to one
`embodiment of this invention, comprising light sensors and
`pressure sensing means;
`FIG. 15b shows an arrangement of keys for structuring an
`enhanced keypad, according to one embodiment of this
`invention;
`FIG. 15c shows an arrangement of keys for structuring an
`enhanced keypad, according to one embodiment of this
`invention;
`FIG. 16 shows a multi-sectioned LCD comprising an
`enhanced keypad according to one embodiment of this
`invention;
`FIG. 16a shows an LCD device, sized as a credit card,
`according to one embodiment of this invention;
`FIG. 16b shows a multi-sectioned LCD according to one
`embodiment of this invention;
`FIG.16c shows a multi-sectioned LCD according to one
`embodiment of this invention;
`FIG. 16d shows a multi-sectioned LCD comprising an
`enhanced keypad according to one embodiment of this
`invention;
`FIG. 16e shows a credit size computer having a multi
`sectioned LCD and enhanced keypad according to one
`embodiment of this invention;
`FIGS. 16g shows an a credit card size computer and
`telecommunication device according to one embodiment of
`the invention.
`FIG. 17 shows a large LCD panel having multiple hinges
`for increased folding or miniaturization;
`FIG. 18 shows a wrist watch phone and PDA, according
`to one embodiment of this invention, comprising a recessed
`enhanced keypad with locking mechanism;
`FIG. 19 shows an enhanced keypad device according to
`one embodiment of this invention, having two keypads;
`
`30
`
`40
`
`45
`
`50
`
`35
`
`In the drawings in which like reference characters denote
`similar elements throughout the several views:
`FIG. 1 shows a fingerprint detection interface, according
`to one embodiment of the invention, for enabling inputting
`of numbers, letters, or other symbols and commands to a
`device via fingerprints or other biological differences among
`fingers:
`FIG. 2 is a mapping table portion of a database, according
`to one embodiment of the invention, which illustrates a
`particular finger being logically mapped to one or more
`corresponding functions or symbols;
`FIG. 3 is a wristwatch having a fingerprint detection pad,
`according to one embodiment of the invention, so that the
`wristwatch can be configured to operate as a radio, phone, or
`other device without requiring a console, numeric keypad or
`other bulky input device;
`FIG. 4 is a calculator having a fingerprint detection pad,
`according to one embodiment of the invention, so that
`individuals can enter functions and other commands via
`fingerprint detection;
`FIG. 5 shows the fingerprint detection interface of FIG. 1,
`according to one embodiment of the invention, having four
`fingerprint pads;
`FIG. 6a is a wrist mounted telephone device, according to
`one embodiment of the invention, having a fingerprint pad
`for dialing, in place of a numeric pad;
`FIG. 6b shows the wrist mounted telephone device of
`55
`FIG. 6a, having two fingerprint pads for additional func
`tionality;
`FIG. 7 shows an optical finger detection device, according
`to one embodiment of the invention, for capturing images of
`fingers, hands, or portions of fingers or hands in order to
`detect a particular corresponding character, number, func
`tion, or command;
`FIG. 8 shows a detection device that comprises both,
`optical finger detection means and Voice recognition means,
`according to one embodiment of the invention;
`FIG. 9 shows a finger mapping table, according to one
`embodiment of this invention;
`
`60
`
`65
`
`IPR2022-00602
`Apple EX1031 Page 38
`
`

`

`US 7,020,270 B1
`
`15
`
`7
`FIG. 20 shows an enhanced keypad device according to
`one embodiment of this invention, having a removable
`handset that includes a display pad;
`FIG. 21 shows a handset device according to one embodi
`ment of this invention, having a display pad on the rear 5
`portion of the handset:
`FIG.22 shows a handset device according to one embodi
`ment of this invention, configured to detachably connect to
`the enhanced keypad device of FIG. 20.
`FIG. 23 shows a flowchart concerning the general steps of 10
`character, symbol and function recognition system accord
`ing to preferred embodiment.
`FIG. 24 shows a flowchart concerning the steps of rec
`ognition of alpha characters and symbols according to
`preferred embodiment.
`FIG. 25 shows a flowchart concerning the steps of rec
`ognition of numeric characters and symbols according to
`preferred embodiment.
`FIG. 26 shows a flowchart concerning the steps of rec
`ognition of command and functions according to preferred
`embodiment.
`FIG. 27a shows a key of an enhanced keypad using click
`sensitive pad according to one embodiment of the invention.
`FIG.27b shows a key of an enhanced keypad using click
`sensitive pad according to one embodiment of the invention.
`FIG. 28 shows a key of an enhanced keypad using click
`sensitive pad according to one embodiment of the invention.
`FIG. 29a shows an enhanced multi-sectioned keypad
`according to one embodiment of the invention.
`FIG. 29b shows an enhanced multi-sectioned keypad
`having a LCD according to one embodiment of the inven
`tion.
`FIG. 29c shows an enhanced multi-sectioned keypad in
`closed position according to one embodiment of the inven- 35
`tion.
`
`8
`With continued reference to FIG. 1, display screen 122 is
`provided as an optional visual indication of the fingerprint
`detection mechanism. For example, an individual inputting
`a phone number via the fingerprint device can see the phone
`number displayed on the display screen as it is detected.
`According to one embodiment, the display Screen acts as a
`buffer, wherein the individual can view the display screen in
`order to correct any errors and Subsequently transmit the
`buffered information to the corresponding device. Such as a
`phone. As will be explained below, command buttons 132
`and 134 can be used for this purpose.
`In addition, indicator light 124 can be configured to flash
`and/or beep to indicate the operation of the fingerprint
`device. Thus, an individual can use the fingerprint pad
`without v