I 1111111111111111 11111 1111111111 111111111111111 IIIII IIIII 111111111111111111
`US008443199B2
`
`c12) United States Patent
`Kim et al.
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 8,443,199 B2
`May 14, 2013
`
`(54) MOBILE TERMINAL AND METHOD OF
`CONTROLLING THE MOBILE TERMINAL
`
`(75)
`
`Inventors: Jong Hwan Kim, Seoul (KR); Byung
`Eun Bong, Seoul (KR)
`
`(73) Assignee: LG Electronics, Inc., Seoul (KR)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 388 days.
`
`(21) Appl. No.: 12/727,197
`
`(22) Filed:
`
`Mar. 18, 2010
`
`(65)
`
`Prior Publication Data
`
`US 2010/0240415 Al
`
`Sep. 23, 2010
`
`(30)
`
`Foreign Application Priority Data
`
`Mar. 18, 2009
`Mar. 9, 2010
`
`(KR) ........................ 10-2009-0023211
`(KR) ........................ 10-2010-0020866
`
`(51)
`
`Int. Cl.
`H04L29/06
`(52) U.S. Cl.
`USPC ............................ 713/182; 455/565; 345/173
`(58) Field of Classification Search ................... 713/182
`See application file for complete search history.
`
`(2006.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`7,280,677 B2 * 10/2007 Chandler et al ............... 382/116
`7,420,546 B2 * 9/2008 Abdallah et al ............... 345/173
`
`7,697,729 B2 *
`2006/0284853 Al
`2007/0150842 Al
`
`4/2010 Howell et al .................. 382/115
`12/2006 Shapiro
`6/2007 Chaudhri et al.
`
`JP
`WO
`WO
`
`FOREIGN PATENT DOCUMENTS
`2007-304646 A
`11/2007
`WO 2007/140806 Al
`12/2007
`WO 2008/086302 Al
`7 /2008
`OTHER PUBLICATIONS
`
`AhmadAhsanullah et al. "Research Design for Evaluation of Finger
`Input Properties on Multi-touch Screen." International Conference
`on Information and Communication Technologies (ICICT), Jul.
`23-24, 2011 (pp. 1-6). *
`
`* cited by examiner
`
`Primary Examiner - Taghi Arani
`Assistant Examiner - Narciso Victoria
`(74) Attorney, Agent, or Firm -Birch, Stewart, Kolasch &
`Birch, LLP
`
`ABSTRACT
`(57)
`A mobile terminal and a method of controlling the mobile
`terminal are provided. The method includes storing a plural(cid:173)
`ity of pieces of fingerprint information on at least one of a
`finger-by-finger basis, a user-by-user basis, and a pattem-by(cid:173)
`pattem basis; receiving a fingerprint-touch input through a
`display module capable of performing fingerprint identifica(cid:173)
`tion; and if fingerprint information of the received finger(cid:173)
`print-touch input matches with one of the plurality of pieces
`of fingerprint information for locking a predefined operating
`menu, locking the predefined operating menu. Therefore, it is
`possible to easily lock or unlock the mobile terminal in
`response to a fingerprint-touch input. In addition, it is pos(cid:173)
`sible to effectively perform various operations performed by
`the mobile terminal in response to a fingerprint-touch input.
`
`18 Claims, 33 Drawing Sheets
`
`520
`
`530
`
`540
`
`T,,I
`
`HONG, KIL DONG
`
`=
`
`ell12.47AM
`INDEX FINGER
`
`T,d
`
`=
`
`ell1247AM
`MIDDLE FINGER
`
`T,11
`
`.ASSOCIATED FUNCTION
`
`I SCREEN LOCKAJNLOCK I
`
`OK
`
`CANCEL
`
`(a)
`
`.ASSOCIATED FUNCTION
`
`I TOUCH LOCK'lJNLOCK I
`
`OK
`
`CANCEL
`
`=
`
`(b)
`
`.ASSOCIATED FUNCTION
`
`I KEY LOCK/UNLOCK I
`
`OK
`
`CANCEL
`
`(c)
`
`Apple Ex. 1016
`Apple Inc. v. Firstface Co., Ltd.
`IPR2019-01011
`Page 00001
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 1 of 33
`
`US 8,443,199 B2
`
`FIG. 1
`
`190
`
`100 ?
`
`POWER SUPPLY UNIT
`
`150
`
`OUTPUT UNIT
`
`DISPLAY MODULE
`
`AUDIO OUTPUT
`MODULE
`
`ALARM MODULE
`
`HAPTIC MODULE
`
`CONTROLLER
`
`180
`
`181
`
`170
`
`MULTIMEDIA
`PLAY MODULE
`
`INTERFACE UNIT
`
`MEMORY
`
`151
`
`153
`
`155
`
`157
`
`160
`
`105
`
`110
`
`WIRELESS
`COMMUNICATION UNIT
`BROADCAST
`RECEPTION MODUL
`
`M BILE
`COMMUNICATION
`MODULE
`WIRELESS
`INTERNET MODULE
`
`COMMUNICATION
`MODULE
`
`GPS MODULE
`
`111
`
`113
`
`115
`
`117
`
`119
`
`120
`
`AN INPUT UNIT
`
`CAMERA
`
`MICROPHONE
`
`130
`
`140
`
`USER INPUT UNIT
`
`SENSING UNIT
`
`PROXIMITY SENSOR
`
`PRESSURE SENSOR
`
`MOTION SENSOR
`
`IPR2019-01011 Page 00002
`
`

`

`l}.S. -Patent
`
`Sbeet 2 of 33
`
`\JS S,443,199 132
`
`FIG. 2
`
`__ _/~ooA-2
`,ooA-1
`
`100B
`
`130b \
`
`IPR2019-01011 Page 00003
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 3 of 33
`
`US 8,443,199 B2
`
`FIG. 3
`
`1 00A-2 1 00A-1
`
`100A"'\
`
`150
`
`125
`
`12ib
`
`126
`100B~
`
`i90
`
`i30f
`
`100B-1
`
`100B-2
`
`IPR2019-01011 Page 00004
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 4 of 33
`
`US 8,443,199 B2
`
`FIG. 4
`
`(a)
`
`(b)
`
`Touch Sensor
`
`Window
`
`Photo Sensor
`LCD Module
`
`BASE LAYER
`
`Window
`
`Touch Sensor
`
`Photo Sensor
`LCD Module
`
`BASE LAYER
`
`IPR2019-01011 Page 00005
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 5 of 33
`
`US 8,443,199 B2
`
`FIG. 5
`
`(a)
`
`(b)
`
`Scan-Flim
`
`Window
`
`LCD Module
`
`BASE LAYER
`
`Window
`
`Scan-Flim
`
`LCD Module
`
`BASE LAYER
`
`IPR2019-01011 Page 00006
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 6 of 33
`
`US 8,443,199 B2
`
`FIG. 6
`
`(a)
`
`(b)
`
`(c)
`
`Scan-Flim
`
`Touch Sensor
`
`Window
`
`LCD Module
`
`BASE LAYER
`
`Touch Sensor
`
`Scan-Flim
`
`Window
`
`LCD Module
`
`BASE LAYER
`
`Touch Sensor
`
`Window
`
`Scan-Flim
`
`LCD Module
`
`BASE LAYER
`
`IPR2019-01011 Page 00007
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 7 of 33
`
`US 8,443,199 B2
`
`FIG. 7
`
`Transistor (TR)
`
`CO
`
`C1
`
`( \
`
`RO
`R1
`
`- - --- --
`
`--
`
`Cn
`-- L - - -
`
`..._ ..._
`
`' ' ..._
`
`' ' ' ' ..._
`
`'
`
`....
`
`'
`
`' '
`
`' '- '-
`
`' ' '-
`
`' '-
`
`I
`
`Photo Diode (PD)
`(b)
`
`Rn
`
`Processor
`
`(a)
`
`IPR2019-01011 Page 00008
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 8 of 33
`
`US 8,443,199 B2
`
`FIG. 8
`
`•• cm I~ R1
`C 2 i~ I
`I
`C1 I~ R1
`R2
`
`R2
`I
`R3
`
`Red
`
`100%
`
`50%
`
`20%
`
`Green
`
`50%
`
`20%
`
`•
`
`Blue
`
`0%
`
`10%
`
`0%
`
`R3
`I
`•••
`
`•
`
`•
`
`•
`
`Rn
`
`•
`
`•
`
`••
`
`•••
`I
`Rn
`
`-
`• -
`• -
`
`••
`
`-
`
`IPR2019-01011 Page 00009
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 9 of 33
`
`US 8,443,199 B2
`
`FIG. 9A
`
`START
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER,
`USER-BY-USER
`PATTERN-BY-PATTERN BASIS
`
`No
`
`PERFORM OPERATION
`CORRESPONDING TO RECEIVED
`USER INPUT OR OCCURRED EVENT
`
`S206
`
`No
`
`Yes
`
`END
`
`IPR2019-01011 Page 00010
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 10 of 33
`
`US 8,443,199 B2
`
`FIG. 9B
`
`LOCK MOBILE TERMINAL
`
`S212
`
`S216
`
`UNLOCK MOBILE TERMINAL - - - - -
`
`S220
`
`TEMPORARILY UNLOCK
`MOBILE TERMINAL
`
`S222
`
`TREAT RECEIVED
`FINGERPRINT-TOUCH INPUT
`AS ORDINARY TOUCH INPUT
`
`B
`
`IPR2019-01011 Page 00011
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 11 of 33
`
`US 8,443,199 B2
`
`FIG. 10
`
`START
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY(cid:173)
`USER, PATTERN-BY-PATTERN BASIS
`
`DISPLAY OPERATION SCREEN
`
`8250
`
`S252
`
`No
`
`S260
`
`TREAT RECEIVED FINGERPRINT
`-TOUCH INPUT AS ORDINARY
`TOUCH INPUT
`
`No
`
`END
`
`IPR2019-01011 Page 00012
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 12 of 33
`
`US 8,443,199 B2
`
`FIG. 11
`
`START
`
`S300
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY-USER,
`PATTERN-BY-PATTERN BASIS
`
`S302
`
`LOCK MOBILE TERMINAL
`
`No
`
`UNLOCK MOBILE TERMINAL AND
`ENTER PREDEFINED OPERATING MODE
`
`IPR2019-01011 Page 00013
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 13 of 33
`
`US 8,443,199 B2
`
`FIG. 12
`
`START
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY(cid:173)
`USER, PATTERN-BY-PATTERN BASIS
`
`DISPLAY SCREEN SHOWING
`GROUP OF MENU ICONS
`
`S350
`
`S352
`
`No
`
`S358
`
`S360
`
`TREAT RECEIVED FINGERPRINT
`-TOUCH INPUT AS ORDINARY
`TOUCH INPUT
`
`DISPLAY SCREEN SHOWING GROUP
`OF MENU ICONS CORRESPONDING
`TO FINGERPRINT INFORMATION THAT
`MATCHES WITH FINGERPRINT
`INFORMATION OF RECEIVED
`FINGERPRINT-TOUCH INPUT
`
`No
`
`S364
`
`No
`
`END
`
`IPR2019-01011 Page 00014
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 14 of 33
`
`US 8,443,199 B2
`
`FIG. 13
`
`400
`)
`
`(
`
`c:::::::)
`
`T11d
`
`,mJ12:47AM
`
`THE FINGERPRINT
`DENTIFICATION FUNCTION
`IS PROVIDED.
`PLEASE REGISTER
`FINGERPRINT FOR USE
`OF THE FINGERPRINT
`IDENTIFICATION
`FUNCTION.
`
`II OK
`
`jCANCEL
`
`( ~ ~
`
`~ =»
`
`IPR2019-01011 Page 00015
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 15 of 33
`
`US 8,443,199 B2
`
`FIG. 14
`
`r
`
`423
`
`/
`
`.,.,.
`
`812:47AM
`FINGERPRINT STORAGE
`
`81247AM
`Tllf
`FINGERPRINT STORAGE
`
`425
`.,.,.
`
`/
`
`/
`
`'11i112:47AM
`FINGERPRINT STORAGE
`
`420
`
`/
`
`T~
`llll12:47AM
`FINGERPRINT TOUCH
`
`I
`I
`I
`I
`I I
`I
`I
`I
`I
`I
`1 FINGERPRINT TOUCH
`I
`On/Off
`I I
`2 FINGERPRINT STORAGE FINGERPRINT :
`STORAGE
`1
`I
`I I
`
`THERE IS NO
`FINGERPRINT
`REGISTERED
`
`1 MAIN FINGERPRINT
`2 AUXILIARY
`FINGERPRINT
`
`1. FINGERPRINT TYPE1
`
`2. FINGERPRINTTYPE2
`
`3. FINGERPRINTTYPE3
`
`4. FINGERPRINT TYPE4
`
`5. FINGERPRINT TYPES
`
`II OK
`
`II CANCEL
`
`II
`
`I ADD
`
`MENU II EDIT
`
`II ADD
`
`MENU II EDIT i ADD
`
`: I
`~
`~
`~
`--------------------------------------------------------------J
`
`i
`I
`I
`I
`I
`I
`I
`I
`I
`
`4271
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`IPR2019-01011 Page 00016
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 16 of 33
`
`US 8,443,199 B2
`
`FIG. 15
`
`450
`
`T,111
`,mJ12:47AM
`ADD FINGERPRINT
`
`.FINGERPRINT NAME
`
`I FINGERPRINT TYPE1 I
`
`• FINGERPRINT SENSING AREA
`PLEASE DRAG YOUR
`FINGER VERTICALLY
`ACROSS THE
`FINGERPRINT
`SENSING AREA
`
`.VIBRATIOt\
`VIBRATION1
`
`SAVE
`
`IPR2019-01011 Page 00017
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 17 of 33
`
`US 8,443,199 B2
`
`FIG. 16
`
`05
`5
`_,/
`
`510
`
`513
`
`,m:J12:47AM
`LOCK ALL
`eLOCK
`
`LOCK WHEN
`TURNED ON
`e LOCK/UNLOCK
`SINGLE
`FINGERPRINT-TOUCH
`
`OK
`
`CANCEL
`
`500
`)
`
`c=:=::>
`
`(
`
`T,111
`
`,m:J12:47AM
`LOCK
`1. OUTGOING CALL
`RESTRICTIONS
`2 INTERNET ACCESS
`RESTRICTIONS
`3. PRIVACY PROTECTION
`
`y -
`
`4. LOCK ALL
`
`5. CHANGE PASSWORD
`
`6. PASSWORD HINT
`
`7. EMERGENCY NUMBER
`REGISTRATION
`II CANCEL
`II OK
`
`« O"'i:>
`
`~
`
`~ = ~)
`
`(a)
`
`(b)
`
`IPR2019-01011 Page 00018
`
`

`

`FIG. 17
`
`520
`
`530
`
`540
`
`c:::::::)
`
`c:::::::)
`
`c:::::::)
`
`T,111
`
`m112:47AM
`HONG, KIL DONG
`
`.NAME
`
`I INDEX FINGER
`
`• REtbii1fib~~iEA
`
`.ASSOCIATED FUNCTION
`
`I SCREEN LOCKAJNLOCK I
`
`~L
`
`= ~
`
`(a)
`
`Tdli
`
`m112:47AM
`INDEX FINGER
`
`.NAME
`r - -
`
`.ASSOCIATED FUNCTION
`
`I TOUCH LOCK/UNLOCK I
`I OK
`II CANCEL
`
`Tdll
`
`m112:47AM
`MIDDLE FINGER
`
`.NAME
`
`I INDEX FINGER
`
`• REtbi%7tlb~~iEA
`
`.ASSOCIATED FUNCTION
`
`I KEY LOCKAJNLOCK I
`I CANCEL
`-
`'I OK
`
`CR:, ~
`
`@ ~
`
`(b)
`
`(c)
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`"' ...
`0 ....
`
`N
`
`~
`
`('D
`('D
`
`QO
`
`rJJ =(cid:173)
`.....
`....
`0 ....
`
`~
`~
`
`d r.,;_
`
`00
`~
`~ w
`"'
`"'""' \0
`
`\0 = N
`
`IPR2019-01011 Page 00019
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 19 of 33
`
`US 8,443,199 B2
`
`FIG. 18
`
`600
`
`(cid:143)
`
`mJ12:47AM
`
`T,111
`~fm~~
`tEEu[9]
`~~ii~
`~~
`
`603
`
`605
`
`IPR2019-01011 Page 00020
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 20 of 33
`
`US 8,443,199 B2
`
`FIG. 19
`
`610
`
`620
`
`,mJ12:47AM
`
`To1II
`[j] I All contacts ,.. I§
`I + New contact I p Search
`I
`m Agnes Milne*
`(6\
`laJ !,l 222-333-5555 &;
`
`c:=:::>
`
`T,111
`[ill
`
`,mJ12:47AM
`All contacts .... I I ":::) I
`
`613
`
`(a)
`
`623
`
`(b)
`
`IPR2019-01011 Page 00021
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 21 of 33
`
`US 8,443,199 B2
`
`FIG. 20
`
`630
`
`640
`
`T111I
`001
`lnbox
`B Agnes Milne
`•·Ii jcn.rh,s is realyco
`
`,m)1247AM
`
`,.. 11~1
`
`( Rep~• l
`
`B Angelina Taylor ~
`T·~ere ,:1 r·o roxr:n to~
`
`,m)12:47AM
`
`8
`
`T,111
`~
`OD Folder 1
`OD Folder2
`OD Folder3
`,..,...·-~-=--=---i1.•-·...,,-_-_--l-t
`0 File l1
`(,
`\
`0 File 2,
`\
`
`• 200 2.
`
`t - - - - - , l \., - )
`
`633
`
`(a)
`
`I
`File 4.pp
`
`643
`
`(b)
`
`IPR2019-01011 Page 00022
`
`(cid:143)
`

`

`U.S. Patent
`U.S. Patent
`
`May14, 2013
`May 14, 2013
`
`Sheet 22 of 33
`Sheet 22 of 33
`
`US 8,443,199 B2
`US 8,443,199 B2
`
`FIG. 21
`FIG, 21
`
`650
`
`660
`
`
`
`c er;:.,
`
`,
`
`» ¥»
`
`(a)
`
`(b)
`
`IPR2019-01011 Page 00023
`
`IPR2019-01011 Page 00023
`
`

`

`FIG. 22
`
`FINGERPRINT
`TOUCH
`USER1
`
`SCROLL
`SPEED/ ACCELERATION
`VERY LOW
`
`FINGERPRINT
`TOUCH
`THUMB
`
`SCROLL
`SPEED/ACCELERATION
`VERY LOW
`
`FINGERPRINT
`TOUCH
`PATTERN1
`
`SCROLL
`SPEED/ ACCELERATION
`VERY LOW
`
`USER2
`
`USER3
`
`USER4
`
`USER5
`
`LOW
`
`NORMAL
`
`HIGH
`
`VERY HIGH
`
`(a)
`
`INDEX FINGER
`
`LOW
`
`MIDDLE FINGER
`
`NORMAL
`
`RING FINGER
`
`HIGH
`
`LITTLE FINGER
`
`VERY HIGH
`
`PATTERN2
`
`PATTERN3
`
`PATTERN4
`
`PATTERN5
`
`LOW
`
`NORMAL
`
`HIGH
`
`VERY HIGH
`
`(b)
`
`(c)
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`"' ...
`0 ....
`
`N
`
`~
`
`('D
`('D
`
`rJJ =(cid:173)
`.....
`N
`~
`
`0 ....
`
`~
`~
`
`d r.,;_
`
`00
`~
`~ w
`"'
`"'""' \0
`
`\0 = N
`
`IPR2019-01011 Page 00024
`
`

`

`FIG. 23
`
`FINGERPRINT
`TOUCH
`USER1
`
`SCROLL
`SPEED/ACCELERATION
`1 SCREEN BASIS
`
`FINGERPRINT
`TOUCH
`THUMB
`
`SCROLL
`SPEED/ACCELERATION
`1 LINE BASIS
`
`FINGERPRINT
`TOUCH
`PATTERN1
`
`SCROLL
`SPEED/ACCELERATION
`1 PAGE BASIS
`
`USER2
`
`USER3
`
`USER4
`
`USERS
`
`2 SCREEN BASIS
`
`3 SCREEN BASIS
`
`4 SCREEN BASIS
`
`S SCREEN BASIS
`
`(a)
`
`INDEX FINGER
`
`2 LINE BASIS
`
`MIDDLE FINGER
`
`3 LINE BASIS
`
`RING FINGER
`
`4 LINE BASIS
`
`LITTLE FINGER
`
`S LINE BASIS
`
`(bl
`
`PATTERN2
`
`PATTERN3
`
`PATTERN4
`
`PATTERNS
`
`2 PAGE BASIS
`
`3 PAGE BASIS
`
`4 PAGE BASIS
`
`S PAGE BASIS
`
`(cl
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`"' ...
`0 ....
`
`N
`
`~
`
`('D
`('D
`
`rJJ =(cid:173)
`.....
`N ...
`0 ....
`
`~
`~
`
`d r.,;_
`
`00
`~
`~ w
`"'
`"'""' \0
`
`\0 = N
`
`IPR2019-01011 Page 00025
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 25 of 33
`
`US 8,443,199 B2
`
`FIG. 24
`
`700
`
`rB12:47AM
`
`'T'dll
`~I I All contacts ... I I~
`I + New contact I p Search
`I
`
`705
`
`707
`
`710
`
`720
`
`730
`
`(a)
`
`(b)
`
`IPR2019-01011 Page 00026
`
`

`

`FIG. 25
`
`, RECOGNITION
`
`760
`
`a RECOGNITION
`
`770
`
`=
`
`T,~
`8
`D Ll Folder1
`
`4!111?:47AM
`§
`
`=
`
`.,, ..
`8
`
`§
`
`* RECOGNITION
`=
`
`T,11
`8
`D (:] Folder1
`
`41111?:47AM
`§
`
`750
`
`(cid:157)
`
`.~.t, ,tRECOGNITION
`=
`
`T,dl
`B
`0 (:] Folder1
`
`411112:47AM
`§
`
`751
`
`761
`
`-~
`
`(a)
`
`(b)
`
`771
`(c)
`
`"""'
`
`781
`
`(d)
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`"' ...
`0 ....
`
`N
`
`~
`
`('D
`('D
`
`rJJ =(cid:173)
`.....
`N
`O'I
`
`0 ....
`
`~
`~
`
`d r.,;_
`
`00
`~
`~ w
`"'
`""'"' \0
`
`\0 = N
`
`IPR2019-01011 Page 00027
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 27 of 33
`
`US 8,443,199 B2
`
`FIG. 26
`
`790
`
`)
`
`VERY SLOWLY :
`
`SLOWLY
`
`NORMAL
`
`QUICKLY
`
`:
`f--
`
`1
`
`:
`
`VERY QUICKLY J
`
`,- -
`
`c:::::::, (
`ill] -, I L I C: IW
`
`i!llli2:~7AM
`
`'1",111
`
`•) KANG, SAN AE
`
`• KANG, SUNG H.OON I
`
`• KANG, S00 JI
`--
`•> KAI\JG,- WO~ RAE
`• KIM. INSIK
`
`7
`91
`
`'II •
`r.'
`
`@;JI 011-90XX-XXXX
`MENU II OK
`
`II BACK
`
`< CR:,
`
`!
`
`! = )
`
`IPR2019-01011 Page 00028
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 28 of 33
`
`US 8,443,199 B2
`
`FIG. 27
`
`----,
`
`, - - -
`
`-- -
`
`1.,-
`
`('
`80
`1
`
`800
`)
`
`c= : ) (
`Music
`~ The Beautiful Girls U)
`,.__
`t~ ?ea~[if~l_girls
`~ - - v - -01: 19
`
`~
`...
`
`II
`
`M4
`
`-..i---THUMB
`
`r---,.._---'-'=-"
`
`RING FINGER
`
`I
`I
`I
`I
`I
`I
`:
`
`I
`I
`I
`INDEX FINGER
`I
`MIDDLE FINGER 1
`I
`i-
`l ~ -----------~~~ ~l~~E~ j
`
`IPR2019-01011 Page 00029
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 29 of 33
`
`US 8,443,199 B2
`
`_,,.-~1----THUMB
`
`I
`I
`I
`I
`MIDDLE FINGER I
`I
`I- -
`I
`~LITTLE FINGER )
`
`INDEX FINGER
`
`RING FINGER
`
`FIG. 28
`
`-
`
`_Q
`
`FIG. 29
`
`810
`
`811
`
`820
`
`=
`To11I
`[i I j All conlacts ~ 113
`
`,au12:47AM
`
`821
`
`,.,.-~1----THUMB
`
`I
`I
`I
`I
`MIDDLE FINGER I
`I
`r- - - -
`I
`LITTLE FINGER )
`
`INDEX FINGER
`
`RING FINGER
`
`IPR2019-01011 Page 00030
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 30 of 33
`
`US 8,443,199 B2
`
`FIG. 30
`
`---,
`
`..---1t-l----·rnuMB
`
`(,-
`I
`I
`I
`I
`I
`I
`I
`I
`
`l
`
`I
`I
`I
`I
`MIDDLE FINGER I
`I
`r- - -
`I
`LITTLE FINGER )
`--------------------
`
`INDEX FINGER
`
`RING FINGER
`
`830
`
`=
`
`Business
`
`In a small telephoney
`market, the most impor(cid:173)
`ant issune for users
`would be the values
`such as "user-frinedlines
`and "cost effectiveness"
`-IA .pu[§uit of thes
`
`alluy
`values, tradi
`LG has been providing
`hybrid architecture in the
`
`--
`
`MENU BOOKMARK GACK
`
`831
`
`- - - - - - -
`
`-
`
`IPR2019-01011 Page 00031
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 31 of 33
`
`US 8,443,199 B2
`
`FIG. 31
`
`840
`
`850
`
`=
`
`=
`
`845
`
`--847
`
`Press to unlock
`1st -Message
`2nd.Music
`3rd -Contacts
`4th -Alarm
`5th -Game
`
`1st -Message
`2nd.Music
`~ 3rd -Contacts
`-
`th -Alarm
`th -Game
`
`860
`}
`
`(
`
`=
`Music
`~ The Beautiful Girls [I]
`the beautiful girls
`Luces Kusung
`
`855
`
`~
`®@ @-CB>
`
`C C 'A-B 00:20:30
`
`It' ~
`
`(a)
`
`(b)
`
`(c)
`
`IPR2019-01011 Page 00032
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 32 of 33
`
`US 8,443,199 B2
`
`FIG. 32
`
`870
`
`880
`)
`~ (
`
`To11l
`
`,mJ12:47AM
`
`lil!lilt. . ..,,.
`111~1
`~ rn3
`,-----.,
`,-----.,
`I (S\1:.i~)
`) ~
`@
`l ~,
`ft (E3 n 1(5'
`~t\: (8aJ • ij
`
`~~;
`
`(. ~:;' ,/
`
`_"-.,_,o/;
`
`.
`
`s
`
`I (cid:141)
`
`I Selected playlist is empty j
`
`-
`
`875
`
`~ ~ [~ (E'i
`,_,
`~ ~ ~ Mi: ©·
`
`___ ._,,
`
`(a)
`
`(b)
`
`IPR2019-01011 Page 00033
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 33 of 33
`
`US 8,443,199 B2
`
`FIG. 33
`
`890
`
`'fdll
`
`,mJ12:47AM
`
`~EID~~
`(cid:143) 828 arJ [Q]
`~: · mJ iir
`,---,, r:--:-:-:::~> \~,::\,
`'
`>----
`
`'
`
`895
`
`IPR2019-01011 Page 00034
`
`

`

`US 8,443,199 B2
`
`1
`MOBILE TERMINAL AND METHOD OF
`CONTROLLING THE MOBILE TERMINAL
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application claims the priority benefit of Korean
`Patent Application No. 10-2009-0023211, filed on Mar. 18,
`2009 and Korean Patent Application No. 10-2010-0020866,
`filed on Mar. 9, 2010 in the Korean Intellectual Property
`Office, the disclosure of which is incorporated herein by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`The present invention relates to a mobile terminal and a
`method of controlling the mobile terminal, and more particu(cid:173)
`larly, to a mobile terminal and a method of controlling the
`mobile terminal, in which various operations performed by
`the mobile terminal can be effectively controlled in response
`to a fingerprint-touch input having fingerprint information.
`2. Description of the Related Art
`Mobile terminals are portable devices, which can provide
`users with various services such as a voice calling service, a
`video calling service, an information input/output service,
`and a data storage service.
`As the types of services provided by mobile terminals
`diversify, an increasing number of mobile terminals have
`been equipped with various complicated functions such as
`capturing photos or moving pictures, playing music files or
`moving image files, providing game programs, receiving
`broadcast programs and providing wireless internet services
`and have thus evolved into multimedia players.
`Various attempts have been made to realize such compli(cid:173)
`cated functions as hardware devices or software programs.
`For example, various user interface (UI) environments, in
`which users are allowed to easily search for and choose
`desired functions, have been developed. In addition, the
`demand for various designs for mobile terminals such as a
`double-sided liquid crystal display (LCD) or a full touch
`screen has steadily grown due to a growing tendency of con(cid:173)
`sidering mobile terminals as personal items that can represent
`personal individuality.
`However, there is a restriction in allocating sufficient space
`for the installation of a UI such as a display or a keypad
`without compromising the mobility and the portability of the
`mobile terminal. Therefore, it is necessary to develop ways to
`control the operation of a mobile terminal using a new data
`input method and thus use various complicated functions
`provided by the mobile terminal with convenience.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides a mobile terminal and a
`method of controlling the mobile terminal, in which various
`operations performed by the mobile terminal can be effec(cid:173)
`tively controlled in response to a fingerprint-touch input hav(cid:173)
`ing fingerprint information.
`According to an aspect of the present invention, there is
`provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-user basis, and a pattern-by-pattern basis; receiving a
`fingerprint-touch input through a display module capable of
`performing fingerprint identification; and if fingerprint infor(cid:173)
`mation of the received fingerprint-touch input matches with
`
`5
`
`2
`one of the plurality of pieces of fingerprint information for
`locking a predefined operating menu, locking the predefined
`operating menu.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica(cid:173)
`tion; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger
`basis, a user-by-user basis, and a pattern-by-pattern basis; and
`10 a controller configured to receive a fingerprint-touch input
`through the display module, wherein, if fingerprint informa(cid:173)
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information for lock(cid:173)
`ing a predefined operating menu, the controller locks the
`15 predefined operating menu.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`20 user-by-user basis, and a pattern-by-pattern basis; displaying
`an operation screen on a display module capable of perform(cid:173)
`ing fingerprint identification; receiving a fingerprint-touch
`input through the display module; and if fingerprint informa(cid:173)
`tion of the received fingerprint-touch input matches with one
`25 of the plurality of pieces of fingerprint information for con(cid:173)
`trolling the display of a screen, controlling the display of the
`operation screen in accordance with a control value corre(cid:173)
`sponding to the fingerprint information that matches with the
`fingerprint information of the received fingerprint-touch
`30 input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica(cid:173)
`tion and display an operation screen; a memory configured to
`35 store a plurality of pieces of fingerprint information on at least
`one of a finger-by-finger basis, a user-by-user basis, and a
`pattern-by-pattern basis; and a controller configured to
`receive a fingerprint-touch input through the display module,
`wherein, if fingerprint information of the received finger-
`40 print-touch input matches with one of the plurality of pieces
`of fingerprint information for controlling the display of a
`screen, the controller controls the display of the operation
`screen in accordance with a control value corresponding to
`the fingerprint information that matches with the fingerprint
`45 information of the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including locking a predefined operating mode;
`receiving a fingerprint-touch input through a display module
`50 capable of performing fingerprint identification; and if fin(cid:173)
`gerprint information of the received fingerprint-touch input
`matches with one of a plurality of pieces of previously-stored
`fingerprint information for unlocking the predefined operat(cid:173)
`ing mode, unlocking the predefined operating mode and
`55 entering an operating mode corresponding to the fingerprint
`information that matches with the fingerprint information of
`the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`60 configured to be capable of performing fingerprint identifica(cid:173)
`tion; a memory configured to store a plurality of pieces of
`fingerprint information; and a controller configured to receive
`a fingerprint-touch input through the display module,
`wherein, if fingerprint information of the received finger-
`65 print-touch input matches with one of a plurality of pieces of
`previously-stored fingerprint information for unlocking the
`predefined operating mode, the controller unlocks the pre-
`
`IPR2019-01011 Page 00035
`
`

`

`US 8,443,199 B2
`
`4
`FIGS. 22 through 30 illustrate how to control a screen in
`response to a fingerprint-touch input;
`FIG. 31 illustrates how to unlock a mobile terminal and
`enter a predetermined operating mode in response to a fin-
`5 gerprint-touch input; and
`FIGS. 32 and 33 illustrate how to display menu icons
`classified into different menu groups in response to a finger(cid:173)
`print-touch input.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`3
`defined operating mode and enters an operating mode corre(cid:173)
`sponding to the fingerprint information that matches with the
`fingerprint information of the received fingerprint-touch
`input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-user basis, and a pattern-by-pattern basis; displaying
`a first screen showing a number of menu icons on a display 10
`module capable of performing fingerprint identification;
`receiving a fingerprint-touch input through the display mod(cid:173)
`ule; and if fingerprint information of the received fingerprint(cid:173)
`touch input matches with one of the plurality of pieces of 15
`fingerprint information, displaying a second screen showing a
`predefined group of menu icons corresponding to the finger(cid:173)
`print information that matches with the fingerprint informa(cid:173)
`tion of the received fingerprint-touch input.
`According to another aspect of the present invention, there 20
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica(cid:173)
`tion and display a first screen showing a number of menu
`icons; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger 25
`basis, a user-by-user basis, and a pattern-by-pattern basis; and
`a controller configured to receive a fingerprint-touch input
`through the display module, wherein, if fingerprint informa(cid:173)
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information, the con- 30
`trailer displays a second screen showing a predefined group
`of menu icons corresponding to the fingerprint information
`that matches with the fingerprint information of the received
`fingerprint-touch input.
`
`The present invention will hereinafter be described in
`detail with reference to the accompanying drawings in which
`exemplary embodiments of the invention are shown.
`The term 'mobile terminal', as used herein, may indicate a
`mobile phone, a smart phone, a laptop computer, a digital
`broadcast receiver, a personal digital assistant (PDA), a por(cid:173)
`table multimedia player (PMP), or a navigation device. In this
`disclosure, the terms 'module' and 'unit' can be used inter(cid:173)
`changeably.
`FIG.1 illustrates a block diagram ofa mobile terminal 100
`according to an embodiment of the present invention. Refer(cid:173)
`ring to FIG. 1, the mo bile terminal 100 may include a wireless
`communication unit 110, an audio/video (AN) input unit
`120, a user input unit 130, a sensing unit 140, an output unit
`150, a memory 160, an interface unit 170, a controller 180,
`and a power supply unit 190. Two or more of the wireless
`communication unit 110, the AN input unit 120, the user
`input unit 130, the sensing unit 140, the output unit 150, the
`memory 160, the interface unit 170, the controller 180, and
`the power supply unit 190 may be incorporated into a single
`unit, or some of the wireless communication unit 110, the AN
`input unit 120, the user input unit 130, the sensing unit 140,
`35 the output unit 150, the memory 160, the interface unit 170,
`the controller 180, and the power supply unit 190 may be
`divided into two or more smaller units.
`The wireless communication unit 110 may include a
`broadcast reception module 111, a mobile communication
`40 module 113, a wireless internet module 115, a short-range
`communication module 117, and a global positioning system
`(GPS) module 119.
`The broadcast reception module 111 may receive a broad(cid:173)
`cast signal and/or broadcast-related information from an
`45 external broadcast management server through a broadcast
`channel. The broadcast channel may be a satellite channel or
`a terrestrial channel. The broadcast management server may
`be a server which generates broadcast signals and/or broad(cid:173)
`cast-related information and transmits the generated broad-
`50 cast signals and/or the generated broadcast-related informa(cid:173)
`tion or may be a server which receives and then transmits
`previously-generated broadcast signals and/or previously(cid:173)
`generated broadcast-related information.
`The broadcast-related information may include broadcast
`55 channel information, broadcast program information and/or
`broadcast service provider information. The broadcast signal
`may be a TV broadcast signal, a radio broadcast signal, a data
`broadcast signal, the combination of a data broadcast signal
`and a TV broadcast signal or the combination ofa data broad-
`60 cast signal and a radio broadcast signal. The broadcast-related
`information may be provided to the mobile terminal 100
`through a mobile communication network. In this case, the
`broadcast-related information may be received by the mobile
`communication module 113, rather than by the broadcast
`65 reception module 111. The broadcast-related information
`may come in various forms. For example, the broadcast(cid:173)
`related information may be electronic program guide (EPG)
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The above and other features and advantages of the present
`invention will become more apparent by describing in detail
`preferred embodiments thereof with reference to the attached
`drawings in which:
`FIG. 1 illustrates a block diagram of a mobile terminal
`according to an exemplary embodiment of the present inven(cid:173)
`tion;
`FIG. 2 illustrates a front perspective view of the mobile
`terminal shown in FIG. 1;
`FIG. 3 illustrates a rear perspective view of the mobile
`terminal shown in FIG. 1;
`FIGS. 4 through 8 illustrate the structure of a display mod(cid:173)
`ule capable of identifying a fingerprint, which can be used in
`the mobile terminal shown in FIG. 1;
`FIGS. 9A and 9B illustrate flowcharts of a method of
`controlling a mobile terminal according to a first exemplary
`embodiment of the present invention;
`FIG. 10 illustrates a flowchart of a method of controlling a
`mobile terminal according to a second exemplary embodi(cid:173)
`ment of the present invention;
`FIG. 11 illustrates a flowchart of a method of controlling a
`mobile terminal according to a third exemplary embodiment
`of the present invention;
`FIG. 12 illustrates a flowchart of a method of controlling a
`mobile terminal according to a fourth exemplary embodiment
`of the present invention;
`FIGS. 13 through 16 illustrate how to register fingerprint
`information;
`FIGS. 17 through 21 illustrate how to lock or unlock a
`mobile terminal in response to a fingerprint-touch input;
`
`IPR2019-01011 Page 00036
`
`

`

`US 8,443,199 B2
`
`5
`of digital multimedia broadcasting (DMB) or may be elec(cid:173)
`tronic service guide (ESG) of digital video broadcast-hand(cid:173)
`held (DVB-H).
`The broadcast reception module 111 may receive the
`broadcast signal using various broadcasting systems such as
`digital multimedia broadcasting-terrestrial (DMB-T), digital
`multimedia broadcasting-satellite (DMB-S), media forward
`link only (MediaFLO), DVB-H, and integrated services digi-
`tal broadcast-terrestrial (ISDB-T). In addition, the broadcast
`reception module 111 may be configured to be suitable for 10
`nearly all types of broadcasting systems other than those set
`forth herein. The broadcast signal and/or the broadcast-re(cid:173)
`lated information received by the broadcast reception module
`111 may be stored in the memory 160.
`The mobile communication module 113 may transmit 15
`wireless signals to or receives wireless signals from at least
`one of a base station, an external terminal, and a server
`through a mobile communication network. The wireless sig(cid:173)
`nals may include various types of data according to whether
`the mobile terminal 100 transmits/receives voice call signals, 20
`video call signals, or text/multimedia messages.
`The wireless internet module 115 may be a module for
`wirelessly accessing the internet. The wireless internet mod(cid:173)
`ule 115 may be embedded in the mobile terminal 100 or may
`be installed in an external device. The wireless internet mod- 25
`ule 115 may be embedded in the mobile terminal 100 or may
`be i