Apple Ex. 1016
`Apple Inc. v. Firstface Co., Ltd.
`IPR2019-00614
`Page 00001
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 1 of 33
`
`US 8,443,199 B2
`
`FIG, 1
`
`POWER SUPPLY UNIT
`
`190
`
`100
`
`105
`
`110
`
`150
`
`MOTION SENSOR
`
`157 CONTROLLER
`180
`
`DISPLAY MODULE
`
`151
`
`AUDIO OUTPUT
`
`ALARM MODULE
`
`155
`
`HAPTIC MODULE
`
`181
`
`160
`
`170
`
`IPR2019-00614 Page 00002
`
`W
`
`11
`
`113
`
`415
`
`117
`
`119
`
`120
`
`130
`
`140
`
`141
`
`143
`
`145
`
`WIRELESS
`COMMUNICATION UNIT
`BROADCAST
`RECEPTION MODUL
`MOBILE
`COMMUNICATION
`MODULE
`
`WIRELESS
`INTERNET MODULE
`FORTRAN
`COMMUNICATION
`MODULE
`
`GPS MODULE
`
`USER INPUT UNIT
`
`MULTIMEDIA
`PLAY MODULE
`
`PROXIMITY SENSOR
`
`PRESSURE SENSOR
`
`INTERFACE UNIT
`
`IPR2019-00614 Page 00002
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 2 of 33
`
`US 8,443,199 B2
`
`FIG, 2
`
`
`
`IPR2019-00614 Page 00003
`
`IPR2019-00614 Page 00003
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 3 of 33
`
`US 8,443,199 B2
`
`FIG, 3
`
`100A-2 100A-1
`
`
`
`
` 7p)~~100B-2
`
`
`
`1907]
`
`7~~1 00B-1
`
`IPR2019-00614 Page 00004
`
`IPR2019-00614 Page 00004
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet4 of 33
`
`
`
`
`
`
`
`IPR2019-00614 Page 00005
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 5 of 33
`
`US 8,443,199 B2
`
`
`KKK«lla
`
`(a)
`
` MALLCE Window
`Lidl a
`
`Scan-Flim
`
`IPR2019-00614 Page 00006
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 6 of 33
`
`US 8,443,199 B2
`
`
`
`Kl
`
`—K«*< LCD Module
`
`
`
` 7
`
`IPR2019-00614 Page 00007
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 7 of 33
`
`US 8,443,199 B2
`
`FIG. 7
`
`
`
`Processor
`
`Transistor (TR)
`
`Photo Diode (PD)
`
`(b)
`
`IPR2019-00614 Page 00008
`
`IPR2019-00614 Page 00008
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 8 of 33
`
`US 8,443,199 B2
`
`FIG, 8
`
`Soe
`
`me 100%
`
`IPR2019-00614 Page 00009
`
`IPR2019-00614 Page 00009
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 9 of 33
`
`US 8,443,199 B2
`
`FIG, 9A
`
`START
`
`
`
`
`$200
`
`$202
`
`
`
` IS THERE
`
`ANOTHER USER INPUT
`
`
`RECEIVED OR EVENT
`
`
`OCCURRED?
`
`
`$204
`
`
`
`CORRESPONDING TO RECEIVED
`
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER,
`USER-BY-USER
`
`PATTERN-BY-PATTERN BASIS
`
`
` Yes (A) IS THERE
`
`
`FINGERPRINT-TOUCH INPUT
`RECEIVED?
`
`
` PERFORM OPERATION
`USER INPUT OR OCCURRED EVENT
` ESCAPE FROM
`MODE?
`
`CURRENT OPERATING
`
`Yes
`
`END
`
`IPR2019-00614 Page 00010
`
`IPR2019-00614 Page 00010
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 10 of 33
`
`US 8,443,199 B2
`
`FIG. 9B
`
`$912
`DOES
`FINGERPRINT
`
`
`INFORMATION OF RECEIVED
`
`FINGERPRINT-TOUCH INPUT MATCH
`
`
`
`LOCK MOBILE TERMINAL
`WITH FINGERPRINT INFORMATION
`FOR LOCKING
`MOBILE TERMINAL?
`
`
` $210
`
`
`DOES
`FINGERPRINT
`INFORMATION OF RECEIVED
`FINGERPRINT-TOUCH INPUT MATCH
`
`UNLOCK MOBILE TERMINAL
`
`
`WITH FINGERPRINT INFORMATION
`FOR UNLOCKING
`
`
`MOBILE TERMINAL?
`
`DOES
`
`FINGERPRINT
`
`INFORMATION OF RECEIVED
`
`FINGERPRINT-TOUCH INPUT MATCH
`
`
`TEMPORARILY UNLOCK
`WITH FINGERPRINT INFORMATION
`MOBILE TERMINAL
`
`
`
`TEMPORARILY UNLOCKING
`MOBILE TERMINAL?
`
`
`TREAT RECEIVED
`FINGERPRINT-TOUCH INPUT
`
`
`
`
`AS ORDINARY TOUCH INPUT
`
`IPR2019-00614 Page 00011
`
`IPR2019-00614 Page 00011
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 11 of 33
`
`US 8,443,199 B2
`
`FIG. 10
`
`START
`
`
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY-
`USER, PATTERN-BY-PATTERN BASIS
`
`
`
`
`
`
`
`
`S260
`
`
`DISPLAY OPERATION SCREEN .
`
`S254
`
`
`
`IS THERE FINGERPRINT
`-TOUCH INPUT RECEIVED?
`
`
`
`No
`
`
`
`
`
`Yes
`
`$258
`
`CONTROL DISPLAY OF QPERATION
`SCREEN IN ACCORDANCE WITH
`PREDEFINED CONTROL VALUE
`
`TREAT RECEIVED FINGERPRINT
`-TOUCH INPUT AS ORDINARY
`TOUCH INPUT
`
`
`
`$262
`
`
`S THERE
`
`ANOTHER USER INPU
`No
`RECEIVED OR EVENT
`OCCURRED?
`
`
`
`PERFORM OPERATION
`CORRESPONDING TO RECEIVED
`
`USER INPUT OR OCCURRED EVENT
`
`
`S266
`
`ESCAPE FROM
`
`
`
`CURRENT OPERATING MODE?
`
`No
`
`Yes
`
`END
`
`IPR2019-00614 Page 00012
`
`IPR2019-00614 Page 00012
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 12 of 33
`
`US 8,443,199 B2
`
`FIG, 11
`
`$300
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY-USER,
`PATTERN-BY-PATTERN BASIS
`
`$302
`
`
`
`
`
`
`LOCK MOBILE TERMINAL
`
`
`
`IS THERE
`
`FINGERPRINT-TOUCH INPUT
`RECEIVED?
`
`
`
`NFOR
`
`INGERPRINT-TO
`FINGERPRIN
`
`UNLO!
`
`$308
`
`UNLOCK MOBILE TERMINAL AND
`ENTER PREDEFINED OPERATING MODE
`
`
`
`IPR2019-00614 Page 00013
`
`IPR2019-00614 Page 00013
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 13 of 33
`
`US 8,443,199 B2
`
`FIG. 12
`
`START
`
`STORE FINGERPRINT INFORMATION
`ON FINGER-BY-FINGER, USER-BY-
`USER, PATTERN-BY-PATTERN BASIS
`
`DISPLAY SCREEN SHOWING
`GROUP OF MENU ICONS
`
`$350
`
`$352
`
`
`
`$354
`
`IS THERE
`FINGERPRINT-TOUCH INPUT
`
`
`RECEIVED?
`
` RECEIVED OR EVENT
`
`
`
`
`
`TREAT RECEIVED FINGERPRINT
`-TOUCH INPUT AS ORDINARY
`TOUCH INPUT
`
`S360
`
`
`
`OCCURRED?
`
`
` PERFORM OPERATION
`
`CORRESPONDING TO RECEIVED
`
`
`USER INPUT OR OCCURRED EVENT
`
`
`
`ESCAPE FROM
`CURRENT OPERATING MODE?
`
`
`Yes
`
`
`
`
`END
`
`IPR2019-00614 Page 00014
`
`IPR2019-00614 Page 00014
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 14 of 33
`
`US 8,443,199 B2
`
`FIG. 13
`
`400
`
`FUNCTION.
`
`Yili
`
`12:47AM
`
`THE FINGERPRINT
`DENTIFICATION FUNCTION
`IS PROVIDED.
`PLEASE REGISTER
`FINGERPRINT FOR USE
`OF THE FINGERPRINT
`IDENTIFICATION
`
`IPR2019-00614 Page 00015
`
`IPR2019-00614 Page 00015
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 15 of 33
`
`US 8,443,199 B2
`
`FIG. 14
`
`420
`
`
`
`
`
`Fal
`12:47AM
`
`
`FINGERPRINT TOUCH
`
`
`1, FINGERPRINT TOUCH
`On/Off
`
`2, FINGERPRINT STORAGE| FINGERPRINT
`STORAGE
`
`
`
`
`
`THERE IS NO
`FINGERPRINT
`REGISTERED
`
`1.MAIN FINGERPRINT
`2. AUXILIARY
`FINGERPRINT
`
`1. FINGERPRINT TYPE1
`2. FINGERPRINT TYPE2
`3. FINGERPRINT TYPES
`4. FINGERPRINT TYPE4
`
`§. FINGERPRINT TYPES
`
`IPR2019-00614 Page 00016
`
`IPR2019-00614 Page 00016
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 16 of 33
`
`US 8,443,199 B2
`
`FIG. 15
`
`450
`
`
`
`
`
`
`ADD FINGERPRINT
`
`@FINGERPRINT NAME
`FINGERPRINT TYPE1
`
`
`
`
`SENSING AREA @ ViBRATION
`VIBRATION1
`
`e FINGERPRINT SENSING AREA
`PLEASE DRAG YOUR
`FINGER VERTICALLY
`ACROSS THE
`FINGERPRINT
`
`
`
`
`IPR2019-00614 Page 00017
`
`IPR2019-00614 Page 00017
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 17 of 33
`
`US 8,443,199 B2
`
`FIG. 16
`
`500
`
`510
`
`@p12:47AM
`
`LOCK ALL
`
`LOCK WHEN
`TURNED ON
`@ LOCK/UNLOCK
`
`IPR2019-00614 Page 00018
`
`
`
`LOCK
`1. OUTGOING CALL
`RESTRICTIONS
`2. INTERNET ACCESS
`RESTRICTIONS
`3, PRIVACY PROTECTION
`
`505
`
`4. LOCK ALL
`
`——
`
`5. CHANGE PASSWORD
`
`6. PASSWORD HINT
`
`7. EMERGENCY NUMBER
`REGISTRATION
`
`IPR2019-00614 Page 00018
`
`

`

` O¢S
`
`W272
`
`NOG1‘SNOH
`
`3WVN@
`
`
`
`U.S. Patent
`
`May 14, 2013
`
`Sheet 18 of 33
`
`US 8,443,199 B2
`
`OvS
`
`0S
`
`LT“DI
`
`
`
`ANIHdYSONISeYANXAGNI
`
`
`
`NOILONNJGALVIOOSSV@
`
`Loo[|
`
`
`
`
`
`
`YAONIFFICCI
`
`VadNOILINDOOSYeANIHGYSONIS
`
`
`
`NOILONNdGALVIDOSSV@
`
`
`
`CZ
`
`
`
`YAONISXSQNI
`
`
`
`VWsuvNOLINDSOOSYeANIWdGYIONIS
`
`
`
`NOILONNJC3LVIOOSSV@
`
`IPR2019-00614 Page 00019
`
`IPR2019-00614 Page 00019
`
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 19 of 33
`
`US 8,443,199 B2
`
`FIG. 18
`
`600
`
`
`
`603
`
`
`
`
`
`
`
`
`IPR2019-00614 Page 00020
`
`IPR2019-00614 Page 00020
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 20 of 33
`
`US 8,443,199 B2
`
`FIG. 19
`
`610
`
`620
`
`
`
`Fil
`12:47AM
`Ful
`
`All contacts +
`[a]
`|@2009.2250
`
`12:47AM
`
`Agnes Milne® ©
`222-333-5555
`
`
`
`IPR2019-00614 Page 00021
`
`IPR2019-00614 Page 00021
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 21 of 33
`
`US 8,443,199 B2
`
`FIG. 20
`
`630
`
`640
`
`633
`ner 6
`
`12:47AM
`
`oe)
`Agnes Milne
`nfijun.ths is realyco
`
`Ba Angelina Taylor
`Trere @ ro roxcn for
`
`pq 000-111-2222crass
`i yur
`hig 1S [ealy
`
`@912:47AM
`
`IPR2019-00614 Page 00022
`
`IPR2019-00614 Page 00022
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 22 of 33
`
`US 8,443,199 B2
`
`FIG, 21
`
`
`
`IPR2019-00614 Page 00023
`
`IPR2019-00614 Page 00023
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 23 of 33
`
`US 8,443,199 B2
`
`
`
`NOLLWH31209/43
`
`JO8OS
`
`NOIWH37S99V/G4Sd$
`INIHdYSDNIS
`NOWLWH31399V/d33dS
`
`66Old
`
`
`
`
`
`MO71AXSAbYasn
`
`WAWHON
`
`HOIH
`
`HOIHAW3A
`
`
`
`HSONIAXAQNI
`
`WWHON
`
`HAONISATA!
`
`YSIONISONIY
`
`WWHON
`
`HOIH
`
`eyasn
`
`vYssn
`
`
`
`HAONIdFILL
`
`
`
`HOIHAYSASuasn
`
`IPR2019-00614 Page 00024
`
`IPR2019-00614 Page 00024
`
`
`
`
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 24 of 33
`
`US 8,443,199 B2
`
`NOLLVYS1390W/GAadS
`
`(9)
`
`NOUUWHS1309/0adSHONOL
`
`IOSINIddu3ONId
`NOILLWHS1390V/dadS
`
`SISV@NN|@WNHL
`
`SISWENASY¥OS|
`
`SISVESANIT¢
`
`YAONIS
`
`
`
`SISVdNAAYOS@
`
`
`
`
`
`XSCNI coUI
`
`SISVGSNITE
`
`
`WIONISFICCI
`
`SIS¥dNASHOS€&
`
`SISVdSANIT7
`
`HAONISONIY
`
`SISV@N33YOS¥
`
`SISVESNITS
`
`
`YIONIFILL
`
`
`
`SISVGNASHOSS
`
`IPR2019-00614 Page 00025
`
`IPR2019-00614 Page 00025
`
`
`
`
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 25 of 33
`
`US 8,443,199 B2
`
`FIG. 24
`
`700
`
`Co)
`
`
`
`IPR2019-00614 Page 00026
`
`Yul
`
`512:47AM
`
`705
`@|Agnes Mijré* © 720
`
` ;
`aa,
`G
`Ah)
`@ 222-35
`\N.
`B®) Angeling~-" *
`707718|azzafls “2
`A|Billy on]
`Al ae
`
`
`IN
`
`
`IPR2019-00614 Page 00026
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 26 of 33
`
`US 8,443,199 B2
`
`
`
`0 2.
`Z
`
`NOWINDON3Y|>" OS4
`
`
`
`NOIUND003Y©
`G6“Old 9
`NOLLINDOO3d-
`
`0
`2
`
`IPR2019-00614 Page 00027
`
`IPR2019-00614 Page 00027
`
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 27 of 33
`
`US 8,443,199 B2
`
`FIG, 26
`
`(
`!
`I Dra
`!
`/
`
`\
`VERY SLOWLY |
`toy
`NORMAL
`| ~
`QUICKLY
`VERY QUICKLY|
`
`
`
`
`
`«KANG, SAN AE
`
`@ KANG, S00J
`@KANG;WON RAE
`@ KIM INSK
`
`¥011-QOXX-XXXX
`
`790
`
`791
`
`IPR2019-00614 Page 00028
`
`IPR2019-00614 Page 00028
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 28 of 33
`
`US 8,443,199 B2
`
`FIG. 27
`
`C(O THUMB
`
`|
`l
`| a,
`
`(/
`
`|
`|
`
`|
`|
`INDEX FINGER |
`
`MIDDLE FINGER
`
`RING FINGER
`
`!
`r ~~
`
`LITTLE FINGER
`
`
`800
`
`(=) The Beautiful Girls (Z)
`
`~
`
`
`
`IPR2019-00614 Page 00029
`
`IPR2019-00614 Page 00029
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 29 of 33
`
`US 8,443,199 B2
`
`FIG, 28
`
` —_———
`
`THUMB
`
`INDEX FINGER
`
`MIDDLE FINGER
`
`RING FINGER
`
`r me
`
`FIG. 29
`
`820
`
`LITTLE FINGER |
`
`
`
`me
`
`|
`
`|
`INDEX FINGER |
`
`MIDDLEFINGER|
`RING FINGER
`[~~~
`LITTLE FINGER
`
`Yul
`
`
`
`7
`
`é
`
`|
`
`{ ! (
`
`f
`
`4NY /
`
`(s)aaaJ)
`
`012:47AM
`
`~
`
`
`
`IPR2019-00614 Page 00030
`
`IPR2019-00614 Page 00030
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 30 of 33
`
`US 8,443,199 B2
`
`FIG, 30
`
`|
`
`|
`|
`
`|
`| a,
`
`/
`
`!
`(
`
`THUMB
`
`I
`|
`INDEX FINGER |
`|
`
`MIDDLE FINGER!
`RING FINGER bo
`LITTLE FINGER |
`)
`
`ee —_
`
`830
`
`i]
`
`
`
`In a small telephoney
`market, the most impor-
`ant issune for users
`
`would bethe values
`such as "user-frinedlines
`
`values,tradii®nalluy
`LG has been providing
`hybrid architecture in the
`
`IPR2019-00614 Page 00031
`
`IPR2019-00614 Page 00031
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 31 of 33
`
`US 8,443,199 B2
`
`FIG. 31
`
`840
`
`845
`
`
`
`
`847
`
`Press to unlock
`
`
`{Sl -Message
`2nd -Music
`3° -Contacts
`
`Ath -Alarm
`5th -Game
`
`
`
`850
`
`855
`
`
`
`
`
`Press to unlock
`
`
`
`{St -Message
`2nd -Music
`
`860
`
`
`
`
`[>] The Beautiful Girls [2]
`he beautifulgirls
`Luces Kusting
`
`
`
`IPR2019-00614 Page 00032
`
`IPR2019-00614 Page 00032
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 32 of 33
`
`US 8,443,199 B2
`
`FIG. 32
`
`870
`
`welalela
`
`Tw
`
`
`
`Ce CEN EF) GS
`| fol
`te] @4
`O
`
`
`
`ie(S) (BE)
`(fe) 4) Ash:
`
`IPR2019-00614 Page 00033
`
`IPR2019-00614 Page 00033
`
`

`

`U.S. Patent
`
`May14, 2013
`
`Sheet 33 of 33
`
`US 8,443,199 B2
`
`FIG. 33
`
`890
`
`
`
`
`$9) [9]
`
`
`
`
`pis)
`
`@
`
`andy
`
`895
`
`
`
`
`
`IPR2019-00614 Page 00034
`
`IPR2019-00614 Page 00034
`
`

`

`US 8,443,199 B2
`
`1
`MOBILE TERMINAL AND METHOD OF
`CONTROLLING THE MOBILE TERMINAL
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application claims the priority benefit of Korean
`Patent Application No. 10-2009-0023211, filed on Mar. 18,
`2009 and Korean Patent Application No. 10-2010-0020866,
`filed on Mar. 9, 2010 in the Korean Intellectual Property
`Office, the disclosure of which is incorporated herein by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`The present invention relates to a mobile terminal and a
`method of controlling the mobile terminal, and moreparticu-
`larly, to a mobile terminal and a method of controlling the
`mobile terminal, in which various operations performed by
`the mobile terminal can be effectively controlled in response
`to a fingerprint-touch input having fingerprint information.
`2. Description of the Related Art
`Mobile terminals are portable devices, which can provide
`users with various services such as a voice calling service, a
`video calling service, an information input/output service,
`and a data storage service.
`As the types of services provided by mobile terminals
`diversify, an increasing number of mobile terminals have
`been equipped with various complicated functions such as
`capturing photos or moving pictures, playing music files or
`moving image files, providing game programs, receiving
`broadcast programs and providing wireless internet services
`and have thus evolved into multimedia players.
`Various attempts have been madeto realize such compli-
`cated functions as hardware devices or software programs.
`For example, various user interface (UI) environments, in
`which users are allowed to easily search for and choose
`desired functions, have been developed. In addition,
`the
`demand for various designs for mobile terminals such as a
`double-sided liquid crystal display (LCD) or a full touch
`screen has steadily grown due to a growing tendency of con-
`sidering mobile terminals as personal items that can represent
`personal individuality.
`However,there is a restriction in allocating sufficient space
`for the installation of a UI such as a display or a keypad
`without compromising the mobility and the portability of the
`mobile terminal. Therefore, it is necessary to develop waysto
`control the operation of a mobile terminal using a new data
`input method and thus use various complicated functions
`provided by the mobile terminal with convenience.
`
`SUMMARYOF THE INVENTION
`
`The present invention provides a mobile terminal and a
`methodof controlling the mobile terminal, in which various
`operations performed by the mobile terminal can be effec-
`tively controlled in responseto a fingerprint-touch input hav-
`ing fingerprint information.
`According to an aspect of the present invention, there is
`provided a method of controlling a mobile terminal, the
`methodincluding storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-userbasis, and a pattern-by-pattern basis; receiving a
`fingerprint-touch input through a display module capable of
`performingfingerprint identification; andif fingerprint infor-
`mation of the received fingerprint-touch input matches with
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`2
`one ofthe plurality of pieces of fingerprint information for
`locking a predefined operating menu, locking the predefined
`operating menu.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger
`basis, auser-by-userbasis, and a pattern-by-pattern basis; and
`a controller configured to receive a fingerprint-touch input
`through the display module, wherein,if fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information for lock-
`ing a predefined operating menu, the controller locks the
`predefined operating menu.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-userbasis, and a pattern-by-pattern basis; displaying
`an operation screen on a display module capable of perform-
`ing fingerprint identification; receiving a fingerprint-touch
`input through the display module; andif fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information for con-
`trolling the display of a screen, controlling the display of the
`operation screen in accordance with a control value corre-
`spondingto the fingerprint information that matches with the
`fingerprint
`information of the received fingerprint-touch
`input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion and display an operation screen; a memory configured to
`store a plurality ofpieces offingerprint information on at least
`one of a finger-by-finger basis, a user-by-user basis, and a
`pattern-by-pattern basis; and a controller configured to
`receive a fingerprint-touch input through the display module,
`wherein, if fingerprint information of the received finger-
`print-touch input matches with oneofthe plurality of pieces
`of fingerprint information for controlling the display of a
`screen, the controller controls the display of the operation
`screen in accordance with a control value corresponding to
`the fingerprint information that matches with the fingerprint
`information of the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including locking a predefined operating mode;
`receiving a fingerprint-touch input through a display module
`capable of performing fingerprint identification; and if fin-
`gerprint information of the received fingerprint-touch input
`matches with one of a plurality ofpieces ofpreviously-stored
`fingerprint information for unlocking the predefined operat-
`ing mode, unlocking the predefined operating mode and
`entering an operating mode corresponding to the fingerprint
`information that matches with the fingerprint information of
`the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion; a memory configured to store a plurality of pieces of
`fingerprint information; and a controller configuredto receive
`a fingerprint-touch input
`through the display module,
`wherein, if fingerprint information of the received finger-
`print-touch input matches with one ofa plurality of pieces of
`previously-stored fingerprint information for unlocking the
`predefined operating mode, the controller unlocks the pre-
`IPR2019-00614 Page 00035
`
`IPR2019-00614 Page 00035
`
`

`

`US 8,443,199 B2
`
`3
`defined operating mode and enters an operating modecorre-
`spondingto the fingerprint information that matches with the
`fingerprint
`information of the received fingerprint-touch
`input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`methodincluding storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-userbasis, and a pattern-by-pattern basis; displaying
`a first screen showing a number of menu icons on a display
`module capable of performing fingerprint
`identification;
`receiving a fingerprint-touch input through the display mod-
`ule; andif fingerprint information ofthe received fingerprint-
`touch input matches with one of the plurality of pieces of
`fingerprint information, displaying a second screen showing a
`predefined group of menuicons correspondingto the finger-
`print information that matches with the fingerprint informa-
`tion of the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performingfingerprint identifica-
`tion and display a first screen showing a number of menu
`icons; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger
`basis, a user-by-user basis, and a pattern-by-pattern basis; and
`a controller configured to receive a fingerprint-touch input
`through the display module, wherein,if fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information, the con-
`troller displays a second screen showing a predefined group
`of menu icons corresponding to the fingerprint information
`that matches with the fingerprint information of the received
`fingerprint-touch input.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The above andotherfeatures and advantagesofthe present
`invention will become more apparent by describing in detail
`preferred embodiments thereof with reference to the attached
`drawings in which:
`FIG. 1 illustrates a block diagram of a mobile terminal
`according to an exemplary embodimentof the present inven-
`tion;
`FIG.2 illustrates a front perspective view of the mobile
`terminal shown in FIG.1;
`FIG. 3 illustrates a rear perspective view of the mobile
`terminal shown in FIG.1;
`FIGS. 4 through8 illustrate the structure of a display mod-
`ule capable of identifying a fingerprint, which can be used in
`the mobile terminal shown in FIG.1;
`FIGS. 9A and 9B illustrate flowcharts of a method of
`
`controlling a mobile terminal accordingto a first exemplary
`embodimentof the present invention;
`FIG.10 illustrates a flowchart of a method of controlling a
`mobile terminal according to a second exemplary embodi-
`mentof the present invention;
`FIG.11 illustrates a flowchart of a method of controlling a
`mobile terminal according to a third exemplary embodiment
`of the present invention;
`FIG.12 illustrates a flowchart of a method of controlling a
`mobile terminal according to a fourth exemplary embodiment
`of the present invention;
`FIGS. 13 through 16 illustrate how to register fingerprint
`information;
`FIGS. 17 through 21 illustrate how to lock or unlock a
`mobile terminal in responseto a fingerprint-touch input;
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`FIGS. 22 through 30 illustrate how to control a screen in
`responseto a fingerprint-touch input;
`FIG. 31 illustrates how to unlock a mobile terminal and
`
`enter a predetermined operating mode in responseto a fin-
`gerprint-touch input; and
`FIGS. 32 and 33 illustrate how to display menu icons
`classified into different menu groups in responseto a finger-
`print-touch input.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`The present invention will hereinafter be described in
`detail with reference to the accompanying drawings in which
`exemplary embodiments of the invention are shown.
`The term ‘mobile terminal’, as used herein, may indicate a
`mobile phone, a smart phone, a laptop computer, a digital
`broadcast receiver, a personal digital assistant (PDA), a por-
`table multimedia player (PMP), ora navigation device. In this
`disclosure, the terms ‘module’ and ‘unit’ can be used inter-
`changeably.
`FIG.1 illustrates a block diagram ofa mobile terminal 100
`according to an embodimentofthe present invention. Refer-
`ring to FIG. 1, the mobile terminal 100 mayinclude a wireless
`communication unit 110, an audio/video (A/V) input unit
`120, a user input unit 130, a sensing unit 140, an output unit
`150, a memory 160, an interface unit 170, a controller 180,
`and a power supply unit 190. Two or more of the wireless
`communication unit 110, the A/V input unit 120, the user
`input unit 130, the sensing unit 140, the output unit 150, the
`memory 160, the interface unit 170, the controller 180, and
`the power supply unit 190 may be incorporated into a single
`unit, or some ofthe wireless communication unit 110, the A/V
`input unit 120, the user input unit 130, the sensing unit 140,
`the output unit 150, the memory 160, the interface unit 170,
`the controller 180, and the power supply unit 190 may be
`divided into two or more smaller units.
`The wireless communication unit 110 may include a
`broadcast reception module 111, a mobile communication
`module 113, a wireless internet module 115, a short-range
`communication module 117, and a global positioning system
`(GPS) module 119.
`The broadcast reception module 111 mayreceive a broad-
`cast signal and/or broadcast-related information from an
`external broadcast managementserver through a broadcast
`channel. The broadcast channel maybea satellite channel or
`a terrestrial channel. The broadcast management server may
`be a server which generates broadcast signals and/or broad-
`cast-related information and transmits the generated broad-
`cast signals and/or the generated broadcast-related informa-
`tion or may be a server which receives and then transmits
`previously-generated broadcast signals and/or previously-
`generated broadcast-related information.
`The broadcast-related information may include broadcast
`channel information, broadcast program information and/or
`broadcast service provider information. The broadcast signal
`may bea TV broadcast signal, a radio broadcastsignal, a data
`broadcast signal, the combination of a data broadcast signal
`and a TV broadcastsignal or the combination ofa data broad-
`cast signal and a radio broadcastsignal. The broadcast-related
`information may be provided to the mobile terminal 100
`through a mobile communication network. In this case, the
`broadcast-related information may be received by the mobile
`communication module 113, rather than by the broadcast
`reception module 111. The broadcast-related information
`may come in various forms. For example, the broadcast-
`related information may be electronic program guide (EPG)
`IPR2019-00614 Page 00036
`
`IPR2019-00614 Page 00036
`
`

`

`US 8,443,199 B2
`
`5
`of digital multimedia broadcasting (DMB) or maybeelec-
`tronic service guide (ESG)ofdigital video broadcast-hand-
`held (DVB-H).
`The broadcast reception module 111 may receive the
`broadcast signal using various broadcasting systems such as
`digital multimedia broadcasting-terrestrial (DMB-T), digital
`multimedia broadcasting-satellite (DMB-S), media forward
`link only (MediaFLO), DVB-H,andintegrated services digi-
`tal broadcast-terrestrial (ISDB-T). In addition, the broadcast
`reception module 111 may be configured to be suitable for
`nearly all types of broadcasting systems other than those set
`forth herein. The broadcast signal and/or the broadcast-re-
`lated information received by the broadcast reception module
`111 maybe stored in the memory 160.
`The mobile communication module 113 may transmit
`wireless signals to or receives wireless signals from at least
`one of a base station, an external terminal, and a server
`through a mobile communication network. The wireless sig-
`nals may include various types of data according to whether
`the mobile terminal 100 transmits/receives voice call signals,
`videocall signals, or text/multimedia messages.
`The wireless internet module 115 may be a module for
`wirelessly accessing the internet. The wireless internet mod-
`ule 115 may be embeddedin the mobile terminal 100 or may
`be installed in an external device. The wireless internet mod-
`ule 115 may be embeddedin the mobile terminal 100 or may
`be installed in an external device. The wireless internet mod-
`ule 115 may use various wireless internet technologies such
`as wireless local area network (WLAN), Wireless Broadband
`(WiBro), World Interoperability for Microwave Access
`(Wimax), and High Speed Downlink Packet Access (HS-
`DPA).
`The short-range communication module 117 may be a
`module for short-range communication. The short-range
`communication module 117 may use various short-range
`communication techniques such as Bluetooth, radio fre-
`quency identification (RFID),
`infrared data association
`(IrDA), ultra wideband (UWB), and ZigBee.
`The GPS module 119 may receive position information
`from a plurality of GPSsatellites.
`The A/V input unit 120 may be used to receive audio
`signals or video signals. The A/V input unit 120 may include
`a camera 121 and a microphone 123. The camera 121 may
`process various image frames suchasstill images or moving
`images captured by an imagesensorduring a video call mode
`or an image capturing mode. The imageframes processed by
`the camera 121 may be displayed by a display module 151.
`The image frames processed by the camera 121 may be
`stored in the memory 160 or maybe transmittedto an external
`device through the wireless communication unit 110. The
`mobile terminal 100 may include two or more cameras 121.
`The microphone 123 mayreceive external sound signals
`during a call mode, a recording mode, or a voice recognition
`mode with the use ofa microphone and may convert the sound
`signals into electrical sound data. In the call mode, the mobile
`communication module 113 may convert the electrical sound
`data into data that can be readily transmitted to a mobile
`communication base station and then outputthe data obtained
`by the conversion. The microphone 123 may use various
`noise removal algorithms to remove noise that may be gen-
`erated during the reception of external soundsignals.
`Theuser input unit 130 may generate key input data based
`on user input for controlling the operation of the mobile
`terminal 100. The user input unit 130 may be implementedas
`a keypad, a dome switch, a touch pad(static pressure/static
`voltage), a jog wheel, or a jog switch.In particular, if the user
`input unit 130 is implemented as a touch pad and forms a layer
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`structure together with the display module 151, the user input
`unit 130 and the display module 151 maybe collectively
`referred to as a touch screen.
`
`The sensing unit 140 determines a current state of the
`mobile terminal 100 such as whether the mobile terminal 100
`
`is openedup or closed, the position ofthe mobile terminal 100
`and whether the mobile terminal 100 is placed in contact with
`a user, and generates a sensing signal for controlling the
`operation of the mobile terminal 100. For example, when the
`mobile terminal 100 is a slider-type mobile phone, the sens-
`ing unit 140 may determine whetherthe mobile terminal 100
`is opened up or closed. In addition, the sensing unit 140 may
`determine whether the mobile terminal 100 is powered by the
`powersupply unit 190 and whetherthe interface unit 170 is
`connected to an external device.
`
`The sensing unit 140 may include a proximity sensor 141,
`a pressure sensor 143 and a motion sensor 145. The proximity
`sensor 141 may determine whetherthere is an object nearby
`and approaching the mobile terminal 100 without any
`mechanical contact with the entity. More specifically, the
`proximity sensor 141 may detect an object that is nearby and
`approaching by detecting a change in an alternating magnetic
`field or the rate of change of static capacitance. The sensing
`unit 140 may include two or more proximity sensors 141.
`The pressure sensor 143 may determine whether pressure
`is being applied to the mobile terminal 100 or may measure
`the level of pressure, if any, applied to the mobile terminal
`100. The pressure sensor 143 maybeinstalled ina certain part
`of the mobile terminal 100 where the detection of pressure is
`necessary. For example, the pressure sensor 143 may be
`installed in the display module 151. In this case, it is possible
`to differentiate a typical touch input from a pressure touch
`input, which is generated using a higher pressure level than
`that used to generate a typical touch input, based on data
`provided by the pressure sensor 143. In addition, when a
`pressure touch input is received through the display module
`151, itis possible to determinethe level ofpressure applied to
`the display module 151 uponthe detection of a pressure touch
`input based on data provided bythe pressure sensor 143.
`The motion sensor 145 may determine the location and
`motion of the mobile terminal 100 using an acceleration
`sensoror a gyro sensor.
`In the meantime,acceleration sensors are a type of device
`for converting a vibration in acceleration into an electric
`signal. With recent developments in micro-electromechanical
`system (MEMS)technology, acceleration sensors have been
`widely used in various products for various purposes ranging
`from detecting large motions such as car collisions as per-
`formedin airbag systems for automobiles to detecting minute
`motions such as the motion of the hand as performed in
`gaming input devices. In general, one or more acceleration
`sensors representing twoor three axial directions are incor-
`porated into a single package. There are some cases when the
`detection of only one axial direction, for example, a Z-axis
`direction, is necessary. Thus, when an X- or Y-axis accelera-
`tion sensor,
`instead of a Z-axis acceleration sensor,
`is
`required,
`the X- or Y-axis acceleration sensor may be
`mounted on an additional substrate, and the additional sub-
`strate may be mounted on a main substrate.
`Gyro sensors are sensors for measuring angular velocity,
`and may determinetherelative directionofthe rotation ofthe
`mobile terminal 100 to a reference direction.
`
`The output unit 150 may output audio signals, video sig-
`nals and alarm signals. The output unit 150 may include the
`display module 151, an audio output module 153, an alarm
`module 155, and a haptic module 157.
`IPR2019-00614 Page 00037
`
`IPR2019-00614 Page 00037
`
`

`

`US 8,443,199 B2
`
`7
`The display module 151 may display various information
`processed by the mobile terminal 100. For example, if the
`mobile terminal 100 is in a call mode, the display module 151
`may display a user interface (UI) or a graphic user interface
`(GUI) for making or receiving a call. If the mobile terminal
`100 is in a video call mode or an image capturing mode, the
`display module 151 may display a UI or a GUIfor capturing
`or receiving images.
`If the di