Apple Ex. 1016
`Apple Inc. v. Firstface Co., Ltd.
`IPR2019-00614
`Page 00001
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 1 of 33
`
`US 8,443,199 B2
`
`FIG. 1
`
`POWER SUPPLY UNIT
`
`190
`
`m
`
`105
`
`‘7
`
`110
`
`150
`
`WIRELESS
`COMMUNICATION UNIT
`
`RECEPTION MODUL
`MoBLE
`MODULE
`COMMUNICATION
`
`WIRELESS
`INTERNET MODULE
`. . . _. , V
`COMMUNICATION
`MODULE
`
`
`
`113
`
`1 1 5
`
`I 17
`
`120
`
`130
`
`USER INPUT UNIT
`
`MULTIMEDIA
`PLAY MODULE
`
`MOTION SENSOR
`
`PRESSURE SENSOR
`
`143
`
`I45
`
`INTERFACE UNIT
`
`IPR2019-00614 Page 00002
`
`180 I40
`
` HAPTIC MODULE
`
`MODULE
`AUDIO OUTPUT
`
`ALARM MODULE
`
`151
`
`153
`
`155
`
`157
`
`160
`
`CONTROLLER
`
`181
`
`IPR2019-00614 Page 00002
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 2 of 33
`
`US 8,443,199 B2
`
`FIG. 2
`
`
`
`IPR2019-00614 Page 00003
`
`IPR2019-00614 Page 00003
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 3 of 33
`
`US 8,443,199 B2
`
`FIG. 3
`
`1OOA-2 1OOA*1
`
`190/\._/
`
`
`
`
`
`
`
`
`/\_/1OOB'1
`
`’\_/1OOB-2
`
`IPR2019-00614 Page 00004
`
`IPR2019-00614 Page 00004
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 4 of 33
`
`/
`
`OOOOOOOOOOOO
`
`W
`
`
`
`
`
`W m
`
`
`
`
`
`///////////////////I
`
`
`
`2%
`
`
`
`
`eeeee
`
`(b)
`
`IPR2019-00614 Page 00005
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 5 of 33
`
`US 8,443,199 B2
`
`
`//////////////////%if:
`
`\\\\\\\
`
`(a)
`
`
`
`
`
`///////////fl/ Window
`
`
`
`Scan-Fum
`
`////////////////////
`
`:33:
`
`IPR2019-00614 Page 00006
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 6 of 33
`
`US 8,443,199 B2
`
`
`
`
`
`
`
`
`
`\\
`
`\\\\\\\\(€3
`
`
`
`
`
`IPR2019-00614 Page 00007
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 7 of 33
`
`US 8,443,199 B2
`
`FIG. 7
`
`Transistor (FR)
`
`
`
`Processor
`
`Photo Diode (PD)
`
`(b)
`
`IPR2019-00614 Page 00008
`
`IPR2019-00614 Page 00008
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 8 of 33
`
`US 8,443,199 B2
`
`FIG. 8
`
`
`
`m: ERI-
`
`
`
`
` “-
`
`IPR2019-00614 Page 00009
`
`IPR2019-00614 Page 00009
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 9 of 33
`
`US 8,443,199 B2
`
`FK3.9A
`
`START
`
`STORE FINGERPRINT INFORMATION
`
`ON FINGER—BY—FINGER,
`USER-BY-USER
`
`PATTERN—BY—PATTERN BASIS
`
`
`
`
`S200
`
`
`8202
`
`Yes
`IS THERE
`
`FINGERPRINT—TOUCH INPUT
`
`RECEIVED?
`
`S204
`
`
`IS THERE
`ANOTHER USER INPUT
`
`
`RECEIVED OR EVENT
`
`OCCURRED?
`
`
`PERFORM OPERATION
`
`
`CORRESPONDING TO RECEIVED
`
`
`USER INPUT OR OCCURRED EVENT
`
`
` ESCAPE FROM
`CURRENT OPERATING
`
`
`MODE?
`
`
`Yes
`
`END
`
`IPR2019-00614 Page 00010
`
`IPR2019-00614 Page 00010
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 10 of 33
`
`US 8,443,199 B2
`
`FIG. 9B
`
`DOES
`8210
`
`
`8212
`FINGERPRINT
`
`
`INFORMATION OF RECEIVED
`
`FINGERPRINT-TOUCH INPUT MATCH
`
`LOCK MOBILE TERMINAL
`
`
`WITH FINGERPRINT INFORMATION
`
`FOR LOCKING
`
`MOBILE TERMINAL?
`
`
`
`
`
`DOES
`FINGERPRINT
`
`INFORMATION OF RECEIVED
`FINGERPRINT-TOUCH INPUT MATCH
`
`
`WITH FINGERPRINT INFORMATION
`
`
`FOR UNLOCKING
`MOBILE TERMINAL?
`
`
`UNLOCK MOBILE TERMINAL
`
`
`DOES
`
`
`FINGERPRINT
`
`INFORMATION OF RECEIVED
`FINGERPRINT—TOUCH INPUT MATCH
`
`
`WITH FINGERPRINT INFORMATION
`TEMPORARILY UNLOCKING
`
`
`MOBILE TERMINAL?
`
`TEMPORARILY UNLOCK
`
`MOBILE TERMINAL
`
`
`
`
`TREAT RECEIVED
`
`FINGERPRINT—TOUCH INPUT
`
`AS ORDINARY TOUCH INPUT
`
`
`
`IPR2019-00614 Page 00011
`
`IPR2019-00614 Page 00011
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 11 of 33
`
`US 8,443,199 B2
`
`FIG. 10
`
`START
`
`STORE FINGERPRINT INFORMATION
` S250
`
`
`ON FINGER—BY—FINGER. USER-BY—
`USER, PATTERN—BY—PA'ITERN BASIS
`
`
`DISPLAY OPERATION SCREEN .
`
`8252
`
`
`
`
`
`
`
`8260
`
`8254
`
`No
`
`
`IS THERE FINGERPRINT
`
`-TOUCH INPLT RECEIVED?
`
`
`
`Yes
`
`8258
`
`CONTROL DISPLAY OF OPERATION
`SCREEN IN ACCORDANCE WITH
`PREDEFINED CONTROL VALUE
`
`TREAT RECEIVED FINGERPRINT
`—TOUCH INPUT AS ORDINARY
`TOUCH INPUT
`
`
`ANOTHER USER INPU
`
`RECEIVED OR EVENT
`OCCURRED?
`
`
`
`PERFORM OPERATION
`CORRESPONDING TO RECEIVED
`
`USER INPUT OR OCCURRED EVENT
`
`
`8266
`
`No
`
`
`ESCAPE FROM
`
`CURRENT OPERATING MODE?
`
`
`
`
`Yes
`
`END
`
`IPR2019-00614 Page 00012
`
`IPR2019-00614 Page 00012
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 12 of 33
`
`US 8,443,199 B2
`
`FIG. 11
`
`
`
`8300
`
`STORE FINGERPRINT INFORMATION
`ON FINGER—BY—FINGER, USER-BY-USER,
`
`
`
`PATTERN—BY-PATTERN BASIS
`
`LOCK MOBILE TERMINAL
`
`8302
`
`K
`
`
`
`IS THERE
`FINGERPRINT-TOUCH INPUT
`
`
`RECEIVED?
`
`
`
`INFORF
`
`
`INGERPRINT-TOUOCH INPUT MATCH WIT
`
`
`FINGERLIJDIR’INTNINFORMATION FOR
`
`S306
`
`
`
`
`
`UNLOCK MOBILE TERMINAL AND
`
`
`ENTER PREDEFINED OPERATING MODE
`
`IPR2019-00614 Page 00013
`
`IPR2019-00614 Page 00013
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 13 of 33
`
`US 8,443,199 B2
`
`FIG. 12
`
`START
`
`STORE FINGERPRINT INFORMATION
`ON FINGER—BY—FINGER, USER—BY—
`USER, PATTERN—BY—PATTERN BASIS
`
`DISPLAY SCREEN SHOWING
`GROUP OF MENU ICONS
`
`8350
`
`8352
`
`$354
`
`IS THERE
`
`FINGERPRINT—TOUCH INPUT
`
`RECEIVED?
`
`
`
`
`8360
`
`TREAT RECEIVED FINGERPRINT
`
`—TOUCH INPUT AS ORDINARY
`
`LAY SCREEN S
`TOUCH INPUT
`O MENU ICONS CO
`
`
`TO FINGERPRINT INFO
`MATCHES WITH FINGERPRINT
`
`
`INFORMATION OF RECEI
`FINGERPRINT-TOUCH IN
`
`
`
`ANOTHER USER INPU
`
`RECEIVED OR EVENT
`
`OCCURRED'7
`
`
`
`
` PERFORM OPERATION
`
`CORRESPONDING TO RECEIVED
`
`
`USER INPUT OR OCCURRED EVENT
`
`
`
`
`
`ESCAPE FROM
`CURRENT OPERATING MODE?
`
`
`Yes
`
`END
`
`IPR2019-00614 Page 00014
`
`IPR2019-00614 Page 00014
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 14 of 33
`
`US 8,443,199 B2
`
`FIG. 13
`
`400
`
`7..“
`
`9312:47AM
`
`FUNCTION.
`
`THE FINGERPRINT
`DENTIFICATION FUNCTION
`IS PROVIDED.
`PLEASE REGISTER
`FINGERPRINT FOR USE
`OF THE FINGERPRINT
`IDENTIFICATION
`
`IPR2019-00614 Page 00015
`
`IPR2019-00614 Page 00015
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 15 of 33
`
`US 8,443,199 B2
`
`FIG. 14
`
`420
`
`
`
`
`
`Yd!
`@12z47AM
`
`
`FINGERPRINT TOUCH
`
`
`
`1 FINGERPRINT TOUCH
`
`
`0N0“
`2 FINGERPRINTSTORAGE FINGERPRINT
`STORAGE
`
`
`
`
`
`
`
`
`
`THERE IS NO
`FINGERPRINT
`REGISTERED
`
`‘1 MAIN FINGERPRINT
`
`2 AUXILIARY
`FINGERPRINT
`
`1, FINGERPRINT TYPE1
`2. FINGERPRINT TYPE2
`3, FINGERPRINT TYPES
`4. FINGERPRINT TYPE4
`
`5, FINGERPRINT TYPES
`
`IPR2019-00614 Page 00016
`
`IPR2019-00614 Page 00016
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 16 of 33
`
`US 8,443,199 B2
`
`FIG. 15
`
`450
`
`ADD FINGERPRINT
`
`.FINGERPRINT NAME
`FINGERPRINT TYPEI
`
`. FINGERPRINT SENSING AREA
`PLEASE DRAG YOUR
`FINGER VERTICALLY
`ACROSS THE
`FINGERPRINT
`
`
`
`
`
`
`
`
` SENSING AREA
`
`VIBRATIONI ‘
`
`.VIBRATIOIV
`
`
`
`
`
`IPR2019-00614 Page 00017
`
`IPR2019-00614 Page 00017
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 17 of 33
`
`US 8,443,199 B2
`
`FIG. 16
`
`500
`
`510
`
`505
`
`01112147AM
`OCK
`1. OUTGOING CALL
`RESTRICTIONS
`2, INTERNET ACCESS
`RESTRICTIONS
`3. PRIVACY PROTECTION
`
`—L
`
`
`
`
`
`4. LOCK ALL
`
`——-——>-
`
`5. CHANGE PASSWORD
`
`6, PASSWORD HINT
`
`7. EMERGENCY NUMBER
`REGISTRATION
`
`IPR2019-00614 Page 00018
`
`IPR2019-00614 Page 00018
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 18 of 33
`
`US 8,443,199 B2
`
`
`
`
`
`HZEnEmozE.ImOZEXmoz_
`
`
`
`295238268?.
`
`MEI
`
`
`
`
`SZNYNFQ
`
`
`
`mmOZExmoz_
`
`
`
`mmOZE300:2
`
`
`
`<mm<Z/O_._._ZOOOmm.._.z_mn.mm_Oz_u_
`
`mszZ.
`
`
`
`2052282682.
`
`
`
`3GE
`
`mm
`
`o
`
`
`
`
`
`XOOJZDEQOJzmwmow
`
`
`
`2952282582.
`
`IPR2019-00614 Page 00019
`
`N m
`
`gnvnmvg
`
`020042.020:
`
`mmozmmeZ
`
`
`
` xV\<mm<zoEszomm.FzEnEmozE
`
`£52.
`
`IPR2019-00614 Page 00019
`
`
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 19 of 33
`
`US 8,443,199 B2
`
`FIG. 18
`
`600
`
`
`
`
`
`
`
`603
`
`
`
`
`
`
`
`IPR2019-00614 Page 00020
`
`IPR2019-00614 Page 00020
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 20 of 33
`
`US 8,443,199 B2
`
`FIG. 19
`
`610
`
`620
`
`7,."
`
`@12:47AM
`
`E,
`
`Allcontacmv
`
`Agnes Milnei @
`222—333-5555
`
`
`
`
`
`
`
`IPR2019-00614 Page 00021
`
`IPR2019-00614 Page 00021
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 21 of 33
`
`US 8,443,199 B2
`
`FIG. 20
`
`630
`
`640
`
`7,."
`
`
`@12147AM
`
`Y,“
`
`@12:47AM
`
`T'*era a m mxcn to'
`
`IE Agnes Milne
`"1i ijhzs is realyco
`
`[8 Angelina Taylor
`
`IPR2019-00614 Page 00022
`
`IPR2019-00614 Page 00022
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 22 of 33
`
`US 8,443,199 B2
`
`FIG. 21
`
`650
`
`660
`
`
`
`IPR2019-00614 Page 00023
`
`IPR2019-00614 Page 00023
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 23 of 33
`
`US 8,443,199 B2
`
`jOmom
`
`ZO_H<mm._moo<\Dmmn_m
`
`
`
`>>On_>mm>
`
`._.Z_mn_mm_wz_n_
`
`10:9.
`
`Fzmmtdd
`
`mzmmE/E
`
`J_<SEOZ
`
`mzmmtuqa
`
`IQ:
`
`vzmmt<m
`
`
`
`IQ:>mm>
`
`mzmmE/E
`
`HZEQWEOZF. mm.05
`
`gmmfizmmien:HmmOZEmeZ_
`
`%ImOZE5t:HmmGZE02E
`
`ZOF<mm4moo<EmmmwIODOH
`jOmOm
` ZO:.<mmeO<\men_m
`
`jOmOW
`
`HzEamwOZE
`
`IODOH
`
`
`
`IPR2019-00614 Page 00024
`
`IPR2019-00614 Page 00024
`
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 24 of 33
`
`US 8,443,199 B2
`
`
`
`
`
`ZO_._.<mm._m_oo<\Qm_mn.mIODOH
`
`
`._._Omow.rzEnEmGZE
`
`2ExmwamIQDOHOmflmmwmaHzEnEmOZE
`2:.<mamIODOHOmflwmwmfim
`
`HzEnEmOZE w_m<mm2:NmmGZE
`
`mm.05
`
`m_m<mm2:F922.:
`
`xmoz_
`
`
`
`995m2:m.mOZE50m:
`
`mfi<mm2:vmwGZE62E
`
`m_m<mm2:mmmwzmHt:
`
`
`
`IPR2019-00614 Page 00025
`
`IPR2019-00614 Page 00025
`
`
`
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 25 of 33
`
`US 8,443,199 B2
`
`FIG. 24
`
`700
`
`C:
`
`Yall
`
`I12z47AM
`
`
`
`
`
`.2, Agnes ieir <9
`
`\
`l
`I222— ,f
`\\
`_\\‘,/
`\
`”.3! Angell
`\
`I..:~!i
`43222-3
`53‘ Q
`8'” J
`t
`\
`-
`
`SIZE}. ‘ Q4
`
`\
`
`707
`
`705
`
`71 O
`
`
`
`720
`
`
`
`IPR2019-00614 Page 00026
`
`IPR2019-00614 Page 00026
`
`

`

`U.S. Patent
`
`May 14, 2013
`
`Sheet 26 of 33
`
`US 8,443,199 B2
`
`
`
`o
`\.
`m
`
`ZOEZGOomE0
`
`
`
`mm
`.05 o
`
`5w
`
`o
`m
`
`ZOEZOOOmmr
`
`
`
`zoEzooomi,4.0.0
`
`own
`
`IPR2019-00614 Page 00027
`
`IPR2019-00614 Page 00027
`
`
`
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 27 of 33
`
`US 8,443,199 B2
`
`FIG. 26
`
`790
`
`{
`:
`9 q x
`I
`/
`I
`L
`
`1
`VERY SLOWLY :
`L
`: \ ‘ ‘
`NORMAL
`1
`QUICKLY
`VERY QUICKLY)
`
`
`0 we, SAN NE
`
`
`
`
`¢ KANG, 300 J]
`.>T<m~.wou FLAE
`9 KIM IN sm
`1 01 1 -90XX-><XXX
`
`791
`
`IPR2019-00614 Page 00028
`
`IPR2019-00614 Page 00028
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 28 of 33
`
`US 8,443,199 B2
`
`FIG. 27
`
`I
`I
`|
`I
`I
`I
`E
`I
`I
`
`\J/
`/
`
`_
`
`THUMB
`
`I
`I
`|
`INDEX FINGER I
`I
`MIDDLE FINGER }
`RING FINGER
`IN
`LITTLE FINGER '
`
`800
`
`I
`
`IPR2019-00614 Page 00029
`
`IPR2019-00614 Page 00029
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 29 of 33
`
`US 8,443,199 B2
`
`FIG. 28
`
`810
`
`THUMB I
`
`II
`
`\
`
`Q
`/
`
`INDEX FINGER I
`I
`MIDDLE FINGER i
`RING FINGER
`f‘ ~ 4 E \
`\LIWLE FINGER j
`
`FIG. 29
`
`811
`
`820
`
`Y.III
`
`“12:47AM
`
`
`“ ’
`
`\
`
`,\_/
`
`\I /
`
`.
`
`THUMB
`
`I
`I
`|
`INDEX FINGER I
`I
`
`MIDDLE FINGER:
`
`RING FINGER " \ ~ \
`
`LITILE FINGER )I
`
`K
`
`I
`
`IIIIIIIII
`
`’
`
`L
`
`
`
`
`[3-5
`,
`
`
`
`
`
`IPR2019-00614 Page 00030
`
`IPR2019-00614 Page 00030
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 30 of 33
`
`US 8,443,199 B2
`
`FIG. 30
`
`830
`
`I
`|
`'
`|
`I
`I
`I
`:
`I
`K¥
`
`\j
`/
`
`THUMB
`
`I
`I
`|
`INDEX FINGER |
`|
`MIDDLE FINGER I
`I
`RING FINGER
`IN“
`LITTLE FINGER I
`4)
`
`________________
`
`"
`
`In a small telephoney
`market, the most impor-
`ant Issune for users
`would be the values
`such as "user-IrinedIInes
`
`
`
`values. tradi .. alluy
`LG has been providing
`hybrid architecture in the
`
`IPR2019-00614 Page 00031
`
`IPR2019-00614 Page 00031
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 31 of 33
`
`US 8,443,199 B2
`
`FIG. 31
`
`840
`
`850
`
`860
`
`
`
`
`
`
`15$ Message
`2nd—Music
`3rd ~Contacts
`4th -Alarm
`5th Game
`
`
`
`Press to unlock
`
`845
`
`—-—>
`
`847
`
`855
`
`
`
`
`
`Press to unlock
`
`
`
`15t Message
`2nd —Music
`
`the beautifu! girls
`Luces Kusung
`
`
`
`
`
`
`IPR2019-00614 Page 00032
`
`IPR2019-00614 Page 00032
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 32 of 33
`
`US 8,443,199 B2
`
`FIG. 32
`
`870
`
`880
`
`W“
`
`m1zz47AM
`
`m12-47A1v1
`
`Il1"""1fl
`
`I: Selected playhst1s empty.
`
`131 (/3
`
`(73% 1
`
`Ill/J E @LQ
`
`1deg; 111%11::
`
`
`
`111100“E
`
`1111111119
`
`@EQPWU
`
`IPR2019-00614 Page 00033
`
`IPR2019-00614 Page 00033
`
`

`

`US. Patent
`
`May 14, 2013
`
`Sheet 33 of 33
`
`US 8,443,199 B2
`
`FIG. 33
`
`
`
`
`
`IPR2019-00614 Page 00034
`
`IPR2019-00614 Page 00034
`
`

`

`US 8,443,199 B2
`
`1
`MOBILE TERMINAL AND METHOD OF
`CONTROLLING THE MOBILE TERMINAL
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application claims the priority benefit of Korean
`Patent Application No. 10-2009-0023211, filed on Mar. 18,
`2009 and Korean Patent Application No. 10-2010-0020866,
`filed on Mar. 9, 2010 in the Korean Intellectual Property
`Office, the disclosure of which is incorporated herein by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present invention relates to a mobile terminal and a
`method of controlling the mobile terminal, and more particu-
`larly, to a mobile terminal and a method of controlling the
`mobile terminal, in which various operations performed by
`the mobile terminal can be effectively controlled in response
`to a fingerprint-touch input having fingerprint information.
`2. Description of the Related Art
`Mobile terminals are portable devices, which can provide
`users with various services such as a voice calling service, a
`video calling service, an information input/output service,
`and a data storage service.
`As the types of services provided by mobile terminals
`diversify, an increasing number of mobile terminals have
`been equipped with various complicated functions such as
`capturing photos or moving pictures, playing music files or
`moving image files, providing game programs, receiving
`broadcast programs and providing wireless internet services
`and have thus evolved into multimedia players.
`Various attempts have been made to realize such compli-
`cated functions as hardware devices or software programs.
`For example, various user interface (UI) environments, in
`which users are allowed to easily search for and choose
`desired functions, have been developed. In addition,
`the
`demand for various designs for mobile terminals such as a
`double-sided liquid crystal display (LCD) or a full touch
`screen has steadily grown due to a growing tendency of con-
`sidering mobile terminals as personal items that can represent
`personal individuality.
`However, there is a restriction in allocating sufficient space
`for the installation of a UI such as a display or a keypad
`without compromising the mobility and the portability of the
`mobile terminal. Therefore, it is necessary to develop ways to
`control the operation of a mobile terminal using a new data
`input method and thus use various complicated functions
`provided by the mobile terminal with convenience.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides a mobile terminal and a
`method of controlling the mobile terminal, in which various
`operations performed by the mobile terminal can be effec-
`tively controlled in response to a fingerprint-touch input hav-
`ing fingerprint information.
`According to an aspect of the present invention, there is
`provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-user basis, and a pattem-by-pattem basis; receiving a
`fingerprint-touch input through a display module capable of
`performing fingerprint identification; and if fingerprint infor-
`mation of the received fingerprint-touch input matches with
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`one of the plurality of pieces of fingerprint information for
`locking a predefined operating menu, locking the predefined
`operating menu.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger
`basis, auser-by-user basis, and apattem-by-patternbasis; and
`a controller configured to receive a fingerprint-touch input
`through the display module, wherein, if fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information for lock-
`ing a predefined operating menu, the controller locks the
`predefined operating menu.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-user basis, and a pattern-by-pattem basis; displaying
`an operation screen on a display module capable of perform-
`ing fingerprint identification; receiving a fingerprint-touch
`input through the display module; and if fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information for con-
`trolling the display of a screen, controlling the display of the
`operation screen in accordance with a control value corre-
`sponding to the fingerprint information that matches with the
`fingerprint
`information of the received fingerprint-touch
`input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion and display an operation screen; a memory configured to
`store a plurality ofpieces offingerprint information on at least
`one of a finger-by-finger basis, a user-by-user basis, and a
`pattem-by-pattem basis; and a controller configured to
`receive a fingerprint-touch input through the display module,
`wherein, if fingerprint information of the received finger-
`print-touch input matches with one of the plurality of pieces
`of fingerprint information for controlling the display of a
`screen, the controller controls the display of the operation
`screen in accordance with a control value corresponding to
`the fingerprint information that matches with the fingerprint
`information of the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including locking a predefined operating mode;
`receiving a fingerprint-touch input through a display module
`capable of performing fingerprint identification; and if fin-
`gerprint information of the received fingerprint-touch input
`matches with one of a plurality ofpieces ofpreviously-stored
`fingerprint information for unlocking the predefined operat-
`ing mode, unlocking the predefined operating mode and
`entering an operating mode corresponding to the fingerprint
`information that matches with the fingerprint information of
`the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion; a memory configured to store a plurality of pieces of
`fingerprint information; and a controller configured to receive
`a fingerprint-touch input
`through the display module,
`wherein, if fingerprint information of the received finger-
`print-touch input matches with one of a plurality of pieces of
`previously-stored fingerprint information for unlocking the
`predefined operating mode, the controller unlocks the pre-
`
`IPR2019-00614 Page 00035
`
`IPR2019-00614 Page 00035
`
`

`

`US 8,443,199 B2
`
`3
`defined operating mode and enters an operating mode corre-
`sponding to the fingerprint information that matches with the
`fingerprint
`information of the received fingerprint-touch
`input.
`According to another aspect of the present invention, there
`is provided a method of controlling a mobile terminal, the
`method including storing a plurality of pieces of fingerprint
`information on at least one of a finger-by-finger basis, a
`user-by-user basis, and a pattem-by-pattem basis; displaying
`a first screen showing a number of menu icons on a display
`module capable of performing fingerprint
`identification;
`receiving a fingerprint-touch input through the display mod-
`ule; and if fingerprint information ofthe received fingerprint-
`touch input matches with one of the plurality of pieces of
`fingerprint information, displaying a second screen showing a
`predefined group of menu icons corresponding to the finger-
`print information that matches with the fingerprint informa-
`tion of the received fingerprint-touch input.
`According to another aspect of the present invention, there
`is provided a mobile terminal including a display module
`configured to be capable of performing fingerprint identifica-
`tion and display a first screen showing a number of menu
`icons; a memory configured to store a plurality of pieces of
`fingerprint information on at least one of a finger-by-finger
`basis, a user-by-user basis, and a pattem-by-patternbasis; and
`a controller configured to receive a fingerprint-touch input
`through the display module, wherein, if fingerprint informa-
`tion of the received fingerprint-touch input matches with one
`of the plurality of pieces of fingerprint information, the con-
`troller displays a second screen showing a predefined group
`of menu icons corresponding to the fingerprint information
`that matches with the fingerprint information of the received
`fingerprint-touch input.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The above and other features and advantages ofthe present
`invention will become more apparent by describing in detail
`preferred embodiments thereof with reference to the attached
`drawings in which:
`FIG. 1 illustrates a block diagram of a mobile terminal
`according to an exemplary embodiment of the present inven-
`tion;
`FIG. 2 illustrates a front perspective view of the mobile
`terminal shown in FIG. 1;
`FIG. 3 illustrates a rear perspective view of the mobile
`terminal shown in FIG. 1;
`FIGS. 4 through 8 illustrate the structure of a display mod-
`ule capable of identifying a fingerprint, which can be used in
`the mobile terminal shown in FIG. 1;
`FIGS. 9A and 9B illustrate flowcharts of a method of
`
`controlling a mobile terminal according to a first exemplary
`embodiment of the present invention;
`FIG. 10 illustrates a flowchart of a method of controlling a
`mobile terminal according to a second exemplary embodi-
`ment of the present invention;
`FIG. 11 illustrates a flowchart of a method of controlling a
`mobile terminal according to a third exemplary embodiment
`of the present invention;
`FIG. 12 illustrates a flowchart of a method of controlling a
`mobile terminal according to a fourth exemplary embodiment
`of the present invention;
`FIGS. 13 through 16 illustrate how to register fingerprint
`information;
`FIGS. 17 through 21 illustrate how to lock or unlock a
`mobile terminal in response to a fingerprint-touch input;
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`FIGS. 22 through 30 illustrate how to control a screen in
`response to a fingerprint-touch input;
`FIG. 31 illustrates how to unlock a mobile terminal and
`
`enter a predetermined operating mode in response to a fin-
`gerprint-touch input; and
`FIGS. 32 and 33 illustrate how to display menu icons
`classified into different menu groups in response to a finger-
`print-touch input.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`The present invention will hereinafter be described in
`detail with reference to the accompanying drawings in which
`exemplary embodiments of the invention are shown.
`The term ‘mobile terminal’, as used herein, may indicate a
`mobile phone, a smart phone, a laptop computer, a digital
`broadcast receiver, a personal digital assistant (PDA), a por-
`table multimedia player (PMP), or a navigation device. In this
`disclosure, the terms ‘module’ and ‘unit’ can be used inter-
`changeably.
`FIG. 1 illustrates a block diagram of a mobile terminal 100
`according to an embodiment of the present invention. Refer-
`ring to FIG. 1, the mobile terminal 100 may include a wireless
`communication unit 110, an audio/video (A/V) input unit
`120, a user input unit 130, a sensing unit 140, an output unit
`150, a memory 160, an interface unit 170, a controller 180,
`and a power supply unit 190. Two or more of the wireless
`communication unit 110, the A/V input unit 120, the user
`input unit 130, the sensing unit 140, the output unit 150, the
`memory 160, the interface unit 170, the controller 180, and
`the power supply unit 190 may be incorporated into a single
`unit, or some ofthe wireless communication unit 110, theA/V
`input unit 120, the user input unit 130, the sensing unit 140,
`the output unit 150, the memory 160, the interface unit 170,
`the controller 180, and the power supply unit 190 may be
`divided into two or more smaller units.
`
`The wireless communication unit 110 may include a
`broadcast reception module 111, a mobile communication
`module 113, a wireless internet module 115, a short-range
`communication module 117, and a global positioning system
`(GPS) module 119.
`The broadcast reception module 111 may receive a broad-
`cast signal and/or broadcast-related information from an
`external broadcast management server through a broadcast
`channel. The broadcast channel may be a satellite channel or
`a terrestrial channel. The broadcast management server may
`be a server which generates broadcast signals and/or broad-
`cast-related information and transmits the generated broad-
`cast signals and/or the generated broadcast-related informa-
`tion or may be a server which receives and then transmits
`previously-generated broadcast signals and/or previously-
`generated broadcast-related information.
`The broadcast-related information may include broadcast
`channel information, broadcast program information and/or
`broadcast service provider information. The broadcast signal
`may be a TV broadcast signal, a radio broadcast signal, a data
`broadcast signal, the combination of a data broadcast signal
`and a TV broadcast signal or the combination of a data broad-
`cast signal and a radio broadcast signal. The broadcast-related
`information may be provided to the mobile terminal 100
`through a mobile communication network. In this case, the
`broadcast-related information may be received by the mobile
`communication module 113, rather than by the broadcast
`reception module 111. The broadcast-related information
`may come in various forms. For example, the broadcast-
`related information may be electronic program guide (EPG)
`
`IPR2019—00614 Page 00036
`
`IPR2019-00614 Page 00036
`
`

`

`US 8,443,199 B2
`
`5
`of digital multimedia broadcasting (DMB) or may be elec-
`tronic service guide (ESG) of digital Video broadcast-hand-
`held (DVB-H).
`The broadcast reception module 111 may receive the
`broadcast signal using various broadcasting systems such as
`digital multimedia broadcasting-terrestrial (DMB-T), digital
`multimedia broadcasting-satellite (DMB-S), media forward
`link only (MediaFLO), DVB-H, and integrated services digi-
`tal broadcast-terrestrial (ISDB-T). In addition, the broadcast
`reception module 111 may be configured to be suitable for
`nearly all types of broadcasting systems other than those set
`forth herein. The broadcast signal and/or the broadcast-re-
`lated information received by the broadcast reception module
`111 may be stored in the memory 160.
`The mobile communication module 113 may transmit
`wireless signals to or receives wireless signals from at least
`one of a base station, an external terminal, and a server
`through a mobile communication network. The wireless sig-
`nals may include various types of data according to whether
`the mobile terminal 100 transmits/receives voice call signals,
`video call signals, or text/multimedia messages.
`The wireless internet module 115 may be a module for
`wirelessly accessing the internet. The wireless internet mod-
`ule 115 may be embedded in the mobile terminal 100 or may
`be installed in an external device. The wireless internet mod-
`
`ule 115 may be embedded in the mobile terminal 100 or may
`be installed in an external device. The wireless internet mod-
`
`ule 115 may use various wireless internet technologies such
`as wireless local area network (WLAN), Wireless Broadband
`(WiBro), World Interoperability for Microwave Access
`(Wimax), and High Speed Downlink Packet Access (HS-
`DPA).
`The short-range communication module 117 may be a
`module for short-range communication. The short-range
`communication module 117 may use various short-range
`communication techniques such as Bluetooth, radio fre-
`quency identification (RFID),
`infrared data association
`(IrDA), ultra wideband (UWB), and ZigBee.
`The GPS module 119 may receive position information
`from a plurality of GPS satellites.
`The A/V input unit 120 may be used to receive audio
`signals or video signals. The A/V input unit 120 may include
`a camera 121 and a microphone 123. The camera 121 may
`process various image frames such as still images or moving
`images captured by an image sensor during a video call mode
`or an image capturing mode. The image frames processed by
`the camera 121 may be displayed by a display module 151.
`The image frames processed by the camera 121 may be
`stored in the memory 160 or may be transmitted to an external
`device through the wireless communication unit 110. The
`mobile terminal 100 may include two or more cameras 121.
`The microphone 123 may receive external sound signals
`during a call mode, a recording mode, or a voice recognition
`mode with the use ofa microphone and may convert the sound
`signals into electrical sound data. In the call mode, the mobile
`communication module 113 may convert the electrical sound
`data into data that can be readily transmitted to a mobile
`communication base station and then output the data obtained
`by the conversion. The microphone 123 may use various
`noise removal algorithms to remove noise that may be gen-
`erated during the reception of external sound signals.
`The user input unit 130 may generate key input data based
`on user input for controlling the operation of the mobile
`terminal 100. The user input unit 130 may be implemented as
`a keypad, a dome switch, a touch pad (static pressure/static
`voltage), a jog wheel, or a jog switch. In particular, if the user
`input unit 130 is implemented as a touch pad and forms a layer
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`structure together with the display module 151, the user input
`unit 130 and the display module 151 may be collectively
`referred to as a touch screen.
`
`The sensing unit 140 determines a current state of the
`mobile terminal 100 such as whether the mobile terminal 100
`
`is opened up or closed, the position ofthe mobile terminal 1 00
`and whether the mobile terminal 1 00 is placed in contact with
`a user, and generates a sensing signal for controlling the
`operation of the mobile terminal 100. For example, when the
`mobile terminal 100 is a slider-type mobile phone, the sens-
`ing unit 140 may determine whether the mobile terminal 100
`is opened up or closed. In addition, the sensing unit 140 may
`determine whether the mobile terminal 100 is powered by the
`power supply unit 190 and whether the interface unit 170 is
`connected to an external device.
`
`The sensing unit 140 may include a proximity sensor 141,
`a pressure sensor 143 and a motion sensor 145. The proximity
`sensor 141 may determine whether there is an object nearby
`and approaching the mobile terminal 100 without any
`mechanical contact with the entity. More specifically, the
`proximity sensor 141 may detect an object that is nearby and
`approaching by detecting a change in an alternating magnetic
`field or the rate of change of static capacitance. The sensing
`unit 140 may include two or more proximity sensors 141.
`The pressure sensor 143 may determine whether pressure
`is being applied to the mobile terminal 100 or may measure
`the level of pressure, if any, applied to the mobile terminal
`100. The pressure sensor 143 may be installed in a certain part
`of the mobile terminal 100 where the detection of pressure is
`necessary. For example, the pressure sensor 143 may be
`installed in the display module 151. In this case, it is possible
`to differentiate a typical touch input from a pressure touch
`input, which is generated using a higher pressure level than
`that used to generate a typical touch input, based on data
`provided by the pressure sensor 143. In addition, when a
`pressure touch input is received through the display module
`151, it is possible to determine the level ofpressure applied to
`the display module 151 upon the detection of a pressure touch
`input based on data provided by the pressure sensor 143.
`The motion sensor 145 may determine the location and
`motion of the mobile terminal 100 using an acceleration
`sensor or a gyro sensor.
`In the meantime, acceleration sensors are a type of device
`for converting a vibration in acceleration into an electric
`signal. With recent developments in micro -electromechanical
`system (MEMS) technology, acceleration sensors have been
`widely used in various products for various purposes ranging
`from detecting large motions such as car collisions as per-
`formed in airbag systems for automobiles to detecting minute
`motions such as the motion of the hand as performed in
`gaming input devices. In general, one or more acceleration
`sensors representing two or three axial directions are incor-
`porated into a single package. There are some cases when the
`detection of only one axial direction, for example, a Z-axis
`direction, is necessary. Thus, when an X- or Y—axis accelera-
`tion sensor,
`instead of a Z-axis acceleration sensor,
`is
`required,
`the X- or Y—axis acceleration sensor may be
`mounted on an additional substrate, and the additional sub-
`strate may be mounted on a main substrate.
`Gyro sensors are sensors for measuring angular velocity,
`and may determine the relative direction ofthe rotation ofthe
`mobile terminal 100 to a reference direction.
`
`The output unit 150 may output audio signals, video sig-
`nals and alarm signals. The output unit 150 may include the
`display module 151, an audio output module 153, an alarm
`module 155, and a haptic module 157.
`
`IPR2019-00614 Page 00037
`
`IPR2019-00614 Page 00