as) United States
`a2) Patent Application Publication co) Pub. No.: US 2010/0227642 Al
` (43) Pub. Date: Sep. 9, 2010 Kim etal.
`
`
`US 20100227642A1
`
`(54) MOBILE TERMINAL HAVING SUB-DEVICE
`
`(30)
`
`Foreign Application Priority Data
`
`(75)
`
`Inventors:
`
`Jong-Hwan Kim, Gyeonggi-do
`(KR); Sang-Yun Oh,Seoul (KR);
`Woo-Jin Suh, Seoul (KR);
`Sang-Hyuck Lee, Seoul (KR)
`
`Correspondence Address:
`LEE, HONG, DEGERMAN, KANG & WAIMEY
`660 S. FIGUEROA STREET,Suite 2300
`LOS ANGELES, CA 90017 (US)
`
`(73) Assignee:
`
`LG Electronics Inc.
`
`(21) Appl. No.:
`
`12/552,766
`
`(22)
`
`Filed:
`
`(KR) wee eeeeeeees 10-2009-0019010
`Mar. 5, 2009
`(KR) once 10-2009-0034739
`Apr. 21,2009
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`HO4M 1/00
`(52) US. CMe oeccceccsssssssssssssseseeesesesessssssssssnnneeees 455/556.1
`(57)
`ABSTRACT
`A mobile terminal includes a sub-device that is attached
`thereto or detached therefrom, to remotely control the opera-
`tion and state ofthe terminal. The mobile terminalincludes: a
`sub-device having an input/output unit and attached to or
`detached from the terminal; and a controller configured to
`receive a user input via a certain communication path from
`the sub-device when the sub-device is separated, and control
`elements and applications of the terminal according to the
`user input.
`
`Sep. 2, 2009
`
` chose
`
`COUPLING
`
`SEPARATING
`Ca
`
`APPLE 1010
`
`APPLE 1010
`
`1
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 1 of 79
`
`US 2010/0227642 Al
`
`FIG.
`
`t
`
`a is
`= commCxTiON On
`‘
`4
`
`|
`proaeast
`ay)
`ELD") RBCEEVINGOLns
`ier
`
`
`OBER
`
`COUMNTCATIONMODULE
`Wipes |
`
`
`
`
`INTERNET MODULE
`|
`
`"SHORERANGE
`P
`
`
`OMBEINTCATIONNODULE
`
`.
`t
`
`| i
`joint 1b
`i
`a!
`AUDIO OUTPEY. Ll4se
`i
`WODULE
`|4
`
`1
`
`poreansivt
`wey
`
`aly in UNTE
`
`L181
`4 WOLTPABDIA
`
`
`OLE
`
`
`
`“upyory
`
`L160
`
`SEINE2
`
`
`. DRTECTENG SENSOR
`enn nonsevvsued
`
`
`
`
` DETECTneSENSU
`
`2
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 2 of 79
`
`US 2010/0227642 Al
`
`IG.
`
`2A
`
`BH
`
`
`FlG,
`
`2B
`
`3
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 3 of 79
`
`US 2010/0227642 Al
`
`FIG. 3A
`
`
`
`4
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 4 of 79
`
`US 2010/0227642 Al
`
`FIG. 3B
`
`
`
`5
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 5 of 79
`
`US 2010/0227642 Al
`
`FIG. 4
`
`*
`
`aeSe,
`
`be iesveno eis akanna lynt yanhaiya SDaHr
`
`}
`;
`8 ‘SesnrenntaNieilaity aN Frmonmemenimnnbeicpconnes POSSEOESetd aeaieSe Seoe eetana
`
`eS
`
`
`6
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 6 of 79
`
`US 2010/0227642 Al
`
`PVrg 4H ROLDRRPART
`
`
`
`ae
`SN
`
`a
`oe
`ied
`ee ne
`
`MAIN BODY
`
`| —-tiAEN Bony
`
`155
`
`156
`
`185
`
`156
`
`tal ©
`
`ae
`:
`
`
`
`BEkb, 840X480
`
`(NOWENT BAEK
`[MENU|VIEW [BACK |
`
`
`(Glog Gi-noe|
`
`{ hall SP
`
`
`
`
`
`
`
`all
`tuil 3
`| CANERA ALBUM
`LED) ERIEND y
`
`
`
`
`ii
`
`;To
`a1:3a8
`iy1k1%
`a8
`isp
`
`7
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 7 of 79
`
`US 2010/0227642 Al
`
`FIG. 6A
`
`_-STEP-N
`
` 1°" REGION -
`ahd peeron -
`
`
`
`8
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 8 of 79
`
`US 2010/0227642 Al
`
` | anne
`‘[ penecriax UNIT |
`
`
`
`neraran/ounuie
`|; aN
`
`“On
`‘SUB-DEVICES
`
`
`
`peTRCTIONrH
`
`
`
`
`MAIN DEVICE
`yo220 490-7|DETECTION UNIT
`
`
`
`
`[cowecrian inet ,oti
`Ag >
`Fe
`NTF
`
`
`
`
`~ S00n
`
`
`COUPLING
`:
`
` LP
`_ DETACTION UNIT |
`
`9
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 9 of 79
`
`US 2010/0227642 Al
`
`FIG. 8
`
`7, OVERLAPPED
`
`a sos
`
`*:
`
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 10 of 79
`
`US 2010/0227642 Al
`
`HIG. SA
`
`SocpeeglililiLilloirindagieniatn Coe Seinpei et ie Set il eal la wal
`
`300 a
`CONTROLLER280
`
`
`
`“POWER SUPPLY UNIT}—]~ §
`
`COUPLINGa9
`
`peTeCHON UNIT
`[connection init 1-430
`
`i
`
`CLINE wTf+
`
`FIG. 9B
`
`3Ol
`
`800.
`.
`
`\
`
`11
`
`11
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 11 of 79
`
`US 2010/0227642 Al
`
`FIG. 9C
`
`INDICATOR
`|
`}
`
`SPRARER
`BARPHONE
`MIC
`fo
`CAMERA
`¢
`
`~f
`
`“ye.
`
`
`
`
`
`
`12
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 12 of 79
`
`US 2010/0227642 Al
`
`FIG. LOA
`
`
`
`
`
`13
`
`13
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 13 of 79
`
`US 2010/0227642 Al
`
`PIG. LOB
`
`
`
`100
`
`IL, coup.ing
`
`
`
`14
`
`14
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 14 of 79
`
`US 2010/0227642 Al
`
`HIG. LOC
`
`
`
`15
`
`15
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 15 of 79
`
`US 2010/0227642 Al
`
`FIG. 10D
`
`
`N
`
`100
`
`16
`
`16
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 16 of 79
`
`US 2010/0227642 Al
`
`FIG. 11A
`
`
`
`17
`
`17
`
`

`

`Sep. 9, 2010 Sheet 17 of 79
`
`US 2010/0227642 Al
`
`Patent Application Publication
`
`FIG. IIB
`
`18
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 18 of 79
`
`US 2010/0227642 Al
`
`
`
`19
`
`19
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 19 of 79
`
`US 2010/0227642 Al
`
`
`
`.
`
`a
`
`COUPLING
`SEPARATING
`
`
` *
`
`f
`, ae
`iy
`Le!
`L
`|
`
`20
`
`cc }
`
`| CC ||
`fo |
`.
`aa
`|
`|“1008
`|
`
`oe
`
`|
`
`|=
`
`20
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 20 of 79
`
`US 2010/0227642 Al
`
`FIG. 11h esti
`
`oe
`
`|
`
`:
`
`100
`
`Lo
`
`21
`
`21
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 21 of 79
`
`US 2010/0227642 Al
`
`IG. 1eA
`‘
`
`15h -
`
`22
`
`22
`
`

`

`Patent Application Publication
`
`US 2010/0227642 Al
`
`Sep. 9,2010 Sheet 22 of 79
`
`SiO
`
`23
`
`23
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 23 of 79
`
`US 2010/0227642 Al
`
`FIG. 12c
`
` SEPARATING
`
`CUUPLINGOGa
`
`530
`
`24
`
`24
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 24 of 79
`
`US 2010/0227642 Al
`
`FIG. 12D
`
`| |
`
`SEPARATING
`
` COUPLING
`
`25
`
`25
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 25 of 79
`
`US 2010/0227642 Al
`
`eTG,
`
`12k
`
`let 100b —+
`
`Iems
`{0lanenh.
`
`510 ~
`poe
`
`—~——100
`
`m= 1008
`
`COUPLING
`
`E>
`
`SEPARATING:
`
`26
`
`26
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 26 of 79
`
`US 2010/0227642 Al
`
`FIG. 13A
`
` 120b Co
`
`oem 300
`
`27
`
`27
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 27 of 79
`
`US 2010/0227642 Al
`
`FIG. 13B
`
`af
`
`SEPARATING
`
`510
`
`Fig. 130
`
`sophriterrttercermbe
`
`“an0n0|
`
`= 100
`
`28
`
`28
`
`
`
`
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 28 of 79
`
`US 2010/0227642 Al
`
`FIG. 13D
`
`
`
`29
`
`29
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 29 of 79
`
`US 2010/0227642 Al
`
`FiG. 14A
`
`
`300 |
`
`
`
`30
`
`30
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 30 of 79
`
`US 2010/0227642 Al
`
`FIG. 146
`
`31
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 31 of 79
`
`US 2010/0227642 Al
`
`FIG. 14C
`
`
` 100
`
`
`
`32
`
`32
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 32 of 79
`
`US 2010/0227642 Al
`
`FIG. 14D
`
`
`FIG. LOA
`
`33
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 33 of 79
`
`US 2010/0227642 Al
`
`
`
`
`
`34
`
`34
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 34 of 79
`
`US 2010/0227642 Al
`
`FIG. Loc
`
`
` 160¢tinea
`27_SEPARATING
`
`COUPLING
`
`i)
`
`35
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 35 of 79
`
`US 2010/0227642 Al
`
`FIG. 15D
`
`100a__
`
`
`36
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 36 of 79
`
`US 2010/0227642 Al
`
`FIG. LG
`
`
`
`37
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 37 of 79
`
`US 2010/0227642 Al
`
`FIG. 17A
`
`GENERAL MEN
`
`
`
`So— =alis ce
`ia2a
`
` 100
`
`38
`
`38
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 38 of 79
`
`US 2010/0227642 Al
`
`FIG. 17B
`
`
`
`300
`
`39
`
`39
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 39 of 79
`
`US 2010/0227642 Al
`
`FIG. 18
`
`Lp100
`
`
`
`40
`
`40
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 40 of 79
`
`US 2010/0227642 Al
`
`FIG. 19A
`
`f+ai
`
`onogos
`
`F100
`
`300
`
`41
`
`41
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 41 of 79
`
`US 2010/0227642 Al
`
`FIG. 19B
`
`La
`
`ee =
`
`5300) a /\
`
`oA
`<< S
`
`|
`
`_
`
`
`.
`=
`:
`*
`||
`ee
`||
`
`
`
`300 =
`
`109
`
`
`|
`| S Dg
`
`
`SEPARATING
`
`42
`
`|
`
`
`
`oe
`
`~
`
`
`KEYPAD MANIPULATION MPN OR
`BY HOUSE MANIPULATIONMENU
`
`42
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 42 of 79
`
`US 2010/0227642 Al
`
` FIG,
`
`VIRTUALOR DONE KEYPAD
`
`
`
`COUPLING
`
`43
`
`43
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 43 of 79
`
`US 2010/0227642 Al
`
`
`FIG. 20B
`
` 300 —.
`
`44
`
`44
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 44 of 79
`
`US 2010/0227642 Al
`
`FIG. 2lA
`
`CAMERAVIEFER
`=> 300 1} Pan
`
`COUPLING
`
`7m 100
`
`45
`
`45
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 45 of 79
`
`US 2010/0227642 Al
`
`
`
`PR oA
`
`oe a: Sak
`
`46
`
`46
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 46 of 79
`
`US 2010/0227642 Al
`
`FIG.
`
`ae
`
`300 “=
`
`,ee
`
`Ee
`
`deHta
`
`“NA
`SESSA
`if
`283
`y
`Ones
`to|
`|
`UST)
`ih
`l
`ren
`.
`
`3)|
`
`o
`
`Ls
`q
`
`47
`
`47
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 47 of 79
`
`US 2010/0227642 Al
`
`
`
`SEPARATING
`
`FIG, 23 BACKGROUND IMAGE 1
`
`
`
`BACKGROUND THAGE 3
`
`
`BACKGROUND MAGE 2
`
`48
`
`48
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 48 of 79
`
`US 2010/0227642 Al
`
`FIG. 24
`
`300 —
`
`SEPARATING (POIEROF
`LCDOF BAINBODY IS
`AUTONEICALLY TERMED ORF)
`
`
`300
`
`a S
`
`SCOUPLING (POWER
`LCD OF WAIN BODY 7"
`
`AUTOMATICALLYTURNED GN)
`
`49
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 49 of 79
`
`US 2010/0227642 Al
`
`SEPARATING —
`(WAIN BODY 1S SRT-T0 Be
`-AUNORATICALLY LOCKRED
`—>
`
`ACTORATICALLY UNLOCKED}
`
`oo
`
`— CONPLING
`(HAIN BODY TS SET TO Be
`
`
`
`—indicator)
`
`COUPLING/SEPARATING|
`ENVIRONMENT SETTING
`
`OPERATION CONTROL
`
`|2 [snr coupe,
`|
`
`
`ieGAPINGCONTROL
`| TLOSXING COTROL
`
`
`
`
`
`USER SETTING HENS
`
`50
`
`50
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 50 of 79
`
`US 2010/0227642 Al
`
`FIG. 27
`
`
`
`ey
`
`i
`
`;
`
`ay
`pot
`| Wiha
`|
`read
`|
`| SUORT-ANGE. CORMENTCETIONi
`
`i)
`
`
`__|
`
`CBT,
`
`IRDA, ete.
`
`POWER OFF |
`
`51
`
`51
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 51 of 79
`
`US 2010/0227642 Al
`
`FIG. <8
`
`CARRIEDAROUND IN
`
`BAG OR POCKET
`
`
`
`
`
`
`
`
`
`
`
`
`"CALL BROW
`HONG REL-DONG*
`Te
`
`==Sound
`
`ain
`
`ee
`
`
`ABSENCE 0
`PRESENCEOF
`
`ONPLN DISa“AY
` ONE-LINE DISPLAY
`
`
`52
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 52 of 79
`
`US 2010/0227642 Al
`
`PIG. 29
`
`
`
`
`ezace aites
`ena
`
`
`oa
`
`
` SHORTMEARGE COMMERCATION
`
`
`ienennnnnntiinitieetriins.Sanatintepephenmnanatataeine,manicbiaSpceitaemnate"Sabaanasyix°
`
`
`
`
`
`
`:eSTo4onyfJ+it}j:i|
`
`
`
`
`
`a
`
`CARRIED AROUND IN
`BAG OR POCKET
`
`Chee Sante
`
`nrtntinentrantcincieatie
`
`atten: Set
`
`"BERING YOU
`44
`BANTEAY ESTE
`~ HONDER GIRLS"
`see
`
`—HB0D
`
`PRESENCE OF
`ONE-LINE. DISPLAY
`
`ABSENCE OF
`ONE-LINE DISPLAY
`
`r
`
`53
`
`53
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 53 of 79
`
`US 2010/0227642 Al
`
`FIG. 30
`
`Keig
`
`
`
`SiSyaar
`
`~
`SHORT-RANGE
`AS oaWenuswaa
`
`
`seineattrtoe
`CONNTCATION
`|
`
`
`
`300
`
`
`ES
`
`
`
`a me
`
`
`
`
`oll
`
`oo Te{
`
`54
`
`54
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 54 of 79
`
`US 2010/0227642 Al
`
`FIG. ol
`
`
`
`-COMANICATION
` SHORE-RANGE
`
`55
`
`55
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 55 of 79
`
`US 2010/0227642 Al
`
`FIG. 32
`
`_CONMNTCATION
`
`
`299
`
` “GORERANGE
`
`56
`
`56
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 56 of 79
`
`US 2010/0227642 Al
`
`100
`
`
`IRDA, etc.)
`
`
`5
`
`iis \
`
`4HL]i
`
`gE
`SEOPT“RANGECOMUNICATIcn a
`CBT,
`
`
`
`o7
`
`57
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 57 of 79
`
`US 2010/0227642 Al
`
`FIG. 34
`
`# 100
`
`ae ;
`
`ideetiea.
`
`
`
`Seae:eineSM
`
`
`
`SShemainint
`
`SHORT-RAGE COMMUNICATION Ui
`(BY,
`IRDA, ete.)
`8
`
`NEXTPILE
`sn
`
`
`
`ye
`Seacesoco
`JMAGE PILE
`
`DISPLAY NEXT
`
`Ji (OR PREVIOUS)
`
`\/
`
`58
`
`58
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 58 of 79
`
`US 2010/0227642 Al
`
`pat
`ly
`
`
`
`—L
`
`“SHORE-RANGH CORNMICATION 4
`(BT,
`IRDA, ete.)
`
`
`
`DISPLAY HANDWRITTEN INET
`
`_ILOVEYOran
`
`
`
`
`RECOGNIZE USER'S HANDWRUTTEN INPUT
`AND DISPLAY CORRESPONDING _
`CHARACTERS (PRINT LETTERS)
`
`59
`
`59
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 59 of 79
`
`US 2010/0227642 Al
`
`FIG. 36
`
`
`
`yt
`Hf
`
`ete
`
`1
`;
`
`CATION 11)
`SHOMRGE COMIN
`I a
`Kc
`-)
`(BT, IRDA,
`ie
`
`
`
`
`
` ‘
`
`4i
`
`bog
`i
`i
`/SHEC-RANCE COMACATION |
`(BE,
`IRDA, ete.)
`
`60
`
`60
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 60 of 79
`
`US 2010/0227642 Al
`
`FIG.
`
`386A
`
`
`
`PASS MODE [ SLERPHODE
`
`|
`
`loveyou
`
`| Ulowe you
`
`|
`
`[loweyou
`
`
`
`.neve
`
`janes
`eet
`otttenentvenentveceeeenevittncncenntnrce ed cececececccenetntnenet
`PASS MODE CRED}
`SLEEP MODECGREY)
`CONFERENCE MODECRLUE)
`
`FIG, 36B
`
`|
`
`
`
`|
`iloveyou —.
`LL,
`
`
`(ODE
`
`
`
`
`
`(LUE)
`~~
`(8-12 of dieek)
`
`(OREN)
`(72-18 of cloek)
`
`61
`
`| love you
`
`
`
`(RED)
`(18-24 at elock)
`
`61
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 61 of 79
`
`US 2010/0227642 Al
`
`FIG. 39A
`
`62
`
`62
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 62 of 79
`
`US 2010/0227642 Al
`
`FIG. 39C
`
`
`
`“300
`
`
`
`
`
`
`= aot
`A a
`|:
`A} Ae H i wun A Aa (
`
`ROA, BEC
`
`‘
`
`.
`
`: a
`3
`SIVA MG
`
`63
`
`63
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 63 of 79
`
`US 2010/0227642 Al
`
`64
`
`64
`
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 64 of 79
`
`US 2010/0227642 Al
`
`FIG. 40A
`
`
`
`
`
`F wosnnnnmensmnameonnanennnnncsnvanenonennnnoneneenny I
`
`{CL}
`CONTENTS INTEGRATION
`
`(2) VIEW TYPE CHANGE
`
`HEDRY INFORMATICS
`
`
`
`(INTERNAL WOBILE MEMORY
`
`
`
`/-—~- 300
`
`65
`
`65
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 65 of 79
`
`US 2010/0227642 Al
`
` ie,ra[=
`
`
`
`iYCONTENTS|
`
`
`
`66
`
`66
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 66 of 79
`
`US 2010/0227642 Al
`
`FIG. 41
`
`
`eeOT near
`
`
`67
`
`67
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 67 of 79
`
`US 2010/0227642 Al
`
`
`
`
`
`
`
`POWEROF MAIN DEVICB(100)CAN BE
`CONTROLLED BYSUB-DEVICE(300)
`
`68
`
`68
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 68 of 79
`
`US 2010/0227642 Al
`
`300.
`
`2 4|
`z
`
`||
`
`OLDER TYPE TERMINAL
`
`69
`
`69
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 69 of 79
`
`US 2010/0227642 Al
`
`FI G. 43 .
`
`
`
`
`SLIDE TYPE TERMINAL
`
`70
`
`70
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 70 of 79
`
`US 2010/0227642 Al
`
`FIG. 44
`
` SyVISUAL FUNCTION PART(200)
`
`VOICE FUNCTION PARTC1O0)
`
`,
`
`“5
`
`r
`
`COUPLING TYPE
`(QUERTY KEYBOARD)
`
`sor K
`
`‘.
`
`CRAB A EAA
`
`veered
`_ COUPLING TYPE
`(NUMERIC KEYBOARD)
`
`71
`
`71
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 71 of 79
`
`US 2010/0227642 Al
`
`FIG. 45
`
`jaa nn iSe Si St tt ant erty
`
`
`
`Murree
`
`
`
`A
`
`
`
`Multi-Tasking
`
`72
`
`72
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 72 of 79
`
`US 2010/0227642 Al
`
`FIG. 46
`
`
`
`73
`
`73
`
`

`

`Patent Application Publication
`
`Sep. 9,2010 Sheet 73 of 79
`
`US 2010/0227642 Al
`
`FIG. 477A
`
`
`
`74
`
`74
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 74 of 79
`
`US 2010/0227642 Al
`
`HG ee
`
`
`
`15
`
`75
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 75 of 79
`
`US 2010/0227642 Al
`
`FIG. 46
`
`REMOTE. CONTRGLLER
`
`\
`|
`|
`|
`4
`|
`i
`j
`|
`j
`i
`4
`i
`|
`|
`}
`|
`q
`
`NE aa
`
`|
`i
`
`i
`i
`i
`i
`i
`}
`|
`|
`I
`i
`i
`|
`|
`{
`i
`|
`|
`
`i
`i
`
` i
` RENOTS CONTROLLING REYBOARD—
`
`proce sui in nc ‘hg i “tmsn th ei pe i ni ict ep amy
`
`OR
`
`76
`
`76
`
`

`

`Patent Application Publication
`
`D)
`
`Sep. 9, 2010 Sheet 76 of 79
`
`US 2010/0227642 Al ——300
`
`
`
`ee 3 J RIGHT
`
`77
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 77 of 79
`
`US 2010/0227642 Al
`
`FIG. 50
`
`a fF
`
`of
`
`FRONT
`eae
`
`
`3h ae 7 SOLAR LIGHT|gy SURENGE SOLAR LIGHT
`<a:
`f
`é
`f
`
`, \
`i
`
`are
`
`:
`
`.
`
`.
`
`i
`
`3:
`
`
`
`78
`
`78
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010
`
`Sheet 78 of 79
`
`US 2010/0227642 Al
`
`FIG. 51
`
`~—-CINDICATOR)
`
`
`
`te
`
`
`aoeSEFTING|
`‘au| fimo)
`
`
`
`@ SAR CLL, CHAROR SETTING
`Cunece ParORITYseTing|
`
`
`
`
`© SB-DEVICE ONLY
`
`@ S08 SEICE-HANN DEVICE
`
`
`| OTADN DEVICE-SUB DEVICE
`
`CD SOLAR CELL CHARGE RELEASE
`
`
`
`
`
`
`
`
`CINDICATOR)
`
`<eSOLARCELL ENVIRONMENT SITTIN? |
`
`
`
`
`cues, | ERRCATION
` wae
`
`COIN DEVICE(CHARGE. COMPLETION
`
`@ SUB DEVICRCCHARGE COHPLEDION)
`[rwaAO
`
`|| COMNSIBDRNCEHAIN DEVICE) |
`
`
`none
`;
`
`
`
`
`OK
`[Wwmenu |
`
`
`(hniatiepemnoeeeeme
`
`79
`
`79
`
`

`

`Patent Application Publication
`
`Sep. 9, 2010 Sheet 79 of 79
`
`US 2010/0227642 Al
`
`FIG. 53
`
`$10—{CHARGINGBATTERY
`
`
`
`
` ~ FestSEPARATING)
`
`
`_—AVALLAE
`
`gag —<— FOR COMMUNICATION ~
`ALARM OUTPUT
`|
`(BY SUB-DEVICE)|
`ye WITHMAINDEVICE?
`
`VES
`
`_[ TRANSFER CHARGE COMPLETION
`|
`MESSAGE 10 WAIN DEVICE
`
`
`
`80
`
`80
`
`

`

`US 2010/0227642 Al
`
`Sep. 9, 2010
`
`MOBILE TERMINAL HAVING SUB-DEVICE
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] The present application claimspriority to Korean
`Application No. 10-2009-0019010 filed in Korea on Mar. 5,
`2009, and Korean Application No. 10-2009-0034739 filed in
`Korea on Apr. 21, 2009, the entire contents ofwhichis hereby
`incorporated by referencein its entirety.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`[0002]
`[0003] The present invention relates to a mobile terminal
`that allows a sub-device to be attached thereto or detached
`therefrom.
`
`2. Description of the Related Art
`[0004]
`[0005] Terminals may be divided into a mobile terminal
`(portable terminal) and a stationary terminal according to
`whether the terminalis portable or not. The mobile terminals
`may be divided into a handheld terminal that can be directly
`carried around and a vehicle mountterminal.
`[0006] According to diversification of functions, the termi-
`nals are implementedin the form of multimedia players hav-
`ing complex functions such as capturing images or video,
`reproducing music or videofiles, playing games, receiving
`broadcasts, etc.
`[0007]
`Inorder to support and increase the functionsof the
`terminals, modification of structural parts and/or software
`parts of the terminals may be taken into consideration.
`Research on mobile terminals having bodies that are made
`blocks or modularized so as to be detachably attached in
`functional or structural aspects is ongoing.
`
`SUMMARYOF THE INVENTION
`
`[0008] Accordingly, one object of the present invention is
`to address the above-noted and other problems.
`[0009] Another object ofthe present inventionis to provide
`a method for controlling an operation and state of a mobile
`terminal when a main device and a sub-device of the mobile
`terminal are coupled or separated.
`[0010]
`To achieve these and other advantages and in accor-
`dance with the purpose of the present invention, as embodied
`and broadly described herein, the present invention provides
`in one aspect a mobile terminal including: a sub-device hav-
`ing an input/output unit and attachedto or detached from the
`terminal; and a controller configured to receive a user input
`via a certain communication path from the sub-device when
`the sub-device is separated, and control elements and appli-
`cations of the terminal accordingto the user input.
`[0011]
`To achieve these and other advantages and in accor-
`dance with the purpose of the present invention, as embodied
`and broadly described herein, the present invention provides
`in another aspect a methodfor controlling coupling and sepa-
`ration of a sub-device to or from a mobile terminal, the
`methodincluding: establishing a radio communication path
`with the sub-device when a connection ofthe mobile terminal
`with the sub-device is released; receiving a user input via the
`communication path; and controlling elements and applica-
`tions of the terminal according to the received user input.
`[0012]
`Further scope of applicability of the present inven-
`tion will become apparentfrom the detailed description given
`hereinafter. However,
`it should be understood that
`the
`detailed description and specific examples, while indicating
`
`preferred embodiments of the invention, are given by illus-
`tration only, since various changes and modifications within
`the spirit and scope of the invention will become apparent to
`those skilled in the art from this detailed description.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`invention will become more fully
`[0013] The present
`understood from the detailed description given hereinbelow
`and the accompanying drawings, which are given byillustra-
`tion only, and thusare not limitative of the present invention,
`and wherein:
`
`FIG. 1 is a schematic block diagram of a mobile
`[0014]
`terminal implementing an embodimentof the present inven-
`tion;
`FIG. 2 isa front perspective view of a mobile termi-
`[0015]
`nal implementing an embodimentofthe present invention;
`[0016]
`FIG. 3 isa rear perspective view of a mobile termi-
`nal implementing an embodimentofthe present invention;
`[0017]
`FIGS. 3a and 36 are front views of the mobile ter-
`minalfor explaining operational states ofthe mobile terminal
`according to an embodimentofthe present invention;
`[0018]
`FIG. 41s a conceptual view for explaining a prox-
`imity depth of a proximity sensor;
`[0019]
`FIG. 5is aconceptual view for explaining a method
`for controlling a touch operation in a configuration that a pair
`of display units overlap with each other;
`[0020]
`FIGS. 6a and 66 are conceptual viewsillustrating
`proximity touch recognition regions where proximity signals
`are detected and haptic regions where haptic effects are gen-
`erated;
`FIG. 7 illustrates the configuration of the mobile
`[0021]
`terminal including a main device and a sub-device according
`to an embodimentof the present invention;
`[0022]
`FIG.8 illustrates the configuration ofthe sub-device
`attachable to the main device of the mobile terminal accord-
`ing to an embodimentof the present invention;
`[0023]
`FIGS. 9a to 9d illustrate various configuration ofthe
`sub-device according to an embodimentofthe present inven-
`tion;
`FIGS. 10a to 10d illustrate how the main device and
`[0024]
`the sub-device are coupled according to an embodimentofthe
`present invention;
`[0025]
`FIGS. 11a to 11e illustrate the structure and method
`for coupling or separating the sub-device to a folder type main
`device according to an embodimentofthe present invention;
`[0026]
`FIGS. 12a to 12eillustrate the structure and method
`for coupling or separating the sub-deviceto a slide type main
`device according to an embodimentofthe present invention;
`[0027]
`FIGS. 13a to 13d illustrate the structure and method
`for coupling or separating the sub-device to a swivel type
`main device according to an embodiment of the present
`invention;
`[0028]
`FIGS. 14a to 14d illustrate the structure and method
`for coupling or separating the sub-device to a bar type main
`device according to an embodimentofthe present invention;
`[0029]
`FIGS. 15a to 15d illustrate the structure and method
`for coupling or separating the sub-device to a watch type main
`device according to an embodimentofthe present invention;
`[0030]
`FIG. 16 illustrates the structure of a clip type sub-
`device that can be easily attached to any types ofmain devices
`according to an embodimentofthe present invention;
`[0031]
`FIGS. 17a@ and 176 illustrate an example of auto-
`matic controlling of a terminal operation (menudisplay);
`
`81
`
`81
`
`

`

`US 2010/0227642 Al
`
`Sep. 9, 2010
`
`FIG. 18 illustrates application of the automatic con-
`[0032]
`trolling of the terminal operation (menu display) to a swing
`type or swivel type mobile terminal;
`[0033]
`FIGS. 19a and 198 illustrate another example of
`automatic controlling ofa terminal operation (menudisplay);
`[0034]
`FIGS. 20a and 206 illustrate automatic controlling
`of a terminal operation (keypad controlling);
`[0035]
`FIG. 21 illustrates automatic controlling of a termi-
`nal operation (application controlling);
`[0036]
`FIG.22illustrates an example of automatic control-
`ling of a terminalstate;
`[0037]
`FIG. 23 illustrates another example of automatic
`controlling of a terminal state;
`[0038]
`FIG. 24 illustrates automatic controlling of power
`saving of the terminal;
`[0039]
`FIG.25 illustrates automatic controlling of locking
`of the terminal;
`[0040]
`FIG.26 illustrates user setting in controlling of cou-
`pling/separating according to an embodimentof the present
`invention;
`[0041]
`FIG. 27 illustrates controlling of power of the main
`device 100;
`[0042]
`FIG. 28 illustrates controlling of a call function of
`the sub-device 300;
`[0043]
`FIG. 29 illustrates controlling of a multimedia
`player;
`FIG. 30 illustrates an example of controlling of a
`[0044]
`mousefunction;
`[0045]
`FIG. 31 illustrates another example of controlling of
`the mouse function;
`[0046]
`FIG. 32 illustrates controlling of a game function;
`[0047]
`FIGS. 33a and 336 illustrate controlling of execu-
`tion of a widget;
`[0048]
`FIG. 34 illustrates an example of controlling of
`function interworking;
`[0049]
`FIG. 35 illustrates another example of controlling of
`function interworking;
`[0050]
`FIG. 36 illustrates mode conversion and strength
`adjustment of the main device;
`[0051]
`FIG. 37 illustrates remote controlling of an image
`capture function;
`[0052]
`FIGS. 38a and 386illustrate controlling of an emo-
`tion mode;
`[0053]
`FIGS. 39a to 39¢illustrate controlling of a function
`of the clip type sub-device;
`[0054]
`FIGS. 40¢ and 406illustrate an example of amethod
`of controlling the main device 100 and the sub-device 300 in
`a coupledstate;
`[0055]
`FIG. 41 illustrates another example of a method of
`controlling the main device 100 and the sub-device 300 in a
`coupledstate;
`[0056]
`FIG. 42 illustrates controlling of powerofthe ter-
`minal;
`FIGS. 43a to 43c illustrate coupling of non-touch
`[0057]
`type terminals and the sub-device;
`[0058]
`FIG.44illustrates a voice function part and a visual
`function part of the mobile terminal;
`[0059]
`FIG.45 illustrates multitasking ofthe voice function
`part and the visual function part;
`[0060]
`FIG.46 illustrates the mobile terminal used by sev-
`eral people at the same time;
`[0061]
`FIGS. 47a and 476 illustrate a video call of the
`mobile terminal according to an embodimentof the present
`invention;
`
`FIG. 48 illustrates the use of a second body in a
`[0062]
`separated state;
`[0063]
`FIG. 49 illustrates a coupling methodoffirst and
`second bodies according to an embodiment of the present
`invention;
`[0064]
`FIG. 50 illustrates the mobile terminal provided
`with powerfrom a solar cell;
`[0065]
`FIG. 51 illustrates a screen image of a charge menu
`of a solar cell environmentsetting;
`[0066]
`FIG. 52 illustrates a screen imageofa notification
`menuofthe solar cell environmentsetting; and
`[0067]
`FIG. 53 is a flow chart illustrating the process of
`charging a battery by the solar cell.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`[0068] The mobile terminal according to exemplary
`embodiments of the present invention will now be described
`with reference to the accompanying drawings. In the follow-
`ing description, the suffixes ‘module’, ‘unit’ and ‘part’ may be
`used for elements in order to facilitate the disclosure. Signifi-
`cant meanings or roles may not be givento the suffixes them-
`selves and it is understoodthat the ‘module’, ‘unit’ and ‘part’
`may be used together or interchangeably.
`[0069] Embodiments ofthe present invention maybe appli-
`cable to various types of terminals. Examples of such termi-
`nals may include mobile terminals as well as stationary ter-
`minals, such as mobile phones, user equipment, smart
`phones, DTV, computers, digital broadcast terminals, per-
`sonal digital assistants, portable multimedia players (PMP)
`and/or navigators.
`[0070] A further description may be provided with regard
`to a mobile terminal, although such teachings may apply
`equally to other types of terminals.
`[0071]
`FIG. 1 is a block diagram of a mobile terminal in
`accordance with an example embodiment. Other embodi-
`ments and arrangements mayalso be provided. FIG. 1 shows
`a mobile terminal 100 having various components, although
`other components may also be used. More or less components
`mayalternatively be implemented.
`[0072]
`FIG. 1 showsthat the mobile terminal 100 includes
`a wireless communication unit 110, an audio/video (A/V)
`input unit 120, a user input unit 130, a sensing unit 140, an
`output unit 150, a memory 160, an interface unit 170, a
`controller 180 and a power supply 190.
`[0073] The wireless communication unit 110 may be con-
`figured with several components and/or modules. The wire-
`less communication unit 110 may include a broadcast receiv-
`ing module 111, a mobile communication module 112, a
`wireless Internet module 113, a short-range communication
`module 114 anda position-location module 115. The wireless
`communication unit 110 may include one or more compo-
`nents that permit wireless communication between the
`mobile terminal 100 and a wireless communication system or
`a network within which the mobile terminal 100 is located. In
`case of non-mobile terminals, the wireless communication
`unit 110 may be replaced with a wire communication unit.
`The wireless communication unit 110 and the wire commu-
`nication unit may be commonlyreferred to as a communica-
`tion unit.
`
`[0074] The broadcast receiving module 111 mayreceive a
`broadcast signal and/or broadcast associated information
`from an external broadcast managing entity via a broadcast
`channel. The broadcast channel mayincludea satellite chan-
`nel anda terrestrial channel. The broadcast managing entity
`
`82
`
`82
`
`

`

`US 2010/0227642 Al
`
`Sep. 9, 2010
`
`mayrefer to a system that transmits a broadcast signal and/or
`broadcast associated information.
`
`[0075] At least two broadcast receiving modules 111 may
`be provided in the mobile terminal 100 to pursue simulta-
`neous reception of at least two broadcast channels or facili-
`tation of broadcast channel switching.
`[0076] Examples of broadcast associated information may
`include information associated with a broadcast channel, a
`broadcast program, a broadcast service provider, etc. For
`example, broadcast associated information may include an
`electronic program guide (EPG)of digital multimedia broad-
`casting (DMB) and an electronic service guide (ESG) of
`digital video broadcast-handheld (DVB-H).
`[0077] The broadcast signal may be a TV broadcast signal,
`a radio broadcast signal, and/or a data broadcast signal. The
`broadcast signal may further include a broadcast signal com-
`bined with a TV or radio broadcast signal.
`[0078] The broadcast receiving module 111 may receive
`broadcast signals transmitted from various types ofbroadcast
`systems. As a non-limiting example, the broadcasting sys-
`tems may include digital multimedia broadcasting-terrestrial
`(DMB-T), digital multimedia broadcasting-satellite (DMB-
`S), digital video broadcast-handheld (DVB-H), a data broad-
`casting system known as media forward link only (Media-
`FLO®)and integrated services digital broadcast-terrestrial
`(ISDB-T). The receiving of multicast signals may also be
`provided. Data received by the broadcast receiving module
`111 maybe stored in the memory 160, for example.
`[0079] The mobile communication module 112 may com-
`municate wireless signals with one or more network entities
`(e.g. a base station or Node-B). The signals may represent
`audio, video, multimedia, control signaling, and data, etc.
`[0080] The wireless Internet module 113 may support
`Internet access for the mobile terminal 100. This wireless
`
`Internet module 113 maybe internally or externally coupled
`to the mobile terminal 100. Suitable technologies for wireless
`Internet may include,but are not limited to, WLAN (Wireless
`LAN)(Wi-F1), Wibro (Wireless broadband), Wimax (World
`Interoperability for Microwave Access), and/or HSDPA
`(High Speed Downlink Packet Access). The wireless Internet
`module 113 may be replaced with a wire Internet module in
`non-mobile terminals. The wireless Internet module 113 and
`the wire Internet module maybe referred to as an Internet
`module.
`
`[0081] The short-range communication module 114 may
`facilitate short-range communications. Suitable technologies
`for short-range communication may include, but are not lim-
`ited to, radio frequency identification (RFID), infrared data
`association (IrDA), ultra-wideband (UWB), as well as net-
`working technologies such as Bluetooth and ZigBee.
`[0082] The position-location module 115 may identify or
`otherwise obtain a location of the mobile terminal 100. The
`position-location module 115 maybe provided using global
`positioning system (GPS) components that cooperate with
`associated satellites, network components, and/or combina-
`tions thereof.
`
`[0083] The position-location module 115 may precisely
`calculate current 3-dimensional position information based
`on longitude, latitude and altitude by calculating distance
`information and precise time information from at least three
`satellites and then by applyingtriangulationto the calculated
`information. Location and time informations may be calcu-
`lated using three satellites, and errors of the calculated loca-
`tion position and time informations may then be amended or
`
`changed using anothersatellite. The position-location mod-
`ule 115 may calculate speed information by continuously
`calculating a real-time current location.
`[0084] The audio/video (A/V)input unit 120 may provide
`audio or video signal input to the mobile terminal 100. The
`A/V input unit 120 may include a camera 121 and a micro-
`phone 122. The camera 121 mayreceive and process image
`frames ofstill pictures and/or video.
`[0085] The microphone 122 mayreceive an external audio
`signal while the mobile terminalis in a particular mode, such
`as a phonecall mode, a recording mode and/or a voice rec-
`ognition mode. The received audio signal may then be pro-
`cessed and converted into digital data.
`[0086] The mobile terminal 100, and in particular the A/V
`input unit 120, may include a noise removing algorithm (or
`noise canceling algorithm) to remove noise generated in the
`course of receiving