`(12) Patent Application Publication (10) Pub. No.: US 2010/0227642 A1
`
` Kim et al. (43) Pub. Date: Sep. 9, 2010
`
`
`US 20100227642A1
`
`(54) MOBILE TERMINAL HAVING SUB-DEVICE
`
`(30)
`
`Foreign Application Priority Data
`
`.
`InVemorS-
`
`(75)
`
`.
`.
`Jong'Hwan K11“: Gyeonggl'do
`(KR); Sang-Yun 0h, Seoul (KR);
`Woo-Jin Suh, Seoul (KR);
`Sang-Hyuck Lee, Seoul (KR)
`
`Correspondence Address:
`LEE, HONG, DEGERMAN, KANG & WAIMEY
`660 S. FIGUEROA STREET, Suite 2300
`LOS ANGELES, CA 90017 (US)
`
`(73) Assignee:
`
`LG Electronics Inc.
`
`(21) Appl. NO':
`
`12/552’766
`
`(22)
`
`Filed:
`
`Sep. 2, 2009
`
`Mar. 5, 2009
`Apr. 21, 2009
`
`(KR) ........................ 10-2009-0019010
`(KR) ........................ 10—2009—0034739
`_
`_
`_
`_
`Publication Class1ficat10n
`
`(51)
`
`Int. Cl.
`H04M 1/00
`
`(2006.01)
`
`(52) US. Cl. ..................................................... 455/556.1
`(57)
`ABSTRACT
`h d
`.
`h
`.
`1 d
`b d
`.
`1
`.
`b]
`A mo 1e termma inc u es a su - eV1ce t at is attac e
`thereto or detached therefrom, to remotely control the opera-
`tion and state ofthe terminal. The mobile terminal includes: a
`
`sub-device haVing an input/output unit and attached to or
`detached from the terminal; and a controller configured to
`receive a user input Via a certain communication path from
`the sub-device when the sub-device is separated, and control
`elements and applications of the terminal according to the
`user input.
`
`(:3
` 63:9ng
`
`130019513 "G
`
`
`
`
`SEPARATiNG
`
`1
`
`APPLE 1010
`
`APPLE 1010
`
`1
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 1 of 79
`
`US 2010/0227642 A1
`
`FIG.
`
`1
`
`
`7
`PGWEE YYYYYYY 3
`
`
`YYYYYY
`
`
`YYY'YYYYYYY
`
`-
`
` _
`
`
`
`
`
`AUDIG YYYYYYYYM'
`
`'
`
`YYOIRE
`
`'YYYYYYYYYGY0 Ya
`Y
`‘
`
`Y
`.
`YYUYYIY:
`
`1-12 “Y YYYYYYYYYYYYYYYYYYYYY
`{W Y
`YYYYYYYYS” " -
`
`
`E
`YYYYYYYYYY YYYYYYYY
`f
`............................................
`3,
`
` _
`;
`
`dHUKTflAYYAIE
`_
`‘ WAEW‘YILATAGX YAQBAEJEI
`
`‘
`
`
`
`f”""“"‘”“"“" mmmmmm
`
`
`A‘Y‘ MW? LEVY;
`
`
`
`W Y‘YFLTLYYEDIA 5‘18"
`
` Y YYYYYYYYYYYYYYYY
`
`
`
`
`
`YYYYYYY
`
`' ~~ 1:66
`
`
`
`DYYTANE
`YYYJAY
`__
`
`5
`DETYCYEK‘YY SEE30R
`
`
` YY~YYYY‘"
`
`
`YYYYYYIYYYYYYYYYYY
`
`12‘
`
`2
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 2 of 79
`
`US 2010/0227642 A1
`
`F}.
`
`K},
`
`22
`
`
`
`FIG
`
`22
`
`
`
`3
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 3 0f 79
`
`US 2010/0227642 A1
`
`FIG 3A
`
`10K
`
`121 E5?“
`
`319
`
`
`
`‘
`
`1‘51,_'_
`
`1513:»,g_._,
`
`151$ ...‘
`
`l'5},-bwg_'_i" V
`
`_._-
`
`_
`
`4
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 4 0f 79
`
`US 2010/0227642 A1
`
`FIG 3B
`
`
`
`5
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 5 0f 79
`
`US 2010/0227642 A1
`
`FIGQ 4'}
`
`K
`
`mm“"m
`
`Tl}
`£53 -m,.......~-....--~w~-ww,.~w*__..- _. w .. ,..WMWWWMwrwvwn "7...... ._.._.uf« ymww.‘i.»-...f-nw‘_._...~...,———.—_—._;~ w
`1
`I312 u,fm.._,_......_.____.____r.h._.““4”“;w‘mw..g.h.;,_._+w.;_;_;.;;..gagwm‘_v;.q..__.____ ..*_..'.;.Anmw.wm.w~-.a
`
`
`
`6
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 6 of 79
`
`US 2010/0227642 A1
`
`
`
`
`3 {-4'MA1N‘803Y
`
`‘
`
`5 -'~a§QLDER PART
`
` Mm W. ,.
`:31] FRIEND E
`‘
`
`’
`
` ' 1mm; VIEW ; Em
`
`
`
`:
`
`156
`155
`{Miifliimmmimmmmwwmmmm
`
`mm”
`.ii
`gauf
`_mmfligmmg
`E
`-
`
`iii} galifis 1
`" '5
`:...
`
`
`
`
`863%),- {Mme
`v:
`{Mimi}
`333%; ”BASE:
`
`
`
`E We K133»?
`: 123 may
`
`
`
`
`
`_
`
`.
`
`
`
`
`
`7
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 7 0f 79
`
`US 2010/0227642 A1
`
`FIG. 6A
`
`
`
`8
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 8 0f 79
`
`US 2010/0227642 A1
`
`MM 3903-
`-
`Swims;
`: amnew WET
`
`.
`
` ;_
`
`_
`.
`_
`SUB-~DEEQCEB
`
`~-
`
`
`
`mew' 7“ ”W! 3001)
`
`419
`210
`{I cgmme;
`'CQEEPLINKEEMT ,
`
` mfim .
`
`.mamafcasma
`.
`.
`r
`w
`
`*
`'Wv Wm ;
`,
`_. “W E
`‘ m;
`2%-
`
`
`
`;Jmmm um
`“M ”3“- N“ maimm an: "gm-223
`42.3-
`
`
`
`
`4:50..» .
`_CONN£CT10MM1%~_
`‘7" ‘:
` :
`
`_
`M2
`“*9x
`45*-
`
`
`
`
`
`£5213?me
`K
`.,
`~,
`
`
`fiEfi‘iiniOa‘Q um? ‘
`
`
`
`
`433-"éEco2qNECIIDN WET J
`
`
`
`30911
`
`9
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 9 0f 79
`
`US 2010/0227642 A1
`
`FIG“
`
`.8
`
`
`
`1O
`
`10
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 10 0f 79
`
`US 2010/0227642 A1
`
`FIG 9A
`
`
`
`rww-ww&Wewmfl
`_ W®W1¢ 283
`
`E,
`
`
`
`g éwwmgiw+ 4-30
`L W. m m... ..,_._ .. w M... .M J
`
`
`
`11
`
`11
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 11 0f 79
`
`US 2010/0227642 A1
`
`HG; 9C
`
`is‘lDliCfi‘EOR
`
`SPEAKER
`
`MIC
`
`EfiWHGNE
`:
`'
`
`
`
`
`
`12
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 12 0f 79
`
`US 2010/0227642 A1
`
`HG i 0A
`
`
`
`
`
`13
`
`13
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 13 0f 79
`
`US 2010/0227642 Al
`
`N G 10B
`
`
`
`183C}
`
`{3;}UPLEEEG
`
`
`
`14
`
`14
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 14 0f 79
`
`US 2010/0227642 A1
`
`M G 1 C
`
`
`
`
`
`
`
`-"-,....a.....‘-..;~-4..‘....'..'.........u...,._...-.-.'...g..r...w...;...;....=...-.
`_..a www.mv—
`.
`V
`.
`.
`.
`.
`.
`.
`.
`HEW
`
`- VW~w»--~»m»....‘~mmm ._,
`“1...”...
`..“.l,-¢~w.._arnw-----m
`.
`
`-
`-
`-
`,
`-mwww
`
`
`
`15
`
`15
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 15 0f 79
`
`US 2010/0227642 A1
`
`FIG. 1-0:)
`
`
`
`
`16
`
`16
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 16 0f 79
`
`US 2010/0227642 A1
`
`FIG;
`
`11A.
`
`10Gb.
`
`J
`
`/ Cit: m (3%
`“NM“. DVMCm f/
`
`NW“
`
`V {4+
`“5““;
`
`lfifiav _y
`
`
`
`
`17
`
`17
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 17 0f 79
`
`US 2010/0227642 A1
`
`FIG 11 B
`
`
`.
`ngz:
`"
`
`.
`<22; é:;> ~“;::
`~
`xéfibqwm5%?
`
`fimfim‘“9~*§\;;;;?’/
`£305
`
`.
`
`
`
`
`
`1’;
`z
`
`
`
`
`
`
`
`
`
`
`O
`
`‘5‘...”
`
`_ “a“
`.r'
`
`,..
`
`X
`f”
`/
`
`f
`
`I
`
`~N
`
`mN _
`
`
`
`r
`
`3
`
`/ J
`
`.
`
`‘ _
`
`302:}
`
`---r~»-«~—
`
`
`
`18
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 18 0f 79
`
`US 2010/0227642 A1
`
`FIG 11C
`
`
`
`19
`
`19
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 19 0f 79
`
`US 2010/0227642 A1
`
`
`
` ‘CQUFLENQ-
`
`{: / f
`\L
`i
`
`gamma
`
`20
`
`20
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 20 0f 79
`
`US 2010/0227642 A1
`
`HG. 11E
`
`
`
`21
`
`21
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 21 of 79
`
`US 2010/0227642 A1
`
`‘IGv 12A
`
` 151. a
`
`22
`
`22
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 22 of 79
`
`US 2010/0227642 A1
`
`
`
`23
`
`23
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 23 0f 79
`
`US 2010/0227642 A1
`
`Fiat}, 120
`
` SEPARA’EENG
`
`539
`
`_
`
`
`
`
`
`i}\ _
`
`
`
`:(Djlli’L-iM;
`
`24
`
`24
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 24 0f 79
`
`US 2010/0227642 A1
`
`<3
`
`smmme
`
` :: {E’Lmfi
`
`25
`
`25
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 25 of 79
`
`US 2010/0227642 A1
`
`1'11}
`
`1 121*?
`
`
`
`26
`
`26
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 26 0f 79
`
`US 2010/0227642 A1
`
`FIG.)
`
`1 3A
`
`
`
`27
`
`27
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 27 of 79
`
`US 2010/0227642 A1
`
`F19 1188
`
`{
`
`NH,11,mB;
`
`35mm web
`
`iGfi 13C
`
`28
`
`28
`
`
`
`
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 28 0f 79
`
`US 2010/0227642 A1
`
`FIG; 13D
`
`
`
`TMWW?’
`
`wwmmwmm‘m '”meunxmmwu Er
`flflflfl,00909
`
`
`.0.I.i’
`
`/.
`
`.i E3
`
`29
`
`29
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 29 0f 79
`
`US 2010/0227642 A1
`
`FiiGfi 14A
`
`
`
`
`
`
`
`30
`
`30
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 30 0f 79
`
`US 2010/0227642 A1
`
`FIG 14B
`
`
`
`31
`
`31
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 31 0f 79
`
`US 2010/0227642 A1
`
`FiG iii-“C
`
`
`
`.s'amqrma 4} fi GWFG
`
`
`
`32
`
`32
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 32 0f 79
`
`US 2010/0227642 A1
`
`
`
`33
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 33 0f 79
`
`US 2010/0227642 A1
`
`
`
`
`
`34
`
`34
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 34 0f 79
`
`US 2010/0227642 A1
`
`FIG» 15C
`
` g
`
`{180%}NG
`g? sfipmnm
`
`
`
`35
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 35 0f 79
`
`US 2010/0227642 A1
`
`FIG 153
`
`
`
`36
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 36 0f 79
`
`US 2010/0227642 A1
`
`FEG.
`
`'16
`
`
`
`37
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 37 0f 79
`
`US 2010/0227642 A1
`
`
`
`mm: may
`
`38
`
`38
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 38 0f 79
`
`US 2010/0227642 A1
`
`FIG 17B
`
`
`
`39
`
`39
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 39 0f 79
`
`US 2010/0227642 A1
`
`FIG;
`
`18:?
`
`i MW 100
`
`
`
`40
`
`40
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 40 0f 79
`
`US 2010/0227642 A1
`
`W Ga,
`
`1.91%
`
`306’ ‘
`
`'
`
`9 ~~-—:;oa
`
`41
`
`41
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 41 0f 79
`
`US 2010/0227642 A1
`
`FIG, 11%
`
`30:3. -
`
`"Wm-139-
`
`.E “a...“
`
`sammma
`
`KEYPAS imptmm firm 0R
`ET @0335 mz-Pummm MENU
`
`42
`
`42
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 42 0f 79
`
`US 2010/0227642 A1
`
`FEGQ 20A
`
` 9A0
`
`mama; 03 30,23 KEY
`
`
`
`43
`
`43
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 43 0f 79
`
`US 2010/0227642 A1
`
`
`HG 90
`
`
`mm WWW __
`
`44
`
`44
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 44 0f 79
`
`US 2010/0227642 A1
`
`FiG 211A
`
`mm ViEii‘ER '
`{:j> 30G ~~~ M
`
`CSUE’LING
`
`. “‘“M £05)
`
`45
`
`45
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 45 0f 79
`
`US 2010/0227642 A1
`
`
`
`
`
`46
`
`46
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 46 of 79
`
`US 2010/0227642 A1
`
`H G 9
`
`232
`
`
`
`47
`
`47
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 47 0f 79
`
`US 2010/0227642 A1
`
`WG—3 23
`
`BALI-3(GRGUNEEMC? 1
`
`i
`
`i SEE‘KRA’HNQ
`
`
`
`333333333313 13333 3
`
`
`
`BACK:ROWE?
`
`3" ’3
`
`48
`
`48
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 48 0f 79
`
`US 2010/0227642 A1
`
`39a, ~--~ ~
`
`mama (mm: a?
`Leg: {,‘r- hiéifigfim‘ 13,
`immiécw was it???)
`
`L->
`
`196
`
`
`CGUPLRQG, (REESE ~31?
`LCE: GE? 'aamzsé 30;)? .113
`AUMEICALLY 'iHRNED 0N} -
`
`-
`
`49
`
`49
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 49 of 79
`
`US 2010/0227642 A1
`
`
`
`-~.».~;__~_~.
`
`SEEKING LIBCKING
`
`_
`SEPARAIINS
`IIIAEN‘BOBY :5 SEE-I IQ RE
`Alfi‘fihfi’ifiifiifi LSEKED)
`
`M ,
`
`ll
`
`. mama
`cm BODY 18, SET. ID 3;
`aa'raémma‘z imam;
`
`
`
`FIG .,
`
`323 E3
`
`""""""-{IEIIIEIM‘}
`
`Gama sfimm
`Emigmé gamma
`CPEIIAIEGN 00ng
`.- STATE 50mg;
`- 3 P3551: smmmgi,
`"
`{J
`553ng {$an
`{3
`I
`
`
`
`
`
`
`
`
`_.
`
`
`
`
`FESER 3mm; IBM?)
`
`50
`
`50
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 50 0f 79
`
`US 2010/0227642 A1
`
`EjGu 27
`
`'f-
`
`.
`
`_
`
`
`
`SEEEEEE—REEEEE EGEEJEEJEQETEEEEE-iE ,
`(BE,
`EE‘DAT etc}
`
`
`
`POWER 9?? i
`
`51
`
`51
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 51 0f 79
`
`US 2010/0227642 A1
`
`FiGw 28
`
`
`
`:CARHEEHJ‘AROZEND 1351
`B136 GR PCI‘I‘HW
`
`33333333 .33
`
`HQHEHMHE éflSPLA-Y
`
`
`
`
`
`
`
`
`"(1511311 FRC1H
`HHHG HIEDBMS“
`
`333
`
`3W3?
`01‘EwiINE 3533313?
`
`
`
`52
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 52 0f 79
`
`US 2010/0227642 A1
`
`PEG“ 29
`
` :
`
`w:
`a
`j
`‘ j *
`~
`.
`
`1
`5
`
`.5
`;
`5
`.
`
`
`
`SEER/PM‘JL Wfififiiiflififi
`
`
`
`
`CARREEE 1%} 3531} 1}?
`$35" {3R Exii’ilii‘lifi’
`
`33;3‘33E’G’é
`
`mm“: $1321.53“
`m...“
`
`‘
`
`‘ A
`
`‘
`
`'
`
`'
`
`h .
`
`.
`
`v...
`
`'
`
`_
`
`_'
`
`x
`
`1/
`
`a
`i
`
`3 i
`
`5 3
`
`, mm (a?
`ammma MSPW
`
`L
`auxin ’3?
`Wigwam DISPLAY
`
`53
`
`53
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 53 0f 79
`
`US 2010/0227642 A1
`
`mm 30
`
`32-0 «M, ”'
`
`
`WNW -
`'
`
`-
`
`
`SSEGIEI~§£§E§
`
`54
`
`54
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 54 0f 79
`
`US 2010/0227642 A1
`
`F1 G i. 31
`
`
`
`
`Slrialefwmwa
`
`_ *CGQKEUM’QATIOM
`
`55
`
`55
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 55 0f 79
`
`US 2010/0227642 A1
`
`Immmw'
`
`_ Wmumm
`
`
`56
`
`56
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 56 0f 79
`
`US 2010/0227642 A1
`
`
`
`57
`
`57
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 57 0f 79
`
`US 2010/0227642 A1
`
`‘ 16(3-
`
`‘
`
`x}
`
`"human-F“
`
`“94......”
`
`\
`‘3
`I
`
`x
`.
`i
`
`i
`
`WHX‘W: {iiimfifiéififi’i‘ififij
`(8?, 133A, 816-.)
`
`'
`
`*
`
`. EESPLAY m3“.
`
`& (GE: PRMGGS)
`
`-
`
`1mg mg.
`
`
`
`58
`
`58
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 58 0f 79
`
`US 2010/0227642 A1
`
`{8‘1 mm, etc.)
`
`'S%Efi32'1*~kié$fi temzymmfi _ .; .-
`
`
`
`
`
`SESPLAY ammméafi EMT
`
`
`
`RECQGNKZE USER‘S iif‘iiimfiii-WEN INPUT
`mu DESfifl‘f mwSPONDIrs-is .
`camamfis {PRINT LE‘N‘ERS)
`
`59
`
`59
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 59 0f 79
`
`US 2010/0227642 A1
`
`MG '8 63
`
`
`
`
`‘3
`
`W”
`
`‘3
`‘1
`1
`
`M.
`
`333
`
`wwwn' n.
`
`Sifi}E‘T-RA=‘%EE 10333333333333-
`3 Bi: 3323 333-3;)
`
`.
`
`.
`
`.
`
`6O
`
`60
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 60 0f 79
`
`US 2010/0227642 A1
`
`FIG. 88A
`
`3033
`s.
`
`393’)-
`3
`
`363:3
`5
`
`W 33333; 33333333
`WWW...”
`
`.
`
`”TEQF£33333j
`
`3
`
`3] {1333- 5%
`
`305% 533%
`
`¥
`
`3 3%335%5%%
`
`
`
`
`W , ME
`P3333 533333335313)
`
`gmeWW—ME
`335533 33333353335333)
`
`33333353353333 335335:3333U3)
`
`FIG. 3‘88
`
`#5
`
`
` 33 3; “33333533333335
`
` 3 55335355555 _C>i
`
`3""""""""
`
`3333333323
`_
`(83312 a‘c’so‘ck}
`
`3533355333
`{3? 18 0 333330115)
`
`33333533:
`{f18~24. 603333133“)
`
`61
`
`61
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 61 0f 79
`
`US 2010/0227642 A1
`
`FIG,
`
`:3- 9A
`
`
`
`62
`
`62
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 62 0f 79
`
`US 2010/0227642 A1
`
`FIG, 8396
`
`
`
`' son
`
`FIG.
`
`iii-QB
`
`
`
`
`‘
`
`,
`
`‘
`
`\\
`
`
`IR‘EZFA, 13m...) Q: *
`
`~
`~i
`’
`-
`.a
`a
`,1
`:
`bfifii‘fififififi Ufi‘fiflmfi
`.
`\ _
`.
`
`.
`x 1::
`.\:>fi
`i
`j i
`' b3»...
`\
`\‘
`
`: L-a L :-
`
`_
`
`
`
`‘
`
`(133",
`
`63
`
`63
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 63 of 79
`
`US 2010/0227642 A1
`
`64
`
`64
`
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 64 0f 79
`
`US 2010/0227642 A1
`
`FIG—i 40A
`
`
`
`
`'"1
`
`
`
`
`' lawns 1mm
`
`[3 WE? TYPES Cliriz‘ifiii
`
`$33952? BEDREEL’HGE
`
`
`
`:3“ m’mm 2mm MGR?
`
`
`
`3 W390
`
`65
`
`65
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 65 0f 79
`
`US 2010/0227642 A1
`
`{:23 iNTERNAi
`
`
`
` m LDNTM’FS
`
`
`
`
`(3?:G?can
`
`
`'
`
`J
`
`1&0.
`
`66
`
`_____
`‘
`(”Mew '
`iii-Pi? LEM“
`
`,
`
`i
`
`66
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 66 0f 79
`
`US 2010/0227642 A1
`
`FIG. 41
`
`
`
` . gfil‘éfiGfl
`
`
`
`67
`
`67
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 67 0f 79
`
`US 2010/0227642 A1
`
`
`
`
`
`
`
`mm 91:?- MN mm 3.0) CAN a
`CNTRQLIES $35 {SUBmfiEVi'QEi30333:}
`
`68
`
`68
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 68 0f 79
`
`US 2010/0227642 A1
`
`FIG 43A
`
`._
`
`30.6%.“;
`
`1'N
`Q‘Nmkj
`1Ix
`/
`
`:
`
`
`
`/ g
`
`eigm Tm: TERMINAL
`
`69
`
`69
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 69 0f 79
`
`US 2010/0227642 A1
`
`FEE G Q
`
`
`
`8 C
`
`(f
`,3 9
`
`.
`
`f
`
`Rm? TYPE- "iélTiétfiéaiimm.
`
`7O
`
`70
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 70 0f 79
`
`US 2010/0227642 A1
`
` _
`
`WWSUAL FUNCTEQii mmaa)
`‘ NVGICE FUNCTIQN PART{ 13%))
`
`CQ§3§314§N§ WW}
`.
`.
`r
`,-
`fl
`
`-
`
`\_
`
`M" q .
`‘éEfiRTELfii,
`
`{MMEREC .KE‘JBGMD)
`
`71
`
`71
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 71 0f 79
`
`US 2010/0227642 A1
`
`FIE
`
`45
`
`,u-m m,“ m— --.,-—-r--_-- -- --g ....._....w.... -- mm...
`
`f"'5"“5’l5"7'T"””“""'"";"M
`
`
`
`Mu] Eli" aakifig
`
`72
`
`72
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 72 0f 79
`
`US 2010/0227642 A1
`
`HQ 46
`
`
`
`73
`
`73
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 73 0f 79
`
`US 2010/0227642 A1
`
`FEG ,,. 47A
`
`
`
`74
`
`74
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 74 0f 79
`
`US 2010/0227642 A1
`
` H G é
`
`
`
`75
`
`75
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 75 0f 79
`
`US 2010/0227642 A1
`
`#”*””“‘“* “““““““““““““““““““““““““““
`*REMO’E‘E EGRTROLLER
`
`;
`
`: ig ii i I ii sg is ia sa i i
`
`'\ ..._.~wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww w
`
`91%
`
`i i
`
`
`
`
`/"""""""“"‘““",“T”Z"”§.“:”"I"_"”“WMWWMWW” mmmmmmmmmmm “mm
`
`
`REMOTE cairmvm a: {swat/aim.
`
`1
`i
`4
`3
`2
`I
`s
`1
`x
`g
`s
`i
`i
`i
`i
`a
`u
`a
`a
`s
`i
`.
`
`i
`
`76
`
`E
`s
`3
`3:
`i
`a
`a‘
`3;.
`3
`i
`i
`z
`z
`i
`i
`i
`i
`i
`3'
`i:
`i
`
`/
`
`76
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 76 0f 79
`
`US 2010/0227642 A1
`
`
`
`77
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 77 0f 79
`
`US 2010/0227642 A1
`
`MG. 350
`
`31.0-
`
`FRQNT ‘
`bimfihi‘kgg
`
`.r' SGLAE LEGHT
`
`\\
`
`REAR
`sums}; f;z,
`_
`_
`f
`i
`.
`
`I
`
`- 'i
`
`3’!
`
`I
`‘
`
`I
`
`h
`
`
`
`<PRO‘V’EBED DH REAR SURFAQEE
`
`
`
`swim}; RAM;
`,,‘;‘C3§?0£‘§....._ -
`
`
`
`3
`
`
`
`78
`
`78
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 78 of 79
`
`US 2010/0227642 A1
`
`FIG. 51
`
` 3333133333?
`
`-
`
`_ W333 3313.; 3333333333 333333333 '
`
`C3333 333333333
`{3; 33333 3333 33333 3333333
`
`
`
`333333: 33133333 3333133
`
`
`
`
`‘
`
`
`
`
`Q SfifiZ-Bfiii’ifi 'QNLY
`
`
`l 3333 3333333333 33333133
`
`
`
`
`
`Q 33 1:3 333133—333 333333 ,
`
`C3 33333 CELL 33333333331333
`
`
`
`~
`
`
`(INDICATOR)
`«33333: 333 3313333333 33333333» .
`
`
`WE. ' 33333333333
`
`
`
`(.2) 33:13 3333333333333 3333333333 '
`
`
`
`
`
`
`
`-W
`
`{2*} SE33 3333233333333 3333333333):
`- 333% 33333333333333;
`
` s
`*‘ 0.31 {-3333 333312333313 333133} ;
`‘
`
`
`79
`
`
`
`Patent Application Publication
`
`Sep. 9, 2010 Sheet 79 0f 79
`
`US 2010/0227642 A1
`
`FFG 53
`
` L.
`
`F43,
`"
`‘
`
`‘
`
`-; FFFFFFFFFFTFFFF
`
`,flFFFFFFF\\
`FFF FFFFFFFFFTFFF
`-'
`FFFF FFFF FFFIFFF
`- {FY SFFFBEFICF}E
`
`
`
`
`,
`
`._ _?. TFFFFFFFF FFFFFF: FF:FFFFFFF H
`
`,
`FFSFFFF F0 FFFF DEFILE
`
`mmMWmemwwwmmmmrmum-MmM“.w
`
`
`
`: FLFRF UFFPUT (FFFMIFFFFVFFE)_
`_
`
`
`
`
`
`
`80
`
`80
`
`
`
`US 2010/0227642 A1
`
`Sep. 9, 2010
`
`MOBILE TERMINAL HAVING SUB-DEVICE
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] The present application claims priority to Korean
`Application No. 10-2009-0019010 filed in Korea on Mar. 5,
`2009, and Korean Application No. 10-2009-0034739 filed in
`Korea on Apr. 2 l, 2009, the entire contents ofwhich is hereby
`incorporated by reference in its entirety.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`[0002]
`[0003] The present invention relates to a mobile terminal
`that allows a sub-device to be attached thereto or detached
`therefrom.
`
`2. Description of the Related Art
`[0004]
`[0005] Terminals may be divided into a mobile terminal
`(portable terminal) and a stationary terminal according to
`whether the terminal is portable or not. The mobile terminals
`may be divided into a handheld terminal that can be directly
`carried around and a vehicle mount terminal.
`
`[0006] According to diversification of functions, the termi-
`nals are implemented in the form of multimedia players hav-
`ing complex functions such as capturing images or video,
`reproducing music or video files, playing games, receiving
`broadcasts, etc.
`[0007]
`In order to support and increase the functions of the
`terminals, modification of structural parts and/or software
`parts of the terminals may be taken into consideration.
`Research on mobile terminals having bodies that are made
`blocks or modularized so as to be detachably attached in
`functional or structural aspects is ongoing.
`
`SUMMARY OF THE INVENTION
`
`[0008] Accordingly, one object of the present invention is
`to address the above-noted and other problems.
`[0009] Another object ofthe present invention is to provide
`a method for controlling an operation and state of a mobile
`terminal when a main device and a sub-device of the mobile
`
`terminal are coupled or separated.
`[0010]
`To achieve these and other advantages and in accor-
`dance with the purpose of the present invention, as embodied
`and broadly described herein, the present invention provides
`in one aspect a mobile terminal including: a sub-device hav-
`ing an input/output unit and attached to or detached from the
`terminal; and a controller configured to receive a user input
`via a certain communication path from the sub-device when
`the sub-device is separated, and control elements and appli-
`cations of the terminal according to the user input.
`[0011]
`To achieve these and other advantages and in accor-
`dance with the purpose of the present invention, as embodied
`and broadly described herein, the present invention provides
`in another aspect a method for controlling coupling and sepa-
`ration of a sub-device to or from a mobile terminal, the
`method including: establishing a radio communication path
`with the sub-device when a connection ofthe mobile terminal
`
`with the sub-device is released; receiving a user input via the
`communication path; and controlling elements and applica-
`tions of the terminal according to the received user input.
`[0012]
`Further scope of applicability of the present inven-
`tion will become apparent from the detailed description given
`hereinafter. However,
`it should be understood that
`the
`detailed description and specific examples, while indicating
`
`preferred embodiments of the invention, are given by illus-
`tration only, since various changes and modifications within
`the spirit and scope of the invention will become apparent to
`those skilled in the art from this detailed description.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`invention will become more fully
`[0013] The present
`understood from the detailed description given hereinbelow
`and the accompanying drawings, which are given by illustra-
`tion only, and thus are not limitative of the present invention,
`and wherein:
`
`FIG. 1 is a schematic block diagram of a mobile
`[0014]
`terminal implementing an embodiment of the present inven-
`tion;
`FIG. 2 is a front perspective view of a mobile termi-
`[0015]
`nal implementing an embodiment of the present invention;
`[0016]
`FIG. 3 is a rear perspective view of a mobile termi-
`nal implementing an embodiment of the present invention;
`[0017]
`FIGS. 3a and 3b are front views of the mobile ter-
`minal for explaining operational states ofthe mobile terminal
`according to an embodiment of the present invention;
`[0018]
`FIG. 4 is a conceptual view for explaining a prox-
`imity depth of a proximity sensor;
`[0019]
`FIG. 5 is a conceptual view for explaining a method
`for controlling a touch operation in a configuration that a pair
`of display units overlap with each other;
`[0020]
`FIGS. 6a and 6b are conceptual views illustrating
`proximity touch recognition regions where proximity signals
`are detected and haptic regions where haptic effects are gen-
`erated;
`FIG. 7 illustrates the configuration of the mobile
`[0021]
`terminal including a main device and a sub-device according
`to an embodiment of the present invention;
`[0022]
`FIG. 8 illustrates the configuration ofthe sub-device
`attachable to the main device of the mobile terminal accord-
`
`ing to an embodiment of the present invention;
`[0023]
`FIGS. 9a to 9d illustrate various configuration ofthe
`sub -device according to an embodiment of the present inven-
`tion;
`FIGS. 10a to 10d illustrate how the main device and
`[0024]
`the sub-device are coupled according to an embodiment ofthe
`present invention;
`[0025]
`FIGS. 11a to lle illustrate the structure and method
`for coupling or separating the sub -device to a folder type main
`device according to an embodiment of the present invention;
`[0026]
`FIGS. 12a to 126 illustrate the structure and method
`for coupling or separating the sub-device to a slide type main
`device according to an embodiment of the present invention;
`[0027]
`FIGS. 13a to 13d illustrate the structure and method
`for coupling or separating the sub-device to a swivel type
`main device according to an embodiment of the present
`invention;
`[0028]
`FIGS. 14a to 14d illustrate the structure and method
`for coupling or separating the sub-device to a bar type main
`device according to an embodiment of the present invention;
`[0029]
`FIGS. 15a to 15d illustrate the structure and method
`for coupling or separating the sub-device to a watch type main
`device according to an embodiment of the present invention;
`[0030]
`FIG. 16 illustrates the structure of a clip type sub-
`device that can be easily attached to any types ofmain devices
`according to an embodiment of the present invention;
`[0031]
`FIGS. 17a and 17b illustrate an example of auto-
`matic controlling of a terminal operation (menu display);
`
`81
`
`81
`
`
`
`US 2010/0227642 A1
`
`Sep. 9, 2010
`
`FIG. 18 illustrates application of the automatic con-
`[0032]
`trolling of the terminal operation (menu display) to a swing
`type or swivel type mobile terminal;
`[0033]
`FIGS. 19a and 19b illustrate another example of
`automatic controlling of a terminal operation (menu display);
`[0034]
`FIGS. 20a and 20b illustrate automatic controlling
`of a terminal operation (keypad controlling);
`[0035]
`FIG. 21 illustrates automatic controlling of a termi-
`nal operation (application controlling);
`[0036]
`FIG. 22 illustrates an example of automatic control-
`ling of a terminal state;
`[0037]
`FIG. 23 illustrates another example of automatic
`controlling of a terminal state;
`[0038]
`FIG. 24 illustrates automatic controlling of power
`saving of the terminal;
`[0039]
`FIG. 25 illustrates automatic controlling of locking
`of the terminal;
`[0040]
`FIG. 26 illustrates user setting in controlling of cou-
`pling/separating according to an embodiment of the present
`invention;
`[0041]
`FIG. 27 illustrates controlling of power of the main
`device 100;
`[0042]
`FIG. 28 illustrates controlling of a call function of
`the sub-device 300;
`[0043]
`FIG. 29 illustrates controlling of a multimedia
`player;
`FIG. 30 illustrates an example of controlling of a
`[0044]
`mouse function;
`[0045]
`FIG. 31 illustrates another example of controlling of
`the mouse function;
`[0046]
`FIG. 32 illustrates controlling of a game function;
`[0047]
`FIGS. 33a and 33b illustrate controlling of execu-
`tion of a widget;
`[0048]
`FIG. 34 illustrates an example of controlling of
`function interworking;
`[0049]
`FIG. 35 illustrates another example of controlling of
`function interworking;
`[0050]
`FIG. 36 illustrates mode conversion and strength
`adjustment of the main device;
`[0051]
`FIG. 37 illustrates remote controlling of an image
`capture function;
`[0052]
`FIGS. 38a and 38b illustrate controlling of an emo-
`tion mode;
`[0053]
`FIGS. 39a to 396 illustrate controlling of a function
`of the clip type sub-device;
`[0054]
`FIGS. 40a and 40b illustrate an example of a method
`of controlling the main device 100 and the sub-device 300 in
`a coupled state;
`[0055]
`FIG. 41 illustrates another example of a method of
`controlling the main device 100 and the sub-device 300 in a
`coupled state;
`[0056]
`FIG. 42 illustrates controlling of power of the ter-
`minal;
`FIGS. 43a to 430 illustrate coupling of non-touch
`[0057]
`type terminals and the sub-device;
`[0058]
`FIG. 44 illustrates a voice function part and a visual
`function part of the mobile terminal;
`[0059]
`FIG. 45 illustrates multitasking ofthe voice function
`part and the visual function part;
`[0060]
`FIG. 46 illustrates the mobile terminal used by sev-
`eral people at the same time;
`[0061]
`FIGS. 47a and 47b illustrate a video call of the
`mobile terminal according to an embodiment of the present
`invention;
`
`FIG. 48 illustrates the use of a second body in a
`[0062]
`separated state;
`[0063]
`FIG. 49 illustrates a coupling method of first and
`second bodies according to an embodiment of the present
`invention;
`[0064]
`FIG. 50 illustrates the mobile terminal provided
`with power from a solar cell;
`[0065]
`FIG. 51 illustrates a screen image of a charge menu
`of a solar cell environment setting;
`[0066]
`FIG. 52 illustrates a screen image of a notification
`menu of the solar cell environment setting; and
`[0067]
`FIG. 53 is a flow chart illustrating the process of
`charging a battery by the solar cell.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`[0068] The mobile terminal according to exemplary
`embodiments of the present invention will now be described
`with reference to the accompanying drawings. In the follow-
`ing description, the sufiixes ‘module’, ‘unit’ and ‘part’ may be
`used for elements in order to facilitate the disclosure. Signifi-
`cant meanings or roles may not be given to the sufiixes them-
`selves and it is understood that the ‘module’, ‘unit’ and ‘part’
`may be used together or interchangeably.
`[0069] Embodiments ofthe present invention may be appli-
`cable to various types of terminals. Examples of such termi-
`nals may include mobile terminals as well as stationary ter-
`minals, such as mobile phones, user equipment, smart
`phones, DTV, computers, digital broadcast terminals, per-
`sonal digital assistants, portable multimedia players (PMP)
`and/or navigators.
`[0070] A further description may be provided with regard
`to a mobile terminal, although such teachings may apply
`equally to other types of terminals.
`[0071]
`FIG. 1 is a block diagram of a mobile terminal in
`accordance with an example embodiment. Other embodi-
`ments and arrangements may also be provided. FIG. 1 shows
`a mobile terminal 100 having various components, although
`other components may also be used. More or less components
`may alternatively be implemented.
`[0072]
`FIG. 1 shows that the mobile terminal 100 includes
`a wireless communication unit 110, an audio/video (A/V)
`input unit 120, a user input unit 130, a sensing unit 140, an
`output unit 150, a memory 160, an interface unit 170, a
`controller 180 and a power supply 190.
`[0073] The wireless communication unit 110 may be con-
`figured with several components and/or modules. The wire-
`less communication unit 110 may include a broadcast receiv-
`ing module 111, a mobile communication module 112, a
`wireless Internet module 113, a short-range communication
`module 114 and a position-location module 115. The wireless
`communication unit 110 may include one or more compo-
`nents that permit wireless communication between the
`mobile terminal 100 and a wireless communication system or
`a network within which the mobile terminal 1 00 is located. In
`case of non-mobile terminals, the wireless communication
`unit 110 may be replaced with a wire communication unit.
`The wireless communication unit 110 and the wire commu-
`
`nication unit may be commonly referred to as a communica-
`tion unit.
`
`[0074] The broadcast receiving module 111 may receive a
`broadcast signal and/or broadcast associated information
`from an external broadcast managing entity via a broadcast
`channel. The broadcast channel may include a satellite chan-
`nel and a terrestrial channel. The broadcast managing entity
`
`82
`
`82
`
`
`
`US 2010/0227642 A1
`
`Sep. 9, 2010
`
`may refer to a system that transmits a broadcast signal and/or
`broadcast associated information.
`
`[0075] At least two broadcast receiving modules 111 may
`be provided in the mobile terminal 100 to pursue simulta-
`neous reception of at least two broadcast channels or facili-
`tation of broadcast channel switching.
`[0076] Examples of broadcast associated information may
`include information associated with a broadcast channel, a
`broadcast program, a broadcast service provider, etc. For
`example, broadcast associated information may include an
`electronic program guide (EPG) of digital multimedia broad-
`casting (DMB) and an electronic service guide (ESG) of
`digital video broadcast-handheld (DVB-H).
`[0077] The broadcast signal may be a TV broadcast signal,
`a radio broadcast signal, and/or a data broadcast signal. The
`broadcast signal may further include a broadcast signal com-
`bined with a TV or radio broadcast signal.
`[0078] The broadcast receiving module 111 may receive
`broadcast signals transmitted from various types ofbroadcast
`systems. As a non-limiting example, the broadcasting sys-
`tems may include digital multimedia broadcasting-terrestrial
`(DMB-T), digital multimedia broadcasting-satellite (DMB-
`S), digital video broadcast-handheld (DVB-H), a data broad-
`casting system known as media forward link only (Media-
`FLO®) and integrated services digital broadcast-terrestrial
`(ISDB-T). The receiving of multicast signals may also be
`provided. Data received by the broadcast receiving module
`111 may be stored in the memory 160, for example.
`[0079] The mobile communication module 112 may com-
`municate wireless signals with one or more network entities
`(e.g. a base station or Node-B). The signals may represent
`audio, video, multimedia, control signaling, and data, etc.
`[0080] The wireless Internet module 113 may support
`Internet access for the mobile terminal 100. This wireless
`
`Internet module 113 may be internally or externally coupled
`to the mobile terminal 100. Suitable technologies for wireless
`Internet may include, but are not limited to, WLAN (Wireless
`LAN)(Wi-Fi), Wibro (Wireless broadband), Wimax (World
`Interoperability for Microwave Access), and/or HSDPA
`(High Speed Downlink Packet Access). The wireless Internet
`module 113 may be replaced with a wire Internet module in
`non-mobile terminals. The wireless Internet module 113 and
`
`the wire Internet module may be referred to as an Internet
`module.
`
`[0081] The short-range communication module 114 may
`facilitate short-range communications. Suitable technologies
`for short-range communication may include, but are not lim-
`ited to, radio frequency identification (RFID), infrared data
`association (IrDA), ultra-wideband (UWB), as well as net-
`working technologies such as Bluetooth and ZigBee.
`[0082] The position-location module 115 may identify or
`otherwise obtain a location of the mobile terminal 100. The
`
`position-location module 115 may be provided using global
`positioning system (GPS) components that cooperate with
`associated satellites, network components, and/or combina-
`tions thereof.
`
`[0083] The position-location module 115 may precisely
`calculate current 3-dimensional position information based
`on longitude, latitude and altitude by calculating distance
`information and precise time information from at least three
`satellites and then by applying triangulation to the calculated
`information. Location and time informations may be calcu-
`lated using three satellites, and errors of the calculated loca-
`tion position and time informations may then be amended or
`
`changed using another satellite. The position-