(12) United States Patent
`Lee et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,008,190 B2
`Apr. 14, 2015
`
`US009008190B2
`
`(54) APPARATUS FOR PROCESSING IMAGES
`AND METHOD THEREOF
`
`(58) Field of Classification Search
`CPC. H04N 7/50; H04N 7/26941; H04N 21/2365
`USPC ..................... 375/240.01-240.29; 725/3745
`See application file for complete search history.
`
`(75) Inventors: Kun-Sik Lee, Pyeongtaek-si (KR):
`Yoon-Jung Kim, Pyeongtaek-si (KR):
`Hae-Jin Bae, Pyeongtaek-si (KR):
`Gyu-Seung Kim, Pyeongtaek-si (KR);
`U.S. PATENT DOCUMENTS
`Sang-Chul Kim, Pyeongtaek-si (KR);
`348.7
`5,583,560 A 12/1996 Florin etal
`Sang-Kil Park, Pyeongtaek-si (KR):
`- w-
`Ol C al. . . . . . . . . . . . . . . . . . . . . . .
`E. 7,076,151 B2 * 7/2006 Chotoku et al. .............. 386,241
`Tae-Il Chung, Pyeongtaek-si (KR) s
`(Continued)
`
`(56)
`
`References Cited
`
`(73) Assignee: LG Electronics, Inc., Seoul (KR)
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 557 days.
`
`ES
`
`FOREIGN PATENT DOCUMENTS
`1935 A. 1239
`(Continued)
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 12/6.51,730
`
`(22) Filed:
`(65)
`
`Jan. 4, 2010
`Prior Publication Data
`
`PCT International Search Reportdated May 25, 2010 issued in Appli
`cation No. PCT.KR2010/000017.
`(Continued)
`
`Aug. 5, 2010
`US 2010/O194998 A1
`Foreign Application Priority Data
`
`(30)
`
`Primary Examiner — Andy Rao
`(74) Attorney, Agent, or Firm — Ked & Associates, LLP
`
`Jan. 6, 2009 (KR) ........................ 10-2009-0000660
`Jan. 6, 2009 (KR) ........................ 10-2009-OOOO661
`Jun. 3, 2009 (KR) ........................ 10-2009-00491.93
`(51) Int. Cl
`tion 7/18
`H4N2L/4402
`H04N 5/445
`H4N2L/482
`
`(2006.01)
`(201 1.015
`(2011.01)
`(2011 015
`(Continued)
`
`(52) U.S. Cl.
`CPC ....... H04N2I/440263 (2013.01); H04N 5/445
`(2013.01); H04N21/.482 (2013.01); H04N
`21/4263 (2013.01); H04N 2 1/4755 (2013.01)
`
`ABSTRACT
`(57)
`An apparatus for processing images may include a de-multi
`lexer that receives a data stream and de-multinlexes a video
`p
`p
`signal and channel information from the data stream, a first
`decoder that provides a decoded video signal, a thumbnail
`generator coupled to the first decoder to generate at least one
`of a still picture thumbnail or a moving picture thumbnail
`based on the decoded video signal, and an encoder coupled to
`the thumbnail generator and the de-multiplexer. The encoder
`encodes the thumbnail with the channel information to pro
`vide a thumbnail data stream to provide thumbnails of mov
`ing pictures and/or still pictures on a display.
`
`16 Claims, 26 Drawing Sheets
`
`17O-1
`
`
`
`217
`
`
`
`OW
`SIGNAL
`
`TS. s.
`
`
`
`S2
`
`TS
`SWITCH
`
`SCALER
`
`iMAGE
`COMPRESSION
`CIRCUIT
`
`ENCODERH TSa
`
`-TS
`
`EX. 1006
`LG Electronics, Inc. / Page 1 of 38
`
`

`

`US 9,008,190 B2
`Page 2
`
`(51) Int. Cl.
`H4N2L/426
`HO4N 2 1/475
`
`(2011.01)
`(2011.01)
`
`(56)
`
`References Cited
`
`10-2006-0031957 A
`KR
`10-2006-00944O1 A
`KR
`10-2008-0011850 A
`KR
`10-2008-0035298
`KR
`10-2008-0057486 A
`KR
`WOO1,26367
`WO
`WO WO 2007/105876
`
`4/2006
`8, 2006
`2, 2008
`4/2008
`6, 2008
`4/2001
`9, 2007
`
`U.S. PATENT DOCUMENTS
`
`OTHER PUBLICATIONS
`
`
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`71.5/721
`
`B2 12/2010 Aratani et al. .........
`. 725/37
`Chinese Office Action dated Jul. 3, 2013.
`Al 1 1/2002 Kikinis et al. .
`33 European Search Report issued in EP Application No. EP
`A1* 3, 2005 Suh ..........
`... 38646
`10729271.6 dated Dec. 14, 2012.
`A1
`6, 2005 Furuta ......
`r 725/37
`European Search Report dated Jul. 15, 2014 issued in Application
`A1
`3f2006 Sull et al. ...............
`No. 10729 2716.
`A1 12/2008 Kim et al.
`Korean Office Action dated Nov. 24, 2014, issued in Application No.
`A1* 7, 2009 Cronin et al. ..........
`10-2009-OOOO660.
`Korean Office Action dated Nov. 24, 2014, issued in Application No.
`10-2009-OOOO661.
`European Office Action for Application 10729271.6 dated Feb. 10,
`2015.
`
`7,849.478
`2002fO166122
`2005/0048916
`2005, 0141856
`2006, OO64716
`2008/0307458
`2009/0172543
`
`FOREIGN PATENT DOCUMENTS
`
`KR
`KR
`KR
`KR
`
`10-2004-006.7139 A
`10-2005-0001057. A
`10-2005-0077875 A
`10-2006-0015075. A
`
`T 2004
`1, 2005
`8, 2005
`2, 2006
`
`* cited by examiner
`
`EX. 1006
`LG Electronics, Inc. / Page 2 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 1 of 26
`
`US 9,008,190 B2
`
`FIG. 1
`
`100
`
`175
`
`STORAGE
`DEVICE
`
`V 120
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SECOND
`
`TUNER
`
`ANALOG
`IMAGE
`SIGNAL
`EXTERNAL
`SIGNAL INPUT
`DEVICE
`
`
`
`28
`
`FIRST
`DEMODULATION
`CIRCUIT
`
`Deion
`CIRCUIT
`
`DVENCODER
`
`AO
`
`DV
`SIGNAL
`
`CHANNEL
`R.S. CONTROL UNIT
`CIRCUIT
`is
`
`185
`
`SOUND OUTPU
`CIRCUIT
`
`DISPLAY
`
`18O
`
`EXTERNAL
`OUTPUT
`
`16O
`
`150
`
`INTERFACE
`CIRCUIT
`
`
`
`REMOTE
`CONTROL
`DEVICE
`
`200
`
`EX. 1006
`LG Electronics, Inc. / Page 3 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 2 of 26
`
`US 9,008,190 B2
`
`FIG. 2
`
`
`
`DV
`SIGNAL
`
`DV
`DECODER
`
`SCALER
`
`IMAGE
`COMPRESSION
`CIRCUIT
`
`ENCODER-> TSa
`
`> TSb
`
`EX. 1006
`LG Electronics, Inc. / Page 4 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 3 of 26
`
`US 9,008,190 B2
`
`70-2
`
`DV
`SIGNAL
`
`
`
`IS
`SWITCH
`
`TS1
`
`
`
`
`
`
`
`
`
`FIG 3
`
`27
`
`220 250 230
`
`240
`
`
`
`251
`
`253
`
`OW
`DECODER
`
`
`
`
`
`
`
`215
`
`
`
`SCALER
`
`WDEO
`DECODER
`
`IMAGE
`COMPRESSION
`CIRCUIT
`
`ENCODER
`
`BUFFER
`
`252
`
`BUFFER
`
`EX. 1006
`LG Electronics, Inc. / Page 5 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 4 of 26
`
`US 9,008,190 B2
`
`
`
`
`
`
`
`
`
`
`
`F.G. 4
`
`100
`
`175
`
`
`
`STORAGE
`DEVICE
`
`30
`
`190
`
`st DEMODULATION
`
`CIRCUIT
`
`SECOND
`
`
`
`EXTERNAL
`SIGNAL INPUT
`DEVICE
`
`7|
`
`
`
`CHANNEL
`BROWSNG
`
`CIRCUIT
`
`CONTROL UN
`
`
`
`185
`
`SOUND OUTPU
`CIRCUIT
`
`
`
`DISPLAY
`
`18O
`
`160
`
`INTERFACE
`CIRCUIT
`
`150
`
`
`
`REMOTE
`CONTROL
`DEVICE
`
`2OO
`
`EX. 1006
`LG Electronics, Inc. / Page 6 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 5 of 26
`
`US 9,008,190 B2
`
`FIG. 5
`
`ANALOG
`SIGNAL
`
`
`
`
`
`
`
`SWITCH
`
`
`
`TS2
`
`
`
`VIDEO
`DECODER
`
`IMAGE
`COMPRESSION
`CIRCUIT
`
`TSa
`
`> TS)
`
`EX. 1006
`LG Electronics, Inc. / Page 7 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 6 of 26
`
`US 9,008,190 B2
`
`ANALOG
`SIGNAL
`
`2O5
`
`
`
`OW
`DECODER
`215
`
`VIDEO
`DECODER
`
`VIDEO
`
`TS1
`
`TS2
`
`IS
`SWITCH
`
`TS2
`
`DEMUX
`
`AUDIO, DATA
`
`TS
`
`F.G. 6
`
`240
`
`25
`
`253
`
`COMPRESSION: ENCODER BUFFERS
`CIRCUI
`
`5,
`
`MUX
`
`252
`
`TSb
`BUFFER
`
`EX. 1006
`LG Electronics, Inc. / Page 8 of 38
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 14, 2015
`Apr. 14, 2015
`
`Sheet 7 of 26
`Sheet7 of 26
`
`US 9,008,190 B2
`US 9,008,190 B2
`
`
`
`FIG 7
`FIG.7
`
`
`
`EX. 1006
`LG Electronics,Inc. / Page 9 of 38
`
`EX. 1006
`LG Electronics, Inc. / Page 9 of 38
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 14, 2015
`Apr. 14, 2015
`
`Sheet 8 of 26
`Sheet8 of 26
`
`US 9,008,190 B2
`US 9,008,190 B2
`
`
`
`FIG. 8
`FIG.8
`
`
`
`EX. 1006
`LG Electronics, Inc. / Page 10 of 38
`
`EX. 1006
`LG Electronics, Inc. / Page 10 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 9 of 26
`
`US 9,008,190 B2
`
`FIG. 9
`
`150
`
`151
`
`COORDNATE
`CALCULATION CIRCUIT
`
`152
`
`153
`
`RMODULE
`
`154
`
`RF MODULE
`
`321
`
`
`
`
`
`POWER SUPPLY
`CIRCUIT
`
`GYRO SENSOR
`
`WIBRATION
`MODULE
`
`
`
`ACCELERATION
`SENSOR
`
`
`
`FN-340
`
`SOUND OUTPUT
`MODULE
`
`DISPLAY
`MODULE
`
`353
`
`355
`
`3 5 6
`
`EX. 1006
`LG Electronics, Inc. / Page 11 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 10 of 26
`
`US 9,008,190 B2
`
`
`
`FIG. 10
`
`5OO
`
`CADTV35-1
`
`EX. 1006
`LG Electronics, Inc. / Page 12 of 38
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 14, 2015
`Apr. 14, 2015
`
`Sheet 11 of 26
`Sheet 11 of 26
`
`US 9,008,190 B2
`US 9,008,190 B2
`
`==
`is
`
`news|[caste][ae|LOCK[or|ALIGN[av][Hom][coweonenr]
`
`
`
`
` PREVIOUSNEXT[ext|_
`
`w=a
`
`an
`
`
`
`O)
`Cr)
`
`s
`()
`L
`
`H
`2
`2
`O
`On
`s
`CD
`
`c
`
`l
`-
`O
`CC
`
`EX. 1006
`LG Electronics, Inc. / Page 13 of 38
`
`
`
` 600
`
`
`
`.
`COMPONENT2
`
`N
`2
`J
`2.
`O
`Cl
`s
`O
`O
`
`FIG.11
`
`2—
`—4
`
`<xo
`
`O
`ud
`ro
`
`EX. 1006
`LG Electronics, Inc. / Page 13 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 12 of 26
`
`US 9,008,190 B2
`
`FIG. 12
`
`START
`
`S71 O
`
`DISPLAY SELECTED SCREEN
`
`S715
`
`CHANNEL LIST VIEW
`INPUTTED
`
`NO
`
`YES
`
`DISPLAY SCREEN INCLUDING THUMBNAL
`MAGE CORRESPONDING TO BROADCASTING
`SIGNAL MAGE
`
`S72O
`
`
`
`S725-s SELECTION INPUTEDO-N
`
`YES
`
`ED INPUTEDs-NO
`
`YES
`
`S735
`
`S/30
`
`DISPLAY SCREEN INCLUDING
`SELECTED THUMBNAMAGE
`
`EDT THUMBNAL IMAGE
`S740
`
`END
`
`EX. 1006
`LG Electronics, Inc. / Page 14 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 13 of 26
`
`US 9,008,190 B2
`
`
`
`FIG. 13
`
`800
`
`810
`
`IMAGE CHANNELLIST -- MOVE
`
`a
`
`EX. 1006
`LG Electronics, Inc. / Page 15 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 14 of 26
`
`US 9,008,190 B2
`
`FIG. 14
`
`
`
`OTW 11-1
`
`800
`
`81 O
`
`IMAGE CHANNEL LIST -- MOVE
`
`(OCHANNFL CHANGE
`
`EX. 1006
`LG Electronics, Inc. / Page 16 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 15 of 26
`
`US 9,008,190 B2
`
`FIG. 15
`
`
`
`OTV 1 - 1
`
`1 OOO
`
`MAGE CHANNEL ST -- MOVE
`
`(OCHANNEL CHANGE
`
`CADTV 38-1
`
`-
`
`2NV2
`
`g
`
`i
`
`33a
`
`s
`
`g
`
`||
`
`3
`
`1
`
`DTV 9
`
`|| 2 |
`
`EX. 1006
`LG Electronics, Inc. / Page 17 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 16 of 26
`
`US 9,008,190 B2
`
`FIG. 16
`
`DTV 11-1
`
`1 OOO
`
`
`
`
`
`IMAGE CHANNELLIST -- MOVE
`DTV 11-1
`
`(OCHANNE CHANGE
`
`CADTV 38-1
`s
`3
`(2)
`2)
`
`M
`S.
`
`s
`
`d
`
`CADTy39
`&
`
`EX. 1006
`LG Electronics, Inc. / Page 18 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 17 of 26
`
`US 9,008,190 B2
`
`
`
`IMAGE CHANNEL LIST -- MOVE
`
`1200
`
`1220
`
`CADTV 38-1 CADTV 39-1 T
`
`3.
`
`C
`
`I
`
`C
`
`p.m.. 8
`
`HDDRAMA
`DTV6-1 APRIL 2, 2009 (MON) p.m. 6:20-p.m. 7:20
`APRIL 2 (MON)
`O. m. 7
`Major League Baseball
`Head Line NeWS
`Sat.
`Evening NeWS
`EBS SAT
`PROGRAMGUDEMODE) ( DATECHANGE) (RECORDINGIWATCHINGTIMER) ( TIMERLIST
`
`Terminator
`Ost
`
`-1
`1-1
`
`EX. 1006
`LG Electronics, Inc. / Page 19 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 18 of 26
`
`US 9,008,190 B2
`
`F.G. 18
`
`IMAGE CHANNEL LIST -- MOVE
`
`(OCHANNEL CHANGE
`
`||
`
`||
`
`||
`
`CAD TV 36. CADTV 37-1 CADTV 38-1 CADTV 39-1 TV3
`N.
`(2) &
`(ANNELOC)(CHANNEEDCANAC)GPREVIOUS)ONET )C E. D
`1305
`
`T
`
`
`
`
`
`
`
`CHANNELALIGN
`
`CHANNEL NUMBER
`FAVORITECHANNEN
`RECENT WATCHING CHANNEL
`
`CHANNEDELETE
`
`EXT
`
`CLOSE
`
`FAVORITE CHANNEL LIST -- MOVE
`
`(OCHANNEL CHANGE
`
`i.
`
`2.
`-
`
`1300
`
`31 O
`
`132O
`
`EX. 1006
`LG Electronics, Inc. / Page 20 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 19 of 26
`
`US 9,008,190 B2
`
`
`
`
`
`
`
`
`
`
`
`FIG. 19
`
`IMAGE CHANNEL LIST -- MOVE
`
`(OCHANNEL CHANGE
`
`
`
`
`
`
`
`
`
`1 400
`
`
`
`I
`(2) &
`A
`(EANNELC)(CHANNEEDCANAG)GPREVIOUS)ONE DO ET D
`1 405
`
`
`
`CHANNELALIGN
`
`CHANNEL NUMBER
`
`FAVORITE CHANNEL
`FECENTLY WATCHED CHANNE
`CHANNELDELETE
`
`EXIT
`
`CLOSE
`
`RECENTLY WATCHED CHANNEL LIST-- MOVE
`
`(OCHANNEL CHANGE
`
`f
`
`(ANNELC)(HANNELEDCANNEAG)GPREYOUS)ONET )O ET )
`
`1410
`
`1420
`
`EX. 1006
`LG Electronics, Inc. / Page 21 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 20 of 26
`
`US 9,008,190 B2
`
`
`
`
`
`
`
`
`
`F.G. 20
`
`
`
`IMAGE CHANNELIST -- MOVE
`
`(OCHANNEL CHANGE
`
`1500
`
`A
`
`
`
`||
`
`{
`
`6
`
`||
`
`5
`
`||
`
`(ANNELOC)(CHANNELEDGENAC)GPREVIOUS)ONET )C ET)
`1505
`
`CHANNEL ALGN
`
`CHANNEL NUMBER
`
`FAVORTE CHANNEL
`
`RECENT WATCHING CHANNEL
`C
`CHANNELDELETE M
`EXT
`CLOSE
`
`(OCHANNEL CHANGE
`
`1520
`
`CHANNEL DELETE LIST -- MOVE
`DTV 7-
`DTV 9-1
`
`3 || 2
`
`5.
`6.
`DTV 3
`
`A
`f CA
`
`CADTV 37
`
`EX. 1006
`LG Electronics, Inc. / Page 22 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 21 of 26
`
`US 9,008,190 B2
`
`F.G. 21.
`
`CHANNEL EDT
`
`-- MOVE
`
`O FILEMENU
`
`CHANNEL EDT END
`
`PREVIOUS) ( NEXT
`
`
`
`CHANNEL EDT
`WATCH
`FAVORITECHANNELREGIS
`LOCK
`DELETE
`
`EXIT CLOSE
`
`A CHANNEL CADTV 32 REGISTERED
`ASFAVORITECHANNEL N
`
`620
`
`1630
`
`EX. 1006
`LG Electronics, Inc. / Page 23 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 22 of 26
`
`US 9,008,190 B2
`
`F.G. 22
`
`
`
`MAGE CHANNEL ST -- MOVE
`5. g
`2-1 CADTV33-
`2
`
`(). CHANNEL CHANGE
`||
`CARTV34-1||CAD
`se
`I
`
`17OO
`
`CADTV 371 CADTV 38–1 CADTV 39-1 TV 13
`A || 3
`(2.
`2.
`
`||
`
`I
`
`CHANNEL EDT
`
`-- MOVE
`
`(O FILEMENU
`
`CADTV 30-1
`
`1710
`
`1720
`
`CHANNEL EDT
`
`WACH
`
`FAVORITE CHANNEL REGISTER
`
`LOCK
`DELETE
`EXIT COSE
`
`EX. 1006
`LG Electronics, Inc. / Page 24 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 23 of 26
`
`US 9,008,190 B2
`
`FIG. 23
`
`CHANNEL CADTV32 DELETE2
`
`
`
`CHANNEL EDT
`
`-- MOVE
`
`(O FILEMENU
`
`V
`
`GPREYOUS)ONET )
`
`1705
`
`1713
`
`1730
`
`1720
`
`171 O
`
`EX. 1006
`LG Electronics, Inc. / Page 25 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 24 of 26
`
`US 9,008,190 B2
`
`F.G. 24
`
`IMAGE CHANNEL LIST
`DTV7-
`TV9-
`
`- MOVE
`DT 6-1
`
`O CHANNEL CHANGE
`d
`
`CHANNELLOCE)CHANNEDCANNELAG)C PREVIOUS OCEDGXD
`CHANNEL EDT
`-- MOVE
`O FILEMENU
`
`
`
`CHANNEL EDT
`WATCH
`FAVORITE CHANNEL REGISTER
`...
`LOCK
`N.
`DELETE
`
`EX
`
`CLOSE
`
`CHANNELEDIT
`
`-- MOVE
`
`O FILEMENU
`
`CHANNEL EDT END
`
`PREVIOUS) ( NEXT
`
`EX. 1006
`LG Electronics, Inc. / Page 26 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 25 of 26
`
`US 9,008,190 B2
`
`
`
`FIG. 25
`
`1900
`
`1900
`
`DTV 1 - 1
`
`DTV 11-1
`
`-
`
`CADTV 38-1 CADTV 39-1
`S. 3
`(2)
`&
`
`EX. 1006
`LG Electronics, Inc. / Page 27 of 38
`
`

`

`U.S. Patent
`
`Apr. 14, 2015
`
`Sheet 26 of 26
`
`US 9,008,190 B2
`
`FIG. 26
`
`2005
`
`MAGE CHANNEL ST -- MOVE
`
`(OCHANNEL CHANGE
`
`
`
`
`
`
`
`
`
`
`
`.
`
`S
`
`A.
`
`f
`
`K
`
`
`
`G
`
`V 30
`s
`
`CADTy35-1
`E.
`
`
`
`Pb
`
`Pa
`
`||
`4
`CAPTy36||CAPTV31 ||CADTV38
`6
`S
`f
`S.
`A.
`(2
`3)
`
`
`
`
`
`MAGE CHANNELIST -- MOVE
`
`(OCHANNEL CHANGE
`
`
`
`(ANNELOC)(CHANNEEDCANNELAG)GPREVIOUS)ONE )OEXT )
`
`EX. 1006
`LG Electronics, Inc. / Page 28 of 38
`
`

`

`US 9,008,190 B2
`
`1.
`APPARATUS FOR PROCESSING IMAGES
`AND METHOD THEREOF
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`The present application claims priority under 35 U.S.C.
`119 and 35 U.S.C. 365 to Korean Patent Application Nos.
`10-2009-0000660 (filed on Jan. 6, 2009), 10-2009-0000661
`(filed on Jan. 6, 2009) and 10-2009-0049193 (filed on Jun. 3,
`2009) which are hereby incorporated by reference in its
`entirety.
`
`BACKGROUND
`
`In more detail, the present disclosure relates to an appara
`tus for processing images and an operating method thereof, in
`which a plurality of turners are employed in order to extract a
`plurality of channel information from a signal received in one
`of the turners and then the channel information is displayed.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`10
`
`15
`
`2
`ratus for displaying images 100 includes a first tuner 120, a
`second tuner 125, an external signal input unit 128, a first
`demodulator 130, a second demodulator 135, an analog/digi
`tal converter 140, an interface unit 150, a controller 160, a
`channel browsing processing unit 170, a storage unit 175, a
`display 180, and a sound output unit 185.
`The first tuner 120 selects a radio frequency (RF) broadcast
`signal corresponding to a channel selected by a user, among
`RF broadcast signals received through an antenna and then
`converts the selected RF broadcast signal into an intermediate
`frequency signal or a baseband image/sound signal. For
`example, if the selected RF broadcast signal is a digital broad
`cast signal, it is converted to an analog baseband image? sound
`signal (CVBS 1/SIF). That is, the first tuner 120 may be a
`hybrid tuner that can process a digital broadcast signal and an
`analog signal. The analog baseband image? sound signal
`(CVBS 1/SIF) outputted from the first tuner 120 can be input
`ted to the controller 160 directly.
`Additionally, the first tuner 120 can receive an RF broad
`cast signal of a single carrier according to an Advanced Tele
`vision Systems Committee (ATSC) format or an RF broad
`cast signal of a multi-carrier based on a Digital Video
`Broadcasting (DVB) format.
`Similar to the first tuner 120, the second tuner 125 selects
`an RF broadcast signal corresponding to a channel selected
`by a user among RF broadcast signals received through an
`antenna, and then converts the selected RF broadcast signal
`into an intermediate frequency signal or a baseband image/
`Sound signal.
`In addition, the second tuner 125 sequentially/periodically
`selects an RF broadcast signal corresponding to all broadcast
`ing channels that are pre-stored through a channel memory
`function among RF broadcast signals received through an
`antenna, and can convert the selected RF broadcast signal into
`an intermediate frequency signal or a baseband image? sound
`signal. In the embodiment, an image of another pre-stored
`channel is displayed on at least portion of a screen with a
`thumbnail view. Therefore, it is possible to sequentially or
`periodically receive an RF broadcast signal of all pre-stored
`channels.
`For example, the first tuner 120 converts a main RF broad
`cast signal selected by a user into an intermediate frequency
`signal or a baseband image/sound signal. The second tuner
`125 selects sequentially/periodically all RF broadcast signals
`(sub RF broadcast signal) except for the main RF broadcast
`signal or all RF broadcast signals, and can converts the
`selected signal into an intermediate frequency (IF) signal or a
`baseband image? sound signal. Although signal reception is
`shown as received through an antenna, the signals may be
`received via coaxial cable or fiber optic cables or any other
`type of connection for receiving broadcast signal from a
`broadcast station or content provider, Such as cable service
`providers.
`The first demodulator 130 receives the digital IF signal
`DIF1 converted in the first tuner 120 to perform a demodula
`tion operation. For example, if the digital IF signal DIF1
`outputted from the first tuner 120 is an ATSC format, the first
`demodulator 130 performs an 8-Vestigal Side Band (8-VSB)
`demodulation. Additionally, the first demodulator 130 may
`perform a channel demodulation. The first demodulator 130
`may include a Trellis decoder, de-interleaves, and a Reed
`Solomon decoder to perform Trellis demodulation, de-inter
`leaving, and Reed Solomon encoding.
`For example, the digital IF signal DIF1 outputted from the
`first turner 120 is a DVB format, the first demodulator 130
`performs a Code Orthogonal Frequency Division Modulation
`(COFDMA) demodulation. Additionally, the first demodula
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`The embodiments will be described in detail with reference
`to the following drawings in which like reference numerals
`refer to like elements wherein:
`FIG. 1 is an internal block diagram of an apparatus for
`displaying images according to an embodiment.
`FIG. 2 is a block diagram illustrating one embodiment
`170-1 of the channel browsing processing circuit 170 of FIG.
`1.
`FIG. 3 is a block diagram illustrating a configuration of a
`channel browsing processing circuit 170-2 according to
`another embodiment.
`FIG. 4 is an internal block diagram of an apparatus for
`displaying images 100 according to another embodiment.
`FIG. 5 is a view illustrating one embodiment 171-1 of the
`channel browsing processing circuit 171 of FIG. 4.
`FIG. 6 is a view illustrating another embodiment 171-2 of
`the channel browsing processing circuit 171 of FIG. 4.
`FIGS. 7 and 8 are views illustrating a usage example of the
`remote control device 200 of FIG. 1 or 3.
`FIG.9 is an internal block diagram illustrating the interface
`unit 150 of FIG. 1 and the movement sensitive remote 301 of
`FIGS. 7 and 8.
`FIG. 10 is a view illustrating a screen according to opera
`tions of the channel browsing processing circuit 170-1, 170-2.
`171-1, or 171-2 of FIG. 2, 3, 5, or 6.
`FIG. 11 is a view illustrating another example where a
`screen is displayed according to an operation of the channel
`browsing processing circuit of FIGS. 2 and 3 or FIGS. 5 and
`6.
`FIG. 12 is a flowchart illustrating an operation method of
`an image display device according to an embodiment.
`FIGS. 13 to 17 are views illustrating various examples of
`an image channel list view.
`55
`FIGS. 18 to 20 are views illustrating various examples of a
`channel align when an image channel list is displayed.
`FIGS. 20 to 24 are views illustrating various examples of
`channel edit when an image channel list is displayed.
`FIGS. 25 and 26 are views illustrating various examples of
`the next screen view or a previous screen view when an image
`channel list is displayed.
`
`60
`
`DETAILED DESCRIPTION
`
`FIG. 1 is an internal block diagram of an apparatus for
`displaying images according to a first embodiment. The appa
`
`65
`
`EX. 1006
`LG Electronics, Inc. / Page 29 of 38
`
`

`

`3
`tor 130 can perform channel demodulation. The first demodu
`lator 130 may include a convolution decoder, a de-interleaver,
`and a Reed-Solomon decoder to perform convolution
`demodulation, de-interleaving, and Reed-Solomon demodu
`lation.
`The external signal input unit 128 performs a signal input
`with an external device. For this, the external signal input unit
`128 includes an A/V input/output unit, and a wireless com
`munication unit.
`The external signal input unit 128 is connected to external
`devices such as Digital Versatile Disks (DVD), Blu-rays,
`game consoles, camcorders, computers (e.g., notebook com
`puters), etc. to transmit an external input image signal, an
`external input Sound signal, and an external input data signal
`into the controller 160 in the apparatus for displaying images
`100. Additionally, an image signal, a sound signal, and a data
`signal, processed in the controller 160, can be outputted into
`another external device.
`The A/V input/output unit of the external input circuit may
`include an Ethernet terminal, a USB terminal, a composite
`Video Banking Sync (CVBS) terminal, a component termi
`nal, a S-Video terminal (analog), a Digital Visual Interface
`(DVI) terminal, a High Definition Multimedia Interface
`(HDMI) terminal, a RGB terminal, a D-SUB terminal, an
`IEEE 1394 terminal, a SPDIF terminal, a Liquid HD terminal,
`etc., in order for inputs/outputs of video/audio signals of an
`external device.
`Although not shown in the drawing, various input signals
`inputted through the external signal input unit 128 may be
`inputted into the channel browsing processing circuit 170 that
`will be described later such that thumbnail image extraction
`can be processed. For example, an analog signal inputted
`through the CVBS terminal and the S-Video terminal, as
`mentioned above, is converted into a digital signal, and then is
`inputted into the channel browsing processing circuit 170. A
`35
`digital signal inputted through other input terminals may be
`directly inputted into the channel browsing processing circuit
`170 without analog/digital conversion. Here, the digital sig
`nal outputted from the external signal input circuit 128 may
`be a stream signal. For example, the digital signal may be
`40
`MPEG-2 Transport Stream (TS) where an image signal of an
`MPEG-2 format and a sound signal of Dolby AC-3 format are
`multiplexed.
`The wireless communication unit may perform a wireless
`internet connection. For example, Wireless LAN (WLAN)
`45
`(Wi-Fi), Wireless broadband (Wilbro), World Interoperability
`for Microwave Access (Wimax), High Speed Downlink
`Packet Access (HSDPA) can be used for the wireless internet
`connection.
`Additionally, a wireless communication unit may perform
`a short-distance wireless communication with other elec
`tronic devices. For example, Bluetooth, Radio Frequency
`Identification (RFID), infrared Data Association (IrDA),
`Ultra Wideband (UWB), ZigBee, etc. can be used for the
`short-distance wireless communication.
`In addition, the external signal input circuit 128 may be
`connected to various set-top boxes through at least one of the
`above-mentioned various terminals. For example, the set-top
`box is an Internet Protocol (IP) TV, image, sound, and data
`signals processed in a set-top box for IPTV may be transmit
`ted into the controller 160, or signals processed in the con
`troller 160 may be transmitted to a set-top box for IPTV may
`be processed in the controller 160 through the channel brows
`ing processing circuit 170.
`Moreover, the above-mentioned IPTV may include an
`arbitrary networkTV for receiving abroadcast signal through
`a two-way network. Examples of the networkTV are ADSL
`
`30
`
`50
`
`55
`
`60
`
`65
`
`US 9,008,190 B2
`
`10
`
`15
`
`25
`
`4
`TV, VDSL-TV, FTTH-TV, TV over DSL, Video over DSL,
`TV overIP (TVIP), Broadband TV (BBTV), internet TV, full
`browsing TV according to kinds of a transmission network.
`The first demodulator 130 performs demodulation and
`channel decoding, and then outputs a stream signal TS1. The
`stream signal TS1 may be a signal in which an image signal,
`a sound signal, and a data signal are multiplexed. For
`example, the stream signal TS1 may bean MPEG-2TS where
`an image signal of an MPEG-2 format and a sound signal of
`Dolby AC-3 format are multiplexed. In more detail, the
`MPEG-2TS includes aheader of 4 bytes and a payload of 184
`bytes.
`The stream signal TS1 is inputted into the controller 160
`through the channel browsing processing circuit 170 and then
`demultiplexed and signal-processed. Before the stream signal
`TS1 is inputted into the controller 160, it is inputted into the
`channel browsing processing circuit 170 in order for channel
`browsing processing. The channel browsing processing will
`be described below.
`The first demodulator 130 may include separate compo
`nents based on an ATSC formant and a DVB format. The first
`demodulator 130 may include an ATSC demodulator and a
`DVB demodulator.
`The second demodulator 135 performs a demodulation
`operation by receiving the digital IF signal DIF2 converted in
`the second turner 125, and then outputs a stream signal TS2.
`Operations of the second demodulator 135 may be the same
`as those of the first demodulator 130, and overlapping
`description may be omitted.
`If a signal outputted from the second turner 125 is an
`analog baseband image signal (e.g., CVBS2), the signal may
`be converted into a digital signal in order to be processed in
`the channel browsing processing circuit 170.
`The DigitalVideo encoder 140 converts an inputted analog
`signal into a digital signal. If the inputted signal is an image
`signal, sampling and quantization are performed to convert
`the image signal into a digital video DV signal. The converted
`digital video DV signal is inputted and processed in the chan
`nel browsing processing circuit 170.
`The interface circuit 150 transmits an input signal from a
`user into the controller 160, or a signal from the controller 160
`to the remote control device 200. For example, the interface
`unit 150 receives a user input signal (such as power on/off,
`channel selection, and screen configuration) from a remote
`control device 200, or transmits a signal from the controller
`160 into the remote control device 200 according to various
`communication methods such as an RF communication
`method and an IR communication method.
`The controller 160 demultiplexes an inputted stream, and
`then signal-processes the demultiplexed signals to generate
`and output a signal for an image and Sound output. The
`controller 160 controls overall operations of the apparatus for
`displaying images 100. The controller 160 may include a
`demultiplexer, an image processing circuit, a sound process
`ing circuit, and a user input signal processing circuit.
`The controller 160 demultiplexes the inputted stream sig
`nal (e.g., MPEG-2 TS), and divides it into an image signal, a
`Sound signal, and a data signal. Additionally, the controller
`160 processes brightness, tint, and color adjustment of an
`image signal.
`Additionally, the controller 160 may perform image pro
`cessing of the demultiplexed image signal. For example, if the
`demultiplexed image signal is an encoded image signal, it is
`decoded. In more detail, if the demultiplexed image signal is
`an image signal of an MPEG-2 format, it is decoded using an
`MPEG-2 decoder. Additionally, if the demultiplexed image
`signal is an encoded image signal of an H.264 standard
`
`EX. 1006
`LG Electronics, Inc. / Page 30 of 38
`
`

`

`US 9,008,190 B2
`
`5
`according to a Digital Multimedia Broadcasting (DMB) for
`mator a DVB-H format, it is decoded using an H.264 decoder.
`The image signal that is image-processed in the controller
`160 is inputted into the display 180, and then displayed.
`Additionally, the processed image signal may be inputted to 5
`an external output terminal for connection to an external
`output device.
`Additionally, the controller 160 may perform sound pro
`cessing of a demultiplexed sound signal. For example, if the
`demultiplexed sound signal is an encoded sound signal, it can 10
`be decoded. If the demultiplexed sound signal is an encoded
`sound signal of an MPEG-2 format, it can be decoded using
`an MPEG-2 decoder. When the demultiplexed sound signal is
`an encoded sound signal of an MPEG-4 Bit Sliced Arithmetic
`coding (BSAC) standard according to a terrestrial Digital 15
`Multimedia Broadcasting (DMB) format, it can be decoded
`using an MPEG-4 decoder. If the demultiplexed sound signal
`is an encoded sound signal of an Advanced Audio Codec
`(AAC) of an MPEG-2 formant according to a satellite DMB
`or DVB-H, it can be decoded by an AAC decoder. The con- 20
`troller 160 may adjust base, treble, and volume.
`The sound signal processed in the controller 160 is inputted
`to the Sound output circuit 185 (e.g., a speaker) to output a
`Sound. Additionally, the Sound signal can be inputted to exter
`nal output terminal for connection to the external output 25
`device.
`Additionally, the controller 160 may perform data process
`ing of a demultiplexed data signal. For example, if the demul
`tiplexed data signal is an encoded data signal, it can be
`decoded. The encoded data signal may be Electronic Program 30
`Guide (EPG) information including broadcasting informa
`tion such as a start time and end time of a broadcasting
`program broadcasted in each channel. For example, the EPG
`information may be TSC-PSIP (ATSC-Program and System
`Information Protocol) if it is in an ATSC formant. In a DVB 35
`mode, the EPG information may include DVB-Service Infor
`mation (DVB-SI). ATSC-PSIP information or DVB-SI infor
`mation may be information included in the above stream (i.e.,
`a header (4 byte) of MPEG-2 TS).
`Moreover, the controller 160 may perform On Screen Dis- 40
`play (OSD) processing. The controller 160 can generate sig
`nals for displaying diverse information on a screen of the
`display 180 through graphics or texts, based on at least one of
`an image-processed image signal, a data-processed data sig
`nal, and a user input signal from the remote control device 45
`200. The generated signal may be inputted into the display
`180 together with the image-processed image signal and data
`processed data signal.
`The above-mentioned generated signal for displaying
`graphics or texts may include various data such as a user 50
`interface screen, various menu screen, widgets, and icons of
`the apparatus for displaying images 100.
`The channel browsing processing circuit 170 may perform
`browsing processing with respect to at least one of abroadcast
`signal that corresponds to a received channel and various 55
`input image signals inputted through the external signal input
`circuit 128. The stream signal (TS1 or TS2) is demultiplexed
`by receiving a demodulation and channel demodulated
`stream signal TS1 or TS2 from the demodulator 130 or 135,
`receiving a stream signal from the external input signal input 60
`circuit 128, or receiving a digital video DV signal converted
`in the DV encoder 140. A portion of the demultiplexed image
`signals is extracted and is multiplexed based on an image
`signal including an extracted signal. Such that a new stream
`signal Tsa can be outputted. For example, the stream signal 65
`TSa or TSb may be a signal having the same format as
`MPEG2 TS.
`
`6
`The channel browsing processing circuit 170 may output a
`main stream signal TSb as it is without additional processing.
`The main stream signal TSb corresponds to a main image
`signal displayed in a main area among image signals dis
`played on the display 180. The channel browsing processing
`circuit 170 outputs a sub stream signal TSa with the above
`mentioned channel browsing processing. The Sub Stream sig
`nal TSa corresponds to a Sub image signal displayed in a Sub
`area among image signals displayed on the display 180. In
`relation to this specification, the main stream signal refers to
`abroadcast signal or stream that is continuously displayed on
`the most area of the display 180 over a predetermined time
`regardless of the channel browsing. The Sub Stream signal
`refers to a signal from which thumbnails for channel brows
`ing can be displayed.
`According to an embodiment, a partial image about broad
`cast signals of channels is extracted using the channel brows
`ing processing circuit 170, and then is re-encoded into a
`transport stream forma