USOO951 0040B2
`
`(12) United States Patent
`Selim et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,510,040 B2
`Nov. 29, 2016
`
`(54)
`(71)
`
`(72)
`
`(73)
`
`(*)
`
`(21)
`(22)
`(65)
`
`(63)
`
`GLOBAL PANEL
`
`Applicant: Flextronics AP, LLC, San Jose, CA
`(US)
`Inventors: Mohammed Selim, Oakville (CA);
`Sanjiv Sirpal, Oakville (CA); Fuqu
`Wu, Burlington (CA); Salvador Soto,
`Toronto (CA)
`Assignee: Flextronics AP, LLC, San Jose, CA
`(US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`Appl. No.: 14/834,316
`Filed:
`Aug. 24, 2015
`
`Notice:
`
`Prior Publication Data
`US 2016/005748O A1
`Feb. 25, 2016
`
`Related U.S. Application Data
`Continuation of application No. 13/970,374, filed on
`Aug. 19, 2013, now abandoned, and a continuation of
`application No. 13/968,665, filed on Aug. 16, 2013,
`now Pat. No. 9,247,174, and a continuation of
`application No. 13/969,179, filed on Aug. 16, 2013,
`(Continued)
`
`(51)
`
`Int. C.
`H04N 2L/478
`H04N 2L/43
`
`(2011.01)
`(2011.01)
`(Continued)
`
`(52)
`
`U.S. C.
`CPC .......... H04N 2 1/4316 (2013.01); G06F 3/017
`(2013.01); G06F 3/0481 (2013.01); G06F
`3/04817 (2013.01); G06F 3/04842 (2013.01);
`G06F 3/048.83 (2013.01); H04L 5 1/32
`(2013.01); H04N I/00448 (2013.01); H04N
`5/44 (2013.01); H04N 5/4401 (2013.01);
`H04N 5/4403 (2013.01); H04N 5/445
`
`(2013.01); H04N 5/44591 (2013.01); H04N
`5/45 (2013.01); H04N 5/50 (2013.01); H04N
`1704 (2013.01); H04N 2 1/2.187 (2013.01);
`H04N 21/235 (2013.01); H04N 2 1/2543
`(2013.01); H04N 2 1/25808 (2013.01); H04N
`21/25891 (2013.01); H04N 21/26291
`(2013.01); H04N 2 1/414 (2013.01);
`(Continued)
`(58) Field of Classification Search
`USPC ...................................................... 725/38, 46
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,539,479 A
`5,933,141 A
`
`7/1996 Bertram
`8, 1999 Smith
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`WO
`
`2328346
`2487922
`WO 99.21308
`
`6, 2011
`8, 2012
`4f1999
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 14/822,705, filed Aug. 10, 2015, Sirpal et al.
`(Continued)
`
`Primary Examiner — Kieu Oanh T Bui
`(74) Attorney, Agent, or Firm — Sheridan Ross P.C.
`(57)
`ABSTRACT
`The present disclosure is related to methods and systems of
`displaying content on a television, including: receiving an
`indication associated with a selection by a user; determining,
`based on the received indication, a global panel to display
`via the television; retrieving from memory, a first content
`information for display in the global panel; and displaying,
`via the television, the retrieved content information in the
`specified global panel.
`
`22 Claims, 34 Drawing Sheets
`
`
`
`1504A-7:
`1504B .
`1504C
`1504D.
`1504E
`1504F
`
`Show all inputs
`
`1408
`
`EX. 1001
`LG Electronics, Inc. / Page 1 of 58
`
`

`

`US 9,510,040 B2
`Page 2
`
`(52)
`
`Related U.S. Application Data
`now Pat. No. 9,432,742, and a continuation of appli
`cation No. 13/969,588, filed on Aug. 18, 2013, now
`abandoned, and a continuation of application No.
`13/970,355, filed on Aug. 19, 2013, now Pat. No.
`9,172.896, and a continuation of application No.
`14/418,969, filed as application No. PCT/US2013/
`036826 on Apr. 16, 2013.
`Provisional application No. 61/684.672, filed on Aug.
`17, 2012, provisional application No. 61/702,650,
`filed on Sep. 18, 2012, provisional application No.
`61/697,710, filed on Sep. 6, 2012, provisional appli
`cation No. 61/700,182, filed on Sep. 12, 2012, pro
`visional application No. 61/736,692, filed on Dec. 13,
`2012, provisional application No. 61/798,821, filed
`on Mar. 15, 2013, provisional application No. 61/804,
`942, filed on Mar. 25, 2013, provisional application
`No. 61/804,998, filed on Mar. 25, 2013, provisional
`application No. 61/804,971, filed on Mar. 25, 2013,
`provisional application No. 61/804,990, filed on Mar.
`25, 2013, provisional application No. 61/805,003,
`filed on Mar. 25, 2013, provisional application No.
`61/805,053, filed on Mar. 25, 2013, provisional appli
`cation No. 61/805,030, filed on Mar. 25, 2013, pro
`visional application No. 61/805,027, filed on Mar. 25,
`2013, provisional application No. 61/805,042, filed
`on Mar. 25, 2013, provisional application No. 61/805,
`038, filed on Mar. 25, 2013.
`
`(60)
`
`(51)
`
`Int. C.
`H04N 2L/422
`H04N 2L/462
`H04N I/00
`H04N 7/04
`H04N 5/44
`H04N 2L/482
`H04N 5/50
`H04N 2L/43
`H04N 2L/262
`H04N 2L/437
`H04N 2L/8
`H04N 2L/442
`H04N 2L/485
`H04N 2L/472
`H04N 2L/4788
`H04N 2L/475
`H04N 2L/84
`H04N 2L/8358
`H04N 5/445
`G06F 3/048
`H04N 2L/488
`H04N 2L/6
`H04N 2L/439
`H04N 2L/435
`H04N 2L/432
`H04N 2L/47
`H04L 2/58
`H04N 2L/258
`H04N 2L/45
`G06F 3/0
`G06F 3/0488
`H04N 5/45
`H04N 2L/4782
`H04N 2L/2543
`
`(2011.01)
`(2011.01)
`(2006.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2013.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2006.01)
`(2013.01)
`(2011.01)
`(2011.01)
`(2011.01)
`
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2013.01)
`(2011.01)
`(2011.01)
`
`H04N 2L/44
`H04N 2L/287
`H04N 2L/445
`H04N 2L/658
`H04N 2L/235
`H04N 2L/426
`G06F 3/0484
`H04N 2L/4I4
`HO4N 2 1/433
`U.S. C.
`CPC. H04N 2 1/4221 (2013.01); H04N 21/42204
`(2013.01); H04N 2 1/42207 (2013.01); H04N
`21/42222 (2013.01); H04N 21/42225
`(2013.01); H04N 2 1/42684 (2013.01); H04N
`2 I/432 (2013.01); H04N 2 1/433 (2013.01):
`H04N 21/.435 (2013.01); H04N 2 1/4307
`(2013.01); H04N 21/437 (2013.01); H04N
`21/4312 (2013.01); H04N 2 1/4396 (2013.01);
`H04N 2 1/441 (2013.01); H04N 2 1/442
`(2013.01); H04N 2 1/44.15 (2013.01); H04N
`2 I/44204 (2013.01); H04N 2 1/44213
`(2013.01); H04N 2 1/44222 (2013.01); H04N
`21/4532 (2013.01); H04N 2 1/462 (2013.01);
`H04N 2 1/4622 (2013.01); H04N 2 1/47
`(2013.01); H04N 21/472 (2013.01); H04N
`21/475 (2013.01); H04N 21/478 (2013.01);
`H04N 2 1/4753 (2013.01); H04N 2 1/4755
`(2013.01); H04N 2 1/4756 (2013.01); H04N
`21/4782 (2013.01); H04N 2 1/4788 (2013.01);
`H04N 2 1/47202 (2013.01); H04N 21/47205
`(2013.01); H04N 21/.482 (2013.01); H04N
`2 I/485 (2013.01); H04N 2 1/488 (2013.01):
`H04N 21/.4821 (2013.01); H04N 2 1/4823
`(2013.01); H04N 2 1/4826 (2013.01); H04N
`21/.4828 (2013.01); H04N 2 1/4858 (2013.01);
`H04N 2 1/4882 (2013.01); H04N 21/6125
`(2013.01); H04N 21/6175 (2013.01); H04N
`21/6582 (2013.01); H04N 2 1/8126 (2013.01);
`H04N 2 1/8133 (2013.01); H04N 2 1/8166
`(2013.01); H04N 2 1/8173 (2013.01); H04N
`21/8358 (2013.01); H04N 2 1/84 (2013.01);
`G06F 2203/04804 (2013.01); H04N 21/42219
`(2013.01); H04N 2 1/4332 (2013.01); H04N
`2005/4407 (2013.01); H04N 2005/4414
`(2013.01); H04N 2005/4432 (2013.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,661468 B2 12/2003 Alten et al.
`6,978.473 B1
`12/2005 Nsonwu et al.
`7,152.236 B1* 12/2006 Wugofski .......... HO4N 5/44543
`348/E5105
`
`2, 2009 Orlick
`7.487,529 B1
`2/2009 Klosterman et al.
`7,493,641 B2
`3/2010 Rashkovskiy et al.
`7,685,520 B2
`2/2011 Pauws et al.
`7,880,077 B2
`3/2011 Stark et al.
`7,900,228 B2
`3/2011 Barton et al.
`7,908,635 B2
`4/2012 Griggs
`8, 166,511 B2
`7/2012 Look et al.
`8,220,021 B1
`1/2013 Chane et al.
`8,352.983 B1
`2001.0056577 A1 12/2001 Gordon et al.
`2002fOO26637 A1
`2/2002 Markel et al.
`2002fOO67376 A1
`6/2002 Martin et al.
`2002fO188944 A1 12/2002 Noble
`2002fO188958 A1 12/2002 Miller
`2003/0070171 A1
`4/2003 Jeon et al.
`
`EX. 1001
`LG Electronics, Inc. / Page 2 of 58
`
`

`

`US 9,510,040 B2
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2004/0216156 A1
`2005/OO97622 A1*
`
`2006/0117343 A1
`2007/O199022 A1
`2007,0261090 A1
`2008/0022309 A1
`2008/O120635 A1
`2008. O155613 A1
`2009. O158375 A1
`2009.0160764 A1
`2009/0228919 A1
`2009,0271823 A1
`2010, OO13997 A1
`2010, OO37267 A1
`2011/O119626 A1
`2011 0145860 A1
`2011/0179453 A1
`2011 (02894.19 A1
`2012fOO30317 A1
`2012fO144416 A1
`2012fO144422 A1
`2012/0174039 A1
`2012/0200574 A1
`2012fO221972 A1
`2012fO257108 A1
`2012,0260284 A1
`2014.00531.98 A1
`2014/0059605 A1
`2014/0059606 A1
`2014/00596.15 A1
`2014/0059635 A1
`2014.0068674 A1
`
`10/2004 Wagner
`5/2005 Zigmond ............. HO4N 5,4401
`725/135
`
`6, 2006 Novak et al.
`8, 2007 Moshiri et al.
`11/2007 Miller et al.
`1/2008 Begeja et al.
`5/2008 Trimper et al.
`6/2008 Benya et al.
`6/2009 Rodriguez et al.
`6/2009 Myllymäki
`9, 2009 Zott et al.
`10/2009 Jung et al.
`1/2010 Whang
`2/2010 Bennett
`5/2011 Faenger et al.
`6, 2011 Wei
`7, 2011 Poniatowski
`11/2011 Yu et al.
`2/2012 Smyth et al.
`6, 2012 Wetzer et al.
`6, 2012 Han et al.
`7, 2012 Rhoads et al.
`8, 2012 Hill et al.
`8/2012 Dougall et al.
`10/2012 Friedlander et al.
`10/2012 Friedlander et al.
`2/2014 Sirpal et al.
`2/2014 Sirpal et al.
`2/2014 Selim et al.
`2/2014 Sirpal et al.
`2/2014 Sirpal et al.
`3/2014 Sirpal et al.
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 14/841,199, filed Aug. 31, 2015, Sirpal et al.
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US2013/055294, mailed Dec. 2,
`2013 10 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US2013/055294, mailed Feb.
`26, 2015 10 pages.
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US2013/055296, mailed Nov.
`29, 2013 9 pages.
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US 13/55493, mailed Nov. 7,
`2013 9 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US 13/55493, mailed Feb. 26,
`20158 pages.
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US 13/55509, mailed Nov. 8,
`2013 9 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US 13/55509, mailed Feb. 26,
`20158 pages.
`
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US2013/055303, mailed Dec. 5,
`2013 8 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US2013/055303, mailed Feb.
`26, 2015 7 pages.
`International Search Report and Written Opinion for International
`(PCT) Patent Application No. PCT/US2013/055280, mailed Jan.
`10, 2014 10 pages.
`Official Action for U.S. Appl. No. 13/968,948 mailed May 6, 2014
`11 pages.
`Official Action for U.S. Appl. No. 13/968,948, mailed Nov. 24, 2014
`13 pages.
`Official Action for U.S. Appl. No. 13/968,948, mailed Mar. 11, 2015
`13 pages.
`Official Action for U.S. Appl. No. 13/968,929, mailed Apr. 29, 2015
`12 pages.
`Official Action for U.S. Appl. No. 13/969,588, mailed Nov. 10, 2014
`11 pages.
`Official Action for U.S. Appl. No. 13/969,588, mailed Mar. 11, 2015
`12 pages.
`Official Action for U.S. Appl. No. 13/970,374, mailed Jun. 6, 2014
`7 pages.
`Official Action for U.S. Appl. No. 13/970,374, mailed Dec. 9, 2014
`9 pages.
`Official Action for U.S. Appl. No. 13/970,374, mailed May 22, 2015
`11 pages.
`Official Action for U.S. Appl. No. 13/968,897, mailed Aug. 15, 2014
`15 pages.
`Official Action for U.S. Appl. No. 13/968,897, mailed Jan. 28, 2015
`18 pages.
`Sohail, "Smart TV-A Late Bloomer.” Harwarezonw.com, Apr. 1,
`2011, 2 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US2013/055296, mailed Feb.
`26, 20158 pages.
`International Preliminary Report on Patentability for International
`(PCT) Patent Application No. PCT/US2013/055280, mailed Jun.
`11, 2015.9 pages.
`Official Action for U.S. Appl. No. 13/968,948, mailed Jul. 17, 2015
`13 pages.
`Official Action for U.S. Appl. No. 13/969,588, mailed Aug. 17, 2015
`13 pages.
`Official Action for U.S. Appl. No. 13/968,897, mailed May 8, 2015
`21 pages.
`Notice of Allowance for U.S. Appl. No. 13/968,948, mailed Mar. 28,
`2016. 7 pages.
`Official Action for U.S. Appl. No. 13/968,665, mailed Oct. 9, 2014
`12 pages.
`Official Action for U.S. Appl. No. 13/968,665, mailed May 7, 2015
`11 pages.
`Notice of Allowance for U.S. Appl. No. 13/968,665, mailed Sep. 4.
`20158 pages.
`Official Action for U.S. Appl. No. 14/822,705, mailed Mar. 11, 2016
`21 pages.
`
`* cited by examiner
`
`EX. 1001
`LG Electronics, Inc. / Page 3 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 1 of 34
`
`US 9,510,040 B2
`
`ÁueduuOO
`euoudele L
`
`
`
`
`
`
`
`
`
`
`
`
`EX. 1001
`LG Electronics, Inc. / Page 4 of 58
`
`

`

`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 2 of 34
`Sheet 2 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`U.S. Patent
`U.S. Patent
`
`
`
`gL‘big
`
`- -112- - -D
`
`QLL
`
`O8L
`
`EX. 1001
`LG Electronics,Inc. / Page 5 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 5 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 3 of 34
`
`US 9,510,040 B2
`
`
`
`26b
`
`Fig. 2A
`
`EX. 1001
`LG Electronics, Inc. / Page 6 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 4 of 34
`
`US 9,510,040 B2
`
`
`
`| ? ||
`
`C82
`
`| )--Hiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiifí?ii?
`–TL?
`
`EX. 1001
`LG Electronics, Inc. / Page 7 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet S of 34
`
`US 9,510,040 B2
`
`
`
`-22
`
`-100
`
`-276e
`L-276g
`
`O4
`
`208
`
`EX. 1001
`LG Electronics, Inc. / Page 8 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 6 of 34
`
`US 9,510,040 B2
`
`
`
`
`
`s
`
`Ew time
`
`
`
`W N
`y1
`
`
`
`//
`
`EX. 1001
`LG Electronics, Inc. / Page 9 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 7 of 34
`
`US 9,510,040 B2
`
`
`
`3O8
`
`312
`
`316
`
`Memory
`
`Data
`storage
`
`Display
`COntroller
`
`Configurable Area
`
`Encoding/
`Decoding
`E
`t
`E9 --> Compression/
`Decompression
`Module
`
`364
`
`Processor
`
`WireleSS
`Connectivity
`Module
`
`Other Wireless
`Communications
`Module
`
`POWer SOUrCe and
`POWer Control Module
`
`352
`
`360
`
`356
`
`Port
`Interface
`
`Integrated
`Audio I/O
`
`Hardware
`Buttons
`
`|R/RF
`Module
`
`Image
`Capture
`
`Audio I/O
`Interface
`
`FIG. 3
`
`EX. 1001
`LG Electronics, Inc. / Page 10 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 8 of 34
`
`US 9,510,040 B2
`
`or
`
`452
`
`456
`
`460
`
`Video on
`
`Applications
`
`Application
`Center
`
`User
`Interface
`
`
`
`
`
`
`
`412
`
`408
`
`404
`
`436
`
`464
`440
`
`468
`
`444
`
`TV
`Services
`
`TV Services
`FrameWork
`
`TV
`Resources
`
`User Interface
`Components
`
`Application
`FrameWork
`
`424
`
`448
`
`428
`
`OS
`Runtime
`
`TV Services
`Hypertext Application Language (HAL)
`
`432
`
`420
`
`Operating System (OS)
`Kerne
`
`w
`Drivers
`
`FIG. 4
`
`EX. 1001
`LG Electronics, Inc. / Page 11 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 9 of 34
`
`US 9,510,040 B2
`
`500 S.
`
`416
`
`Applications
`
`
`
`Global
`Panel
`
`Settings Notification
`Panel
`Panel
`
`
`
`
`
`
`
`
`
`
`Silo
`Manager
`
`
`
`
`
`Pane
`Manager
`
`USer
`Interface
`Application
`
`
`
`
`
`412
`
`Silo Application
`
`
`
`Application
`Panel
`
`Bottom
`Panel
`
`Panel
`Controller
`
`552
`
`
`
`
`
`Application
`Framework
`
`
`
`Silo Transition
`Controller
`
`Input Event
`Dispatcher
`
`504
`
`508
`
`FIG. 5
`
`EX. 1001
`LG Electronics, Inc. / Page 12 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 10 of 34
`
`US 9,510,040 B2
`
`432
`
`
`
`
`
`Data Service
`
`608
`
`Media Data
`Model
`
`Content Providers
`
`62O
`
`624
`
`628
`
`V
`OD
`SubService
`
`EPG
`632 SubService
`
`Media
`636 SubService
`
`640
`
`VOD Source
`Plugin
`
`EPG Source
`Plugin
`
`Media Source
`Plugin
`
`656
`
`648
`
`652
`
`Resource
`Arbitrator
`
`660
`
`Thumbnail Cache
`Manager
`
`Resources
`
`616
`
`644
`
`
`
`664
`
`EX. 1001
`LG Electronics, Inc. / Page 13 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 11 of 34
`Sheet 11 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`780
`
`732
`732
`744
`744
`
`764
`764
`
`752
`752
`
`776
`716
`
`768
`768
`
`780
`
`788
`
`792
`
`70
`D
`
`736
`736
`740
`740
`
`748
`748
`
`760
`760
`
`704
`704
`
`708
`708
`
`756
`756
`
`772
`tf2
`
`784
`784
`
`796
`796
`
`794
`
`EX. 1001
`LG Electronics, Inc. / Page 14 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 14 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 12 of 34
`Sheet 12 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`3
`708
`
`s
`704
`
`s
`Fig.8
`
`
`
`Fig.9A
`
`EX. 1001
`LG Electronics, Inc. / Page 15 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 15 of 58
`
`

`

`S.
`
`704904
`
`s
`
`Fig.9C
`
`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 13 of 34
`Sheet 13 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`S
`
`EX. 1001
`LG Electronics, Inc. / Page 16 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 16 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 14 of 34
`Sheet 14 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`1000
`
`Fig. 10
`
`EX. 1001
`LG Electronics, Inc. / Page 17 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 17 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 15 of 34
`Sheet 15 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`Z LZ
`
`Cle
`
`EX. 1001
`LG Electronics, Inc. / Page 18 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 18 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 16 of 34
`Sheet 16 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`ZLZ
`
`ele
`
`l.
`
`61-I
`
`EX. 1001
`LG Electronics, Inc. / Page 19 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 19 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 17 of 34
`Sheet 17 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`1100
`
`00 || ||
`
`
`
`Fig.11C
`
`
`
`N—
`N
`
`
`
`EX. 1001
`LG Electronics, Inc. / Page 20 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 20 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 18 of 34
`
`US 9,510,040 B2
`
` |a! YSAIFOSNVYL>prci(4)SSATAMIMyYSTIONLNODVdbey/Pb-—z,-—--
`
`™a3ONNoSs
`ZeZhiebo
`ee71ndoW:INSNASVNVI
` WNIGaW>|covenalavavayYaMOd:YALNdNOO
`
`3|4YaMOd
`
`i!yoo1o=|.|Y3aAINdG37Nalere3|:
`MOLLSAOPSHOLVNLOVKe-4
`
`
`
`ZL‘big
`
`OZZ1
`
`0071
`
`EX. 1001
`LG Electronics, Inc. / Page 21 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 21 of 58
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 19 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`O@EL
`
`vOELo
`
`9EElL
`
`
`
`
`
`(S)NOLLVOMNddV¥
`
`(S)NOI LVOIT?dV
`
`
`
`YaAV1dVIGANNOILVOMIdd¥AL
`
`‘\OOEL
`
`LNALNOOD
`
`NOILVLNASSud
`
`SOIANSS
`
`LNALNOO
`
`NOILVOAYSOV
`
`SSIANaS
`
`
`
`AOYNOSLNALNOOD
`
`ADIAYAS
`
`EX. 1001
`LG Electronics, Inc. / Page 22 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 22 of 58
`
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 20 of 34
`Sheet 20 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`Application Panel
`
`
`NnN
`=+
`Z || 7 ||
`
`SC
`
`+
`.
`oh
`ir
`
`&g
`
`E
`>
`z
`=
`oO
`oO
`fo@)
`T_
`
`©w
`
`
`
`
`
`
`wee SFE OOOO‘ SSS
`up us
`
`ao
`OH v
`"og
`wpe
`
`wt
`oO
`wTvr
`
`EX. 1001
`LG Electronics, Inc. / Page 23 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 23 of 58
`
`

`

` ContentViewArea
`
`
`
`s
`1404
`
`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 21 of 34
`Sheet 21 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`
`
`
`
`Fig.15A
`
`EX. 1001
`LG Electronics, Inc. / Page 24 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 24 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 22 of 34
`Sheet 22 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`OOLtN_eIaeeeaassneasnnengmmemeenaenaaneennpenmmese.:
`
`agp‘big
`
`
`
` —sindutTeMoysIEsuatyOO,!ai0¢LXOUX-|INGH
`
`
`
`
`
`
`
`
`
`
`
`
`
`-puewaqUEqozs}S:_SOo™
`HAN|s[TepAYs erpopy.[OIBJosmorgeeea DO?SLaumospigojqqng—suonvoyddy#Ceedotug
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`80S190S1
`
`seenennennaee
`
`80rl
`
`OLSL:
`
`
`
`dvSSe|aIMcbshp10?“STYR
`
`Vrosl
`
`
`
`
`
`vozS1NXNO108AEOatT[CTF
`
`avosl
`
`OvOSh
`
`Qv0S}
`
`Ards!
`
`AvOSL
`
`EX. 1001
`LG Electronics, Inc. / Page 25 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 25 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 23 of 34
`
`US 9,510,040 B2
`
`Of709 j.
`
`EX. 1001
`LG Electronics, Inc. / Page 26 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 24 of 34
`
`US 9,510,040 B2
`
`
` oo4soumesrowaneipon[EB|y09!-WwepA¥g
`
`
`
`OO\Pdpilge1qqng—suoeolddy
`sno.:
`-pueweguo["]|:
`
`
`Ol
`
`
`
`SHOIVo9¢xoqX-|INGA<==
`
`
`
`AdvSSOVPIIM2G:¥1‘%Bun
`
`cegl
`
`9e9L
`
`9191
`
`EX. 1001
`LG Electronics, Inc. / Page 27 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 27 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 25 of 34
`
`US 9,510,040 B2
`
`Beeeeeeeneannneeneeeneennnnneenerorereeteeenecerentcececeseeeeeecee”
`
`weweeeeeer)
`
`vOLl
`
`
`OOed
`
`
`
`(Leewanencnceeeesemenfenceneseseerennaassesnessonenanagencccesesesamenanaamewasan%,
`
`
`
`
`annenenneeweenerrrsecesoceateeeeeseeeweenrewebawweewenenanfenwnnneweeeeneeenhnnneeeneennnee
`
`
` ae”taii3i2iH3i:Hhuiu3!#3HBuiiB2Hh3itiit2HyAitRi33HHiHuitHu3iH3it3HeHHi3i+:3HFuii.iHH:jeouReDHy:HHitFFt
`
`OOZL
`
`
`
`Lb‘bigrLLLZLLL
`
`8O/L
`
`
`
`SWENLIANGHHPS
`
`EX. 1001
`LG Electronics, Inc. / Page 28 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 28 of 58
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 26 of 34
`Sheet 26 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`eee ewer enn,
`
`peeeweeeceeeweeneeennnwreweennnnnneeneni+--—TT.~====a3oaaonannnnnnnnneenneneeceecconamemnnanneen
`
`
`0081
`
`8081
`
`EX. 1001
`LG Electronics, Inc. / Page 29 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 29 of 58
`
`

`

`pueweguO
`
`
`
`aWOARYJINOAjeAolug
`
`
`
`SMOUSpUeSOIAOW
`
`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 27 of 34
`Sheet 27 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`V6L“big
`
`EX. 1001
`LG Electronics, Inc. / Page 30 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 30 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 28 of 34
`Sheet 28 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`8061
`
`JOJUeDS
`
`sJeuueyo
`
`
`
`ounjyeassiu3Aolua0}
`
`96L‘big
`
`EX. 1001
`LG Electronics, Inc. / Page 31 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 31 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 29 of 34
`
`US 9,510,040 B2
`
`
`
`series ers sars s m ses a was see n w w a was so a
`
`- - - - - - - - - - - - as
`
`EX. 1001
`LG Electronics, Inc. / Page 32 of 58
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 30 of 34
`
`US 9,510,040 B2
`
`
`
`JOJ JE UO??O?uuOO
`
`
`
`VOZ '61-J
`
`EX. 1001
`LG Electronics, Inc. / Page 33 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 31 of 34
`Sheet 31 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`ALeA
`
`
`
`/\_L ?AIT
`
`
`
`aigeyenyjeubigON
`
`EX. 1001
`LG Electronics, Inc. / Page 34 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 34 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 32 of 34
`Sheet 32 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`
`
`AL8AF]
`
`
`
`/\_L ?AIT
`
`
`
`jQuURYDpaquieloS
`
`902‘big
`
`EX. 1001
`LG Electronics, Inc. / Page 35 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 35 of 58
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 29, 2016
`Nov. 29, 2016
`
`Sheet 33 of 34
`Sheet 33 of 34
`
`US 9,510,040 B2
`US 9,510,040 B2
`
`[euBlSON:|IWGH
`
`
`
`GOZ (61-I
`
`
`
`EX. 1001
`LG Electronics, Inc. / Page 36 of 58
`
`EX. 1001
`LG Electronics, Inc. / Page 36 of 58
`
`
`

`

`U.S. Patent
`
`Nov. 29, 2016
`
`Sheet 34 of 34
`
`US 9,510,040 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`?eqolo ||
`
`
`
`Jesn K?uepl |
`
`EX. 1001
`LG Electronics, Inc. / Page 37 of 58
`
`

`

`US 9,510,040 B2
`
`1.
`GLOBAL PANEL
`
`CROSS REFERENCE TO RELATED
`APPLICATION
`
`The present application is a continuation of and claims
`priority to U.S. patent application Ser. No. 13/970,374 filed
`Aug. 19, 2013 entitled “Global Panel: Ser. No. 13/968,665
`filed Aug. 16, 2013 entitled “Panel User Interface for an
`Intelligent Television: Ser. No. 13/969,179 filed Aug. 16,
`2013 entitled “Intelligent Channel Changing: Ser. No.
`13/969,588 filed Aug. 18, 2013 entitled “Panel User Inter
`face for an Intelligent Television'; and Ser. No. 13/970,355
`filed Aug. 19, 2013 entitled “Content-Sensitive and Context
`Sensitive User Interface for an Intelligent Television; each
`of which claims the benefits of and priority, under 35 U.S.C.
`S119(e), to U.S. Provisional Application Ser. No. 61/684,
`672 filed Aug. 17, 2012, “SmartTV: 61/702,650 filed Sep.
`18, 2012, “Smart TV: 61/697,710 filed Sep. 6, 2012,
`“Social TV: 61/700,182 filed Sep. 12, 2012, “Social TV
`Roadmap': 61/736,692 filed Dec. 13, 2012, “SmartTV:
`61/798,821 filed Mar. 15, 2013, “SmartTV: 61/804,942
`filed Mar. 25, 2013, “SmartTV: 61/804,998 filed Mar. 25,
`2013, “SmartTV: 61/804,971 filed Mar. 25, 2013,
`“SmartTV: 61/804,990 filed Mar. 25, 2013, “SmartTV:
`61/805,003 filed Mar. 25, 2013, “SmartTV: 61/805,053
`filed Mar. 25, 2013, “SmartTV: 61/805,030 filed Mar. 25,
`2013, “SmartTV: 61/805,027 filed Mar. 25, 2013,
`“SmartTV: 61/805,042 filed Mar. 25, 2013, “SmartTV:
`and 61/805,038 filed Mar. 25, 2013, “SmartTV.” The present
`application is also a continuation of and claims priority to
`U.S. patent application Ser. No. 14/418,969 filed Feb. 2,
`2015, entitled “Methods and Displays for Providing Intel
`ligent Television Badges,” which is a national stage appli
`cation under 35 U.S.C. 371 of PCT Application No. PCT/
`US 13/36826, having an international filing date of Apr. 16,
`2013, which claims the benefits of and priority, under 35
`U.S.C. S 119(e), to U.S. Provisional Application Ser. No.
`61/684,672 filed Aug. 17, 2012, “Smart TV: 61/702,650
`filed Sep. 18, 2012, “Smart TV: 61/697,710 filed Sep. 6,
`2012, “Social TV: 61/700,182 filed Sep. 12, 2012, “Social
`TV Roadmap"; 61/736,692 filed Dec. 13, 2012, “SmartTV:
`61/798,821 filed Mar. 15, 2013, “SmartTV: 61/804,942
`filed Mar. 25, 2013, “SmartTV: 61/804,998 filed Mar. 25,
`2013, “SmartTV: 61/804,971 filed Mar. 25, 2013,
`“SmartTV: 61/804,990 filed Mar. 25, 2013, “SmartTV:
`61/805,003 filed Mar. 25, 2013, “SmartTV: 61/805,053
`filed Mar. 25, 2013, “SmartTV: 61/805,030 filed Mar. 25,
`2013, “SmartTV: 61/805,027 filed Mar. 25, 2013,
`“SmartTV: 61/805,042 filed Mar. 25, 2013, “SmartTV:
`and 61/805,038 filed Mar. 25, 2013, “SmartTV. Each of the
`aforementioned documents is incorporated herein by refer
`ence in their entirety for all that they teach and for all
`purposes.
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`BACKGROUND
`
`Consolidation of device features or technological conver
`gence is in an increasing trend. Technological convergence
`describes the tendency for different technological systems to
`evolve toward performing similar tasks. As people use more
`devices, the need to carry those devices, charge those
`devices, update software on those devices, etc. becomes
`more cumbersome. To compensate for these problems, tech
`nology companies have been integrating features from dif
`ferent devices into one or two multi-functional devices. For
`
`60
`
`65
`
`2
`example, cellular phones are now capable of accessing the
`Internet, taking photographs, providing calendar functions,
`etc.
`The consolidation trend is now affecting the design and
`functionality of devices generally used in the home. For
`example, audio receivers can access the Internet, digital
`Video recorders can store or provide access to digital pho
`tographs, etc. The television in home audio/video systems
`remains a cornerstone device because the display function
`cannot be integrated into other devices. As such, consoli
`dating home devices leads to integrating features and func
`tionality into the television. The emergence of the Smart
`Television (SmartTV) is evidence of the trend to consolidate
`functionality into the television.
`A Smart TV is generally conceived as a device that
`integrates access to the Internet and Web 2.0 features into
`television sets. The Smart TV represents the trend of tech
`nological convergence between computers and television
`sets. The Smart TV generally focuses on online interactive
`media, Internet TV, on-demand streaming media, and gen
`erally does not focus on traditional broadcast media. Unfor
`tunately, most Smart TVs have yet to provide seamless and
`intuitive user interfaces for navigating and/or executing the
`various features of the Smart TV. As such, there are still
`issues with the consolidation of features and the presentation
`of these features in Smart TVs.
`
`SUMMARY
`
`There is a need for an Intelligent TV with intuitive user
`interfaces and with seamless user interaction capability.
`These and other needs are addressed by the various aspects,
`embodiments, and/or configurations of the present disclo
`sure. Also, while the disclosure is presented in terms of
`exemplary embodiments, it should be appreciated that indi
`vidual aspects of the disclosure can be separately claimed.
`In various embodiments, the present disclosure relates to
`methods of displaying content on a television, comprising:
`receiving an indication associated with a selection by a user;
`determining, based on the received indication, a global panel
`to display via the television; retrieving from memory, a first
`content information for display in the global panel; and
`displaying, via the television, the retrieved content informa
`tion in the specified global panel.
`In some embodiments, the present disclosure relates to
`non-transitory computer readable information storage medi
`ums having Stored thereon instructions that cause a com
`puting system to execute a method of displaying content on
`a television, comprising: receiving an indication associated
`with a selection by a user; determining, based on the
`received indication, a global panel to display via the tele
`vision; retrieving from memory, a first content information
`for display in the global panel; and displaying, via the
`television, the retrieved content information in the specified
`global panel.
`In further embodiments, the present disclosure relates to
`systems for displaying content on a television, comprising:
`an input device associated with the television; a memory;
`and a microprocessor operable to: receive an indication
`associated with a selection by a user, determine, based on
`the received indication, a global panel to display via the
`television; retrieve from the memory, a first content infor
`mation for display in the global panel; and display, via the
`television, the retrieved content information in the specified
`global panel.
`The present disclosure can provide a number of advan
`tages depending on the particular aspect, embodiment, and/
`
`EX. 1001
`LG Electronics, Inc. / Page 38 of 58
`
`

`

`3
`or configuration. For example, the current disclosure pro
`vides a panel system that aides in the navigation of an
`intelligent television. For example, a multi-panel system is
`provided that satisfies the following: allows a user to watch
`a primary program while Surfing the internet, checking
`Social media, and checking a system error, etc. Moreover,
`information may be displayed in one content area that
`specifically depends on or contextually dependent on the
`primary program or active content area. The panel system
`allows for a same pattern of navigation—all resulting in a
`unified experience for a user. In another area, an application
`panel is provided that allows quick access to core function
`ality, provides an unobtrusive design which allows for the
`active media to always be in view, provides a consistent user
`experience across all applications, and provides focused
`contextual content.
`Another advantage is easy navigation in on-demand pro
`gramming and allowing for consumers increased demand
`for multi-sourced content. Thus, the user interface is flex
`ible, reliable, and consistent across different applications.
`The global panel in on demand includes various views.
`The video on demand interaction framework is flexible so
`different content providers can populate the content into the
`views in video on demand by providing a back end data
`source. Most views in video on demand have multiple
`components; some components are mandatory and others
`are optional. Content providers can pick and choose the
`components that go into each view based on the structure
`and availability of their media content. Multiple variations
`allow the user a rich, elegant, and intelligent navigational
`experience.
`The global panel provides customized information. The
`navigation pattern and content layout remains consistent.
`Key benefits of the global panel includes: quick access to
`core functionality, unobtrusive design allowing the active
`Video to always be in view, consistent user experience, and
`focused contextual content.
`As consumers are demanding more access to content, the
`trend of viewing live and on-demand programming accel
`erates. The panel system provides quick access to extended
`functionality while still maintaining visibility into the main
`content view. The panel system allows the user to continue
`watching a primary program while Surfing, checking Social
`media, checking a system error, etc. The panel system is
`easy to navigate and contextually relevant, designed to
`provide quick access to extended functionality while still
`maintaining visibility into the main content view. These and
`other advantages will be apparent from the disclosure.
`The phrases “at least one”, “one or more', and “and/or
`are open-ended expressions that are