(12) United States Patent
`Strober
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,904,289 B2
`*Dec. 2, 2014
`
`USOO8904289B2
`
`(54)
`
`(75)
`(73)
`
`(*)
`
`(21)
`(22)
`(65)
`
`(60)
`
`(51)
`
`(52)
`
`(58)
`
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`Inventor: David Strober, Rye, NY (US)
`Assignee: Touchstream Technologies, Inc., New
`York, NY (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 254 days.
`This patent is Subject to a terminal dis
`claimer.
`
`Notice:
`
`Appl. No.: 13/157,821
`
`Filed:
`
`Jun. 10, 2011
`
`Prior Publication Data
`US 2012/O272147 A1
`Oct. 25, 2012
`
`Related U.S. Application Data
`Provisional application No. 61/477,998, filed on Apr.
`21, 2011.
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2011.01)
`
`Int. C.
`G06F 3/00
`H04L 29/06
`G06F 3/0
`H4N2L/40
`U.S. C.
`CPC H04L 65/60 (2013.01); G06F 3/01 (2013.01);
`H04N 2 1/40 (2013.01)
`USPC ........... 715/740; 715/718; 715/736; 715/738;
`715/756; 715/835
`
`Field of Classification Search
`CPC ..................................................... GO6F 3/0487
`USPC .......... 715/716, 718, 736, 738, 740, 756, 835
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,613,137 A *
`5,875,311 A *
`
`3/1997 Bertram et al. ................... T10/1
`2, 1999 Bertram et al. ............... T10,305
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`
`9, 2009
`1.01534449
`11, 2009
`1 O157765O
`(Continued)
`OTHER PUBLICATIONS
`Bing search q=mobile+server+television+control&qJun. 26, 2014.*
`(Continued)
`Primary Examiner — Boris Pesin
`Assistant Examiner — John Heffington
`(74) Attorney, Agent, or Firm — Fish & Richardson P.C.
`(57)
`ABSTRACT
`A system for presenting and controlling content on a display
`device includes a network, a server system coupled to the
`network and comprising one or more servers, a display device
`coupled to the network and having a display, and a personal
`computing device operable to transmit a first message accord
`ing to a specified format over the network to the server sys
`tem. The server system stores an association between the
`personal computing device and the display device. The first
`message identifies user-selected content and a media player to
`play the content. The server system is operable, in response to
`receiving the first message from the personal computing
`device, to provide to the display device a second message
`identifying the user-selected content and the media player to
`play the content. In response to receiving the second message,
`the display device is operable to obtain a first media player
`needed to play the content, to load the media player and to
`present the content on the display.
`18 Claims, 9 Drawing Sheets
`
`
`
`APAdapter
`
`34
`
`Server System
`
`Switchboard
`
`36
`Look-up
`Table
`
`Content Providers
`
`1
`
`Charter Ex. 1171
`
`

`

`US 8,904,289 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,181,713 B1* 1/2001 Patki et al. .................... 370/474
`6,252,889 B1* 6/2001 Patki et al. ..
`370/474
`6,756,965 B2 * 6/2004 Combs et al. ................. 345,156
`6,978,424 B2 * 12/2005 Safadi ........................... 71.5/765
`7,058,356 B2
`6, 2006 Slotznick
`7,114,173 B2 * 9/2006 Urdang et al. .................. 725/88
`7,330,875 B1* 2/2008 Parasnis et al.
`709/204
`7,424,718 B2* 9/2008 Dutton ...
`719,318
`7,433,922 B2 * 10/2008 Engstrom
`709/205
`7.440,972 B2 * 10/2008 Oetzel .........
`386.252
`7,453.454 B2 * 1 1/2008 Allen et al. .
`345,418
`7,509,588 B2 * 3/2009 Van Os et al. ................. 715.835
`7,614,070 B2 * 1 1/2009 Urdang et al. .................. 725/90
`7,689.931 B2 * 3/2010 Koga et al. ...
`715,812
`7,769,827 B2* 8/2010 Girouard et al.
`709,219
`7,774,708 B2 * 8, 2010 Bell et al. .......
`715.738
`7.814,144 B2 * 10/2010 Koyama et al. ............... TO9,203
`7,835,505 B2 11/2010 Toyama et al.
`7,849,485 B2 12/2010 Paik et al.
`7,878,904 B2 * 2/2011 Maehiro ......................... 463,37
`7,949,606 B1* 5, 2011 Sweet ......
`705/52
`7.956.846 B2 *
`6/2011 Ording et al.
`345,173
`8,086,679 B2* 12/2011 Nobori et al. ..
`709/206
`8,171,507 B2 *
`5/2012 Hironaka et al.
`725/12
`8,230,360 B2 * 7/2012 Ma et al. ....................... T15,810
`8,250,608 B2 * 8/2012 Hayes et al. .................... 7.25/51
`8.255,968 B2 * 8/2012 Louie et al. ...
`725, 133
`8,316,308 B2 * 1 1/2012 Sherman et al.
`715,744
`8,344,870 B2 *
`1/2013 Evans et al. .
`340/.461
`8,373,660 B2 * 2/2013 Pallakoff ...
`345,163
`8,418,084 B1 * 4/2013 Tischer .......
`715,863
`8,572.488 B2 * 10/2013 Phillips et al.
`715,716
`8,659,553 B1* 2/2014 Chan et al. ..
`345,169
`8,738,536 B2 *
`5/2014 Strom et al. .................... 705/59
`8,738,737 B2 *
`5/2014 Baldini et al. ................ TO9,219
`8,739,074 B2* 5/2014 Kinoshita ...
`715,864
`8,743,284 B2 * 6/2014 Russell et al. .....
`348,515
`8,744,434 B2 * 6/2014 Funderburk et al.
`455,431
`8,745,228 B2 * 6/2014 Beckert et al.
`709,226
`8,745.388 B2 * 6/2014 Kanungo ...
`713,168
`8,751,159 B2* 6/2014 Hall ......................
`701 467
`8,751.520 B1* 6/2014 Bhattacharjee et al. ...... 707/767
`8,751,793 B2 * 6/2014 Ginter et al. .......
`713,156
`8,752,016 B2 * 6/2014 Hernandez Porras
`et al. ............................. 717/122
`8,755,919 B2 * 6/2014 Pyle .........
`TOO/94
`8,756,333 B2 * 6/2014 Jannink et al.
`709,231
`8,756,505 B2* 6/2014 Gonze et al.
`715/721
`8,761,351 B1* 6/2014 Daly et al. ..
`... 379/45
`8,761,792 B2 * 6/2014 Sennett et al.
`455.454
`8,762,240 B2 * 6/2014 Sogo et al. ...................... 705/35
`8,762.548 B1* 6/2014 Kessel et al. .................. TO9,228
`8,763,081 B2 * 6/2014 Bogdanovic et al. ............. T26.3
`2002/0021289 A1
`2/2002 Combs et al. ......
`345,173
`2002fOO34193 A1* 3, 2002 Patki et al. .....
`370/474
`2002fOO75332 A1* 6, 2002 GeilfuSS et al.
`345,859
`2002/0083147 A1* 6/2002 Ripperger ......
`709,213
`2002/O120666 A1* 8, 2002 Landsman et al. .
`709/200
`2002/01291.02 A1* 9, 2002 Landsman et al. .
`709f2O3
`2002/0133518 A1* 9, 2002 Landsman et al. ............ 707/513
`2002/0146122 A1 10/2002 Vestergaard et al.
`2002fO198778 A1* 12/2002 Landsman et al. .............. TO5/14
`2003/0004804 A1
`1/2003 Landsman et al. .
`TO5/14
`2003/0005000 A1
`1/2003 Landsman et al. .
`707/513
`2003/0018885 A1
`1/2003 Landsman et al. ................ 713/2
`2003/0023488 A1
`1/2003 Landsman et al. .
`TO5/14
`2003/0028565 A1
`2/2003 Landsman et al. .
`707/513
`2003,007 1792 A1* 4, 2003 Safadi ............
`345,169
`2003/0112258 A1* 6/2003 Dietz et al. .................... 345/700
`2003. O131251 A1
`7/2003 Fetkovich
`2003/0.142127 A1* 7/2003 Markel ......................... 345.738
`2003/0182663 A1* 9, 2003 Gudorf et al.
`725,110
`2003.0193520 A1* 10, 2003 Oetzel ......
`345/723
`2003/0208765 A1* 11/2003 Urdang et al.
`725/90
`2004/0008.972 A1
`1/2004 Haken ............................. 386/83
`
`2004/0049743 A1* 3/2004 Bogward ...................... 715,531
`2004/0056837 A1* 3/2004 Koga et al.
`345,156
`2004/0088728 A1* 5/2004 Shimizu .......................... 725/89
`2004/0268224 A1* 12/2004 Balkus et al. .............. T15,500.1
`2004/02684.51 A1* 12/2004 Robbin et al. ......... 999,999.999
`2005, OO12723 A1* 1/2005 Pallakoff ....................... 345,173
`2005.0034151 Alt 2.2005 Abramson
`2005/005571.6 A1
`3/2005 Louie et al. ..................... 7.25/58
`2005/0144305 A1* 6/2005 Fegan et al. ...
`TO9,231
`2005, 014997O A1* 7, 2005 Fairhurst et al.
`725/47
`2005/0192096 A1* 9, 2005 Maehiro ......................... 463/37
`2006, OO62544 A1
`3/2006 Southwood et al.
`2006, 0083194 A1
`4, 2006 Dhrima et al.
`2006/0098.624 A1* 5/2006 Morgan et al. ................ 370,352
`2006/0101.098 A1* 5/2006 Morgan et al.
`TO7.204
`2006/0200832 A1* 9, 2006 Dutton .......................... T19,318
`2006/0203758 All 9/2006 Tee et al.
`... 386,52
`2006/0263038 A1* 11/2006 Gilley ...
`2006/0265657 A1* 1 1/2006 Gilley ........................... 715,730
`2007/005.0054 A1* 3/2007 Sambandam Guruparan
`et al. ............................... TOOf 65
`2007/0052868 A1* 3, 2007 Chou et al. ...
`348,734
`2007/0055986 A1* 3/2007 Gilley et al. .
`725,34
`2007, 0083540 A1* 4, 2007 Gundla et al. ..
`707/101
`2007/008.9147 A1* 4, 2007 Urdang et al. ..
`725/90
`2007/0094408 A1* 4, 2007 Gundla et al. ..
`TO9,231
`2007/01 12785 A1* 5/2007 Murphy et al. .
`707/10
`2007/0136778 A1* 6/2007 Birger et al. .................. 725, 117
`2007/O150963 A1
`6/2007 Lee et al.
`2007/0152978 A1* 7/2007 KOcienda et al. ............. 345,173
`2007/0152980 A1* 7/2007 KOcienda et al. ............. 345,173
`2007. O156855 A1* 7, 2007 Johnson ..........
`TO9,219
`2007. O157089 A1* 7, 2007 Van OS et al. ................. 715/702
`2007/0202923 A1
`8/2007 Jung et al.
`2007/0288715 A1 12/2007 Boswell et al.
`2008, 0008439 A1
`1/2008 Liu et al. ......................... 386, 46
`2008/0028037 A1* 1/2008 Moyer et al. .
`709/217
`2008.0034394 A1
`2/2008 Jacobs et al. ....
`725/98
`2008/0040758 A1
`2/2008 Beetcher et al. ................ 725/81
`2008/0077526 A1
`3/2008 Arumugam
`2008/0104.267 A1* 5/2008 Dawson ........................ TO9,231
`2008/O126943 A1* 5/2008 Parasnis et al. .
`... 715,730
`2008/O140849 A1* 6/2008 Collazo ......................... 709,229
`2008. O155600 A1
`6/2008 Klappert et al.
`2008/0178198 A1* 7/2008 Gauba. ........................... T19,320
`2008/0187279 A1* 8/2008 Gilley et al. .
`... 386,52
`2008. O189617 A1* 8, 2008 Cowell et al. .
`715.738
`2008/0216001 A1* 9/2008 Ording et al.
`T15,763
`2008/025O190 A1* 10, 2008 Johnson ..........
`... 711 (103
`2008/0267369 A1* 10, 2008 Parlamas et al.
`379,93.01
`2008/0270881 A1* 10/2008 Meyer et al. .................. 71.5/2O2
`2008/0301737 A1* 12/2008 Hjelmeland Almas et al. 725/61
`2008/0307315 A1* 12/2008 Sherman et al.
`T15,744
`2009.0049373 A1* 2, 2009 Sharma et al. ..
`T15,234
`2009/0077467 A1* 3/2009 Adappa et al. .
`... 715,719
`2009/009.4331 A1* 4/2009 Nobori et al. ................. 709/205
`2009, O100477 A1
`4, 2009 Jeffs
`2009/0164641 A1* 6/2009 Rogers et al. ................. 709,227
`2009,0177989 A1* 7, 2009 Ma et al. ....................... 715,766
`2009/0228919 A1
`9, 2009 Zott et al.
`2009/0254827 A1* 10, 2009 Gonze et al. .................. 715,716
`2009,0259944 A1* 10, 2009 Wu ............................... 715.738
`2009,0259969 A1* 10, 2009 Pallakoff.
`T15/808
`2009/0282470 A1* 11/2009 Yang et al. ...................... T26, 12
`2010, OO27974 A1
`2/2010 Ansari
`2010.0081375 A1
`4/2010 Rosenblatt et al. .......... 455,411
`2010/0094728 A1* 4/2010 Denning et al. ................ 705/27
`2010/0094900 A1
`4/2010 Hughes
`2010/O127847 A1* 5, 2010 Evans et al. ................... 340/.461
`2010.0137028 A1
`6, 2010 Farris et al.
`2010, 013874.6 A1* 6, 2010 Zarom .......................... 71.5/720
`2010/0174993 A1* 7/2010 Pennington et al.
`715.738
`2010/0180307 A1* 7/2010 Hayes et al. .................... 7.25/51
`2010, 019886.0 A1* 8, 2010 Burnett et al. ................ 707/769
`2010/0205628 A1
`8, 2010 Davis et al.
`2010/0208136 A1* 8, 2010 Castano ........................ 348,553
`2010/0265939 A1* 10, 2010 Parlamas et al.
`370,352
`2010/0281042 A1* 11/2010 Windes et al. ..
`707f756
`2010/0283586 A1* 11/2010 Ikeda et al. ................ 340,1042
`
`
`
`2
`
`

`

`US 8,904,289 B2
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2010/0313135 A1 12/2010 Johnson et al. ............... 715.738
`2010/0325552 A1* 12, 2010 Soo et al. ...
`715.738
`2011/0007901 A1
`1/2011 Ikeda et al. ................... 380,270
`2011/00 14972 A1
`1/2011 Herrmann et al. .............. 463,25
`2011/003.0020 A1
`2/2011 Halttunen
`2011/0032870 A1
`2/2011 Kumar .......................... 370,328
`2011/0035692 A1*
`2/2011 Sandone et al. ...
`715,769
`2011/0060998 A1*
`3/2011 Schwartz et al. ..
`715.738
`2011/OO84900 A1*
`4/2011 Jacobsen et al. ...
`345,156
`2011/0090898 A1*
`4/2011 Patel et al. .....
`370,352
`2011/0107227 A1* 5/2011 Rempell et al.
`... 715.738
`2011/O125594 A1* 5, 2011 Brown et al. .............. 705/14.73
`2011/O137729 A1* 6, 2011 Weisman et al. .......... TO5, 14.58
`2011/O138354 A1*
`6/2011 Hertenstein et al. ..
`717,115
`2011/O156879 A1*
`6/2011 Matsushita et al.
`340/10.1
`2011/O161396 A1*
`6, 2011 Filbrich et al. .
`709f2O3
`2011/0202466 A1*
`8/2011 Carter ............
`705/67
`2011/0214148 A1*
`9/2011 Gossweiler et al.
`T25/46
`2011/0228768 A1*
`9, 2011 Gelter et al. .......
`370,389
`2011/0231265 A1* 9, 2011 Brown et al.
`705/14.73
`2011/0231565 A1* 9, 2011 Gelter et al.
`TO9,231
`2011/0231566 A1* 9, 2011 Gelter et al.
`709,231
`2011/02391. 19 A1* 9/2011 Phillips et al.
`715,731
`2011/0267981 A1* 11, 2011 Davies ........
`370,255
`2011/02894.19 A1* 11/2011 Yu et al. ........................ 715.738
`2011/02964.54 A1* 12/2011 Xiong et al. .................... 725/30
`2011/0296465 A1 12/2011 Krishnan et al.
`2011/031438.6 A1* 12/2011 Jeong et al. ................... 715,741
`2012fOO72846 A1* 3, 2012 Curtis ......
`715.738
`2012/0110074 A1* 5, 2012 Getchius ..
`709/204
`2012/01 10464 A1* 5, 2012 Chen et al. ..
`715.738
`2012fO166560 A1* 6, 2012 Nobori et al.
`709/206
`2012/0182994 A1* 7, 2012 Dec et al. ....
`370,392
`2012/0185887 A1* 7, 2012 Newell ............................ 725/12
`2012/0239218 A1* 9/2012 Forbes, Jr. ..................... 7OO 295
`2012fO254931 A1* 10, 2012 Oztaskent et al. ............ 725, 112
`2012fO272148 A1 10, 2012 Strober
`2013/0014142 A1
`1/2013 Newell ............................ 725/12
`2013/O124759 A1
`5, 2013 Strober
`2013/025.0181 A1* 9/2013 Zhang et al. .................. 348,734
`2014/0033198 A1* 1/2014 Umapathy et al. ............ 717/176
`
`
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`WO
`
`101778198
`101815073
`2008/07OOSO
`
`T 2010
`8, 2010
`6, 2008
`
`OTHER PUBLICATIONS
`
`Bing search qphone--server+television+control&qs Jun. 26, 2014.*
`Bing search qphone--server+television+control+me Jun. 26, 2014.*
`Bing search q=mobile+server+television+control+m Jun. 26, 2014.*
`
`Ask Search Internet Search, Session identifier random, printed on
`Nov. 19, 2011.
`Webopedia computer dictionary, Session cookie, printed on Nov. 19.
`2011.
`Webopedia computer dictinary, web identifier, printed on Nov. 19.
`2011.
`Webopedia computer dictionary, user session, printed on Nov. 19.
`2011.
`www.vbulletin.com, Best way to generate Random, Unique ID's,
`printed on Nov. 19, 2011.
`www.vbulletin.com, Best way to generate Random, Unique ID's,
`Internet Archive Wayback Machine, Jan. 16, 2009.
`Official communication from the USPTO in U.S. Appl. No.
`13/245,001, dated Dec. 8, 2011.
`U.S. Appl. No. 13/245,001, filed Sep. 26, 2011.
`Hachman, M., "Snapstick's Media Streaming App/Box: Hands on.”
`www.pcmag.com/article2/0,2817.2375455.00.asp, 2 pages, (Jan. 8,
`2011).
`Dolcourt, J., CES: Snapstick takes on Apple TV. Google TV. http://
`news.cnet.com/8301-17938 105-20025100-1.html, 3 pages, (Dec.
`9, 2010).
`Shaivitz, M., “The Web to Your TV. With a Flick of a Wrist'? Slapstick
`Says Yes.” http://techcocktail.com/the-web-to-our-tv-with-a-flick
`of-a-Wrist-slapstick-says-yes-2010-12, 2 pages, (Dec. 10, 2010).
`SnapStick—Home, "SnapStick.
`http://www.SnapStick.com/, 2
`pages, printed on Mar. 2, 2011.
`Paul, I., Hands on: YouTube Leanback, PCWORLD, http://www.
`pcworld.com/article/200769/hands on youtube leanback.html, 3
`pages, (Jul. 9, 2010).
`Using AirPlay, Article HT4437, http://support.apple.com/kb/
`HT4437, 3 pages, (Apr. 18, 2011).
`Cheng, J., “Stream AirPlay video to regular TV'? Apple might make
`it happen.” http://arstechnica.com/apple/news/2011/03/stream-air
`play-video-to-a-regular-tv-apple-migh. . . , 1 page, printed on Jun. 7.
`2011.
`“Using the Play to feature to stream media.” http://windows.
`microsoft.com/en-US/windows7/using-the-play-to-feature-to
`stream-media, 3 pages, printed on Jun. 7, 2011.
`“YouTube—Leanback.” http://www.youtube.com/t/leanback,
`page, printed on Jun. 7, 2011.
`“Yahoo!7 TV Guide for iPhone, iPod touch and iPad on the iTunes
`App Store.”
`http://itunes.apple.com/au/app/yahoo-7-tv-guide/
`id4247 1992?mt=8, 2 pages, printed on Jun. 7, 2011.
`Hu, C., et al., “MobileMedia Content Sharing in UPnP-Based Home
`Network Environment.” Journal of Information Science and Engi
`neering 24, 1753-1769. (2008).
`Fallahkhair, S., et al., “Dual Device User interface Design for Ubiq
`uitous Language Learning: Mobile Phone and Interactive Television
`(iTV).” Proceedings of the 2005 IEEE Int’l Workshop on Wireless an
`Mobile Technologies in Education, 8 pages, 2005.
`US Patent and Trademark Office, Official communication in U.S.
`Appl. No. 13/736,590 (dated Oct. 25, 2013).
`* cited by examiner
`
`1
`
`3
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 1 of 9
`
`US 8,904,289 B2
`
`10N
`24
`
`Server System
`
`
`
`
`
`26
`APAdapter
`
`34
`
`Switchboard
`
`32
`
`
`
`30
`
`Content Providers
`
`FIG. 1
`
`4
`
`

`

`U.S. Patent
`U.S. Patent
`
`Dec. 2, 2014
`Dec.2, 2014
`
`Sheet 2 of 9
`Sheet 2 of 9
`
`US 8,904,289 B2
`US 8,904,289 B2
`
`
`
`
`
`UOIeOyWeAjebyeL
`
`PIBOQUIIMS/
`
`
`
`0]pappyabessajy
`
`
`
`eseqejeqauoydUelws
`
`
`
`panisoayabessay
`
`SUOYdWesWod
`
`
`
`
`
`SIaAl8gpua-yorg
`
`Buoy,Wes
`
`O01
`
`02
`
`JaydepyIdIeS/aAlup)
`
`SyoeUDaa1AeqAeldsiq
`
`
`
`sabessayMNJO)aseqeyjeq
`
`6Old
`
`
`
`saynoaxyadlaaqAedsiq
`
`abessayyMeNCapiAJOUOHE|USSel4
`
`-0}paidoy
`abessayy
`
`aoinaqAejdsiqAq"*"o}9/PMyyasned/AC|¢|
`
`panjaoeyabessayyMeN
`
`5
`
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 3 of 9
`
`US 8,904,289 B2
`
`
`
`
`
`
`
`
`
`
`
`TargetID MediaPlayerID Command
`
`
`
`
`
`Single Connection Look-up Table
`
`Display Device
`
`Srion e
`
`
`
`
`
`26
`
`
`
`3
`4
`
`D
`B
`
`I
`
`FIG. 3
`
`
`
`
`
`Pause
`
`YouTube
`Ted.com
`
`yt pauseVideo
`pauseVideo
`
`6
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 4 of 9
`
`US 8,904,289 B2
`
`the Media Player that
`is Needed to Play the Video
`Already Loaded in the
`pisplay,Device
`
`Request and Obtain a
`Copy of the Appropriate
`Media Player and a Copy
`of the Video File from
`Content Provider
`
`Load the Media Player
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ls
`a Copy of the
`Video Already Loaded in
`the Display Device
`
`Obtain a Copy
`of the Video
`
`
`
`
`
`
`
`
`
`
`
`
`
`Play the Video
`
`FIG. 6
`
`7
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 5 Of 9
`
`US 8,904,289 B2
`
`Display Device
`
`Splash Page
`
`48
`435-05-342 -- Sync-Code
`
`Sync-Code Look-up Table
`
`
`
`PAddress
`169.343.231234
`
`erg988dhuj
`FIG. 7B
`
`435-05-342
`
`Display Device
`
`Display Device
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SmartPhone
`
`
`
`
`
`FIG. 8
`
`Smart Phone
`
`Smart PhOne
`
`A
`
`FIG.g
`
`(B)
`
`8
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 6 of 9
`
`US 8,904,289 B2
`
`Display Device
`
`
`
`
`
`- N
`
`SmartPhone
`
`SmartPhone
`
`SmartPhone
`
`
`
`
`
`Moderator
`
`Control of
`Display
`
`FIG. 10
`
`Display Device
`
`
`
`Display Device
`
`
`
`
`
`22
`
`N
`
`SmartPhone
`
`
`
`
`
`FIG. 11
`
`9
`
`

`

`U.S. Patent
`
`Dec. 2, 2014
`
`Sheet 7 of 9
`
`US 8,904,289 B2
`
`Display Device
`
`Display Device
`
`Display Device
`
`
`
`
`
`
`SmartPhone SmartPhone SmartPhone
`
`a
`
`Moderator
`
`Control of
`Display
`
`FIG. 12
`
`Display Device
`
`
`
`
`
`Display Device
`
`
`
`
`
`SmartPhone
`
`Third Party
`
`SmartPhone
`
`
`
`
`
`
`
`Playlist and Video Links
`FIG. 13
`
`10
`
`

`

`U.S. Patent
`U.S. Patent
`
`Dec. 2, 2014
`Dec. 2, 2014
`
`Sheet 8 of 9
`Sheet 8 of 9
`
`US 8,904,289 B2
`US 8,904,289 B2
`
`Wsqv3H
`
`JnOA0B40wouas00y49
`
`
`
`
`
`SAOGEPAIS}SBOIAAD
`
`Ol“Old
`
`av“Sls
`
`VvlSls
`
`
`
`
`
`YsdvsH
`
`183/19
`
`TaN¥dTO¥LNOD
`
`HOUWSSILSITAVTd/STANNVHO{ANSW
`
`
`
`
`PAVIASIOIEAVIGSION?AVIUSIOI|)ATASIC
`
`HOUVSS|LSHAVId]$TANNVHOINNAW
`
`JOvdsOV
`
`JVdHSVdS
`
`11
`
`
`
`
`
`
`
`10MO}8q8p00-9UAGau)46]UF
`
`11
`
`

`

`U.S. Patent
`
`Dec.2, 2014
`
`Sheet 9 of 9
`
`US 8,904,289 B2
`
`
`
`UOIN98UUIO’)GNojs)
`
`
`
`gjqe)dn-yoo7
`
`Sl“Sls
`
`
`
`oyeiapoyydnolg=,
`
`suoyuduewsdSdIANGg
`salaaqAejdsiqJo[oju0D=,
`-188f)Ae|dsiq
`TOXLNOO|ONIAYTdMON
`SAMS)==TINVd
`
`=isano|e1san0le1s3n9G1837]134
`
`dvbOldQvb‘Sls
`
`vesQV
`
`¥al004{“OJNISYON
`
`+NOLLdO
`
`12
`
`12
`
`
`

`

`1.
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`US 8,904,289 B2
`
`CROSS-REFERENCE TO RELATED
`APPLICATION(S)
`
`This application claims the benefit of priority of U.S. Pro
`visional Patent Application No. 61/477,998, filed on Apr. 21,
`2011.
`
`BACKGROUND
`
`This disclosure relates to play control of content on a
`display device. Such display devices include, for example,
`television displays used by consumers in their home for view
`ing videos and other media that are either provided from the
`Web or previously stored. In particular, the disclosure relates
`to the creation, storage, manipulation and access of media
`playlists used in conjunction with display devices and control
`of the display devices.
`Web media often is played on computers rather than tele
`vision displays. Although it is knownto connecta computer to
`a television set in order to watch Web media, it is difficult to
`control Such a system within the typical scenario for televi
`sion watching where the viewer is positioned some distance
`from the television. Furthermore, although a wireless device
`can enable the user to control the television from a distance, it
`can be difficult to view a web browser display on the televi
`sion set and may interfere with normal television program
`viewing by other persons.
`Given the desire to watch various World WideWeb media
`on a family’s primary television set, and to control this opera
`tion from the comfort of one’s couch, there is a need to
`operate a television set or other display remotely from a
`personal computing device. Such as a mobile phone. It also is
`desirable to allow a user to perform a general Web search to
`locate and capture Web media, and to control a television or
`other display remotely using the personal computing device.
`
`SUMMARY
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`Various aspects of the invention are set forth in the claims.
`For example, according to one aspect, a system for present
`ing and controlling content on a display device includes a
`network, a server system coupled to the network and com
`45
`prising one or more servers, a display device coupled to the
`network and having a display, and a personal computing
`device operable to transmit a first message according to a
`specified format over the network to the server system. The
`server system stores an association between the personal
`computing device and the display device. The first message
`identifies user-selected content and a media player to play the
`content. The server system is operable, in response to receiv
`ing the first message from the personal computing device, to
`provide to the display device a second message identifying
`the user-selected content and the media player to play the
`content. In response to receiving the second message, the
`display device is operable to obtain a first media player
`needed to play the content, to load the media player and to
`present the content on the display.
`In some implementations, the display device is operable, in
`response to receiving the second message, to obtain the first
`media player from the content provider only if the first media
`player is not already loaded in the display device.
`In some implementations, the personal computing device
`is operable to transmit a message according to a specified
`format over the network to the server system. The message
`
`50
`
`55
`
`60
`
`65
`
`2
`can include a command for controlling playing of the content
`on the display device. The server system is operable, in
`response to receiving the message, to convert the command
`into a corresponding command recognizable by the media
`player if the command received from the personal computing
`device is not recognizable by the media player. The server
`system is operable to provide to the display device a message
`that includes the corresponding command, and the display
`device is operable, in response to receiving the message from
`the server System, to execute the command.
`In some implementations, the personal computing device
`is, for example, a mobile phone, and the display device is a
`television set. Other personal computing devices or display
`devices can be used in other implementations. The network
`can include, for example, the Internet.
`In some implementations, the server system stores a look
`up table that includes a synchronization code uniquely asso
`ciated with the display device. A message from the personal
`computing device can include the synchronization code, and
`in response to receiving the message from personal comput
`ing device, the server system can use the synchronization
`code and the look-up table to identify the display device on
`which the content is to be played. The synchronization code
`can be different from an IP address associated with the dis
`play device and/or a media access control address associated
`with the display device.
`In various implementations, the system can facilitate
`allowing a personal computing device to be used to select
`different content to be played on a remote display even if
`different media players are required to present the different
`content. The system also can allow the user to control how the
`content is displayed on the display device using the personal
`computing device. For example, user-initiated play com
`mands can be passed from the user's personal computing
`device, through the server system, to the display device.
`Other aspects, features and advantages will be apparent
`from the following detailed description, the accompanying
`drawings, and the claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram illustrating an example of a
`system according to the invention.
`FIG. 2 illustrates various details of the flow of information
`and signals according to some implementations.
`FIG.3 illustrates an example of a transmission code incor
`porated into a message from a personal computing device.
`FIG. 4 illustrates an example of a look-up table that forms
`part of a server system.
`FIG. 5 illustrates an example of entries in a universal API
`adapter.
`FIG. 6 is a flow chart showing steps for display device to
`load a video player and video.
`FIG. 7A illustrates an example of a display device includ
`ing a synchronization code.
`FIG. 7B illustrates an example of a synchronization code
`look-up table.
`FIGS. 8-13 illustrate examples of various scenarios in
`which the invention can be used.
`FIGS. 14A through 14E illustrate examples of display
`screens that may appear on a user's personal computing
`device in accordance with the invention.
`FIG. 15 illustrates further information that can be stored in
`the look-up table in the server system.
`
`DETAILED DESCRIPTION
`
`As shown in FIG. 1, a system 10 facilitates synchronizing
`a connection between two or more devices 20, 22 connected
`
`13
`
`

`

`US 8,904,289 B2
`
`3
`to the Internet 21 or other computer network. The connection
`is designed to be made by a first device (e.g., a personal
`computing device) 20 that acts as a controller and a second
`device (e.g., a television set 22 with a display 23) that acts as
`a receiver to play content selected by a user of the first device 5
`and to respond to commands that originate at the personal
`computing device. The personal computing device 20 is oper
`able to display an application or web site that contains infor
`mation and links to content providers 30 on the Internet 21.
`The television set 22 is operable to link back to a server 10
`system 24 from which the television set receives commands.
`When a user makes a selection using the personal computing
`device 20 for particular content to be displayed on the televi
`sion display 23, a signal is sent through the Internet (or other
`network) 21 to the server system 24. A corresponding com- 15
`mand signal then is passed along to the connected television
`set 22, which acts on a transmission code contained within the
`signal and performs specified commands. For example, in
`Some scenarios, the commandinstructs the television set 22 to
`access a content provider 30 through the Internet 21, load a 20
`specific media player, load the media player-specific content
`(e.g., a video) and play the content on the television display
`23. The user can use the personal computing device 20 to
`control how the content is played on the television display 23.
`The user may subsequently visit the same or another Web site 25
`using the personal computing device 20 to select different
`content (e.g., a second video) to be played on the television
`display 23. In that case, another signal would be sent through
`the server system 24 to the television set 22. A transmission
`code associated with this command signal instructs the tele- 30
`vision set 22 to load a new media player (if needed) over the
`Internet and to load the specified video file to be played on the
`display 23. Thus, the system 10 allows a personal computing
`device 20 to be used to select different content to be played on
`a remote display 23 even if different media players are 35
`required for the different content. The user also can control
`how the content is displayed (e.g., play, pause, stop, rewind,
`fast forward, etc.) on the display 23 using the personal com
`puting device 20. The user-initiated play commands are
`passed from the user's personal computing device 20, 40
`through the server system 24, to the television set 22.
`Although the following detailed discussion describes vid
`eos as an example of the type of content to be played on the
`display 23, the system 10 can be used for other types of
`content as well. Thus, depending on the implementation, the 45
`content may include one or more of the following: video,
`audio, interactive video game, streaming media, multimedia,
`images, slides (e.g., a PowerPoint presentation) or other types
`of dynamic content. Furthermore, in the following discus
`Sion, it is assumed that the personal computing device 20 is a 50
`mobile phone that includes a display, an internal micropro
`cessor or other processing circuitry, a keypad, keyboard,
`touchscreen, mouse, trackball, or other device to receive user
`selections and other input, and a transceiver to establish com
`munications to the Internet 21 or other communications net- 55
`works. More generally, however, the personal computing
`device 20 can be any type of handheld or other Internet
`enabled personal computing device, including personal com
`puters, e-books, kiosks, tablets, Smartphones, media players,
`and motion and touch sensory interfaces. In some cases, input 60
`from the user can be received in forms other than tactile input
`(e.g., acoustic or speech).
`FIG. 2 illustrates further details of the flow of information
`and signals according to some implementations. The personal
`computing device (e.g., mobile phone) 20 is operable to dis- 65
`play an application or web site that contains information and
`links to content providers 30 on the Internet 21. The user
`
`4
`operates the mobile phone 20 so as to start the application or
`access the web site (block 100). In some implementations, a
`logo appears on the mobile phone's display. By selecting the
`logo, the user causes a menu to expand and present various
`options. The options can include, for example: (i) add new
`content to a playlist, (ii) play a listed item on a secondary
`device, (iii) play a listed item on the mobile phone 20. If the
`user selects to add new content to the playlist, the user is
`presented with a screen that allows him to enter user-defined
`search parameters oro select predefined search parameters to
`request video data. The search parameters are sent from the
`mobile phone 20 as part of a request for video data that satisfy
`the search parameters (block 102). The request is transmitted
`via the Internet 21 and through the server system 24 to the
`appropriate content provider web site. In response, the con
`tent provider 30 provides metadata (e.g., titles, links to the
`videos) for one or more video files that satisfy the search
`parameters (block 104). The metadata can be provided to the
`mobile phone 20, for example, in the form of an XML data
`file. Upon receiving the data file, the mobile phone 20 dis
`plays a list of one or more videos based on the information
`received from the content provider 30 (block 106).
`If desired, the user can take one of several actions, includ
`ing selecting one of the videos from the displayed list to be
`played on the television display 23 or initiating a command
`with respect to a video that already has been loaded to the
`television set 22 (block 108). The mobile phone 20 then
`formats and transmits a message to the server system 24
`(block 110). The message from the mobile phone 20 contains
`a transmission code that includes data regarding the user
`information (e.g., user identification or account number), the
`secondary display it wants to connect to (e.g., television s