( 12 ) United States Patent
`Strober
`
`US 11,048,751 B2
`( 10 ) Patent No .:
`( 45 ) Date of Patent :
`* Jun . 29 , 2021
`
`US011048751B2
`
`( 54 ) PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`( 56 )
`
`( 71 ) Applicant : Touchstream Technologies , Inc. ,
`Valhalla , NY ( US )
`( 72 ) Inventor : David Strober , Rye , NY ( US )
`( 73 ) Assignee : Touchstream Technologies , Inc. ,
`Valhalla , NY ( US )
`Subject to any disclaimer , the term of this
`patent is extended or adjusted under 35
`U.S.C. 154 ( b ) by 0 days .
`This patent is subject to a terminal dis
`claimer .
`
`( * ) Notice :
`
`( 21 ) Appl . No .: 15 / 687,249
`Aug. 25 , 2017
`
`( 22 ) Filed :
`
`( 65 )
`
`Prior Publication Data
`Dec. 7 , 2017
`US 2017/0351757 A1
`
`Related U.S. Application Data
`( 63 ) Continuation of application No. 13 / 532,546 , filed on
`Jun . 25 , 2012 , now Pat . No. 9,767,195 , which is a
`( Continued )
`
`( 51 )
`
`Int . Ci .
`G06F 1730
`GOOF 9/44
`
`( 2006.01 )
`( 2018.01 )
`( Continued )
`
`( 52 ) U.S. Ci .
`CPC
`
`GO6F 16/74 ( 2019.01 ) ; G06F 9/452
`( 2018.02 ) ; G06F 16/951 ( 2019.01 )
`( 58 ) Field of Classification Search
`USPC
`715/716
`See application file for complete search history .
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`5,613,137 A
`5,878,311 A
`
`3/1997 Bertram et al .
`3/1999 Ichinokawa
`( Continued )
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`
`9/2009
`101534119 A
`101577650 A 11/2009
`( Continued )
`
`OTHER PUBLICATIONS
`Ask Search Internet Search , session identifier random , printed on
`Nov. 19 , 2011 .
`
`( Continued )
`Primary Examiner Tadesse Hailu
`Assistant Examiner Darrin Hope
`( 74 ) Attorney , Agent , or Firm — Shook , Hardy & Bacon
`LLP
`ABSTRACT
`( 57 )
`A system for presenting and controlling content on a display
`device includes a network , a server system coupled to the
`network and comprising one or more servers , a display
`device coupled to the network and having a display , and a
`personal computing device operable to transmit a first mes
`sage according to a specified format over the network to the
`server system . The server system stores an association
`between the personal computing device and the display
`device . The first message identifies user - selected content and
`a media player to play the content . The server system is
`operable , in response to receiving the first message from the
`personal computing device , to provide to the display device
`a second message identifying the user - selected content and
`the media player to play the content . In response to receiving
`the second message , the display device is operable to obtain
`a first media player needed to play the content , to load the
`media player and to present the content on the display .
`20 Claims , 9 Drawing Sheets
`
`Canteat Davidenz .
`Content Providers
`
`XML Data File
`
`Video Files
`
`Video Player
`
`30
`
`Smart Phone
`Start App
`Request Video Data
`100
`Display List of Videos
`
`Action Selected
`
`Switch Video Player
`Load New Video
`Play / Pauselffwdaic ,
`
`Selection Sent to Database
`Display Device
`124
`Display Devica Checks
`Database for New Messages
`
`Now Message Received
`by Display Device
`
`128
`Display Davice Executes
`New Message
`
`24
`
`Back - end Servers
`
`Target Verification
`Switchboard
`
`Message Added to
`Smart Phone Database
`
`Account Verification
`
`Message Received
`from Smart Phone
`120
`Universal API Adapter
`
`122
`Message Copied to
`Display Device Database
`
`1
`
`Charter Ex. 1101
`
`

`

`US 11,048,751 B2
`Page 2
`
`Related U.S. Application Data
`continuation - in - part of application No. 13 / 157,821 ,
`filed on Jun . 10 , 2011 , now Pat . No. 8,904,289 .
`( 60 ) Provisional application No. 61 / 477,998 , filed on Apr.
`21 , 2011 .
`( 51 ) Int . Cl .
`G06F 16/74
`GO6F 16/951
`G06F 9/451
`
`( 2019.01 )
`( 2019.01 )
`( 2018.01 )
`References Cited
`U.S. PATENT DOCUMENTS
`
`( 56 )
`
`6,181,713 B1
`6,252,889 B1
`6,756,965 B2
`6,978,424 B2
`7,058,356 B2
`7,114,173 B2
`7,330,875 B1
`7,424,718 B2
`7,433,922 B2
`7,440,972 B2
`7,453,454 B2
`7,509,588 B2
`7,614,070 B2
`7,689,931 B2
`7,769,827 B2
`7,774,708 B2
`7,814,144 B2
`7,835,505 B2
`7,849,485 B2
`7,878,904 B2
`7,949,606 B1
`7,956,846 B2
`8,060,631 B2
`8,086,679 B2
`8,171,507 B2
`8,230,360 B2
`8,238,887 B2
`8,250,608 B2
`8,255,968 B2
`8,316,308 B2
`8,344,870 B2
`8,356,251 B2
`8,373,660 B2
`8,402,494 B1
`8,418,084 B1
`8,572,488 B2
`8,614,625 B2
`8,620,284 B2
`8,659,553 B1
`8,671,440 B2
`8,738,536 B2
`8,738,737 B2
`8,739,074 B2
`8,743,284 B2
`8,744,434 B2
`8,745,228 B2
`8,745,388 B2
`8,751,159 B2
`8,751,520 B1
`8,751,793 B2
`8,752,016 B2
`8,755,919 B2
`8,756,333 B2
`8,756,505 B2
`8,761,351 B1
`8,761,792 B2
`8,762,240 B2
`8,762,548 B1
`8,763,081 B2
`8,782,262 B2
`8,782,528 B2
`
`1/2001 Patki et al .
`6/2001 Patki et al .
`6/2004 Combs et al .
`12/2005 Safadi
`6/2006 Slotznick
`9/2006 Urdang et al .
`2/2008 Parasnis et al .
`9/2008 Dutton
`10/2008 Engstrom
`10/2008 Oetzel
`11/2008 Allen et al .
`3/2009 Van Os et al .
`11/2009 Urdang et al .
`3/2010 Koga et al .
`8/2010 Girouard et al .
`8/2010 Bell et al .
`10/2010 Koyama et al .
`11/2010 Toyama et al .
`12/2010 Paik et al .
`2/2011 Maehiro
`5/2011 Sweet
`6/2011 Ording et al .
`11/2011 Collart et al .
`12/2011 Nobori et al .
`5/2012 Hironaka et al .
`7/2012 Ma et al .
`8/2012 Filipov
`8/2012 Hayes et al .
`8/2012 Louie et al .
`11/2012 Sherman et al .
`1/2013 Evans et al .
`1/2013 Strober
`2/2013 Pallakoff
`3/2013 Hu et al .
`4/2013 Tischer
`10/2013 Phillips et al .
`12/2013 Alsina et al .
`12/2013 Filipov
`2/2014 Chan et al .
`3/2014 Damola et al .
`5/2014 Strom et al .
`5/2014 Baldini et al .
`5/2014 Kinoshita
`6/2014 Russell et al .
`6/2014 Funderburk et al .
`6/2014 Beckert et al .
`6/2014 Kanungo
`6/2014 Hall
`6/2014 Bhattacharjee et al .
`6/2014 Ginter et al .
`6/2014 Hernandez Porras et al .
`6/2014 Pyle
`6/2014 Jannink et al .
`6/2014 Gonze et al .
`6/2014 Daly et al .
`6/2014 Sennett et al .
`6/2014 Sogo et al .
`6/2014 Kessel et al .
`6/2014 Bogdanovic et al .
`7/2014 Collart et al .
`7/2014 Strober
`
`8,875,180 B2
`8,880,491 B2
`9,071,792 B2
`9,148,756 B2
`9,185,171 B2 *
`9,420,025 B2
`9,720,887 B2
`2002/0021289 Al
`2002/0034193 Al
`2002/0075332 A1
`2002/0083147 Al
`2002/0120666 Al
`2002/0129102 A1
`2002/0133518 Al
`2002/0146122 A1
`2002/0198778 A1
`2003/0004804 Al
`2003/0005000 Al
`2003/0018885 Al
`2003/0023488 A1
`2003/0028565 Al
`2003/0071792 Al
`2003/0112268 Al
`2003/0131251 A1
`2003/0142127 A1
`2003/0182663 A1
`2003/0193520 A1
`2003/0208765 Al
`2004/0008972 Al
`2004/0049743 Al
`2004/0056837 Al
`2004/0088728 Al
`2004/0268224 Al
`2004/0268451 A1
`2005/0012723 A1
`2005/0034151 Al
`2005/0055716 A1
`2005/0144305 Al
`2005/0149970 A1
`2005/0192096 A1
`2006/0062544 Al
`2006/0083194 Al
`2006/0098624 Al
`2006/0101098 Al
`2006/0200832 Al
`2006/0203758 Al
`2006/0263038 A1
`2006/0265657 A1
`2007/0050054 A1
`2007/0052868 A1
`2007/0055986 Al
`2007/0083540 A1
`2007/0089147 Al
`2007/0094408 Al
`2007/0112785 A1
`2007/0136778 A1
`2007/0150963 A1
`2007/0152978 A1
`2007/0152980 A1
`2007/0155506 Al
`2007/0156855 A1
`2007/0157089 Al
`2007/0202923 A1
`2007/0288715 Al
`2008/0008439 Al
`2008/0028037 Al
`2008/0034394 Al
`2008/0040758 Al
`2008/0077526 A1
`2008/0104267 Al
`2008/0126943 A1
`2008/0140849 A1
`2008/0155600 A1
`2008/0178198 Al
`2008/0187279 A1
`2008/0189617 Al
`2008/02 16001 A1
`2008/0250190 Al
`2008/0267369 A1
`
`HOIL 63/08
`
`10/2014 Demchenko et al .
`11/2014 Morris
`6/2015 Alsina et al .
`9/2015 Filipov
`11/2015 Pahlavan
`8/2016 Park
`8/2017 Pappu et al .
`2/2002 Combs et al .
`3/2002 Patki et al .
`6/2002 Geilfuss , Jr. et al .
`6/2002 Ripperger
`8/2002 Landsman et al .
`9/2002 Landsman et al .
`9/2002 Landsman et al .
`10/2002 Vestergaard et al .
`12/2002 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`2/2003 Landsman et al .
`4/2003 Safadi
`6/2003 Wettach
`7/2003 Fetkovich
`7/2003 Markel
`9/2003 Gudorf et al .
`10/2003 Oetzel
`11/2003 Urdang et al .
`1/2004 Haken
`3/2004 Bogward
`3/2004 Koga et al .
`5/2004 Shimizu
`12/2004 Balkus et al .
`12/2004 Robbin et al .
`1/2005 Pallakoff
`2/2005 Abramson
`3/2005 Louie et al .
`6/2005 Fegan et al .
`7/2005 Fairhurst et al .
`9/2005 Maehiro
`3/2006 Southwood et al .
`4/2006 Dhrimaj et al .
`5/2006 Morgan et al .
`5/2006 Morgan et al .
`9/2006 Dutton
`9/2006 Tee et al .
`11/2006 Gilley
`11/2006 Gilley
`3/2007 Sambandam Guruparan et al .
`3/2007 Chou et al .
`3/2007 Gilley et al .
`4/2007 Gundla et al .
`4/2007 Urdang et al .
`4/2007 Gundla et al .
`5/2007 Murphy et al .
`6/2007 Birger et al .
`6/2007 Lee et al .
`7/2007 Kocienda et al .
`7/2007 Kocienda et al .
`7/2007 Malik
`7/2007 Johnson
`7/2007 Van Os et al .
`8/2007 Jung et al .
`12/2007 Boswell et al .
`1/2008 Liu et al .
`1/2008 Moyer et al .
`2/2008 Jacobs et al .
`2/2008 Beetcher et al .
`3/2008 Arumugam
`5/2008 Dawson
`5/2008 Parasnis et al .
`6/2008 Collazo
`6/2008 Klappert et al .
`7/2008 Gauba
`8/2008 Gilley et al .
`8/2008 Covell et al .
`9/2008 Ording et al .
`10/2008 Johnson
`10/2008 Parlamas et al .
`
`2
`
`

`

`US 11,048,751 B2
`Page 3
`
`( 56 )
`
`References Cited
`U.S. PATENT DOCUMENTS
`2008/0270881 A1 10/2008 Meyer et al .
`2008/0301737 Al 12/2008 Hjelmeland Almas et al .
`2009/0049373 Al
`2/2009 Sharma et al .
`2009/0077467 A1
`3/2009 Adappa et al .
`2009/0094331 A1
`4/2009 Nobori et al .
`2009/0100477 A1
`4/2009 Jeffs
`2009/0108057 Al
`4/2009 Mu et al .
`2009/0150553 Al
`6/2009 Collart et al .
`2009/0164641 A1
`6/2009 Rogers et al .
`2009/0172780 A1
`7/2009 Sukeda et al .
`2009/0177989 Al
`7/2009 Ma et al .
`2009/0193466 A1
`7/2009 Ehreth et al .
`2009/0228919 A1
`9/2009 Loft et al .
`2009/0248802 A1 * 10/2009 Mahajan
`2009/0254827 Al 10/2009 Gonze et al .
`2009/0259944 A1 10/2009 Wu
`2009/0259969 Al 10/2009 Pallakoff
`2009/0282470 A1 11/2009 Yang et al .
`2010/0027974 Al
`2/2010 Ansari
`2010/0081375 A1
`4/2010 Rosenblatt et al .
`2010/0094728 A1
`4/2010
`ning
`al .
`2010/0094900 Al
`4/2010 Hughes , Jr.
`2010/0127847 Al
`5/2010 Evans et al .
`2010/0137028 Al
`6/2010 Farris et al .
`2010/0138746 A1
`6/2010 Zarom
`2010/0138780 A1
`6/2010 Marano et al .
`2010/0174993 A1
`7/2010 Pennington et al .
`2010/0180307 Al
`7/2010 Hayes et al .
`2010/0198860 A1
`8/2010 Burnett et al .
`2010/0205628 A1
`8/2010 Davis et al .
`2010/0208136 A1
`8/2010 Castano
`2010/0241699 Al
`9/2010 Muthukumarasamy et al .
`2010/0265939 Al 10/2010 Parlamas et al .
`2010/0281042 Al
`11/2010 Windes et al .
`2010/0283586 A1
`11/2010 Ikeda et al .
`2010/0313135 Al 12/2010 Johnson et al .
`2010/0325552 A1 12/2010 Sloo et al .
`2011/0007901 Al
`1/2011 Ikeda et al .
`2011/0014972 A1
`1/2011 Herrmann et al .
`2011/0030020 A1
`2/2011 Halttunen
`2011/0032870 A1
`2/2011 Kumar
`2011/0035692 Al
`2/2011 Sandone et al .
`2011/0060998 A1
`3/2011 Schwartz et al .
`2011/0084900 A1
`4/2011 Jacobsen et al .
`2011/0090898 A1
`4/2011 Patel et al .
`2011/0107227 Al
`5/2011 Rempell et al .
`2011/0125594 A1
`5/2011 Brown et al .
`2011/0131607 Al
`6/2011 Thomas et al .
`2011/0137729 Al
`6/2011 Weisman et al .
`2011/0138354 Al
`6/2011 Hertenstein et al .
`2011/0156879 A1
`6/2011 Matsushita et al .
`2011/0161396 Al
`6/2011 Filbrich et al .
`2011/0202466 Al
`8/2011 Carter
`2011/0214148 A1
`9/2011 Gossweiler , III et al .
`2011/0228768 A1
`9/2011 Gelter et al .
`2011/0231265 Al
`9/2011 Brown et al .
`2011/0231565 A1
`9/2011 Gelter et al .
`2011/0231566 A1
`9/2011 Gelter et al .
`2011/0239119 Al
`9/2011 Phillips et al .
`2011/0267981 A1
`11/2011 Davies
`2011/0289419 A1
`11/2011 Yu et al .
`2011/0296454 Al 12/2011 Xiong et al .
`2011/0296465 A1 12/2011 Krishnan et al .
`2011/0314386 A1
`12/2011 Jeong et al .
`2012/0054616 Al
`3/2012 Mittal
`2012/0059876 Al
`3/2012 Chinta et al .
`2012/0072846 A1
`3/2012 Curtis
`2012/0102209 A1
`4/2012 Fok Ah Chuen et al .
`2012/0110074 A1
`5/2012 Getchius
`2012/0110464 Al
`5/2012 Chen et al .
`2012/0114313 A1
`5/2012 Phillips et al .
`2012/0130971 A1 *
`5/2012 Morris
`
`G06F 9/541
`709/204
`
`HO4N 21/234309
`707/706
`
`2012/0166560 A1
`2012/0182994 Al
`2012/0185887 A1
`2012/0192225 A1
`2012/0239218 A1
`2012/0254931 A1
`2012/0272148 A1
`2013/0014142 A1
`2013/0124759 Al
`2013/0250181 Al
`2014/0033198 Al
`2016/0241912 A1
`
`6/2012 Nobori et al .
`7/2012 Dec et al .
`7/2012 Newell
`7/2012 Harwell et al .
`9/2012 Forbes , Jr.
`10/2012 Oztaskent et al .
`10/2012 Strober
`1/2013 Newell
`5/2013 Strober
`9/2013 Zhang
`1/2014 Umapathy et al .
`8/2016 McCarthy et al .
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`EP
`JP
`WO
`WO
`WO
`WO
`
`101778198 A
`101815073 A
`2175607 A1
`2004356695 A
`2004100500 A2
`2007078745 A1
`2008070050 A2
`2008108718 Al
`
`7/2010
`8/2010
`4/2010
`12/2004
`11/2004
`7/2007
`6/2008
`9/2008
`
`OTHER PUBLICATIONS
`Webopedia computer dictionary , session cookie , printed on Nov. 19 ,
`2011 .
`Webopedia computer dictionary , user session , printed on Nov. 19 ,
`2011 .
`www.vbulletin.com , Best way to generate Random , Unique ID's ,
`printed on Nov. 19 , 2011 .
`www.vbulletin.com , Best way to generate Random , Unique ID's ,
`Internet Archive Wayback Machine , Jan. 16 , 2009 .
`Hachman , M. “ Snapstick's Media Streaming App Box : Hands on , "
`www.pcmag.com/article2/0,2817,2375455,00.asp , 2 pages ( Jan. 8 ,
`2011 ) .
`Dolcourt , J. , CES : Snapstick takes on Apple TV , Google TV ,
`http://news.cnet.com/8301-17938105-20025100-1.html , 3 pages . ( Dec.
`9 , 2010 ) .
`Snapstick - Home , “ Snapstick , ” http://www.snapstick.com , 2 pages ,
`printed on Mar. 12 , 2011 .
`Paul , I. , Hands On : YouTube Leanback , PCWORLD http : // www .
`pcworld.com/article/200769/hands_on_youtube_leanback.html , 3 pages .
`( Jul . 9 , 2010 )
`Using AirPlay , Article HT4437 , httQ : //support.apple.com/kb/
`HT4437 , 3 pages , ( Apr. 18 , 2011 ) .
`Cheng , J. , “ Stream AirPlay video to regular TV ? Apple might make
`it happen , ” http://arstechnica.com/apple/news/2011/03/stream-airplay
`video - to - a - regular - tv - apple - might , 5 pages , Mar. 23 , 2011 .
`“ Using the Play to feature to stream media ” , http://windows.microsoft .
`com / en - US / windows7 / using - the - play - to - feature - to - stream - media , 3
`pages , printed on Jun . 7 , 2011 .
`“ YouTube — Leanback ” , http : www.youtube.com/t/leanback , 1 page ,
`printed on Jun . 7 , 2011 .
`Hu , C. , et al . , “ Mobile Media Content Sharing in UPnP - Based
`Home Network Environment , ” Journal of Information Science and
`Engineering 24 , 1753-1769 . ( 2008 ) .
`Fallahkhair , S. , et al . , “ Dual Device User interface Design for
`Ubiquitous Language Learning : Mobile Phone and Interactive Tele
`vision ( iTV ) , ” Proceedings of the 2005 IEEE Int'l Workshop on
`Wireless and Mobile Technologies in Education , 8 pages , 2005 .
`Bing search q = mobile + server + television + control & q Jun . 26 , 2014 .
`Bing search q = phone + server + television + control & qs Jun . 26 , 2014 .
`Bing search q = phone + server + television + control + me Jun . 26 , 2014 .
`Bing search q = mobile + server + television + control + m Jun . 26 , 2014 .
`Webopedia computer dictionary , web identifier , printed on Nov. 19 ,
`2011 .
`Preinterview First Office Action dated Sep. 3 , 2020 , in U.S. Appl .
`No. 16 / 917,095 , 24 pages .
`First Action Interview Office Action dated Dec. 10 , 2020 in U.S.
`Appl . No. 16 / 917,095 , 25 pages .
`* cited by examiner
`
`3
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 1 of 9
`
`US 11,048,751 B2
`
`10m
`24
`
`28
`
`34
`
`26
`API Adapter
`
`Server System
`
`Switchboard
`
`Database
`
`32
`36
`Look - up einweshane Database
`Table
`
`23
`
`20
`
`? ?
`
`?? ?
`
`? ?? ?? ?
`
`Nawi
`
`21
`
`LAST
`SKALAN
`
`IT
`
`22
`
`o
`c )
`
`30
`
`Internet
`
`Content Providers
`
`FIG . 1
`
`4
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 2 of 9
`
`US 11,048,751 B2
`
`FIG . 2
`
`122
`
`
`
`Copied to Display Message Device Database
`
`
`
`
`
`Back - end Servers
`
`
`
`Target Verification / Switchboard
`
`
`
`Added to Smart Message Phone Database
`
`
`
`EXPEPA
`
`
`
`Account Verification
`
`118
`
`116
`
`114
`
`
`Message Received from
`
`Smart Phone
`
`
`
`Universal API Adapter
`
`112
`
`120
`
`24
`
`
`
`Smart Phone
`
`Start App
`
`
`
`
`
`Request Video Data
`
`102
`
`106
`
`20
`
`
`
`Display List of Videos
`
`
`
`Action Selected
`
`
`
`Selection Sent to Database
`
`Display Device Checks
`
`
`
`
`
`
`Switch Video Player Database for New Messages 126
`
`
`
`New Message Received
`
`by Display Device
`
`
`
`Display Device Executes
`
`New Message
`128
`
`
`
`Display Device 124
`
`30
`
`
`
`Video Files
`
`
`
`Video Player
`
`40
`
`22
`
`Presentation of Video
`
`Play / Pause / ffwd / etc .
`
`
`
`Load New Video
`
`
`
`
`
`XML Data File
`
`
`Providers . Content Providers 104
`Content Providers Content
`
`
`5
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`9
`
`Sheet 3 of 9
`
`US 11,048,751 B2
`
`Transmission Code
`Userd TargetID MediaPlayers Command Data
`
`Single Connection Look - up Table
`User
`Display Device
`Smartphone
`
`1
`3
`
`4
`
`C
`D
`B
`
`FIG . 3
`
`FIG . 4
`
`28
`
`Universal API Adapter
`Universal Command Media Playerid
`Specific Player Command
`YouTube
`yt_load Video
`New Video
`Ted.com
`getVideo
`Vimeo
`loadNewVideo
`yl_pauseVideo
`YouTube
`pauseVideo
`Ted.com
`pause
`Vimeo
`FIG . 5
`
`Pause
`
`6
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 4 of 9
`
`US 11,048,751 B2
`
`the Media Player that
`is Needed to play the Video
`Already Loaded in the
`Display Device
`?
`
`Request and Obtain a
`Copy of the Appropriate
`Media Player and a Copy
`of the Video File from
`Content Provider
`
`Load the Media Player
`
`Is
`a Copy of the
`Yes
`Video Already Loaded in
`Display
`the Display Device
`
`No
`
`Obtain a Copy
`of the Video
`
`Play the Video
`
`FIG . 6
`
`7
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 5 of 9
`
`US 11,048,751 B2
`
`22
`
`Display Device
`Splash Page
`
`XXWWWW **
`
`435-05-342
`FIG . 7A
`
`Sync - code
`
`IP Address
`169.343,231.234
`
`Sync - code Look - up Table
`Cookie
`erig988dhuj
`FIG . 78
`
`Sync - code
`435-05-342
`
`Display Device
`22 ws
`
`Smart Phone
`20
`
`FIG . 8
`
`Display Device
`22
`
`Smart Phone
`20
`
`WA
`
`Smart Phone
`20
`
`FIG . 9
`
`8
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 6 of 9
`
`US 11,048,751 B2
`
`Display Device
`22 ?
`
`Smart Phone
`20
`
`Smart Phone
`20
`
`Smart Phone
`20
`
`Moderator
`
`Control of
`Display
`FIG . 10
`
`Display Device
`92
`
`Display Device
`
`Smart Phone
`20
`
`NAMA
`
`FIG . 11
`
`9
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`9
`
`Sheet 7 of 9
`
`US 11,048,751 B2
`
`Display Device
`22
`
`Display Device
`22
`
`Display Device
`22
`
`Smart Phone Smart Phone Smart Phone
`20 XARXECH
`20
`
`Moderator
`
`Control of
`Display
`FIG . 12
`
`Display Device
`22
`
`ht
`
`Display Device
`22
`
`Smart Phone
`
`Prest
`
`Third Party
`
`..zoo
`
`MASCURRICUL
`
`??????? ???????
`
`*****
`
`Smart Phone
`20
`
`MAR
`
`Playlist and Video Links
`FIG . 13
`
`10
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 8 of 9
`
`US 11,048,751 B2
`
`LANKAHEKA
`
`AD SPACE
`
`>
`
`M.N.NU
`
`FOOTER
`
`@
`FIG . 14C
`
`©
`
`o
`
`o
`
`my laptop
`
`
`friend's laptop
`living - room PC
`
`
`
`from one of your devices listed above
`
`
`
`Enter the Sync - code below or choose
`
`w *********
`
`WWW
`
`@ g
`
`FIG . 14B
`
`
`
`
`
`
`
`HEADER MENU CHANNELS PLAYLIST SEARCH
`
`
`
`
`
`CONTROL PANEL GUEST DISPLAY 1 || DISPLAY 2 DISPLAY SOSPLAY 4
`
`
`
`MUMMY
`
`AWARTAWARAN
`
`
`
`HEADER MENUICHANNELSIPLAYLIST SEARCH
`
`
`
`SPLASH PAGE
`
`***
`
`CROCHET
`
`?
`
`FIG . 14A
`
`11
`
`

`

`U.S. Patent
`
`Jun . 29 , 2021
`
`Sheet 9 of 9
`
`US 11,048,751 B2
`
`User -
`
`Smartphone
`Group Connection Look - up Table
`Group
`Display
`Device
`
`
`
`...
`
`********
`
`
`
`
`
`ME | GUEST ) GUEST 2IGUEST SIGUEST
`
`2 ? A " , C * , D
`1,3 Y B ** , E
`
`Device FIG . 15 Group Moderator , Control of Display
`
`
`
`
`M
`
`SEND
`
`Kapest
`
`aku
`
`WWW
`
`FIG . 145
`
`
`
`
`
`CONTROL PANEL DISPLAYS
`
`
`
`NOW PLAYING
`
`AD SPACE
`
`INFO ... FOOTER
`OPTION 1 MORE
`
`FIG . 14D
`
`WAARSTWO
`
`?? ?
`
`Meanormance
`
`RELEASTAAVAA
`
`12
`
`

`

`US 11,048,751 B2
`
`CROSS - REFERENCE TO RELATED
`APPLICATIONS
`
`5
`
`1
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`2
`In some implementations , the display device is operable ,
`in response to receiving the second message , to obtain the
`first media player from the content provider only if the first
`media player is not already loaded in the display device .
`In some implementations , the personal computing device
`is operable to transmit a message according to a specified
`format over the network to the server system . The message
`The present application is a continuation of U.S. appli
`can include a command for controlling playing of the
`cation Ser . No. 13 / 532,546 , filed on Jun . 25 , 2012 , which is
`content on the display device . The server system is operable ,
`a continuation - in - part of U.S. application Ser . No. 13/157 ,
`821 , filed on Jun . 10 , 2011 , which issued on Dec. 2 , 2014 as 10 in response to receiving the message , to convert the com
`mand into a corresponding command recognizable by the
`U.S. Pat . No. 8,904,289 , which claims the benefit of priority
`media player if the command received from the personal
`to U.S. Provisional Patent Application No. 61 / 477,998 , filed
`computing device is not recognizable by the media player .
`on Apr. 21 , 2011. The contents of the earlier applications are
`The server system is operable to provide to the display
`incorporated herein by reference .
`15 device a message that includes the corresponding command ,
`and the display device is operable , in response to receiving
`BACKGROUND
`the message from the server system , to execute the com
`mand .
`This disclosure relates to play control of content on a
`In some implementations , the personal computing device
`display device . Such display devices include , for example , 20 is , for example , a mobile phone , and the display device is a
`television displays used by consumers in their home for
`television set . Other personal computing devices or display
`viewing videos and other media that are either provided
`devices can be used in other implementations . The network
`from the Web or previously stored . In particular , the disclo-
`can include , for example , the Internet .
`sure relates to the creation , storage , manipulation and access
`In some implementations , the server system stores a
`of media playlists used in conjunction with display devices 25 look - up table that includes a synchronization code uniquely
`and control of the display devices .
`associated with the display device . A message from the
`Web media often is played on computers rather than
`personal computing device can include the synchronization
`television displays . Although it is known to connect a
`code , and in response to receiving the message from per
`computer to a television set in order to watch Web media , it
`sonal computing device , the server system can use the
`is difficult to control such a system within the typical 30 synchronization code and the look - up table to identify the
`scenario for television watching where the viewer is posi-
`display device on which the content is to be played . The
`tioned some distance from the television . Furthermore ,
`synchronization code can be different from an IP address
`although a wireless device can enable the user to control the
`associated with the display device and / or a media access
`television from a distance , it can be difficult to view a web
`control address associated with the display device .
`browser display on the television set and may interfere with 35
`In various implementations , the system can facilitate
`normal television program viewing by other persons .
`allowing a personal computing device to be used to select
`Given the desire to watch various World Wide Web media
`different content to be played on a remote display even if
`on a family's primary television set , and to control this
`different media players are required to present the different
`operation from the comfort of one's couch , there is a need
`content . The system also can allow the user to control how
`to operate a television set or other display remotely from a 40 the content is displayed on the display device using the
`personal computing device , such as a mobile phone . It also
`personal computing device . For example , user - initiated play
`is desirable to allow a user to perform a general Web search
`commands can be passed from the user's personal comput
`to locate and capture Web media , and to control a television
`ing device , through the server system , to the display devices .
`or other display remotely using the personal computing
`Other aspects , features and advantages will be apparent
`45 from the following detailed description , the accompanying
`device .
`drawings , and the claims .
`SUMMARY
`BRIEF DESCRIPTION OF THE FIGURES
`Various aspects of the invention are set forth in the claims .
`The present technology is illustrated by way of example ,
`For example , according to one aspect , a system for 50
`and not by way of limitation , in the figures of the accom
`presenting and controlling content on a display device
`panying drawings .
`includes a network , a server system coupled to the network
`FIG . 1 is a block diagram illustrating an example of a
`and comprising one or more servers , a display device
`system according to the invention .
`coupled to the network and having a display , and a personal
`FIG . 2 illustrates various details of the flow of information
`computing device operable to transmit a first message 55
`and signals according to some implementations .
`according to a specified format over the network to the
`FIG . 3 illustrates an example of a transmission code
`server system . The server system stores an association
`incorporated into a message from a personal computing
`between the personal computing device and the display
`device .
`device . The first message identifies user - selected content and
`FIG . 4 illustrates an example of a look - up table that forms
`a media player to play the content . The server system is 60
`part of a server system .
`operable , in response to receiving the first message from the
`FIG . 5 illustrates an example of entries in a universal API
`personal computing device , to provide to the display device
`adapter .
`a second message identifying the user - selected content and
`FIG . 6 is a flow chart showing steps for display device to
`the media player to play the content . In response to receiving
`the second message , the display device is operable to obtain 65 load a video player and video .
`a first media player needed to play the content , to load the
`FIG . 7A illustrates an example of a display device includ
`media player and to present the content on the display .
`ing a synchronization code .
`
`13
`
`

`

`US 11,048,751 B2
`
`4
`3
`keyboard , touchscreen , mouse , trackball , or other device to
`FIG . 7B illustrates an example of a synchronization code
`look - up table .
`receive user selections and other input , and a transceiver to
`establish communications to the Internet 21 or other com
`FIGS . 8-13 illustrate examples of various scenarios in
`munications networks . More generally , however , the per
`which the invention can be used .
`FIGS . 14A through 14E illustrate examples of display 5 sonal computing device 20 can be any type of handheld or
`screens that may appear on a user's personal computing
`other Internet - enabled personal computing device , including
`personal computers , e - books , kiosks , tablets , smart phones ,
`device in accordance with the invention .
`FIG . 15 illustrates further information that can be stored
`media players , and motion and touch sensory interfaces . In
`some cases , input from the user can be received in forms
`in the look - up table in the server system .
`10 other than tactile input ( e.g. , acoustic or speech ) .
`FIG . 2 illustrates further details of the flow of information
`DETAILED DESCRIPTION
`and signals according to some implementations . The per
`As shown in FIG . 1 , a system 10 facilitates synchronizing
`sonal computing device ( e.g. , mobile phone ) 20 is operable
`to display an application or web site that contains informa
`a connection between two or more devices 20 , 22 connected
`to the Internet 21 or other computer network . The connec- 15 tion and links to content providers 30 on the Internet 21. The
`tion is designed to be made by a first device ( e.g. , a personal
`user operates the mobile phone 20 so as to start the appli
`computing device ) 20 that acts as a controller and a second
`cation or access the web site ( block 100 ) . In some imple
`device ( e.g. , a television set 22 with a display 23 ) that acts
`mentations , a logo appears on the mobile phone's display .
`as a receiver to play content selected by a user of the first
`By selecting the logo , the user causes a menu to expand and
`device and to respond to commands that originate at the 20 present various options . The options can include , for
`personal computing device . The personal computing device
`example : ( i ) add new content to a playlist , ( ii ) play a listed
`20 is operable to display an application or web site that
`item on a secondary device , ( iii ) play a listed item on the
`contains information and links to content providers 30 on the
`mobile phone 20. If the user selects to add new content to the
`Internet 21. The television set 22 is operable to link back to
`playlist , the user is presented with a screen that allows him
`a server system 24 from which the television set receives 25 to enter user - defined search parameters or o select pre
`commands . When a user makes a selection using the per-
`defined search parameters to request video data . The search
`sonal computing device 20 for particular content to be
`parameters are sent from the mobile phone 20 as part of a
`displayed on the television display 23 , a signal is sent
`request for video data that satisfy the search parameters
`through the Internet ( or other network ) 21 to the server
`( block 102 ) . The request is transmitted via the Internet 21
`system 24. A corresponding command signal then is passed 30 and through the server system 24 to the appropriate content
`along to the connected television set 22 , which acts on a
`provider web site . In response , the content provider 30
`transmission code contained within the signal and performs
`provides metadata ( e.g. , titles , links to the videos ) for one or
`specified commands . For example , in some scenarios , the
`more video files that satisfy the search parameters ( block
`command instructs the television set 22 to access a content
`104 ) . The metadata can be provided to the mobile phone 20 ,
`provider 30 through the Internet 21 , load a specific media 35 for example , in the form of an XML data file . Upon
`player , load the media player - specific content ( e.g. , a video )
`receiving the data file , the mobile phone 20 displays a list of
`and play the content on the television display 23. The user
`one or more videos based on the information received from
`can use the personal computing device 20 to control how the
`the content provider 30 ( block 106 ) .
`content is played on the television display 23. The user may
`If desired , the user can take one of several actions ,
`subsequently visit the same or another Web site using the 40 including selecting one of the videos from the displayed list
`personal computing device 20 to select different content
`to be played on the television display 23 or initiating a
`( e.g. , a second video ) to be played on the television display
`command with respect to a video that already has been
`23. In that case , another signal would be sent through the
`loaded to the television set 22 ( block 108 ) . The mobile
`server system 24 to the television set 22. A transmission
`phone 20 then formats and transmits a message to the server
`code associated with this command signal instructs the 45 system 24 ( block 110 ) . The message from the mobile phone
`television set 22 to load a new media player ( if needed ) over
`20 contains a transmission code that includes data regarding
`the Internet and to load the specified video file to be played
`the user information ( e.g. , user identification or account
`on the display 23. Thus , the system 10 allows a personal
`number ) , the secondary display it wants to connect to ( e.g. ,
`computing device 20 to be used to select different content to
`television set 22 with display 23 ) , the location and name of
`be played on a remote display 23 even if different media 50 the media player for the selected video , the command ( e.g. ,
`players are required for the different content . The user also
`play , pause , rewind , etc. ) , and the video file to be acted upon .
`can control how the content is displayed ( e.g. , play , pause ,
`An example of the format of a transmission code from the
`stop , rewind , fast forward , etc. ) on the display 23 using the
`mobile phone 20 to the server system 24 is illustrated in FIG .
`personal computing device 20. The user -