Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 1 of 21 PageID #: 850
`
`
`
`Exhibit 3
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 2 of 21 PageID #: 851
`
`
`
`11111111111111111111111111f1111j189111j1111111 111111111011111
`
`
`
`(12) United States Patent
`Strober
`
`(10) Patent No.: US 11,086,934 B2
`Aug. 10, 2021
`(45) Date of Patent:
`
`(54) PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`(71) Applicant: Touchstream Technologies, Inc.,
`Valhalla, NY (US)
`
`(72)
`
`Inventor: David Strober, Rye, NY (US)
`
`(73) Assignee: Touchstream Technologies, Inc.,
`Valhalla, NY (US)
`
`( 4 ) Notice:
`
`Subject to any disclaimer. the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,855,842 A
`5,613,137 A
`
`8/1989 Hayes et al.
`3/1997 Bertram et al.
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`
`9/2009
`101534449 A
`11/2009
`101577650 A
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 16/917,095
`
`(22) Filed:
`
`Jun. 30, 2020
`
`(65)
`
`Prior Publication Data
`
`US 2020/0334291 Al
`
`Oct. 22, 2020
`
`Related U.S. Application Data
`
`(63) Continuation of application No. 15/687,249, filed on
`Aug. 25, 2017, now Pat. No. 11,048,751, which is a
`(Continued)
`
`(51) Int. Cl.
`GO6F 3/01
`GO6F 16/74
`
`(2006.01)
`(2019.01)
`(Continued)
`
`(52) U.S. Cl.
`CPC
`
` GO6F 16/74 (2019.01); GO6F 9/452
`(2018.02); GO6F 16/951 (2019.01)
`(58) Field of Classification Search
`CPC
`GO6F 16/74; GO6F 9/452; GO6F 16/951
`See application file for complete search history.
`
`"AnyRemote", Retrieved from Internet URL: http://anyremote.
`sourceforge.net/, pp. 2 (2013).
`(Continued)
`Primary Examiner — Tadesse Hailu
`Assistant Examiner — Darrin Hope
`(74) Attorney, Agent, or Firm — Shook, Hardy & Bacon
`L.L.P.
`ABSTRACT
`(57)
`A system for controlling playback of various types of
`content includes a first computing device that provides a
`unique identifier to a second computing device to establish
`an association there between. By virtue of the established
`association, the second computing device can send one or
`more messages to the first computing device, the one or
`more messages referencing a piece of content associated
`with a first media playing element of a plurality of media
`playing elements, and one or more commands correspond-
`ing to the first media playing element. The first computing
`device can select the first media playing element based on
`the received one or more messages, and control how the first
`media playing element plays the referenced piece of content
`utilizing the one or more commands.
`
`20 Claims, 9 Drawing Sheets
`
`241
`
`26-,
`
`API Adapter
`
`341
`
`Database
`
`201
`
`Server System
`
`Switchboard
`
`361
`L.7aol-ic3iLp
`able
`
`23-,
`
`32-.
`
`Database
`
`J L, T
`22
`
`21
`
`Internet
`
`0
`0
`
`313-,
`
`Content Providers
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 3 of 21 PageID #: 852
`
`US 11,086,934 B2
`Page 2
`
`Related U.S. Application Data
`
`continuation of application No. 13/532,546, filed on
`Jun. 25, 2012, now Pat. No. 9,767,195, which is a
`continuation-in-part of application No. 13/157.821,
`filed on Jun. 10, 2011, now Pat. No. 8,904,289.
`
`(60) Provisional application No. 61/477,998. filed on Apr.
`21, 2011.
`
`(51) Int.
`GO6F 16/951
`GO6F 9/451
`
`(2019.01)
`(2018.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,875,311 A
`5,878,311 A
`6,181,713 B1
`6,252,889 B1
`6,756,965 B2
`6,978,424 B2
`7,058,356 B2
`7,088,823 B2
`7,114,173 B2
`7,330,875 B1
`7,424,718 B2
`7,433,922 B2
`7,440,972 B2
`7,453,454 B2
`7,466,823 B2
`7,509,588 B2
`7,614,070 B2
`7,689,931 B2
`7,769,827 B2
`7,774,708 B2
`7,814,144 B2
`7,835,505 B2
`7,849,485 B2
`7,878,904 B2
`7,949,606 B1
`7,956,846 B2
`8,060,631 B2
`8,086,679 B2
`8,171,507 B2
`8,230,360 B2
`8,238,887 B2
`8,250,608 B2
`8,255,968 B2
`8,316,308 B2
`8,344,870 B2
`8,356,251 B2
`8,373,660 B2
`8,402,494 B1
`8,418,084 B1
`8,433,812 B2
`8,572,488 B2
`8,614,625 B2
`8,620,284 B2
`8,659,553 B1
`8,671,440 B2
`8,738,536 B2
`8,738,737 B2
`8,739,074 B2
`8,743,284 B2
`8,744,434 B2
`8,745,228 B2
`8,745,388 B2
`8,751,159 B2
`8,751,520 B1
`8,751,793 B2
`8,752,016 B2
`8,755,919 B2
`8,756,333 B2
`8,756,505 B2
`
`2/1999 Bertram et al.
`3/1999 Ichinokawa
`1/2001 Patki et al.
`6/2001 Path et al.
`6/2004 Combs et al.
`12/2005 Safadi
`6/2006 Slotznick
`8/2006 Fetkovich
`9/2006 Urdang et al.
`2/2008 Parasnis et al.
`9/2008 Dutton
`10/2008 Engstrom
`10/2008 Oetzel
`11/2008 Allen et al.
`12/2008 Vestergaard et al.
`3/2009 Van Os et al.
`11/2009 Urdang et al.
`3/2010 Koga et al.
`8/2010 Girouard et al.
`8/2010 Bell et al.
`10/2010 Koyama et al.
`11/2010 Toyama et al.
`12/2010 Paik et al.
`2/2011 Maehiro
`5/2011 Sweet
`6/2011 Ording et al.
`11/2011 Collart. et. al.
`12/2011 Nobori et al.
`5/2012 Hironaka et al.
`7/2012 Ma et al.
`8/2012 Filipov
`8/2012 Hayes et al.
`8/2012 Louie et al.
`11/2012 Sherman et al.
`1/2013 Evans et al.
`1/2013 Strober
`2/2013 Pallakoff
`3/2013 Hu et al.
`4/2013 Tischer
`4/2013 Mahajan et al.
`10/2013 Phillips et al.
`12/2013 Alsina et al.
`12/2013 Filipov
`2/2014 Chan ct al.
`3/2014 Damola et al.
`5/2014 Strom et al.
`5/2014 Baldini et al.
`5/2014 Kinoshita
`6/2014 Russell et al.
`6/2014
`Funderburk et al.
`6/2014
`Beckett et al.
`6/2014 Kanungo
`6/2014 Hall
`6/2014 Bhattacharjee et al.
`6/2014 Ginter et al.
`6/2014 Hernandez Porras et al.
`6/2014 Pyle
`6/2014 Jannink et al.
`6/2014 Gonze et al.
`
`8,761,351 Bl
`8,761,792 B2
`8,762,240 B2
`8,762,548 B1
`8,763,081 B2
`8,782,262 B2
`8,782,528 B2
`8,875,180 B2
`8,880,491 B2
`9,071,792 B2
`9,148,756 B2
`9,185,171 B2
`9,420,025 B2
`9,720,887 B2
`2002/0034193 Al
`2002/0075332 Al
`2002/0083147 Al
`2002/0120666 Al
`2002/0129102 Al
`2002/0133518 Al
`2002/0146122 Al
`2002/0198778 Al
`2003/0004804 Al
`2003/0005000 Al
`2003/0018885 Al
`2003/0023488 Al
`2003/0028565 Al
`2003/0112258 Al
`2003/01 12268 A 1
`2003/0142127 Al
`2003/0182663 Al
`2004/0008972 Al
`2004/0049743 Al
`2004/0088728 Al
`2004/0268224 Al
`2004/0268451 Al
`2005/0034151 Al
`2005/0144305 Al
`2005/0149970 Al
`2006/0062544 Al
`2006/0083194 Al
`2006/0098624 Al
`2006/0101098 Al
`2006/0203758 Al
`2006/0263038 Al
`2006/0265657 Al
`2007/0050054 Al
`2007/0052868 Al
`2007/0055986 Al
`2007/0083540 AI
`2007/0094408 Al
`2007/0112785 Al
`2007/0136778 Al
`2007/0150963 Al
`2007/0152978 Al
`2007/0152980 Al
`2007/0155506 Al
`2007/0156855 Al
`2007/0202923 Al
`2007/0288715 Al
`2007/0294621 Al
`2008/0008439 Al
`2008/0028037 Al
`2008/0034394 Al
`2008/0040758 Al
`2008/0077526 Al
`2008/0104267 Al
`2008/0126943 Al
`2008/0140849 Al
`2008/0155600 Al
`2008/0162670 Al
`2008/0178198 Al
`200 8/0 1 87279 A 1
`2008/0189617 A 1
`2008/0250190 Al
`2008/0267369 Al
`2008/0270881 Al
`2008/0301737 Al
`2009/0049373 Al
`
`Daly et al.
`6/2014
`Sennett et al.
`6/2014
`Sogo et al.
`6/2014
`Kessel et al.
`6/2014
`Bogdanovic et al.
`6/2014
`Collart et al.
`7/2014
`Strober
`7/2014
`Demchenko et al.
`10/2014
`11/2014 Morris
`6/2015 Alsina et al.
`9/2015 Filipov
`11/2015 Pahlavan et al.
`8/2016 Park
`8/2017 Pappu et al.
`3/2002 Patki et al.
`6/2002 Geilfuss, Jr. ct al.
`6/2002 Ripperger
`8/2002 Landsman et al.
`9/2002 Landsman et al.
`9/2002 Landsman et al.
`10/2002 Vestergaard et al.
`12/2002 Landsman et al.
`1/2003 Landsman et al.
`1/2003 Landsman et al.
`1/2003 Landsman et al.
`1/2003 Landsman et al.
`2/2003 Landsman et al.
`6/2003 Dietz et al.
`6/2003 Wettach
`7/2003 Markel
`9/2003 Gudorf et al.
`1/2004 Hakcn
`3/2004 Bogward
`5/2004 Shimizu
`12/2004 Balkus et al.
`12/2004 Robbin et al.
`2/2005 Abramson
`6/2005 Fegan, II et al.
`7/2005 Fairhurst et al.
`3/2006 Southwood et al.
`4/2006 Dhrimaj et al.
`5/2006 Morgan et al.
`5/2006 Morgan et al.
`9/2006 'lee et al.
`11/2006 Gilley
`11/2006 Gilley
`3/2007 Sambandam Guruparan et al.
`3/2007 Chou et al.
`3/2007 Gilley et al.
`4/2007 Gundla et al.
`4/2007 Gundla et al.
`5/2007 Murphy et al.
`6/2007 Birger et al.
`6/2007 Lee et al.
`7/2007 Kocienda et al.
`7/2007 Kocienda et al.
`7/2007 Malik
`7/2007 Johnson
`8/2007 Jung et al.
`12/2007 Boswell et al.
`12/2007 Hansen et al.
`1/2008 Liu et al.
`1/2008 Moyer et al.
`2/2008 Jacobs et al.
`2/2008 Beetcher et al.
`3/2008 Arumugam
`5/2008 Dawson
`5/2008 Parasnis et al.
`6/2008 Collazo
`6/2008 Klappert et al.
`7/2008 Chapweske et al.
`7/2008 Gauba
`8/2008 Gilley et al.
`8/2008 Covell et al.
`10/2008 Johnson
`10/2008 Parlamas et al.
`10/2008 Meyer et al.
`12/2008 Hjelmeland Almas et al.
`2/2009 Sharma et al.
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 4 of 21 PageID #: 853
`
`US 11,086,934 B2
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PAYEN(k DOCUMENTS
`
`3/2009 Adappa et al.
`2009(0077467 Al
`4/2009 Jeffs
`2009/0100477 Al
`4/2009 Mu et al.
`2009/0108057 Al
`6/2009 Collart et al.
`2009/0150553 Al
`6/2009 Rogers et al.
`2009/0164641 Al
`2009(0172780 Al* 7/2009 Sukeda
`
`7/2009 Ehreth et al.
`2009/0193466 Al
`9/2009 Zott el al.
`2009/0228919 Al
`2009/0248802 Al * 10/2009 Mahajan
`
` HO4N 21/4227
`726/3
`
` HO4L 65/4015
`709/204
`
`2009/0254827 Al
`2009/0259944 Al
`2009/0259969 Al
`2009/0282470 Al
`2010/0027974 Al
`2010/0081375 Al
`2010(0094728 Al
`2010/0094900 AI
`2010/0137028 Al
`2010/0138746 Al
`2010/0138780 Al
`2010/0174993 Al
`2010/0198860 AI
`2010/0205628 Al
`2010/0208136 Al
`2010/0241699 Al
`2010/0257569 Al
`2010/0265939 Al
`2010/0281042 Al
`2010/0283586 Al
`2010/0313135 Al
`2010/0325552 Al
`2011/0007901 Al
`2011/0014972 Al
`2011/0030020 Al
`2011/0032870 Al
`2011/0035692 Al
`2011(0060998 Al
`2011/0084900 Al
`2011/0090898 Al
`2011/0107227 Al
`2011/0125594 Al
`2011/0131607 Al
`2011/0137729 Al
`2011/0138354 Al
`2011/0156879 Al
`2011/0161396 Al
`2011/0202466 Al
`2011/0214148 Al
`2011/0228768 Al
`2011/0231265 Al
`2011/0231565 Al
`2011/0231566 Al
`2011/0267981 Al
`2011/0289419 Al
`2011/0296454 Al
`2011/0296465 Al
`2011/0314386 Al
`2012(0054616 Al
`2012/0059875 Al
`2012/0059876 Al
`2012/0072846 Al
`2012/0102209 Al
`2012/0110074 Al
`2012(01 10464 Al
`20 12/0 1143 13 Al
`2012/0130971 Al
`2012/0166560 Al
`2012/0182994 Al
`2012(0185887 Al
`2012/0192225 Al
`2012/0239218 Al
`2012/0254931 Al
`2012/0272148 Al
`
`10/2009 Gonze et al.
`10/2009 Wu
`10/2009 Pallakoff
`11/2009 Yang et al.
`2/2010 Ansari
`4/2010 Rosenblatt et al.
`4/2010 Denning et al.
`4/2010 Hughes, Jr.
`6/2010 Farris et al.
`6/2010 Zarom
`6/2010
`Marano et al.
`7/2010
`Pennington et al.
`8/2010 Burnett et al.
`8/2010 Davis et al.
`8/2010 Castano
`9/2010 Muthukumarasamy ct al.
`10/2010 O'Hanlon
`10/2010 Parlamas et al.
`11/2010
`Windes et al.
`11/2010
`Ikeda et al.
`12/2010 Johnson et al.
`12/2010 Sloo et al.
`1/2011 Ikeda et al.
`1/2011 Herrmann et al.
`2/2011 HalOunen
`2/2011
`Kumar
`2/2011
`Sandone et al.
`3(2011 Schwartz et al.
`4/2011 Jacobsen et al.
`4/2011 Patel et al.
`5/2011 Rempell et al.
`5/2011 Brown et al.
`6/2011 Thomas et al.
`6/2011
`Weisman et al.
`6/2011
`Hertenstein et al.
`6/2011 Matsushita et al.
`6/2011 Filbrich et al.
`8/2011 Carter
`9/2011 Gossweiler. III et al.
`9/2011 Gelter et al.
`9/2011 Brown et al.
`9/2011 Gelter ct al.
`9/2011 Gelter et al.
`11/2011 Davies
`11/2011 Yu et al.
`12/2011 Xiong et al.
`12/2011 Krishnan et al.
`12/2011 Jeong et al.
`3/2012 Mittal
`3/2012 Clark
`3/2012 Chinta et al.
`3/2012 Curtis
`4/2012 Fok Ah Chuen et al.
`5/2012 Getchius
`5/2012 Chen et al.
`5/2012
`Phillips et al.
`5/2012
`Morris
`6/2012 Nobori et al.
`7/2012 Dec et al.
`7/2012 Newell
`7/2012 Harwell et al.
`9/2012 Forbes. Jr.
`10/2012 Oztaskent et al.
`10/2012 Strober
`
`2013/0014142 Al
`2013/0124759 Al
`2013/0250181 Al
`2014/0033198 Al
`2016/0241912 Al
`
`1/2013 Newell
`5/2013 Strober
`9/2013 Zhang et al.
`1/2014 Umapathy et al.
`8/2016 McCarthy et al.
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`EP
`JP
`JP
`WO
`WO
`WO
`WO
`
`101778198 A
`101815073 A
`2 175 607 Al
`2004-356695 A
`2006-525771 A
`2004/100500 A2
`2007078745 Al
`2008/070050 A2
`2008108718 Al
`
`7/2010
`8/2010
`4/2010
`12/2004
`11/2006
`11/2004
`7/2007
`6/2008
`9(2008
`
`OTHER PUBLICATIONS
`
`"Best way to generate Random, Unique Session ID's", vBullettn,
`Nov. 19, 2011, p. 1.
`"Best way to generate Random, Unique ID's", vBulletin, Internet
`Archive Wayback Machine, on Nov. 19, 2011, p. 1 (Jan. 2009).
`"Control television phone", Retrieved from Internet URL: http://
`www.bing.com/search ?q=control+television+phone&go=Submit
`+Query &qs=bs&for, Feb. 6, 2014, pp. 3.
`"Control television server phone", Retrieved from Internet URL:
`http://www. bing scorn/ search? q=conlrol +television+server+
`phone&q s=n&formQB LH&pq, Feb. 6, 2014, p. 1.
`"Mobile device server display device", Retrieved from Internet
`I
`http://www.ask.com/web ?q=mobile+device+server+di splay+
`device&q src=0&o=0&1=dir, on Jul. 30, 2012, pp. 2.
`"Mashable-10 Mobile Apps to Control Your TV", Retrieved from
`Internet URL: http://mashable.com/2012/11/28/apps-control-tv/, Nov.
`28, 2012, pp. 102.
`"Mobile Phone Television Remote Control", Retrieved from Inter-
`net URL: http://www.fileguruscom/apps/mobilc phone television
`remote control app, pp. 5 (2013).
`"Mobile server television control", Retrieved from Internet URL:
`http://www.bing.com/search N—mobile+server+television+control
`&qs=n&form=QBLH&p, Jun. 26, 2014, p. 1.
`"Mobile server television control media player". Retrieved from
`
`Internet I IR I http://www.bing.com/search ?q=mobi le+server+ ,:
`television+control+media+player&qs=n&f, Jun. 26, 2014, p. 1.
`"Phone Server television control", Retrieved from Internet URL:
`http://www. bing .com/ search ?q=phone+server+television+
`control&q s=n&form=QBRE&p, Jun. 26, 2014, p. 1.
`"Phone server television control media player", Retrieved from
`Internet URL: http://www. bing .com/ search ?q=phone+server+
`television+control+ media+player &q s=n&f, Jun. 26, 2014, p. 1.
`"Session identifier random", Ask.com, Nov. 19, 2011. p. 1.
`"Session cookie", Webopedia Computer Dictionary, Nov. 19, 2011,
`PP 3.
`"Snapstick", Snapstick—Home, Retrieved from Internet URL :
`http://www.snapstick.com(, on Dec. 12, 2019, pp. 2, (Mar. 201 1).
`"Smartphone Remote Control Apps Boxee Support". Retrieved
`from Internet URL: http://support.boxeestv/entries/20771358-
`smartphone-remote-control-apps, on Feb. 6, 2014, pp. 2 (Dec.
`2011).
`"Using AirPlay", Retrieved from Internet URL : https://web. archive.
`orgiweb/20101129073434/http://supportapplescom/kbiHT4437, pp.
`2 (2011).
`Using the Play to feature to stream media, Retrieved from the
`Internet URL : http://windows.microsoft.com/en-US/windows7/
`using-the-play-to-feature-to-stream-media, pp. 3 ( Jun. 2011).
`"User session", Webopedia Computer Dictionary, Nov. 19, 2011,
`PP 3.
`"Web identifier", Webopedia: Online Computer Dictionary for
`Internet Terms and Technical Support. Retrieved from Internet URL
`: http://wwwwebopedia.com/gsearchJre sults? cx : : : :partner-pub -
`8768004398756183%3A676, on Nov. 19, 2011, pp. 3.
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 5 of 21 PageID #: 854
`
`US 11,086,934 B2
`Page 4
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`"You Tube—Leanback", Retrieved from Internet URL : https://
`www.youtube.com/watch?v=bITse42LpKA, p. 1 (2010).
`"Yahoo!7 TV Guide ", Retrieved from the Internet URL : http://
`itunessapplescom/affiapp/yahoo-7-tv-guideid424719922?mt-8, pp.
`2 (2011).
`Cheng, J., "Stream AirPlay video to regular TV? Apple might make
`it happen", Retrieved from Internet URL : http://arstechnica.com/
`apple/news/20H/03/stream-airplay-video-to-a-regular-tv-apple-might-
`make-it-happen/, on Dec. 12. 2019, pp. 5 (Mar. 2011).
`Dolcourt, J., et al., "Snapstick takes on Apple TV, Google TV,"
`Retrieved from Internet URL : https://w-ww.cnet.comrnews/snapstick-
`takes-on-apple-tv-google-tv/, Dec. 9, 2010, pp. 3.
`Fallahlchair, S., ct al., "Dual Device Uscr interface Design for
`Ubiquitous Language Learning: Mobile Phone and Interactive Tele-
`vision PTV)", Proceedings of the 2005 IEEE International Work-
`shop on Wireless and Mobile Technologies in Education, 2005 , pp.
`8.
`
`Hu. C., et al., "Mobile Media Content Sharing in UPnP-Based
`Home Network Environment", Journal of Information Science and
`Engineering 24, pp. 1753-1769 (2008).
`Hachman, M., "Snapstick's Media Streaming App/Box: Hands on",
`Retrieved from Internet URL : htips://uk.pcmag.comffiews1102838/
`snapsticks-media-streaming-appbox-hands-on, on Dec. 12. 2019,
`pp. 2 (Jan. 2011).
`Paul, I., "Hands on: YouTube Leanback", PCWORLD. Retrived
`from Internet LIRE : http//www.pcworld.com/article/200769/hands_
`on youtube leanback.html, pp. 6 (Jul. 2010).
`Notice of Allowance dated Sep. 3, 2020 in U.S. Appl. No. 15/687,249,
`5 pages.
`Shaivitz, M., "The Web to Your TV, With a Flick of a Wrist?
`Slapstick Says Yes", http://techcocktail.comdhe-web-to-our-tv-with-
`a-flick-of-a-wrist-slapstick-says-yes-2010-12, 2pages, (Dec. 10, 2010)
`(PDF not available).
`Non-Final Office Action dated Feb. 2, 2021 in U.S. Appl. No.
`15/687,249, 9 pages.
`
`* cited by examiner
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 6 of 21 PageID #: 855
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 1 of 9
`
`US 11,086,934 B2
`
`241
`
`26
`
`Server System
`
`28Th
`
`Switchboard
`
`API Adapter
`
`34-\
`
`61
`
`32-N\
`
`Database
`
`Look-up
`Table
`
`4,
`
`Database
`
`23--\
`
`r
`
`g
`
`o
`
`0
`
`0
`
`0
`
`0
`
`0 El ® 0
`
`21
`
`22
`
`Internet
`
`30-\
`
`Content Providers
`
`FIG. 1
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 7 of 21 PageID #: 856
`
`lualgcl •S•9
`
`au III tnv
`
`6 JO Z lootIS
`
`ZS 17E6'980'11 Sfl
`
`FIG. 2
`
`Display Device Database
`
`Message Copied to
`
`(-122
`
`Universal API Adapter
`120-,‘
`
`from Smart Phone
`Message Received
`
`112-
`
`Account Verification
`
`1141
`Smart Phone Database
`
`Message Added to
`
`116-)
`
`Target Verification
`
`/Switchboard
`
`118-\
`
`Back-end Servers
`
`24--N
`
`Display Device Executes
`
`New Message
`
`128-\
`
`New Message Received
`
`by Display Device
`
`126--N
`Database for New Messages
`
`Display Device Checks
`
`Presentation of Video
`130-\
`
`Play/Pauseiffwd/etc...
`
`Load New Video
`
`Switch Video Player
`
`1241
`Display Device
`
`Selection Sent to Database
`110-\
`
`Action Selected
`
`108
`
`Display List of Videos
`
`106
`
`Request Video Data
`
`Start App
`
`Smart Phone
`
`102--N
`
`100
`
`20-
`
`f 30
`
`22--\
`
`Video Player
`40-\,
`
`Video Files
`
`42-N,
`XML Data File
`104-\
`
`[
`
`[— Content Providers
`
`Cnniant Prnviriprk
`Crkntpn4 Prnviricarq I
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 8 of 21 PageID #: 857
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 3 of 9
`
`US 11,086,934 B2
`
`Transmission Code
`Userl TargetID MediaPlayerlD Command Data
`
`Single Connection Look-up Table
`
`Display Device
`
`User -
`Smartphone
`
`2
`1
`3
`4
`
`A
`C
`D
`B
`
`26
`
`FIG. 3
`
`FIG. 4
`
`Universal API Adapter
`Universal Command MediaPlayerlD Specific Player Command
`ytioadVideo
`New Video
`YouTube
`getVideo
`Ted.com
`Vimeo
`YouTube
`Ted .com
`Vimeo
`FIG. 5
`
`loadNewVideo
`yt_pauseVideo
`pauseVideo
`pause
`
`Pause
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 9 of 21 PageID #: 858
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 4 of 9
`
`US 11,086,934 B2
`
`Yes
`
`Is
`the Media Player that
`is Needed to Play the Video
`Already Loaded in the
`Display Device
`
`Request and Obtain a
`Copy of the Appropriate
`Media Player and a Copy
`of the Video File from
`Content Provider
`
`Load the Media Player
`
`Ye
`
`Is
`a Copy of the
`Video Already Loaded in
`the Display Device
`9
`
`No
`
`Obtain a Copy
`of the Video
`
`Play the Video
`
`FIG. 6
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 10 of 21 PageID #: 859
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 5 of 9
`
`US 11,086,934 B2
`
`22
`
`,,.
`
`Display Device
`
`Splash Page
`
`48Th
`435-05-342
`FIG. 7A
`
`-4— Sync-code
`
`IP Address
`169.343.231.234
`
`Sync-code Look-up Table
`Cookie
`erjg988dhuj
`FIG. 7B
`
`Sync-code
`435-05-342
`
`Display Device
`
`22
`
`Display Device
`
`22
`
`Smart Phone
`
`Smart Phone
`
`Smart Phone
`
`20
`
`FIG. 8
`
`20
`
`(A)
`
`20
`
`(B)
`
`FIG. 9
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 11 of 21 PageID #: 860
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 6 of 9
`
`US 11,086,934 B2
`
`Display Device
`
`22
`
`I N.
`
`Smart Phone
`
`Smart Phone
`
`Smart Phone
`
`20
`
`20
`
`20
`
`Moderator
`
`Control of
`Display
`
`FIG. 10
`
`Display Device
`
`Display Device
`
`22
`
`22
`
`Smart Phone
`
`20
`
`FIG. 11
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 12 of 21 PageID #: 861
`
`U.S. Patent
`
`Aug. 10, 2021
`
`Sheet 7 of 9
`
`US 11,086,934 B2
`
`Display Device
`
`Display Device
`
`Display Device
`
`22
`
`22
`
`22
`
`I
`
`Smart Phone
`
`Smart Phone
`
`Smart Phone
`
`20
`
`20
`
`20
`
`Moderator
`
`Control of
`Display
`
`FIG. 12
`
`Display Device
`
`22
`
`t
`
`Smart Phone
`
`Third Party
`
`Display Device
`
`22
`
`t
`
`Smart Phone
`
`20
`
`---••••.••••
`
`20
`
`Playlist and Video Links
`
`FIG. 13
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 13 of 21 PageID #: 862
`
`lualgd •S•9
`
`au III tnv
`
`6 Jo 8 lootIS
`
`ZS 17E6'980'11 Sfl
`
`FIG. 14C
`
`FIG. 14B
`
`FIG. 14A
`
`(0
`
`FOOTER
`
`SEND
`
`0
`
`I
`
`0
`
`0
`
`0
`
`AD SPACE
`
`MENUICHANNELSIPLAYLISTISEARCH
`
`HEADER
`
`Enter the Sync-code below or
`
`devices listed above
`choose from one of your
`
`friend's laptop 0
`living-room PC 0
`
`my laptop
`
`I DISPLAY 21DISPLAY3IDISPLAY 4
`[mu:
`
`CONTROL PANEL
`
`DISPLAY 1)
`
`)
`
`
`
`9.
`
`4
`
`FOOTER
`
`SPLASH PAGE
`
`MENUIOHANNELSIPLAYLISTISEARCH
`
`EADER
`
`0 H
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 14 of 21 PageID #: 863
`
`lualgd •S•9
`
`au III tnv
`
`6 JO 6 lootIS
`
`ZS 17E6'980'11 Sfl
`
`FIG. 14E
`
`FIG. 14D
`
`0
`
`0
`
`FIG. 15
`
`( SEND ,
`
`(
`
`r;
`
`FOOTER
`
`* = Control of Display Device
`" = Group Moderator,
`
`BU*,E
`A",C*,D
`
`Y
`X
`
`1,3
`2
`
`Smartphone
`
`User -
`
`Device Group
`Display
`
`Group Connection
`
`Look-up Table
`
`I GUEST 2IGUEST 3IGUEST
`[DISPLAYS)
`
`GUEST 1
`CONTROL PANEL
`
`ME I
`
`k
`
`MORE INFO...
`OPTION 1
`
`j
`
`AD SPACE
`
`NOW PLAYING
`
`9
`
`(1
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 15 of 21 PageID #: 864
`
`US 11,086,934 B2
`
`1
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`The present application is a continuation of U.S. appli-
`cation Ser. No. 15/687,249, filed Aug. 25, 2017, which is a
`continuation of U.S. application Ser. No. 13/532,546, filed
`on Jun. 25, 2012, which is a continuation-in-part of U.S.
`application Ser. No. 13/157,821, filed on Jun. 10, 2011,
`which issued on Dec. 2, 2014 as U.S. Pat. No. 8,904.289,
`which claims the benefit of priority to U.S. Provisional
`Patent Application No. 61/477,998, filed on Apr. 21, 2011.
`The contents of the earlier applications are incorporated
`herein by reference.
`
`BACKGROUND
`
`This disclosure relates to play control of content on a
`display device. Such display devices include, for example,
`television displays used by consumers in their home for
`viewing videos and other media that are either provided
`from the Web or previously stored. In particular, the disclo-
`sure relates to the creation, storage, manipulation and access
`of media playlists used in conjunction with display devices
`and control of the display devices.
`Web media often is played on computers rather than
`television displays. Although it is known to connect a
`computer to a television set in order to watch Web media, it
`is difficult to control such a system within the typical
`scenario for television watching where the viewer is posi-
`tioned some distance from the television. Furthermore,
`although a wireless device can enable the user to control the
`television from a distance, it can be difficult to view a web
`browser display on the television set and may interfere with
`normal television program viewing by other persons.
`Given the desire to watch various World Wide Web media
`on a family's primary television set, and to control this
`operation from the comfort of one's couch, there is a need
`to operate a television set or other display remotely from a
`personal computing device, such as a mobile phone. It also
`is desirable to allow a user to perform a general Web search
`to locate and capture Web media, and to control a television
`or other display remotely using the personal computing
`device.
`
`SUMMARY
`
`Various aspects of the invention are set forth in the claims.
`For example, according to one aspect, a system for
`presenting and controlling content on a display device
`includes a network, a server system coupled to the network
`and comprising one or more servers, a display device
`coupled to the network and having a display, and a personal
`computing device operable to transmit a first message
`according to a specified format over the network to the
`server system. The server system stores an association
`between the personal computing device and the display
`device. The first message identifies user-selected content and
`a media player to play the content. The server system is
`operable, in response to receiving the first message from the
`personal computing device, to provide to the display device
`a second message identifying the user-selected content and
`the media player to play the content. In response to receiving
`the second message, the display device is operable to obtain
`
`5
`
`2
`a first media player needed to play the content, to load the
`media player and to present the content on the display.
`In some implementations. the display device is operable,
`in response to receiving the second message, to obtain the
`first media player from the content provider only if the first
`media player is not already loaded in the display device.
`In some implementations, the personal computing device
`is operable to transmit a message according to a specified
`format over the network to the server system. The message
`10 can include a command for controlling playing of the
`content on the display device. The server system is operable,
`in response to receiving the message, to convert the com-
`mand into a corresponding command recognizable by the
`media player if the command received from the personal
`15 computing device is not recognizable by the media player.
`The server system is operable to provide to the display
`device a message that includes the corresponding command,
`20 nanmd the display device is operable, in response to receiving
`message from the server system, to execute the corn-
`the
`nl
`In some implementations, the personal computing device
`is, for example, a mobile phone, and the display device is a
`television set. Other personal computing devices or display
`devices can be used in other implementations. The network
`25 can include, for example, the Internet.
`In some implementations, the server system stores a
`look-up table that includes a synchronization code uniquely
`associated with the display device. A message from the
`personal computing device can include the synchronization
`30 code, and in response to receiving the message from per-
`sonal computing device, the server system can use the
`synchronization code and the look-up table to identify the
`display device on which the content is to be played. 'the
`synchronization code can be different from an IP address
`35 associated with the display device and/or a media access
`control address associated with the display device.
`In various implementations, the system can facilitate
`allowing a personal computing device to be used to select
`different content to be played on a remote display even if
`40 different media players are required to present the different
`content. The system also can allow the user to control how
`the content is displayed on the display device using the
`personal computing device. For example. user-initiated play
`commands can be passed from the user's personal comput-
`ing device, through the server system. to the display devices.
`Other aspects, features and advantages will be apparent
`from the following detailed description, the accompanying
`drawings, and the claims.
`
`so
`
`BRIEF DESCRIPTION OF THE FIGURES
`
`55
`
`The present technology is illustrated by way of example,
`and not by way of limitation, in the figures of the accom-
`panying drawings.
`FIG. 1 is a block diagram illustrating an example of a
`system according to the invention.
`FIG. 2 illustrates various details of the flow of information
`and signals according to some implementations.
`FIG. 3 illustrates an example of a transmission code
`60 incorporated into a message from a personal computing
`device.
`FIG. 4 illustrates an example of a look-up table that forms
`part of a server system.
`FIG. S illustrates an example of entries in a universal API
`65 adapter.
`FIG. 6 is a flow chart showing steps for display device to
`load a video player and video.
`
`

`

`Case 2:23-cv-00059-JRG Document 30-3 Filed 03/28/24 Page 16 of 21 PageID #: 865
`
`US 11,086,934 B2
`
`3
`FIG. 7A illustrates an example of a display device includ-
`ing a synchronization code.
`FIG. 713 illustrates an example of a synchronization code
`look-up table.
`FIGS. 8-13 illustrate examples of various scenarios in
`which the invention can be used.
`FIGS. 14A through 14E illustrate examples of display
`screens that may appear on a user's personal computing
`device in accordance with the invention.
`FIG. 15 illustrates further information that can be stored
`in the look-up table in the server system.
`
`DETAILED DESCRIPTION
`
`As shown in FIG. 1, a system 10 facilitates synchronizing
`a connection between two or more devices 20, 22 connected
`to the Internet 21 or other computer network. The connec-
`tion is designed to be made by a first device (e.g., a personal
`computing device) 20 that acts as a controller and a second
`device (e.g., a television set 22 with a display 23) that acts
`as a receiver to play content selected by a user of the first
`device and to respond to commands that originate at the
`personal computing device. The personal computing device
`20 is operable to display an application or web site that
`contains information and links to content providers 30 on the
`Internet 21. The television set 22 is operable to link back to
`a server system 24 from which the television set receives
`commands. When a user makes a selection using the per-
`sonal computing device 20 for particular content to be
`displayed on the television display 23, a signal is sent
`through the Internet (or other network) 21 to the server
`system 24. A corresponding command signal then is passed
`along to the connected television set 22, which acts on a
`transmission code contained within the signal and performs
`specified commands. For example, in some scenarios, the
`command instructs the television set 22 to access a content
`provider 30 through the Internet 21, load a specific media
`player, load the media player-specific content (e.g., a video)
`and play the content on the television display 23. The user
`can use the personal computing device 20 to control how the
`content is played on the television display 23. The user may
`subsequently visit the same or another Web site using the
`personal computing device 20 to select different content
`(e.g., a second video) to be played on the television display
`23. In that case, another signal would be sent through the
`server system 24 to the television set 22. A transmission
`code associated with this conunand signal instructs the
`television set 22 to load a new media player (if needed) over
`the Internet and to load the specified video file to be played
`on the display 23. Thus, the system 10 allows a personal
`computing device 20 to be used to select different content to
`be played on a remote display 23 even if different media
`players are required for the different content. The user also
`can control how the content is displayed (e.g., play, pause,
`stop, rewind, fast forward, etc.) on the display 23 using the
`personal computing device 20. The user-initiated play com-
`mands are passed from the user's personal computing device
`20, through the server system 24, to the television set 22.
`Although the following detailed discussion describes vid-
`eos as an example of the type of content to be played on the
`display 23, the system 10 can be used for other types of
`content as well. Thus, depending on the implementation, the
`content may include one or more of the following: video,
`audio, interactive video game, streaming media, multimedia,
`images, slides (e.g., a PowerPoint presentation) or other
`types of dynamic content. Furthermore, in the following
`discussion, it is assumed that the personal computing device
`
`4
`20 is a mobile phone that includes a display, an internal
`microprocessor or other processing circuitry, a keypad,
`keyboard, touchscreen, mouse. trackball. or other device to
`receive user selections and other input, and a transceiver to
`5 establish communications to the Internet 21 or other com-
`munications net