Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 1 of 21 PageID #: 809
`
`
`
`Exhibit 1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 2 of 21 PageID #: 810
`
`
`
`1111111111111111111111111190111R11j11111111111111111111111111
`
`(12) United States Patent
`Strober
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,356,251 B2
`Jan. 15, 2013
`
`(54) PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`(75)
`
`Inventor: David Strober, Rye, NY (US)
`
`(73)
`
`Assignee: Touchstream Technologies, Inc.,
`Valhalla, NY (US)
`
`( 6 )
`
`Notice:
`
`Subject to any disclaimer. the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 4 days.
`
`CN
`
`(21)
`
`Appl. No.: 13/245,001
`
`(22)
`
`Filed:
`
`Sep. 26, 2011
`
`(65)
`
`Prior Publication Data
`
`US 2012/0272148 Al
`
`Oct. 25, 2012
`
`Related U.S. Application Data
`
`Continuation of application No. 13/157,821, filed on
`Jun. 10, 2011.
`
`Provisional application No. 61/477,998. filed on Apr.
`21, 2011.
`
`Int. Cl.
`GO6F 3/00
`U.S. Cl.
`
`(2006.01)
` 715/740; 715/716; 715/734; 715/738;
`715/751; 715/764; 715/835
`Field of Classification Search
` 715/716,
`715/738, 734, 740, 751, 764, 835
`See application file for complete search history.
`
`References Cited
`
`(63)
`
`(60)
`
`(51)
`
`(52)
`
`(58)
`
`(56)
`
`U.S. PATENT DOCUMENTS
`7,058,356 B2
`6/2006 Slotznick
`7,330,875 B I *
`2/2008 Parasnis et al.
`7,424,718 B2 *
`9/2008 Dutton
`7,433,922 B2 * 10/2008 Engstrom
`
` 709/204
` 719/318
` 709/205
`
`7,440,972 B2 * 10/2008 Oetzel
`7,453,454 B2 * 11/2008 Allen et al.
`7,769,827 B2 * 8/2010 Girouard et al.
`7,774,708 B2 * 8/2010 Bell et al.
`7,814,144 B2* 10/2010 Koyama et al.
`7,835,505 B2
`11/2010 Toyama et al.
`(Continued)
`
`386/252
`345/418
`........ 709/219
`715/738
`......... 709/203
`
`FOREIGN PATENT DOCUMENTS
`
`101534449
`912009
`(Continued)
`
`OTIIER PUBLICATIONS
`
`Ask Search Internet Search. session identifier random.*
`
`(Continued)
`
`Primary Examiner — Boris Pesin
`Assistant Examiner — John Heffington
`(74) Attorney, Agent, or Firm — Fish & Richardson P.C.
`
`ABSTRACT
`(57)
`A system for presenting and controlling content on a display
`device includes a network, a server system coupled to the
`network and comprising one or more servers, a display device
`coupled to the network and having a display, and a personal
`computing device operable to transmit a first message accord-
`ing to a specified format over the network to the server sys-
`tem. The server system stores an association between the
`personal computing device and the display device. The first
`message identifies user-selected content and a media player to
`play the content. The server system is operable, in response to
`receiving the first message from the personal computing
`device. to provide to the display device a second message
`identifying the user-selected content and the media player to
`play the content. In response to receiving the second message,
`the display device is operable to obtain a first media player
`needed to play the content, to load the media player and to
`present the content on the display.
`
`26 Claims, 9 Drawing Sheets
`
`24-,
`
`Server System
`
`28,
`
`API Adapter
`
`Switchboard
`
`36-,
`
`32-,
`
`Database
`
`1-Tabwkle4AP
`
`Database
`
`20-,
`IMO
`
`q
`
`0 0 •
`
`3-,
`
`Lr22
`
`Internet
`
`30-,
`
`Content Providers
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 3 of 21 PageID #: 811
`
`US 8,356,251 B2
`Page 2
`
` 709/206
` 725/12
` 345/859
` 709/200
` 709/203
` 707/513
` 705/14
` 705/14
` 707/513
` 713/2
` 705/14
` 707/513
` 345/738
` 725/110
` 345/723
` 386/83
` 725/89
`........ 715/500.1
` 999/999.999
`
` 709/231
`
` 370/352
` 707/204
` 719/318
`
` 700/65
` 725/34
` 707/101
` 709/231
` 707/10
`
` 386/46
` 709/217
` 725/98
`
` 715/730
` 709/229
`
`U.S. PATENT DOCUMENTS
`7,849,485 B2
`12/2010
`Paik et al.
`
`8,086,679 B2 * 12/2011
`Nobori et al.
`8,171,507 B2 *
`5/2012
`Hironaka et al.
`2002/0075332 Al *
`6/2002
`Geilfitss et al.
`2002/0120666 Al "
`8/2002
`Landsman et al.
`2002/0129102 Al" 9/2002
`Landsman et al.
`2002;0133518 Al" 9/2002
`Landsman et al.
`2002/0198778 Al * 12/2002
`Landsman et al.
`2003/0004804 Al *
`1/2003
`Landsman et al.
`2003/0005000 Al *
`1/2003
`Landsman et al.
`2003/0018885 Al *
`1/2003
`Landsman et al.
`2003;0023488 Al *
`1/2003
`Landsman et al.
`2003/0028565 Al *
`2/2003
`Landsman et al.
`2003/0142127 Al* 7/2003
`Markel
`2003/0182663 Al *
`9/2003
`Gudorf et al.
`2003/0193520 Al * 10/2003
`Oetzel
`2004/0008972 Al *
`1/2004
`Haken
`2004;0088728 A 1 *
`5/2004
`Shimizu
`2004/0268224 Al * 12/2004
`Balkus et al.
`2004/0268451 Al * 12/2004
`Robbin et al.
`2005/0034151 Al
`2/2005
`Abramson
`2005/0144305 Al *
`6/2005
`Fegan et al.
`2006/0083194 A 1
`4/2006
`Dhrimaj et al.
`2006/0098624 Al *
`5/2006
`Morgan et al.
`2006/0101098 Al *
`5/2006
`Morgan et al.
`2006/0200832 Al *
`9/2006
`Dutton
`2006/0203758 Al
`9/2006
`Tee et al.
` 386/52
`2006;0263038 Al * 11/2006
`Gilley
` 715/730
`2006/0265657 Al * 11/2006
`Gilley
`2007/0050054 Al *
`3/2007
`Sambandam Guruparan
`et al.
`2007/0055986 Al" 3/2007 Gilley et al.
`2007/0083540 Al "
`4/2007 Gundla et al.
`2007/0094408 Al* 4/2007 Gundla et al.
`2007/0112785 Al *
`5/2007 Murphy et al.
`2007/0202923 Al
`8/2007 Jung et al.
`2007/0288715 Al
`12/2007 Boswell et al.
`2008/0008439 Al *
`1/2008 Liu et al.
`2008;0028037 Al *
`1/2008 Moyer et al.
`2008/0034394 Al *
`2/2008 Jacobs et al.
`2008/0077526 Al
`3/2008 Arumugam
`2008/0126943 Al *
`5/2008 Parasnis et al.
`2008/0140849 Al *
`6/2008 Collazo
`2008;0155600 Al
`6/2008 Klappert et al.
` 386/52
`2008/0187279 A I * 8/2008 Gilley et al.
` 715/738
`2008/0189617 Al *
`8/2008 Covell et al.
` 379/93.01
`2008/0267369 Al * 10/2008 Parlamas et al.
` 715/202
`2008/0270881 Al * 10/2008 Meyer et al.
`2008/0301737 Al * 12/2008 Hjelmeland Almas et al 725/61
`2009/0049373 A I *
`2/2009 Sharma et al.
` 715/234
`2009/0094331 Al * 4/2009 Nobori et al.
` 709/205
`2009/0164641 Al *
`6/2009 Rogers et al.
` 709/227
`2009/0228919 Al
`9/2009 Zott et al.
`20090254827 Al * 10/2009 Gonze et al.
`2009/0259944 Al* 10/2009 Wu
`
`2009/0282470 Al * 11/2009 Yang et al.
`2010/0027974 Al
`2/2010 Ansmi
`2010/0094728 Al *
`4/2010 Denning et al.
`2010/0137028 Al
`6/2010 Farris et al.
`2010/0138746 Al *
`6/2010 Zarom
`2010/0174993 Al* 7/2010 Pennington et al.
`2010/0198860 Al* 8/2010 Burnett et al.
`2010/0205628 Al
`8/2010 Davis et al.
` 370/352
`2010/0265939 Al * 10/2010 Parlamas et al.
` 707/756
`2010/0281042 Al * 11/2010 Windes et al.
`........ 340/10.42
`2010/0283586 Al * 11/2010 Ikeda et al.
`2010/0313135 Al * 12/2010 Johnson et al.
` 715/738
`2010/0325552 Al * 12/2010 Sloo et al.
` 715/738
`2011/0007901 Al *
`1/2011 Ikeda et al.
` 380/270
`2011;0014972 Al *
`1/2011 Herrmann et al.
` 463/25
`2011/0030020 Al
`2/2011 Halttunen
`2011;0035692 Al" 2/2011 Sandone et al.
`2011/0060998 Al * 3/2011 Schwartz et al.
`2011/0090898 Al * 4/2011 Patel et al.
`2011/0107227 Al *
`5/2011 Rempell et al.
` Al*
`2011/0125594
`5/2011 Brown et al.
` Al*
`2011/0138354
`6/2011 Hertenstein et al.
`
` 715/716
` 715/738
` 726/12
`
` 705/27
`
` 715/720
`715/738
` 707/769
`
` 715/769
` 715/738
` 370/352
` 715/738
` 705/14.73
`...... 717/115
`
`2011/0156879 Al * 6/2011 Matsushita et al.
`2011/0161396 Al * 6/2011 Filbrich et al.
`2011/0214148 Al* 9/2011 Gossweiler et al.
`2011/0228768 Al * 9/2011 Gelter et al.
`2011/0231265 Al * 9/2011 Brown et al.
`2011/0231565 Al * 9/2011 Gelter et al.
`2011/0231566 Al * 9/2011 Gelter et al.
`2011/0289419 Al* 11/2011 Nil et al.
`2011/0296454 Al* 12/2011 Xiong et al. . .....
`2011/0296465 Al
`12/2011 Krishnan et al.
`2012/0072846 Al * 3/2012 Curtis
`.....
`2012/0110464 Al* 5/2012 Chen et al.
`2012/0166560 Al * 6/2012 Nobori et al.
`
`340/10.1
`709/203
`725/46
`370/389
`705/14.73
`709/231
`709/231
`715/738
`725/30
`
`715/738
`715/738
`709/206
`
`CN
`CN
`CN
`
`FOREIGN PATENT DOCUMENTS
`101577650
`1 1/2009
`101778198
`7/2010
`101815073
`8/2010
`
`OTHER PUBLICATIONS
`
`Webopedia computer dictionary, session cookie.*
`Webopedia computer dictionary, web identifier.*
`Webopedia computer dictionary, user session.*
`www.vbulletin.com, Best way to generate Random, Unique ID's.*
`www.vbulletin.com, Best way to generate Random, Unique ID's,
`Internet Archive Wayback Machine, Jan. 16, 2009.*
`webopedi a-com—sessi on 4 denti fier—Nov. 19, 201 1.*
`www-vbulletin.com—best-way-to-generate-random-un que-ses-
`sion-ids—Nov. 19, 2011.*
`www-vbulletimcom—best-way-to-generate-random-unique-ses-
`sion-ids-wayback-archive Nov. 19, 2011.*
`ask—search—q—mobile+device+server+display+device&qs.*
`Ask—Search—q=session-Fidentifier-Frandom&qsrc=0&o=08d—
`Nov. 19, 2011.*
`webopedia-corer—session cookie—Nov. 19, 2011. *
`webopedia-com—user session—Nov. 19, 2011.*
`Ask Search Internet Search, session identifier random, printed on
`Nov. 19, 2011.
`Webopedia computer dictionary, session cookie. printed on Nov. 19,
`2011.
`Webopedia computer dictionary, web identifier, printed on Nov. 19,
`2011.
`Webopedia computer dictionuy, user session, printed on Nov. 19,
`2011.
`www.vbulletin.com, Best way to generate Random, Unique ID's,
`printed on Nov. 19. 2011.
`Officials communication from the USPTO in U.S. Appl. No.
`13/245,001, dated Dec. 8, 2011.
`U.S. Appl. No. 13,245,001, filed Sep. 26, 2011.
`Bachman, M., "Snapstick's Media Streaming App/Box: Hands on,"
`www.pcmag.com;article2/0,2817,2375455,00.asp, 2 pages, (Jan. 8,
`2011).
`Dolcourt, J., CES: Snapstick takes on Apple TV, Goggle TV, http://
`news.cnet.com/8301-17938_105-20025100-1.html, 3 pages, (Dec.
`9, 2010).
`Shaivitz, M., "The Web to Your TV, With a Flick of a Wri st? Slapstick
`Says Yes," http://techcocktail.comithe-web-to-our-tv-with-a-flick-
`of-a-wrist-slapstick-says-yes-2010-12, 2 pages, (Dec. 10, 2010).
`Snapstick Home, "Snapstick," http://www.snapstick.com/, 2
`pages, printed on Mar. 2, 2011.
`Paul, I., Hands on: YouTube Leanback, PCWORLD, http://www.
`pcworld.comarticle/200769/hands on youtube leanback.html, 3
`pages, (Jul. 9, 2010).
`Using AirPlay, Article HT4437, hfip://supporLapple.com/kb/
`HT4437, 3 pages, (Apr. 18, 2011).
`Cheng, J., "Stream AirPlay video to regular TV? Apple might make
`it happen," hfip://arstechnica.com/apple/news/2011/03/stream-air-
`play-video-to-a-regular-tv-apple-migh . . , 1 page, printed on Jun. 7,
`2011.
`"Using the Play To Feature to stream media," http://windows.
`micro soft. comien-US/windows7/using-the-play-to-feature-to -
`stream-media, 3 pages, printed on Jun. 7, 2011.
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 4 of 21 PageID #: 812
`
`US 8,356,251 B2
`Page 3
`
`"YouTube Leanback," http://www.youtubescom/t/leanback,
`page, printed on Jun. 7, 2011.
`"Yahoo!7 TV Guide for iPhone, iPod touch and iPad on the iTunes
`App
`Store,"
`http://itunes.apple.com/au/app/yahoo-7-tv-guide/
`id42471992?mt=8, 2 pages, printed on Jun. 7, 2011.
`Hu, C., et al., "Mobile Media Content Sharing in UPnP-Based Home
`Network Environment," Journal of Information Science and Engi-
`neering 24, 1753-1769. (2008).
`
`1
`
`Fallahkhair, S.. et al., "Dual Device User interface Design for Ubiq-
`uitous Language Learning Mobile Phone and Interactive Television
`(i TV)," Proceedings of the 2005 IEEE Int'l Workshop on Wireless an
`Mobile Technologies in Education. 8 pages, 2005.
`
`* cited by examiner
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 5 of 21 PageID #: 813
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 1 of 9
`
`US 8,356,251 B2
`
`24
`
`26'\
`
`API Adapter
`
`Server System
`
`28
`
`Switchboard
`
`34-\
`
`36- \
`
`32-\
`
`Database
`
` Look-up
`Table
`
`Database
`
`23-.‘
`
`20-\
`r
`
`e=5
`
`q
`
`0
`
`O
`
`I
`
`I
`
`o
`
`1:3
`
`V,s.
`
`.141
`
`30-\
`
`21
`
`Internet
`
`Content Providers
`
`FIG. 1
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 6 of 21 PageID #: 814
`
`1-ualud •S•9
`
`CM 'SI .1-1Uf
`
`6 Jo Z JamIS
`
`ZS ISZ`9S£`8 SR
`
`FIG. 2
`
`Display Device Database
`
`Message Copied to
`
`(-122
`
`Universal API Adapter
`120Th
`
`from Smart Phone
`Message Received
`
`t
`
`1121
`
`Account Verification
`
`114-
`Smart Phone Database
`
`a
`
`Message Added to
`
`1161
`
`ISwitchboard
`
`Target Verification
`
`1181
`
`Back-end Servers
`
`Display Device Executes
`
`New Message
`
`V
`
`128Th
`
`New Message Received
`
`by Display Device
`
`126
`Database for New Messages
`
`Display Device Checks
`
`Presentation of Video
`130Th
`
`Play/Pauseiffwd/etc.„
`
`Load New Video
`
`Switch Video Player
`
`124--•\
`
`Display Device
`
`Selection Sent to Database
`10Th
`
`V
`
`•1
`
`Action Selected
`
`108Th
`
`Display List of Videos
`
`106
`
`Request Video Data
`
`1021
`
`Start App
`
`Smart Phone
`
`22Th
`
`Lylideo Player
`401
`
`I Video Files
`421
`XML Data File
`104Th
`Content Providers
`
`Cnrifon# PrevirlArc
`tuttrint Prrivirinrq
`
`24Th
`
`20Th
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 7 of 21 PageID #: 815
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 3 of 9
`
`US 8,356,251 B2
`
`Transmission Code
`UserlD' TargetlD Media PlayerlD Command Data
`
`
`
` FIG. 3
`
`Single Connection Look-up Table
`User -
`Smartphone
`
`Display Device
`
`2
`1
`3
`4
`
`A
`C
`D
`B
`
`FIG. 4
`
`26
`
`Universal API Adapter
`Universal Command MediaPlayerlD Specific Player Command
`New Video
`ytioadVideo
`YouTube
`Ted.com
`getVideo
`Vimeo
`loadNewVideo
`yt_pauseVideo
`YouTube
`pauseVideo
`Ted.com
`pause
`Vimeo
`FIG. 5
`
`Pause
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 8 of 21 PageID #: 816
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 4 of 9
`
`US 8,356,251 B2
`
`Yes
`
`Is
`the Media Player that
`is Needed to Play the Video
`Already Loaded in the
`Display Device
`
`0
`
`Request and Obtain a
`Copy of the Appropriate
`Media Player and a Copy
`of the Video File from
`Content Provider
`
`Load the Media Player
`
`Yes
`
`Is
`a Copy of the
`Video Already Loaded in
`the Display Device
`
`Obtain a Copy
`of the Video
`
`Play the Video
`
`FIG. 6
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 9 of 21 PageID #: 817
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 5 of 9
`
`US 8,356,251 B2
`
`22
`
`Display Device
`
`Splash Page
`
`48-\
`435-05-342
`FIG. 7A
`
`Sync-code
`
`IP Address
`169.343.231.234
`
`Sync-code Look-up Table
`Cookie
`erjg988dhuj
`FIG. 7B
`
`Sync-code
`435-05-342
`
`Display Device
`
`22
`
`Display Device
`
`22
`
`Smart Phone
`
`Smart Phone
`
`20
`
`FIG. 8
`
`20
`
`(A)
`
`Smart Phone
`20
`(B)
`
`FIG. 9
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 10 of 21 PageID #: 818
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 6 of 9
`
`US 8,356,251 B2
`
`1•
`
`Display Device
`
`22
`
`Z
`
`Smart Phone
`
`2.Q.
`
`Moderator
`
`I N
`
`Smart Phone
`
`Smart Phone
`
`20
`
`20
`
`Control of
`Display
`
`FIG. 10
`
`Display Device
`
`I Display Device
`
`22
`
`
`
`I
`
`
`
`22
`
`\
`/
`Smart Phone
`
`20
`
`FIG. 11
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 11 of 21 PageID #: 819
`
`U.S. Patent
`
`Jan. 15, 2013
`
`Sheet 7 of 9
`
`US 8,356,251 B2
`
`Display Device
`
`Display Device
`
`Display Device
`
`22
`
`22
`
`22
`
`Smart Phone
`
`Smart Phone
`
`Smart Phone
`
`20
`
`ZQ
`
`20
`
`Moderator
`
`Control of
`Display
`
`FIG. 12
`
`Display Device
`
`22
`
`I
`
`Smart Phone
`
`All--..
`
`..
`
`Third Party
`
`.,
`
`Display Device
`
`22
`
`1
`
`Smart Phone
`
`20
`
`20
`
`Playlist and Video Links
`
`FIG. 13
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 12 of 21 PageID #: 820
`
`1-ualud •S•9
`
`CM 'SI .1-1Uf
`
`6 Jo 8 JamIS
`
`ZS ISZ`9S£`8 SR
`
`FIG. 14C
`
`FIG. 14B
`
`FIG. 14A
`
`0
`
`0
`
`0
`
`AD SPACE
`
`MENUICHANNELSIPLAYLISTISEARCH
`
`HEADER
`
`friend's laptop 0'
`living-room PC 0
`0
`
`my laptop
`
`'DISPLAY 1 IDISPIAY 3IISPIAY 4
`DIM
`
`CONTROL PANEL
`
`[DISPLAY 1)
`
`}
`
`0
`
`(L..
`
`FOOTER
`
`L
`
`
` J
`
`SEND
`
`0
`
`devices listed above
`choose fan one of your
`Biter the Sync-oads below or
`
`e
`
`0=1
`
`6
`
`
` }
`
`FOOTER
`
`SPLASH PAGE
`
`MENUICHANNELSIPLAYLISTISEARCH
`
`HEADER
`
`)
`
`(f
`
`I
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 13 of 21 PageID #: 821
`
`luaiud •S•9
`
`CM 'SI .1-1Uf
`
`6 Jo 6 JamIS
`
`ZS ISZ`9S£`8 SR
`
`FIG. 15
`
`SEND
`
`* = Control of Display Device
`" = Group Moderator,
`
`B"*,E
`A",C*,D
`
`Y
`X
`
`1 , 3
`2
`
`Smartphone
`
`User -
`
`Device Group
`Display
`
`Group Connection
`
`Look-up Table
`
`FIG. 14E
`
`FIG. 140
`
`0
`
`
` )
`
`( n
`FOOTER
`MORE INFO... 1, ,.-
`OPTION I
`
`AD SPACE
`
`NOW PLAYING
`
`-%\
`
`0
`
`(
`
`1
`
`klE I (GUEST 11I GUEST 2 IGUEST 3 'GUEST
`DISPLAYS
`
`CONTROL PANEL
`
`\
`
`)
` .
`
`r
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 14 of 21 PageID #: 822
`
`US 8,356,251 B2
`
`1
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`CROSS-REFERENCE TO RELATED
`APPLICATION(S)
`
`This application is a continuation of U.S. application Scr.
`No. 13/157,821, filed on Jun. 10, 2011, which in turn claims
`the benefit of priority of U.S. Provisional Patent Application
`No. 61/477,998, filed on Apr. 21, 2011.
`
`BACKGROUND
`
`This disclosure relates to play control of content on a
`display device. Such display devices include, for example,
`television displays used by consumers in their home for view-
`ing videos and other media that are either provided from the
`Web or previously stored. In particular, the disclosure relates
`to the creation, storage, manipulation and access of media
`playlists used in conjunction with display devices and control
`of the display devices.
`Web media often is played on computers rather than tele-
`vision displays. Although it is known to connect a computer to
`a television set in order to watch Web media, it is difficult to
`control such a system within the typical scenario for televi-
`sion watching where the viewer is positioned some distance
`from the television. Furthermore, although a wireless device
`can enable the user to control the television from a distance, it
`can be difficult to view a web browser display on the televi-
`sion set and may interfere with normal television program
`viewing by other persons.
`Given the desire to watch various World Wide Web media
`on a family's primary television set, and to control this opera-
`tion from the comfort of one's couch, there is a need to
`operate a television set or other display remotely from a
`personal computing device, such as a mobile phone. It also is
`desirable to allow a user to perform a general Web search to
`locate and capture Web media, and to control a television or
`other display remotely using the personal computing device.
`
`SUMMARY
`
`Various aspects of the invention are set forth in the claims.
`For example, according to one aspect, a system for present-
`ing and controlling content on a display device includes a
`network. a server system coupled to the network and com-
`prising one or more servers, a display device coupled to the
`network and having a display, and a personal computing
`device operable to transmit a first message according to a
`specified format over the network to the server system. The
`server system stores an association between the personal
`computing device and the display device. The first message
`identifies user-selected content and a media player to play the
`content. The server system is operable, in response to receiv-
`ing the first message from the personal computing device, to
`provide to the display device a second message identifying
`the user-selected content and the media player to play the
`content. In response to receiving the second message, the
`display device is operable to obtain a first media player
`needed to play the content, to load the media player and to
`present the content on the display.
`In some implementations, the display device is operable, in
`response to receiving the second message, to obtain the first
`media player from the content provider only if the first media
`player is not already loaded in the display device.
`In some implementations, the personal computing device
`is operable to transmit a message according to a specified
`
`5
`
`2
`format over the network to the server system. The message
`can include a command for controlling playing of the content
`on the display device. The server system is operable, in
`response to receiving the message, to convert the command
`into a corresponding command recognizable by the media
`player if the command received from the personal computing
`device is not recognizable by the media player. The server
`system is operable to provide to the display device a message
`that includes the corresponding command, and the display
`device is operable, in response to receiving the message from
`10 the server system, to execute the command.
`In some implementations, the personal computing device
`is, for example, a mobile phone, and the display device is a
`television set. Other personal computing devices or display
`devices can be used in other implementations. The network
`15 can include, for example, the Internet.
`In some implementations, the server system stores a look-
`up table that includes a synchronization code uniquely asso-
`ciated with the display device. A message from the personal
`computing device cm include the synchronization code, and
`20 in response to receiving the message from personal comput-
`ing device, the server system can use the synchronization
`code and the look-up table to identify the display device on
`which the content is to be played. The synchronization code
`can be different from an IP address associated with the dis-
`25 play device and/or a media access control address associated
`with the display device.
`In various implementations, the system can facilitate
`allowing a personal computing device to be used to select
`different content to be played on a remote display even if
`different media players are required to present the different
`content. The system also can allow the user to control how the
`content is displayed on the display device using the personal
`computing device. For example, user-initiated play com-
`mands can be passed from the user's personal computing
`device. through the server system, to the display device.
`35 Other aspects, features and advantages will be apparent
`from the following detailed description, the accompanying
`drawings, and the claims.
`
`30
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`40
`
`45
`
`50
`
`FIG. 1 is a block diagram illustrating an example of a
`system according to the invention.
`FIG. 2 illustrates various details of the flow of information
`and signals according to some implementations.
`FIG. 3 illustrates an example of a transmission code incor-
`porated into a message from a personal computing device.
`FIG. 4 illustrates an example of a look-up table that forms
`part of a server system.
`FIG. 5 illustrates an example of entries in a universal API
`adapter.
`FIG. 6 is a flow chart showing steps for display device to
`load a video player and video.
`FIG. 7A illustrates an example of a display device includ-
`ing a synchronization code.
`FIG. 713 illustrates an example of a synchronization code
`55 look-up table.
`FIGS. 8-13 illustrate examples of various scenarios in
`which the invention can be used.
`FIGS. 14A through 14E illustrate examples of display
`screens that may appear on a user's personal computing
`60 device in accordance with the invention.
`FIG. 15 illustrates further information that can be stored in
`the look-up table in the server system.
`
`DETAILED DESCRIPTION
`
`65
`
`As shown in FIG. 1, a system 10 facilitates synchronizing
`a connection between two or more devices 20, 22 connected
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 15 of 21 PageID #: 823
`
`US 8,356,251 B2
`
`3
`to the Internet 21 or other computer network. The connection
`is designed to be made by a first device (e.g., a personal
`computing device) 20 that acts as a controller and a second
`device (e.g., a television set 22 with a display 23) that acts as
`a receiver to play content selected by a user of the first device
`and to respond to commands that originate at the personal
`computing device. The personal computing device 20 is oper-
`able to display an application or web site that contains infor-
`mation and links to content providers 30 on the Internet 21.
`The television set 22 is operable to link back to a server
`system 24 from which the television set receives commands.
`When a user makes a selection using the personal computing
`device 20 for particular content to be displayed on the televi-
`sion display 23, a signal is sent through the Internet (or other
`network) 21 to the server system 24. A corresponding com-
`mand signal then is passed along to the connected television
`set 22, which acts on a transmission code contained within the
`signal and performs specified commands. For example, in
`some scenarios, the command instructs the television set 22 to
`access a content provider 30 through the Internet 21, load a
`specific media player, load the media player-specific content
`(e.g., a video) and play the content on the television display
`23. The user can use the personal computing device 20 to
`control how the content is played on the television display 23.
`The user may subsequently visit the same or another Web site
`using the personal computing device 20 to select different
`content (e.g., a second video) to be played on the television
`display 23. In that case, another signal would be sent through
`the server system 24 to the television set 22. A transmission
`code associated with this command signal instructs the tele-
`vision set 22 to load a new media player (if needed) over the
`Internet and to load the specified video file to be played on the
`display 23. Thus, the system 10 allows a personal computing
`device 20 to be used to select different content to be played on
`a remote display 23 even if different media players are
`required for the different content. The user also can control
`how the content is displayed (e.g.. play, pause, stop, rewind,
`fast forward, etc.) on the display 23 using the personal com-
`puting device 20. The user-initiated play commands are
`passed from the user's personal computing device 20,
`through the server system 24, to the television set 22.
`Although the following detailed discussion describes vid-
`eos as an example of the type of content to be played on the
`display 23, the system 10 can be used for other types of
`content as well. Thus, depending on the implementation, the
`content may include one or more of the following: video,
`audio, interactive video game, streaming media, multimedia,
`images, slides (e.g., a PowerPoint presentation) or other types
`of dynamic content. Furthermore, in the following discus-
`sion, it is assumed that the personal computing device 20 is a
`mobile phone that includes a display, an internal micropro-
`cessor or other processing circuitry, a keypad, keyboard,
`touchscreen. mouse, trackball, or other device to receive user
`selections and other input, and a transceiver to establish com-
`munications to the Internet 21 or other communications net-
`works. More generally, however, the personal computing
`device 20 can be any type of handheld or other Internet-
`enabled personal computing device, including personal com-
`puters, e-books, kiosks, tablets, smart phones, media players,
`and motion and touch sensory interfaces. In some cases, input
`from the user can be received in forms other than tactile input
`(e.g., acoustic or speech).
`FIG. 2 illustrates further details of the flow of information
`and signals according to some implementations. The personal
`computing device (e.g., mobile phone) 20 is operable to dis-
`play an application or web site that contains information and
`links to content providers 30 on the Internet 21. The user
`
`4
`operates the mobile phone 20 so as to start the application or
`access the web site (block 100). In some implementations, a
`logo appears on the mobile phone's display. By selecting the
`logo, the user causes a menu to expand and present various
`5 options. The options can include, for example: (i) add new
`content to a playlist. (ii) play a listed item on a secondary
`device. (iii) play a listed item on the mobile phone 20. If the
`user selects to add new content to the playlist, the user is
`presented with a screen that allows him to enter user-defined
`to search parameters or to select predefined search parameters to
`request video data. The search parameters are sent from the
`mobile phone 20 as part of a request for video data that satisfy
`the search parameters (block 102). The request is transmitted
`via the Internet 21 and through the server system 24 to the
`15 appropriate content provider web site. In response, the con-
`tent provider 30 provides metadata (e.g., titles, links to the
`videos) for one or more video files that satisfy the search
`parameters (block 104). The metadata can be provided to the
`mobile phone 20, for example, in the form of an XML data
`20 file. Upon receiving the data file, the mobile phone 20 dis-
`plays a list of one or more videos based on the information
`received from the content provider 30 (block 106).
`If desired, the user can take one of several actions, includ-
`ing selecting one of the videos from the displayed list to be
`25 played on the television display 23 or initiating a command
`with respect to a video that already has been loaded to the
`television set 22 (block 108). The mobile phone 20 then
`formats and transmits a message to the server system 24
`(block 110). The message from the mobile phone 20 contains
`30 a transmission code that includes data regarding the user
`information (e.g., user identification or account number), the
`secondary display it wants to connect to (e.g., television set 22
`with display 23), the location and name of the media player
`for the selected video, the command (e.g., play, pause,
`35 rewind, etc.), and the video file to be acted upon. An example
`of the format of a transmission code from the mobile phone 20
`to the server system 24 is illustrated in FIG. 3. Different
`formats and/or different information may be appropriate for
`other implementations.
`The message from the mobile phone 20 is transmitted over
`the Internet 21 and is received by the server system 24 (block
`112). Based on information in the message from the mobile
`phone 20, the server system 24 verifies that the user has an
`account (block 114), and the contents of the message, as well
`45 as the date and time of receipt of the message, are added to a
`personal computing device database 32 (block 116) which
`forms part of a switchboard 28. In general, all messages from
`a particular user's personal computing device 20 are stored in
`the database 32 corresponding to an account for the particular
`50 user. Thus, the database 32 stores a record of all messages
`received from a user's personal computing device 20, as well
`as the user's identification, an indication of the target device
`22, an identification of the media player that is required for the
`selected video, and an identification of the selected video.
`The switchboard 28 also includes a look-up table 34 that
`stores a correspondence between a particular personal com-
`puting device (such as mobile phone 20) and target devices
`(e.g., the television set 22) to which the user command is
`directed. An example of the look-up table 28 is illustrated in
`60 FIG. 4. In this example, it is assumed that, at most, a single
`connection is established at any given time between a particu-
`lar mobile phone and a display device. IIowever, as explained
`below, other scenarios are also possible to establish group
`connections (e.g., multiple mobile phones connected to the
`65 same display device). The server system 24 performs a target
`verification (block 118), which includes checking whether a
`connection to a particular display device already is estab-
`
`40
`
`55
`
`

`

`Case 2:23-cv-00059-JRG Document 30-1 Filed 03/28/24 Page 16 of 21 PageID #: 824
`
`US 8,356,251 B2
`
`5
`li shed for the mobile phone 20 and. if so, checking the iden-
`tification of the display device. During the target verification,
`if the look-up table indicates that there is no connection
`established between the mobile phone 20 and a particular
`display device, then the server system 24 sends a message to
`the mobile phone 20 to prompt the user to identify the device
`on which the video is to be displayed.
`A user can identify the device on which the video is to be
`displayed in one of several ways, depending on the imple-
`mentation. In some implementations, the user can select the
`display device from a list of devices displayed on the mobile
`phone 20. The list can include a field populated with names or
`identifications of display devices that previously have been
`initialized for connection. Alternatively, the user can select
`the display device by entering a synchronization code
`uniquely associated with the particular display device. As
`illustrated in FIG. 7A, the synchroniz