8416456
`
`September 26, 2023
`
`THIS IS TO CERTIFY THAT ANNEXED IS A TRUE COPY FROM THE
`RECORDS OF THIS OFFICE OF THE FILE WRAPPER AND CONTENTS
`OF:
`
`APPLICATION NUMBER: 15/687,249
`FILING DATE: August 25, 2017
`PATENT NUMBER: 11048751
`ISSUE DATE: June 29, 2021
`
`Page 1 of 893
`
`Comcast, Ex. 1176
`
`

`

`API Adapter||| Pf ll
`
`aa
`| Database <—+|
`
`
`
`; 26
`
`«>| Database|| |
`
`Page 2 of 893
`
`Page 2 of 893
`
`

`

`cab
`
`
`0}paidogebessey)
`
`
`panje2oyebessayy/MON
`
`&
`
`aonagAedsiq
`
`6Oia
`
`
`
`ssiaaq]Agidsic)Aq
`
`gzi|=
`
`ore
`
`
`saindexgaaiegAgdsiq
`
`abessayyMAK
`
`oapiA10uopeIueseid|
`
`—>[eidepyiaviesienun|ORE
`
`perjeoayabessayy
`
`AUCMEWSLOY
`
`
`—olaseaqered0}wesWO
`sebesseyyMeNJO]eseqereq|SYOBUD
`
`pennonpoh
`B2/Aaq]Aeidsiq
`
`
`jaseqejeqlLWeWS)
`o]peppyabessoyy
`
`
`co—ee|\Zz|qoajes||
`
`__BedoapiAIsenbey|SardSeaWK;Teak|Pol
`|Saycapirl
`
`
`
`SJBAI8SPUBIEG
`
`
`
`UOINSOULIOA,}90I8Zt
`
`PIBOQUOUMS/
`
`
`
`
`
`[iekeig6oapiA|.toeovHF
`
`CaIIL
`
`Page 3 of 893
`
`Page 3 of 893
`
`
`
`
`
`
`
`
`

`

`Transmission Code _
`|
`‘UserlD]Targeti|MediaPlayeriD|
`
`
` User -
`
`di Data
`Smartphone FIG. 4
`26~ | Vimeo
`
`Pause
`
`
`
`yt_pauseVideo
`| YouTube
`‘Tedcom.pauseVideoS~*~S~
`ee‘Vimeo—‘pause
`FIG. 5
`
`Page 4 of 893
`
`Page 4 of 893
`
`

`

`
`
`_-~the Media Player that ~~_
`y;
`“~>
`28." ig Needed to Play the Video
`
`~~. Already Loaded in the _-—-
`
`~~ ~DisplayDevice- —
`Request and Obtain a
`
`
`
`Copy of the Appropriate
`Media Player and a Copy)
`
`of the Video File from |
`
`
`Yes a Copy ofthe
`™,
`
`v
`is
`~
`
`Content Provider
`
`
`
`
`a Video Already Loadeditin >
`
`*, ihe> DIspIBY Device,PO rer ;| _LoadtheMediaPlayer
`
`
` Obtain a Copy |
`
`
`a
`
`s
`
`a
`
`>|
`
`Playthe Video
`
`—|
`
`FIG. 6
`
`Page 5 of 893
`
`|
`
`ofthe Video
`
`|
`
`Page 5 of 893
`
`

`

`Display Device_
`
`Splash Page
`
`a2
`
`
`
`485,
`[435-05-342| ene SYNC-COUE
`
`FIG. 7A
`
`FIG. 76
`
`
`
`Page 6 of 893
`
`Page 6 of 893
`
`

`

`Display Device |
` 22
`Z IN
`20
`
`Moderator
`
`Contral of
`Display
`
`]
`
`FIG. 10
`
`| Display Device |
`
`_Dispiay Device|
`20
`
`|
`
`FIG. 11
`
`Page7 of 893
`
`Page 7 of 893
`
`

`

`| Display Device
`
` | Smart Phone
`20
`I
`
`|
`
`Moderator
`
`Control of
`Display
`
`FIG. 12
`
`
`
`2
`
`
`Playlist and Video Links
`
`FIG. 13
`
`Page 8 of 893
`
`Page 8 of 893
`
`

`

`
`
`
`
`10MOjOGBLO-OUAS449AF
`
`JOA{0OUOweyas
`
`
`
`BADEPalsyseonap
`
`
`
`[©doydeyspuayy
`
`O qwoorBuiay=‘odakaroe
`
`JONHSVIcS
`
`Page 9 of 893
`
`Page 9 of 893
`
`
`
`
`
`
`

`

`aneAgidsiqjojo4uog=,|
`
`SbOd
`
`
`
`UONOeULIO’Y)dnoicy
`
`Bice4dn-y00")
`
`a(S113
`
`i
`
`Page 10 of 893
`
`Page 10 of 893
`
`
`
`
`
`

`

`PTO/AIA/01 (06-12)
`Approved for use through 01/31/2014. OMB 0651-0032
`U.S. Patent and Trademark Office; US. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respondto a collection of information unlessit displays a valid OMB control number.
`
`
`
`The attached application, or
`
`
`
`United States application or PCTinternational application number
`
` DECLARATION(37 CFR 1.63) FOR UTILITY OR DESIGN APPLICATION USING AN
`
`APPLICATION DATA SHEET(37 CFR 1.76)
`
`
`
` PLAY CONTROL OF CONTENT ONA DISPLAY DEVICE
`Title of
`Invention
`
`
`Asthe below namedinventor, | hereby declare that:
`
`
`
`
`This declaration |
`
`is directed to:
`
`
`
`
`
`filed on
`
`
`
`The above-identified application was made or authorized to be made by me.
`
`
`
`| believe that | am the original inventor or an original joint inventor of a claimed inventionin the application.
`
` | hereby acknowledge that anywillful faise statement made in this declaration is punishable under 18 U.S.C. 1001
`
`
`by fine or imprisonmentof not more thanfive (5) years, or both. WARNING:
`
`
`
`
`Petitioner/applicant is cautioned to avoid submitting personal information in documentsfiled in a patent application that may
`contribute to identity theft. Personal information such as social security numbers, bank account numbers, or credit card numbers
`(other than a checkorcredit card authorization form PTO-2038 submitted for payment purposes)is never required by the USPTO
`to support a petition or an application.
`If this type of personal information is included in documents submitted to the USPTO,
`
`
`petitioners/applicants should consider redacting such personal information from the dacuments before submitting them to the
`
`
`USPTO. Petitionerfapplicant is advised that the record of a patent application is available to the public after publication of the
`
`
`application (unless a non-publication request in compliance with 37 CFR 1.213(a) is madein the application) or issuance of a
`
`
`patent. Furthermore, the record from an abandonedapplication may also be available to the public if the application is
`
`
`referenced in a published application or an issued patent (see 37 CFR 1.14). Checks and credit card authorization forms
`
`
`
`PTQ-2038 submitted for payment purposes arenotretained in the application file and therefore are not publicly available.
`
` LEGAL NAME OF INVENTOR
`
`
`
`DAVID STROBER
`Date (Optional) ; AUS 25, 2017
`Inventor:
`
`
`
`ehfence
`Signature: ! ee
`I
`
`
`
`Note: An application data sheet (PTO/SB/14 or equivalent), including naming the entire inventive entity, must accompanythis form or must have
`beenpreviously filed. Use an additional PTO/AIA/01 form for each additional inventor.
`
`This collection of information is required by 35 U.S.C. 115 and 37 CFR 1.63. The information is required to obtain or retain a benefit by the public whichis to file (and
`by the USPTOto process)an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 1 minute to
`complete, inciuding gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending uponthe individual case. Any
`comments on the amountof time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S.
`Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO
`THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`ifyou need assistance in completing the form, cal! 1-800-PTO-9199 and select option 2.
`
`Page 11 of 893
`
`
`
`Page 11 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`ABSTRACT OF THE INVENTION
`
`A system for presenting and controlling content on a display device includes a network, a
`
`server system coupled to the network and comprising one or moreservers, a display device coupled
`
`to the network and having a display, and a personal computing device operable to transmit a first
`
`message according to a specified format over the network to the server system. The server system
`
`stores an association between the personal computing device and the display device. Thefirst
`
`message identifics uscr-sclected content and a media playerto play the content. The server system
`
`is operable, in response to receiving the first message from the personal computing device, to
`
`provideto the display device a second messageidentifying the user-selected content and the media
`
`player to play the content. In response to receiving the second message, the display device is
`
`operable to obtain a first media player needed to play the content, to load the media player and to
`
`present the content on the display.
`
`8327117
`
`Page 27 of 27
`
`Page 12 of 893
`
`Page 12 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`CLAIMS
`
`Whatis claimedis:
`
`1.
`
`A non-transitory computer storage medium storing computer-useable
`
`instructions that, when used by one or more computing devices, cause the one or more computing
`
`devices to perform operations for remotely presenting various types of content, the operations
`
`comprising:
`
`initializing a connection with a remote server device to facilitate an
`
`association with a remote computing device;
`
`receiving, from the remote server device, a first message that includes at
`
`least one commandin a first format, wherein the first message is received based at
`
`least in part on a second messageincludingat least one command in a second format
`
`having been sent from the associated remote computing device;
`
`employing a first media player application operable to load a first piece of
`
`content referenced in the received first message; and
`
`controlling a presentation of the first piece of content
`
`loaded in the
`
`employedfirst media player application based on a first commandin the first format
`
`having been includedin the received first message for recognition by the first media
`
`player application.
`
`2.
`
`The non-transitory computer storage medium of claim 1, wherein a
`
`commandin the second format is a universal command.
`
`8327117
`
`Page 21 of 27
`
`Page 13 of 893
`
`Page 13 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`3.
`
`The non-transitory computer storage medium of claim 2, wherein the first
`
`format is different than the second format.
`
`4,
`
`The non-transitory computer storage medium of claim 1, wherein the
`
`second message is sent to the remote server device.
`
`5.
`
`The non-transitory computer storage medium of claim 1, wherein the at
`
`least one commandin the second format is converted into the at least one commandin thefirst
`
`format based at least in part on the second message including therein a referenceto the first piece
`
`of content.
`
`6.
`
`The non-transitory computer storage medium of claim 1, wherein the at
`
`least one commandin the second format is converted into the at least one commandin thefirst
`
`format based at least in part on a reference to the first media player application having been
`
`included in the second message.
`
`7.
`
`The non-transitory computer storage medium of claim 1, wherein the first
`
`media player application is employed basedat least in part on the received first message including
`
`therein a reference to the first media player application.
`
`8.
`
`The non-transitory computer
`
`storage medium of claim 1, wherein
`
`controlling the presentation includes an execution of the first command.
`
`8327117
`
`Page 22 of 27
`
`Page 14 of 893
`
`Page 14 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`9.
`
`The non-transitory computer storage medium of claim 1, the operations
`
`further comprising:
`
`obtaining the first media player application based on a determinationthat
`
`the first media player application is not already being employed.
`
`10.
`
`The non-transitory computer storage medium of claim 9, wherein the first
`
`media player application is obtained from a content provider that corresponds to the referenced
`
`first piece of content.
`
`11.
`
`The non-transitory computer storage medium of claim 1, wherein the
`
`connection with the remote server device is maintained, for at least a duration that the first media
`
`player application is being employed,to facilitate a change from the first media player application
`
`to a second media player application operable to load a second piece of content referenced in a
`
`second message received from the remote server device.
`
`12.
`
`A computer-implemented method for remotely presenting various types of
`
`content, comprising:
`
`initializing, by a content presentation device, a connection with a remote
`
`server device to facilitate an association between the content presentation device
`
`and a remote computing device;
`
`receiving, by the content presentation device and from the remote server
`
`device, a first message that includes at least one commandin a first format, wherein
`
`the first message is received basedat least in part on a second message including at
`
`8327117
`
`Page 23 of 27
`
`Page 15 of 893
`
`Page 15 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`least one commandin a second format having been sent from the remote computing
`
`device associated with the content presentation device;
`
`employing, while the connection with the remote server device is
`
`maintained, a first media player application operableto load a first piece of content
`
`based at least in part on the first piece of content being referenced in the received
`
`first message; and
`
`controlling, by the content presentation device, a presentation of the first
`
`piece of content loaded in the employed first media player application based on a
`
`first commandin the first format having been included in the received first message
`
`for recognition by the first media player application.
`
`13.
`
`The computer-implemented method of claim 12, wherein the first media
`
`player application is employed basedat least in part on the received first message including therein
`
`a reference to the first media player application.
`
`14.
`
`The computer-implemented method of claim 12,
`
`the operations further
`
`comprising:
`
`obtaining the first media player application based on a determination that a
`
`second media player application is being employed.
`
`15.
`
`The computer-implemented method of claim 12, wherein the first media
`
`player application obtained byretrieving the first media player application from a content provider
`
`associated with the referenced first piece of content.
`
`8327117
`
`Page 24 of 27
`
`Page 16 of 893
`
`Page 16 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`16.
`
`The computer-implemented method of claim 12, wherein the presentation
`
`of the first piece of content loaded in the employed first media player application is controlled
`
`based further on the first command in the first format having been converted, from the second
`
`commandin the second format, for inclusion in the received first message for recognition by the
`
`first media player application.
`
`17.
`
`A content presentation device comprising:
`
`a display;
`
`at least one processor; and
`
`at least one computer storage media storing computer-usable instructions that,
`
`when used bythe at least one processor, cause the at least one processorto:
`
`initialize a connection with a remote server device to facilitate an
`
`associalion between the content presentation device and a remote computing
`
`device, wherein the associated remote computing device is configured to send
`
`messagesthat include at least one command in a second format;
`
`receive, from the remote server device,a first messagethat includesat least
`
`one commandinafirst format based on a second message in the second formatsent
`
`from the associated remote computing device;
`
`employ a first media player application operable to load a first piece of
`
`content referenced in the received first message; and
`
`control a presentation of the first picce of content loaded in the employed
`
`first media player application based on a first commandin the first format having
`
`been included in the received first message for recognition by the first media player
`
`application.
`
`8327117
`
`Page 25 of 27
`
`Page 17 of 893
`
`Page 17 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`18.
`
`The content presentation device of claim 17, wherein a commandin the first
`
`format is recognizable by the first media player application.
`
`19.
`
`The content presentation device of claim 17, wherein the second messageis
`
`sent to the remote server device.
`
`20.
`
`The content presentation device of claim 18, wherein the first media player
`
`application is employed based at least in part on the received first message including therein a
`
`referenceto the first media player application.
`
`8327117
`
`Page 26 of 27
`
`Page 18 of 893
`
`Page 18 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`PLAY CONTROL OF CONTENT ON A DISPLAY DEVICE
`
`CROSS-REFERENCE TO RELATED APPLICATIONS
`
`[0001]
`
`The present application is a continuation of U.S. Application No. 13/532,546, filed
`
`on June 25, 2012, which is a continuation-in-part of U.S. Application No. 13/157,821, filed on
`
`June 10, 2011, which issued on December2, 2014 as U.S. Patent No. 8,904,289, which claimsthe
`
`benefit of priority to U.S. Provisional Patent Application No. 61/477,998, filed on April 21, 2011.
`
`The contents of the earlier applications are incorporated herein by reference.
`
`BACKGROUND
`
`[0002]
`
`This disclosure relates to play control of content on a display device. Such display
`
`devices include, for example, television displays used by consumers in their home for viewing
`
`videos and other media that are either provided from the Web orpreviously stored. In particular,
`
`the disclosure relates to the creation, storage, manipulation and access of media playlists used in
`
`conjunction with display devices and control of the display devices.
`
`[0003]
`
`Web media often is played on computers rather than television displays. Although
`
`it is known to connect a computerto a television set in order to watch Web media,it is difficult to
`
`control such a system within the typical scenario for television watching where the viewer is
`
`positioned some distance from the television. Furthermore, although a wireless device can enable
`
`the user to control the television from a distance, it can be difficult to view a web browserdisplay
`
`on the television set and may interfere with normal television program viewing by other persons.
`
`[0004]
`
`Given the desire to watch various World Wide Web media on a family's primary
`
`television set, and to control this operation from the comfort of one's couch, there is a need to
`
`operate a television set or other display remotely from a personal computing device, such as a
`
`mobile phone.It also is desirable to allow a user to perform a general Websearch to locate and
`
`Page 1 of 27
`
`8327117
`
`Page 19 of 893
`
`Page 19 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`capture Web media, and to control a television or other display remotely using the personal
`
`computing device.
`
`SUMMARY
`
`Various aspects of the invention are set forth in the claims.
`
`For example, according to one aspect, a system for presenting and controlling
`
`[0005]
`
`[0006]
`
`content on a display device includes a network, a server system coupled to the network and
`
`comprising one or moreservers, a display device coupled to the network and having a display, and
`
`a personal computing device operable to transmit a first message according to a specified format
`
`over the networkto the server system. The server systemstores an association between the personal
`
`computing device and the display device. The first message identifies user-selected content and a
`
`media player to play the content. The server system is operable, in response to receiving the first
`
`message from the personal computing device, to provide to the display device a second message
`
`identifying the user-selected content and the media player to play the content. In response to
`
`receiving the second message,the display device is operable to obtain a first media player needed
`
`to play the content, to load the media playerand to present the content on the display.
`
`[0007]
`
`In some implementations, the display device is operable, in response to receiving
`
`the second message, to obtain the first media player from the content provider only if the first
`
`media playeris not already loaded inthe display device.
`
`[0008]
`
`In some implementations, the personal computing device is operable to transmit a
`
`message according to a specified format over the network to the server system. The message can
`
`include a command for controlling playing of the content on the display device. The server system
`
`is operable, in response to receiving the message, to convert the command into a corresponding
`
`command recognizable by the media playerif the command received from the personal computing
`
`Page 2 of 27
`
`8327117
`
`Page 20 of 893
`
`Page 20 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`device is not recognizable by the media player. The server system is operable to provide to the
`
`display device a message that includes the corresponding command, and the display device is
`
`operable, in response to receiving the message from the server system, to execute the command.
`
`[0009]
`
`In some implementations, the personal computing device is, for example, a mobile
`
`phone, and the display device is a television set. Other personal computing devices or display
`
`devices can be used in other implementations. The network can include, for example, the Internet.
`
`[0010]
`
`In some implementations, the server system stores a look-up table that includes a
`
`synchronization code uniquely associated with the display device. A message from the personal
`
`computing device can include the synchronization code, and in response to receiving the message
`
`from personal computing device, the server system can use the synchronization code and the look-
`
`up table to identify the display device on which the content is to be played. The synchronization
`
`code can be different from an IP address associated with the display device and/or a media access
`
`control address associated with the display device.
`
`[0011]
`
`In various implementations,
`
`the system can facilitate allowing a personal
`
`computing device to be used to select different content to be played on a remote display even if
`
`different media players are required to present the different content. The systemalso can allow the
`
`user to control how the content is displayed on the display device using the personal computing
`
`device. For cxample, uscr-initiated play commands can be passed from the uscr's personal
`
`computing device, through the server system,to the display devices.
`
`[0012]
`
`Other aspects, features and advantages will be apparent from the following detailed
`
`description, the accompanying drawings, and the claims.
`
`8327117
`
`Page 3 of 27
`
`Page 21 of 893
`
`Page 21 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`BRIEF DESCRIPTION OF THE FIGURES
`
`[0013]
`
`The present technology is illustrated by way of example, and not by way of
`
`limitation, in the figures of the accompanying drawings.
`
`[0014]
`
`FIG. 1 is a block diagram illustrating an example of a system according to the
`
`invention.
`
`[0015]
`
`FIG, 2 illustrates various details of the flow of information and signals according
`
`to some implementations.
`
`[0016]
`
`FIG. 3 illustrates an example of a transmission code incorporated into a message
`
`from a personal computing device.
`
`FIG. 4 illustrates an example of a look-up table that forms part of a server system.
`
`FIG. 5 illustrates an example of entries in a universal API adapter.
`
`FIG. 6 is a flow chart showing steps for display device to load a video player and
`
`[0017]
`
`[0018]
`
`[0019]
`
`video.
`
`[0020]
`
`PIG. 7A illustrates an example of a display device including a synchronization
`
`code.
`
`[0021]
`
`[0022]
`
`used.
`
`FIG. 7B illustrates an example of a synchronization code look-up table.
`
`FIGS. 8-13 illustrate examples of various scenarios in which the invention can be
`
`[0023]
`
`FIGS. 14A through 14E illustrate examples of display screens that may appear on
`
`a user's personal computing device in accordance with the invention.
`
`[0024]
`
`FIG. 15 illustrates further information that can be stored in the look-up table in the
`
`server system.
`
`8327117
`
`Page 4 of 27
`
`Page 22 of 893
`
`Page 22 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`DETAILED DESCRIPTION
`
`[0025]
`
`As shown in FIG. 1, a system 10 facilitates synchronizing a connection between
`
`two or more devices 20, 22 connected to the Internet 21 or other computer network. The connection
`
`is designed to be made bya first device (e.g., a personal computing device) 20 that acts as a
`
`controller and a second device (e.g., a television set 22 with a display 23) that acts as a receiver to
`
`play content selected by a userof the first device and to respond to commandsthatoriginate at the
`
`personal computing device. The personal computing device 20 is operable to display an application
`
`or website that contains information and links to content providers 30 on the Internet 21. The
`
`television set 22 is operable to link back to a server system 24 from which the television set
`
`receives commands. When a user makesa selection using the personal computing device 20 for
`
`particular content to be displayed onthe television display 23, a signal is sent throughthe Internet
`
`(or other network) 21 to the server system 24. A corresponding command signal then is passed
`
`along to the connected television set 22, which acts on a transmission code contained within the
`
`signal and performs specified commands. For example, in some scenarios, the command instructs
`
`the television set 22 to access a content provider 30 through the Internet 21, load a specific media
`
`player, load the media player-specific content (e.g., a video) and play the content on the television
`
`display 23. The user can use the personal computing device 20 to control how the contentis played
`
`on the television display 23. The user may subsequently visit the same or another Website using
`
`the personal computing device 20 to select different content (e.g., a second video) to be played on
`
`the television display 23. In that case, another signal would be sent through the server system 24
`
`to the television set 22. A transmission code associated with this command signal instructs the
`
`television set 22 to load a new media player (if needed) over the Internet and to load the specified
`
`videofile to be played on the display 23. Thus, the system 10 allows a personal computing device
`
`8327117
`
`Page 5 of 27
`
`Page 23 of 893
`
`Page 23 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`20 to be used to select different content to be played on a remote display 23 even if different media
`
`players are required for the different content. The user also can control how the contentis displayed
`
`(e.g., play, pause, stop, rewind, fast forward, etc.) on the display 23 using the personal computing
`
`device 20. The user-initiated play commandsare passed from the user's personal computing device
`
`20, through the server system 24, to the television set 22.
`
`[0026]
`
`Although the following detailed discussion describes videos as an example of the
`
`type of content to be played on the display 23, the system 10 can be used for other types of content
`
`as well. Thus, depending on the implementation, the content may include one or more of the
`
`following: video, audio, interactive video game, streaming media, multimedia, images, slides (e.g.,
`
`a PowerPoint presentation) or other types of dynamic content. Furthermore, in the following
`
`discussion,it is assumed that the personal computing device 20 is a mobile phonethat includes a
`
`display, an internal microprocessoror other processing circuitry, a keypad, keyboard, touchscreen,
`
`mouse, trackball, or other device to receive user selections and other input, and a transceiver to
`
`establish communications to the Internet 21 or other communications networks. More generally,
`
`however, the personal computing device 20 can be any type of handheld or other Internet-enabled
`
`personal computing device, including personal computers, e-books, kiosks, tablets, smart phones,
`
`media players, and motion and touch sensory interfaces. In some cases, input from the user can be
`
`reccived in forms otherthan tactile input (c.g., acoustic or specch).
`
`[0027]
`
`FIG. 2 illustrates further details of the flow of information and signals according to
`
`some implementations. The personal computing device (e.g., mobile phone) 20 is operable to
`
`display an application or web site that contains information and links to content providers 30 on
`
`the Internet 21. The user operates the mobile phone 20soas to start the application or access the
`
`website (block 100). In some implementations, a logo appears on the mobile phone's display. By
`
`8327117
`
`Page 6 of 27
`
`Page 24 of 893
`
`Page 24 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`selecting the logo, the user causes a menu to expand and present various options. The options can
`
`include, for example: (i) add new contentto a playlist, (ii) play a listed item on a secondary device,
`
`(111) play a listed item on the mobile phone 20.If the user selects to add new content to the playlist,
`
`the user is presented with a screen that allows him to enter user-defined search parameters or o
`
`select predefined search parameters to request video data. The search parameters are sent from the
`
`mobile phone 20 as part of a request for video data that satisfy the search parameters (block 102).
`
`The requestis transmitted via the Internet 21 and through the server system 24 to the appropriate
`
`content provider website. In response, the content provider 30 provides metadata(e.¢., titles, links
`
`to the videos) for one or more video files that satisfy the search parameters (block 104). The
`
`metadata can be provided to the mobile phone 20, for example, in the form of an XML data file.
`
`Uponreceiving the data file, the mobile phone 20 displays a list of one or more videos based on
`
`the information received from the content provider 30 (block 106).
`
`[0028]
`
`If desired, the user can take one of several actions, including selecting one of the
`
`videos from the displayed list to be played on the television display 23 or initiating a command
`
`with respect to a video that already has been loadedto the television set 22 (block 108). The mobile
`
`phone 20 then formats and transmits a message to the server system 24 (block 110). The message
`
`from the mobile phone 20 contains a transmission code that includes data regarding the user
`
`information(c.g., uscr identification or account numbcr), the secondary display it wants to connect
`
`to (e.g., television set 22 with display 23), the location and name of the media player for the
`
`selected video, the command(e.g., play, pause, rewind, etc.), and the video file to be acted upon.
`
`An example of the format of a transmission code from the mobile phone 20 to the server system
`
`24is illustrated in FIG. 3. Different formats and/or different information may be appropriate for
`
`other implementations.
`
`8327117
`
`Page 7 of 27
`
`Page 25 of 893
`
`Page 25 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`[0029]
`
`The message from the mobile phone 20 is transmitted over the Internet 21 and is
`
`received by the server system 24 (block 112). Based on information in the message from the mobile
`
`phone 20, the server system 24 verifies that the user has an account (block 114), and the contents
`
`of the message, as well as the date and time of receipt of the message, are added to a personal
`
`computing device database 32 (block 116) which forms part of a switchboard 28. In general, all
`
`messages from a particular user's personal computing device 20 are stored in the database 32
`
`corresponding to an account for the particular user. Thus, the database 32 stores a record ofall
`
`messages received from a user's personal computing device 20, as well as the user's identification,
`
`an indication of the target device 22, an identification of the media player that is required for the
`
`selected video, and an identification of the selected video.
`
`[0030]
`
`The switchboard 28 also includes a look-up table 34 that stores a correspondence
`
`between a particular personal computing device (such as mobile phone 20) andtarget devices(e.g.,
`
`the television set 22) to which the user commandis directed. An example of the look-up table 28
`
`is illustrated in FIG. 4. In this example, it is assumed that, at most, a single connection is
`
`established at any given time between a particular mobile phone and a display device. However,
`
`as explained below, other scenarios are also possible to establish group connections(e.g., multiple
`
`mobile phones connected to the same display device). The server system 24 performs a target
`
`verification (block 118), which includes checking whether a connection to a particular display
`
`device already is established for the mobile phone 20 and,if so, checking the identification of the
`
`display device. During the target verification, if the look-up table indicates that there is no
`
`comnection established between the mobile phone 20 and a particular display device, then the
`
`server system 24 sends a message to the mobile phone 20 to promptthe user to identify the device
`
`on whichthe video is to be displayed.
`
`8327117
`
`Page 26 of 893
`
`Page 8 of 27
`
`Page 26 of 893
`
`

`

`Nonprovisional Application
`
`Attorney Docket No.: TSTH.278581
`
`[0031]
`
`A user can identify the device on which the videois to be displayed in one of several
`
`ways, depending on the implementation. In some implementations, the user can select the display
`
`device from a list of devices displayed on the mobile phone 20. The list can include a field
`
`populated with namesoridentifications of display devices that previously have beeninitialized for
`
`comnection. Alternatively, the user can select the display device by entering a synchronization code
`
`uniquely associated with the particular display device. As
`
`illustrated in FIG. 7A,
`
`the
`
`synchronization code 48 can be displayed,