IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`In re Patent Application of: Esteban Sardera
`Title: SYSTEMS AND METHODS TO MODIFY PLAYOUT OR PLAYBACK
`
`Attorney Docket No.: 2050.053USl
`Customer No.: 44367
`
`Commissioner for Patents
`PO. Box l4S0
`
`Alexandria, VA 22313-1450
`
`PATENT APPLICATION TRANSMITTAL
`
`We are transmitting herewith the following attached items and information (as indicated with an "X"):
`
`|><
`
`IX[X
`
`Utility Patent Application under 37 CFR l.53(b) comprising:
`X
`Specification (_7_l pgs, including claims numbered I through Q and a I page Abstract).
`X
`Formal Drawings (_2_1 sheets).
`Unsigned Combined Declaration and Power of Attorney (3 pgs).
`Request and Certification Under 35 U.S.C. l22(b)(2)(B)(i) (1 pg);
`
`
`
`25
`
`
`
`The film; fee OT ENCLOSED will be calculated as follows:
`
`— ”°'*"‘°"T
`TOTAL CLAIMS
`33-20 “ x 5000 =
`$3400.00
`INDEPENDENT CLAIMS
`x 200.00 =
`$5000.00
`[]MULTlPLE DEPENDENT CLAIMS PRESENTED W
`BASIC FEE
`$300.00
`
`$200.00
`EXAMINATION FEE
`
`APPLICATION SIZE FEE
`$0.00
`
`$9400.00
`TOTAL
`
`
`
`
`
`
`
`THE FILING FEE WILL BE PAID UPON RECEIPT OF THE NOTICE TO FILE MISSINEARTS.
`;
`SCHVVEGMAN, LUNDBERG, WOESSNER & KLUTI-I, PA.
`By: Wm” 24
`
`J}
`_L Jr];
`
`Customer Number: 44367
`
`Atty: Mark R. Vatuone
`Reg. No. 53,719
`
`Date of Deposit: August 31, ;006
`This paper or fee is being filed on the date indicated above using the USPTO's electronic filing system EFS-Web, and is addressed to The Commissioner for Patents,
`PO. Box 1450, Alexandria, VA 223134450.
`
`NTFX—1002 / Page 1 of 335
`
`
`
`
`
`
`

`
`UNITED STATES PATENT APPLICATION
`
`FOR
`
`SYSTEMS AND METHODS TO MODIFY PLAYOUT OR PLAYBACK
`
`Inventor
`
`Esteban Sardera
`
`Prepared by:
`Schwegman, Lundberg, Woessner & Kluth
`1600 TCF Tower 121 South Eighth Street
`Minneapolis, MN 55402
`(612) 373-6900
`Attomeyfls Docket No. 2050.053US1
`Client Ref. No. OPTV-294fORGfUS
`
`NTFX—1002 I Page 2 of 335
`
`

`
`SYSTEMS AND METHODS TO MODIFY PLAYOUT OR PLAYBACK
`
`FIELD
`
`[0001] Embodiments relate generally to the technical field of communications
`
`and more specifically to systems and methods to modify playout or playback of
`
`primary content.
`
`BACKGROUND
`
`[0002] Many receiving devices such as personal video recorders (PVRS) or
`
`digital video recorders (DVRS) may provide support for trick mode requests that
`
`enable a user to fast forward or rewind content (c. g. primary content). For
`
`example, a user who has recorded a movie on a PVR may fast forward through a
`
`scene while playing the movie. In response to the request, the PVR may render
`
`the movie to a display device at an accelerated speed. Two disadvantages may be
`
`identified in processing the users request to fast forward. First, the content
`
`played out in response to the fast forward request is the same content,
`
`nevertheless played at an accelerated speed. Second, the content played out in
`
`response to the fast forward request may appear jerky and reproduce poorly
`
`making identification of scenes difficult.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`[0003] Embodiments are illustrated by way of example and not limitation in
`
`the figures of the accompanying drawings, in which like references indicate
`
`similar elements and in which:
`
`[0004] Figure 1 is a block diagram illustrating a system, according to an
`
`example embodiment, to modify playout of primary content;
`
`[0005] Figure 2 is a block diagram illustrating a database, according to an
`
`example embodiment;
`
`[0006] Figure 3 is a block diagram illustrating example embodiments of
`
`entertainment secondary information, according to an example embodiment;
`
`[0007] Figure 4 is a block diagram illustrating example embodiments of
`
`advertisement secondary information;
`
`Atty. me. No. 2050.053USl
`
`1
`
`Client Ref. No.0PT§1’T9FgQ[$bl5§§l,lSage 3 0, 335
`
`

`
`[0008] Figure 5 is a block diagram illustrating frames and packets, according
`
`to an example embodiment;
`
`[0009] Figure 6 is a flowchart illustrating a method, according to an example
`
`embodiment;
`
`[0010] Figure 7 is a flowchart illustrating a method, according to an example
`
`embodiment, to identify secondary information based on a trick mode request;
`
`[0011] Figure 8 is a flowchart illustrating a method, according to an example
`
`embodiment;
`
`[0012] Figure 9 is a block diagram illustrating a system, according to an
`
`example embodiment, to modify simulated primary content at a receiving
`
`device;
`
`[0013] Figure 10 is a block diagram illustrating a database, according to an
`
`example embodiment;
`
`[0014]
`
`Figure 11 is a flow chart illustrating a method, according to an
`
`example embodiment, to modify simulated primary content at a receiving
`
`device;
`
`[0015] Figure 12 is a block diagram illustrating a system, according to an
`
`example embodiment;
`
`[0016]
`
`Figure 13 is a block diagram illustrating a database, according to an
`
`example embodiment;
`
`[0017]
`
`Figure 14 is a block diagram illustrating a database, according to an
`
`example embodiment;
`
`[0018]
`
`Figure 15 is a block diagram illustrating a receiving device, according
`
`to an example embodiment;
`
`[0019] Figure 16A is a block diagram illustrating a component transmission,
`
`according to an example embodiment;
`
`[0020] Figure 16B is a block diagram illustrating a component transmission,
`
`according to an example embodiment;
`
`[0021]
`
`Figure 16C is a block diagram illustrating a component transmission,
`
`according to an example embodiment;
`
`[0022]
`
`Figure 16D is a block diagram illustrating a transmission, according to
`
`an example embodiment;
`
`[0023]
`
`Figure 17 is a block diagram illustrating streams associated with a
`
`channel, according to an example embodiment;
`
`Atty. Dkl. No. 2050.053US1
`
`2
`
`Client Ref. No. l'$%ge 4 of 335
`
`

`
`[0024] Figure 18 is a block diagram illustrating the packet, according to an
`
`example embodiment;
`
`[0025]
`
`Figure 19 is a block diagram illustrating a secondary information table,
`
`according to an example embodiment;
`
`[0026]
`
`Figure 20 is a block diagram illustrating primary content and
`
`secondary information communicated in the video stream and the audio stream
`
`of a single channel, according to an example embodiment;
`
`[0027] Figure 21 is a block diagram illustrating primary content
`
`communicated in a first channel and secondary information communicated in a
`
`second channel, according to an example embodiment;
`
`[0028] Figure 22 is a block diagram illustrating the primary content
`
`communicated in a video stream and an audio stream of a channel and the
`
`secondary information communicated in the metadata stream of the same
`
`channel, according to an example embodiment;
`
`[0029] Figure 23 is a block diagram illustrating end of primary content
`
`markers, according to an example embodiment;
`
`[0030] Figure 24 is flowchart illustrating a method, according to an example
`
`embodiment, to modify playback of primary content at a receiving device;
`
`[003]] Figure 25 is a flow chart illustrating a method, according to an
`
`example embodiment, to communicate a transmission that facilitates
`
`modification of playback of primary content at a receiving device;
`
`[0032]
`
`Figures 26 is a diagram illustrating a user interface, according to an
`
`example embodiment;
`
`[0033] Figure 27 is a block diagram of a machine, according to an example
`
`embodiment, including instructions to perform any one or more of the
`
`methodologies described herein.
`
`DETAILED DESCRIPTION
`
`[0034]
`
`In the following description, for purposes of explanation, numerous
`
`specific details are set forth in order to provide a thorough understanding of
`
`example embodiments of the present invention. It will be evident, however, to
`
`one skilled in the art that the present invention may be practiced without these
`
`specific details.
`
`Atty. Dkt. No. 2I]50.053US1
`
`3
`
`Client Ref. No. owiq-gsggogggiipage 5 0, 335
`
`

`
`[0035] Embodiments described below use one of two approaches to respond to
`
`a trick mode request (e.g., fast forward, rewind, skip request). First, a trick mode
`
`request may be responded to by associating primary content to secondary
`
`content and playing out the secondary content on a receiving device, the
`
`secondary content not being derived from the primary content. For example, a
`
`user viewing a movie (e.g., primary content) may select a fast forward button
`
`that causes fast forwarding of the movie; however, instead of viewing the movie
`
`at an accelerated speed, the user may View andfor hear secondary content.
`
`Taking this approach, the author of the secondary content is empowered with
`
`complete editorial control over the secondary content. Accordingly, the author
`
`may create secondary content of the same subject matter as the primary content
`
`or create secondary content of a different subject matter altogether. Further, the
`
`author may create secondary content of the same medium (e.g., audio andfor
`
`video) and presentation (e.g., full motion andfor slide show) of the primary
`
`content or create secondary content of a different medium (e.g., audio andfor
`
`video) and presentation (e.g., full motion andfor slide show). In addition, the
`
`author of the primary content need not be the author of the secondary content or
`
`be legally or otherwise related to the author of the secondary content.
`
`[0036]
`
`Second, a trick mode request may be responded to by associating
`
`primary content to secondary content and playing out the secondary content on a
`
`receiving device, the secondary content being derived from the primary content
`
`but played at a nonnal speed for the secondary content. Taking this approach,
`
`the author of the secondary content is empowered with limited editorial control
`
`over the secondary content because the secondary content is derived from the
`
`primary content. For example, the derivative secondary content may include
`
`selected samples (e.g., audio andfor visual; motion andlor slide show) from the
`
`associated primary content. Further, the secondary content may be played at a
`
`normal speed for the secondary content thereby eliminating the jerkiness and
`
`poor reproduction normally associated with rendering primary content that is fast
`
`forwarded or rewound.
`
`Definitions
`
`[0037]
`
`Primary Content in this document is intended to include content that
`
`may be played on a receiving device or interacted with on a receiving device.
`
`Atty. on. No. 2050.053USl
`
`4
`
`Client Ref. No. opryfiaggodggnghge 6 of 335
`
`

`
`Primary content may include but is not limited to entertainment content and
`
`advertisement content. Further, primary content may include video content
`
`andfor audio content andfor associated metadata-
`
`[0038]
`
`Secondary Content in this document is intended to include content that
`
`may be substituted for primary content responsive to receipt of a trick mode
`
`request (e.g., fast forward, rewind, reverse, etc.). The secondary content may be
`
`played or interacted with on a receiving device. Further, secondary content may
`
`include video content andfor audio content andfor associated metadata.
`
`[0039]
`
`Secondary Information in this document may include secondary
`
`content, information to generate secondary content or information to access
`
`secondary content.
`
`[0040] Derivative Secondary Content in this document is intended to include
`
`secondary content that is generated from the associated primary content. For
`
`example, derivative secondary content may include samples (e.g., audio andfor
`
`visual) from the associated primary content.
`
`[0041] Non-Derivative Secondary Content in this document is intended to
`
`include secondary content that is not generated from the associated primary
`
`content. For example, derivative secondary content does not include samples
`
`(e.g., audio and!or visual) from the associated primary content.
`
`[0042] Normal Speed in this document is intended to include an instantaneous
`
`speed to render a discrete unit of content (e.g., primary content or secondary
`
`content) to an output device, the normal speed being the speed necessary to
`
`completely render the discrete unit of content from beginning to end in a
`
`predetermined play time that is associated with the content. For example, an
`
`episode of Gilligan’s Island may be rendered at a receiving device at a normal
`
`speed such that the episode completes in a predetermined running time (eg,
`
`play time) of twenty-five minutes- Play times may be published with the primary
`
`and secondary content. For example, movies may be stored on media and labeled
`
`with the play time of the movie. A normal speed may be applicable to advancing
`
`the discrete unit of content in forward or reverse directions.
`
`[0043] Accelerated Speed in this document is intended to include an
`
`instantaneous speed to render a discrete unit of content to an output device, the
`
`accelerated speed being any speed greater than the normal speed associated with
`
`Atty. Dkt. No. 2o5o.os3Us1
`
`5
`
`Client Ref. No. oPry.,2F9,ggti33(§r)1,§sag9 7 of 335
`
`

`
`the discrete unit of content. An accelerated speed may be applicable to
`
`advancing the discrete unit of content in forward or reverse directions.
`
`Point to Point Communications
`
`[0044] This section describes aspects of the present disclosure that may be
`
`embodied using point to point communications. For example, point to point
`
`communications may be embodied as a receiving device that requests a video on
`
`demand asset from a video on demand server.
`
`[0045] According to a first example aspect of the present disclosure a request
`
`for primary content may be received at a System. In response, the system may
`
`communicate the primary content to a receiving device that may render the
`
`primary content to an output device at a normal speed of the primary content.
`
`Also, i.n response, the system may associate primary content to secondary
`
`information that is communicated to a receiving device. Next, the receiving
`
`device may receive a request to render the primary content at the receiving
`
`device at an accelerated speed of the primary content (e.g., fast forward, rewind).
`
`In response, the receiving device may use the secondaiy information to render
`
`secondary nomderivotive content to the output device instead of the primary
`
`content.
`
`[0046] According to a second example aspect of the present disclosure
`
`processing is substantially similar as the first example aspect of the present
`
`disclosure except the secondary infonnation may be used to render secondary
`
`derivative content instead of secondary non-derivate derivative content Further,
`
`the receiving device may render the secondary derivative content at a normal
`
`speed for the secondary non—derivative content. For example, the secondary non-
`
`derivative content may include a full motion recording of selected scenes from
`
`the primary content.
`
`[0047] Other embodiments of the first and second aspects may include the
`
`primary content being stored to a storage device at the receiving device before
`
`rendering to the output device, the secondary content being already generated at
`
`the time of the trick mode request, and the secondary content to be generated at
`
`the time of the trick mode request.
`
`[0048] According to a third example aspect of the present disclosure a system
`
`receives a request for primary content. In response to the request, the system
`
`Atty. mu. No. 2oso.o53us1
`
`6
`
`Client Ref. No. orry12F9§gofi,gx,Lgsage 8 of 335
`
`

`
`may communicate the primary content to a receiving device that renders the
`
`primary content to an output device at a normal speed of the primary content.
`
`Next, the system may receive a request from the receiving device to
`
`communicate the primary content for rendering at the output device at the
`
`receiving device at an accelerated speed of the primary content (eg, fast
`
`forward, rewind). In response, the system may associate the primary content to
`
`secondary non-derivative content and communicate the secondary non-
`
`derivative content to the receiving device. Next, the receiving device may render
`
`the secondary non-derivative content to the output device.
`
`[0049] According to a fourth example aspect of the present disclosure
`
`processing is substantially similar as the third example aspect of the present
`
`disclosure except the secondary derivative content may be utilized instead of
`
`secondary non-derivate derivative content. Further, the receiving device may
`
`render the secondary derivative content at a normal speed for the secondary
`
`derivative content.
`
`[0050] Other embodiments of the third and fourth aspects may include the
`
`primary content being stored to a storage device at the receiving device before
`
`rendering to the output device, the secondary content being already generated at
`
`the time of the trick mode request, and the secondary content to be generated at
`
`the time of the trick mode request.
`
`[0051] According to a fourth example aspect of the present disclosure a
`
`receiving device may receive a request for primary content. In response, the
`
`receiving device may render the primary content to an output device at the
`
`receiving device at a normal speed for the primary content. Next, the receiving
`
`device may receive a request to render the primary content to the output device
`
`at an accelerated speed for the primary content (e.g., fast forward, rewind). Next,
`
`the receiving device may receive a simulated primary content at the receiving
`
`device for render to the output device at the receiving device so as to simulate
`
`render of the primary content to the output device at the receiving device at an
`
`accelerated speed (e.g., fast forward, rewind). Next, the receiving device may
`
`generate secondary derivative content based on the simulated primary content.
`
`Finally, the receiving device may render the secondary derivative content to the
`
`output device instead of the simulated primary content. Further, the receiving
`
`Atty. Dkt. No. 205[|.0S3US1
`
`7
`
`Client Ref. No. OPTN7-r2F9§_fQ}B9;y1[Sage 9 of 335
`
`

`
`device may render the secondary derivative content at a normal speed for the
`
`secondary derivative content.
`
`Point to Multi-Point Communications
`
`[0052] This section describes aspects of the present disclosure that may be
`
`embodied using point to multi-point communications. For example, point to
`
`multi-point communications may be embodied using an insertion system that
`
`transmits an Internet Protocol (IP) transport streams in Moving Picture Experts
`
`Group — two (MPEG-2) compression formats to multiple receiving devices (eg,
`
`settop boxes).
`
`[0053] According to a fifth example aspect of the present disclosure a
`
`receiving device receives a transmission that includes primary content and a
`
`secondary information identifier. The receiving device stores the transmission on
`
`a local storage device (e.g. Pause). Next, the receiving device may retrieve the
`
`transmission from the local storage device to render the primary content to an
`output device at the receiving device at a normal speed for the primary content
`
`(e.g., Play). Next, the receiving device may receive a request to render the
`
`primary content to an output device at the receiving device at an accelerated
`
`speed of the primary content (e.g., Fast forward, rewind). Next, the receiving
`
`device may associate the primary content to secondary non-derivative content
`
`based on the secondary information identifier. Finally, the receiving device may
`
`render the secondary non-derivative content to the receiving device.
`
`[0054] According to a sixth example aspect of the present disclosure
`
`processing is substantially similar as the fifth example aspect of the present
`
`disclosure except the secondary derivative content may be utilized instead of
`
`secondary non-derivate derivative content. Further, the receiving device may
`
`render the secondary derivative content at a normal speed for the secondary non-
`
`derivative content.
`
`[0055] Other embodiments of the fifth and sixth aspects may include the
`
`secondary content being already generated at the time of the trick mode request,
`
`the secondary content being generated responsive to the trick mode request, and
`
`the secondary content being retrieved from remote storage rather than local
`
`storage.
`
`Atty. ma. No. 2oso.os3Us1
`
`3
`
`Client Ref.No.OP'mll=52_=t(6b|5(;-/[$15,599 ,0 0, 335
`
`

`
`[0056] According to a seventh example aspect of the present disclosures a
`
`system generates a transmission that includes primary content and a secondary
`
`infonnation identifier. Next, the system communicates the transmission to a
`
`receiving device that may process the transmission according the fifth aspect
`
`described above.
`
`[0057] According to an eight example aspect of the present disclosures a
`
`system generates a transmission that includes primary content and a secondary
`
`information identifier. Next, the system communicates the transmission to a
`
`receiving device that may process the transmission according the sixth aspect
`
`described above.
`
`[0058]
`
`Figure 1 is a block diagram illustrating a system 10, according to an
`
`example embodiment. The system 10 is shown to include a receiving device 12,
`
`a video on demand system 14, and a network 16. The receiving device 12 may,
`
`for example, include a set top box (STB), a personal computer, an iPod, a
`
`personal video recorder (PVR) (e.g., analog or digital input), a personal digital
`
`recorder (PDR) (e.g., analog or digital input), a mobile phone, a portable media
`
`player, a game console or any other device capable of playing video and./or audio
`
`content. The receiving device 12 is shown to be coupled to an output device 13
`
`and a database 22. In an example embodiment, the receiving device 12 may be
`
`operated or controlled with control buttons 19 or a remote control 20. The
`
`output device 18 may include a sound device 24 and a display device 26,
`
`however, it will be appreciated by those skilled in the art that the output device
`
`18 may also include a machine device to communicate machine interface
`
`information (e.g., SGML) to a machine (e.g., client, server, peer to peer). The
`
`network 16 may be any network capable of communicating video andfor audio
`
`and may include the Intemet, closed IP networks such as DSL or FTTH, digital
`
`broadcast satellite, cable, digital, tenestrial, analog and digital (satellite) radio,
`
`etc. andfor hybrid solutions combining one or more networking technologies.
`
`[0059] The video on demand system 14 is shown to include a streaming server
`
`28 a live feed 29, and a database 30. The database 30 that may be a source of
`
`prerecorded primary content 32 and secondary information 34 and the live feed
`
`29 may be a source of live primary content 32 and live secondary information
`
`34. The primary content 32 may be played on the output device 18 at the
`
`receiving device 12. The secondary information 34 may include entertainment
`
`Atty. Dkl. No. 2050.053US1
`
`9
`
`Client Ref. No.e H of 335
`
`

`
`secondary information and advertisement secondary information. The secondary
`
`information 34 may filrther include secondary content 35 that also may be
`
`played on the output device 18 at the receiving device 12. Other embodiments
`
`may include secondary information 34 that may be used to generate secondary
`
`content 35, as described further below.
`
`[0060] The streaming server 28 includes a request module 36 and a
`
`communication module 38. The request module 36 may receive requests from
`
`the receiving device 12. For example, the request module 36 may receive a
`
`request to play primary content 32, a request to fast forward primary content 32,
`
`a request to rewind primary content 32, and a request to pause primary content
`
`32. In one example embodiment, the streaming server 28 and the receiving
`
`device 12 may utilize the real time streaming protocol (RTSP) to communicate.
`
`In another example embodiment the streaming server 28 and the receiving
`
`device 12 may utilize the digital storage media command and control protocol
`
`(DSM-CC) to communicate.
`
`[006l] The communication module 38 may respond to requests received by
`
`the receiving module 218. For example, the communication module 38 may
`
`respond by communicating primary content 32 to the receiving device 12,
`
`communicating a secondary infonnation identifier to the receiving device 12, or
`
`communicating secondary content 35 to the receiving device 12.
`
`[0062] While the system 10 shown in Figure l employs a client-server
`
`architecture, the present disclosure is of course not limited to such an
`
`architecture, and could equally well find application in a distributed, or peer-to-
`
`peer, architecture system. The request module 36 and communication module
`
`38 may also be implemented as standalone software programs, which do not
`
`necessarily have networking capabilities.
`
`[0063] Figure 2 is a block diagram illustrating a database 30, according to an
`
`example embodiment. The database 30 is shown to include an entertainment
`
`asset table 40, and advertisement asset table 42, an entertainment secondary
`
`infonnation table 48, and an advertisement secondary information table 50. The
`
`entertainment asset table 40 includes primary content 32 in the form of
`
`entertainment assets 44 (e.g., video on demand assets). The entertainment asset
`
`44 may be embodied as an audiofvideo asset such as a movie, television program
`
`such as a documentary, a biography, a cartoon, a program, music, or music video
`
`Atty. Dkt. No. 2050.053USl
`
`10
`
`Client Ref. No. 0P'fl‘{g§9_4(Q_fiG.fl.]§Je 12 of 335
`
`

`
`or an audio asset such as music track, audio interview or news program or any
`
`other form of entertainment that may be requested from the receiving device 12.
`
`A particular entertainment asset 44 may be accessed in the entertainment asset
`
`table 40 with an entertainment asset identifier.
`
`[0064] The advertisement asset table 42 includes primary content 32 in the
`
`form of advertisement assets 46 (e.g., video on demand assets). For example, the
`
`advertisement asset 46 may be embodied as a commercial, a public service
`
`announcement, an infomercial or any other fonn of advertisement. A particular
`
`advertisement asset 46 may be accessed in the advertisement asset table 42 with
`
`an advertisement asset identifier.
`
`[0065] The entertainment secondary information table 48 includes secondary
`
`information 34 that includes secondary content 35 that may be embodied as an
`
`entertainment recording 52. For example, the entertainment recording 52 may
`
`include key scenes from a movie that may be presented in fiill motion with
`
`sound thereby enabling the user to easily identify where the user wishes to
`
`resume play. The entertainment secondary information table 48 may include
`
`multiple entertainment recordings 52 that respectively correspond to
`
`entertainment assets 44 in the entertainment asset table 40. Accordingly, a
`
`specific entertainment asset 44 may be associated to a corresponding secondary
`
`information 34 (eg, entertainment recording 52) in the entertainment secondary
`
`information table 48.
`
`[0066] The advertisement secondary information table 50 includes secondary
`
`information 34 in the form of secondary content 35 the may be embodied as an
`
`advertisement recording 54. For example, the advertisement recording 54 may
`
`include an abbreviated fonn of the full length advertisement asset 46. The
`
`advertisement secondary information table 50 may include multiple
`
`advertisement recordings 54 that respectively conespond to advertisement assets
`
`46 in the advertisement asset table 42. Accordingly, a specific advertisement
`
`asset 46 may be associated to a corresponding secondary information 34 (eg,
`
`advertisement recording 54) in the advertisement secondary information table
`
`50.
`
`[0067] The entertainment recordings S2 and the advertisement recordings 54
`
`are respectively shown to include six versions that correspond to types of trick
`
`mode requests to fast forward or reverse (e.g., rewind) primary content 32.
`
`Atty. am. No. 2o5o.o53Us1
`
`11
`
`Client Ref. No. 0P'mlFg2_4{Q§(_;.’,lJ,§3e 13 of 335
`
`

`
`Further the trick mode may specify an accelerated speed to fast forward or
`
`rewind the primary content 32. For example, the request to fast forward or
`
`rewind may be twice-times (e. g., 2X), four-times (e.g., 4X) and six-times (e.g.,
`
`6X) of the normal speed at which the primary content 32 is rendered to the
`
`output device 18. Other example embodiments may include additional or fewer
`
`versions.
`
`[0068] The various versions may correspond to secondary content 35 that has
`
`play times of different duration. For example, secondary content 35
`
`corresponding to twice-times (e.g., 2X), a four-times (e.g., 4X), and six-times
`
`(e.g., 6X) may have play times of 10, 5, and 2 seconds, respectively. Further, it
`
`will be appreciated by a person having ordinary skill in the art that the above
`
`described secondary content 35 may be designed to be played at normal speed or
`
`at any speed within a range of speeds around the normal speed (e.g., accelerated
`
`speeds) to achieve a high quality play out.
`
`[0069]
`
`In some embodiments, the primary content 32 and secondary content
`
`35 may be accompanied with an interactive application that may result in a
`
`presentation to an end user that enables interaction with the user. For example,
`
`an entertainment asset 44 in the form of an episode of “American Idol” may
`
`include an interactive application that may cause a pop-up that enables an end
`
`user to cast a vote. The episode of “American Idol” may further be interleaved
`
`with advertisements assets 46 that may enable the voting to continue while the
`
`advertisement asset 46 is playing. Further, the entertainment asset 44 and the
`
`advertisement recording 54 may be respectively associated with secondary
`
`content 35 (e.g., an entertainment recording 52 and an advertisement recording
`
`54) that may also include interactive applications that may also result in a
`
`presentation to an end user that has an interactive quality. For example, an
`
`entertainment recording 52 associated with the episode of “American Idol” may
`
`include an interactive application that causes a pop-up that presents a current
`
`tally of the previously described vote.
`
`[0070]
`
`Figure 3 is a block diagram illustrating example embodiments of
`
`entertainment secondary information 37. The entertainment secondary
`
`information 37 may include secondary content 35, secondary metadata 58 or a
`
`secondary application 60.
`
`Atty. Dkt. No. 2050.053US1
`
`12
`
`Client Ref. No. oP§"yF;(24g5§g;,gg,§e 14 of 335
`
`

`
`[007]] The secondary content 56 may be immediateiy rendered by the
`
`receiving device 12 to the output device 18 and may be embodied as the
`
`previously described entertainment recording 52 or an entertainment slide show
`
`62. The entertainment slide show 62 may include one or more still images and
`
`sound that be rendered to the output device 18 at the receiving device 12. The
`
`still images may have video effects applied to them, including but not limited to
`
`fade-ins and fade-outs dissolves, splits, wipes, etc.
`
`[0072] The secondary content 35 may include derivative secondary content
`
`and non—derivative secondary content For example, the derivative secondary
`
`content may include samples (e.g., audio and/or visual) from the associated
`
`primary content. In contrast, the non-derivative secondary content does not
`
`include samples (e.g., audio and/or visual) from the associated primary content.
`
`[0073] The secondary metadata 58 may be utilized to generate secondary
`
`content 35 (e.g., an entertainment recording 52 or an entertainment slide show
`
`62). The secondary metadata 58 may be embodied as entertainment recording
`
`metadata 64 and an entertainment slide show metadata 66. The entertainment
`
`recording metadata 64 may be utilized by the communication module 38 or the
`
`receiving device 12 to generate the entertainment recording 52. In addition, the
`
`entertainment slide show metadata 66 may be utilized by the communication
`
`module 38 or the receiving device 12 to generate the entertainment slide show
`
`62. For example, the communication module 38 or the receiving device 12 may
`
`utilize the metadata 72, 74 to identify and collect samples (e.g., audio, visual)
`
`from the associated primary content 32.
`
`[0074] The secondary application 60 may be an application that may be
`
`executed by the communication module 38 or the receiving device [2 to
`
`generate secondary content 56. For example, the secondary application 60 may
`
`include an entertainment application 68 that may be executed by communication
`
`module 38 or the receiving device 12 to generate an entertainment recording 52
`
`or an entertaimnent slide show 62.
`
`[0075] The secondary content 35, secondary metadata 58, and the secondary
`
`application 60 may be prerecorded and stored on the database 30. Further, the
`
`secondary content 35 may be live (e.g., sporting events, election results, etc.) and
`
`communicated to the streaming server 28 from the live feed 29. Accordingly, the
`
`secondary information 34 received from the live feed 302 may include an
`
`Atty. mu. No. 2050.053USl
`
`13
`
`Client Ref. No. oP',qyF;g_4,/