U800810'1786B2
`
`(12) United States Patent
`Sardera
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,107,786 B2
`Jan. 31, 2012
`
`(54) SYSTEMS AND METHODS TO MODIFY
`PLAYOUT 0R PLAYBACK
`
`FOREIGN PATENT DOCUMENTS
`1553593 A2
`7.5200 5
`wry—2005029836 A2
`312005
`
`EP
`we
`
`(75)
`
`Inventor: Esteban Sardera, San Francisco, CA
`(US)
`
`(73) Assignee: Open TV, Ine._. San Francisco, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U-S-C- 15403) by 1436 days-
`
`OTHER PUBLICATIONS
`“European Application Serial No. 0'11 15246.6 ofl'ice action mailed
`Oct. 2’1. 2009”, 3 pgs.
`“PX to test new ad to combat DV'R viewers”, [Online]. Retrieved
`from
`the
`Internet:
`<URL:
`http:.-"1news.com.com-"
`FX+to+test+new+ad+to+combat+DVR+viewers.-"2 100-1024_3-
`6116143.html?tag=nefd.top>, [:Sep. 15, 2005).
`
`(2]) App]. No; 111469,195
`
`* cited by examiner
`
`(22]
`
`Filed:
`
`Aug. 31-. 2005
`
`(65)
`
`Prior Publication Data
`US 200810124052 Al
`May 29, 2008
`
`(51)
`
`Int. Cl.
`HMN 5/935
`(52) U.S.Cl.
`
`(2006.01)
`3861205; 3861203; 3861344; 3861350;
`3861286; 3861343
`3861205.
`(58) Field of Classification Search
`3861203, 343, 344, 350, 286
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`u_s_ PATENT DOCUMENTS
`6,028.?26 A
`2-...2000 Yanagihaia
`6,041.06? A *
`3.12000 Takamorietal.
`............. 3701514
`
`”1.245.664 B1 ’1"
`”11200? Ohnami
`........
`3115124028
`?,3?9.463 B2 *
`512003 Tomita ..................... 370139554
`
`10‘
`
`VIDEO ON DEMAND SYSTEM Hi
`
`Primary Examiner — Helen Shibr‘ll
`('14) Attorney, Agem, or Firm — Schwegman. Lundberg &
`Woessner, P.A.
`
`(57)
`
`ABSTRACT
`
`Systems and methods to modify playout or playback include
`a first and second approach to respond to a trick mode request
`(e.g., fast forward, rewind). First, a trick mode request may be
`responded to by associating primary content to secondary
`content and playing out the secondary content on a receiving
`device, the secondary content not being derived from the
`primary content. Second. a trick mode request may be
`responded to by associating primary content to secondary
`content and playing out the secondary content on a receiving
`device, the secondary content being derived from the primary
`content but played at a normal speed tor the secondary con-
`19111-
`
`7 Claims, 21 Drawing Sheets
`
`_
`_
`[manage
`30
`PRIMRI
`CONTENT
`:12
`
`.
`IMPORT-Two“
`
`
`34
`_
`
`
`seccomnv
`,
`
`Liv: FEED
`29
`PRIMJLRY
`CONTENT
`........3.2......._
`IPFORMm'ION
`SECCNmRIr
`3:.
`
`:
`E
`:
`:
`I
`I
`|
`:
`I
`
`:
`I
`I
`i
`I
`I
`E
`I
`I
`I
`'
`
`I
`.
`I
`i
`;
`'
`;
`I
`-
`:
`.
`;
`
`.........— .
`_ _ __ __:
`seas
`OAT-)2
`..
`..
`.‘r
`
`E
`
`.
`
`..
`
`REQUEST MODULE
`‘96
`cmmNICATIcN
`
`mayLE
`
`'
`
`
`
`REMOTE
`anTFIOL
`
`cum-.11 DEVICE 13
`
`NTFX—1001 1Page 1 of 39
`
`
`
`________________
`
`STREMtIdc SERVER
`{E G..'I1|DEOON DCMFND SERVER]
`28
`
`I
`nae. RI'SF‘t
`
`
`
`
`IEG. mam _._._._._.!__._._._..
`
`—————————————
`RECEIVING new:
`"Em“
`‘2
`
` 16
`
`sound)
`16 G..iNTERNE1. DSL. SAFEuITE. CflBLE.
`{E 6.. senor: 80x.
`DIGITFL IRRESTRIN... 1M SAVE! .ITE RHINO.
`—D' DEVICE
`
`
`
`EXC I
`24
`
`I+
`I insmer LIEUiCE
`
`I
`:
`
`

`

`U.S. Patent
`
`n
`
`OJ1
`
`21
`
`12f
`
`9H11.0198m
`
`m68H...-
`
`a\-1]-aJr2‘.
`
`3Nu
`
`.mmflmikin
`
`nuax.,2.
`
`
`
`
`
`IIIIIIIIIIIIIm0___)m.002.2."..Umx
`
`mm
`
`
`
`NUSmD>Slm_
`
`who—amt
`
`
`
`
`
`IIIIIIIIIIIIIIIIIIIImonEwUSwfl._._...n_._.DOAOmHZDU
`
`0.1mVN2.t“F30WEEemmUSwfl.,._.emDZJOmKCmEDP—MmGm:h_S”_V
`
`
`65$.m._._._._m:qmEx_._¢_x._.wmmxm._.2:99
`
`
`
`
`.398.mujmbam4mm..szmhz.dm:
`"mm
`
`"mm”Emem0232mm200mg;___ow.
`mNJDDOE
`
`"mmbmmmozfiqmmkm
`
` ZO_#40_Z32.200
`
`
`m_:_3005.Pmm.3‘me
`
`
`
`
`EmE_QE
`
`xmogkmz
`
`Tn555024ozo
`
`..E.
`
`
`
`
`
`
`
`mm"hzwhzoo”__EEzOUmmmuu«m__3”_m__29.2592._"ZO_h¢.E.mOuZ_">E¢QZOUmwM_Emazoomm"_uu_2m_uI..........N.m...........I"hfipzooM"hzmhzoo")Edgxn."u">m¢§m1"mamTimmmmmeuiiL.
`
`
`
`3w
`
`GE
`
`FMEDOE
`
`
`
`mm
`
`NTFX—1001 I Page 2 of 39
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 2 of 21
`
`US 8,107,786 B2
`
`
`DATABASE 30
`
`ENTERTAINMENT SECONDARY
`INFORMATION TABLE 48
`SECONDARY INFORMATION 34
`
`ENTERTAINMENT ASSET TABLE 40
`
`PRIMARY CONTENT 32
`
`
`
`E
`E
`
`I
`E
`
`.
`
`ENTERTAINMENT
`ASSET
`44
`
`(ES. VIDEO ON
`DEMAND ASSET)
`
`E
`
`:
`E
`-
`
`E
`
`E
`E
`.
`
`.
`E
`
`I
`E
`
`5—5 .
`'
`E
`E
`
`E
`
`ENTERTAINMENT
`ASSET
`44
`
`[EGH VIDEO ON
`DEMAND ASSET]
`
`
`
`ENTERTAINMENT
`RECORDING
`52
`(5.6., SECONDARY
`CONTENT)
`2X FF VERSION
`4X FF VERSION
`6X FF VERSION
`2X REW VERSION
`4X REW VERSION
`
`5X REW VERSION
`
`4X REW VERSION
`
`ENTERTAINMENT
`RECORDING
`52
`(E.G., SECONDARY
`CONTENT)
`2X FF VERSION
`4X FF VERSION
`6X FF VERSION
`2X REW VERSION
`
`
`
`
`
`
`ADVERTISEMENT ASSET TABLE 42
`ADVERTISEMENT SECONDARY
`INFORMATION TABLE 50
`
`
`
`E"m""IS'R'I—MART'OONTENTSE"""""
`E
`.r-----------------------------------------I
`E
`E
`
`!
`E
`
`E
`E
`
`ADVEE'SSEETMENT
`45
`
`E
`i
`
`(5.6.. VIDEO ON
`DEMAND ASSET)
`
`E
`E
`'
`
`'
`I
`I-------------------------------------------
`
`'
`
`E
`
`I
`
`E
`
`E
`
`I
`
`ADVERTISEMENT
`ASSET
`45
`(56.. VIDEO ON
`DEMAND ASSET)
`
`.
`
`I
`
`
`
`
`
`
`i
`E
`E
`
`E
`E
`
`E
`E
`E
`E
`
`E
`E
`
`I
`E
`
`E
`E
`
`"SEE—ONDARTENFORIJIATIONSZ"
`ADVERTISEMENT
`RECORDING
`54
`(E.G., SECONDARY
`CONTENT)
`2x FF VERSION
`4x FF VERSION
`6X FF VERSION
`2x REw VERSION
`4x REW VERSION
`6X REW VERSION
`
`-
`
`
`
`
`ADVERTISEMENT
`RECORDING
`54
`(E_G., SECONDARY
`__________o.QIIIENII________
`2" FF VERS'O”
`ex FF VERSION
`4X FF VERS'ON
`2x REw VERSION
`4x REW VERSION
`6X REw VERSION
`
`
`
`
`
`
`
`
`
`
`Fl GU R E 2
`
`NTFX—‘I 001 I Page 3 of 39
`
`

`

`U.S. Patent
`
`Jan.31,2012
`
`Sheet30f21
`
`US 8,107,786 B2
`
`
`
`
`
`
`
`
`
`Om.ZD_H¢U_._n_n?_>I<DZOONMumd.._.<D(._.m_2>w—(DZOUMW\Am)_._.4__)mwmwo7.0202d.m>_._.da;_fiwn_.m.£
`
`
`
`
`
`
`
`no,
`
`
`
`\x.mmHEMP—.200>w—4DZOUmm
`
`
`
`
`
`.....wfifimfifim$WamhzmizgmwhzmEmgzimmpzmmEmzzEEEzmszézimmpzm_.__5..
`
`
`
`
`
`zo_._.(o_._n_n?__301wmafimOzfimoommm301mwhimOZEEOme
`
`
`
`
`
`
`
`
`205mm;tém205%.:t5205mm.)t5m205%:2mmm205mm.)3mxm20.9mm“;tx.“m20.9.9,t5.206mm,)txw":9metxmszmm;H:xmzOEmmStxamgamma,”EVa205%.;“Ixm206mm,;..Exm205mm;..EXvm33w-206%;u...5:m........._.,_.flmmmwmmmm
`mmm4._.4n_E.mz£35m:_mmmm
`
`
`
`
`
`gm—mKw“.."06%3mmé_m205%.;25mv82am_Z_Mm...)
`
`
`
`
`
`
`
`
`
`gumx“m299mm;25mVa2065:2mmxmm205%:2mmxmom;zmMm?23xxwm206%.;am:xv2055:2mmx.“m206mm:2mmmnonmmw;fin“w2053;
`
`
`
`
`
`
`
`
`mmmDOE
`
`mm\
`
`
`
`mmEH285.328%
`
`
`
`
`
`r...q
`
`
`
`.....__\\r..:...\\....I5.x..x.\.
`
`
`
`
`
`8zQEQqu\Egzoomm3533m:yfioonum@222me20202,“.3:42me.3.
`
`
`
`
`
`
`
`wimqmfimmFfiomMaEmgmmfimgoa‘mm..zmzwmzxmpfihzmgumzxmfiqEmEmmzxmyoJ.
`
`_u,
`
`.5__..\
`
`
`
`
`
`
` 3mmx“mm205%:3mmxmzo_mmm>3mmxmmm20%meM-.ammwmwfimwmm205E;5mmVGmm765%:Emaxm_m205mm;3mX.»205mm;.smmxwmm55%}Exxvnonmmw»”Mmmom_Honmmw;EM““wm2065;2mmx”zng;2mmxmnzoamm>t62055,;n:xwmm205%.:téom_momM206mm;txw20.2w:..:xu299m:txv2063.;txom_szmm;H:xm_20619”IVazofixmp..:Va__206%;tVa20.2%tx3_205%.)”EXvm.....-..-.-..-.ww............mmH206%.»txmm”29mm?Exm____EE4045:__«29.522Em20:5..qu
`BozmNoammmozamoomm26$53ozazoowm
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`wmK36E
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`NTFX—1001 I Page 4 of 39
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan.31,2012
`
`Sheet4of21
`
`US 8,107,786 B2
`
`mmWEED/an,
`
`meo¢m
`
`HOmQ>rom.
`
`.5204?—
`
`Aoa:«:omvmPMKOJE
`
`Kx,
`
`
`
`AmmmemfiJDEV
`
`ommm§<mu
`
`..____..\
`
`
`
`
`
`
`
`
`mon“vmmoz¢zomwmm02(roMm2<mmm§<mummfiqmu
`
`
`“mozmmmummmmmozmmmmwmmmozmliwm
`
`
`
`
`
`
`mozmmmmmmmozmmmmmm“mozmmmmmm
`
`m§<mum2<mummfiqmu
`mm«mmOz<zomemmoz<zo
`
`wa:aamm............Mmm§<mmmm<qu<hm2m
`
`mmwmfizwum
`
`AmeOOzmv
`
`NTFX—1001 I Page 5 of 39
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 5 of 21
`
`US 8,107,786 B2
`
`8—a
`
`3:...
`
`
`
`vmr.
`
`
`
`
`
`
`
`
`
`
`
`Gang—mama5.01....meflOm—xm_>_wU.n._mwmr
`
`
`
`
`
`DNm—nwIEEZOZ...:—><._n_OhNoam—D
`
`
`
`1?
`
`
`
`
`Em?EmEzEEHzm
`
`
`35.23228a?
`
`NTFX—1001 I Page 6 of 39
`
`
`
`..OEHZOO
`
`wwr,CjaGZGmwmQrmMODE
`
`
`
`whet—ww—wI...ZOZOtDm
`>431
`
`
`u
`
`_
`
`
`
`$2..93Dmuaw
`
`mm;FZMEZEFENHZNmwflzww—024.m.>_m_0m_w_
`
`
`
`
`__.22522$3359659Emma.1|
`
`
`
`02EU
`
`mmeOE
`
`
`
`mex_
`
`
`,2me?uzfimozoowns»9mechmum:
`
`
`HME45.1
`
`,cc.0mg03%44:82
`
`me...i._.m.n_.m_.>.n._.mww.._um6.m._._.mmmw._.2H115Wm._.mm.mm_mzmmmzmm2wmmm.....
`
`
`
`
`
`
`
`
`
`hwmmd,._.Zm_22_4._.~._m_._.2m_m...40_ZDEEOU
`
`33:3035309.
`
`
`
`mmEmbmmmOZ_2(MN_._.m
`
`..EEm....
`
`
`
`
`
`'mhmmw¢0242mm.ZOown...)>5n.O......wMDOmmmgmomm
`
`
`
`
`
`f.a?
`
`
`
`
`
`
`
`...wmjawmNDOE20E...MEMONM
`
`.ZEKOZ.5.mewfi...Zw—zmwfixmbnq«50meD73.mar—NONE1‘. E...hmfiuOZGGMKErmMao:v5.1...mhmwnflmmmum...+$2.6.9flwmaw
`
`
`
`
`
`
`
`
`
`
`.
`
`
`
`401F200wkozwmmi.2098:00.ZOEbmGama—mo“.
`.
`
`
`
`
`.........1A...mmwfi...Zmfimmrpmmbflim.._.<U_ZD—.‘EOO+if.a:
`
`
`
`
`
`
`
`
`
`0:.mOSm—DOZSEOmmEOKu
`
`
`
`
`
`m_I_.Dmdngu...mai
`
`
`
`
`
` ..om:EmEoo>m¢§mm3.2.6034+...wmmd
`FZmEmwfimwbflfl
`
`
`_.zw._.zoo
`
`Eqazoumm9Em?Emzmmfimmam
`
`..m:
`
`
`
`
`NNFimadam—DO._.OZEEOUMEFZmem_hw_w>D¢mwozwm02¢mam—0mmT
`
`...........
`mogmn
`
`......................-"925.5%m59ozfixoomm
`
` Emsmafimmanzm7:mEQzDEEOUour+Gzamoomm
`Fzmzwmcmmpni
`
`m0__>m_n_
`
`
` mhmmbdmmEma:ba;82m.02.0mm.www—hzwedmmfimwbfldir
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 6 of 21
`
`US 8,107,786 B2
`
`[II-
`
`
`
`I! 166
`
`FAST FORWARD _...-O'IREOTION OF __
`\:'j_
`TRICK MODE
`_:_-;
`REQUEST-aw,
`
`REVERSE
`
`_\ f " 1G4
`
`_.5F'iEED OF FA'ST..__ BX
`2x
`2x NORMAL
`
`FAST FORWARD «rm-«1" FORWARD TRICK .L?--------
`VERSION
`MODE?
`
`
`
`I
`
`i“
`I,
`4x NORMAL
`FAST FORWARD I'
`VERSION
`=
`
`
`ax NORMAL
`i
`FAST FORWARD?
`VERSION
`'
`
`1T0
`
`163
`
`
`
`
`
`H
`
`174
`
`o
`
`
`
`2"
`Egg?
`
`I“
`DIRECTION
`VERSION
`'
`
`
`FIGURE 7
`
`. 160
`
`”2
`
`3"
`__I
`‘
`
`’
`
`
`
`"
`
`
`,. 173
`
`.
`
`32%;???
`DIRECTION
`VERSION
`
`
`
`/_.,«"SFEEO OF“
`'---.._BEVEr\"-‘§§E:R'°K,
`
`‘X
`
`III NORMAL
`REVERSE
`DIRECTION
`VERSION
`
`175
`
`i'
`I.—b
`I
`
`I"
`
`END
`
`I
`
`NTFX—1001 I Page 7 of 39
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 7 of 21
`
`US 8,107,786 B2
`
`8—,,
`
`
`
`
`
`
`
`
`
`N_.NUSMQ027.:MUNKmmKmbtmwOzmuémmhw
`
`
`
`
`
`":mmmq
`
`w0_>.n._n_\ffilma0.“.Fwwmua.._.Zm__22_d__.u.im_.rzwZm—Dzwx024.mam—Um?—9:dm:EmmaEsmozb12‘..24.
`
`
`
`me.......................................................................................................I
`t:+
`N3.\h5quhzmzzufimmhzm
`
`
`
`
`
`
`
`
`
`
`-.........-.........-IEamigo;5E..wwr.1:Emin—Oz_mmm_w_n_>mMOOS—¥U_N_._.whmeOm—EZm—mfl01..MOE/MD02.2m0mmEON—L....m2.
`
`
`930%3.6FzmszzhxmhzmwmunzwmmoanozSfiomxn.5F
`
`
`
`
`
`
`
`>>OImman—Em,h2m22_¢hmwh2m24NF¢IWZMOO._.ZO_._.<_D_Jn_n_¢_._.Zm_—.¢Z_4me_h2m_02:10—23:20”...EDPmOm".
`
`
`hzmzzEEmEm6.3E,x,fi.mmmmmqmfimmmmmmsmmmuwmfiwmw._..hw.MmwhenEmPo..o.we.9.mfim..wwfiwfimmmfiwwwg.N8
`
`
`
`.6528$0mem5.:0ca6.3292.5945.9.
`
`
`EszEEEzm9:3.5093musmo3550mm..................................................................
`
`
`
`
`
`ZOFdUIn—Qd.HZm—EZZPZMHZWmeFw024.mam—OWN.TIJII.........IAZC_._.<_G_.—n_n_(hZWEZEFEMth.Whig—2.22.200iii!3..
`
`
`
`
`:3ram:ommaw253022magicSE30m5_.Emlmqwzmfiqiwmflzmwnwwfimomhmim-
`
`1...,.Efim.,
`h584
`
`
`.‘HmmwiFZMEZEhIMHZmthqQZDE—aooP..mmw
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`_
`
`MOOS—>441
`
`
`
`
`
`om;m._.Zm__22_(._.mm_._.2m_Ema—2mm02¢.m_>_m_0m_m
`
`
`
`3:.wmvEmma
`
`
`
`.25022mafia.Efima0hEm?
`
`02m
`
`_H02m_
`
`mum
`30.“.
`
`
`
`3—,aW
`
`
`
`
`
`
`\.\..MT;20ZOFth>43.»GZEWMME>mMGO—a>49“—meWDOwEEme
`
`
`
`
`
`
`
`JOIFZOOWhOEmK
`
`
`
`
`
`mm".\m-DmdmHZWEZEFN—m—HZMGZENAWZNN—wnOPmNoam—DDES—MONK
`
`
`
`
`
`
`923meO._.mmbmmw02.5.(mxhwth9.meme02d.__<.O_._w
`
`
`
`EWEZZhMMFZMMkfimoowwtu..;..mm".mZO_._.4.U_._n_Qd.thEZEFN—m—hzw..._O._.meM(
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`me—am—EMOO—dKUE...mam—UNI
`
`
`
`
`
`hmmmc.Hzms.2.45;w...2m
`
`
`
`m._.(O_Z35.200
`
`
`
`walw44.252._.4>413“Dbw0___;m_.n_
`
`
`GEE—mONMEDI”.FwNDOmmm—ZMOMI....mm"
`
`
`
`
`
`
`NTFX—1001 I Page 8 of 39
`
`
`
`
`
`
`
`
`

`

`
`
`9.mogwo‘SQFDD
`
`mm
`
`Enigma
`
`magma
`
`
`
`on
`
`who—aww—
`
`401F200
`
`mam
`
`RN
`
`0mm
`
`meDUm—D
`
`mmawa.
`
`vNN
`
`MADDOE
`
`
`
`
`”um—xm3n=._.u.3.2mm
`mommmuomm
`
`9N
`
`h_.N
`
`
`
`02.2m0m1
`
`MJDDOE
`
`EN
`
`
`
` .5m:20U
`mZOhFDm
`
`mw
`
`._.Zm_._.Z00
`
`20:52:2500
`
`wJD00.2
`
`arm
`
`
`
`momMUSMDmogkmIZOD.—
`
`Em...wywEmDDOm—D
`
`m«0333....
`m“Emism
`
`_______u_>KOEME"_________
`.cm.
`
`
`
` _N5mE032m_
`
`
`44:90.396.m:._._m:<m
`
`an.Ezmmfiz..dm:
`..E6...:
`
`U.S. Patent
`
`Jan.31,2012
`
`Sheet80f21
`
`US 8,107,786 B2
`
`
`
`mm
`
`mm<m¢h¢fl
`
`
`
`
`
`
`
`
`
`
`N_.
`
`
`
`mot/m562.2muwx
`
`
`
`
`
`
`
`Alba#5.”..XOmmoth—m:GM:
`
`8a
`
`m;
`
`ZEOEE.m:
`
`mtijw5.x$.58me
`
`SE"055.
`
`mmKDOE
`
`
`
`
`
`"we“Em._.m>m9242320953
`
`mm
`
`
`
`Em}mwm02—54mm.5
`
`wwqmd‘wfin
`
`mam
`
`
`
`mm“
`
`
`
`
`Dmbq.525
`
`\rmdgxn.
`
`hZMFZDU
`
`
`
`mm
`
`>1d._2_In_
`
`hZMFZOO
`
`
`
`NTFX—1001 I Page 9 of 39
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 9 of 21
`
`US 8,107,786 B2
`
`
`
`DATABASE
`235
`
`
`ENTERTAINMENT SIMULATED PRIMARY
`ENTERTAINMENT ASSET TABLE 40
`
`CONTENT TABLE 236
`PRIMARY CONTENT 32
`SIMULATED PRIMARY CONTENT
`238
`ACCELERATED SPEED
`ENTERTAINMENT
`ASSET
`24D
`(EG... FAST FORWARD.
`REVERSE]
`
`ENTERTAINMENT
`ASSET
`44
`
`(BO. NORMAL SPEED)
`
`
`
`
`
`
`
`
`
`
`
`
`
`ENTERTAINMENT
`ASSET
`44
`
`(EGHNORMALSPEED)
`
`
`
`ACCELERATED SPEED
`ENTERTAINMENT
`ASSET
`240
`(E.G.. FAST FORWARD.
`REVERSE
`
`
`ii ET
`
`_ ADVERT
`
`
`
`ADVERTISEMENT SIMULATED PRIMARY
`CONTENT TABLE 241
`
`
`
`PRIMARY OONTENT 32
`
`ADVERTISEMENT
`ASSET
`45
`
`(E.G., NORMAL SPEED]
`
`
`
`ADVERTISEMENT
`AS SET
`46
`
`(£13., NORMAL SPEED)
`
`
`
`
`
`
`
`
`SIMULATED PRIMARY CONTENT I
`238
`ACCELERATED SPEED
`ADVERTISE ME NT
`AS SET
`242
`(E.|3.. FAST FORWARD.
`REVERSE]
`
`ACCELERATED SPEED
`ADVERTISEMENT
`ASSET
`242
`(E.G.. FAST FORWARD.
`REVERSE
`
`
`
`
`
`
`
`FIGURE 10
`
`NTFX—1DO1 I Page 10 of 39
`
`

`

`U.
`
`a
`
`S
`
`8H...-
`
`m
`
`
`
`
`
`
`
`
`
`t8m..,E45_..E45_
`_1.................,tNMN.\..II....................I..................Ib:..mem1................
`
`
`
`
`
`
`
`
`.flmagma025.3%855mm023(me
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`awn.+..Em?9%.:chEm:..........................................-....,|I.mm?53a9Sundmmmawomx
`
`
`
`
`
`
`
`
`
`
`
`aJ.Main—OEIMDZMImw>_m_0m_w_m-ADDOEZO_F¢U_ZDEEOUFZWPZOUEKG—7.32200.I...me
`
`1m.yfinwa95qu
`
`
`
`
`
`
`fl8”mFzmngEszwa.mummzmz..........$quEmzzzEmEmEm?Em22_Emem
`
`
`
`
`
`
`
`
`
`
`
`WU.MG0230@Wm—mD501““735107.—KNHE_0M:FMMDOWKL,.azfimuSwnmoo:29w:mmamomi5:902oszomm022(me970DMMn‘wla:.me”mm>mmwIREIOZ"FQWDCm—W—m-DOEV-U—W—PQWF¢0_ZDEEOO02¢LIN—mgFZMEZ(PW—EmNI...Old—EEO“—.rmd‘u—OHNOE/mm.2mhd.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`3mg2I....................................H.....................................
`
`
`
`
`
`
`
`nmmmmmwow.1...............mw.2mwwwwmmmmlfiamwmmmfimfifimmmflmmmmm......nmhéwgwooqzqwzgznzfioocan
`
`2“..ydEmma.l--..............................L.FzmzzzEmhzwommmmamhéfimog..........EmmaEmzzEEmEm
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Em—Dzww—“d.wmkfiflm—ZWUmil-DOE20:40—23:30FZm—hZOOMI...E..>d¢wwfimmawwomanEmma.Emzzgmmhzmomwmwamhémdooqm520E0mN—m—OZm—mTil>>C_._m«bu—4m._.ZH|__22_4._.I.II.:.ZM_Om.._.§.n._2m_5>444Urp1524fl00$l0MJDOOE
`
`
`
`
`
`
`
`
`1EmEZEEwEm
`
`
`
`
`
`
`
`ammamdzmozmxmémm
`
`:2.oE_i---.........
`
`
`
`0234meE55%02:8mo»5%meLEE3222:2200...................................................It.Emma2552Einn.95:60
`
`
`
`
`
`
`024.m0_>wn_nail—Ego_024KmmbEommHmmDmeOZSEOME201mHmmflxumm9250mm
`
`9.30mmmoanmEN>51mmamomi£302oszomxEN_
`
`
`
`6I.ww—DOE
`
`..8....................................H.............................................................w.......................S92dmvmmUmenmJd‘EIOZ
`r.r0H.ozm._5.azm...J,..r1...r1
`
`
`
`
`._.d._MOE/MDm-_Hmwmd‘ENEZ_(._.IW._.ZM
`C/
`
`8m@329.3:90:«.3me.RN
`...nail—EmaO._.ngPZm—Eznd‘hmm—FZW__m_._.4.D_ZD—228
`
`
`
`
`
`NTFX—1DO1 I Page 11 of 39
`
`
`
`
`
`
`
`
`
`..
`
`
`
`5quEmgzwfimwpzm39%8254304
`
`
`
`
`
`
`
`O._.Fm—mmd.PZm-EZEFMm—Em—m_._.<_00wm(
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan.31,2012
`
`Sheetllof21
`
`US 8,107,786 B2
`
`
`
`3m.
`
`
`
`mmNEm.rm>mHm<OQ<OZm
`
`8?u..92me
`
`20593.25mEcumzimh.....a.,
`
`
`
`th—ZOREOU"N.0m_n=a..O.wv.r.
`
`
`
`thEzEfimmFZm
`
`mmrxmm
`
`mmqmqlmxa
`
`8m
`
`
`
`mm
`
`>M§En
`
`.95an
`
`.520200mm
`
`ZO_._.<_2w_Omz_
`
`
`
`
`
`
`
`
`._n__zoamimzéh"muEmmzozmmmz.""hzmzonioo_u«annu_,Em:m3:
`___mmmm>mmm"wfifimw""mango:m.................uEm2m9Em>o<"u"EOmeE____.uuuEmu
`
`
` _m_n".EwEw".........................."finm_EOumzaE"m5man"20.2522m"flammadmv_mine:zo_mm_zmz<E"fizozoommmn."zo_wm_zwz¢E
`
`#523500"mmH..................n_Hvan
`
`
`
`
`
`
`
`
`
`
`.-85392.289“.54meEoumzth
`
`mamas.dun:m
`hmm201m939.5.x...
`
`
`
`mwwarm—DPDQ—.30
`
`on
`
`502mm
`
`.6528
`
`NFmm:0_n_
`
`&
`
`
`
`$43quat
`mm......IRE.XOmnotmfi6m:
`
`
`
`..xxI-J...mama:5%EB
`
`
`
`..................l..-i...i.-.....-.
`
`
`
`...............EOEmqu25.5.52
`
`Agmth.2
`
`
`magma..,GE.wtdem
`
`
`0238$me9m:.maqojmogmzmmhé6Q
`
`amkm.va
`
`
`
`
`
`anEmhmrwazczmm2.0Own?
`
`.moqxflmmfifim..
`
`
`
`azifimmkw
`
`Ema/Ema
`
`mm
`
`
`
`
`as
`
`833
`
`wwqfidhdfi
`
`to
`
`
`
`>m¢fl200mm
`
`ZO_._.d__S_w—Ou2_
`
`NTFX—1DO1 I Page 12 of 39
`
`mm(mar—.5.
`
`8m
`
`NM.
`
`>v.?__.2_xn_
`
`hzthDD
`
`an
`
`rzfiflzoomw
`
`ZOFCEMOmZ_
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 12 of 21
`
`US 8,107,786 B2
`
`ENTERTAINMENT SECONDARY
`
`
`DATABASE
`306
`
`
`
`ENTERTAINMENT
`RECORDING
`52
`2X FF VERSION
`
`4X FF VERSION
`
`6X FF VERSION
`
`
`2X REW VERSION
`4X REW VERSION
`
`
`6X REW VERSION
`
`
`
`ENTERTAINMENT
`RECORDING
`52
`2X FF VERSION
`4X FF VERSION
`6X FF VERSION
`2X REW VERSION
`4X REW VERSION
`
`
`6X REW VERSION
`
`
`
`
`
`
`
`
`
`
`
`
`
`SECONDARY INFORMATION 34
`ADVERTISEMENT
`RECORDING
`54
`2X FF VERSION
`4X FF VERSION
`
`
`
`2x REW VERSION
`6X FF VERSION
`4x REW VERSION
`6X REW VERSION
`
`
`
`RECORDING
`54
`2x FF VERSION
`4X FF VERSION
`6X FF VERSION
`2x REW VERSION
`4x REW VERSION
`
`
`
`
`
`DATABASE
`300
`ENTERTAINMENT ASSET TABLE 40
`
`PRIMARY CON TENT
`32
`
`ENTERTAINMENT
`ASSET
`
`44
`
`ENTERTAINMENT
`ASSET
`
`44
`
`
`
`
`
`
`
`
`
`
`
`
`Fl G U RE 1 3
`
`
`ADVERTISEMENT ASSET TABLE
`42
`
`PRIMARY CONTENT 32
`"""""""""""""""""""""""_
`
`ADVERTISEMENT
`
`ASSET
`
`45
`
`ADVERTISEMENT
`ASSET
`
`46
`
`Fl {3 U RE 1 4
`
`NTFX-1DO1 I Page 13 of 39
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 13 of 21
`
`US 8,107,786 B2
`
`
`RECEIVING DEVICE
`12
`IE.G., SETTOP BOX. DVR. FUR)
`—‘
`
`
`
`PROCESSOR
`2‘10
`
`MEMORY
`212
`
`i
`i
`
`DE CODER SYSTEM
`218
`
`
`
`
`
`219
`
`PROCESSOR
`
`
`
`|
`pi MODULE
`
`DEMULTIF‘LEXER
`21?
`
`
`
`
`
`MEMORY
`
`226
`
`(ED. BUFFER]
`
`IJ'F
`
`223
`
`
`TRAN SMISSIDN
`(E.G.. MPEG-2 ]
`25}?
`
`—b-
`
`PROCESSING
`
`MODULE
`322
`
`
`
`
`__
`__
`DECODEH
`230
`
`_,_ _____________________________
`LOCAL STORAGE DEVICE 309:
`
`
`
`
`
`DA'IAIBFISE
`22
`
`TRANSMISSION
`DEMULTIPLEXED)
`
`SECONDARY
`CONT EN T 35
`
`SECONIJARY
`
`i
`
`1
`
`i SECONDARY
`iAPPLICATION 60
`
`i
`-
`
`.
`
`
`
`
`
`
`
`
`
`,r—--------------
`g CONTROL
`g BUTTONS
`=
`19
`
`
`in:
`222
`
`—
`
`I I 1
`E
`RENDER
`f
`'
`MODULE
`;
`234
`;
`-
`.
`;
`=
`
`DISPLAY
`DEVICE
`26
`
`
`OUTPUT DEViCE 1B
`
`
`
`REMOTE
`CONTROL
`20
`
`
`
`FIGURE 15
`
`NTFX-1DO1 I Page 14 of 39
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 14 of 21
`
`US 8,107,786 B2
`
`
`.. ’ 4" 292
`
`
`FIRST C HANNEL
`
`SECOND CHANNEL
`
`THIRD CHANNEL
`FOURTH CHANNEL
`
`FIFTH CHANNEL
`
`- 323
`
`— 323
`
`, 323
`— 323
`
`— 323
`
`I
`
`I
`
`I
`:
`
`IENTERTAINMENT ASSETS - 44
`IADVERTISEMENT ASSETS - 45
`ISECONDARY INFORMATION - 34
`:
`
`SIXTH CHANNEL
`-323
`i
`
`
`Fl GU RE 1 6A
`
`,
`293
`
`
`FIRST CHANNEL
`
`- 323
`
`........
`
`SECOND CHANNEL
`
`— 323
`
`THIRD CHANNEL
`FOURTH CHANNEL
`
`_ 323
`— 323
`
`
`A,
`
`IE TERT
`ASSETS
`i
`ESECONDARY INFORMATION - 34
`I
`""""""""
`
`— 323
`FIFTH CHANNEL
`SIXTH CHANNEL
`— 323
`
`
`I
`
`
`_____.., 295
`
`FIRST CHANNEL
`
`— 323
`
`*
`
`FIG U R E 1 6B
`
`SECOND CHANNEL
`
`THIRD CHANNEL
`
`FOURTH CHANNEL
`
`FIFTH CHANNEL
`SIXTH CHANNEL
`
`' 323
`
`- 323
`
`- 323
`
`- 323
`— 323
`
`{ACNE-RTCEMENT—ASSETS:liém"
`SECONDARY INFORMATION — 34
`I
`i
`I
`
`_________________________________________________________
`
`i
`
`FIGURE 1 6C
`
`_. ,__ -- 297
`
`FIRST CHANNEL
`
`— 323
`
`—I|
`
`SECOND CHANNEL
`
`' 323
`
`THIRD CHANNEL
`
`- 323
`
`ENTERTAINMENT ASSEISAA
`I
`ESECONDARY INFORMATION - 34
`I
`I
`I
`"""""" IADVERTISEMENT ASSETS- 46
`i
`ISECONDARY INFORMATION - 34
`I
`' 323
`FOURTH CHANNEL
`I
`i
`5
`— 323
`FIFTH CHANNEL
`
`
`— 323SIXTH CHANNEL —5
`
`i
`j
`
`FIGURE 16D
`
`NTFX—1DO1 I Page 15 of 39
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 15 of 21
`
`US 8,107,786 B2
`
`FRAMES 30
`
`r—
`
`PACKETBZ
`(EG.VDEO)
`*
`VIDEO STREAM 32?
`
`I"""""""‘L;
`/
`I'
`
`"k
`
`If, R
`--
`I REEESEECE
`I RES§EEECE
`REFERENCE
`
`
`i
`I
`FRAMEsa
`. CHANGE 34
`. CHANGE 84
`
`'\I
`
`["""""""""IR
`I
`I"
`
`
`
`
`323
`
`4:
`‘
`
`(EECEIIDI‘O
`I
`'
`"
`AUDIO STREAM 329
`
`i REFERENCE
`REFERENCE
`
`
`FRAME
`I
`FRAME
`REESEEEE
`CHANGE 84
`g ORANGE s4
`
`
`
`l''''''''''''''''''''''
`g
`PACKET 32
`{EC-L. METADATAJ
`
`
`
`METADATA STREAM 331
`
`.I.
`
`..
`
`-
`
`
`\——
`
`(DEMULTPLEXER)
`
`
`
`METADATA
`FRAME a?
`
`
`
`
`
`
`
`_‘.>
`
`IMAGE
`DATA
`
`\\
`
`SOUND
`DATA
`
`IDECODERI
`
`HGURE17
`
`82
`
`PACKET
`
`342 ,
`
`HEADER
`
`__.. 340
`
`
`
`344
`
`STREAMIDENHFERI
`
`
`HGURE18
`
`34
`
`350
`
`x
`f
`
`352
`f
`354
`.r’
`I
`I
`r"
`SECONDARY INFORMATION
`-’
`1'
`1"
`If ." SECONDARY INFORMATION TABLE
`
`
`
`
`
`
`
`
`
`IZX FF VERSION
`I4X FF VERSION
`IEX FF VERSION
`EZX REW VERSION
`i4): REW VERSION
`IGX REW VERSION
`
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`- SECONDARY INFORMATION IDENTIFIER. SECONDARY INFORMATION OFFSET
`
`FIGURE 19
`
`NTFX—1DO1 I Page 16 of 39
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 16 of 21
`
`US 8,107,786 B2
`
`32
`l, 34
`
`l-‘HIMAHY
`SECONDARY
`PRIMARY
`CONTENT
`INFORMATION
`CONTENT
`
`
`PRIMARY
`SECONDARY
`PRIMARY
`,
`
`CONTENT
`INFORMATION
`CONTENT
`i
`
`
`
`METADATA
`
`SECONDARY
`INFORMATION
`TABLE
`
`METADATA
`
`i
`
`I
`
`
`
`FIGURE 20
`
`350
`
`
`PRIMARY
`PRIMARY
`PRIMARY
`CONTENT
`CONTENT
`CONTENT
`
`
`PRIMARY
`PRIMARY
`PRIMARY
`CONTENT
`CONTENT
`CONTENT
`
`
`
`METADATA
`
`SECONDARY
`INFORMATION
`TABLE
`
`METADATA
`
`
`
`
`
`
`
`
`SECONDARY
`SECONDARY
`SECONDARY .
`INFORMATION
`INFORMATION
`INFORMATION i
`
`SECONDARY
`SECONDARY
`SECONDARY .
`
`L___________________________________________________________J
`______________________________J
`INFORMATION
`INFORMATION
`INFORMATION
`.
`
`FIGURE 21
`
`PRIMARY
`
`PRIMARY
`
`PRIMARY
`
`' “050 STREAM 327
`
`CHANNEL 323 ,1 AUD'O STREAM 3’29
`‘-
`
`METADATA STREAM 331
`
`YIOEO STREAM 327
`
`FIRST
`CHANNEL 323
`
`AUDIO STREAM 329
`
`METADATA STREAM 331
`'—
`
`VIDEO STREAM 327
`
`SECOND
`CHANNEL 323
`
`,
`
`AUDIO STREAM 329
`
`VIDEO STREAM 32?
`
`i
`
`CHANNEL 323 <'
`i
`
`“10"”) STREAM 329
`
`METADATA STREAM 331
`.__
`
`
`
`CONTENT
`CONTENT
`CONTENT
`
`PRIMARY
`PRIMARY
`PRIMARY
`CONTENT
`CONTENT
`CONTENT
`
`.
`SECONDARY
`
`
`bECONDARY
`INFORMATION
`INFORMATION
`TABLE
`
`
`
`
`
`METADATA
`
`
`
`FIGU RE 22
`
`NTFX—1DO1 I Page 17 of 39
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 17 of 21
`
`US 8,107,786 B2
`
`361-\
`
`32 a
`
`361 x
`
`\._\ \
`
`\\
`
`‘.
`
`-\\\
`\_\
`
`\\
`
`32 _
`
`\\
`
`\_\
`
`\\
`
`,z’
`
`f"-
`
`\ \
`\
`\__\
`\‘\
`E____T_________________________________________________________________T________________________________________________________________________________
`
`:
`i
`5
`
`E
`g
`
`PRIMARY CONTENT
`(EG"ADVER“5EMENT
`ASSET46)
`
`E
`g
`
`(EC; gn$ggfigéfigflifigSET44
`""
`
`)
`
`
`
`
`
`
`
`SECONDARY
`CONTENT35
`n
`
`me,
`ADVERHSEMENT
`
`SECONDARY
`CONTENTSS
`n
`
`man
`ENTERTNNMENT
`
`RECORDmesm
`RECORWNGSM
`
`
`FIGURE 23
`
`NTFX—1001 I Page 18 of 39
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 13 of 21
`
`US 8,107,786 B2
`
`370
`
`374
`
`376
`
`\
`
`332 \
`
`l
`DEMUL'I'IPLEXER RECEIVES TRANSMISSION INCLUDING PRIMARY CONTENT
`
`AND SECONDARY INFORMATION IDENTIFIER AT SETTOP BOX,
`DEMULTIPLEXES TRANSMISSION AND CAUSINC THE TRANSMISSION TO SE
`STORED IN THE STORACE DEVICE (E.G.. MEMORY)
`
`T
`DESCRAMBLER IDENTIFIES STREAMS BASED ON MOST RECENT CHANNEL
`
`
`REQUEST AND DESCRAMBLES THE IDENTIFIED STREAMS
`II
`DECODER DECODES IDENTIFIED STREAMS (E.G., PRIMARY CONTENT)
`AND COMMUNICATES PRIMARY CONTENT TO RENDERING MODULE
`"""""""""""""""""""""""""""""""""""""""""I'''''''''''''''''''''''''''''''''''''''''''
`
`‘
`
`\
`
`RENDER MODULE RENDERS PRIMARY CONTENTTO OUTPUT
`
`DEVICE (E.G., DISPLAY DEVICE AND SOUND DEVICE]
`
`
`‘
`
`386
`
`I“ \_
`
`“a,“
`
`
`
`
`PROCESSING MODULE RECEIVES REQUEST TO PAUSE
`AND CDMMUNICATES REQUEST TO DESCRAMSLER
`
`' P
`
`ROCESSING MODULE RECEIVES PLAY REQUEST AND COMMUNICATES REQUEST TO DECODER
`SYSTEM AND THE DESCRAMBLER. THE DESCRAMBLER RESUMES DESCRAMBLING. THE DECODE
`RESUMES RETRIEVING TRANSMISSION FROM LOCAL STORAGE
`
`
`
`i
`I
`
`388 HE‘S-h.
`
`II
`PROCESSING MODULE RECEIVES TRICK MODE REQUEST TO RENDER THE PRIMARY
`I
`
`CONTENT AT A OUTPUT DEVICE AT AN ACCELERATED SPEED (E_G_, FAST FORWARD}
`'
`
`
`39.0 ,_ __
`
`PROCESSING MODULE ASSOCIATES PRIMARY CONTENT TO SECONDARY CONTENT
`BASED ON SECONDARY INFORMATION IDENTIFIER AND COMMUNICATES IDENTIFIED I
`CHANNEL TO DESCRAMBLER THAT DESCRAMBLES AN ENTERTAINMENT APPLICATION I
`
`' "~
`
`ETC-am
`
`392 ~—._,_
`
`PROCESSING MODULE CAUSES ENTERTAINMENT APPLICATION TO
`
`‘ PI EXECUTE. ENTERTAINMENT APPLICATION CENERATES SECONDARY
`I
`CONTENT IE.G., ENTERTAINMENT RECORDING)
`
`I
`*
`DECODER DECODES SECONDARY CONTENT
`
`._.._,__\
`
`*___________________________________________________
`393 5"“ “--——_ --—I
`RENDER MODULE RENDERS SECONDARY CONTENT TO THE OUTPUT
`DEVICE AT NORMAL SPEED OF THE SECONDARY CONTENT
`'
`
`
`
`
`394 -\
`
`396 a.“
`
`PROCESSING MODULE RECEIVES A PLAY REQUEST. COMMUNICATES CHANNEL TO
`DESCRAMBLER, IDENTIFIES THE END OF PRIMARY CONTENT MARKER IN THE PRIMARY
`CONTENT. AND COMMUNICATES END OF PRIMARY CONTENT MARKER T0 DECODER SYSTEM.
`
`
`____________________________________________________I___________________________________________________
`DECODER DECODES PRIMARY CONTENT
`"5"" "-
`
`
`,
`T
`--~..__j RENDER MODULE RENDERS PRIMARY CONTENT TO THE OUTPUT DEVICE
`
`AT NORMAL SPEED OF THE PRIMARY CONTENT
`
`FIGURE 24
`
`NTFX—1DO1 I Page 19 of 39
`
`

`

`U.S. Patent
`
`Jan.31,2012
`
`Sheetl9of21
`
`US 8,107,786 B2
`
`8w
`
`
`
`.U..Efim,5
`
`
`
` HzmZOaEOQm._.(0_z_u_$_S_DQr
`
`
`
`9263402.ZOGQEw—cfix...
`
`
`
`
`
`02¢._.Zm_._.ZOO>md5=ma
`
`
`
`ZC_._.4.EECH_2_>140206wm
`
`\
`
`ImiC—cmfl—
`
`2me
`
`
`
`
`
`thZOLEOOw._.(U_Z_._ES_OU
`
`
`
`
`
`
`
`Vonruby—mmPZMEmmFKmEQq
`
`
`
`
`mamEmbmwwEms—ZEHEMHZM
`
`Namammu—w>_._
`
`
`
`mommm>mwmZOFK37:
`
`
`
`NFmogmflOZZNOMK
`
`
`
`
`
`
`
`024.._.29.200\rfiqgmn.
`
`
`
`20.5.4:MOLE>m¢0200mw
`
`1m_n__.550—
`
`a
`
`
`
`
`3.22802.03402.ZOEQEdefi—hmFZNZDn—EGOm...<0_z
`
`
`
`
`ZOEmeZd‘N—H_b.2m2015.00mam—0mm.
`
`._.Zm_Zawn—.200mam—0mm
`
`
`
`02¢hszoo>m<s=mm_T.zo_¢m_2wz§h 02.03402.20595ng
`zompquOué>m4ozoommm,,,
`
`
`+u_uu_mmzfiszm_
`
`8..
`
`
`
`
`
`zo_mm_§wz.§_kmmEszmEoo mu4m__nmI.....Grit.wamommmm
`
`mmMEDOE
`
`m..PZNZOEEOUZOmefim
`
`
`
`"\ZOEQEdeQhmwdmm—zwo
`
`
`
` wkquinfiéoo*@205mfiwzguh
`
`
`
`H..525..~_
`
`
`
`O._.7.059sz43%
`
`waSMD025—w0mm
`
`”I!“
`
`
`
`ZOEQEmZépmimomm
`
`3w
`
`NTFX—1DO1 I Page 20 of 39
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 31,2012
`
`Sheet 20 of 21
`
`US 8,107,786 B2
`
`
`
`,1M
`
`FLY FRIENDLY AIRLINES
`
`,1%
`
`
`
`
`
`
`
`HGUREZB
`
`NTFX—1001 I Page 21 of 39
`
`

`

`U.S. Patent
`
`Jan. 31, 2012
`
`Sheet 21 of 21
`
`US 8,107,786 B2
`
`600 —
`
`602 —\_\
`
`608
`
`.2— 610
`
`624
`
`\
`
`PROCESSOR
`
`I iNSTRUCTIONS
`
`
`
`
`624 — \
`
`{MAIN MEMORY
`
`INSTRUCTIONS I
`
`
`
`606 — .,
`
`624
`
`STATIC MEMORY
`
`
`
`INSTRUCTIONS
`
`520 —..__
`
`NETWORK
`INTERFACE
`DEVICE
`
`
`
`624
`
`626
`
`VIDEO
`DISPLAY
`
`612
`
`ALPHA—NUMERIC
`IN PUT
`DEVICE
`
`
`
`_..2— 614
`
`CURSOR CONTROL
`DEVICE
`
`------—618
`
`
`
`
`
`DRIVE UNIT
`
`MAC HINE-
`READABLE
`MEDIUM
`
`"
`
`INSTRUCTIONS
`
`_ — 622
`
`'
`
`_2— 618
`
`SIGNAL GENERATION
`DEVICE
`
`FIGURE 27
`
`NTFX—1001 I Page 22 of 39
`
`

`

`US 8,107,786 B2
`
`1
`SYSTEMS AND METHODS TO MODIFY
`PLAYOUT OR PLAYBACK
`
`FIELD
`
`Embodiments relate generally to the technical field ofcom-
`munications and more specifically to systems and methods to
`modify playout or playback of primary content.
`
`BACKGROUND
`
`Many receiving devices such as personal video recorders
`(PVRs) or digital video recorders (DVRs) may provide sup-
`port for trick mode requests that enable a user to fast forward
`or rewind content (e.g. primary content). For example, a user
`who has recorded a movie on a PVR may fast forward through
`a scene while playing the movie. In response to the request.
`the PVR may render the movie to a display device at an
`accelerated speed. Two disadvantages may be identified in
`processing the users request to fast forward. First, the content
`played out in response to the fast forward request is the same
`content. nevertheless played at an accelerated speed. Second.
`the content played out in response to the fast forward request
`may appearjerky and reproduce poorly making identification
`of scenes difficult.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`Embodiments are illustrated by way of example and not
`limitation in the figures of the accompanying drawings, in
`which like references indicate similar elements and in which:
`
`FIG. 1 is a block diagram illustrating a system, according to
`an exalnple embodiment. to modify playout of primary con-
`tent;
`
`FIG. 2 is a block diagram illustrating a database, according
`to an example embodiment;
`FIG. 3 is a block diagram illustrating example embodi-
`ments of entertainment secondary infonnation, according to
`an example embodiment;
`FIG. 4 is a block diagram illustrating example embodi-
`ments of advertisement secondary information;
`FIG. 5 is a block diagram illustrating frames and packets,
`according to an example embodiment;
`FIG. 6 is a flowchart illustrating a method, according to an
`example embodiment;
`FIG. 7 is a flowchart illustrating a method, according to an
`example embodiment,
`to identify secondary information
`based 011 a trick mode request:
`FIG. 8 is a flowchart illustrating a method, according to an
`example embodiment;
`FIG. 9 is a block diagram illustrating a system, according to
`an example embodiment, to modify simulated primary con-
`tent at a receiving device;
`FIG. 10 is a block diagram illustrating a database. accord-
`ing to an example embodiment;
`FIG. 11 is a flow chart illustrating a method, according to
`an example embodiment, to modify simulated primary con-
`tent at a receiving device;
`FIG. 12 is a block diagram illustrating a system. according
`to an example embodiment;
`FIG. 13 is a block diagram illustrating a database, accord-
`ing to an example embodiment;
`FIG. 14 is a block diagram illustrating a database, accord-
`ing to an example embodiment;
`FIG. 15 is a block diagram illustrating a receiving device.
`according to an example embodiment;
`
`10
`
`15
`
`20
`
`30
`
`50
`
`55
`
`60
`
`2
`
`FIG. 16A is a block diagram illustrating a component
`transmission, according to an example embodiment;
`FIG. 16B is a block diagram illustrating a component traits-
`mission, according to an example embodiment;
`FIG. 16C is a block diagram illustrating a component trans-
`mission, according to an example embodiment;
`FIG. 16D is a block diagram illustrating a transmission.
`according to an example embodiment;
`FIG. 17 is a block diagram illustrating streams associated
`with a channel, according to an example embodiment;
`FIG. 18 is a block diagram illustrating the packet. accord-
`ing to an example embodiment;
`FIG. 19 is a block diagram illustrating a secondary infor-
`mation table, according to an example embodiment;
`FIG. 20 is a block diagram illustrating primary content and
`secondary information communicated in the video stream
`and the audio stream of a single channel, according to an
`example embodiment;
`FIG. 21 is a block diagram illustrating primary content
`communicated in a first channel and secondary infonnation
`communicated in a second chalmel. according to an example
`embodiment;
`FIG. 22 is a block diagram illustrating the primary content
`communicated in a video stream and an audio stream of a
`
`chalmel and the secondary information communicated in the
`metadata stream of the same channel, according to an
`example embodiment;
`FIG. 23 is a block diagram illustrating end of primary
`content markers, according to an example embodiment;
`FIG. 24 is flowchart illustrating a method, according to an
`example embodiment, to modify playback ofprimary content
`at a receiving device;
`FIG. 25 is a flow chart illustrating a method, according to
`an example embodiment, to communicate a transmission that
`facilitates modification of playback of primary content at a
`receiving device:
`FIG. 26 is a diagram illustrating a user interface, according
`to an example embodiment;
`FIG. 27 is a block diagram of a machine, according to an
`example embodiment. including instructions to perform any
`one or more of the methodologies described herein.
`
`DETAILED DESCRIPTION
`
`In the following description, for purposes of explanation,
`numerous specific details are set forth in order to provide a
`thorough understanding of example embodiments of the
`present invention. It will be evident. however, to one skilled in
`the art that the present invention may be practiced without
`these specific details.
`Embodiments described below use one of two approaches
`to respond to a trick mode request (e. g._. fast forward, rewind,
`skip request). First, a trick mode request may be responded to
`by associating primary content to secondary content and
`playing out the secondary content on a receiving device. the
`secondary content not being derived from the primary con-
`tent. For example, a user viewing a movie (e.g., primary
`content) may select a fast forward button that causes fast
`forwarding of the movie; however, instead of viewing the
`movie at an accelerated speed. the user may view andfor hear
`secondary content. Taking this approach, the author of the
`secondary content is empowered with complete editorial con-
`trol over the secondary content. Accordingly, the author may
`create secondary content of the same subject matter as the
`primary content or create secondary content of a different
`subject matter altogether. Further. the author may create sec-
`ondary content ofthe same medium (e.g., audio andt'or video)
`
`NTFX—1001 I Page 23 of 39
`
`

`

`3
`
`4
`
`US 8,107,786 B2
`
`and presentation (e.g., full motion andfor slide show} of the
`primary content or create secondary content of a different
`medium (e.g., audio andr'or video) and presentation (e.g., full
`motion andfor slide show). In addition, the author of the
`primary content need not be the author of the secondary
`content or be legally or otherwise related to the author of the
`secondary content.
`Second. a trick mode request may be responded to by
`associating primary content to secondary content and playing
`out the secondary content on a receiving device, the second-
`ary content being derived froln the primary content but played
`at a normal speed for the secondary content. Taking this
`approach, the author of the secondary cont