`Vallone et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 6,847,778 B1
`Jan. 25, 2005
`
`USOO6847778B1
`
`(54) MULTIMEDIA VISUAL PROGRESS
`INDICATION SYSTEM
`
`EP
`EP
`wo
`
`0 898 279 A2
`0 889 649 A3
`93/08664
`
`211999
`8/1999
`4/1993
`
`(75)
`
`Inventors: Robert Vallone, Palo Alto, CA (US);
`53k
`
`CA (US)
`
`(73) Assignee: Tivo, Inc, Alviso, CA (US)
`
`(* ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`use 154(b) by 0 days,
`
`(21) Appl. No.: 09/539,433
`.
`“led:
`
`Man 30’ 2000
`
`(22)
`
`(60)
`
`Related US. Application Data
`Provisional application No. 60/127,178, filed on Mar. 30,
`1999‘
`5/
`Int. Cl] ..................................................
`. . . . . . . . . . . . . . . . .
`(52) US. Cl.
`. . . . .. 386/68; 386/46
`
`(58) Field of Search ............................ .. 386/68, 69, 52,
`386/55, 46, 1, 4, 6, 70, 82, 125, 126, 124,
`45, 40, 83; 360/32; H04N 5/91
`
`(56)
`
`References Clted
`
`U‘S' PATENT DOCUMENTS
`4,600,989 A
`7/1986 Schwartz et at.
`5,063,547 A
`11/1991 Custers et al.
`....... ..
`
`5,206,733 A "'
`4/1993 Nismgaki 9‘ 31-
`
`5,502,504 A
`3/1996 Mf'ISha" 6' 31-
`
`5,513,3% A "'
`4/1996 Mllls et al.
`
`""""""
`2 *
`3min:
`5:878:186 A
`3/1999 Bennett at 63.312 313.. 386/85
`
`5,903,264 A *
`5/1999 Moeller et a1.
`........... .. 345/719
`
`364/200
`369/32
`386/9
`343/555
`715/530
`
`EP
`EP
`EP
`EP
`
`FOREIGN PATENT DOCUMENTS
`0 435 370 A2
`7/1991
`___________" HON/gm
`0 691 651 A1
`1/1996
`......... .. 0113/27/34
`0 764 951 Al
`3/1997
`....... .. GllB/27/O34
`0 889 649 A2
`1/1999
`........ .. H04N/5/775
`
`......... .. 6113/27/10
`H04N/5/775
`.. H04N/5/78
`
`
`............ H04N/5/44
`
`98/12872
`wo
`* cited by examiner
`
`3/1998
`
`Primry Examiner—Robert Chevalier
`(74) Attorney, Agent, or Firm—Kirk D. Wong; Hickman
`Palermo Truong & Becker LLP
`
`ABSTRACT
`(57)
`A multimedia visual progress indication system that pro-
`vides a trick play bar that is overlaid onto the program
`material or displayed on a dedicated display. A cache bar
`inside of the trick play bar indicates the length of a recording
`session or the length of stored program material and expands
`to the right when material is being recorded. Every half hour
`(or selected increment), the cache bar slides to the left. Time
`marks are displayed inside the trick play bar giving the user
`a visual reference
`from which to judge the current [ime
`and visual time reference points. The time marks are in any
`increment of time needed. The total length of the stored
`program material or next time or counter increment in the
`recording cycle is displayed on the right hand end of the
`trick play bar. A position indicator moves within the trick
`play bar and tells the user visually where his current position
`is within the program material. A slider moves along the
`trick play bar and on top of the cache bar and is linked to the
`position indicator and can be moved anywhere within the
`cache bar by the user. The slider displays the numeric time
`or counter mark of the current position. Amode indicator is
`positioned below the slider and follows the slider’s move-
`meat and
`whether the user
`play, record, pause,
`slow play, fast play, fast forward (1x, 2x, and 3x), slow
`“mm Play, 510w “We”, and fast "ms" (1", 2", and 3")
`m0des~ The 1x, 2X: and 3X Speeds are aldjumble by the
`system to be any variable desired (e.g., 2x, 16x, and 32x).
`The trick play bar and its associated components are dis-
`played for a predetermined time period when overlaid onto
`the ngam ma‘cnal-
`
`39 Claims, 34 Drawlng Sheets
`
`2603
`
`2604
`
`2607
`
`2605
`
`2608
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 1 of 49
`
`
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 1 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25,2005
`
`
`
`
`
`
`Sheet 1 0f 34
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`MPEG
`
`streams
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Input
`
`streams
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 2 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 2 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`
`
`
`
`Sheet 2 0f 34
`
`
`
`US 6,847,778 B1
`
`
`
`207
`
`
`
`
`Input
`
`Module
`
`Input
`
`
`Module
`
`
`Input
`Module
`
`
`
`In ut
`
`
`
`
`
`202
`
`
`
`203
`
`
`
`204
`
`
`
`
`Output
`
`Module
`
`205
`
`
`
`_ Output
`
`
`Module
`
`Medic:
`
`Switch
`
`
`
`
`
`Output
`Module
`
`
`
`
`Out ut
`
`
`
`
`206
`
`
`
`
`
`207
`
`208
`
`
`
`209
`
`
`
`FIG. 2
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 3 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 3 of 49
`
`
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 3 of 34
`
`US 6,847,778 B1
`
`308
`
`.
`
`302
`301
`
`
`
`309 i
`
`305
`306
`
`307
`
`A
`
`FIG. 3
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 4 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 4 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 4 0f 34
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`406
`
`
`407
`
`
`
`
`
`
`”mit
`
`409
`
`
`
`
`470
`I.—
`video buffer
`
`
`
`
`471v-
`
`
`401
`
`
`
`
`402
`
`.
`
`408
`
`
`
`
`
`
`
`
`403
`
`xt
`
`
`
`
`404
`
`
`
`
`
`I
`
`
`int
`
`
`
`
`
`4051
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`nmst —nmn '-
`
`(JUle buffer
`
`
`"“m't
`
`
`
`
`
`“mit
`
`
`
`
`
`
`472
`I.-
`private data buffer
`
`
`
`
`
`
`473
`II—
`event buffer
`
`
`
`FIG. 4
`
`
`
`5011
`
`
`
`502
`
`
`503
`
`504
`
`time stamp
`
`address
`
`
`
`type
`
`
`
`
`
`
`
`FIG. 5
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 5 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 5 of 49
`
`
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 5 of 34
`
`US 6,847,778 B1
`
`Media Switch
`
`Circuldr
`Segment
`Buffers
`
`Events
`
`T runs loted
`_ Logical
`Segments
`
`
`
`A Logical
`Segment
`
`Type = l-FRAME
`
`Timestamp = 096453
`
`60
`4.
`
`Netflix, Inc. et a1.
`
`Exhibit 1008
`Page 6 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 6 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 6 of 34
`
`US 6,847,778 B1
`
`hard disk
`
`VB] data
`
`MPEG
`encode r
`
`'
`
`MPEG
`decoder
`
`
`
`ogdio
`Video
`on- screen
`
`display
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 7 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 7 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 7 of 34
`
`US 6,847,778 B1
`
`801
`
`303
`
`
`of data
`
`
`
`encoder
`
`decode r
`
`buffers
`
`Transforms
`
`804 -
`
`hard disk
`
`FIG.8
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 8 of 49
`
`
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 8 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 8 of 34
`
`US 6,847,778 B1
`
`-
`-
`Media SWItch
`
`Vela
`decoder
`
`decoder
`
`releaseEmptyBuf
`. ushFUI IBuf
`P "36' me
`ka source _ ka Xfrm _
`0| locEmptyBuf
`nextFul lBuf
`910
`915
`9H
`
`
`
`912
`
`918
`
`push
`
`cur rent
`
`\ 919
`
`\920
`
`FIG. .9
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 9 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 9 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 9 of 34
`
`kaC l ipCoche
`
`kaClip
`Writer
`
`1002-\
`
`
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 10 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 10 of 49
`
`
`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 10 of 34
`
`US 6,847,778 B1
`
`1114-
`
`.1101
`
`1102
`
`"04
`
`1 105
`
`Push
`Switch
`
`Cache
`Tronst rm
`1108
`
`Pull
`Switch
`
`TV Signal
`
`"06
`
`CI'
`
`
`
`
`Clip Reader
`Clip Reader
`
`mo .. -
`-
`1107 -
`
`Action
`Clip
`
`Clip Reader
`
`Decoder
`
`\-1115
`
`I
`
`1113
`
`1112
`
`1111
`
`FIG. 11
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 11 of 49
`
`
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 11 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 11 of 34
`
`US 6,847,778 B1
`
`_ NTSC Field Sequence
`
`-
`
`Region
`
`VBl Line 21 (FCC Mandated)
`
`If Even field. Line 21
`Contains Extended Data
`Services
`(EDS) data (e.g.,
`Time of day, V-chip)
`
`-- Two characters per add field
`
`Circular Buffer
`
`Next Un
`Charactgra
`
`rsed
`
`_
`.
`Next Empty POSItIOn,
`
`Word Parser
`
`Recognizer state machine
`
`\-
`IIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
`
`
`
`Separate into
`W0 rdS
`
`Wordl StateA
`Word2 StateB "-4.
`Word3 StateC
`
`Words added to a special
`segment
`in the fixed-size
`PES buffer.
`
`\1207
`
`Trigger
`Action
`
`Start capture, '
`Stop COPtures
`Phrase seen.
`Etc'
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 12 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 12 of 49
`
`
`
`U. S. Patent
`
`Jan. 25,2005
`
`Sheet 12 of 34
`
`Input
`streams
`
`MPEG
`streams
`
`MPEG
`st reams“
`
`
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 13 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 13 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`43f031teehS
`
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1.
`
`Exhibit 1008
`Page 14 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 14 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 14 of 34
`
`US 6,847,778 B1
`
`1501
`
`1505
`
` Media
`
`Control
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 15 of 49
`
`
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 15 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 15 0f 34
`
`
`
`
`
`
`0,.
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 16 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 16 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 16 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`'
`
`Netfllx, Inc. et a1
`
`. E h'bit 1008
`
`)éaée 17 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 17 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 17 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`1§01
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`, X“
`
`1805
`
`
`
`
`
`
`
`
`
`K
`1808
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page180f49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 18 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 18 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`.
`.2420 an1109—‘1234WWWW-xsrwl
`.1'
`Ratéd,PG:-113.fi(SSC H _, "L...
`4'
`-..
`,dy'entur'e'
`ornedy‘ '
`f
`‘
`‘ Duratlnng2:30 Hrs.
`.
`- agW
`
`_
`
`W 1902
`
`
`
`.l-- 1903
`
`
`
`-w 1904
`
`W 1905
`
`1906
`
`
`
`m" 1907
`
`
`
`
`
`
`
`Wlid'Wants tube a millionaire? Paul (Kind) does, and he hopes to hit
`the jackppt as a‘contest'ant on Who Wants to Be a Millionaire, the
`hottest game show on IV; (CC, SS)
`_
`-V
`,
`‘
`.
`._;
`
`
`
`Wed?!
`v
`
`'
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 19 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 19 of 49
`
`
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 19 of 34
`
`
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 20 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 20 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 20 of 34
`
`2008
`
`
`
`2007
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 21 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 21 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 21 0f 34
`
`
`
`
`
`
`I
`KR our tutu totin’ super hero dan
`evil engineer§ in a delightful battle of‘
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 22 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 22 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 22 0f 34
`
`
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 23 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 23 of 49
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 23 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`US. Patent
`
`
`
`‘
`
`
`
`3* Movies.
`- \a'v-xs-wn a
`
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 24 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 24 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 24 0f 34
`
`
`
`
`
`
`
`
`
`
`69, "out'fth’enoPéo" a'zdseuleinfo
`{ea mauan
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 25 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 25 of 49
`
`
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 25 0f 34
`
`US 6,847,778 B1
`
`2405
`
`2403 2404
`
`f
`
`2405
`2401
`I
`_ /
`
`2407
`
`
`
`mé mm?
`' TheSin-jpsons;
`The Sihfis’o'ns.
`
`The Siffinsofls;
`
`.
`
`.,
`
`'
`
`'
`
`.,
`
`I
`
`'
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 26 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 26 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 26 of 34
`
`
`
`Fig. 25
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 27 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 27 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 27 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`.
`
`, "fa!
`
`‘
`
`
`
`ty=fl¢wr1tmrn
`. m~.., mM...v..1£f,""""'"m I.
`7.
`a
`'
`'
`FMan—nuraus'p'u'n ,
`J
`\
`IQQQ»M-
`7.
`6”“
`,
`-,
`7 w '5‘;
`
`
`
`
`
`2602
`
`2606
`
`2610
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 28 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 28 of 49
`
`
`
`US. Patent
`
`2705
`
`
`
`2716
`
`Jan. 25,2005
`
`Sheet 28 of 34
`
`US 6,847,778 B1
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 29 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 29 of 49
`
`
`
`
`
`.//
`m » the Magic $61001. "
`=30 bin"; The Magic Sum; .
`.
`I
`j'MétRAngetls'Zeaf
`".1519 Magldfi;
`swim»
`.ThaNawAddam ‘
`Jfawékfi-N”
`Hein'g'tm'mmgm:
`
`,.
`
`I;
`Kd's'o‘
`14 Km
`‘51? W08 f
`‘20'
`‘Kew’a' Itov‘e‘tuc
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 29 0f 34
`
`US 6,847,778 B1
`
`2809 2810
`\2898 2807
`
`\
`
`2,806
`
`.
`
`.
`
`.
`
`.
`
`7
`
`‘
`
`I
`
`.
`
`..‘J:'
`
`:
`
`‘;
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 30 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 30 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 30 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`,
`
`-
`
`‘
`
`:1”
`
`l
`.
`_ H” A
`I
`.@'Brimstone
`’-'
`ve‘tak
`-
`'MOumlngAltef: Stoneleam‘s hell's esoap s
`over his wife's suburban community. Wllh: Judi Dench, Billy
`Connqlly. Geoffrey Palmer, Anthony shat; Gerald Butler,
`_,..Rlchard Pasco. David Weslhead. Note:
`.
`
`
`
`{limbopM to mom " 1,1: -. Bates: : (a)
`
`‘
`
`‘_
`
`.
`
`_
`
`‘
`
`I
`
`‘
`
`i
`
`~
`
`. B“"( ‘ :00 pm)”
`
`V
`
`.Egimgtgfig:
`Valentine Special
`Providence
`Kicls Say...
`Twa’ofa Kind
`
`The X-Files
`
`T
`
`'-
`
`Washinglon Week...
`. First-Time Felon
`
`-
`
`- All Channels
`I. Flavqritggw
`' Movies"
`Spor ‘
`Child en
`
`Dram .
`
`_
`
`Sci-fl
`-
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 31 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 31 of 49
`
`
`
`
`
`The X-Files
`Godzilla
`GODZILLA PART 1
`Lost in Space
`Lost in...
`
`FwdA
`/\
`
`Lost in.'..
`
`Godzilla
`
`US. Patent
`
`Jan. 25, 2005
`
`Sheet 31 of34
`
`US 6,847,778 B1
`
`1
`
`,
`
`v V.
`
`‘
`
`‘ All Channels
`Favorites
`Movies '
`Sport's
`Childr n
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 32 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 32 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 32 of 34
`
`US 6,847,778 B1
`
`45A
`fAllCh‘annels
`<4
`V Favorites
`Movles
`
`Sports
`Children
`
`Drama
`
`Sci-fl
`
`1>
`
`‘
`
`_
`
`105 ABC Kids Say...
`106 CBS Two ofaKln
`
`"
`
`107 HBO The X-Files
`
`108 TNN Washington
`109 MTV First-TimeF
`
`
`
`8:00 pm
`F-
`102 FOX Brimstone
`103 NKPXValemineSp
`' 104 NBC Providence
`
`3'103
`
`3101
`
`3102
`
`Fig. 31
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 33 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 33 of 49
`
`
`
`
`US. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 33 0f 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`3:09 PM to 9:30 PM "jailed : (H)
`
`...m”°°“< 8:00 pm>7*""‘1
`g102.,EOXffiBrlniétnnéj'fi1‘
`" 103 NKPXValentlne Sp
`‘104 NBC Frovidence'
`105 ABC Kids Say...
`106 CBS Two of a Kin
`107 HBO TheX-Files
`108 TNN Washington
`109.MTV First-Trim .
`
`.
`
`:
`
`"
`
`.
`
`“"‘K 102 .c‘
`'a:’u piston”; _
`_
`_
`M*A*S*H
`Judge Mills Lane
`Change of Heart
`Love Connection
`Godzilla.
`.
`Starshlp Troopers
`Barney.
`
`; @B .‘mstOneu ‘
`-- Mou 'lng.A(ler: Stone [Earns hell‘s escapees ave taken
`.
`over his wife's suburban'communlly. With: Judi Bench, Billy
`Connolly, Geoffrey Palmer, Anthony Sher, Gerald Butler,
`Richard Pasco, David Masthead. Note:
`_
`'
`-
`
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 34 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 34 of 49
`
`
`
`US. Patent
`
`Jan. 25,2005
`
`Sheet 34 0f 34
`
`US 6,847,778 B1
`
`-
`
`; "'éioo PM to 9:30 PM .
`
`, Ratéd : (a)
`
`8£Opm
`7‘
`‘10'2'F'ox anm’sm'nef‘
`V103. N‘K‘P‘X Valentinemsip
`104 N80 Providence
`
`0
`
`_
`
`_
`
`0.
`8:30
`9:00
`
`105 ABC Kids Say...
`106 CBS Two of a Kin
`
`107 HBO The X-Files
`
`108 TNN Washington
`109 MTV Flrst-TlmeF
`
`9:30
`10:0
`
`I. (:3 Brimstone
`Mourning After: Stone leams hell's escapees have taken
`over his wife‘s suburban community. With: Judi Dench, Billy
`Connolly, Geoffrey Palmer. Anthony Sher, Gerald Butler,
`Richard Pasco, David Westhead. Note: 0
`'
`‘
`'
`
`
`
`M*A*S*H
`
`waxJudge Mills Lane
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 35 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 35 of 49
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`1
`MULTIMEDIA VISUAL PROGRESS
`
`
`INDICATION SYSTEM
`
`
`CROSS REFERENCE TO RELATED
`
`
`
`APPLICATIONS
`
`
`
`
`
`
`This application claims benefit of US. Provisional Appli-
`
`
`
`
`
`
`
`cation No. 60/127,178 filed Mar. 30, 1999.
`
`
`
`
`
`
`
`BACKGROUND OF THE INVENTION
`
`
`
`
`
`
`
`
`
`
`
`
`1. Technical Field
`
`
`
`The invention relates to the interactive display of viewer
`
`
`
`
`
`
`
`
`information in a computer environment. More particularly,
`
`
`
`
`
`
`the invention relates to interactive mode and progress indi-
`
`
`
`
`
`
`
`
`cators in a computer environment.
`
`
`
`
`
`2. Description of the Prior Art
`
`
`
`
`
`
`Multimedia devices such as VCRs, DVD players, MP3
`
`
`
`
`
`
`
`
`players, cassette players, CD players, video tape editors, and
`
`
`
`
`
`
`
`
`
`the new class of Personal Video Recorders (PVR) are
`
`
`
`
`
`
`
`
`
`extremely popular with consumers. Almost every household
`
`
`
`
`
`
`
`in the United States has at least one of these devices.
`
`
`
`
`
`
`
`
`
`
`
`The most common complaint (and joke) is that VCRs, in
`
`
`
`
`
`
`
`
`
`particular, are difficult to use and understand. This complaint
`
`
`
`
`
`
`
`
`is typical of the majority of multimedia devices.
`
`
`
`
`
`
`
`
`One of the major areas that ease of use is lacking is in the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`program material progression indication. VCRs and DVD
`
`
`
`
`
`
`
`players commonly display the terms “FWD” for
`fast
`
`
`
`
`
`
`
`
`forward, “REV” for reverse, “PLAY” for play on the screen,
`
`
`
`
`
`
`
`
`
`
`telling the user that what mode he has selected. Other
`
`
`
`
`
`
`
`
`
`
`systems display their own set of terms or phrases to the user
`
`
`
`
`
`
`
`
`
`
`
`
`for each mode.
`
`
`
`Additionally, the display of numeric counters are used by
`
`
`
`
`
`
`
`
`
`many manufacturers to tell the user the progression and
`
`
`
`
`
`
`
`
`
`position of the tape, CD, DVD, or MP3. For example, a four
`
`
`
`
`
`
`
`
`
`
`
`
`digit counter is displayed on the TV screen or dedicated
`
`
`
`
`
`
`
`
`
`
`display. The user can surmise what direction the media is
`
`
`
`
`
`
`
`
`
`
`progressing in by observing whether the counter is incre-
`
`
`
`
`
`
`
`
`menting or decrementing.
`
`
`
`The problem with these approaches are that multimedia
`
`
`
`
`
`
`
`equipment manufacturers do not use a consistent user inter-
`
`
`
`
`
`
`
`
`face. Terms, phrases, and counters are cryptic at best.
`
`
`
`
`
`
`
`
`
`Further, terms, phrases, and counters are not intuitive to the
`
`
`
`
`
`
`
`
`
`
`majority of the general public.
`
`
`
`
`
`It would be advantageous to provide a multimedia visual
`
`
`
`
`
`
`
`
`
`progress indication system that is visually intuitive to the
`
`
`
`
`
`
`
`
`
`user and communicates the operation and progression of the
`
`
`
`
`
`
`
`
`
`program material.
`It would further be advantageous to
`
`
`
`
`
`
`
`
`provide a system that is easily standardized and used for any
`
`
`
`
`
`
`
`
`
`
`media.
`
`
`
`
`SUMMARY OF THE INVENTION
`
`
`
`
`The invention provides a multimedia visual progress
`
`
`
`
`
`
`
`indication system. The system communicates information to
`
`
`
`
`
`
`
`the user in a simple, visually intuitive fashion. In addition,
`
`
`
`
`
`
`
`
`
`
`the invention provides a system that the user can easily
`
`
`
`
`
`
`
`
`
`
`interact with and is not dependent on the media type.
`
`
`
`
`
`
`
`
`
`
`Apreferred embodiment of the invention provides a trick
`
`
`
`
`
`
`
`
`play bar that
`is overlaid onto the program material or
`
`
`
`
`
`
`
`
`
`
`displayed on a dedicated display. A cache bar inside of the
`
`
`
`
`
`
`
`
`
`
`
`trick play bar indicates the length of a recording session or
`
`
`
`
`
`
`
`
`
`
`the length of stored program material.
`
`
`
`
`
`
`The cache bar expands to the right when material is being
`
`
`
`
`
`
`
`
`
`
`recorded. Every half hour (or selected increment), the cache
`
`
`
`
`
`
`
`
`bar slides to the left.
`
`
`
`
`
`Time marks are displayed inside the trick play bar giving
`
`
`
`
`
`
`
`
`
`
`the user a visual reference point from which to judge the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`
`
`25
`
`
`30
`
`
`
`35
`
`
`
`40
`
`
`
`45
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`
`
`
`2
`time reference points. The time
`current time and visual
`
`
`
`
`
`
`
`
`marks are in any increment of time needed.
`
`
`
`
`
`
`
`
`The total length of the stored program material or next
`
`
`
`
`
`
`
`
`
`
`time or counter increment in the recording cycle is displayed
`
`
`
`
`
`
`
`
`
`
`on the right hand end of the trick play bar.
`
`
`
`
`
`
`
`
`
`
`A position indicator moves within the trick play bar and
`
`
`
`
`
`
`
`
`
`
`tells the user visually where his current position is within the
`
`
`
`
`
`
`
`
`
`
`
`program material. A slider moves along the trick play bar
`
`
`
`
`
`
`
`
`
`
`and on top of the cache bar. The slider along with the
`
`
`
`
`
`
`
`
`
`
`
`
`position indicator are linked together and can be moved
`
`
`
`
`
`
`
`
`
`anywhere within the cache bar by the user. The slider
`
`
`
`
`
`
`
`
`
`
`displays the numeric time or counter mark of the current
`
`
`
`
`
`
`
`
`
`
`position.
`
`A mode indicator is positioned below the slider and
`
`
`
`
`
`
`
`
`
`follows the slider’s movement. The mode indicator displays
`
`
`
`
`
`
`
`
`whether the user is in play, record, pause, slow play, fast
`
`
`
`
`
`
`
`
`
`
`
`play, fast forward (1x, 2x, and 3x), slow reverse play, slow
`
`
`
`
`
`
`
`
`
`
`
`reverse, and fast reverse (1x, 2x, and 3x) modes. The 1x, 2x,
`
`
`
`
`
`
`
`
`
`
`
`
`and 3x speeds are adjustable by the system to be any
`
`
`
`
`
`
`
`
`
`
`
`variable desired (e.g., 2><, 16x, and 32x).
`
`
`
`
`
`
`
`The trick play bar and its associated components are
`
`
`
`
`
`
`
`
`
`displayed for a predetermined time period when overlaid
`
`
`
`
`
`
`
`
`onto the program material.
`
`
`
`
`Other aspects and advantages of the invention will
`
`
`
`
`
`
`
`become apparent from the following detailed description in
`
`
`
`
`
`
`
`combination with the accompanying drawings, illustrating,
`
`
`
`
`
`by way of example, the principles of the invention.
`
`
`
`
`
`
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`FIG. 1 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention according to the
`
`
`
`
`
`
`
`
`
`invention;
`
`FIG. 2 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the invention using multiple input and output
`
`
`
`
`
`
`
`
`modules according to the invention;
`
`
`
`
`
`FIG. 3 is a schematic diagram of an Moving Pictures
`
`
`
`
`
`
`
`
`
`
`Experts Group (MPEG) data stream and its video and audio
`
`
`
`
`
`
`
`
`
`
`components according to the invention;
`
`
`
`
`
`FIG. 4 is a block schematic diagram of a parser and four
`
`
`
`
`
`
`
`
`
`
`
`direct memory access (DMA) input engines contained in the
`
`
`
`
`
`
`
`
`
`Media Switch according to the invention;
`
`
`
`
`
`
`FIG. 5 is a schematic diagram of the components of a
`
`
`
`
`
`
`
`
`
`
`packetized elementary stream (PES) buffer according to the
`
`
`
`
`
`
`
`invention;
`
`FIG. 6 is a schematic diagram of the construction of a PES
`
`
`
`
`
`
`
`
`
`
`buffer from the parsed components in the Media Switch
`
`
`
`
`
`
`
`
`
`output circular buffers;
`
`
`
`FIG. 7 is a block schematic diagram of the Media Switch
`
`
`
`
`
`
`
`
`
`
`and the various components that
`it communicates with
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 8 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`of the program logic according to the invention;
`
`
`
`
`
`
`
`
`FIG. 9 is a block schematic diagram of a class hierarchy
`
`
`
`
`
`
`
`
`
`of the program logic according to the invention;
`
`
`
`
`
`
`
`
`FIG. 10 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the clip cache component of the invention
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 11 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the invention that emulates a broadcast
`
`
`
`
`
`
`
`studio video mixer according to the invention;
`
`
`
`
`
`
`
`FIG. 12 is a block schematic diagram of a closed caption
`
`
`
`
`
`
`
`
`
`parser according to the invention;
`
`
`
`
`
`FIG. 13 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention utilizing a VCR
`
`
`
`
`
`
`
`
`
`as an integral component of the invention according to the
`
`
`
`
`
`
`
`
`
`
`invention;
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Netflix, Inc. et a1. Exhibit 1008
`Page 36 of 49
`
`Netflix, Inc. et al. Exhibit 1008
`
`Page 36 of 49
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`3
`FIG. 14 is a diagram of a remote control according to the
`
`
`
`
`
`
`
`
`
`invention;
`
`FIG. 15 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention showing the
`
`
`
`
`
`
`
`
`
`viewer interface module interaction according to the inven-
`
`
`
`
`
`
`
`tion;
`
`FIG. 16 is a schematic diagram of a central menu screen
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 17 is a schematic diagram of a program list screen
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 18 is a schematic diagram of a detailed program
`
`
`
`
`
`
`
`
`
`information screen according to the invention;
`
`
`
`
`
`
`FIG. 19 is a schematic diagram of a detailed program
`
`
`
`
`
`
`
`
`
`information screen according to the invention;
`
`
`
`
`
`
`FIG. 20a is a schematic diagram of a small banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 20b is a schematic diagram of a medium banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 20c is a schematic diagram of a detailed banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 21 is a schematic diagram of a suggested program
`
`
`
`
`
`
`
`
`
`list screen according to the invention;
`
`
`
`
`
`
`FIG. 22 is a schematic diagram of a network listing screen
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 23 is a schematic diagram of a program theme list
`
`
`
`
`
`
`
`
`
`screen according to the invention;
`
`
`
`
`
`FIG. 24 is a schematic diagram of a todo list screen
`
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 25 is a schematic diagram of a conflict warning
`
`
`
`
`
`
`
`
`
`screen according to the invention;
`
`
`
`
`
`FIG. 26 is a schematic diagram of a trick play bar overlaid
`
`
`
`
`
`
`
`
`
`on program material according to the invention;
`
`
`
`
`
`
`
`FIG. 27 is a schematic diagram of a the trick bar and its
`
`
`
`
`
`
`
`
`
`
`
`associated components according to the invention;
`
`
`
`
`
`
`FIG. 28 is a schematic diagram of a two column multi-
`
`
`
`
`
`
`
`
`
`
`media schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 29 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 30 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 31 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 32 is a schematic diagram of a two column program
`
`
`
`
`
`
`
`
`
`schedule screen according to the invention; and
`
`
`
`
`
`
`
`FIG. 33 is a schematic diagram of a two column program
`
`
`
`
`
`
`
`
`
`schedule screen showing a program duration indicator
`
`
`
`
`
`
`according to the invention.
`
`
`
`
`DETAILED DESCRIPTION OF THE
`
`
`
`INVENTION
`
`
`
`
`The invention is embodied in a multimedia visual
`
`
`
`
`
`
`
`
`progress indication system in a computer environment. A
`
`
`
`
`
`
`
`
`system according to the invention communicates informa-
`
`
`
`
`
`
`tion to the user in a simple, visually intuitive fashion. In
`
`
`
`
`
`
`
`
`
`
`addition, the invention provides a system that the user can
`
`
`
`
`
`
`
`
`
`easily interact with and is independent of the media type.
`
`
`
`
`
`
`
`
`
`
`Apreferred embodiment of the invention provides a trick
`
`
`
`
`
`
`
`play bar and associated components that visually commu-
`
`
`
`
`
`
`
`nicate the operation and progression through media content.
`
`
`
`
`
`
`
`The trick play bar and its associated components are dis-
`
`
`
`
`
`
`
`
`
`played using a dedicated display (e.g., LCD, LED, Plasma)
`
`
`
`
`
`
`
`
`or by being overlaid over the program material being
`
`
`
`
`
`
`
`
`displayed on a TV or monitor.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`4
`
`Referring to FIG. 1, a preferred embodiment of the
`
`
`
`
`
`
`
`
`invention has an Input Section 101, Media Switch 102, and
`
`
`
`
`
`
`
`
`
`an Qutput Section 103. The Input Section 101 takes televi-
`
`
`
`
`
`
`
`
`
`sion (TV)
`input streams in a multitude of forms,
`for
`
`
`
`
`
`
`
`
`
`
`example, National Television Standards Committee (NTSC)
`
`
`
`
`
`
`or PAL broadcast, and digital forms such as Digital Satellite
`
`
`
`
`
`
`
`
`
`
`System (DSS), Digital Broadcast Services (DBS), or
`
`
`
`
`
`
`
`Advanced Television Standards Committee (ATSC). DBS,
`
`
`
`
`
`
`DSS and ATSC are based on standards called Moving
`
`
`
`
`
`
`
`
`
`Pictures Experts Group 2 (MPEG2) and MPEG2 Transport.
`
`
`
`
`
`
`
`
`MPEG2 Transport is a standard for formatting the digital
`
`
`
`
`
`
`
`
`
`data stream from the TV source transmitter so that a TV
`
`
`
`
`
`
`
`
`
`
`
`receiver can disassemble the input stream to find programs
`
`
`
`
`
`
`
`
`
`in the multiplexed signal. The Input Section 101 produces
`
`
`
`
`
`
`
`
`
`MPEG streams. An MPEG2 transport multiplex supports
`
`
`
`
`
`
`
`multiple programs in the same broadcast channel, with
`
`
`
`
`
`
`
`
`multiple video and audio feeds and private data. The Input
`
`
`
`
`
`
`
`
`
`
`Section 101 tunes the channel
`to a particular program,
`
`
`
`
`
`
`
`
`
`extracts a specific MPEG program out of it, and feeds it to
`
`
`
`
`
`
`
`
`
`
`
`
`the rest of the system. Analog TV signals are encoded into
`
`
`
`
`
`
`
`
`
`
`
`a similar MPEG format using separate video and audio
`
`
`
`
`
`
`
`
`
`encoders, such that the remainder of the system is unaware
`
`
`
`
`
`
`
`
`
`
`of how the signal was obtained. Information may be modu-
`
`
`
`
`
`
`
`
`
`lated into the Vertical Blanking Interval (VBI) of the analog
`
`
`
`
`
`
`
`
`
`
`TV signal in a number of standard ways; for example, the
`
`
`
`
`
`
`
`
`
`
`
`North American Broadcast Teletext Standard.
`(NABTS)
`
`
`
`
`
`
`may be used to modulate information onto lines 10 through
`
`
`
`
`
`
`
`
`
`
`20 of an NTSC signal, while the FCC mandates the use of
`
`
`
`
`
`
`
`
`
`
`
`
`line 21 for Closed Caption (CC) and Extended Data Services
`
`
`
`
`
`
`
`
`
`
`(EDS). Such signals are decoded by the input section and
`
`
`
`
`
`
`
`
`
`
`passed to the other sections as if they were delivered via an
`
`
`
`
`
`
`
`
`
`
`
`
`MPEG2 private data channel.
`
`
`
`
`The Media Switch 102 mediates between a microproces-
`
`
`
`
`
`
`
`sor CPU 106, hard disk or storage device 105, and memory
`
`
`
`
`
`
`
`
`
`
`
`104. Input streams are converted to an MPEG stream and
`
`
`
`
`
`
`
`
`
`
`sent to the Media Switch 102. The Media Switch 102 buffers
`
`
`
`
`
`
`
`
`
`
`
`the MPEG stream into memory. It then performs two opera-
`
`
`
`
`
`
`
`
`
`tions if the user is watching real time TV: the stream is sent
`
`
`
`
`
`
`
`
`
`
`
`
`
`to the Output Section 103 and it is written simultaneously to
`
`
`
`
`
`
`
`
`
`
`
`the hard disk or storage device 105.
`
`
`
`
`
`
`
`The Output Section 103 takes MPEG streams as input and
`
`
`
`
`
`
`
`
`
`
`produces an analog TV signal according to the NTSC, PAL,
`
`
`
`
`
`
`
`
`
`
`or other required TV standards. The Output Section 103
`
`
`
`
`
`
`
`
`
`contains an MPEG decoder, On-Screen Display (OSD)
`
`
`
`
`
`
`
`generator, analog TV encoder and audio logic. The OSD
`
`
`
`
`
`
`
`
`
`generator allows the program logic to supply images which
`
`
`
`
`
`
`
`
`
`will be overlaid on top of the resulting analog TV signal.
`
`
`
`
`
`
`
`
`
`
`
`Additionally, the Output Section can modulate information
`
`
`
`
`
`
`
`supplied by the program logic onto the VBI of the output
`
`
`
`
`
`
`
`
`
`
`
`signal in a number of standard formats, including NABTS,
`
`
`
`
`
`
`
`
`
`CC and EDS.
`
`
`
`With respect to FIG. 2, the invention easily expands to
`
`
`
`
`
`
`
`
`
`
`accommodate multiple Input Sections (tuners) 201, 202,
`
`
`
`
`
`
`
`203, 204, each can be tuned to different types of input.
`
`
`
`
`
`
`
`
`
`
`
`Multiple Output Modules (decoders) 206, 207, 208, 209 are
`
`
`
`
`
`
`
`
`
`added as well. Special effects such as picture in a picture can
`
`
`
`
`
`
`
`
`
`
`
`be implemented with multiple decoders. The Media Switch
`
`
`
`
`
`
`
`
`205 records one program while the user is watching another.
`
`
`
`
`
`
`
`
`
`
`This means that a stream can be extracted off the disk while
`
`
`
`
`
`
`
`
`
`
`
`another stream is being stored onto the disk.
`
`
`
`
`
`
`
`
`Referring to FIG. 3, the incoming MPEG stream 301 has
`
`
`
`
`
`
`
`
`
`interleaved video 302, 305, 306 and audio 303, 304, 307
`
`
`
`
`
`
`
`
`
`segments. These elements must be separated and recom-
`
`
`
`
`
`
`
`bined to create separate video 308 and audio 309 streams or
`
`
`
`
`
`
`
`
`
`
`
`buffers. This is necessary because separate decoders are used
`
`
`
`
`
`
`
`