(12) United States Patent
`Vallone et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 6,847,778 B1
`Jan. 25, 2005
`
`US006847778B1
`
`EP
`EP
`wo
`W0
`wo
`WO
`
`0 sos 279 A2
`0 889 649 A3
`93/08664
`94/14282
`95/ssoos
`98/12872
`
`2/1999
`8/1999
`4/1993
`6/1994
`11/1995
`3/1998
`
`......... .. G11B/27/10
`H04N/5/775
`
`.. H04N/5/78
`.......... .. I'I04N/7/16
`.......... .. H04N/7/S2
`.......... .. I-l04N/5/44
`
`* cited by examiner
`
`Primary Examiner—Robert Chevalier
`(74) Attorney, Agent, or Fir-m—Kirk D. Wong; Hickman
`Palermo Truong & Becker LLP
`
`(57)
`
`ABSTRACT
`
`A multimedia visual progress indication system that pro-
`vides a trick play bar that is overlaid onto the program
`material or displayed on a dedicated display. A cache bar
`inside of the trick play bar indicates the length of a recording
`session or the length of stored program material and expands
`to the right when material is being recorded. Every half hour
`(or selected increment), the cache bar slides to the left. Time
`marks are displayed inside the trick play bar giving the user
`a visual reference point from which to judge the current time
`and visual time reference points. The time marks are in any
`increment of time needed. The total length of the stored
`program material or next time or counter increment in the
`recording cycle is displayed on the right hand end of the
`trick play bar. A position indicator moves within the trick
`play bar and tells the user visually where his current position
`is within the program material. A slider moves along the
`trick play bar and on top of the cache bar and is linked to the
`position indicator and can he moved anywhere within the
`cache bar by the user. The slider displays the numeric time
`or counter mark of the current position. A mode indicator is
`positioned below the slider and follows the s1ider’s move-
`ment and displays whether the user is in play, record, pause,
`slow play, fast play, fast forward (lx, 2x, and 3x), slow
`reverse play, slow reverse, and fast reverse (lx, 2x, and 3x)
`modes. The 1x, 2x, and 3x speeds are adjustable by the
`system to be any variable desired (e.g., 2x, 16x, and 32x).
`The trick play bar and its associated components are dis-
`played for a predetermined time period when overlaid onto
`the program material.
`
`39 Claims, 34 Drawing Sheets
`
`(54) MULTIMEDIA VISUAL PROGRESS
`INDICATION SYSTEM
`
`(75)
`
`Inventors: Robert Vallone, Palo Alto, CA (US);
`Howard Look, Mountain View, CA
`(US); Ain McKendrick, Menlo Park,
`CA (US)
`
`(73) Assignee: Tivo, Inc., Alviso, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(1)) by 0 days.
`
`(21) Appl. No.: 09/539,433
`
`(22) Filed:
`
`Mar. 30, 2000
`
`(60)
`
`Related U.S. Application Data
`Provisional application No. 60/127,178, filed on Mar. 30,
`1999.
`
`
`
`H04N 5/91
`Int. Cl.7
`(51)
`386/68; 386/46
`............... ..
`(52) U.S. Cl.
`386/68, 69, 52,
`(58) Field of Search
`386/55, 46, 1, 4, 6, 70, 82, 125, 126, 124,
`45, 40, 83; 360/32; H04N 5/91
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`........... 364/200
`369/32
`386/9
`348/565
`715/530
`386/46
`348/564
`386/85
`345/719
`
`
`
`7/1986 Schwartz et al.
`4,600,989 A
`11/1991 Custeis et al.
`5,063,547 A
`5,206,738 A “ 4/1993 Nishigaki et al.
`5,502,504 A
`3/1996 Murshallet al.
`5,513,306 A “ 4/1996 Mills etal.
`5,701,383 A * 12/1997 Russo et ul.
`5,710,601 A
`1/1998 Marshall et al.
`5,878,186 A
`3/1999 Bennett et al.
`5,903,264 A “
`5/1999 Moeller et al.
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`
`0 435 370 A2
`0 691 651 Al
`0 764 951 A1
`0 889 649 A2
`
`7/1991
`l/1996
`3/1997
`l/1999
`
`........... .. H03]/9/06
`......... .. G11B/27/34
`....... .. Gl1B/27/034
`........ .. H04N/5/775
`
`
`
`2602
`
`2606
`
`2603
`
`2604
`
`2607
`
`2605
`
`2608
`
`Roku, Inc. Exhibit 1008
`
`2610
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25,2005
`
`
`
`
`
`
`Sheet 1 of 34
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`
`
`
`
`Sheet 2 of 34
`
`
`
`US 6,847,778 B1
`
`
`
`207
`
`
`
`
`Input
`lVl0ClUl€
`
`
`
`Input
`
`
`Module
`
`
`Input
`Module
`
`
`
`Input
`
`
`
`
`
`202
`
`
`
`_
`
`203
`
`
`
`204
`
`
`
`
`Output
`
`Module
`
`205
`
`
`
`7 Output
`
`
`Module
`
`
`Medici
`Switch
`
`
`
`
`
`Output
`Module
`
`
`
`
`Output
`
`
`
`
`206
`
`
`
`207
`
`
`
`208
`
`
`
`209
`
`
`
`1710.2
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 3 of 34
`
`US 6,847,778 B1
`
`III
`
`308
`
`.
`
`302
`
`A
`m’IIflIME
`
`305
`306
`
`307
`
`309 i
`
`FIG. 3
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 4 of 34
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`406
`
`
`407
`
`.
`
`
`
`
`
`pol” er
`409
`
`
`
`
`
`
`'‘
`“m't
`
`
`470
`I--
`video buffer
`
`
`
`
`471-
`
`
`40;
`
`
`
`
`402
`
`nex
`408
`
`
`
`
`
`
`
`I
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`403
`
`
`
`
`404
`
`nex
`
`
`
`poln er
`405J
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`"’“"‘ jmm '-
`
`GUdlO buffer
`
`
`mm
`
`
`
`
`
`'-
`
`l|m't
`
`
`
`
`
`«472
`
`.
`
`
`private data buffer
`
`
`
`
`473
`luj
`event buffer
`
`
`
`iRoku,Inc.
`
`iExhflnt1008
`
`FIG. 4
`
`
`
`5011
`
`
`address
`
`
`
`
`
`type
`
`
`
`
`
`FIG. 5
`
`time stamp
`
`
`502
`
`
`503
`
`504
`
`Roku, Inc. Exhibit 1008
`
`

`
`U. S. Patent
`
`Jan. 25, 2005
`
`Sheet 5 of 34
`
`Us 6,847,778 B1
`
`M d,
`°
`
`S _t h
`W’ °
`
`Type = I-FRAME
`Timestomp = 095453
`
`604
`
`Events
`Translated t
`A Logical
`Segments
`
`\
`
`iRoku,Inc.
`
`iEXhflflt1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25, 2005
`
`Sheet 6 of 34
`
`Us 6,847,778 B1
`
`hard disk
`
`VB] data
`
`Mpgc;
`encoder
`
`'
`
`MPEG
`decoder
`
`ogd io
`V Ideo
`on- sc reen
`
`display
`
`iRoku,Inc.
`
`iEXhflflt1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 7 of 34
`
`US 6,847,778 B1
`
`801
`
`803
`
`Transforms
`
`encoder
`
`decode r
` 804 -
`
`hard disk
`
`FIG. 8
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25, 2005
`
`Sheet 3 of 34
`
`US 6,847,778 B1
`
`Tmk Core
`
`ushmnauf
`
`Pnpelme
`
`Pnpelme
`Tmk Source
`
`Media Switch
`
`nextFuHBuf
`
`9”’
`
`9’5
`
`dagger
`
`decoder
`
`918
`
`push
`
`current
`
`\ 919
`
`\920
`
`FIG. .9
`
`iRoku,Inc.
`
`iEXhflflt1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25, 2005
`
`Sheet 9 of 34
`
`US 6,847,778 B1
`
`1002—\
`
`TmkC I ipCoche
`
`Tm!<Clip
`Writer
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`USJ%mm
`
`Jmnmm %mmMM
`
`IEQMMRBI
`
`1114-
`
`,1101
`
`"02
`
`Push
`Switch
`
`TV Signal
`
`7706
`
`Clip
`Wriier
`
`
`
`
`
`Cache
`Transform
`
`0811
`
`Clip Reader
`
`1107 -
`
`FIG. 11
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 11 of34
`
`US 6,847,778 B1
`
`_ NTSC Field Sequence
`
`-
`
`Region
`
`VB] Line 21 (rec Mandated)
`
`If Even field, Line 21
`Contains Extended Data
`Services (EDS) data (e.g.,
`Time of day, V-chip)
`
`:— Two characters per odd field
`
`\ -)Circu|ar Buffer
`
`Next Un
`Chomcigf
`
`rsed
`
`" .
`Next Empty Position
`
`Recognlzer state machine
`
`Separate into
`word
`S
`
`w dl st t A
`w3.'—d2 stitie ----;.
`Words StateC
`
`Words added to a special
`segment
`in the fixed-size
`PES buffer.
`
`\r2o7
`
`"Trigger
`Action
`
`Start capture, '
`st°P °°Pt‘"e*
`Ph'°'5° 59°"-
`Etc‘
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U. S. Patent
`
`Jan. 25, 2005
`
`Sheet 12 of 34
`
`US 6,847,778 B1
`
`Input
`streams
`
`MPEG
`streams
`
`MPEG
`st rearns_
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`43f031teehS
`
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 14 of 34
`
`US 6,847,778 B1
`
`1501
`
`1505
`
` Media
`
`Control
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 15 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`.51.-
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 16 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 17 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`1807
`c
`
`
`
`
`
`1§O1
`
`
`
`
`
`
`
`
`
`
`
`36,
`" ffltlulatlon
`'
`’
`'h.l¢d.IV-P6.(D)‘”
`tuatl. An V
`
`
`
`
`
`
`
`
`
`
`1805
`
`
`
`K
`1808
`
`1813
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 18 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`"' 1902
`
`.,.. 1903
`
`—« 1904
`
`~— 1905
`
`1906
`
`
`
`"“ 1907
`
`Wlidwants tube a millionaire? Paul (Kind) does. and he hopes to hit
`the jackppt as a"contest'ant on Who Wants to Be a Millionaire_.vti1e
`lwtlest‘ game show on IV.‘ (CC, SS)
`_
`—v
`,
`.
`.
`.
`
`.
`£ln1109~A123«54WWWW-ww4
`Weds .2_.a—2.o
`.7
`--
`Ratéd_.PG-;1,3,V(SSC._ _,
`'
`o'r_nedy'
`A «-. , dyenturé
`.
`’
`l
`‘ Du_ratlnn:_2:3_O Hrs.
`- ag
`
`_
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 19 of 34
`
`US 6,847,778 B1
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25, 2005
`
`Sheet 20 of 34
`
`US 6,847,778 B1
`
`2007
`
`2008
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 21 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`KR our tutu totin’ super hero d}-a'riE:“és‘"ii,Jit "'_th
`evil engineerg in a delightful battle of
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 22 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 23 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`.
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U°S° Patent
`
`
`
`Jam 25, 2005
`
`
`
`Sheet 24 of 34
`
`
`
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`Ge ‘out‘fth9no’p?>.o'.' a”dseu!eIh.fo
`fez"! ure’Suhqay
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 25 of 34
`
`Us 6,847,778 B1
`
`2405
`
`2403 2404
`
`5
`
`2405
`
`2401
`
`2_407
`
`“
`
`’
`
`V 1?!§7$;fl.‘.P39hs¢.
`n.es;mpm=
`The Sinfpsons .-
`The Slnfnxiisohns
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25,2005
`
`Sheet 26 of 34
`
`US 6,847,778 31
`
`Fig. 25
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 27 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`P
`
`'
`
`$."!If'>"=I'£‘I$'1*7"'f' .
`.
`"A" ‘4lI—.u'v-auuuv-z'a:UTll'PI7F
`1"" ‘*|‘”“""."-""-
`‘apv
`:7
`I
`.
`‘_, J‘.
`V.
`
`I
`
`2602
`
`2606
`
`2610
`
`
`
`“'
`
`‘
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25, 2005
`
`Sheet 23 of 34
`
`US 6,847,778 B1
`
`2705
`
`2716
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 29 of 34
`
`Us 6,847,778 B1
`
`2510
`
`\\28_‘08 2807
`
`\
`
`2’806
`
`_,./"
`, m~ ‘n_1eMag1cSt:!1uo!;f..-.'
`0
`The Magic Sd1oi$!f.
`7 pm Ranges" Ze<':
`‘:'_inQM§g1dank
`'
`Spiderlmn 7
`.moNewAddam
`
`%
`
`.
`_
`_
`I
`- K0E0'
`
`.»
`
`:
`‘
`.,
`L’ " -
`
`}
`
`'
`
`‘2o" _kew8' Ilovéluc
`
`_;
`
`'.'~HOtIiéImptoveméf\
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Pate t11
`
`
`
`Jam 25, 2005
`
`
`
`Sheet 30 of 34
`
`
`
`
`
`
`Us 6,847,778 B1
`
`
`
`
`
`
`.
`.
`A
`,,
`,
`_
`_
`_
`.@'Bri_mstone
`’-'
`vetak
`-
`'Moumtng_A!ter': stoneleams h'eII's escap s
`over his wife's suburban community. with: Judi Dench, Billy
`Connolly,-. Geoffrey Palmer, Anthony S_her,-- Gerald _B4u.t_ler,b
`__.,Richard Pasco. David Westhead, Note’:
`.
`
`-
`
`,
`
`- cf
`
`-{‘a:doVApM. to 9:39PM U ,,'.: .. Batod : (a)
`7
`
`% aw *;oopm>~«
`
`‘
`
`'_
`
`.
`
`_
`
`‘
`
`A
`
`é
`
`-_
`
`V’
`
`Valentine Special
`Providence
`Kids say...
`mm a Kind
`
`The X-Files
`
`»‘
`
`V
`
`Washington Week...
`, Flrst-Time Felon
`
`~
`
`-All Channeis
`A. Favoyitgegm
`‘ _l§1Iqvies._
`Spor -
`chitd en
`
`Dram -
`
`_
`
`Sci-fl
`-
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25,2005
`
`Sheet 31 of34
`
`US 6,847,778 B1
`
`‘All Channels 77
`Favorites
`Movies '
`'
`'
`
`i
`
`_
`
`V
`
`"“"‘( 8:00#pm)""° AA
`2 'TWb-df..é.Kind...-
`The X-Files
`Godzilla
`GODZILLA PART 1
`
`Lost in Space
`Lostin...
`
`Lostin.’..
`
`Godzilla
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U-S- Patent
`
`Jan. 25, 2005
`
`Sheet 32 of 34
`
`US 6,847,778 B1
`
`A '
`’- 7AllCh'annels
`D 102 Fox Brimstone
`" Favorites
`103 NKPXValemineSp
`Movies
`' 104 NBC Providence
`
`A
`
`A
`
`Sports
`Children
`
`Drama
`
`Sci-1|
`
`105 ABC Kids Say...
`106 C88 Two oI‘aK|n
`
`7
`
`107 HBO The X-Files
`
`108 TNN Washington
`109 MTV First—TimeF
`
`3'1o3
`
`310'
`
`3102
`
`Fig. 31
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`U.S. Patent
`
`
`
`Jan. 25, 2005
`
`
`
`Sheet 33 of 34
`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`.
`" Mour'nlng'.A{_ler: stone learns lIe'll‘s esca'p‘ees_ avelaken
`over hls wife's suburban'con'1munlly. With: '.lu.dl Bench, Billy
`Connolly, Geoffrey Palmer, Anthony Sher, Gerald Butler,
`laichard Pasco, Davl;l_).'_Veslh,ead. Note:
`
`‘
`
`azup PM to 9:30 PM gnaied : (n)
`
`.7..."°°*< 3:00 pm)-F“
`mg‘102..,EOXff‘.Brlni§tohé§'_‘1'iT~‘
`" 103 NKPXValentlne Sp
`104 NBC Providence’ .
`105 ABC Kids Say...
`106 C88 Two of a Kin
`107 HBO The X-Files
`108 TNN Washington
`109.ll|lTV First-.Tim .
`
`:
`
`"
`
`
`
`.
`
`““°‘f< 102 I
`'8-'0
`‘.§gfi3f§tj_ofi__;_ _
`_
`_
`M*A*S*H
`Judge Mills Lane
`Change of Heart
`Love Connection
`Godzilla
`Starshlp Trooper;
`Barney
`
`-
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`U.S. Patent
`
`Jan. 25, 2005
`
`Sheet 34 of 34
`
`US 6,847,778 B1
`
`A,
`
`4‘
`Brimstdné
`Mournlng After: Stone learns hell's escapees have taken
`over his wife's suburban community. With: Judi Dench, Billy
`Connolly, Geoffrey Palmer, Anthony Sher, Gerald Butler,
`_ Richard Pasco, David Westhead. Note: .
`'
`'
`.
`
`—
`
`jt "bloc PM to 9:30 PM .
`
`. ma : (R)
`
`,h Bwopm
`‘1oéFb_x s;mm+.e‘0
`ms‘ max "vane-'mine'sp
`104 NBC Providence
`
`9:00
`
`105 ABC Kids say...
`106 CBS Two of a Kin
`
`107 HBO The X-Files
`
`108 TNN Washington
`109 MTV First-TlmeF
`
`‘7
`
`9:30
`10:0
`
`V
`M*A*S*H
`
`10:3&Judge Mills Lane
`
`11:00
`
`hange of Heart
`ve Connection
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`
`US 6,847,778 B1
`
`
`
`
`1
`MULTIMEDIA VISUAL PROGRESS
`
`
`INDICATION SYSTEM
`
`
`CROSS REFERENCE TO RELATED
`
`
`
`APPLICATIONS
`
`
`
`
`
`
`This application claims benefit of U.S. Provisional Appli-
`
`
`
`
`
`
`
`cation No. 60/127,178 filed Mar. 30, 1999.
`
`
`
`
`
`
`
`BACKGROUND OF THE INVENTION
`
`
`
`
`
`
`
`
`
`
`
`
`1. Technical Field
`
`
`
`The invention relates to the interactive display of viewer
`
`
`
`
`
`
`
`
`information in a computer environment. More particularly,
`
`
`
`
`
`
`the invention relates to interactive mode and progress indi-
`
`
`
`
`
`
`
`
`cators in a computer environment.
`
`
`
`
`
`2. Description of the Prior Art
`
`
`
`
`
`
`Multimedia devices such as VCRs, DVD players, MP3
`
`
`
`
`
`
`
`
`players, cassette players, CD players, video tape editors, and
`
`
`
`
`
`
`
`
`
`the new class of Personal Video Recorders (PVR) are
`
`
`
`
`
`
`
`
`
`extremely popular with consumers. Almost every household
`
`
`
`
`
`
`
`in the United States has at least one of these devices.
`
`
`
`
`
`
`
`
`
`
`
`The most common complaint (and joke) is that VCRs, in
`
`
`
`
`
`
`
`
`
`particular, are difficult to use and understand. This complaint
`
`
`
`
`
`
`
`
`is typical of the majority of multimedia devices.
`
`
`
`
`
`
`
`
`One of the major areas that ease of use is lacking is in the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`program material progression indication. VCRs and DVD
`
`
`
`
`
`
`
`players commonly display the terms “FWD” for
`fast
`
`
`
`
`
`
`
`
`forward, “REV” for reverse, “PLAY” for play on the screen,
`
`
`
`
`
`
`
`
`
`
`telling the user that what mode he has selected. Other
`
`
`
`
`
`
`
`
`
`
`systems display their own set of terms or phrases to the user
`
`
`
`
`
`
`
`
`
`
`
`
`for each mode.
`
`
`
`Additionally, the display of numeric counters are used by
`
`
`
`
`
`
`
`
`
`many manufacturers to tell the user the progression and
`
`
`
`
`
`
`
`
`
`position of the tape, CD, DVD, or MP3. For example, a four
`
`
`
`
`
`
`
`
`
`
`
`
`digit counter is displayed on the TV screen or dedicated
`
`
`
`
`
`
`
`
`
`
`display. The user can surmise what direction the media is
`
`
`
`
`
`
`
`
`
`
`progressing in by observing whether the counter is incre-
`
`
`
`
`
`
`
`
`menting or decrementing.
`
`
`
`The problem with these approaches are that multimedia
`
`
`
`
`
`
`
`equipment manufacturers do not use a consistent user inter-
`
`
`
`
`
`
`
`
`face. Terms, phrases, and counters are cryptic at best.
`
`
`
`
`
`
`
`
`
`Further, terms, phrases, and counters are not intuitive to the
`
`
`
`
`
`
`
`
`
`
`majority of the general public.
`
`
`
`
`
`It would be advantageous to provide a multimedia visual
`
`
`
`
`
`
`
`
`
`progress indication system that is visually intuitive to the
`
`
`
`
`
`
`
`
`
`user and communicates the operation and progression of the
`
`
`
`
`
`
`
`
`
`program material.
`It would further be advantageous to
`
`
`
`
`
`
`
`
`provide a system that is easily standardized and used for any
`
`
`
`
`
`
`
`
`
`
`media.
`
`
`
`
`SUMMARY OF THE INVENTION
`
`
`
`
`The invention provides a multimedia visual progress
`
`
`
`
`
`
`
`indication system. The system communicates information to
`
`
`
`
`
`
`
`the user in a simple, visually intuitive fashion. In addition,
`
`
`
`
`
`
`
`
`
`
`the invention provides a system that the user can easily
`
`
`
`
`
`
`
`
`
`
`interact with and is not dependent on the media type.
`
`
`
`
`
`
`
`
`
`
`Apreferred embodiment of the invention provides a trick
`
`
`
`
`
`
`
`
`play bar that
`is overlaid onto the program material or
`
`
`
`
`
`
`
`
`
`
`displayed on a dedicated display. A cache bar inside of the
`
`
`
`
`
`
`
`
`
`
`
`trick play bar indicates the length of a recording session or
`
`
`
`
`
`
`
`
`
`
`the length of stored program material.
`
`
`
`
`
`
`The cache bar expands to the right when material is being
`
`
`
`
`
`
`
`
`
`
`recorded. Every half hour (or selected increment), the cache
`
`
`
`
`
`
`
`
`bar slides to the left.
`
`
`
`
`
`Time marks are displayed inside the trick play bar giving
`
`
`
`
`
`
`
`
`
`
`the user a visual reference point from which to judge the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`
`
`25
`
`
`30
`
`
`
`35
`
`
`
`40
`
`
`
`45
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`
`
`
`2
`time reference points. The time
`current time and visual
`
`
`
`
`
`
`
`
`marks are in any increment of time needed.
`
`
`
`
`
`
`
`
`The total length of the stored program material or next
`
`
`
`
`
`
`
`
`
`
`time or counter increment in the recording cycle is displayed
`
`
`
`
`
`
`
`
`
`
`on the right hand end of the trick play bar.
`
`
`
`
`
`
`
`
`
`
`A position indicator moves within the trick play bar and
`
`
`
`
`
`
`
`
`
`
`tells the user visually where his current position is within the
`
`
`
`
`
`
`
`
`
`
`
`program material. A slider moves along the trick play bar
`
`
`
`
`
`
`
`
`
`
`and on top of the cache bar. The slider along with the
`
`
`
`
`
`
`
`
`
`
`
`
`position indicator are linked together and can be moved
`
`
`
`
`
`
`
`
`
`anywhere within the cache bar by the user. The slider
`
`
`
`
`
`
`
`
`
`
`displays the numeric time or counter mark of the current
`
`
`
`
`
`
`
`
`
`
`position.
`
`A mode indicator is positioned below the slider and
`
`
`
`
`
`
`
`
`
`follows the slider’s movement. The mode indicator displays
`
`
`
`
`
`
`
`
`whether the user is in play, record, pause, slow play, fast
`
`
`
`
`
`
`
`
`
`
`
`play, fast forward (1><, 2x, and 3x), slow reverse play, slow
`
`
`
`
`
`
`
`
`
`
`
`reverse, and fast reverse (1><, 2x, and 3x) modes. The 1x, 2x,
`
`
`
`
`
`
`
`
`
`
`
`
`and 3x speeds are adjustable by the system to be any
`
`
`
`
`
`
`
`
`
`
`
`variable desired (e.g., 2><, 16><, and 32x).
`
`
`
`
`
`
`
`The trick play bar and its associated components are
`
`
`
`
`
`
`
`
`
`displayed for a predetermined time period when overlaid
`
`
`
`
`
`
`
`
`onto the program material.
`
`
`
`
`Other aspects and advantages of the invention will
`
`
`
`
`
`
`
`become apparent from the following detailed description in
`
`
`
`
`
`
`
`combination with the accompanying drawings, illustrating,
`
`
`
`
`
`by way of example, the principles of the invention.
`
`
`
`
`
`
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`FIG. 1 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention according to the
`
`
`
`
`
`
`
`
`
`invention;
`
`FIG. 2 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the invention using multiple input and output
`
`
`
`
`
`
`
`
`modules according to the invention;
`
`
`
`
`
`FIG. 3 is a schematic diagram of an Moving Pictures
`
`
`
`
`
`
`
`
`
`
`Experts Group (MPEG) data stream and its video and audio
`
`
`
`
`
`
`
`
`
`
`components according to the invention;
`
`
`
`
`
`FIG. 4 is a block schematic diagram of a parser and four
`
`
`
`
`
`
`
`
`
`
`
`direct memory access (DMA) input engines contained in the
`
`
`
`
`
`
`
`
`
`Media Switch according to the invention;
`
`
`
`
`
`
`FIG. 5 is a schematic diagram of the components of a
`
`
`
`
`
`
`
`
`
`
`packetized elementary stream (PES) buffer according to the
`
`
`
`
`
`
`
`invention;
`
`FIG. 6 is a schematic diagram of the construction of a PES
`
`
`
`
`
`
`
`
`
`
`buffer from the parsed components in the Media Switch
`
`
`
`
`
`
`
`
`
`output circular buffers;
`
`
`
`FIG. 7 is a block schematic diagram of the Media Switch
`
`
`
`
`
`
`
`
`
`
`and the various components that
`it communicates with
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 8 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`of the program logic according to the invention;
`
`
`
`
`
`
`
`
`FIG. 9 is a block schematic diagram of a class hierarchy
`
`
`
`
`
`
`
`
`
`of the program logic according to the invention;
`
`
`
`
`
`
`
`
`FIG. 10 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the clip cache component of the invention
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 11 is a block schematic diagram of a preferred
`
`
`
`
`
`
`
`
`
`embodiment of the invention that emulates a broadcast
`
`
`
`
`
`
`
`studio video mixer according to the invention;
`
`
`
`
`
`
`
`FIG. 12 is a block schematic diagram of a closed caption
`
`
`
`
`
`
`
`
`
`parser according to the invention;
`
`
`
`
`
`FIG. 13 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention utilizing a VCR
`
`
`
`
`
`
`
`
`
`as an integral component of the invention according to the
`
`
`
`
`
`
`
`
`
`
`invention;
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`
`US 6,847,778 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`3
`FIG. 14 is a diagram of a remote control according to the
`
`
`
`
`
`
`
`
`
`invention;
`
`FIG. 15 is a block schematic diagram of a high level view
`
`
`
`
`
`
`
`
`
`
`of a preferred embodiment of the invention showing the
`
`
`
`
`
`
`
`
`
`viewer interface module interaction according to the inven-
`
`
`
`
`
`
`
`tion;
`
`FIG. 16 is a schematic diagram of a central menu screen
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 17 is a schematic diagram of a program list screen
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 18 is a schematic diagram of a detailed program
`
`
`
`
`
`
`
`
`
`information screen according to the invention;
`
`
`
`
`
`
`FIG. 19 is a schematic diagram of a detailed program
`
`
`
`
`
`
`
`
`
`information screen according to the invention;
`
`
`
`
`
`
`FIG. 20a is a schematic diagram of a small banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 20b is a schematic diagram of a medium banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 20c is a schematic diagram of a detailed banner
`
`
`
`
`
`
`
`
`
`
`displayed over program content according to the invention;
`
`
`
`
`
`
`
`
`FIG. 21 is a schematic diagram of a suggested program
`
`
`
`
`
`
`
`
`
`list screen according to the invention;
`
`
`
`
`
`
`FIG. 22 is a schematic diagram of a network listing screen
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 23 is a schematic diagram of a program theme list
`
`
`
`
`
`
`
`
`
`screen according to the invention;
`
`
`
`
`
`FIG. 24 is a schematic diagram of a todo list screen
`
`
`
`
`
`
`
`
`
`
`according to the invention;
`
`
`
`
`FIG. 25 is a schematic diagram of a conflict warning
`
`
`
`
`
`
`
`
`
`screen according to the invention;
`
`
`
`
`
`FIG. 26 is a schematic diagram of a trick play bar overlaid
`
`
`
`
`
`
`
`
`
`on program material according to the invention;
`
`
`
`
`
`
`
`FIG. 27 is a schematic diagram of a the trick bar and its
`
`
`
`
`
`
`
`
`
`
`
`associated components according to the invention;
`
`
`
`
`
`
`FIG. 28 is a schematic diagram of a two column multi-
`
`
`
`
`
`
`
`
`
`
`media schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 29 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 30 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 31 is a schematic diagram of a two column theme-
`
`
`
`
`
`
`
`
`
`based schedule screen according to the invention;
`
`
`
`
`
`
`
`FIG. 32 is a schematic diagram of a two column program
`
`
`
`
`
`
`
`
`
`schedule screen according to the invention; and
`
`
`
`
`
`
`
`FIG. 33 is a schematic diagram of a two column program
`
`
`
`
`
`
`
`
`
`schedule screen showing a program duration indicator
`
`
`
`
`
`
`according to the invention.
`
`
`
`
`DETAILED DESCRIPTION OF THE
`
`
`
`INVENTION
`
`
`
`
`The invention is embodied in a multimedia visual
`
`
`
`
`
`
`
`
`progress indication system in a computer environment. A
`
`
`
`
`
`
`
`
`system according to the invention communicates informa-
`
`
`
`
`
`
`tion to the user in a simple, visually intuitive fashion. In
`
`
`
`
`
`
`
`
`
`
`addition, the invention provides a system that the user can
`
`
`
`
`
`
`
`
`
`easily interact with and is independent of the media type.
`
`
`
`
`
`
`
`
`
`
`Apreferred embodiment of the invention provides a trick
`
`
`
`
`
`
`
`play bar and associated components that visually commu-
`
`
`
`
`
`
`
`nicate the operation and progression through media content.
`
`
`
`
`
`
`
`The trick play bar and its associated components are dis-
`
`
`
`
`
`
`
`
`
`played using a dedicated display (e.g., LCD, LED, Plasma)
`
`
`
`
`
`
`
`
`or by being overlaid over the program material being
`
`
`
`
`
`
`
`
`displayed on a TV or monitor.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`4
`
`Referring to FIG. 1, a preferred embodiment of the
`
`
`
`
`
`
`
`
`invention has an Input Section 101, Media Switch 102, and
`
`
`
`
`
`
`
`
`
`an Qutput Section 103. The Input Section 101 takes televi-
`
`
`
`
`
`
`
`
`
`sion (TV)
`input streams in a multitude of forms,
`for
`
`
`
`
`
`
`
`
`
`
`example, National Television Standards Committee (NTSC)
`
`
`
`
`
`
`or PAL broadcast, and digital forms such as Digital Satellite
`
`
`
`
`
`
`
`
`
`
`System (DSS), Digital Broadcast Services (DBS), or
`
`
`
`
`
`
`
`Advanced Television Standards Committee (ATSC). DBS,
`
`
`
`
`
`
`DSS and ATSC are based on standards called Moving
`
`
`
`
`
`
`
`
`
`Pictures Experts Group 2 (MPEG2) and MPEG2 Transport.
`
`
`
`
`
`
`
`
`MPEG2 Transport is a standard for formatting the digital
`
`
`
`
`
`
`
`
`
`data stream from the TV source transmitter so that a TV
`
`
`
`
`
`
`
`
`
`
`
`receiver can disassemble the input stream to find programs
`
`
`
`
`
`
`
`
`
`in the multiplexed signal. The Input Section 101 produces
`
`
`
`
`
`
`
`
`
`MPEG streams. An MPEG2 transport multiplex supports
`
`
`
`
`
`
`
`multiple programs in the same broadcast channel, with
`
`
`
`
`
`
`
`
`multiple video and audio feeds and private data. The Input
`
`
`
`
`
`
`
`
`
`
`Section 101 tunes the channel
`to a particular program,
`
`
`
`
`
`
`
`
`
`extracts a specific MPEG program out of it, and feeds it to
`
`
`
`
`
`
`
`
`
`
`
`
`the rest of the system. Analog TV signals are encoded into
`
`
`
`
`
`
`
`
`
`
`
`a similar MPEG format using separate video and audio
`
`
`
`
`
`
`
`
`
`encoders, such that the remainder of the system is unaware
`
`
`
`
`
`
`
`
`
`
`of how the signal was obtained. Information may be modu-
`
`
`
`
`
`
`
`
`
`lated into the Vertical Blanking Interval (VBI) of the analog
`
`
`
`
`
`
`
`
`
`
`TV signal in a number of standard ways; for example, the
`
`
`
`
`
`
`
`
`
`
`
`North American Broadcast Teletext Standard.
`(NABTS)
`
`
`
`
`
`
`may be used to modulate information onto lines 10 through
`
`
`
`
`
`
`
`
`
`
`20 of an NTSC signal, while the FCC mandates the use of
`
`
`
`
`
`
`
`
`
`
`
`
`line 21 for Closed Caption (CC) and Extended Data Services
`
`
`
`
`
`
`
`
`
`
`(EDS). Such signals are decoded by the input section and
`
`
`
`
`
`
`
`
`
`
`passed to the other sections as if they were delivered via an
`
`
`
`
`
`
`
`
`
`
`
`
`MPEG2 private data channel.
`
`
`
`
`The Media Switch 102 mediates between a microproces-
`
`
`
`
`
`
`
`sor CPU 106, hard disk or storage device 105, and memory
`
`
`
`
`
`
`
`
`
`
`
`104. Input streams are converted to an MPEG stream and
`
`
`
`
`
`
`
`
`
`
`sent to the Media Switch 102. The Media Switch 102 buffers
`
`
`
`
`
`
`
`
`
`
`
`the MPEG stream into memory. It then performs two opera-
`
`
`
`
`
`
`
`
`
`tions if the user is watching real time TV: the stream is sent
`
`
`
`
`
`
`
`
`
`
`
`
`
`to the Output Section 103 and it is written simultaneously to
`
`
`
`
`
`
`
`
`
`
`
`the hard disk or storage device 105.
`
`
`
`
`
`
`
`The Output Section 103 takes MPEG streams as input and
`
`
`
`
`
`
`
`
`
`
`produces an analog TV signal according to the NTSC, PAL,
`
`
`
`
`
`
`
`
`
`
`or other required TV standards. The Output Section 103
`
`
`
`
`
`
`
`
`
`contains an MPEG decoder, On-Screen Display (OSD)
`
`
`
`
`
`
`
`generator, analog TV encoder and audio logic. The OSD
`
`
`
`
`
`
`
`
`
`generator allows the program logic to supply images which
`
`
`
`
`
`
`
`
`
`will be overlaid on top of the resulting analog TV signal.
`
`
`
`
`
`
`
`
`
`
`
`Additionally, the Output Section can modulate information
`
`
`
`
`
`
`
`supplied by the program logic onto the VBI of the output
`
`
`
`
`
`
`
`
`
`
`
`signal in a number of standard formats, including NABTS,
`
`
`
`
`
`
`
`
`
`CC and EDS.
`
`
`
`With respect to FIG. 2, the invention easily expands to
`
`
`
`
`
`
`
`
`
`
`accommodate multiple Input Sections (tuners) 201, 202,
`
`
`
`
`
`
`
`203, 204, each can be tuned to different types of input.
`
`
`
`
`
`
`
`
`
`
`
`Multiple Output Modules (decoders) 206, 207, 208, 209 are
`
`
`
`
`
`
`
`
`
`added as well. Special effects such as picture in a picture can
`
`
`
`
`
`
`
`
`
`
`
`be implemented with multiple decoders. The Media Switch
`
`
`
`
`
`
`
`
`205 records one program while the user is watching another.
`
`
`
`
`
`
`
`
`
`
`This means that a stream can be extracted off the disk while
`
`
`
`
`
`
`
`
`
`
`
`another stream is being stored onto the disk.
`
`
`
`
`
`
`
`
`Referring to FIG. 3, the incoming MPEG stream 301 has
`
`
`
`
`
`
`
`
`
`interleaved video 302, 305, 306 and audio 303, 304, 307
`
`
`
`
`
`
`
`
`
`segments. These elements must be separated and recom-
`
`
`
`
`
`
`
`bined to create separate video 308 and audio 309 streams or
`
`
`
`
`
`
`
`
`
`
`
`buffers. This is necessary because separate decoders are used
`
`
`
`
`
`
`
`
`
`to convert. MPEG elements back into audio or video analog
`
`
`
`
`
`
`
`
`
`
`components. Such separate delivery requires that
`time
`
`
`
`
`
`
`
`
`
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`
`
`25
`
`
`30
`
`
`
`35
`
`
`
`40
`
`
`
`45
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`Roku, Inc. Exhibit 1008
`
`Roku, Inc. Exhibit 1008
`
`

`
`
`
`
`
`
`US 6,847,778 B1
`
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`
`
`25
`
`
`30
`
`
`
`35
`
`
`
`40
`
`
`
`45
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`
`5
`sequence information be generated so that the decoders may
`
`
`
`
`
`
`
`
`
`be properly synchronized for accurate playback of the
`
`
`
`
`
`
`
`
`signal.
`The Media Switch enables the program logic to associate
`
`
`
`
`
`
`
`proper time sequence information with each segment, pos-
`
`
`
`
`
`
`
`sibly embedding it directly into the stream. The time
`
`
`
`
`
`
`
`
`
`sequence information for each segment
`is called a time
`
`
`
`
`
`
`
`
`
`stamp. These time stamps are monotonically increasing and
`
`
`
`
`
`
`
`
`start at zero each time the system boots up. This allows the
`
`
`
`
`
`
`
`
`
`
`
`
`invention to find any particular spot in any particular video
`
`
`
`
`
`
`
`
`
`
`segment. For example, if the system needs to read five
`
`
`
`
`
`
`
`
`
`
`seconds into an incoming contiguous video stream that is
`
`
`
`
`
`
`
`
`
`being cached, the system simply has to start reading forward
`
`
`
`
`
`
`
`
`
`
`into the stream and look for the appropriate time stamp.
`
`
`
`
`
`
`
`
`
`
`Abinary search can be performed on a stored file to index
`
`
`
`
`
`
`
`
`
`
`
`into a stream. Each stream is stored as a sequence of
`
`
`
`
`
`
`
`
`
`
`
`fixed-size segments enabling fast binary searches because of
`
`
`
`
`
`
`
`
`the uniform timestamping. If the user wants to start in the
`
`
`
`
`
`
`
`
`
`
`
`middle of the program, the system performs a binary search
`
`
`
`
`
`
`
`
`
`
`of the stored segments until it finds the appropriate spot,
`
`
`
`
`
`
`