(12) United States Patent
`Hudson et a].
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 8,479,246 B2
`*Jul. 2, 2013
`
`US008479246B2
`
`(58) Field of Classi?cation Search
`USPC .............. .. 725/60, 87, 112, 59, 1024103, 113
`See application ?le for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`5,027,400 A
`6/1991 Baji
`5,191,573 A
`3/1993 Hair
`5,235,680 A
`8/1993 Bijnagte
`5,253,275 A 10/1993 Yurt et a1.
`(Continued)
`FOREIGN PATENT DOCUMENTS
`0 840 241 Al
`5/1998
`1 016 990 A2
`7/2000
`(Continued)
`OTHER PUBLICATIONS
`
`(54) SYSTEM AND METHOD FOR INTERACTIVE
`VIDEO CONTENT PROGRAMMING
`
`(75) Inventors: Ron J. Hudson, Los Angeles, CA (US);
`Terrence T. Coles, Costa Mesa, CA
`(US); Craig D. Berry, Los Angeles, CA
`(US); Allen D. Easty, Carolton, TX (US)
`
`(73) Assignee: Intertainer, Inc., Los Angeles, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`This patent is subject to a terminal dis
`claimer.
`
`EP
`EP
`
`(21) Appl.No.: 13/495,884
`
`(22) Filed:
`
`Jun. 13, 2012
`
`(65)
`
`Prior Publication Data
`
`US 2012/0254932 A1
`
`Oct. 4, 2012
`
`Related U.S. Application Data
`
`(63) Continuation of application No. 13/228,181, ?led on
`Sep. 8, 2011, Which is a continuation of application
`No. 12/930,456, ?led on Jan. 7, 201 1, now abandoned,
`Which is a continuation of application No. 09/921,097,
`?led on Jul. 31, 2001, noW Pat. No. 7,870,592.
`
`(60) Provisional application No. 60/255,541, ?led on Dec.
`14,2000.
`
`(51) Int. Cl.
`H04N 7/173
`H04N 5/445
`(52) U.S. c1.
`USPC ............ .. 725/113,?25/59;725/102,?25/103
`
`(2011.01)
`(201 1.01)
`
`U.S. Appl. No. 09/605,695, ?led Jun. 2000, Schein.
`(Continued)
`Primary Examiner * Chris Parry
`Assistant Examiner * Sumaiya A ChoWdhury
`(74) Attorney, Agent, or Firm * Martin & Ferraro, LLP
`
`ABSTRACT
`(57)
`The present invention is directed to a system and method for
`interacting With video by displaying one or more interface
`links associated With video content being displayed, pausing
`the video content When an interface link is interacted With,
`alloWing the user to vieW ancillary content the interface link
`is linked to over a netWork, and un-pausing the video content
`after the user elects to continue vieWing the video content. In
`one or more embodiments, the ancillary content may permit
`e-commerce, display additional video or other images, and/or
`include links to additional ancillary content. The present
`invention also includes a method for creating an interactive
`video.
`
`30 Claims, 4 Drawing Sheets
`
`Hulu
`Exhibit 1001
`Page 0001
`
`

`

`US 8,479,246 B2
`Page2
`
`-
`
`U.S. PATENT DOCUMENTS
`215323;; A
`Z133: ‘321G321
`513471632 A
`9/1994 “1111111111111
`513711532 A 12/1994 Gelman etal'
`21322133 A
`3,133;
`515391450 A
`7,1996 Hindglsman
`’
`’
`.
`2
`3,1332 g‘ffkowltz
`515531281 A
`9,1996 Biofxfietal
`5,557,541 A
`9/1996 Schulhofet al.
`515761951 A 11/1996 L°°kW°°d
`515841025 A 12/1996 Kelthley et 31'
`212121212 2
`‘61,133;
`5,652,615 A
`7/1997 Bryant et a1.
`516961965 A 12/1997 Dedmk
`517061448 A
`V1998 Blfldes
`2%?31232 A
`51332 vD‘gztr‘ilcl?ahletal'
`5,710,887 A
`1/1998 (3116111111 61111.
`517171923 A
`“998 Dednck
`517241521 A
`“998 DeF'mk
`213521321‘ 2
`3,1332
`5,745,710 A
`4/1998 Clanton 61111. ................ .. 725/60
`517521238 A
`5/1998 Dedrick
`2
`2,1332 3:31:31
`5,758,257 A
`5/1998 HGIZ 6111.
`5,765,152 A
`6/1998 Erickson
`517671845 A
`6/1998 oashietal'
`A
`$332 2332;;
`5,790,426 A
`8/1998 Robinson
`517901935 A
`8/1998 Payton
`518021518 A
`9/1998 Km“ et 31'
`518051154 A
`9/1998 Brown
`21211222:
`121222
`5,819,271 A 10/1998 Mahoneyet al.
`5,825,876 A 10/1998 Peterson, Jr.
`5,826,243 A 10/1998 Musmanno etal.
`21222122? A 131333 geratce
`a1.
`5,864,871 A
`1/1999
`1
`1
`518921508 A
`4/1999 H9We etal'
`212351238 2
`3,1333 guéteretall'
`519101987 A
`61999 Gilt:
`1
`1
`.
`519181012 A
`6/1999 AS“? et 311
`213212;: 2
`3,1333 E3212";
`5,929,849 A
`7/1999 Kikinis '
`1
`1
`2
`3,1333 911115936191
`519561693 A
`9,1999 Gjg‘llglgs
`g
`1
`1
`519561700 A
`9/1999 Landry
`21322158 2 13,333 5??“ et 31'
`
`5,973,683 A 10/1999 Cragun 6131. 5,974,396 A 10/1999 Anderson et a1.
`5,987,509 A 11/1999 Po1111es1 ...................... .. 725/113
`6,006,265 A 12/1999 Rangan @1211.
`“999 G
`218%?1223 A 132000 Slarg . k
`610181768 A
`1,2000 Ul‘l’ggilcet 31
`610261369 A
`20000 Capek
`'
`6,029,045 A
`2/2000 Picco 6131.
`4/2000 W111no11 61111.
`6,047,296 A
`6058 424 A
`5/2000 Dixon et 31‘
`630653042 A
`5/2000 Reimer et 31,
`6,094,677 A
`7/2000 Capeket 31,
`6,134,593 A 10/2000 Alexander et a1.
`6,154,738 A 11/2000 (3111
`6,154,771 A 11/2000 Rangan etal.
`6,157,929 A 12/2000 Zamiska @1211.
`6,163,272 A 12/2000 Goode @1211.
`
`1
`
`,
`
`,
`
`enner
`
`6,163,795 A 12/2000 Kikinis
`6,166,730 A 12/2000 Goode @1211.
`6,169,573 B1
`1/2001 Sampath-Kumar 6111.
`211328133 51
`115881 (13111131121111
`6,184,878 B1
`2/2001 A1onso 61111.
`6,185,541 B1
`2/2001 Scroggie 6111.
`6,189,008 B1
`2/2001 Eastyetal.
`6,199,082 B1
`3/2001 Ferrel et a1.
`6,202,056 B1
`3/2001 Nuttall
`6,205,432 B1
`3/2001 Gabbardetal.
`21553135? 5%
`2,588} gown? ‘it 31'
`6,237,022 B1
`5/2001 1333013111
`6,243,725 B1
`6/2001 Hempleman 6111.
`6,247,130 B1
`6/2001 Fritsch
`2152315345‘ 5%
`3,588} lsilade
`6,292,785 B1
`9/2001 McEvoyetal.
`6,292,797 B1
`9/2001 TuZhilin 61111.
`6,314,451 B1
`11/2001 Landsman 6111.
`21311132 3}
`3,588} gg?gsztnai'tal
`6,337,901 B1
`1/2002 Rome 6111.
`6,338,044 B1
`1/2002 Cooketal.
`6,338,094 B1
`1/2002 Scott 6111.
`g}
`521E“
`6,381,747 B1
`4/2002 Wonfor et a1.
`6,385,596 B1
`5/2002 Wiser 613.1.
`212553139? 3%
`3,588; 332230
`614241998 B2
`7/2002 Hunter
`6,457,010 B1
`9/2002 Elderin 1 1
`,
`,
`g e a.
`6,462,754 B1
`10/2002 Chakraborty 6111.
`21233123? 5; 1%883 5213f
`tyet :11.
`,
`,
`6,496,802 B1
`12/2002 VanZoest
`6,496,981 B1
`12/2002 Wistendahl et a1.
`6,526,438 B1
`2/2003 Bienvenu 61111.
`B1
`14
`21238123; 5%
`2,588; gfrigflz‘t’gletal'
`615721662 B2
`600% Manoharét 31
`635743424 B1
`600% Dimitriet a1‘ '
`6,604,224 B1
`8/2003 Armstrong 6131.
`616151251 B1
`9/2003 K1“? ‘M11
`6,628,302 B2
`9/2003 Wh1te @1211.
`6,636,237 B1
`10/2003 Murray 6111.
`6,637,032 B1
`10/2003 Feinleib
`6,640,145 B2 10/2003 Ho?bergetal.
`6,650,640 B1
`11/2003 Mulleretal.
`6,718,551 B1
`4/2004 Swix 61111.
`6,763,345 B1
`7/2004 Hempleman 6111.
`617991165 B1
`9/2004 BOeSJeS
`6,801,576 B1
`10/2004 Haldemanetal.
`6,810,527 B1
`10/2004 Conradetal.
`6,845,485 B1
`1/2005 Shastri 61111.
`6,853,728 B1
`2/2005 Kahnetal.
`6,925,469 B2
`8/2005 Headings et a1.
`6,944,585 B1
`9/2005 Pawson
`
`
`213321223 5; 8,5882 6’986’156 B1 M2006 Rodriguez et a1
`710101801 B1
`300% Jerdin m1 1
`1
`1
`,,
`g
`'
`7,017,173 B1
`3/2006 Armstrong et a1. ........... .. 725/87
`7,017,188 B1
`3/2006 Schmeidler et a1.
`7,069,249 B2
`6/2006 Stolfo 6111.
`7,089,579 B1
`8/2006 Maoietal.
`34532133; 5%
`$5882 113mg;
`"V
`1
`1
`7,103,906 B1
`9/2006 Katz etal.
`7,139,813 B1* 11/2006 Wallenius ................... .. 709/219
`7,203,758 B2
`4/2007 Cooket a1.
`7,207,006 B1
`4/2007 Feig etal
`7,243,365 B1
`7/2007 Rahman
`7,254,622 B2
`8/2007 Nomuraet 31.
`7,275,254 B1
`9/2007 111111
`7,325,245 B1
`1/2008 Clapper
`
`Hulu
`Exhibit 1001
`Page 0002
`
`

`

`US 8,479,246 B2
`Page 3
`
`3/2008 Hendricks et al.
`7,343,614 B1
`7/2008 Wonfor et al.
`7,395,545 B2
`2/2010 Markel
`7,661,117 B2
`4/2010 Hassellet al.
`7,694,319 B1
`6/2010 MacCormacket al.
`7,730,515 B1
`1/2011 Hudson etal.
`7,870,592 B2
`5/2012 Kopra
`8,175,921 B1
`5/2012 Harveyetal.
`8,191,091 B1
`2001/0003214 A1
`6/ 2001 Shastri et al.
`2001/0016947 A1
`8/ 2001 Nishikawa et al.
`9/2001 Gaudian
`2001/0025255 A1
`2001/0033296 A1
`10/2001 Fullerton et al.
`2001/0042043 A1
`11/2001 Shear et al.
`2002/0007493 A1
`1/ 2002 Butler et al.
`2002/0016736 A1
`2/ 2002 Cannon et al.
`2002/0056118 A1
`5/ 2002 Hunter et al.
`2002/0059574 A1
`5/2002 Tudor et al.
`5/ 2002 Borger et al.
`2002/0062393 A1
`5/ 2002 Tennyson et al.
`2002/0065715 A1
`2002/0072997 A1
`6/2002 Colson et al.
`6/ 2002 Headings et al.
`2002/0083006 A1
`2002/0085024 A1
`7/ 2002 White et al.
`7/ 2002 Kaplan et al.
`2002/0087976 A1
`7/ 2002 Carlton
`2002/0095606 A1
`7/ 2002 DudkiewicZ
`2002/0100046 A1
`2002/0112235 A1
`8/ 2002 Ballou et al.
`8/ 2002 StrietZel
`2002/0120564 A1
`10/2002 Headings et al.
`2002/0143647 A1
`10/2002 Headings et al.
`2002/0143782 A1
`10/2002 Headings et al.
`2002/0144283 A1
`10/ 2002 DudkiewicZ
`2002/0152474 A1
`2002/0184255 A1
`12/2002 Edd et al.
`1/2003 Lindner
`2003/0014328 A1
`2003/0070167 A1
`4/2003 HoltZ et al.
`2003/0097657 A1
`5/2003 Zhou et al.
`6/2003 Lindner
`2003/0120549 A1
`2003/0120557 A1
`6/2003 Evans et al.
`2003/0126033 A1
`7/2003 Evans et al.
`2003/0191816 A1
`10/2003 Landress et al.
`11/2005 Headings et al.
`2005/0262024 A1
`5/ 2009 Headings et al.
`2009/0138925 A1
`5/ 2009 Headings et al.
`2009/0138964 A1
`6/ 2009 Schein
`2009/0144154 A1
`6/ 2009 Headings et al.
`2009/0150219 A1
`2/2010 Headings et al.
`2010/0036724 A1
`2011/0321109 A1 12/2011 Hudson et al.
`
`EP
`JP
`W0
`W0
`W0
`WO
`
`FOREIGN PATENT DOCUMENTS
`1 037 419 A2
`9/2000
`11-316579
`11/1999
`WO 99/10822 A1
`3/1999
`WO 00/02143 A1
`1/2000
`WO 01/27773 A1
`4/2001
`WO01/61592 A1
`8/2001
`
`OTHER PUBLICATIONS
`
`Apple Inc., Google Inc., and Napster Inc.’s Invalidity Contentions,
`from Intertainer, Inc. v. Apple Computer, Inc., Google Inc., and
`Napster Inc., In the United States District Court for the Eastern
`District of Texas Marshali Division, Civil Action No. 2-06CV-549
`TJW (Oct. 9, 2007).
`Intertainer, Inc. v. Hulu, LLC, In the United States District Court for
`the Central District of California Southern Division, Defendant Hulu,
`LLC’s Responses to Plaintiff Intertainer, Inc.’s First Set of Interroga
`tories, Case No. SACV 11-01208 CJC (RNBX) (Mar. 19, 2012).
`Intertainer, Inc. v. Hulu, LLC, In the United States District Court for
`the Central District of California Southern Division, Defendant Hulu
`LLC’s First Supplemental Responses to Plaintiff Intertainer, Inc.’s
`Interrogatories Nos. 2 and 3, Case No. SACV 11-01208 CJC (RNBX)
`(Apr. 20, 2012).
`Anamaria Wilson, In Brief, Time Magazine (Mar. 20, 2000), avail
`able
`at
`http://www.time.com/time/magaZine/articie/
`0,9171,996415,00.html (p. 1).
`“Buying Music over the Internet”, R. Colombo, Liquid Audio White
`Paper, 1997.
`
`“Dig-Music: An On Demand Digital Musical Selection System Uti
`liZing CATV Facilities,” IEEE Transactions on Consumer Electron
`ics, vol. CE-28, Issue 3, pp. Xviii-XXvi (Aug. 1982).
`“Final Report: Digital Audio Visual Work Trading by ATMiAT
`MA ,” obtained from ftp://ftp.cordis.europa.eu/pub/infowin/docs/
`fr-225.pdf (Feb. 1999).
`“Liquid Audio: Products & Services,” http://web.archive.org/web/
`20000302001521/www.liquidaudio.com/services/anl/anlhtml (and
`linked pages), stored on archive.org on Mar. 2, 2000.
`A.J.S. Ball, G.V. Bachmann and Jan Gecsei, “VideoteX Networks,”
`IEEE Computer, vol. 13, Issue 12, Dec. 1980, pp. 8-14.
`Bargeron, David et al., Annotations for Streaming Video on the Web:
`System Design and Usage Studies (Elsevier Science B.V.) 11 pp.
`(Mar. 1999).
`Bove, W. Michael et al., Adding Hyperlinks to Digital Television,
`Proc. 140th SMPTE Technical Conference 11 pp. (1998).
`Buchanan, M. Cecelia et al, Specifying Temporal Behavior in
`Hypermedia Documents, ACM ECHT Conference 12 pp. (1992).
`Bulterman, Dick C.A. et al., GRiNS: A Graphical Interface for cre
`ating an playing SMIL documents, Computer Networks and ISDN
`Systems 30, 14 pp. (1998).
`Bulterman, Dick, C.A. Models, Media and Moton: Using the Web to
`Support Multimedia Documents, Multimedia Modeling 97, 20 pp.
`(Nov. 1997).
`C. Federighi and LA. Rowe, “A Distributed Hierarchical Storage
`Manager for aVideo-on-Demand System,” Proc. of IS&T/ SPIE 1994
`Int’l Symp. on Elec. Imaging: Science and Technology, San Jose, CA,
`Feb. 1994, Also appears in Storage and Retrieval for Image andVideo
`Databases II, The International Society for Optical Engineering, vol.
`2185, pp. 185-197, 1994.
`C. Fenger and M. Elwood-Smith, “The Fantastic Broadband Multi
`media System: Software Platform Description” (v. 1,3), The Fantas
`tic Corporation, May 19, 2000.
`Caravello-Hibbert, Stephanie M., Teaching Non-Science Majors:
`Science Through Interactive Multi-Media, A Quarterly Devoted to
`Microcomputers in the Higher Eduction Curriculum, Vo. X, No. 2,
`pp, 97-102 (May 1992).
`Cardillo, Darlene S., Using a Foreign Film to Improve Second Lan
`guage Pro?ciency: Video vs. Interactive Multimedia, J. Educational
`Technology Systems, vol. 25(2), 1996, pp. 169-177.
`Chang, Edward Y., :rtDTV: A Client-Based Interactive DTV Archi
`tecture, Multimedia ’99 4 pp. (1999).
`Dakss, Jonathan et al., HyperActive: An Automated Tool for Creating
`Hyperlinked Video, Media 1997 pp. 1-101 (Sep. 1999).
`Dakss, Jonathan et al, Hyperlinked Video, Proc. SPIE, vol. 3528, 9
`pp. (Nov. 1998).
`(http://web.archive.org/web/
`website
`Diva Systems Corp.
`19980509053455/divatv.com/onsetlayer2-3.htrn), archived by web.
`archive.org, in May 1998 (3 pages).
`Diva Systems Corp., Form 10-K (Sep. 28, 1999). Available at http://
`www.sec.gov.
`Earthnoise.com, archived by archve.org on various dates between
`Apr. 23, 2000 and May 11, 2003 (19 pages).
`Echiffre, Marica et al., MHEG-5iAims, Concepts; and Implemen
`tation issues, Journal IEEE Multimedia, vol. 5, No. 1, pp. 84-91
`(Jan-Mar. 1998).
`Francisco-Revilla, Luis, A Picture of Hypervideo Today, 12 pp,
`(1998) at http:/www.csdl.tamu.edu/~10f0954/academic/cpsc610/p
`1.htm.
`Frank J. Der?er, Jr. & Les Freed, How Networks Work, 4th Ed. Que
`Corporation (Macmillian Computer Publishing) (1998).
`Freeman, Mark et al., Seamless Video EXpansion: Shaping the Con
`tours of Streams for Personalized TV, ACM SIGCHI (Human Factors
`in Computer Systems) pp. 5-15 (2000).
`G, Caire, “ATMAN: Trading of Digital Audio Visual Contents,”
`Multimedia Applications, Services and TechniquesiECMAST ’98,
`David Hutchison, Ralf Schafer (Eds.), 352-365, May 1998.
`Goldsworthy, Richard, Designing Instruction for Emotional Intelli
`gence, Educational Technology, vol. 40, No. 5, pp. 43-48 (Sep.-Oct.
`2000).
`H. Jiang & A.K. Elmagarmid, “WVTDBiA Semantic Content
`BasedVideo Database System on the WorldWide Web,” IEEE Trans
`actions on Knowledge and Data Engineering, vol. 10, No. 6, Nov./
`Dec. 1998.
`
`Hulu
`Exhibit 1001
`Page 0003
`
`

`

`US 8,479,246 B2
`Page 4
`
`Hardman, Lynda et al., Hypermedia: The Link with Time, ACM
`Computing Surveys, vol. 31, No. 4ES. 5 pp. (Dec. 1999).
`Hardman, Lynda et al., Links in Hypermedia: The Requirement for
`Context, Hypertest ’93 Proceedings, pp. 183-191 (Nov. 1993).
`Hauglid et al., “WebSTARiVideo Database on WWW,” IS&T/SPIE
`Conference on Multimedia Computing and Networking 2000, San
`Jose, California, Jan. 2000.
`IMAKE.COM, as archived by archive.org, available at http://web.
`archive.org/web/19980110131456/www.imake.com/media/prod
`ucts/dbs.html, 1998.
`Intertainer press release web page for 1998 (http//:www.intertainer.
`com/pr1998.html): press release dated Feb. 11, 1998, “Intertainer
`Unveils World’ s First Interactive Broadband Service for On-Demand
`Delivery of Full Motion Video-Based Entertainment” (http://www.
`intertainercom/ news/ 30 .html).
`Intertainer, www.intertainer.com, archived by web.archive.org on
`various dates between Feb. 21, 1999 and Jun. 21, 1999 (pp. 1-858).
`Intertainer, Inc., May 24, 1999 Press Release, “Big Entertainment’s
`Bige.corn Expands Distribution Reach on Intertainer’s On-Demand
`Entertainment Broadband Network,” available at http://www.
`intertainercom/news/19.html, 2 pages.
`Intertainer website, “Advertising Information,” available at http://
`web.archive.org/webI2000022914285 5/www.intertainer.com/ser
`vice/advertisinghtml, Feb. 2000, 1 page.
`J. Gecsei, The Architecture of J/ldeotex Systems, Prentice-Hall, Inc.
`(1983).
`Jeff Patterson & Ryan Melcher, Audio on the Web, Peachpit Press,
`1998.
`Johnson, Judi Mathis, ed., Software Reviews, The Computing
`Teacher pp. 49-55 (Oct. 1994).
`Jose Alvear, ShareYourWorld and Make Money From Your Home
`Videos, StreamingMediacom Research Center (Mar. 7, 2000), at
`http://www.streamingmedia.com/article.asp?id:5028&page:1 (pp.
`1-2).
`José Maria Gonzalez, “The Berkeley Video on Demand System
`Implementation,” May 22, 2000 (pp. 1-22).
`L.A. Rowe, J. Boreczky, and C. Eads, “Indexes for User Access to
`Large Video Databases,” Proc. of IS&T/SPIE 1994 Int’! Symp. on
`Elec. Imaging.‘ Science and Technology, San Jose, CA, Feb. 1994.
`Also appears in Storage and Retrieval for Image andVideo Databases
`II, The International Society for Optical Engineering, vol. 2185, pp.
`150-161,1994.
`Lawton, George, Video Streams into the Mainstream, Computer, vol.
`33, No. 7, pp. 12-17 (Jul. 2000).
`Lewis, Paul A. et al., Media-based Navigation with Generic Links,
`Hypertext ’96 pp. 215-223 (1996).
`LiquidAudio, Inc., Liqui?er Pro User Manual Version 1.2, Jun. 1997.
`Little et al., “Prospects for Interactive Video-on-Demand,” IEEE
`Multimedia, Fall 1994, 22 pages.
`Loudeye Corp., Form 10-K (Feb. 27, 2001): available at http://www.
`sec.gov.
`M. Carrer et al., “An Annotation Engine for Supporting Video Data
`base Population,” Multimedia Tools and Applications, vol. 5, No. 3,
`Nov. 1997, pp. 233-258. (available at hulk.bu.edu/pubs/papers/ 1997/
`TR-08-15-96.pdf).
`M. Re, “Business-to-Business Digital Video Mega-Stores,”
`Advances in Information Technologies.‘ The Business Challenge,
`J.-Y. Roger et al. (Eds.), (IOS Press 1998).
`Ma,. Wei-hsiu et al., Networked Hyper QuickTime: Video-Based
`Hypermedia Authoring and Delivery for Education-on-Demand, 19
`pages (UMSI 99/52 Apr. 1999).
`Ma, Wei-hsiu et al., Video-Based Hypermedia for Education-on
`Demand, IEEE MuitiMedia, pp. 72-83, Jan-Mar. 1998.
`Makofske, David B. et al., From Broadcast Television to Internet
`Audio/Video: Techniques and Tools for VCR-Style Interactivity, 24
`pp. (Oct. 1999).
`Manolescu, Dragon-Anton et al., Link Management Framework for
`Hyper-media Documents, Proceedings IEEE International Confer
`ence on Multimedia Computing and Systems ’97. Jun. 3-6, 1997, 8
`pages, (1997).
`Meyer, Thomas et al., A Taxonomy on Multimedia Synchronization,
`Proceedings of the Fourth Workshop on Fugure Trends of Distributed
`Computing Systems, Sep. 22-24, 1993, pp. 97-103 (1993).
`
`Michael Robertson & Ron Simpson, The Oj?cial MP3.com Guide to
`MP3, Sybil Sosin ed., MP3.com, Inc., 1999.
`MP3 .comiArtist
`Area
`FAQ,
`http://web.archive.org/web/
`20010605151513/studio.mp3.com/cgi-bin/artistadmin/support.
`cgi?step:FAQ, (Archived by web.archive.org on Jun. 5, 2001) (pp.
`1-40).
`Milenkovic, “Delivering Interactive Services via a Digital TV Infra
`structure,” IEEE, Fall 1998, 10 pages.
`Miller, Gene et al., News On-Demand for Multimedia Networks,
`Proc. ACM International Conference on Multimedia, Anaheim, Cali
`fornia USA, Aug. 2-6, 1993 11 pp. (1993).
`MP3.com website (http://www.mp3.com) archived by web.archive.
`org in May 1999 at http://web.archive.org/web/19990508090942/
`www.mp3.com/Artist/artistfaq.php3 (69 pages).
`P.W. Bagenal and SM. Upton, “Customer Management and the
`Eurocypher Conditional Access System at British Satellite Broad
`casting,” British Satellite Broadcasting, UK, pp. 270-277, Sep.
`21-25, 1990.
`Preston Gralla, How the Internet Works, Millenium eEdition, Que
`Corporation (Macmillian Computer Publishing) (Aug. 1999).
`RealPlayer 8 Plus User Manual, 112 pp, (Aug. 2000), at http.//
`service .real . com/help/ player/plusimanual. 8/ rppmanual .htm.
`Real System Production Guide, 200 pp. (Dec. 12, 2000), at http://
`service .real . com/help/library/guides/production8/realpgd.htm.
`Request for Inter Partes Reexamination for U. S. Patent No. 6,925,469
`to Headings et al. under 35 USC section 311 and 37 CFR section
`1.913: dated Oct. 31, 2007.
`Rod Underhill & Nat Gertler, The Complete Idiot ’s Guide to MP3.‘
`Music on the Internet, 2000.
`Rodrigues, L.M. et al., Improving SMIL Documents with NCM
`Facilities, Multimedia Modeling ’99, Oct. 4, 1999, 20 pp. (1999).
`Rody, J .A. et al., A Remote Presentation Agent for Multimedia Data
`bases, 1995 International Conference on Multimedia Computing and
`Systems (ICMCS’95) pp. 223-230 (1995).
`Ron White, How Computers Work, Millennium Ed., Quo Corporation
`(Macmillian Computer Publishing) (Sep. 1999).
`Shareyourworld.com, archived by archive.org in Feb/Mar. 2000 (pp.
`1-2).
`Shareyourworld.com Web Site Archive (2000), available at http://
`web.archive.org/web/20000229135009/http://www.
`shareyourworld.com/about.phtrnl (pp. 1-15).
`Shea, Peter, Leveling the Playing Field: A Study of Captioned Inter
`active Video for Second Language Learning, Journal of Educational
`Computing Research, vol. 22, No. 3, pp. 243-263 (2000).
`Smith, Jason McC. Et al., An Orthogonal Taxonomy for Hyperlink
`Anchor Generation in Video Streams using OvalTine, Hypertext ’00
`Proc. of the Eleventh ACM on Hypertext and Hypermedia, 8 pp.
`(2000).
`Swan, Karen, Exploring the Role of Video in Enhancing Learning
`from Hypermedia, J. Educational Technology Systems, vol. 25(2),
`1996, pp. 179-188.
`Swinehart, Daniel C. et al., A Structural View of the Cedar Program
`ming Environment, ACM Transactions on Programming Languages
`AMD Systems, vol. 8, No.4, pp. 419-490 (Oct. 1986).
`Synchronized Mulimedia Integration Language (SMIL) 1.0 Speci?
`cation, W3C Recommendation, Jun. 15, 1998, http://www.w3.org/
`TIUREC-smil/.
`Synchronized Mulimedia Integration Language (SMIL) Boston
`Speci?cation, W3C Working Draft, Nov. 15, 1999, 175 pages, http://
`www.w3org/T1U1999/WD-smil-boston-19991 1 15/.
`T. Horstmann & R. Bentley, “Distributed Authoring on the Web with
`the BSCW Shared Workspace System,” StandardView, vol. 5, No. 1,
`Mar. 1997 (pp. 9-16).
`ten Kate, Warner et al., Presenting Multimedia on the Web and in TV
`Broadcast, 3rd European Conference on Multimedia Applications,
`Services, and Techniques, 19 pp. (1998).
`Viren, John et al., Distance Learning Over ATM/Sonet: The Distance
`Learning Environment Demonstration, J. of Education Technology
`Systems, Voil, 27, No. 3, pp. 231-243 (1999).
`Washisaka, Mitsukazu et al., Video/ Text Linkage System Assisted by
`a Concept Dictionary and Image Recognition, Proceedings of the
`Third IEEE International Conference on Multimedia Computer and
`Systems ’96, pp. 334-339, Jun. 1996.
`
`Hulu
`Exhibit 1001
`Page 0004
`
`

`

`US 8,479,246 B2
`Page 5
`
`Wegener Announces MPEG-2 Based System for Broadcasters Using
`Micropolis Video Servers, Mar. 27, 1995.
`Ackerman, D. et al., “Streaming Video Over the Internet,” Connect,
`(Oct. 5, 1998), three pages.
`Examiner’s Answer for Reexamination Control No. 95/000,313
`mailed Apr. 16, 2012, 5 pages.
`Patent Owner Rebuttal Brief for Reexamination Control No.
`95/000,313 ?led May 16, 2012, 20 pages.
`Herrmann, L., “MPEG-4 Interactive Services over IP,” located at
`www.itu.int/TELECOlVUwt99/cfp/auth/2697/papi2697.doc, (Oct.
`1999), pp. 1-6.
`
`Pereira, F. et al., “MPEG-44Opening New Frontiers to Broadcast
`Services,” EBU Technical Review, (1999), pp. 1-14.
`Request for Inter Partes Reexamination for U. S. Patent No. 7,780,592
`to Hudson et al. under 35 U.S.C. § 311 and 37 CPR. § 1.913, and
`Exhibits 1 to 35; ?led Sep. 14, 2012, 804 pages.
`Amendment for Reexamination Control No. 95/002,358, ?led Mar.
`7, 2013, 441 pages.
`Third Party Requesters Comments After Patent Owner Response
`Pursuant to 37 CFR § 1.947 for Reexamination Control No.
`95/002,358, ?led Apr. 8, 2013, 66 pages.
`
`* cited by examiner
`
`Hulu
`Exhibit 1001
`Page 0005
`
`

`

`US. Patent
`
`Jul. 2, 2013
`
`Sheet 1 of4
`
`US 8,479,246 B2
`
`100
`
`END POINTSERVER(5)
`VIDEO SERVER \l\| 106
`WEB SERVER K108
`
`E” M ‘“ _' “—
`
`j:
`I
`l
`'
`
`I
`2
`
`com/w
`l
`DATABASE
`W
`
`[- -—~ W —— ~--- 4 110
`
`300
`cm TE STORYBOARD J
`
`ENCODE VIDEO AS55719
`
`j”
`
`320
`‘
`CREA mus PAGE J
`
`330
`czmrsus mags) J
`
`‘
`
`FIG 3
`'
`
`FIG 1
`
`USER
`
`/
`104
`
`102
`
`v
`340
`PROGRAMJNTEREAEE J
`LIN/((5)
`
`F
`350
`ASSOCJA TEINERFACE
`LINKS WI v
`comrgvgnfo J
`
`360
`‘I
`DISTRIBUTE VIDEO T0 J
`VIDEOSERVER
`
`DISTRIBUTE HUB AND J70
`SUB PAGES r0 WEB
`SERVER
`
`380
`‘
`DISWBUTEMETADA 7A .2’
`T0 comm/r 0,4 TABASE
`
`Hulu
`Exhibit 1001
`Page 0006
`
`

`

`US. Patent
`
`Jul. 2, 2013
`
`Sheet 2 of4
`
`US 8,479,246 B2
`
`mmmb
`
`wmmb
`
`N 6E
`
`
`
`
`
`mm; mmm. QMQS
`
`
`
`
`
`mm‘; NEW Mug
`
`KREOU 0
`
`15,6)
`
`
`
`ELEM QMQS
`
`mmmb
`
`932 K E“,
`mm; mmm.
`
`
`Hulu
`Exhibit 1001
`Page 0007
`
`

`

`US. Patent
`
`Jul. 2, 2013
`
`Sheet 3 of4
`
`US 8,479,246 B2
`
`F 1‘ G 4
`
`RECEIVE 1/1050
`REQUEST
`
`400
`“J
`
`1r
`402
`DISPLAYREQUESTED
`VIDEO smEzqM WITH .1
`mEREA CE LINMS)
`
`404
`
`HASA NEW
`IN7ERACHO
`WITH AN
`INTERFACE u/v
`BEEN uErEcrE
`;
`
`406
`
`VIDEO STREAMING RUNS J
`TO fOMPLETION
`
`NO
`
`408
`YES
`PAUSE VTDEU SIREAM J
`
`ACCESS ADDRESS AS50614 7H?
`14/1771‘ IMERACT ED INTERFACE LINK
`
`410
`J
`
`1r
`DELIVER HUB PA GE AND ANY A
`ASSOCIA 7E0 METADA 7A
`
`414
`
`f 416
`
`DELIVER SELECTED sus
`PAGEAND ANY
`Assocm TED METADA TA
`
`HA5 USER
`SELECTED
`A SUB
`PAGE
`?
`
`HA5 USER
`SELECTED
`ANomER
`SUB PAGE
`.7
`
`420
`
`HA5 USE’
`ELECTED TO
`COMYNUE
`VIDEO srm YES
`
`f 422
`CONTINUE vwEo
`STREAM
`
`Hulu
`Exhibit 1001
`Page 0008
`
`

`

`US. Patent
`
`Jul. 2, 2013
`
`Sheet 4 of4
`
`US 8,479,246 B2
`
`‘55)
`
`[:1 CLICK ON MARKER WHICH
`INDICA TES INTER/l CH'VITY
`
`u, 53
`
`$ Q 3
`
`5
`
`BACK TO
`PRIMARY CONTENT
`
`22
`'_ SELECT "BUY NON/"LINK
`FROM SPA WNED WINDOW
`
`-51....
`mm":
`
`g I
`
`14
`EU Y MERCi-MNDISE
`
`I]! II
`
`FIG. 5
`
`Hulu
`Exhibit 1001
`Page 0009
`
`

`

`US 8,479,246 B2
`
`1
`SYSTEM AND METHOD FOR INTERACTIVE
`VIDEO CONTENT PROGRAMMING
`
`RELATED APPLICATION
`
`This application is a continuation of US. application Ser.
`No. 13/228,181, ?led Sep. 8, 201 1, Which is a continuation of
`US. application Ser. No. 12/930,456, ?led Jan. 7, 2011
`(abandoned); Which is a continuation of US. application Ser.
`No. 09/921,097, ?led Jul. 31, 2001 (now US. Pat. No. 7,870,
`592); Which claims the bene?t of US. Provisional Applica
`tion No. 60/255,541, ?led Dec. 14, 2000; all of Which are
`incorporated by reference herein.
`
`BACKGROUND OF THE INVENTION
`
`Some interactive programs include digital video discs
`(DVDs) or resident client computer applications, Which
`enable users to vieW ancillary content that relates to the pri
`mary content being vieWed. For example, DVD movies (the
`primary content) can include other footage relating to the
`movie, such as intervieWs With the cast, the movie trailer, and
`outtakes. DVDs also exist that permit the user to connect to a
`universal resource locator (URL) through a broWser When
`vieWed on a personal computer. This experience, hoWever, is
`limited in that the user must use the DVD to make such a
`connection and the user is unable to pause the video to interact
`With any ancillary content. In the case of DVDs Without such
`Internet connectivity, the user can only navigate through the
`ancillary content embedded in the DVD, and cannot perform
`any real-time transactions (e.g., buy a copy of a movie
`soundtrack through an e-commerce transaction) or other user
`interaction.
`Other interactive programs permit users to Watch content
`(e. g., a television episode) and log onto a Website afterWards
`to purchase items vieWed during the shoW (e.g., a Wristwatch
`Worn by an actor in the shoW).
`Some interactive programs in a broadcast environment uti
`liZe the vertical blanking interval (VBI) to insert data into the
`broadcast stream, thus enabling interactive functionality. For
`example, With Web television, users may play along With
`game shoWs as they are being broadcast. HoWever, this
`approach is limited to the broadcast arena Where the primary
`content (e.g., a television shoW) cannot be interrupted While
`the user interacts With ancillary content.
`While the foregoing interactive programs provide users
`With an enhanced experience, they are limited in providing
`real-time interactivity betWeen the user and the content While
`the user is vieWing the primary content and do not provide a
`user-friendly experience. Therefore there exists a need for
`interactive video content programming that permits the user
`to stop the video play to vieW ancillary content, and then
`continue video play from the point in time Where play Was
`stopped.
`
`SUMMARY OF THE INVENTION
`
`The present invention is directed to a system and methods
`for creating and distributing interactive video content (IVC).
`IVC includes the creation of interactive content using soft
`Ware tools (e.g., FlashTM and ShockWave®), and digital assets
`(e. g., a movie or television commercial), and distributing the
`created interactive content in real-time to a user over an
`Internet Protocol (IP)-based netWork (e.g., Internet and intra
`net), or other netWork supporting tWo-Way communication,
`to provide an interactive user experience.
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`As used herein, the term “content” is meant to include all
`forms of vieWable electronic information including, but not
`limited to, advertisements, promotions, music videos, motion
`pictures, and television programs. A preferred embodiment of
`the present invention is directed to a method for using an
`interactive video including displaying a video on a visual
`display, the video having at least one interface link associated
`thereWith, the interface link adapted to be displayed on the
`visual display and being linked to ancillary content accessible
`over a netWork (Wire or Wireless); interacting With the inter
`face link to access the ancillary content; interrupting the
`display of the video at a point in time; delivering the ancillary
`content to the visual display; and continuing the display of the
`video from the point in time Where the display of the video
`Was interrupted.
`As used herein, the phrase “ancillary content” is meant to
`include any content or page of content linked to the primary
`content or content linked therefrom. Also as used herein, the
`phrase “visual display” is meant to include all types of video
`or audio-visual devices including, but not limited to, screens
`for computer and televisions, personal digital assistants, or
`any other device that provides visual content to a user. As used
`herein, the phrase “interface link” is meant to include any
`means that functions as a link betWeen video content and
`another piece of content, for example, a hypertext link under
`an Internet protocol regime.
`Each interface link is preferably associated With, or related
`to, content being displayed on the screen. For example, if the
`user is Watching a basketball game, and the user is interested
`in a particular shoe Worn by a basketball player, the user may
`select the interface link associated With the basketball play
`er’s shoe. Interacting With the interface link associated With
`the basketball shoe alloWs the user to access one or more
`pages of information or media content related to the shoe of
`interest, including retail information. During the user’ s inter
`action With the interface link, the video stream is paused until
`the user returns to or continues the video stream delivery.
`Thus, a user may freely interact With one or more interface
`links to gain more information about an object of interest
`being displayed Without missing any of the primary content
`video. As used herein, the phrase “primary content” is meant
`to include any content ?rst requested by or to be shoWn to the
`user.
`The present invention is also directed to a method for
`creating an interactive video, including creating a link pro
`gram adapted to interrupt the delivery of video to a visual
`display and provide access to ancillary content accessible
`over a netWork; encoding the video onto a storage medium
`adapted to store video content; associating the link program
`With the video; delivering the video to the visual display; and
`displaying the video on the visual display.
`Once an interactive video has been created, it may be
`distributed in several Ways. A preferred distribution channel
`is to stream the video over an Internet Protocol (IP)-based
`netWork (e. g., Internet and intranet). Interface links may be
`displayed With the video stream in several Ways. For example,
`interface links may be delivered separately from the video
`stream such that the links overlay the video stream content
`When displayed to the user (a “?oating” interface link), or the
`interface links may be embedded in the video stream itself.
`Delivering interface links separately from the video stream
`eliminates any need to modify the original video content to
`support one or more interface links. Interaction With the inter
`face link provides the user access to at least one IP address, for
`example, a Web page address.
`The present invention provides real-time interactivity that
`permits the user to