I 1111111111111111 11111 111111111111111 1111111111 1111111111 lll111111111111111
`US009158745B2
`
`c12) United States Patent
`Barger et al.
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 9,158,745 B2
`Oct. 13, 2015
`
`(54) OPTIMIZATION OF MEDIA CONTENT
`USING GENERATED INTERMEDIATE
`MEDIA CONTENT
`
`(71) Applicant: AUTOMATED MEDIA
`PROCESSING SOLUTIONS INC.,
`Sausalito, CA (US)
`
`(72)
`
`Inventors: Sean Barger, Mill Valley, CA (US);
`Brian Rice, Darien, IL (US); Matt
`Butler, Beaverton, OR (US); David
`Pochron, Cambridge, MA (US)
`
`(73) Assignee: EQUILIBRIUM, Sausalito, CA (US)
`
`( *)
`
`Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 273 days.
`
`(21)
`
`Appl. No.: 13/752,110
`
`(22) Filed:
`
`Jan.28,2013
`
`(65)
`
`Prior Publication Data
`
`US 2013/0138774 Al
`
`May 30, 2013
`
`Related U.S. Application Data
`
`(60)
`
`Continuation of application No. 12/238,842, filed on
`Sep. 26, 2008, now Pat. No. 8,381,110, which is a
`division of application No. 12/173,747, filed on Jul.
`15, 2008, now Pat. No. 8,656,046, which is a division
`
`(51)
`
`(52)
`
`Int. Cl.
`G06F 17100
`G06F 17122
`G06F 17121
`
`(Continued)
`
`(2006.01)
`(2006.01)
`(2006.01)
`(Continued)
`
`U.S. Cl.
`CPC .......... G06F 1712264 (2013.01); G06F 171211
`(2013.01); G06F 1712235 (2013.01); G06F
`17127 (2013.01); G06F 17/30017 (2013.01);
`
`(58)
`
`G06F 17/30038 (2013.01); G06F 17/30058
`(2013.01); G06F 17/30905 (2013.01)
`Field of Classification Search
`CPC ... G06F 17/211; G06F 17/2264; G06F 17/27;
`G06F 17/2235; G06F 17/30017; G06F
`17 /30058; G06F 17 /30038
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,088,052 A
`5,355,472 A
`
`2/1992 Spielman et al.
`10/1994 Lewis
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`AU
`EP
`
`8/1998
`5303198
`12/1996
`0747842 Al
`(Continued)
`
`OTHER PUBLICATIONS
`
`"Tables of Contents service for Computers & Geosciences", Com(cid:173)
`puters and GeoSciences, vol. 23, Issue 5; http://library. iem.ac.
`ru/comp&geol00983004/sz977014.html,, retrieved on Mar. 18, 2004
`from website:, 1997, 2, pp.
`(Continued)
`
`Primary Examiner - Cesar Paula
`Assistant Examiner - David Faber
`(74) Attorney, Agent, or Firm - Michael A. Glenn; Perkins
`CoieLLP
`
`ABSTRACT
`(57)
`An automatic graphics delivery system that operates in par(cid:173)
`allel with an existing Web site infrastructure is provided. The
`system streamlines the post-production process by automat(cid:173)
`ing the production of media through content generation pro(cid:173)
`cedures controlled by proprietary tags placed by an author
`within URLs embedded within Web documents.
`
`14 Claims, 23 Drawing Sheets
`
`100
`
`SYSTEM
`
`110
`
`Web Server
`
`Client Browser
`
`Akamai Ex. 1001
`Akamai Techs. v. Equil IP Holdings
`IPR2023-00332
`Page 00001
`
`

`

`US 9,158,745 B2
`Page 2
`
`Related U.S. Application Data
`
`of application No. 11/269,916, filed on Nov. 7, 2005,
`now abandoned, which is a continuation-in-part of
`application No. 09/929,904, filed on Aug. 14, 2001,
`now Pat. No. 6,964,009, which is a continuation-in(cid:173)
`part of application No. 09/425,326, filed on Oct. 21,
`1999, now Pat. No. 6,792,575.
`
`Int. Cl.
`G06F 17130
`G06F 17127
`
`(51)
`
`(56)
`
`(2006.01)
`(2006.01)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,442,771 A
`5,530,852 A
`5,701,451 A
`5,708,845 A
`5,710,918 A
`5,737,619 A
`5,740,430 A *
`5,745,908 A
`5,758,110 A
`5,761,655 A
`5,793,964 A
`5,819,261 A
`5,822,436 A
`5,845,084 A
`5,845,279 A
`5,845,299 A
`5,860,068 A
`5,860,073 A
`5,861,881 A
`5,862,325 A
`5,864,337 A
`5,870,552 A
`5,880,740 A
`5,890,170 A
`5,895,476 A
`5,895,477 A
`5,903,277 A
`5,903,892 A
`5,937,160 A
`5,943,680 A
`5,956,737 A
`6,009,436 A
`6,167,442 A
`6,173,316 Bl*
`6,300,947 Bl *
`6,310,601 Bl*
`6,311,185 Bl
`6,345,279 Bl *
`6,412,008 Bl*
`6,456,305 Bl *
`6,463,445 Bl
`6,483,851 Bl
`6,484,149 Bl
`6,539,420 Bl *
`6,563,517 Bl
`6,591,280 B2
`6,623,529 Bl
`6,658,462 Bl *
`6,789,170 Bl*
`6,857,102 Bl*
`6,909,708 Bl
`6,925,595 Bl *
`6,938,073 Bl *
`6,970,602 Bl *
`7,016,963 Bl*
`7,089,330 Bl*
`7,284,201 B2
`7,313,361 B2
`7,406,434 Bl
`7,477,688 Bl
`
`8/1995
`6/1996
`12/1997
`1/1998
`1/1998
`4/1998
`4/1998
`4/1998
`5/1998
`6/1998
`8/1998
`10/1998
`10/1998
`12/1998
`12/1998
`12/1998
`1/1999
`1/1999
`1/1999
`1/1999
`1/1999
`2/1999
`3/1999
`3/1999
`4/1999
`4/1999
`5/1999
`5/1999
`8/1999
`8/1999
`9/1999
`12/1999
`12/2000
`1/2001
`10/2001
`10/2001
`10/2001
`2/2002
`6/2002
`9/2002
`10/2002
`11/2002
`11/2002
`3/2003
`5/2003
`7/2003
`9/2003
`12/2003
`9/2004
`2/2005
`6/2005
`8/2005
`8/2005
`11/2005
`3/2006
`8/2006
`10/2007
`12/2007
`7/2008
`1/2009
`
`1/1
`
`Filepp et al.
`Meske, Jr. et al.
`Rogers et al.
`Wistendahl et al.
`Lagarde et al.
`Judson
`Rosenberg et al.
`Anderson et al.
`Boss et al.
`Hoffman
`Rogers et al.
`Takahashi et al.
`Rhoads
`Cordell et al.
`Garofalakis et al.
`Arora et al.
`Cook
`Ferrel et al.
`Freeman et al.
`Reed et al.
`Marvin
`Dozier et al.
`Halliday et al.
`Sidana
`Orr et al.
`Orr et al.
`Sutherland et al.
`Hoffert et al.
`Davis et al.
`Shimizu et al.
`King eta!.
`Motoyarna et al.
`Sutherland et al.
`De Boor et al. ............... 709/218
`Kanevsky ..................... 715/866
`Moore et al. .................. 345/660
`Markowitz et al.
`1/1
`Li et al.
`.................. 709/228
`Fields et al.
`Qureshi et al. ................ 715/800
`Suzuki et al.
`Neogi
`Jarnmes et al.
`Fields et al.
`.................. 709/206
`Bhagwat et al.
`Orr et al.
`Lakritz
`Dutta ............................ 709/219
`Jacobs et al. .................. 711/133
`Bickmore et al.
`............ 715/205
`Krishnaswarny et al.
`Whitledge et al. ............ 715/234
`Mendhekar et al. .......... 709/217
`Smith et al. ................... 382/232
`Judd et al ...................... 709/228
`Mason .......................... 709/246
`Cohen-so la!
`Steelberg et al.
`Chang et al.
`Zhang et al.
`
`7,574,486 Bl*
`7,574,653 B2 *
`7,673,063 B2
`7,843,437 Bl*
`2002/0103934 Al *
`2002/0103935 Al *
`2003/0225568 Al
`2004/0025176 Al
`2005/0091311 Al
`2005/0190872 Al
`2005/0255852 Al
`2005/0278794 Al
`2006/0015580 Al
`2006/0127059 Al
`2007/0061198 Al
`2007/0234213 Al
`2008/0155230 Al
`2008/0186377 Al
`2008/0187279 Al
`2008/0195938 Al
`2008/0205389 Al
`2008/0207182 Al
`2008/0307454 Al
`2009/0003432 Al
`2009/0013347 Al
`2009/0070485 Al
`2009/0089422 Al
`2009/0240569 Al
`2009/0254672 Al
`2010/0046842 Al
`2010/0153495 Al
`2011/0221745 Al
`2011/0279638 Al
`2012/0016858 Al
`2012/0215629 Al
`
`8/2009 Cheng et al. .................. 709/219
`8/2009 Croney et al. ................. 715/249
`3/2010 Xie et al.
`11/2010 Arnold et al. ................. 345/169
`8/2002 Fishman et al.
`.............. 709/246
`8/2002 Fishman et al.
`.............. 709/246
`12/2003 Salmonsen
`2/2004 Franklin et al.
`4/2005 Lund et al.
`9/2005 Seong et al.
`11/2005 Steelberg et al.
`12/2005 Leinonen et al.
`1/2006 Gabriel et al.
`6/2006 Fanning
`3/2007 Ramer et al.
`10/2007 Krikorian et al.
`6/2008 Robbins et al.
`8/2008 Eriksson et al.
`8/2008 Gilley et al.
`8/2008 Tischer et al.
`8/2008 Fang et al.
`8/2008 Maharajh et al.
`12/2008 Ahanger et al.
`1/2009 Liu et al.
`1/2009 Ahanger et al.
`3/2009 Barger et al.
`4/2009 Barger et al.
`9/2009 Ramer et al.
`10/2009 Zhang
`2/2010 Conwell
`6/2010 Barger et al.
`9/2011 Goldman et al.
`11/2011 Periyannan et al.
`1/2012 Rathod
`8/2012 Girouard et al.
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`WO
`WO
`WO
`
`0782085 Al
`0818907 A2
`0843276
`0876034
`0883068 A2
`0886409 A2
`0895171 A2
`0926607 A2
`0949571 A2
`WO-9749252
`WO-98/40842
`WO-9843177
`
`7 /1997
`1/1998
`5/1998
`11/1998
`12/1998
`12/1998
`2/1999
`6/1999
`10/1999
`12/1997
`9/1998
`10/1998
`
`OTHER PUBLICATIONS
`
`Berinstein, P, "The Big Picture; Text and Graphics on UMI's
`ProQuest Direct: The Best (Yet) of Both Words", http://www.
`infotoday.corn/online/MarOL97 /picture3 .html, retrieved on Mar. 23,
`2004 from website:, Mar. 1997, 11, pp.
`Bulterman, D, "Models. Media and Motion: Using the Web to
`Support Multimedia Documents", Proceedings of 1997 Infl. Conf. on
`Multimedia Modeling, Singapore, Nov. 1997, 17-20, pp.
`Dobson, R, "Animating Your Web Pages with Direct Animation",
`Web Techniques; Jun. 1998, 49-52, 5pp.
`McNeil, S, "Research Interests", httpllwww.coe.uh.edu!'smcneil/
`research.htm, Mar. 18, 2004, 3, pp.
`Mohler, J, "Migrating Course Materials to the World Wide Web: A
`Case Study of the Department of Technical Graphics at Purdue Uni(cid:173)
`versity", Computer Networks and ISDN Systems; vol. 30, Issues
`20-21,, Nov. 12, 1988, 2 pp.
`Sakaguchi, et al., "A browsing tool for multi-lingual documents for
`users without multilingual fonts", ACM International Conference on
`Digital Libraries, 1996, 63-71, pp.
`Zaiane, et al., "Mining multimedia data", ACM Conference of the
`Center for Advanced Studies on Collaborative research, Nov. 1998,
`1-18, pp.
`
`* cited by examiner
`
`IPR2023-00332 Page 00002
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 1 of 23
`
`US 9,158,745 B2
`
`100
`
`SYSTEM
`
`110
`
`Web Server
`
`120a
`
`D
`
`DElt----------1
`Client Browser
`
`INTERNET
`
`120d
`
`Client Browser
`
`120b
`
`120c
`
`Client Browser
`
`D
`Client Browser
`
`FIG. 1
`
`IPR2023-00332 Page 00003
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 2 of 23
`
`US 9,158,745 B2
`
`200 B Original Media
`
`210
`
`MEDIA POST
`PRODUCTION
`SYSTEMS
`
`Media is manipulated
`by hand and prepared
`for the Web.
`
`220 B Generated Web media
`
`230
`
`HTML referring to
`media tags
`
`110
`
`Web Server
`
`160
`
`INTERNET
`
`120
`
`FIG. 2
`(PRIOR ART)
`
`IPR2023-00332 Page 00004
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 3 of 23
`
`US 9,158,745 B2
`
`200 B
`
`JOO
`
`SYSTEM
`
`Generated B
`
`Web
`media L..,--.:------1
`
`110
`
`230
`
`Modified HTML
`referring to
`generated media
`
`Web Server
`
`160
`
`INTERNET
`
`FIG. 3
`
`IPR2023-00332 Page 00005
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 4 of 23
`
`US 9,158,745 B2
`
`ORIGINAL IMAGES
`ASSETS
`
`Disk
`Management
`
`400
`
`410
`
`POST PRODUCTION
`SYSTEMS
`
`Manipulation
`Conversion
`Upload
`
`WEB IMAGES
`
`Disk
`Management
`
`460
`
`HTML PAGES
`
`110
`\
`
`WEB SERVER
`
`120
`
`FIG. 4
`(PRIOR ART)
`
`IPR2023-00332 Page 00006
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 5 of 23
`
`US 9,158,745 B2
`
`460
`
`HTML PAGES
`
`110
`
`100
`
`WEB SERVER
`
`SYSTEM
`
`ASSET MANAGEMENT
`AUTOMATIC MANIPULATION
`AUTOMATIC CONVERSION
`AUTOMATIC UPLOAD
`AUTOMATIC DISK MANAGEMENT
`
`120
`
`FIG. 5
`
`IPR2023-00332 Page 00007
`
`

`

`~ = ~
`
`~
`~
`~
`
`00 .
`~
`
`I
`-1
`
`-
`
`-
`
`-
`
`65
`f
`
`-
`
`-
`
`SYSTEM
`CREATION
`
`MEDIA
`
`-
`
`~
`-----
`
`-SvsTeM
`
`-
`
`~O,
`
`-
`
`-
`
`N
`~
`UI
`~
`~
`00
`""'"' UI
`_."-0
`rJl.
`d
`
`~
`N
`
`0 ....
`O'I
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`~ ....
`0
`
`(')
`
`N
`'"~
`
`0 ....
`
`Ul
`
`1
`
`1
`
`_______ Generated Images _________ Original Image_
`
`FIG. 6
`
`B
`
`B
`
`665
`
`660
`
`B
`
`645
`
`·
`
`···· --
`
`230
`
`images
`created
`system
`
`Modified
`
`HTML with I [} ~
`
`PARSER
`HTML
`
`-
`
`_ -
`
`610
`I
`I
`----
`~
`
`100
`
`WEB SERVER
`
`120
`
`110
`
`600
`
`300
`
`HTMLwith IQ
`
`tags
`proprietary
`
`IPR2023-00332 Page 00008
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 7 of 23
`
`US 9,158,745 B2
`
`SYSTEM
`/
`l OO
`
`Proprietary )
`media tag is
`converted to
`standard HTML
`that refers to
`media in cache.
`
`(
`
`Media tag
`and t~e HTML
`eqmvalen~
`are stored m
`media tags
`
`TO HTML
`CONVERTER
`
`620
`
`MEDIA
`CACHE
`
`MEDIA
`TAGS
`DATA-
`BASE
`
`640
`
`up media tags
`in database. If
`media tag is
`found then-'----
`produce
`modified HTML.
`
`\
`
`Media tags
`are replaced
`by standard
`HTML
`equivalent
`in HTML
`document.
`
`Modified
`HTML
`
`(Orig!n~I) B
`
`media 1s
`created.
`
`200
`
`( Media is)
`placed
`in system.
`
`( Generated )
`media is
`placed in
`media cache.
`
`MEDIA
`REPOSI-
`TORY
`
`660
`
`B 220
`
`630
`
`Media tag is used
`to generate
`Web media
`
`Web Server)
`passes
`requested
`web page
`to parser.
`
`(
`
`HTML is created)
`with media tags
`and placed on
`Web Server.
`
`Modified HTML)
`document is
`delivered to
`Web Server. ~-.it:==--.
`
`(
`
`( de::~ :~~~ied)
`HTML to Browser.
`
`"----__,,
`
`Q
`-
`(
`. .
`1
`ngma
`0
`HTML
`110
`
`130
`
`FIG. 7
`
`lUser views)
`
`Web page.
`
`r User requests)
`\ a Web page.
`
`IPR2023-00332 Page 00009
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 8 of 23
`
`US 9,158,745 B2
`
`AUTHORING FLOWCHART
`
`START
`
`USER ADDS ORIGINAL
`GRAPHIC TO
`SYSTEM
`
`USER CREATES
`HTML THAT CONTAINS
`PROPRIETARY
`MEDIA TAGS
`
`USER PLACES HTML
`ON WEB SERVER
`
`810
`
`820
`
`830
`
`840
`
`END
`
`FIG. 8
`
`IPR2023-00332 Page 00010
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 9 of 23
`
`US 9,158,745 B2
`
`HTML PARSING FLOWCHART
`
`START
`
`900
`
`910
`
`920
`
`930
`
`USER REQUESTS
`WEB PAGE
`
`WEB SERVER HANDS
`REQUEST OF WEB
`PAGE TO SYSTEM
`
`SYSTEM PARSES
`WEB PAGE
`
`940
`
`NO
`
`980
`
`DELIVER MODIFIED
`WEB PAGE TO WEB
`SERVER
`
`RETRIEVE HTML
`EQUIVALENT OF
`MEDIA TAG
`
`950
`
`990
`
`STOP
`
`REPLACE MEDIA TAG
`WITH HTML
`EQUIVALENT
`
`CONTINUE PARSING
`WEB PAGE
`
`960
`
`970
`
`FIG. 9
`
`IPR2023-00332 Page 00011
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 10 of 23
`
`US 9,158,745 B2
`
`MEDIA CREATION FLOWCHART
`
`START
`
`1000
`
`1010
`
`1020
`
`SYSTEM REQUESTS
`HTML EQUIVALENT
`TO A MEDIA TAG
`
`MEDIA TAG IS
`COMBINED
`WITH BANDWIDTH
`INFORMATION
`
`RETRIEVE HTML
`EQUIVALENT FROM
`DATABASE
`
`1050
`
`1080
`
`CREATE
`MEDIA
`USING
`MEDIA TAG
`
`1090
`
`STORE
`MEDIA IN
`MEDIA
`CACHE
`
`1100
`
`GENERATE
`HTML
`REFERRING TO
`GENERATED
`MEDIA
`
`1110
`
`1070
`
`REMOVE
`MEDIA TAG
`ENTRY FROM
`MEDIA TAG
`DATABASE
`
`RETURN HTML
`EOUIVALENTTO
`REOUESTOR
`
`PLACE MEDIA
`TAG AND HTML
`_.-J060
`,__ ________ __, EQUIVALENTIN
`MEDIA TAG
`DATABASE
`
`1120
`
`STOP
`
`FIG. 10
`
`IPR2023-00332 Page 00012
`
`

`

`N
`~
`UI
`~
`~
`00
`"'""' UI
`_."-0
`
`d r.,;_
`
`FIG. 11
`
`;;;
`
`~
`N
`
`0 ....
`....
`....
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`Ul
`
`N
`'"~
`
`0 ....
`:-+- ....
`0
`
`(')
`
`~ = ~
`
`~
`~
`~
`
`00 .
`~
`
`... ,-
`
`l
`
`OD
`
`(cid:143)
`
`Dependencies
`
`Generated File{s)
`
`Bam:lwldth
`
`MedlaScript
`
`MEDIA CURRENTLY IN THE FREER!OE DATABASE
`
`.Ch.ecJd)ependendes
`
`Clear the Freerlde Datab:se
`
`Equilibrium F:ree:ride Administration
`
`FIREEIRIO
`POIIIERE'!:1 Ell' ~
`
`,
`
`Equilibrium Freeride Adrnlnfstratlon
`
`0
`
`~I
`
`IPR2023-00332 Page 00013
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 12 of 23
`
`US 9,158,745 B2
`
`DATABASE DESCRIPTION
`
`1200
`
`\ SCRIPT TABLE
`
`MEDIA SCRIPT
`
`t -
`
`...,.,,,--1210
`
`HTML EQUIVALENT
`
`i--vl220
`
`BANDWIDTH
`
`i--v1230
`
`GENERATED FILE
`
`DEPENDENCY LIST
`
`i--v1240
`
`v~1250
`
`1
`
`(
`1270
`1200----
`
`I
`
`FIG. 12
`
`DEPENDENCY TABLE
`
`FILE NAME
`
`MODIFICATION DATE
`
`126 0
`
`I
`
`-
`
`IPR2023-00332 Page 00014
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 13 of 23
`
`US 9,158,745 B2
`
`ORIGINAL IMAGES
`
`D lhumbnail_mask.tga@100%.(RGB)D D
`
`(cid:143)
`
`I
`
`I!> I
`
`I--1300
`
`' -
`~
`V
`f~lJ>
`
`1310
`
`(cid:143)
`
`logo3.tga@100% (RGB)
`
`(cid:143)(cid:143)
`
`FIG.13
`
`IPR2023-00332 Page 00015
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 14 of 23
`
`US 9,158,745 B2
`
`HTML DOCUMENT WITH PROPRIETARY TAG
`
`1400
`
`(cid:143)
`
`\
`
`image.html
`
`<freerideimage></freerideimage>
`
`f1G. 14
`
`(cid:143)(cid:143)
`
`"-
`
`9
`
`IPR2023-00332 Page 00016
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 15 of 23
`
`US 9,158,745 B2
`
`HTML DOCUMENT VIEWED IN BROWSER
`
`Title frame
`
`(cid:143)(cid:143) (cid:143)
`
`1c.=Jr==J
`
`1500
`/
`I
`
`0
`
`~ I
`
`[@]
`
`'
`
`1510
`
`I
`
`CJ
`
`HTML DOCUMENT SOURCE
`
`imaaa.html
`
`DO
`-
`
`§
`"'
`
`!<II~
`
`FIG.15
`
`IPR2023-00332 Page 00017
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 16 of 23
`
`US 9,158,745 B2
`
`GENERATED GIF IMAGE
`
`(cid:143)
`
`927064674139.gif@ 100%
`
`(cid:143)(cid:143)
`
`m
`
`I
`
`---1600
`
`~
`
`A -V
`
`I <I I t>
`
`FIG.16
`
`IPR2023-00332 Page 00018
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 17 of 23
`
`US 9,158,745 B2
`
`200
`
`B
`
`210
`Media Post
`Production
`Systems
`
`230
`
`Original Media
`
`220 B
`
`Generated
`Web Media
`
`HTML Page
`
`0 referring to
`
`Media URLs
`
`! (cid:143) IE~~
`
`Web Server
`
`110
`
`F JG. 17
`
`IPR2023-00332 Page 00019
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 18 of 23
`
`US 9,158,745 B2
`
`200
`
`B
`
`Original
`Media
`
`100
`
`110
`
`!B,
`
`Web Server
`
`FIG. 18
`
`IPR2023-00332 Page 00020
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 19 of 23
`
`US 9,158,745 B2
`
`460
`
`HTML
`Pages
`
`110
`
`Web
`Server
`
`System
`
`100
`
`501
`
`Asset Management
`Automatic Manipulation
`Automatic Conversion
`Automaice Upload
`Automatic Customization
`Automatic Disk Management
`Proxy-cache control
`Delivery
`
`F JG. 19
`
`IPR2023-00332 Page 00021
`
`

`

`N
`~
`UI
`~
`~
`00
`"'""' UI
`_."-0
`
`d r.,;_
`
`~
`N
`
`0 ....
`
`0
`N
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`0 ....
`N
`~
`:-+(cid:173) ....
`0
`
`(')
`
`Ul
`
`~ = ~
`
`~
`~
`~
`
`00 .
`~
`
`Original Media
`
`2050-----JB
`
`FIG.20
`
`Generated Images
`
`2060~1B[ lB
`
`Server
`Web
`
`110
`
`System
`• 1 Creation
`
`Media
`
`1
`
`System
`
`100
`
`Server
`
`2000
`
`301
`
`IPR2023-00332 Page 00022
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 21 of 23
`
`US 9,158,745 B2
`
`Original{ B
`
`200
`
`Media is
`Created
`
`100
`
`2180
`
`2170
`
`2160
`
`2040
`
`Primary
`Cached Media
`
`User Profile
`Procedure
`
`Media
`Repository
`
`2120
`
`2130
`Primary
`Key
`Generation
`
`2190
`
`2000
`
`Server
`
`301
`
`110
`
`Web Server 1-------1
`
`Browser
`
`HTML Page with
`Proprietary
`URL Tags
`
`FIG.21
`
`IPR2023-00332 Page 00023
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 22 of 23
`
`US 9,158,745 B2
`
`URL
`
`2200
`
`Parse Proprietaty URL Tags
`.--_ _ _ _ _.__ _ _ _ _ _,.,,.... 2220
`Final Lookup Key Generation
`
`2210
`
`y
`
`Separate Dynamic Tags
`
`2250
`
`Intermediate Image Lookup Key Generation
`
`2260
`Retrieve Cached
`Image
`
`2271
`
`Content Generation
`For Zoom/Pan/
`Scale/Slice
`
`2260
`Content
`Gene mt ion
`
`Image
`Format
`Conversion
`
`2273
`
`2280--...r----~------.
`User Profile Processing--------~
`
`Proxy-cache Control
`
`2290
`
`To Browser
`
`2295
`
`FIG. 22
`
`IPR2023-00332 Page 00024
`
`

`

`U.S. Patent
`
`Oct. 13, 2015
`
`Sheet 23 of 23
`
`US 9,158,745 B2
`
`Start
`
`User adds original
`graphic to system
`
`2310
`
`User creates content
`generation procedures
`on system to
`manipulate originals
`
`User creates HTML
`pages on Web Server
`with Proprietary
`URL Tags
`
`2320
`
`2330
`
`End
`
`2340
`
`FIG.23
`
`IPR2023-00332 Page 00025
`
`

`

`US 9,158,745 B2
`
`1
`OPTIMIZATION OF MEDIA CONTENT
`USING GENERATED INTERMEDIATE
`MEDIA CONTENT
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a Continuation of U.S. Ser. No. 12/238,
`842, filed Sep. 26, 2008, which is a Divisional ofU.S. Ser. No.
`12/173,747, filed Jul. 15, 2008, which is a Divisional of U.S.
`Ser. No. 11/269,916, filed Nov. 7, 2005, which is a Continu(cid:173)
`ation-in-Part ofU.S. Ser. No. 09/929,904, filedAug. 14, 2001,
`now U.S. Pat. No. 6,964,009 granted on Nov. 8, 2005, which
`is a Continuation-in-Part of U.S. Ser. No. 09/425,326, filed
`Oct. 21, 1999, now U.S. Pat. No. 6,792,575, granted on Sep. 15
`14, 2004, each of which is hereby incorporated in its entirety
`by this reference thereto.
`
`2
`Also, from a user's perspective, the current state of the art
`is to offer the consumer zooming and panning capabilities so
`that by clicking on an image the consumer can view more
`closely or from a different angle. On the horizon are pages
`5 with three-dimensional imagery that enable a user to move
`around a page that can look more like a room than a brochure.
`While interesting, these features are merely incremental
`improvements to a consumer's surfing experience.
`D. C. A. Bulterman, Models, Media, and Motion: Using the
`10 Web to Support Multimedia Documents, Proceedings of 1997
`International Conference on Multimedia Modeling, Sin(cid:173)
`gapore, 17-20 Nov. 1997 discloses "an effort underway by
`members of industry, research centers and user groups to
`define a standard document format that can be used in con-
`junction with time-based transport protocols over the Internet
`and intranets to support rich multimedia presentations. The
`paper outlines the goals of the W3C's Synchronized Multi(cid:173)
`media working group and presents an initial description of the
`first version of the proposed multimedia document model and
`20 format."
`Text and Graphics on UMI 's Pro Quest Direct: The Best
`(yet) of both Worlds, Online, vol. 21, no. 2, pp. 73-7, March(cid:173)
`April 1997 discloses an information system that offers "peri(cid:173)
`odical and newspaper content covering a wide range ofbusi-
`25 ness, news, and professional topics ... letting the user search
`both text and graphics and build the product to suit. Articles
`can be retrieved in varying levels of detail: citation, abstracts,
`full text, and text with graphics. Images come in two flavors:
`Page Image, a virtual photocopy, and Text+Graphics, in
`30 which graphics are stored separately from the text and are
`manipulable as discrete items .... [The system] comes in two
`versions: Windows and Web."
`John Mills Dudley, Network-Based Classified Information
`Systems, AU-A-53031/98 (27 /08/98) discloses a "system for
`35 automatically creating databases containing industry, ser(cid:173)
`vice, product and subject classification data, contact data,
`geographic location data (CCG-data) and links to web pages
`from HTML, XML, or SGML encoded web pages posted on
`computer networks such as Intemets or Intranets . . . .
`40 The ... databases may be searched for references (URLs) to
`web pages by use of enquiries which reference one or more of
`the items of the CCG-data. Alternatively, enquiries referenc(cid:173)
`ing the CCG-data in the databases may supply contact data
`without web page references. Data duplication and coordina-
`45 tion is reduced by including in the web page CCG-data dis(cid:173)
`play controls which are used by web browsers to format for
`display the same data that is used to automatically update the
`databases."
`Cordell et al, Automatic Data Display Formatting with A
`50 Networking Application, U.S. Pat. No. 5,845,084 (Dec. 1,
`1998) discloses a placeholder image mechanism. "When a
`data request is made, the data transfer rate is monitored. When
`the receive data transfer rate is slow, and the data contains an
`embedded graphical image of unknown dimensions, a small
`55 placeholder image is automatically displayed for the user
`instead of the actual data. The small placeholder image holds
`a place on a display device for the data or the embedded
`graphical image until the data or embedded graphical image
`is received. When embedded graphical image is received, the
`60 placeholder image is removed, and the display device is refor(cid:173)
`matted to display the embedded graphical image."
`Jonathon R. T. Lewis, System For Substituting Tags For
`Non-Editable Data Sets In Hypertext Documents And Updat(cid:173)
`ing Web Files Containing Links Between Data Sets Corre-
`65 sponding To Changes Made To The Tags, U.S. Pat. No. 5,355,
`472 (Oct. 11, 1994) discloses a "hypertext data processing
`system wherein data sets participating in the hypertext docu-
`
`BACKGROUND OF THE INVENTION
`
`1. Technical Field
`The invention relates to software systems. More particu(cid:173)
`larly, the invention relates to an Internet server-based soft(cid:173)
`ware system that provides delivery of automated graphics and
`other media to Web sites for access by an end user or con(cid:173)
`sumer.
`2. Description of the Prior Art
`Most Web sites today are primarily handmade. From the
`guy publishing a simple online technology newsletter from
`his home, to the Fortune 1000 company's multi-tiered site
`with hundreds of pages of text, images, and animations, the
`Web developer and each of his HTML-coding and graphics(cid:173)
`producing coworkers toil page by page and image by image.
`Thousands of established online companies employ hundreds
`of highly-skilled workers just to produce and maintain their
`Web sites. After all, the Web is now a major selling vehicle
`and marketing medium for many of these companies. The
`Web has even sprouted service industries such as, for
`example, public companies with multi-billion dollar valua(cid:173)
`tions created just to consult and produce Web sites for others.
`Most Web developers who use established WYSIWYG
`tools in the industry still must produce each page on their Web
`site one by one. The same rate applies to preparing and plac(cid:173)
`ing images, animations, and other visual assets. Each page
`represents its own set of issues ranging from whether to use
`GIF, JPEG, or PNG file formats, to finding the optimum bit
`depth for each image to ensure the fastest downloading
`through the different browsers of the consumer. The bottle(cid:173)
`necked state of the customer's workflow to produce graphics
`for Web pages can be described as follows:
`Current Workflow for Creating Web Graphics
`Original Artwork/Asset Creation
`Use third-party point products
`Asset Editing
`Scale/reduce/slice
`Asset Format Conversion
`JPEG/GIF/PNG
`Asset Staging
`Place in Web file system
`Edit HTML
`Create/Modify HTML for particular page
`Store HTML on Web server
`View final pages
`Repeat process for each version of each graphic on each
`page
`Estimated Time
`Two hours per page times the number of pages
`
`IPR2023-00332 Page 00026
`
`

`

`US 9,158,745 B2
`
`3
`ment may be edited, the data processing system inserting tags
`into the data sets at locations corresponding to the hypertext
`links to create a file which is editable by an editor and the data
`processing system removing the tags, generating a revised
`data set and updating the link information after the editing
`process. Its main purpose is to preserve the linking hierarchy
`that may get lost when the individual data sets get modified."
`Wistendahl et al, System for Mapping Hot Spots in Media
`Content Interactive Digital Media Program, U.S. Pat. No.
`5,708,845 (Jan. 13, 1998) discloses a "system for allowing 10
`media content to be used in an interactive digital media (ID M)
`program [that] has Frame Data for the media content and
`object mapping data (N Data) representing the frame
`addresses and display location coordinates for objects 15
`appearing in the media content. The N Data are maintained
`separately from the Frame Data for the media content, so that
`the media content can be kept intact without embedded codes
`and can be played back on any system. The IDM program has
`established linkages connecting the objects mapped by the N 20
`Data to other functions to be performed in conjunction with
`display of the media content. Selection of an object appearing
`in the media content with a pointer results in initiation of the
`interactive function. A broad base of existing non-interactive
`media content, such as movies, videos, advertising, and tele- 25
`vision programming can be converted to interactive digital
`media use. An authoring system for creating IDM programs
`has an object outlining tool and an object motion tracking tool
`for facilitating the generation of N Data. In a data storage
`disk, the Frame Data and the N Data are stored on separate 30
`sectors. In a network system, the object mapping data and
`IDM program are downloaded to a subscriber terminal and
`used in conjunction with presentation of the media content."
`Rogers et al, Method for Fulfilling Requests of A Web
`Browser. U.S. Pat. No. 5,701,451 (Dec. 23, 1997) and 35
`Lagarde at al, Method for Distributed Task Fulfillment ofWeb
`Browser Requests, U.S. Pat. No. 5,710,918 (Jan. 20, 1998)
`disclose essentially "improvements which achieve a means
`for accepting Web client requests for information, obtaining
`data from one or more databases which may be located on 40
`multiple platforms at different physical locations on an Inter(cid:173)
`net or on the Internet, processing that data into meaningful
`information, and presenting that information to the Web client
`in a text or graphics display at a location specified by the
`request."
`Tyan et al, HTML Generator, European Patent Application
`No. EP 0843276 (May 20, 1998) discloses "generating an
`HTML file based on an input bitmap image, and is particu(cid:173)
`larly directed to automatic generation of an HTML file, based
`on a scanned-in document image, with the HTML file in turn 50
`being used to generate a Web page that accurately reproduces
`the layout of the original input bitmap image."
`TrueSpectra has a patent pending for the technology
`employed in its two products, IrisAccelerate and IrisTransac(cid:173)
`tive. These products are designed for zooming and panning 55
`and simple image transformations and conversions, respec(cid:173)
`tively. They support 10 file formats and allow developers to
`add new file formats via their SDK. They do not require the
`use of Flashpix for images. However, their documentation
`points out that performance is dependent on the Flashpix 60
`format. The system would be very slow if a non-Flashpix
`format was used.
`TrueSpectra allows the image quality and compression to
`be set for JPEGs only. The compression setting is set on the
`server and all images are delivered at the same setting.
`TrueSpectra has a simple caching mechanism. Images in
`the cache can be cleared out automatically at certain times and
`
`4
`it does not have any dependency features for image propaga(cid:173)
`tion. The Web server needs to be brought down in order to
`update any original assets.
`TrueSpectra does not require plug-ins to operate features
`such as zooming/panning or compositing. The alternative to
`plug-ins is using their Javascript or active server page tech(cid:173)
`nology. These technologies are used by many Web sites to
`provide interactivity, but not all Web browsers work correctly
`with these technologies.
`TrueSpectra relies on Flashpix as its native file format and
`does not support media types such as multi-GIFs and sound
`formats. Flashpix files are typically larger than most file for(cid:173)
`mats. Access to files is faster for zooming and panning, but
`appears to be quite slow.
`The key to IrisTransactive is the compositing subsystem. It
`requires three things to build a shopping solution using image
`composition.
`1) The original images must be created. It is suggested that
`the image be converted to Flashpix for better perfor(cid:173)
`mance.
`2) All of the individual images must be described in XML
`using the image composer program. The program allows
`the editor to specify anchor points, layer attributes, and
`layer names. The resulting file is between 5 k and 50 k.
`3) The Web designer must place HTML referring to the
`XML in the Web site. By specifying parameters to the
`XML, the Web designer can turn on or off layers.
`The herein above process for compositing images enables
`Web designers to create shopping sites. However, a lot of
`overhead is the result. The XML documents add 5 k-50 k to a
`Web site. The compositing commands that are embedded in
`the HTML are difficult to understand. And, because the com(cid:173)
`positing feature requires several steps to implement, it is not
`suitable for every image on a Web site. The process seems to
`be designed for the specific purpose of shopping.
`MediaBin™ is limited to activities behind the firewall
`automating only the "post-creative busywork." In addition,
`MediaBin requires the use of an application server to function
`through a web interface. Thus images may not be directly
`added to any existing web page.
`Macromedia' s Generator operates by embedding variables
`in their proprietary Flash format. Therefore the actual imag(cid:173)
`ing operations are somewhat limited and cannot be controlled
`directly from a web page request.
`MGI Software sells point solutions that require end-users
`to download a viewer to process a proprietary image format.
`PictureIQ offers a server-side image-processing appliance
`that provides a limited set of Photoshop functionalities. This
`appliance runs on the web-page server, processes information
`embedded in the web page, and rewrites the web page with
`image data.
`The disclosed prior art fail to provide systems and meth-
`odologies that result in a quantum leap in the speed with
`which they can modify and add images, video, and sound to
`sites, in the volume of data they can publish internally and
`externally, and in the quality of the output. The development
`of such an automated media delivery system would constitute
`a major technological advance.
`It would be advantageous to empower an end user with
`flexibility and control by providing interactive page capabili(cid:173)
`ties.
`It would be advantageous from an end user's perspective to
`generate Web pages that contain active graphics. For
`example, clicking on a Corvette image will cause a simple
`65 menu to pop up suggesting alternative colors and sizes in
`which to see the car. Clicking on portions of the image, such
`as a fender, can call up a close-in view of the fender.
`
`45
`
`IPR2023-00332 Page 00027
`
`

`

`US 9,158,745 B2
`
`6
`client. The need for the Web author to create different ver(cid:173)
`sions of a Web site is reduced because the image content of the
`site is automatically handled by the system. In addition, gen(cid:173)
`er