USOO8495242B2
`
`(12) United States Patent
`Barger et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8.495,242 B2
`Jul. 23, 2013
`
`(54)
`(75)
`
`(73)
`
`(*)
`
`(21)
`(22)
`(65)
`
`(60)
`
`AUTOMATED MEDLA DELVERY SYSTEM
`
`Inventors: Sean Barger, Mill Valley, CA (US);
`Steve Johnson, Mill Valley, CA (US);
`Matt Butler, Beaverton, OR (US); Jerry
`Destremps, Sausalito, CA (US); David
`Pochron, Cambridge, WI (US); Trent
`Brown, San Anselmo, CA (US)
`Assignee: Automated Media Processing
`Solutions, Inc., Sausalito, CA (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 76 days.
`
`Notice:
`
`Appl. No.: 12/713,637
`
`Filed:
`
`Feb. 26, 2010
`
`Prior Publication Data
`US 2010/O153495 A1
`Jun. 17, 2010
`
`Related U.S. Application Data
`Division of application No. 12/173,747, filed on Jul.
`15, 2008, which is a division of application No.
`11/269,916, filed on Nov. 7, 2005, now abandoned,
`which is a continuation-in-part of application No.
`09/929,904, filed on Aug. 14, 2001, now Pat. No.
`6,964,009, which is a continuation of application No.
`09/425,326, filed on Oct. 21, 1999, now Pat. No.
`6,792,575.
`
`(51)
`
`(52)
`
`Int. C.
`G06F 15/16
`U.S. C.
`USPC .............. 709/236; 709/246; 341/50; 708/204
`
`(2006.01)
`
`(58) Field of Classification Search
`USPC ................. 709/263,234, 231, 226, 219, 217,
`709/204, 203, 200; 370/552,468, 431, 353,
`370/352, 330, 280, 241: 341/50; 708/204
`See application file for complete search history.
`References Cited
`
`(56)
`
`AU
`EP
`
`U.S. PATENT DOCUMENTS
`5,088,052 A
`2/1992 Spielman et al.
`5,355,472 A 10, 1994 Lewis
`5,442,771 A
`8/1995 Filepp et al.
`5,530,852 A
`6/1996 Meske, Jr. et al.
`5,701,451 A 12/1997 Rogers et al.
`(Continued)
`FOREIGN PATENT DOCUMENTS
`A-53031.98
`8, 1998
`O747842
`12/1996
`(Continued)
`OTHER PUBLICATIONS
`Berinstein, Paula; “The Big Picture; Text and Graphics on UMI's
`ProQuest Direct: The Best (Yet) of Both Worlds”. Mar. 1997:
`retrieved on Mar. 23, 2004 from website: http://infotoday.com/
`online/MarOL97 picture3.html, 11 pages.
`(Continued)
`Primary Examiner — David Lazaro
`Assistant Examiner — Charles Murphy
`(74) Attorney, Agent, or Firm — Michael A. Glenn; Glenn
`Patent Group
`ABSTRACT
`(57)
`An automatic graphics delivery system that operates in par
`allel with an existing Web site infrastructure is provided. The
`system streamlines the post-production process by automat
`ing the production of media through content generation pro
`cedures controlled by proprietary tags placed by an author
`within URLs embedded within Web documents.
`20 Claims, 23 Drawing Sheets
`
`100
`
`SYSTEM
`
`
`
`Web Server
`
`Client Browser
`
`
`
`Cient Browser
`
`Client Browser
`
`Ciet Bowser
`
`Akamai Ex. 1001
`Akamai Techs. v. Equil IP Holdings
`IPR2023-00330
`Page 00001
`
`

`

`US 8,495,242 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`A
`32.
`3. With. al.
`5.7376 to A
`4, 1998 E.
`5.745.90s A
`4, 1998 Anderson etal
`575s.1 10 A
`5, 1998 BOSS etal
`576,655 A
`6, 1998 Hoffman
`5,793.964 A
`8/1998 Rogers et al.
`5,819.261 A 10, 1998 Takahashi et al.
`5.822436 A 10, 1998 Rhoads
`5.845084 A 12/1998 Cordell et all
`5,845.379 A 12/1998 Garofalakis et al
`
`8, 2008 Tischer et al.
`2008/O195938 A1
`8/2008 Fang et al.
`2008/0205389 A1
`8/2008 Maharajh et al.
`2008/0207182 A1
`1/2009 Ahanger et al.
`2009 OO13347 A1
`3/2009 Barger et al.
`2009/0070485 A1
`4/2009 Barger et al.
`2009.0089422 A1
`9, 2009 Ramer et al.
`2009,024.0569 A1
`2009/0254672 A1 10/2009 Zhang
`2010, 0046842 A1
`2/2010 Conwell
`2010.0153495 A1
`6/2010 Barger et al.
`2011/0221745 A1
`9, 2011 Goldman et al.
`2011/0279638 A1 1 1/2011 Periyannan et al.
`
`1f1
`
`5,845,299 A 12/1998 Arora et all
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`2012fOO16858 A1
`
`1/2012 Rathod
`
`1, 1999 Cook
`5,860,068 A
`1/1999 Ferrel et al.
`5,860,073. A
`1/1999 Freeman et al.
`5,861,881. A
`1/1999 Reed et al.
`5,862,325 A
`1, 1999 Marvin
`5,864,337 A
`2, 1999 Dozier et al.
`5,870,552 A
`3/1999 Halliday et al.
`5,880,740 A
`3/1999 Sidana
`5,890, 170 A
`4/1999 Orr et al.
`5,895,476 A
`4/1999 Orr et al.
`5,895.477 A
`5/1999 Hoffert et al.
`5,903,892 A
`8/1999 Davis et al.
`5.937,160 A
`8/1999 Ohga et al.
`5,943,680 A
`9/1999 King et al.
`5,956,737 A
`6,009,436 A 12/1999 Motoyama et al.
`6,311, 185 B1
`10/2001 Markowitz et al.
`6,456,305 B1 ck
`9, 2002 Qureshi et al.
`8. s R
`38: S. et al. ......................... 1f1
`6,484.149 B1
`11, 2002 Nies et al.
`6,563.5 17 B1 * 5/2003 Bhagwat et al. .............. 71.5/735
`6,591.280 B2
`T/2003 Orr
`6,623.529 B1
`9, 2003 Lakritz
`6,909,708 B1* 6/2005 Krishnaswamy et al. ... 370/352
`6,938,073 B1
`8, 2005 Mendhekar et al.
`7,284,201 B2 10/2007 Cohen-Solal
`7,313.361 B2 12/2007 Steelberg et al.
`7,406.434 B1
`7/2008 Chang et al.
`7,477,688 B1
`1/2009 Zhang et al.
`T.673,063 B2
`3/2010 Xie etal
`2003/0225568 A1 12, 2003 Salmonsen
`2004/002517.6 A1
`2/2004 Franklin et al.
`2005/0091311 A1
`4/2005 Lund et al.
`2005/0255852 A1 1 1/2005 Steelberg et al.
`2005/0278794 A1 12/2005 Leinonen et al.
`2006/0015580 A1
`1/2006 Gabriel et al.
`2006/O127059 A1
`6/2006 Fanning
`2007, OO61198 A1
`3/2007 Ramer et al.
`2007/0234213 A1 10, 2007 Krikorian et al.
`2008. O155230 A1
`6, 2008 Robbins et al.
`2008/O186377 A1
`8/2008 Eriksson et al.
`
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`WO
`WO
`WO
`
`FOREIGN PATENT DOCUMENTS
`O782O85
`7/1997
`O818907
`1, 1998
`O843.276
`5, 1998
`O876.034
`11, 1998
`O883068
`12/1998
`O8864.09
`12/1998
`O895171
`2, 1999
`O9266O7
`6, 1999
`O949.9571
`10, 1999
`WO 97/49252
`12/1997
`WO 98.40842
`9, 1998
`WO98,43177
`10, 1998
`OTHER PUBLICATIONS
`Bulterman, Dick.C.A.; Models, Media and Motion. Using the Web to
`Support Multimedia Documents; Proceedings of 1997 Int’l Conf. on
`Multimedia Modeling; p. 17-20; Nov. 1997; Singapore.
`Dobson, R.; Animating Your Web Pages with Direct Animation, Web
`Techniques; vol. 3, No. 6, p. 49-52; Jun. 1998.
`McNeil, Sara; Research Interests; retrieved on Mar. 18, 2004 from
`website: http//www.coe.uh.edu/smcneil/research.htm, 3 pages.
`Mohler, J.L.; Migrating Course Materials to the World Wide Web. A
`Case Study of the Department of Technical Graphics at Purdue
`University, Computer Networks and ISDN Systems; vol. 30, Issues
`20-21, pp. 1981-1990; Nov. 12, 1988.
`Sakaguchi, et al., “A browsing tool for multi-lingual documents for
`s
`USS without multi-lingual fonts'; 1996; ACM International Confer
`ence on Digital Libraries, pp. 63-71.
`Tables of Contents service for Computers & Geosciences; Copyright
`1997; Computers and GeoSciences, vol. 23, Issue 5, retrieved on Mar.
`18, 2004 from website: http://library.iem.ac.ru/comp&geo?
`00983.004'sz977014.html, 2 pages.
`Zaiane, et al.; "Mining multimedia data'; Nov. 1998; ACM Confer
`ence of the Center for Advanced Studies on Collaborative research,
`pp. 1-18.
`
`* cited by examiner
`
`IPR2023-00330 Page 00002
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 1 of 23
`
`US 8,495,242 B2
`
`
`
`110
`
`Web Server
`
`100
`
`SYSTEM
`
`Client BrOWSer
`
`Client BrOWSer
`
`120b
`
`120C
`
`Client BrOWSer
`
`Client BrOWSer
`
`FIG. I
`
`IPR2023-00330 Page 00003
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 2 of 23
`
`US 8,495,242 B2
`
`200
`
`Original Media
`
`210
`
`MEDIA POST
`PRODUCTION
`SYSTEMS
`
`Media is manipulated
`by hand and prepared
`for the Web.
`
`220
`
`Generated Web media
`
`
`
`110
`
`HTML referring to
`media tags
`
`
`
`Web Server
`
`160
`
`
`
`FIG. 2
`(PRIOR ART)
`
`Web BrOWSer
`
`IPR2023-00330 Page 00004
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 3 of 23
`
`US 8,495,242 B2
`
`200
`
`Original Media
`
`100
`
`SYSTEM
`
`300
`
`N
`
`HML With
`proprietary
`media tags
`
`220
`
`Generated
`Web
`media
`
`230
`
`N
`
`MOdified HM
`referring to
`generated media
`
`160
`
`\
`
`7
`
`110 R /
`
`N
`Web Server
`
`120
`
`FIG. 3
`
`Web BOWSer
`
`IEEE
`
`IPR2023-00330 Page 00005
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 4 of 23
`
`US 8,495,242 B2
`
`400
`
`ORIGINAL MAGES
`ASSETS
`
`Disk
`Management
`
`
`
`460
`
`
`
`
`
`HTML PAGES
`
`Manipulation
`P 0SETION COnVersion
`Upload
`
`
`
`
`
`
`
`
`
`
`
`
`
`I {O
`
`WEBSERVER
`
`120
`
`BROWSER
`
`WEBMAGES
`
`Disk
`Management
`
`FIG. 4
`(PRIOR ART)
`
`IPR2023-00330 Page 00006
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 5 of 23
`
`US 8,495,242 B2
`
`460
`
`HTM PAGES
`
`
`
`
`
`110
`
`WEBSERVER
`
`SYSTEM
`
`
`
`
`
`120
`
`
`
`BROWSER
`
`FIG. b
`
`500
`A
`ASSET MANAGEMENT
`AUTOMATIC MANIPULATION
`AUTOMATIC CONVERSION
`AUTOMATIC UPLOAD
`AUTOMATIC DSK MANAGEMENT
`
`Y
`
`IPR2023-00330 Page 00007
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 6 of 23
`
`VidaW
`
`AYWOLISOdSY
`
`099
`
`S9
`9
`
`
`
`JHOVOVIGaW
`
`dSvavlvd
`
`0
`bg
`
`SP9
`
`WALSAS
`
`Vida
`
`Ld]WOS
`
`vIdaWVidsW
`
`NOiva¥9
`W3LSAS
`
`DNIHOVO
`
`WALSAS
`
`WLH
`
`YdaSuVd
`
`US 8,495,242 B2
`
`
`
`
`
`
`
`Poafew]eulBuQre“sabewi|payeaueyBT
`
`oe
`LITAWISVAP
`INIDNA_
`Auejalsdosd
`WMWLH
`$6e}
`
`009
`
`
`
`YAAYAS84M
`
`OTT
`
`OgT
`
`0&2
`
`iS
`UMWLH
`Papo
`pe]ea19
`WwaysAs
`sebew
`
`IPR2023-00330 Page 00008
`
`IPR2023-00330 Page 00008
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 7 of 23
`
`US 8,495,242 B2
`
`Original
`media is
`Created.
`
`SYSTEM
`f
`100
`
`Proprietary
`620
`media tag is
`Converted to
`Standard HTML O
`ted
`that refers to
`G
`media in Cache.
`enerate
`media is
`placed in
`media Cache.
`
`
`
`Mediat
`edia tag
`and the HTML MEAA.
`equivalent VCWEERJ700
`Parser
`are stored in
`media tags
`parses HTML
`database.
`Eg for
`media tags.
`
`
`
`
`
`
`
`TAGS
`DATA-
`BASE
`
`640
`
`200
`
`Media i
`E.
`in System
`
`MEDIA
`REPOS
`TORY
`
`660
`
`220
`
`6.30
`MEDIA
`
`
`
`SYSTEM
`
`Media tag is used
`to generate
`Web media
`
`Parser lookS
`up media tags
`in database. If
`found then
`|
`produce
`\
`modified HTML.
`
`Generated
`Web media
`610
`
`PARSER
`
`Media tags
`are replaced
`by Isard
`equivalent
`
`N
`
`Modified
`
`Web Server
`passes
`requested
`to parser.
`
`N
`
`
`
`Modified HTML
`documentis
`delivered to
`Web Sever.
`E
`Web Server
`deliverS modified
`HTML to BrOWSer. s
`Web Server
`
`Original
`HTML
`110
`
`HTML is Created
`with media tags
`and placed On
`Web Server.
`
`FIG. 7
`
`G E.
`
`Web page.
`
`-
`t
`
`(e.
`
`a Web page.
`
`s
`
`120
`
`IPR2023-00330 Page 00009
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 8 of 23
`
`US 8,495,242 B2
`
`AUTHORNG FLOWCHART
`
`
`
`800
`
`USER ADDS ORIGINA
`GRAPHICTO
`SYSTEM
`
`810
`
`USER CREATES
`HTM THAT CONTAINS
`PROPRIETARY
`MEDIATAGS
`
`USER PLACES HTML
`ON WEB SERVER
`
`820
`
`830
`
`FIG. 8
`
`IPR2023-00330 Page 00010
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 9 of 23
`
`US 8,495,242 B2
`
`HTML PARSING FLOWCHART
`
`START
`
`900
`
`910
`
`920
`
`930
`
`USER REQUESTS
`WEBPAGE
`
`WEBSERVER HANDS
`REQUEST OF WEB
`PAGE TO SYSTEM
`
`SYSTEM PARSES
`WEB PAGE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`940
`
`NO
`
`FOUND
`A MEDIA
`TAG?
`
`980
`
`
`
`DELIVER MODIFIED
`WEB PAGE TOWEB
`SERVER
`
`RETREVE HTML
`EOUVALENT OF
`MEDIATAG
`
`
`
`950
`
`990
`
`STOP
`
`REPLACE MEDIATAG -960
`WITH HTML
`EQUIVALENT
`
`CONTINUE PARSING
`WEBPAGE
`
`
`
`970
`
`FIG. 9
`
`IPR2023-00330 Page 00011
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 10 of 23
`
`US 8,495,242 B2
`
`MEDIA CREATION FLOWCHART
`
`STAR
`
`1000
`
`
`
`SYSTEM REQUESTS
`HTMLEOUVALENT
`TO A MEDIATAG
`
`1010
`
`MEDIATAGS
`COMBINED
`WITH BANOWDTH
`INFORMATION
`
`1020
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`DOES
`MEDIATAG EXIST
`NMEDIATAG
`DATABASE2
`
`
`
`
`
`
`
`HAVE
`ANY OF THE ORIGINAL
`ASSES USED TO CREATE
`THE MEDIA
`CHANGED?
`
`
`
`NO
`
`
`
`RETRIEVE HTML
`EOUVALENT FROM
`DATABASE
`
`E.
`USING
`MEDIATAG
`
`1090
`
`
`
`STORE
`MEDAN
`MEDIA
`CACHE
`
`1100
`
`
`
`GENERATE
`HTML
`REFERRING TO
`GENERATED
`MEDIA
`
`REMOVE
`MEDIATAG
`ENTRY FROM
`MEDIATAG
`DATABASE
`
`1050
`
`1110
`
`RETURN HTML -1060
`EQUIVALENT TO
`REQUESTOR
`
`PLACE MEDA
`TAG AND HTML
`EQUIVALENT IN
`MEDIATAG
`DATABASE
`
`1120
`
`FIG. IO
`
`IPR2023-00330 Page 00012
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 11 of 23
`
`US 8,495,242 B2
`US 8,495,242 B2
`
`
`
`I I ’50 I.H.
`
`ITDid
`
`so|ouspusdeg
`
`
`
`
`
`UONESUIWIpYaplaads
`
`
`
`
`
`HOnR.YSTUIpYspliee1,gamMpqyinby@)ress
`
`
`
`
`
`Ssqujec]epueslgsq7Ieop
`
`
`
`Solouapusdedosy_
`
`wniagninby
`
`
`
`
`
`
`
`ASVEVLVGJOMAIY4SHLNIATLNSYENOVIGIIN
`
`
`
`IPR2023-00330 Page 00013
`
`IPR2023-00330 Page 00013
`
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 12 of 23
`
`US 8.495,242 B2
`
`DATABASE DESCRIPTION
`
`SCRIPTTABLE
`
`
`
`MEDIA SCRIPT
`
`HTML EQUVALENT
`
`BANDWDTH
`
`1200
`
`
`
`
`
`
`
`
`
`1260
`
`DEPENDENCY TABLE
`
`
`
`FILE NAME
`
`MODIFICATION DATE
`
`FIG. 12
`
`IPR2023-00330 Page 00014
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 13 of 23
`
`US 8,495,242 B2
`
`ORIGINAL IMAGES
`
`Othumbnail mask.tgaG100%.(RGB) O
`
`13OO
`
`
`
`1310
`
`logo3.iga G 100% (RGB)
`
`FIG.13
`
`IPR2023-00330 Page 00015
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 14 of 23
`
`US 8.495,242 B2
`
`HTML DOCUMENT WITH PROPREARY AG
`
`
`
`1400
`
`image.html
`
`FIG. I.4
`
`IPR2023-00330 Page 00016
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 15 Of 23
`
`US 8,495,242 B2
`
`OO
`/
`
`HTM DOCUMENT VIEWED IN BROWSER
`
`itle Frame
`
`it - - - - - - )
`
`'?'
`
`HTML DOCUMENT SOURCE
`
`
`
`image.html
`
`IPR2023-00330 Page 00017
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 16 of 23
`
`US 8.495,242 B2
`
`GENERATED GF IMAGE
`
`
`
`1600
`
`FIG 16
`
`IPR2023-00330 Page 00018
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 17 Of 23
`
`US 8,495,242 B2
`
`200
`
`
`
`
`
`210
`
`Medid Post
`Production
`Systems
`
`Original Media
`
`
`
`220
`
`Generated
`Web Media
`
`HTML. Page
`referring to
`Media URLs
`
`110
`
`
`
`Y
`
`Web Server
`
`Client
`Browser
`
`Client
`Browser
`
`FIC. 17
`
`IPR2023-00330 Page 00019
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 18 of 23
`
`US 8,495,242 B2
`
`HTML Page
`
`301
`N
`
`With Tag- C
`
`embedded URLs
`
`200
`
`- Original
`
`Medio
`
`
`
`100
`
`NI's
`Web Server
`
`s
`Client
`Browser
`
`130
`
`120d.
`
`Er t O
`Cient
`Browser
`
`120
`
`f20C
`
`Client
`Browser
`
`Clien
`Browser
`
`FIG. 18
`
`IPR2023-00330 Page 00020
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 19 Of 23
`
`US 8,495,242 B2
`
`460
`
`110
`
`
`
`501
`u-1N-N
`Asset Management
`Automatic Manipulation
`Automatic Conversion
`Automaice Upload
`Automatic Customization
`Automatic Disk Management
`Proxy-cache control
`Delivery
`
`Browser
`
`FIC. 19
`
`IPR2023-00330 Page 00021
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 23, 2013
`Jul. 23, 2013
`
`Sheet 20 of 23
`Sheet 20 of 23
`
`US 8,495,242 B2
`US 8,495,242 B2
`
`1U81U04
`
`S81NP800d4UO!}D498UE9
`
`PIPE
`
`U0}}D8I9
`
`wa}Shs
`
`ABAL8S
`
`000¢
`
`
`
`seBod“WLH
`
`UpIM
`
`
`
`Aapyalido,
`
`s60}yun
`
`
`
`
`
`
`
`
`
`
`
`
`
`DIpaWjou!5}40
`
`Og“OLA
`
`02 ' 0 I.H.
`
`DIPEW
`
`pe,D4eues A10}|soday
` 090¢
`
`Sefpw]
`
`0902
`
`JasMoig
`
`
`
`02
`Oct
`
`GoM
`
`JBALBS
`
`OLL
`
`IPR2023-00330 Page 00022
`
`IPR2023-00330 Page 00022
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 21 of 23
`
`US 8.495,242 B2
`
`200
`
`Original
`Medid is
`Credited
`
`100
`
`2180
`
`2170
`
`2160
`
`2040
`
`Primary
`Cached Medio
`
`Secondary
`Cached Medid
`
`User Profile
`Procedure
`
`Medio
`Repository
`
`
`
`2120
`
`Medid
`Cache
`
`
`
`
`
`
`
`
`
`
`
`Primary
`Key
`Generation
`
`Secondary
`Key
`Generation
`
`Dynamic Media
`Procedures
`
`2140
`
`Content
`Generation
`Procedures
`
`2100
`
`URL Tag
`Porser
`
`2190
`
`Cache
`Control
`
`f10
`Web Server
`
`f2O
`
`301 d
`
`HTML. Page with
`Proprietary
`URL Tags
`
`FIC. 21
`
`IPR2023-00330 Page 00023
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 22 of 23
`
`US 8.495,242 B2
`
`URL
`
`2200
`
`Parse Proprietaty URL Tags
`
`2210
`
`Final Lookup Key Generation
`
`2220
`
`22.30
`Y<1mage Cached
`N
`-2240
`Separate Dynamic Tags
`
`2250
`Intermediate Image Lookup Key Generation
`
`2260
`Retrix Cached Y Image Cached? N
`mage
`D
`
`2260
`
`Generotion
`
`Intermediate
`Image Caching
`
`Content Generation Y
`For Zoom/Pan/
`
`Dynamic NN
`Processing
`
`sal steals
`
`N
`
`Image
`Formot
`Conversion
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Proxy-cache Control
`
`2290
`
`FIC 22
`
`IPR2023-00330 Page 00024
`
`

`

`U.S. Patent
`
`Jul. 23, 2013
`
`Sheet 23 of 23
`
`US 8,495,242 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`User adds original
`graphic to system
`
`User creates content
`generation procedures
`on system to
`manipulate originals
`
`User creates HTML
`pages on Web Server
`with Proprietary
`URL Tags
`
`FIG. 23
`
`IPR2023-00330 Page 00025
`
`

`

`US 8,495,242 B2
`
`1.
`AUTOMATED MEDLA DELVERY SYSTEM
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a Divisional of U.S. Ser. No. 12/173,
`747, filed Jul. 15, 2008, which is a Divisional of U.S. Ser. No.
`11/269,916, filed Nov. 7, 2005 now abandoned, which is a
`Continuation-in-Part of U.S. Ser. No. 09/929,904, filed Aug.
`14, 2001, now U.S. Pat. No. 6,964,009 granted on Nov. 8,
`2005, which is a Continuation-in-Part of U.S. Ser. No.
`09/425,326, filed Oct. 21, 1999, now U.S. Pat. No. 6,792,575,
`granted on Sep. 14, 2004, each of which is hereby incorpo
`rated in its entirety by this reference thereto.
`
`10
`
`15
`
`BACKGROUND OF THE INVENTION
`
`2
`closely or from a different angle. On the horizon are pages
`with three-dimensional imagery that enable a user to move
`around a page that can look more like a room than a brochure.
`While interesting, these features are merely incremental
`improvements to a consumer's Surfing experience.
`D. C. A. Bulterman, Models, Media, and Motion. Using the
`Web to Support Multimedia Documents, Proceedings of 1997
`International Conference on Multimedia Modeling, Sin
`gapore, 17-20 Nov. 1997 discloses “an effort underway by
`members of industry, research centers and user groups to
`define a standard document format that can be used in con
`junction with time-based transport protocols over the Internet
`and intranets to Support rich multimedia presentations. The
`paper outlines the goals of the W3C's Synchronized Multi
`media working group and presents an initial description of the
`first version of the proposed multimedia document model and
`format.”
`Text and Graphics on UMI's Pro Quest Direct. The Best
`(yet) of both Worlds, Online, Vol. 21, no. 2, pp. 73-7, March
`April 1997 discloses an information system that offers “peri
`odical and newspaper content covering a wide range of busi
`ness, news, and professional topics... letting the user search
`both text and graphics and build the product to suit. Articles
`can be retrieved in varying levels of detail: citation, abstracts,
`full text, and text with graphics. Images come in two flavors:
`Page Image, a virtual photocopy, and Text--Graphics, in
`which graphics are stored separately from the text and are
`manipulable as discrete items.... The system comes in two
`versions: Windows and Web.
`John Mills Dudley, Network-Based Classified Information
`Systems, AU-A-53031/98 (27/08/98) discloses a “system for
`automatically creating databases containing industry, ser
`vice, product and Subject classification data, contact data,
`geographic location data (CCG-data) and links to web pages
`from HTML, XML, or SGML encoded web pages posted on
`computer networks such as Internets or Intranets . . .
`.
`The . . . databases may be searched for references (URLs) to
`web pages by use of enquiries which reference one or more of
`the items of the CCG-data. Alternatively, enquiries referenc
`ing the CCG-data in the databases may supply contact data
`without web page references. Data duplication and coordina
`tion is reduced by including in the web page CCG-data dis
`play controls which are used by web browsers to format for
`display the same data that is used to automatically update the
`databases.”
`Cordell et al. Automatic Data Display Formatting with A
`Networking Application, U.S. Pat. No. 5,845,084 (Dec. 1,
`1998) discloses a placeholder image mechanism. “When a
`data requestis made, the data transferrate is monitored. When
`the receive data transfer rate is slow, and the data contains an
`embedded graphical image of unknown dimensions, a small
`placeholder image is automatically displayed for the user
`instead of the actual data. The Small placeholder image holds
`a place on a display device for the data or the embedded
`graphical image until the data or embedded graphical image
`is received. When embedded graphical image is received, the
`placeholder image is removed, and the display device is refor
`matted to display the embedded graphical image.”
`Jonathon R. T. Lewis, System For Substituting Tags For
`Non-Editable Data Sets In Hypertext Documents And Updat
`ing Web Files Containing Links Between Data Sets Corre
`sponding To Changes Made To The Tags, U.S. Pat. No. 5,355,
`472 (Oct. 11, 1994) discloses a “hypertext data processing
`system wherein data sets participating in the hypertext docu
`ment may be edited, the data processing system inserting tags
`into the data sets at locations corresponding to the hypertext
`links to create a file which is editable by an editor and the data
`
`1. Technical Field
`The invention relates to software systems. More particu
`larly, the invention relates to an Internet server-based soft
`ware system that provides delivery of automated graphics and
`other media to Web sites for access by an end user or con
`SUC.
`2. Description of the Prior Art
`Most Web sites today are primarily handmade. From the
`guy publishing a simple online technology newsletter from
`his home, to the Fortune 1000 company's multi-tiered site
`with hundreds of pages of text, images, and animations, the
`Web developer and each of his HTML-coding and graphics
`producing coworkers toil page by page and image by image.
`Thousands of established online companies employ hundreds
`of highly-skilled workers just to produce and maintain their
`Web sites. After all, the Web is now a major selling vehicle
`and marketing medium for many of these companies. The
`Web has even sprouted service industries such as, for
`example, public companies with multi-billion dollar valua
`tions created just to consult and produce Web sites for others.
`Most Web developers who use established WYSIWYG
`tools in the industry still must produce each page on their Web
`site one by one. The same rate applies to preparing and plac
`ing images, animations, and other visual assets. Each page
`represents its own set of issues ranging from whether to use
`GIF, JPEG, or PNG file formats, to finding the optimum bit
`depth for each image to ensure the fastest downloading
`through the different browsers of the consumer. The bottle
`necked State of the customer's workflow to produce graphics
`for Web pages can be described as follows:
`Current Workflow for Creating Web Graphics
`Original Artwork/Asset Creation
`Use third-party point products
`Asset Editing
`Scale/reduce? slice
`Asset Format Conversion
`JPEG/GIFFPNG
`Asset Staging
`Place in Web file system
`Edit HTML
`Create/Modify HTML for particular page
`Store HTML on Web server
`View final pages
`Repeat process for each version of each graphic on each
`page
`Estimated time
`Two hours per page times the number of pages
`Also, from a user's perspective, the current state of the art
`is to offer the consumer Zooming and panning capabilities so
`that by clicking on an image the consumer can view more
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`IPR2023-00330 Page 00026
`
`

`

`3
`processing system removing the tags, generating a revised
`data set and updating the link information after the editing
`process. Its main purpose is to preserve the linking hierarchy
`that may get lost when the individual data sets get modified.”
`Wistendahl et al. System for Mapping Hot Spots in Media
`Content Interactive Digital Media Program, U.S. Pat. No.
`5,708,845 (Jan. 13, 1998) discloses a “system for allowing
`media content to be used in an interactive digital media (IDM)
`program that has Frame Data for the media content and
`object mapping data (N Data) representing the frame
`addresses and display location coordinates for objects
`appearing in the media content. The N Data are maintained
`separately from the Frame Data for the media content, so that
`the media content can be kept intact without embedded codes
`15
`and can be played back on any system. The IDM program has
`established linkages connecting the objects mapped by the N
`Data to other functions to be performed in conjunction with
`display of the media content. Selection of an object appearing
`in the media content with a pointer results in initiation of the
`interactive function. A broad base of existing non-interactive
`media content, such as movies, videos, advertising, and tele
`vision programming can be converted to interactive digital
`media use. An authoring system for creating IDM programs
`has an object outlining tool and an object motion tracking tool
`for facilitating the generation of N Data. In a data storage
`disk, the Frame Data and the N Data are stored on separate
`sectors. In a network system, the object mapping data and
`IDM program are downloaded to a subscriber terminal and
`used in conjunction with presentation of the media content.”
`Rogers et al. Method for Fulfilling Requests of A Web
`Browser, U.S. Pat. No. 5,701,451 (Dec. 23, 1997) and
`Lagarde etal, Method for Distributed Task Fulfillment of Web
`Browser Requests, U.S. Pat. No. 5,710,918 (Jan. 20, 1998)
`disclose essentially “improvements which achieve a means
`for accepting Web client requests for information, obtaining
`data from one or more databases which may be located on
`multiple platforms at different physical locations on an Inter
`net or on the Internet, processing that data into meaningful
`information, and presenting that information to the Web client
`in a text or graphics display at a location specified by the
`request.”
`Tyanetal, HTML Generator, European Patent Application
`No. EP 0843276 (May 20, 1998) discloses “generating an
`HTML file based on an input bitmap image, and is particu
`larly directed to automatic generation of an HTML file, based
`on a scanned-in document image, with the HTML file in turn
`being used to generate a Web page that accurately reproduces
`the layout of the original input bitmap image.”
`TrueSpectra has a patent pending for the technology
`employed in its two products, IrisAccelerate and IrisTransac
`tive. These products are designed for Zooming and panning
`and simple image transformations and conversions, respec
`tively. They support 10 file formats and allow developers to
`add new file formats via their SDK. They do not require the
`use of Flashpix for images. However, their documentation
`points out that performance is dependent on the Flashpix
`format. The system would be very slow if a non-Flashpix
`format was used.
`TrueSpectra allows the image quality and compression to
`be set for JPEGs only. The compression setting is set on the
`server and all images are delivered at the same setting.
`TrueSpectra has a simple caching mechanism. Images in
`the cache can be cleared out automatically at certaintimes and
`it does not have any dependency features for image propaga
`tion. The Web server needs to be brought down in order to
`update any original assets.
`
`65
`
`40
`
`45
`
`50
`
`55
`
`60
`
`US 8,495,242 B2
`
`10
`
`25
`
`30
`
`35
`
`4
`TrueSpectra does not require plug-ins to operate features
`Such as Zooming?panning or compositing. The alternative to
`plug-ins is using their JavaScript or active server page tech
`nology. These technologies are used by many Web sites to
`provide interactivity, but not all Web browsers work correctly
`with these technologies.
`TrueSpectra relies on Flashpix as its native file format and
`does not support media types such as multi-GIFs and Sound
`formats. Flashpix files are typically larger than most file for
`mats. Access to files is faster for Zooming and panning, but
`appears to be quite slow.
`The key to IrisTransactive is the compositing Subsystem. It
`requires three things to build a shopping Solution using image
`composition.
`1) The original images must be created. It is suggested that
`the image be converted to Flashpix for better perfor
`aCC.
`2) All of the individual images must be described in XML
`using the image composer program. The program allows
`the editor to specify anchor points, layer attributes, and
`layer names. The resulting file is between 5 k and 50 k.
`3) The Web designer must place HTML referring to the
`XML in the Web site. By specifying parameters to the
`XML, the Web designer can turn on or off layers.
`The herein above process for compositing images enables
`Web designers to create shopping sites. However, a lot of
`overhead is the result. The XML documents add 5k-50k to a
`Web site. The compositing commands that are embedded in
`the HTML are difficult to understand. And, because the com
`positing feature requires several steps to implement, it is not
`suitable for every image on a Web site. The process seems to
`be designed for the specific purpose of shopping.
`MediaBinTM is limited to activities behind the firewall
`automating only the “post-creative busy work.” In addition,
`MediaBin requires the use of an application server to function
`through a web interface. Thus images may not be directly
`added to any existing web page.
`Macromedia's Generator operates by embedding variables
`in their proprietary Flash format. Therefore the actual imag
`ing operations are somewhat limited and cannot be controlled
`directly from a web page request.
`MGI Software sells point solutions that require end-users
`to download a viewer to process a proprietary image format.
`PictureIO offers a server-side image-processing appliance
`that provides a limited set of Photoshop functionalities. This
`appliance runs on the web-page server, processes information
`embedded in the web page, and rewrites the web page with
`image data.
`The disclosed prior art fail to provide systems and meth
`odologies that result in a quantum leap in the speed with
`which they can modify and add images, video, and Sound to
`sites, in the Volume of data they can publish internally and
`externally, and in the quality of the output. The development
`of such an automated media delivery system would constitute
`a major technological advance.
`It would be advantageous to empower an end user with
`flexibility and control by providing interactive page capabili
`ties.
`It would be advantageous from an end user's perspective to
`generate Web pages that contain active graphics. For
`example, clicking on a Corvette image will cause a simple
`menu to pop up Suggesting alternative colors and sizes in
`which to see the car. Clicking on portions of the image. Such
`as a fender, can call up a close-in view of the fender.
`It would be advantageous to provide an automated graphics
`delivery system that becomes part of the Web site infrastruc
`
`IPR2023-00330 Page 00027
`
`

`

`5
`ture and operates as part of the Web page transaction and that
`thereby provides a less expensive and less time-consuming
`process.
`It would be advantageous to provide a system for auto
`mated processing and delivery of media (images, video, and
`sound) to a Web server whereby it eliminates the laborious
`post-production and conversion work that must be done
`before a media asset can be delivered on a Web server.
`It would be advantageous to create a dynamic Web site,
`wherein images are generated on demand from original
`assets, wherein only the original assets need to be updated,
`and wherein updated changes propagate throughout the site.
`It would be advantageous to provide a system that gener
`ates media based on current Web server traffic thereby opti
`mizing throughput of the media through the Web server.
`It would be advantageous to provide a system that gener
`ates media that is optimized for the Web client, wherein client
`connection speed determines optimum quality and file size.
`It would be advantageous to provide a system that gener
`ates media, whereby the media is automatically uploaded.
`It would be advantageous to provide a system that auto
`matically caches generated media so identical requests can be
`handled without regeneration of images.
`It would be advantageous to provide a system that resides
`behind the Web server, thereby eliminating security issues.
`It would be advantageous to provide a system wherein the
`client browser does not require a plug-in.
`It would be advantageous to provide a system wherein the
`system does not require any changes to a Web server.
`It would be advantageous to provide a system wherein the
`system manages the Web server media cache.
`It would be advantageous to provide a system wherein the
`Web media is generated only if requested by a client browser.
`It would be advantageous for a system to reduce the need
`for a Web author to create different versions of a Web site, the
`system automatically handling image content.
`It would be advantageous to provide dynamic imaging
`capabilities, have a more complete set of image processing
`functionality, and be controlled directly through an image
`URL.
`It would be advantageous to provide an end-to-end Solution
`requiring only a standard browser that is completely control
`lable using the proprietary tags contained within a simple
`image link in the web page.
`It would be advantageous to run an image application as a
`separate server controlled directly by sin