United States Patent [19J
`Mayle et al.
`
`111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US006018774A
`[11] Patent Number:
`[45] Date of Patent:
`
`6,018,774
`Jan.25,2000
`
`[54] METHOD AND SYSTEM FOR CREATING
`MESSAGES INCLUDING IMAGE
`INFORMATION
`
`[75]
`
`Inventors: NeilL. Mayle, Cambridge; David L.
`Rose, Boston, both of Mass.
`
`[73] Assignee: YoBaby Productions, LLC,
`Cambridge, Mass.
`
`[21] Appl. No.: 08/887,616
`
`[22]
`
`Filed:
`
`Jul. 3, 1997
`
`[51]
`[52]
`[58]
`
`[56]
`
`Int. Cl? ...................................................... G06F 13/00
`U.S. Cl. ........................... 709/250; 709/203; 709/206
`Field of Search ......................... 395/210.36, 200.76,
`395/200.8, 200.33, 200.47; 709/206, 246,
`250, 203, 217
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,426,594
`5,623,681
`5,666,490
`
`6/1995 Wright eta!. ....................... 364/514 R
`4/1997 Rivette et a!.
`.......................... 395/788
`9/1997 Gillings et a!. .................... 395/200.68
`
`5,671,282
`5,678,046
`5,732,229
`5,737,729
`5,778,372
`5,806,005
`5,844,969
`
`9/1997 Wolff eta!. ............................... 380/25
`10/1997 Cahill et a!. ............................ 395/616
`3/1998 Dickinson ............................... 395/334
`4/1998 Denman .................................. 705/401
`7/1998 Cordell et a!. . ... ... .... ... ... ... ... ... 707/100
`9/1998 Hull et a!. ............................... 455!566
`12/1998 Goldman et a!. .................... 379/93.24
`
`Primary Examiner-Zarni Maung
`Attorney, Agent, or Firm---Choate, Hall & Stewart
`
`[57]
`
`ABSTRACT
`
`A system for creation of an image display such as an
`electronic postcard. The system interacts with a user to
`create and configure the display. The user provides the
`image data to the system and optionally specifies a message
`and addressee for the image display. The system creates the
`display, comprising a mixture of image and textual data, and
`sends a notification including identification of the display to
`a specified addressee, for instance, the recipient of the
`postcard. The addressee can then request receipt of the
`display from the system via the identification information
`sent by the system.
`
`6 Claims, 18 Drawing Sheets
`
`354
`
`355
`
`356
`
`351
`
`photo
`file
`
`352
`
`Petitioner - Exhibit 1006
`Page 1 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 1 of 18
`
`6,018,774
`
`0)
`
`'\."1
`
`qaM <lP!M PIJOM
`
`-
`
`..:.::
`c
`::J
`~
`.Q
`c
`u
`c
`::J
`E
`E
`0
`u
`0 E
`0 Q)
`0 -o
`.
`0
`::2:
`0
`
`....
`
`-
`
`Q)
`c
`....
`a..
`....
`Q)
`en
`~
`
`.
`<..9
`
`LL
`
`-
`....
`Q)
`c
`....
`a..
`....
`Q)
`"'
`c
`__J
`
`....
`
`Q)
`(f)
`
`-c
`
`..:.::
`c
`~
`en
`c
`.Q
`u
`c
`::J
`E
`E
`0
`\..)
`
`o E
`0 Q)
`"'C
`0
`0
`0
`::2:
`
`" 0
`
`I
`
`[ITO D \..)
`
`a..
`
`[] IJ \..)
`
`0
`
`I
`
`a..
`
`Petitioner - Exhibit 1006
`Page 2 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 2 of 18
`
`6,018,774
`
`Personal Computer v
`
`10
`
`operating system
`51
`
`I Browser I
`
`52
`
`File System
`53
`
`I Photo I
`
`File
`
`54
`
`I Mail Reader I
`
`31
`
`""-
`
`Server Computer
`operating system
`
`61
`
`Web Server
`Software
`
`64
`
`Mail Server
`Software
`
`62
`Session
`Database
`
`63
`
`Card
`Database
`
`65
`Temp Image
`Database
`
`66
`
`Image
`Database
`
`FIG.2
`
`Petitioner - Exhibit 1006
`Page 3 of 34
`
`

`
`351
`
`photo
`file
`
`352
`
`caption
`
`353
`text
`color
`
`355
`
`356
`
`FIG. 3A
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`~
`~
`?
`N
`~Ul
`
`N c c c
`
`'JJ. =(cid:173)~
`~ .....
`
`~
`0 ......,
`"""" 00
`
`,--
`1 CAROl
`I FRONT I
`I --
`-
`
`0\
`
`.... = ~
`
`00
`....
`......::.
`......::.
`""-
`
`Petitioner - Exhibit 1006
`Page 4 of 34
`
`

`
`301
`
`message
`
`......
`
`302
`from I
`
`307
`
`308
`
`f
`
`-1.- _ ... _
`
`I
`
`-t .... __ ._ ____ ·--''
`
`""" --
`
`I aenerate \
`
`- ~
`I render\
`I comoress\
`f comoosite \
`
`~ ,--,
`I CARD I
`BACK I
`L--
`
`305
`
`306
`
`309
`
`310
`
`304
`
`FIG. 3 B
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`~
`~
`?
`N
`~Ul
`
`N c c c
`
`'JJ. =-~
`~ .....
`
`~
`0 ......,
`'"""' 00
`
`0\
`
`.... = ~
`
`00
`....
`......::.
`......::.
`""-
`
`Petitioner - Exhibit 1006
`Page 5 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 5 of 18
`
`6,018,774
`
`40!
`
`402
`
`400
`
`404
`
`Ger1erateci
`1 n put i'}H!fl
`
`406
`
`Petitioner - Exhibit 1006
`Page 6 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 6 of 18
`
`6,018,774
`
`I
`
`I
`
`,--,
`/__ -'
`
`I I
`I I
`I 1
`I I
`
`....
`r<>O
`0
`I()
`
`L() .
`(.9
`
`LL
`
`:>.
`0
`I-
`Q)
`>
`oo
`
`l[)
`
`Petitioner - Exhibit 1006
`Page 7 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 7 of 18
`
`6,018,774
`
`~ ~ 1
`.--
`
`f""'
`
`.0
`0
`+-
`0
`QJ
`tn
`0
`0 .c.
`u
`...........
`
`1:1
`L-
`
`0 u
`.....
`0
`0
`.J::.
`a..
`
`(\J
`0
`<D-
`
`I ,---
`,
`I
`I
`I
`---1
`
`I
`
`- -
`
`I I
`I I
`I I
`I I
`-
`
`- -
`
`0
`
`~ , - -
`{g:
`0
`1/)
`1/)
`Cl) f---
`:::ii!
`1:1 q)
`....
`a
`u f - - -
`+-
`liD
`1/)
`0
`,,,,
`0
`~''"
`a..
`.. f - - -
`0. ~
`a
`u
`1/) f - - -
`rfJ
`z
`
`Cl)
`
`-Cl)
`
`' - - - -
`
`r - -
`
`~
`-
`
`'If
`
`0
`
`0
`0
`
`c--- -
`
`I - -
`c
`0
`a
`u
`0
`_j
`
`J
`
`L afioss aw 1
`r
`1.()
`0
`<.0
`
`-
`
`'C
`.Q
`.....
`0..
`0 u
`h
`
`' o;;t
`
`0
`<.0
`
`r -
`0
`......
`!()
`0
`:---0
`.c.
`tD
`a.
`'--
`
`I
`
`0
`<.D
`
`/
`
`0
`0
`tD
`
`1-+ f-
`
`1-
`
`-, 0
`
`1'-
`
`<.D
`
`-,.
`
`tJ _j
`-
`~ 0 ....
`-.c.
`
`u
`_j
`1/) c
`.Q
`u
`:::1
`1:1
`a..
`>-
`..c
`0 rn
`0
`~
`(])
`(J) -
`
`(J>
`
`....
`>-
`0..
`0
`u
`
`c.o
`0
`<.0
`
`-
`
`Petitioner - Exhibit 1006
`Page 8 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 8 of 18
`
`6,018,774
`
`~ I~ I
`
`,....-'
`
`@]
`
`~
`Q)
`Ol
`0
`(/)
`(/)
`Q)
`
`E
`.....
`:::J
`0
`>.
`c
`
`Q)
`a.
`~
`
`Q) r - -
`0>
`0 ~
`<Jl
`U')
`Q) t----
`~ en
`"0 ...
`0
`....
`u 1---
`o 1m
`U')
`, ...
`il'"'
`0
`a..
`.. f - -
`<11
`
`a. OJ
`-Q)
`
`0
`u
`U')
`
`z
`
`t------
`rf;
`
`I
`
`_ ,
`
`, _
`~
`
`/ r --,
`
`I
`I
`----1
`
`~
`7 ~
`
`I
`
`- -
`
`-
`
`I I
`I I
`I I
`I I
`
`- -
`
`j
`
`J-+ I-
`
`,_
`
`-,
`
`u
`_j
`_j
`U') c
`
`.Q -u
`
`:::J
`"0
`0 ....
`a..
`>-
`.0
`0 rn
`0
`~
`{]')
`{]') -
`....
`..c
`0>
`.....
`>-a.
`0
`<..)
`
`'------
`. - -
`~
`
`1 -
`0
`
`0
`
`'--
`c
`0
`
`1 - -
`
`0
`0
`u
`0
`0
`'------ _j
`
`1-
`
`/
`
`0
`0
`<.0
`
`.
`
`(9
`LL
`
`Petitioner - Exhibit 1006
`Page 9 of 34
`
`

`
`Netscape: Postcard Message
`
`I QO l o¢ I ~ II @ I ~ I ~~ I 8 I w I ~
`Location f
`
`1
`
`(Type inyourmessage)
`
`[ill
`
`~
`~
`
`701
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`~
`~
`?
`N
`~Ul
`
`N c c c
`
`'JJ. =(cid:173)~
`~ .....
`'0
`0 ......,
`'"""' 00
`
`0\
`
`.... = ~
`
`00
`....
`......::.
`......::.
`""-
`
`Copyright 1997yo8aby Productions LLC
`
`I
`
`- - - - -
`
`- - -
`
`1-+
`- - - _j~
`
`600
`~
`
`FIG.8
`
`I
`
`L
`
`Hi Michael and Makiko. We ~
`had a great time when you
`visited. The kids look
`great. Come visit again
`soon. I
`¢>1
`I Cancei)CQB)
`
`/
`
`~
`[¢
`
`~
`
`I
`I
`
`~---~
`I
`I
`L __ l
`
`I -------
`
`I
`
`I
`
`j -
`
`Petitioner - Exhibit 1006
`Page 10 of 34
`
`

`
`600
`'---..
`
`FIG. 9
`
`I QO I oc) I ~ I
`Location I
`
`Netscape: Postcard Messoqe
`
`~~~~~~~1 8 1~1~
`
`[ill
`
`I
`
`~
`
`""""
`
`(choose a photo for the ca,:CU
`
`Browse your hard drive and
`select a photograph in
`G IF or J PEG format
`I Browse I
`I
`you can also send it via emai I
`
`I
`
`jcancci)IAddj
`
`-
`
`~02
`,--~
`I
`I
`L __ l
`
`I
`I
`
`I -- --
`-- --
`
`I
`
`I.......
`
`I
`
`Copyright 1997yo8aby Productions LLC
`
`I
`
`j -
`
`~
`I
`
`I
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`~
`~
`?
`N
`~Ul
`
`N c c c
`
`'JJ. =(cid:173)~
`~ .....
`'"""' c
`0 ......,
`'"""' 00
`
`0\
`
`.... = ~
`
`00
`....
`......::.
`......::.
`""-
`
`Petitioner - Exhibit 1006
`Page 11 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 11 of 18
`
`6,018,774
`
`0
`0
`\
`
`v
`0
`r- ~
`0
`
`0
`::r:
`..c:
`Ill
`
`0 -c
`
`-~
`Ill -·-0'1
`
`C1J
`E
`0
`Ill
`
`lTJ
`
`'---
`
`I•
`
`~00 00~
`- I
`v
`
`00
`~
`
`""")
`
`0
`
`0
`
`•
`
`~ ~:t:~
`'51 01 01
`01 01
`llll'.ltf) 0. a.
`~ g s ~ ~ ·~·-:-
`
`·-:- ~ ~ ~ ~ 00
`0
`'"0"0 1/)111
`0 C\1-occ:OO
`0 Oooo.a.a
`eJ Oe:JIO!E®fle:Je:J
`
`§
`
`@]
`Sf -
`C1J -~
`Q)
`....
`"0
`
`[g:
`
`0
`Ill
`Ill
`
`0 u f - --Ill
`
`0
`(L
`
`0 liD
`'0''"'
`.. f - -
`till
`~ 0
`b'!J
`-<11 ~
`
`u
`Ill I - -
`z
`
`' - - - -
`
`.--
`~
`
`~
`
`'\)
`0
`
`'--
`c
`0
`
`1 - -
`
`0
`
`0
`u
`0
`0
`L---- -'
`
`-I r --,
`
`I
`I
`--...1
`
`I I
`I I
`I I
`I I
`
`- -
`
`-
`
`-
`
`-
`
`J
`
`1- >-
`,_
`
`-
`
`u
`-'
`-'
`Ill
`c:
`
`.Q -u
`
`::J
`"0
`0 ....
`(L
`>.
`.a
`0
`CD
`0
`~
`(Tl
`
`en --
`
`..c:
`01
`.....
`>. a.
`0 u
`
`1-
`
`0
`(9
`LL
`
`Petitioner - Exhibit 1006
`Page 12 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 12 of 18
`
`6,018,774
`
`Petitioner - Exhibit 1006
`Page 13 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 13 of 18
`
`6,018,774
`
`600
`--.;_'&
`
`Petitioner - Exhibit 1006
`Page 14 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 14 of 18
`
`6,018,774
`
`Ccpydght
`
`Petitioner - Exhibit 1006
`Page 15 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 15 of 18
`
`6,018,774
`
`600
`
`~----------
`
`.
`
`1!
`i i
`il
`I
`
`Petitioner - Exhibit 1006
`Page 16 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 16 of 18
`
`6,018,774
`
`600
`
`Fi
`
`Petitioner - Exhibit 1006
`Page 17 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 17 of 18
`
`6,018,774
`
`1601
`
`,
`r
`... _ ...._-~I
`
`'
`
`I i
`j!
`
`.
`II
`l~:::~: =~=~~::;y=~-=----=----=--=====-··=-.·~~:~~~~-=~~~~~~~~;:~=~ 99 i')'o8a b.~.:~~~~~~:~~~~E;~·-·····-------~~~~: ..... L ____ -i~~---j
`
`Petitioner - Exhibit 1006
`Page 18 of 34
`
`

`
`U.S. Patent
`
`Jan.25,2000
`
`Sheet 18 of 18
`
`6,018,774
`
`,..-,~ r. !
`
`, ••• f '
`E '•,~:J. ~
`:
`
`Petitioner - Exhibit 1006
`Page 19 of 34
`
`

`
`6,018,774
`
`1
`METHOD AND SYSTEM FOR CREATING
`MESSAGES INCLUDING IMAGE
`INFORMATION
`
`The present invention relates generally to image process(cid:173)
`ing and manipulation and more specifically to a system for
`the creation of electronic postcards.
`
`5
`
`2
`ISPs also provide the home user the ability to send and
`receive electronic mail (email). Often an individual access(cid:173)
`ing the web will have an email address, a unique identifier
`for a particular user that allows that user to receive mail. The
`ISP will receive the email for the user and store it until the
`user dials into the ISP to actually retrieve the messages.
`These events have created a situation where an individual
`at home can download the images captured by their digital
`camera or scanner into their home computer, connect to the
`10 web by modem in their computer, and transmit their picture
`onto the web. Thus, the individual can send the image to a
`second person, at a remote location.
`As digital cameras become widely accepted, a greater
`need will arise for flexibility in the electronic distribution of
`15 images. Current methods for distribution include email
`where the digital photograph is converted to a textual
`representation, sent to the remote user who then converts the
`textual representation back into the digital photograph.
`Users may also distribute the digital photograph via prede-
`20 signed web pages which allows any number of remote users
`to examine the digital photograph. None of the current
`mechanisms allow the user to transfer a digital photograph
`to a server, process the image data into a display and send
`a notification to one or more specific individuals to view the
`25 display.
`
`BACKGROUND OF THE INVENTION
`Photographic images or pictures may be represented and
`stored as a sequence of digital information. For instance, a
`photograph may be placed into a scanner connected to a
`computer system. The scanner is designed to convert images
`into digital information. A typical scanner comprises a row
`of discrete light sensors that are stepped sequentially across
`the photograph. At each discrete step the intensity and/or
`color of the photograph is measured by each discrete sensor
`in the row. The values are read out of the sensors prior to
`moving the row to the next discrete step. The row of light
`sensors is thus moved step-by-step across the photograph
`until the entire image is scanned. The end result is an array
`of data values representing the photographic image, where
`each value is the measurement taken by the discrete sensor
`element for a particular row. The information collected may
`then be transferred to a computer for further processing. This
`process of converting image information into discrete values
`representing individual picture elements or pixels is also
`known as scanning.
`In the past, the typical way to create an electronic image
`was through such a scanner connected to a computer. Thus, 30
`if an individual desired to have a digital electronic photo(cid:173)
`graph the individual would typically use a conventional
`photographic camera to create a film image, have it pro(cid:173)
`cessed onto photographic paper, and then scan the image
`into a computer with a scanner. Recently, this process has 35
`changed with the advent of digital cameras--cameras that
`directly create a digital photograph that may be transferred
`directly into a computer.
`The creation of digital cameras has created an opportunity
`to utilize the unique aspects of a digital photograph. For 40
`instance, a digital photograph can be sent across a computer
`network and shared by others electronically. In addition,
`digital photographs allow further image manipulation.
`Recent advances in technology have broadened the utility
`of digital photographs. The first advance is the penetration of 45
`powerful personal computers in the home environment.
`These new personal computers are capable of running
`complex processing applications. Today, a typical system
`includes a 32 bit processor, large memory array, high capac-
`ity mass storage device, high resolution color monitor and 50
`fast modem. The price for such a system is now within the
`budget of many households.
`The second advance is the development and acceptance of
`the world wide web (WWW, web or Internet) as a mode of
`exchanging electronic information. The web is a network of 55
`computer systems that allow the free interchange of infor(cid:173)
`mation. Users at a home computer or clients connects via a
`modem to the web via an Internet Service Provider (ISP)
`which provides users local access to the web. Users seeking
`access to the web typically dial up and connect to an ISP, 60
`which acts as an intermediary and passes data between the
`web and the user. Also connected to the web are servers(cid:173)
`computers capable of supplying information or services to
`users. Each individual computer connected to the web has a
`unique identifier so that information can be directed to the 65
`proper location. Information is passed between users on the
`web via pages displayed on a browser.
`
`SUMMARY OF THE INVENTION
`
`Accordingly, it is a goal of the present invention to
`provide a system which can load a picture image onto a
`server and to provide notice to specific individuals.
`It is an alternate goal of the present invention to allow the
`creation of electronic postcard composed of the user's
`digital photograph.
`It is an alternate goal of the present invention to allow the
`creation of electronic postcard that mimics aspects of a
`conventional postcard.
`It is an alternate goal of the present invention to allow the
`creation of electronic postcard having a postmark or logo
`information.
`It is an alternate goal of the present invention to allow the
`creation of electronic postcard that includes the ability to
`merge text information with the digital photograph.
`Other objects will be obvious and will appear hereinafter.
`The invention comprises an article of manufacture as exem(cid:173)
`plified in the following summary and detailed description.
`The present invention is a system and method for pro(cid:173)
`cessing electronic image data. The system comprises at least
`one server computer connected to a network. The server is
`adapted to receive electronic image data from a second
`computer connected to the network. The server processes the
`electronic image data and creates a display containing at
`least a portion of the processed electronic image data. One
`or more displays may be assigned a unique identifier. The
`data representing the display is in a format that allows for
`transmission to and viewing on a client computer. Viewing
`on the client computer is preferably accomplished via a web
`browser. The server is also adapted to send a notification
`containing the unique identifier to at least one person via the
`network. The person receiving the unique identifier can
`retrieve the one or more displays represented by the iden(cid:173)
`tifier from the server for viewing.
`The processing on the server consists of one or more of
`the following: captioning, formatting, storing, transmitting,
`centering, cropping, flipping, anti-aliasing, scaling,
`compressing, filtering, color correcting, adding special bar-
`
`Petitioner - Exhibit 1006
`Page 20 of 34
`
`

`
`6,018,774
`
`4
`FIG. 17 is an image of the present invention electronic
`postcard illustrating the display of a sent postcard.
`
`3
`ders and/or corner motifs, blurring, and adding visual
`effects. In addition, the client may be augmented to perform
`a portion of the processing during interactions with the
`server.
`The data for the electronic image may also be provided 5
`via a photo processor where film is developed and then
`converted into an electronic image. The data representing
`the electronic image may then be transferred from the photo
`processor to the client computer or directly to the server
`computer.
`The above mentioned objectives of the present invention
`will become more apparent and the invention itself better
`understood with reference to the following description of the
`embodiments of the present invention in conjunction with
`the accompanying drawings.
`
`15
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`System Architecture
`The present invention relates to a system for the genera(cid:173)
`tion of electronic postcards for distribution via an electronic
`network. FIG. 1 illustrates a simplified view of a network of
`computers. Two basic machines are connected to the
`10 network, user (or client) computers 10 and 20, and server
`systems 31 through 35. User computers, for example com(cid:173)
`puter 10, are conceptually separate from server systems, as
`they provide the functions necessary for a typical user to
`connect to the network and exchange information with other
`user computers and server systems. In the present invention,
`the user computer 10 may interface to a variety of peripheral
`devices, including a scanner 12, printer 13, video camera 14
`and digital camera 15. In addition, the user computer 10
`communicates via a communications device 11, here illus-
`20 trated as a modem, for communicating over the network.
`The user computer 10 of the present invention is con(cid:173)
`nected to a broader system of networked computers as
`illustrated in FIG. 1. In this environment, user computer 10
`connects via the modem 11 to an ISP 31. The ISP provides
`the interface between the user computer and the web 30. The
`25 ISP 31 may also provide other services, such a receipt and
`storage of user email, storage of user files and various other
`services. As the interface to the web 30, the ISP 31 receives
`packets of data from the user computer 10 and stores the
`received information or forwards the information on the web
`30 30 to the addressed destination. The addressed destination
`may be one of the servers 31-35 or may be a separate user
`computer 20. One of ordinary skill in the art will appreciate
`the variety of configurations possible on such a network.
`While the web is illustrated as a single network, it is
`35 understood that it may comprise one of a number of local
`area networks (LANs) and wide area networks (WANs).
`In the preferred embodiment, the electronic postcard
`functionality is implemented as a component of a web site.
`A web site is essentially a server computer providing public
`40 access to one or more files containing hypertext documents.
`A user utilizing a web browser running on a client computer
`10 to access the hypertext documents stored on one or more
`server computer 31-35 located on the network 30. The
`server, running hyper text transfer protocol (HTTP) web
`45 server software, transfers the hypertext document to the user
`computer for display on the browser. The present invention
`is directed to software that adapts the server to perform the
`functions necessary to create and transmit an electronic
`postcard.
`50 Server
`With reference to FIG. 2, in the preferred embodiment a
`server 31 is a Pentium Pro (Intel Corporation, San Jose,
`Calif.) based computer connected to the Internet running the
`Linux operating system (Red Hat Software, Inc., Research
`55 Triangle Park, N.C.) and the MetaHTML web server soft(cid:173)
`ware 61 (Universal Access Inc., Santa Barbara, Calif.). The
`web server software supports the HTTP protocol-the stan(cid:173)
`dard used in World Wide Web interaction. When a request is
`made over the Internet to view a web page, the server
`60 responds to this request returning a reply in the form of text
`describing the page in the hyper text markup language
`(HTML) format. A user specifies the page he would like to
`view with a Uniform Resource Locator (URL), or web
`address.
`65 Database on Server
`The server 31 is adapted to store and process data that is
`transmitted over the Internet. The present invention utilizes
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The foregoing discussion will be understood more readily
`from the following detailed description of the invention,
`when taken in conjunction with the accompanying drawings,
`in which:
`FIG. 1 is a simplified block diagram of connections to the
`web;
`FIG. 2 is a simplified block diagram of a server and
`personal computer as found in FIG. 1, illustrating a portion
`of the functions utilized by the present invention;
`FIGS. 3a and 3b are flowcharts of the steps executed by
`a personal computer of the present invention in creating the
`front and back of an electronic postcard;
`FIG. 4 is an example screen of the present invention
`indication the static and generated image areas;
`FIG. 5 is a diagram illustrating the process of creating a
`generated image area and particularly the compositing of
`text on an image;
`FIG. 6 is an image of the present invention electronic
`postcard creation page, as displayed within a browser
`window, where the electronic postcard is empty of user
`information;
`FIG. 7 is an image of the present invention electronic
`postcard illustrating the prompt for a message;
`FIG. 8 is an image of the present invention electronic
`postcard illustrating the input of a message;
`FIG. 9 is an image of the present invention electronic
`postcard illustrating the prompt for input of an input image;
`FIG. 10 is an image of the present invention electronic
`postcard illustrating the selection of an input image;
`FIG. 11 is an image of the present invention electronic
`postcard illustrating the input image placed on a side of the
`postcard;
`FIG. 12 is an image of the present invention electronic
`postcard illustrating the prompt for an image caption;
`FIG. 13 is an image of the present invention electronic
`postcard illustrating the composite created from the input
`image and image caption;
`FIG. 14 is an image of the present invention electronic
`postcard illustrating the prompt for the sender's name and
`address;
`FIG. 15 is an image of the present invention electronic
`postcard illustrating the prompt for the recipient's name and
`address;
`FIG. 16 is an image of the present invention electronic
`postcard illustrating the completed postcard prior to sending
`to the recipient; and
`
`Petitioner - Exhibit 1006
`Page 21 of 34
`
`

`
`6,018,774
`
`5
`two type of storage: temporary storage and permanent
`storage. The temporary storage keeps the data that is entered
`by the user during a "session" of interaction with the site.
`The temporary storage is called the Session Database 62. As
`the user makes changes to the postcard the data in the 5
`Session Database 62 is updated.
`In order to manage the data for a particular user, each user
`is assigned a unique identification number that distinguishes
`that user's session from all others. This unique identification
`number is stored by the client via the web browser using a
`standard mechanism known as the "cookie mechanism."
`The identification number is used by the client as the key to
`the Session Database 62. While the cookie is stored on the
`client, writing of the cookie and recording and retrieving
`data from the Session Database 62 is handled by the server 15
`via the MetaHTML software.
`The electronic postcard is composed of two data forms:
`textual and graphical. The textual data is stored in the
`Session Database while the card is being created. The
`graphical data (generated images and photographs) are
`stored in the file system of the server in a directory specifi(cid:173)
`cally created to store the temporary image files, herein
`designated as the Temp Image Database 65. In the preferred
`embodiment, the directory name utilizes the same cookie
`identification number although various other naming
`schemes are possible. By using the cookie in the directory
`name, the system ensures that each user has his own
`temporary directory. This directory can be thought of as an
`extension of the Session Database 62. The graphical data
`files are assigned names that are also stored in the Session 30
`Database.
`After the electronic postcard is sent, the postcard data is
`stored "permanently" in two other databases. One database,
`called the Card Database 63, stores the sender's and recipi(cid:173)
`ent's name and email address. The other database, called the
`Image Database 66, stores the images that have been con(cid:173)
`structed for the front and back of the card. In the preferred
`embodiment, after the electronic postcard is sent and the
`data is stored in the Image Database 66, the temporary
`graphical data files and session data can be deleted. As an
`alternate embodiment, the temporary graphical data files
`may be retained for additional uses, such as creation of an
`album of images.
`The data in both the Card Database 63 and the Image
`Database 66 is keyed by a unique identifier called the Card
`Key that is created at the time the card is sent. This key-the
`information required for retrieving the electronic postcard
`data from the Card Database 63 and Image Database 64-is
`sent to the recipient of the card in a message. As a result, the
`recipient has sufficient information for interacting with the 50
`server so as to view the specific electronic postcard identi(cid:173)
`fied by the Card Key.
`The Card Database 63 also stores the date that the card
`was sent and the number of times that the card has been
`viewed. The data for a card is typically stored for 14 days
`(the number of days is a number set when the system is
`configured, and is not a limitation of the server storage time).
`After that point the permanent card and image data may be
`automatically deleted. The data is also deleted after the card
`has been viewed 15 times (this number is also set when the
`system is configured). One of ordinary skill in the art can
`appreciate the possible variations for determining when to
`delete the data. As an alternate embodiment, the permanent
`card and image data may be retained for additional uses,
`such as creation of an album of images.
`Like the Temp Image Database 65, the Image Database 66
`uses the file system to store the image files. The files are
`
`6
`stored in a directory whose name is derived from the Card
`Key. In this case, there is a separate directory created for
`each card that is sent.
`Dynamically generated web pages
`The present invention is adapted to process text and
`graphic data to create an electronic postcard that is com(cid:173)
`posed of custom generated HTML pages including gener(cid:173)
`ated images within the HTML pages. The system looks at
`the data it has stored from previous user inputs and creates
`10 the HTML page to achieve the custom look desired by the
`user. The user specifies the look by supplying the graphical
`data to upload, the style parameters for the look of the card
`and text for the textual content and address. Certain style
`characteristics may be automatically determined from the
`user data. For example, different HTML text is generated
`when the photo is horizontally oriented than when it is
`vertically oriented. Orientation is, in turn, determined by the
`aspect ratio of the graphical data uploaded by the user.
`The electronic postcard 400, as illustrated in FIG. 4, is
`20 composed of HTML pages consisting of tables, with some
`cells of the table containing static images and some cells
`containing generated images. Static images 401 to 406 are
`created once and do not change during further modifications
`to the postcard. Generated images 407 through 409 change
`25 during the customization of the postcard and are thus
`regenerated as required. The use of static and generated
`images improves the efficiency of the system by preventing
`the recreation and retransmission of images that are essen-
`tially "fixed" during operation of the system.
`When a user enters text or makes a style selection, this
`input is sent to the server and is stored and processed using
`code residing on the server. This process uses a scripting
`language such as MetaHTML or Dynamo (Art Technology
`Group, Boston, Mass.) (detailed algorithms of this process
`35 are outlined below in the "Use" section). The server then
`sends to the client a new HTML page containing the updated
`information and regenerated images. In order to improve
`operation of the system, only those sections of a displayed
`page are updated during an update of the information. Thus,
`40 only the images of the portion of the display that depend on
`the changed data will be regenerated and retransmitted. For
`example, referring to FIG. 4, generated portion 408 includes
`a caption and therefore portion 408 will be regenerated and
`retransmitted if the caption text data is modified.
`45 Client
`With reference to FIG. 1, in the preferred embodiment the
`user or client computer 10 is a personal computer that is
`connected to the Internet. The computer can be a Apple
`Macintosh (Apple Computer, Inc., Cupertino, Calif.), an
`IBM-compatible machine (IBM Corp., Armonk, N.Y.) or
`any other computer capable of running a standard web
`browser. The client connects to and communicates on the
`web using the TCP/IP protocol. The actual physical connec(cid:173)
`tion is not critical for the present invention, and may be
`55 accomplished via a dedicated line or a modem via a dialup
`connection. Turning to FIG. 2, in the preferred embodiment,
`the user computer 10 runs the Microsoft Windows 95
`operating system (Microsoft Corporation, Redmond, Wash.)
`and a browser 51 such as Netscape Navigator (Netscape
`60 Communications Corporation, Mountain View, Calif.) or
`Microsoft Internet Explorer (Microsoft Corporation,
`Redmond, Wash.). The browser may be further augmented
`for supporting the Java language (Sun Microsystems, Inc.,
`Mountain View, Calif.) to enable the browser to support
`65 processing local to the client.
`The browser 51 is the application running under the
`operating system on the client computer that allows the user
`
`Petitioner - Exhibit 1006
`Page 22 of 34
`
`

`
`6,018,774
`
`10
`
`7
`to make style selections, enters text and uploads photos. The
`browser 51 displays the pages received from the server 31
`and collects user input for transmission to the server 31. The
`pages in the preferred embodiment are written in standard
`HTML capable of being displayed on the web browser with 5
`no additional plug-ins or other applications.
`Graphic data uploaded by the user at the user computer 10
`may be supplied from a variety of sources. For instance
`graphical data representing drawings created by programs
`such as Corel Draw (Corel Corporation, Ottawa, Ontario,
`Canada), Adobe Illustrator or Adobe Photoshop (both of
`Adobe Systems Incorporated, Seattle, Wash.) can be used as
`image data for uploading. For graphical data representing
`digital photos, various sources of data are possible. As
`illustrated in FIG. 1, the user computer can receive data from
`a digital camera 15, video camera 14, scanner 12, or from a 15
`film processor who provides electronic image data. In addi(cid:173)
`tion to the different sources, a variety of graphical data
`formats can be used to encode the image information. In the
`preferred embodiment, graphical data is provided in the
`JPEG or GIF format.
`In the preferred embodiment of the present invention, a
`separate client computer, such as user computer 21 of FIG.
`1, may be the receiver of the electronic postcard. For
`reception of the electronic postcard, the receiving computer
`should have access to an email account and be able to send 25
`and read email using a standard email reader such as Eudora
`(QUALCOMM, Inc., San Diego, Calif.) or Netscape Navi(cid:173)
`gator.
`Operation of the System
`As illustrated in FIG. 17, the el