(12) United States Patent
`Aihara et al.
`
`111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US006223190Bl
`US 6,223,190 Bl
`Apr. 24,2001
`
`(10) Patent No.:
`(45) Date of Patent:
`
`(54) METHOD AND SYSTEM FOR PRODUCING
`AN INTERNET PAGE DESCRIPTION FILE
`ON A DIGITAL IMAGING DEVICE
`
`5,721,908 * 2/1998 Lagarde et a!. ........................ 707/10
`5,898,833 * 4/1999 Kidder ... ... ... ... ... ... .... ... ... ... .. 709/234
`6,035,323 * 3/2000 Narayen eta!. ................. 707/501 X
`
`(75)
`
`Inventors: Tim Takao Aihara, Yono (JP); Rodney
`Somerstein, San Jose, CA (US)
`
`(73) Assignee: FlashPoint Technology, Inc., San Jose,
`CA(US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/059,611
`
`(22) Filed:
`
`Apr. 13, 1998
`
`Int. Cl? ...................................................... G06F 17/21
`(51)
`(52) U.S. Cl. ........................... 707/513; 348/207; 348/552
`(58) Field of Search ..................................... 707/501, 513,
`707/10; 396/297, 300; 348/552, 333.01-333.05,
`207; 345/328; 709/218, 219, 231
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,335,072
`5,633,678
`5,640,193 *
`5,649,186 *
`5,659,729 *
`
`. ... ... ... .... ... ... ... 348/232
`8/1994 Tanaka et a!.
`5/1997 Parulski et a!. ...................... 348/232
`6/1997 Wellner .................................... 348/7
`7/1997 Ferguson ................................ 707/10
`8/1997 Nielsen . ... ... .... ... ... ... ... ... .... ... ... 707/3
`
`FOREIGN PATENT DOCUMENTS
`
`0 650 125
`4/1995 (EP) .
`wo 98/14887
`4/1998 (WO) .
`* cited by examiner
`
`Primary Examiner-Joseph H. Feild
`(74) Attorney, Agent, or Firm-Sawyer Law Group LLP
`
`(57)
`
`ABSTRACT
`
`A method and system for generating an HTML (hypertext
`markup language) file including images captured by a digital
`imaging device, the digital imaging device having a display.
`A script and it's predefined model are provided to the digital
`camera. The script is comprised of a set of software program
`instructions. The digital camera executes the script to dis(cid:173)
`play interactive instructions on the display that prompt a
`user to perform specific operations. In response to the user
`performing the specific operations, the digital camera auto(cid:173)
`matically updates the interactive instructions, such that the
`user is guided through a series of related image captures to
`obtain a series of resulting images. The digital camera then
`generates an HTML file including the resulting images,
`wherein the HTML file is formatted in accordance with the
`predefined model.
`
`19 Claims, 11 Drawing Sheets
`
`Control Returns to 722
`Control Application
`
`Petitioner - Exhibit 1005
`Page 1 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 1 of 11
`
`US 6,223,190 Bl
`
`(
`
`~I
`
`.....
`Q)
`.......
`::::1
`0.
`E
`0
`()
`
`~~
`
`1r
`
`~ ~I
`·:;:
`Q)
`0
`0)
`.5
`0) ca
`E -
`
`•
`
`-LJ..
`
`Petitioner - Exhibit 1005
`Page 2 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 2 of 11
`
`US 6,223,190 Bl
`
`co
`.....
`.....
`~~
`r
`~ ~
`~ Q)
`.....
`c: -
`
`'- ~
`Q) oi
`~~
`0 u
`
`..
`
`._ col
`Cl- g N
`octlcnN
`-c:Q)
`COO)
`C:·- (.)
`<t.cne
`a..
`
`r--.:t
`
`.....
`.....
`
`~I
`
`lr
`
`CJ)
`'-
`.9
`0
`::E
`
`C)g
`a>'-
`cac:
`Ea>
`-en
`
`'-
`Q)
`~
`u:::
`
`..
`
`CJ)~
`c:-
`Q)ctl
`.....JO..
`
`~rC
`
`.....
`
`N
`•
`
`u.. -
`
`1
`
`._col
`Cl_g N
`~I
`·- '-
`c:ctiN
`~
`Ea>
`·- c:
`1-Q)
`(!)
`
`.4~
`
`~I
`
`co
`
`(.)
`
`("')
`N
`~ .....
`ca a..
`~ -ro
`~ c.
`0
`
`Petitioner - Exhibit 1005
`Page 3 of 34
`
`

`
`402
`
`LCD Screen
`4.Q.8
`
`Buttons &
`Dials 404
`
`Status LCD
`406
`
`COMPUTER
`
`LCD
`Controller
`300
`
`I
`I
`
`1/0
`.348
`
`352
`
`116
`~ I
`
`I
`
`I
`
`Power
`Manager
`342
`
`I I
`
`-
`
`Power
`Supply
`.3.Q.2 _
`
`I I
`
`362
`
`-
`
`CPU
`344
`
`DRAM
`.34.6
`
`Non-Volatile
`Memory
`.3.5Q
`
`Main
`Batteries
`.3..5.8
`
`Backup
`Batteries
`
`;)00
`
`364
`_/
`
`FIG. 3
`
`Removable
`Memory
`.3.Q.4
`
`-
`
`I
`
`Imaging Device
`
`114
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`>
`'t:l :-:
`
`N
`~,J;;..
`
`N c c
`'"""'
`
`'JJ. =(cid:173)~
`~ .....
`
`~
`0 ......,
`'"""'
`'"""'
`
`e
`
`rJ'l
`0'1
`'N
`N
`~ -..
`1--"
`\0
`Q
`~
`1--"
`
`Petitioner - Exhibit 1005
`Page 4 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 4 of 11
`
`US 6,223,190 Bl
`
`WORKING MEMORY
`
`~
`Frame Buffers
`r - - - - - - - - - - - - - - -
`
`Input Buffer 1
`r - - - - - - - - - - - - - - -
`
`Input Buffer 2
`r - - - - - - - - - - - - - - -
`
`538
`
`~{
`
`•
`•
`•
`•
`•
`
`Input Buffer N
`- - - - - - - - - - - - - - -
`
`Ram Disk
`
`System Area
`
`~
`
`534
`
`FIG. 4
`
`Petitioner - Exhibit 1005
`Page 5 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 5 of 11
`
`US 6,223,190 Bl
`
`41 Ob _,_-I-~.......__!___.
`411 b .._.__ __
`
`416
`
`FIG. SA
`
`412
`
`414
`
`Menus
`
`426a
`
`426b
`
`418
`
`426---o
`
`Record
`
`422
`
`424
`
`D
`
`Mode
`
`0
`
`420
`
`FIG. 58
`
`Petitioner - Exhibit 1005
`Page 6 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 6 of 11
`
`US 6,223,190 Bl
`
`43 0
`
`111111,111
`
`409
`
`Front View 1 of 5
`
`~ 2
`
`Menu
`
`43 2
`'--
`
`Stop Script
`
`FIG. 6A
`
`43 0
`'--
`
`409
`
`Script XYZ
`
`....
`A Enter name of image:
`
`B Vacation in [£]
`rc,
`
`L
`
`.J
`
`D
`....
`[K]
`
`43 2
`'--
`
`Space
`
`Exit
`
`02
`4
`~
`
`Menu
`
`FIG. 68
`
`Petitioner - Exhibit 1005
`Page 7 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 7 of 11
`
`US 6,223,190 Bl
`
`Directed Image Capture
`Sequence
`
`,,.
`
`DRAM
`
`Control Application
`QQ2
`
`Toolbox
`
`Image Processors
`
`604
`
`002
`
`Camera Control Shell
`2Qa
`
`Script Interpreter
`
`Q1Q
`
`I
`I
`I
`I
`
`Drivers
`
`Kernel
`
`Startup I Config.
`
`350 _ /
`
`Q12
`
`ill
`
`21.2
`
`FIG. 7
`
`Petitioner - Exhibit 1005
`Page 8 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 8 of 11
`
`US 6,223,190 Bl
`
`Insert Removable Memory
`
`Mount Removable Memory
`
`Search for System Files
`
`Install any Scripts Found
`
`User Selects Script Including
`a Directed Image Capture
`Sequence to Run
`
`Begin Interpreting the Script 710
`
`Fetch Command
`
`User Presses
`Shutter Button
`
`Interpret Command
`
`718
`
`Generate Code in
`Accordance with
`the Script's
`Predefined Model
`
`719
`
`\-----~ Control Returns to 722
`Control Application
`
`FIG. 8
`
`Petitioner - Exhibit 1005
`Page 9 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 9 of 11
`
`US 6,223,190 Bl
`
`Christopher Realty, Inc.
`
`958 Willowleaf Drive
`
`D D
`
`Sq. Footage: 3500
`Price: $1000000
`
`Lot Size: 3/4 acre(s)
`Age: 5 year(s)
`
`3 bedroom(s)
`2.5 baths
`2 car garage
`
`Agent: S. Saylor (408) 555-1212
`
`FIG. 9
`
`Petitioner - Exhibit 1005
`Page 10 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 10 of 11
`
`US 6,223,190 Bl
`
`Camera
`
`ill}
`
`~ll
`
`,,.
`
`Modem
`
`8.Q1
`
`~~
`
`~lr
`
`Phone Jack
`802
`
`~~
`
`Local Loop
`
`Modem
`Bank ~
`~
`~------~~+-----~ T1 ------~~~
`
`Internet
`
`ISP
`
`FIG. 10
`
`Petitioner - Exhibit 1005
`Page 11 of 34
`
`

`
`U.S. Patent
`
`Apr. 24, 2001
`
`Sheet 11 of 11
`
`US 6,223,190 Bl
`
`1
`I
`
`---------------------------------------------------------------
`903
`
`Applications
`
`910
`
`-+---
`
`Web Server
`
`Motion Detection
`
`...
`
`Operating
`System
`
`904
`
`~
`
`~
`
`I
`...
`I
`I
`
`-I
`I
`I Aim Control
`"'
`Protocol
`Stack
`
`ruu_
`------------- -------------------------------- -----------
`
`A
`
`~,.
`
`J
`
`Communications
`Hardware 902
`,,.
`HTML
`Files
`
`HTTP
`Requests
`
`~
`Camera
`Hardware
`
`.905
`
`FIG. 11
`
`Petitioner - Exhibit 1005
`Page 12 of 34
`
`

`
`US 6,223,190 Bl
`
`5
`
`10
`
`2
`over the Internet using web server software. The HTML file
`essentially becomes a web page which web browser
`equipped users can view or download on demand.
`However, even with these advanced capabilities, it
`remains desirable to make the user's experience with the
`digital camera as intuitive and "hassle-free" as possible. The
`objective is to provide the advanced capabilities afforded by
`a digital camera while retaining the simplicity and straight
`forwardness of conventional point and shoot cameras.
`Consequently, there is a problem in providing sophisti-
`cated capabilities and features to the user while still retain(cid:173)
`ing a simple straight forward method of operation. For
`example, to create and electronically distribute a document
`and pictures from a digital camera, a user needs to first
`capture the image (e.g., take the picture), and then transfer
`15 the image to a personal computer. One method involves
`transferring a removable storage element (e.g., a flash disk)
`from the digital camera to a corresponding input peripheral
`device (flash disk attachment) coupled to the personal com(cid:173)
`puter. Another method involves tethering the camera to the
`20 computer and transferring the file to the computer using a
`specialized software application. The user can then manipu(cid:173)
`late the image using a separate image editing software tool,
`or use any image editing features included in the specialized
`software application. The user then imports the image into a
`25 document editing application. If the resulting document is to
`be in HTML format, an HTML publishing application would
`typically be used. There, the user formats the document by,
`for example, annotating the image with, for example,
`descriptive text, and including any other patentee informa-
`30 tion. The image is placed on the "page" with respect to the
`descriptive text (e.g., title, subheadings, etc.). The resulting
`document is saved in HTML format.
`Thus, in order to create an HTML file including images
`taken with the digital camera, in addition to taking the
`picture, the user is currently required to know how to
`transfer the picture to the PC, import the image into an image
`editing application, import the image into an HTML pub(cid:173)
`lishing application, and format an HTML file. As the infor(cid:173)
`mation must be entered while using the HTML publishing
`40 application, as opposed to when the pictures are taken, the
`user needs to remember the relevant details about each
`picture or have previously taken notes regarding the pictures
`elsewhere. In addition to all of the above, the user is also
`required to have the requisite skills in operating the image
`editing application, and operating the HTML publishing
`application.
`Hence, what is needed is an inexpensive method and
`system for capturing images and generating a formatted
`electronic document which references those images. The
`50 document should be readily interchangeable among users
`using a variety of computer implemented methods, such as,
`for example, email, LANs/WANs (local area networks/wide
`area networks), or the Internet. The process of creating the
`formatted document including the image should be intuitive
`55 and user friendly. The present invention provides a novel
`solution to the above requirements.
`
`1
`METHOD AND SYSTEM FOR PRODUCING
`AN INTERNET PAGE DESCRIPTION FILE
`ON A DIGITAL IMAGING DEVICE
`
`FIELD OF THE INVENTION
`
`The field of the present invention pertains to digital image
`capture devices. More particularly, the present invention
`relates to a method and system for producing HTML using
`the electronic systems within a digital camera.
`
`BACKGROUND OF THE INVENTION
`
`Most digital cameras today are very similar in size and
`behavior to conventional point-and-shoot cameras. Modern
`digital cameras for taking pictures of scenes and the like
`typically include an imaging device which is controlled by
`a computer running a software program. When an image is
`captured, the imaging device is exposed to light and gener(cid:173)
`ates raw image data representing the image. The raw image
`data is typically stored in a single image buffer where it is
`then processed and compressed by the processor. Many
`types of compression schemes are used to compress the
`image data, with the joint photographic expert group (JPEG)
`standard being the most popular. After the processor pro(cid:173)
`cesses and compresses the raw image data into JPEG image
`files, the processor stores the JPEG image files into an
`internal memory or on an external memory card.
`Some digital cameras are also equipped with a liquid(cid:173)
`crystal display (LCD) or other type of display screen on the
`back of the camera. Through the use of the LCD, the
`processor can cause the digital camera to operate in one of
`two modes, play and record, although some cameras only
`have a record mode. In play mode, the LCD is used as a
`playback screen for allowing the user to review previously
`captured images either individually or in arrays of four, nine, 35
`or sixteen images. In record mode, the LCD is used as a
`viewfinder in which the user may view an object or scene
`before taking a picture.
`Besides the LCD, digital camera user interfaces also
`include a number of buttons or switches for setting the
`camera into one of the two modes and for navigating
`between pictures in play mode. For example, most digital
`cameras include two buttons labeled"-" and"+" that enable
`a user to navigate or scroll through captured pictures. For
`example, if the user is reviewing pictures individually, 45
`meaning that single pictures are displayed full-sized in the
`LCD, pressing one of navigation buttons causes the cur(cid:173)
`rently displayed picture to be replaced by the next picture.
`The electronic nature of the digital camera's pictures
`make them particularly well suited for use with other
`electronic applications. The pictures are also particularly
`well suited for use in the creation of complex text and image
`documents. Using document creation software applications,
`the pictures can be incorporated into a document along with
`corresponding text annotations or descriptions. Once
`created, the documents can be electronically transmitted
`(e.g., via email) or printed and distributed conventionally.
`The resulting document can be formatted in accordance with
`any of a number of popular page description languages used
`for the Internet, such as HTML (hypertext markup 60
`language), XML (extensible markup language), java script,
`and the like.
`For example, once the HTML file, referencing the pictures
`has been created, it can easily be exchanged among any
`number of users via email and subsequently viewed (e.g., as
`a web page) using any of a number of web browsers.
`Alternatively, the HTML file itself can be made available
`
`SUMMARY OF THE INVENTION
`The present invention provides an inexpensive method
`and system for capturing images and generating a formatted
`electronic document which includes those images. The
`document is readily interchangeable among users using a
`variety of computer implemented methods, such as, for
`example, email, LAN/WANs, or the Internet. The present
`65 invention provides a process of creating the formatted
`document including the image which is intuitive and user
`friendly.
`
`Petitioner - Exhibit 1005
`Page 13 of 34
`
`

`
`US 6,223,190 Bl
`
`4
`FIG. 7 shows a block diagram illustrating the contents of
`a ROM and DRAM of a the camera from FIG. 1.
`FIG. 8 is a flow chart illustrating an exemplary process of
`installing and running a script in accordance with one
`embodiment of the present invention.
`FIG. 9 shows a web page as described by an HTML file
`created by a script in accordance with one embodiment of
`the present invention.
`FIG.10 shows a diagram of a digital camera of the present
`invention coupled to the Internet via an ISP and a dial-up
`connection.
`FIG. 11 shows a diagram of the connectivity and appli(cid:173)
`cation software of the camera from FIG. 10 is shown.
`
`10
`
`15
`
`3
`In one embodiment, the present invention comprises a
`method and system for generating a page description file,
`such as HTML (hypertext markup language) that references
`images captured by a digital camera. A script, comprised of
`computer readable instructions, is provided to the digital 5
`camera. The script is interpreted by the camera such that the
`camera sequences though a series of actions, such as for
`example, prompting the user to take a picture, prompting the
`user to enter any descriptive information regarding a picture,
`and the like. The script also includes a set of predefined
`instructions and formatting commands which are adapted to
`create a formatted web page (e.g., HTML file) in accordance
`with a certain desired appearance. This set of instructions
`and commands are referred to as a "model". The creator of
`the script develops the model in accordance with the par-
`ticular requirements to which the script is designed.
`The digital camera executes the script to display interac(cid:173)
`tive instructions on the camera's display that prompt a user
`to perform specific operations. In response to the user
`performing the specific operations, the digital camera auto(cid:173)
`matically updates the interactive instructions, such that the 20
`user is guided through a series of steps, such as, for example,
`taking a series of related image captures and annotating
`them. The digital camera then generates an HTML file
`referencing the resulting images, wherein the HTML file is
`formatted in accordance with the script's predefined model. 25
`In so doing, the present invention allows a user having no
`knowledge of HTML to produce HTML and image files
`which describe one or more web pages including the result(cid:173)
`ing images. The web pages are viewable through the use of
`any of a number of widely used web browsers. In addition, 30
`the present invention allows the user to annotate and enter
`descriptive information regarding the images at the time
`they are captured, rather than having to first transfer the
`captured images to a PC or enter notes elsewhere.
`The HTML file can then be downloaded from the digital
`camera using, for example, a removable storage device
`(flash disk, PC Card, etc.). Alternatively, in another
`embodiment, the HTML file can be made directly available
`over the Internet through the use of a web server hosted by
`the digital camera itself.
`
`35
`
`40
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`In the following detailed description of the present
`invention, numerous specific details are set forth in order to
`enable one of ordinary skill in the art to make and use the
`invention and is provided in the context of a patent appli(cid:173)
`cation and its requirements. Although the present invention
`will be described in the context of a digital camera, various
`modifications to the preferred embodiment will be readily
`apparent to those skilled in the art and the generic principles
`herein may be applied to other embodiments. That is, any
`image capture device which displays or prints images, icons
`and/or other items, could incorporate the features described
`hereinbelow and that device would be within the spirit and
`scope of the present invention. Thus, the present invention
`is not intended to be limited to the embodiment shown but
`is to be accorded the widest scope consistent with the
`principles and features described herein.
`The present invention provides an inexpensive method
`and system for capturing images and generating a formatted
`electronic document which includes or references those
`images. The document is readily interchangeable among
`users using a variety of computer implemented methods,
`such as, for example, email, LAN/WAN, or the Internet. The
`present invention also provides a process of creating the
`formatted document including the image which is intuitive
`and user friendly. In addition, the present invention includes
`a method and system for inexpensively making the format(cid:173)
`ted document available via the Internet to web browser
`45 equipped users. The present invention and its advantages are
`further described below.
`Referring now to FIG. 1, a block diagram of a digital
`camera 110 is shown for use in accordance with the present
`invention. Camera 110 preferably comprises an imaging
`device 114, a system bus 116 and a computer 118. Imaging
`device 114 is optically coupled to an object 112 and elec(cid:173)
`trically coupled via system bus 116 to computer 118. Once
`a photographer has focused imaging device 114 on object
`112 and, using a capture button or some other means,
`55 instructed camera 110 to capture an image of object 112,
`computer 118 commands imaging device 114 via system bus
`116 to capture raw image data representing object 112. The
`captured raw image data is transferred over system bus 116
`to computer 118 which performs various image processing
`60 functions on the image data before storing it in its internal
`memory. System bus 116 also passes various status and
`control signals between imaging device 114 and computer
`118.
`Referring now to FIG. 2, a block diagram of one preferred
`65 embodiment of imaging device 114 is shown. Imaging
`device 114 typically comprises a lens 220 having an iris, a
`filter 222, an image sensor 224, a timing generator 226, an
`
`50
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The present invention is illustrated by way of example
`and not by way of limitation, in the figures of the accom(cid:173)
`panying drawings in which like reference numerals refer to
`similar elements and in which:
`FIG. 1 shows a block diagram of a digital camera for use
`in accordance with the present invention.
`FIG. 2 shows a block diagram of an imaging device in
`accordance with one preferred embodiment of the present
`invention.
`FIG. 3 shows a block diagram of a computer in accor(cid:173)
`dance with one preferred embodiment of the present inven(cid:173)
`tion.
`FIG. 4 shows a memory map of a DRAM in accordance
`with one embodiment of the present invention.
`FIG. SA shows a top view diagram depicting the preferred
`hardware components of the camera from FIG. 1.
`FIG. 5B shows a back view diagram depicting the pre(cid:173)
`ferred hardware components of the camera from FIG. 1.
`FIG. 6Ashows a diagram of a first directed image capture
`screen in accordance with one embodiment of the present
`invention.
`FIG. 6B shows a diagram of a second directed image
`capture screen in accordance with one embodiment of the
`present invention.
`
`Petitioner - Exhibit 1005
`Page 14 of 34
`
`

`
`US 6,223,190 Bl
`
`5
`analog signal processor (ASP) 228, an analog-to-digital
`(AID) converter 230, an interface 232, and one or more
`motors 234.
`In operation, imaging device 114 captures an image of
`object 112 via reflected light impacting image sensor 224
`along optical path 236. Image sensor 224, which is typically
`a charged coupled device (CCD), responsively generates a
`set of raw image data in CCD format representing the
`captured image 112. The raw image data is then routed
`through ASP 228, AID converter 230 and interface 232.
`Interface 232 has outputs for controlling ASP 228, motors
`234 and timing generator 226. From interface 232, the raw
`image data passes over system bus 116 to computer 118.
`Referring now to FIG. 3, a block diagram of one preferred
`embodiment for computer 118 is shown. System bus 116
`provides connection paths between imaging device 114, an
`optional power manager 342, central processing unit (CPU)
`344, dynamic random-access memory (DRAM) 346, input/
`output interface (110) 348, non-volatile memory 3SO, and
`buffers/connector 3S2. Removable memory 3S4 connects to 20
`system bus 116 via buffers/connector 3S2. Alternately, cam(cid:173)
`era 110 may be implemented without removable memory
`3S4 or buffers/connector 3S2.
`Power manager 342 communicates via line 366 with
`power supply 3S6 and coordinates power management
`operations for camera 110. CPU 344 typically includes a
`conventional processor device for controlling the operation
`of camera 110. In the preferred embodiment, CPU 344 is
`capable of concurrently running multiple software routines
`to control the various processes of camera 110 within a
`multithreaded environment. DRAM 346 is a contiguous
`block of dynamic memory which may be selectively allo(cid:173)
`cated to various storage functions. LCD controller 390
`accesses DRAM 346 and transfers processed image data to
`LCD screen 402 for display.
`1!0 348 is an interface device allowing communications
`to and from computer. For example, 1!0 348 permits an
`external host computer (not shown) to connect to and
`communicate with computer 118. 1!0 348 also interfaces
`with a plurality of buttons and/or dials 404, and an optional
`status LCD 406, which in addition to the LCD screen 402,
`are the hardware elements of the camera's user interface
`408.
`Non-volatile memory 3SO, which may typically comprise
`a conventional read-only memory or flash memory, stores a
`set of computer-readable program instructions to control the
`operation of camera 110. Removable memory 3S4 serves as
`an additional image data storage area and is preferably a
`non-volatile device, readily removable and replaceable by a 50
`camera 110 user via buffers/connector 3S2. Thus, a user who
`possesses several removable memories 3S4 may replace a
`full removable memory 3S4 with an empty removable
`memory 3S4 to effectively expand the picture-taking capac-
`ity of camera 110. In the preferred embodiment of the 55
`present invention, removable memory 3S4 is typically
`implemented using a flash disk. Power supply 3S6 supplies
`operating power to the various components of camera 110.
`In the preferred embodiment, power supply 3S6 provides
`operating power to a main power bus 362 and also to a 60
`secondary power bus 364. The main power bus 362 provides
`power to imaging device 114, 1!0 348, non-volatile memory
`3SO and removable memory 3S4. The secondary power bus
`364 provides power to power manager 342, CPU 344 and
`DRAM 346.
`Power supply 3S6 is connected to main batteries 3S8 and
`also to backup batteries 360. In the preferred embodiment,
`
`6
`a camera 110 user may also connect power supply 3S6 to an
`external power source. During normal operation of power
`supply 3S6, the main batteries 3S8 provide operating power
`to power supply 3S6 which then provides the operating
`5 power to camera 110 via both main power bus 362 and
`secondary power bus 364. During a power failure mode in
`which the main batteries 3S8 have failed (when their output
`voltage has fallen below a minimum operational voltage
`level) the backup batteries 360 provide operating power to
`10 power supply 3S6 which then provides the operating power
`only to the secondary power bus 364 of camera 110.
`Referring now to FIG. 4, a memory diagram showing one
`embodiment of dynamic random-access-memory (DRAM)
`346 is shown. In the preferred embodiment, DRAM 346
`15 includes RAM disk S32, a system area S34, and working
`memory S30.
`RAM disk S32 is a memory area used for storing raw and
`compressed image data and typically is organized in a
`"sectored" format similar to that of conventional hard disk
`drives. In the preferred embodiment, RAM disk S32 uses a
`well-known and standardized file system to permit external
`host computer systems, via 1!0 348, to readily recognize and
`access the data stored on RAM disk S32. System area S34
`typically stores data regarding system errors (for example,
`25 why a system shutdown occurred) for use by CPU 344 upon
`a restart of computer 118.
`Working memory S30 includes various stacks, data struc(cid:173)
`tures and variables used by CPU 344 while executing the
`software routines used within computer 118. Working
`memory S30 also includes several input buffers S38 for
`temporarily storing sets of raw image data received from
`imaging device 114, and a frame buffer S36 for storing data
`for display on the LCD screen 402. In a preferred
`embodiment, each input buffer S38 and the frame buffer S36
`are split into two separate buffers (shown by the dashed
`lines) to improve the display speed of the digital camera and
`to prevent the tearing of the image in the display 402.
`FIGS. SA and SB are diagrams depicting the preferred
`40 hardware components of the camera's 110 user interface
`408. FIG. SA is back view of the camera 110 showing the
`LCD screen 402, a four-way navigation control button 409,
`an overlay button 412, a menu button 414, and a set of
`programmable soft keys 416. FIG. SB is a top view of the
`45 camera 110 showing a shutter button 418, and a mode dial
`420. The camera may optionally include status LCD 406,
`status LCD scroll and select buttons 422 and 424, a sound
`record button 426, and zoom-in, zoom-out buttons 426a and
`426b.
`The digital camera of the present invention is controlled
`by graphical-user-interface (GUI) based operating system
`(OS), which is in contrast to conventional digital cameras
`that are controlled by proprietary hardware architectures. In
`the preferred embodiment of the present invention, the OS
`provides the digital camera with several different operating
`modes for supporting various camera functions. Although
`the digital camera may include several different operating
`modes, the modes relevant to this description are capture
`mode, and play mode.
`In capture mode, the camera 110 supports the actions of
`preparing to capture an image, and capturing an image
`through the use of either the LCD screen 402 alone or the
`status LCD 406 with the aid of an optional optical view(cid:173)
`finder (not shown). In review mode, the camera 110 supports
`65 the actions of reviewing camera contents, editing and sorting
`images, and printing and transferring images. In play mode,
`the camera 110 allows the user to view screen-sized images
`
`30
`
`35
`
`Petitioner - Exhibit 1005
`Page 15 of 34
`
`

`
`US 6,223,190 Bl
`
`5
`
`7
`in the LCD screen 402 in the orientation that the image was
`captured. Play mode also allows the user to hear recorded
`sound associated to a displayed image, and to play back
`sequential groupings of images, which may comprise time
`lapse, slide show, and burst image images. The user prefer-
`ably switches between the capture, review, and play modes,
`using the mode dial 420. When the camera is placed into a
`particular mode, that mode's default screen appears in the
`LCD screen 402 in which a set of mode-specific items, such
`as images, icons, and text, are displayed.
`The present invention provides an inexpensive method
`and system for capturing images and generating a formatted
`electronic document which includes those images. The
`document is readily interchangeable among users using a
`variety of computer implemented methods, such as, for 15
`example, email, LAN/WAN, or the Internet. The present
`invention provides a process of creating the formatted
`document including the image which is intuitive and user
`friendly. The document can be created in any of a number of
`formats. Such formats include, for example, HTML format, 20
`Postscript format, Acrobat format, and the like.
`In one embodiment, the present invention comprises a
`method and system wherein camera 110 automatically gen(cid:173)
`erates a formatted HTML file referencing images captured
`by the user. This is accomplished through the use of a script. 25
`As used herein, a script is an interpreted program written
`with text-based commands. A script may also be written
`using other interpreted languages, such as BASIC and LISP,
`for example. A script in accordance with the present inven(cid:173)
`tion also includes a predefined set of commands which 30
`determine the formatted appearance of a web page. The
`script is interpreted by camera 110, which performs the
`actions, steps, functions, and the like, as dictated by the
`script. The predefined set of commands which determine the
`formatted appearance of a web page are referred to as a 35
`model. The model is designed (e.g., by the user, a third party
`developer, or the like) to give the resulting web page its
`distinctive appearance.
`For example, in one embodiment, a script can be created
`that sequentially directs the user to select from a set of 40
`previously captured images stored within camera 110, enter
`annotations regarding each image, and automatically format
`an HTML file in accordance with a predefined model.
`Alternatively, in another embodiment, a script can be created
`that directs the user to take a series of images, enter 45
`annotations for the images, and automatically format an
`HTML file in accordance with the predefined model. In both
`cases, the HTML commands which determine the
`appearance, hereafter referred to as the format, of the
`resulting web page are generated by the script in accordance 50
`with the predefined model.
`In the embodiment where the script includes a directed
`image capture sequence, the directed image capture
`sequence provides a series of instructions which prompts
`and directs the user through a sequence actions, such as, for 55
`example, taking a picture, promoting the user for any
`descriptive information regarding the picture, prompting the
`user for annotations, and the like. Camera 110 executes the
`directed image capture sequence, and typically displays
`interactive instructions on LCD screen 402 that guide the 6