l||||||||||||||||||||||||||||||||||||ll ll|||||||||l|||||||||||||||||||||||
`
`USi){l656'i"122B1
`
`(12) Ulllted States Patent
`Anderson et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 6,567,122 B1
`May 20, 2003
`
`(54) Ml+:'[‘H0l) AND SYS’I'l£M FOR HOSTING AN
`IIsITIgRNI:;I‘ WEB SITE on A DIGITAL
`CAMERA
`
`S/2001 Ward et al.
`200110010543 Al *
`812001 Bnho, II
`20tJ1,r(_tti149 10 Al *
`2t'JUl,-'l.ll'J5l'l".-'11 Al
`" 12,-'2U[]I] Karuhe et al.
`
`
`
`343207.90
`‘mam?
`348E220
`
`(75)
`
`Inventors: Eric C. Anderson, San Jose, CA (US);
`Mie|1nelA. Ramirez, Palo Alto, CA
`(US); Stephen G. Sullivan, Mountain
`VIEW’ CA (US)
`
`EP
`'5"
`W0
`W0
`
`FOREIGN PATENT DOCUMENTS
`[1 821 522
`210998
`‘l§35‘lll
`3”993
`W0 9{JiU2i|CIIEI
`1.u’l9'9t‘J
`W0 97.-’38.'J1|'.i
`Iii.-"I99"?
`
`
`
`Ilr14Nl5i232
`_
`I-Il]4Ni’:\.92.§2
`II04lJl2.-'38
`
`OTHER IJUBLICATIONS
`
`l’A'l'NEWS: What isn't obvious in the patent world‘? E—Mail
`correspondence.
`
`‘ “ml '39 “’‘'‘‘“‘i“‘~'’
`Prirrtary Examirter—Wendy R. Gather
`Assfismm E.rmi:iner—-Lin Ye
`(74) Airorrifiifi Age:-it, or Ftrm—Sawyer Law Group 11.!’
`5
`( 7)
`ABSTRACT
`The present invention comprises a method and system for
`implementing intemet access to images stored in a digital
`image capture unit
`including an imaging device and a
`display. The image capture unit (e.g., a digital camera} is
`used to capture images and store them within its internal
`menmry. The image capture unit accesses :1 ID server via the
`internel and registers its identity and interact address with
`the web server. A user subsequently accesses the image
`capture unit by entering the 1(l(.l‘lllly ot the tntagceapture
`uml ll']l(l his web browser. The web browser, using standard
`imernet protocols.
`then queries the ID server with the
`identity of the image capture unit and retrieves the interaet
`address. The internet aclclress is subsequently used to access
`a web page hosted by the image capture unit and display the
`web page to the user. The web page provides access to the
`stored images within the image capture unit
`'
`'
`
`22 Claims, 11 Drawing Sheets
`
`(73)
`
`/\ssignee:
`
`ll’/\C Acquisition Subsidiary I,
`Peterborough, NH (US)
`
`( ‘ ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`u.s.c. 154(1)) by 0 days.
`
`(21) App}. No; 09.3044-,644
`(22
`Filed:
`Mar. 18, 1998
`(51)
`Int. Cl.’
`
`(52) U.S. Cl.
`
`H04N 511232; 110414 9104;
`H04-N 7114; G051’ 15316
`348,i21l.3; 34-8i’207.99;
`34804.01; 709E201; 7'09i217
`348.3552, 20?,
`(58) Field of Search
`348,314, 14.03, 207.99, 207.1, 207.1l, 211.3,
`14.01; 709K201, 217, 219
`
`References Cited
`Us. PM,EN,I_ DOCUMENTS
`5,633,078 A *
`5:109? Panllski el at.
`3,649,186 A *
`7;1<m I-‘erguson
`5__<.J9<.i,2t'J‘:' A *
`l2fl‘J‘J‘.»‘ Rodriguez el al-
`5.-0'2.-U83 A * U200“ Li “I “L
`5-‘J3-W33} *“
`*
`3’2”“'” NW3"-‘“ °‘ 3"
`6"l63’333 A *
`lyznm Bamclough
`6,205,485 B1 *
`3.’2U0l Kikinis
`0,240,430 B1 “‘
`639.001 Peters et al.
`0,353,848 B1 *
`3.12002 Morris
`
`348x232
`. vsrmri
`-- 343.914
`709*?”-J
`70°73‘-‘E
`" 34””
`'i'[}9r'23l
`343314
`709x203
`
`
`
`(56)
`
`!lI!1
`_
`““::"::=.:‘.'.r.:.",1::'..“.:’;‘“I~’
`IIDE‘
`
`iloéh In
`wIIcd'.:'r
`
`um dig‘
`:mn-m
`Inn hrvn
`:I:il.m|'u-Ni
`Irliunlusar Llm dqiull inmun
`l‘-05
`wiIJ|a[Iprnflri :
`mn:-.u-.a'nty min:
`tun
`
`
`
`Nohly nu apprnprim II!
`lenu by
`nllvlitg rim
`mu iligiuzt
`en in on line
`
`..—J
`
`:LE-snrule Ill Ir|II'IIirIl:'urI
`H1\II'I:m mllhn Iltcdigunl
`rlrntrn
`
`1'
`
`Aux:-an IHI: ID mm with .
`mm: WPII brow!
`5 I
`rll\r§
`{VII
`u|'l
`on
`i-amen
`
`in
`..—J
`
`j.
`
`R:=IwIl 1-a'igiI.nii:nmier.I
`nu Ihc
`browser until‘
`an inwrm-. nddrru
`
`,...J
`
`7?.
`aim-u liln‘ ur'..§.|:u ms.
`da,,_-in-. nmnl emu \I1'l.I
`pup tzmnl by the dntitnl
`ear...-.
`
`nu,
`.-
`
`1”"
`
`I 105
`
`
`
` ‘
`
`0001
`0001
`
`Apple/Twitter
`Apple/Twitter
`Ex. 1019
`Ex. 1019
`IPR2 of U.S. Pat. No. 7,765,482
`IPR2 of U.S. Pat. No. 7,765,482
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 1 0f 11
`
`US 6,567,122 B1
`
`FIG. 1
`
`Computer
`
`116
`
`/—114
`
`Imagmg Device
`
`112 E>\
`
`0002
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 2 of 11
`
`US 6,567,122 B1
`
`oz
`
`DZ
`
`.H®uL®>GOU
`
`uomwwoonm
`
`Ndbm
`
`MESH.
`
`pouwumcmmu
`
`8«..t35fimmE230
`
`
`
`mo_ma<
`
`_§m_m
`
`mmmafl
`
`aomamm
`
`«S
`
`
`
`E5
`
`0003
`
`0003
`
`
`
`
`
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 3 of 11
`
`US 6,567,122 B1
`
`@339M3925
`
`msxumm
`
`mmimfimm
`
`EEOum
`
`maofismDOAmfismEabmQ04-
`
`wowwowwowW
`
`N3
`
`m3a>oEmm
`
`E8832
`
`£Eflo>-:oZ
`
`Nfofiwmz
`
`GOA
`
`.$=o.SGoO
`
`Sfiafioo
`
`0004
`
`0004
`
`
`
`
`
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 4 0f 11
`
`US 6,567,122 B1
`
`WORKING MEMORY
`
`‘\530
`
`_FEA_1VI_E EUEEEBS __________ __ __
`
`536
`
`._I11PLJT_B_UF_F_E_R_1 __________ _ _
`
`JKPLJLBLJEFEFLZ __________ _ _
`
`538
`
`[
`
`JEPLT'LBHEFEILN _________ __ _ A
`
`RAM DISK
`
`\
`532
`
`SYSTEM AREA
`
`'\
`534
`
`FIG. 4
`
`0005
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 5 0f 11
`
`US 6,567,122 B1
`
`k
`
`/ / /
`416M
`
`J
`
`FIG. 5A
`
`422
`
`424
`
`I
`
`418
`
`0006
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 6 6f 11
`
`US 6,567,122 B1
`
`wow |\
`
`DOA
`
`l NNN wow
`
`66K
`
`
`
`039A 25%
`
`lwwmEH 3mm
`
`mpmw
`wot/om
`mwmEH
`
`w .Ubm
`
`0007
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 7 0f 11
`
`US 6,567,122 B1
`
`M
`
`g?g?k
`lQ-Q
`
`USER
`7_2Q
`
`DIAL UP CONNECTION
`
`DIAL UP CONNECTION
`
`ISP <—>
`1m
`
`INTERNET
`
`<—> ISP
`M
`
`7_5_
`
`ID Server
`m
`
`FIG. 7
`
`0008
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 8 0f 11
`
`US 6,567,122 B1
`
`CAMERA
`lo
`
`MODEM
`(I) H
`
`LOCAL LOOP
`
`l
`
`MODEM BANK O
`CO
`
`ISP
`
`FIG. 8
`
`0009
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 9 of 11
`
`US 6,567,122 B1
`
`_90_0
`
`346
`
`F _________________________ _ _
`
`_ j
`
`I
`
`l
`
`APPLICATIONS _03
`I
`910
`\:_ web server
`OPERATING
`:
`motion detection H SYSTEM 904
`:
`aim control
`I
`t
`I
`PROTOCOL STACK
`I I
`592i
`.
`
`l
`
`l
`
`I
`
`I
`:
`I
`:
`i
`I
`I
`.
`
`l
`
`CAMERA
`HARDWARE 905
`
`$
`COMMUNICATIONS
`HARDWARE 902
`
`T
`
`HTTP
`Requests
`
`l
`
`HTML
`?les
`
`FIG. 9
`
`0010
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 10 0f 11
`
`US 6,567,122 B1
`
`INTERNET
`
`70
`
`ID Server
`
`_
`
`REGISTRY 1 01
`
`CAMERA 10 ADDRESS 1 02 USER INFO 1 03
`
`FIG. 10
`
`0011
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 11 0f 11
`
`US 6,567,122 B1
`
`m
`
`1101
`Couple a digital camera to ,J
`the telephone system
`
`Determine whether
`the digital camera
`has been
`initialized
`
`1103
`Initialize the digital camera
`with appropriate A]
`connectivity information
`1
`
`1104
`Notify the appropriate ID A]
`server by registering that
`the digital camera is on-line
`
`1105
`Execute an application [J
`Program within the digital
`camera
`
`1109
`
`_
`Contmue
`
`L\ r——————>t
`
`1106
`
`1107
`
`Access the ID server with a
`user's web brower to
`retrieve the internet address
`of the digital camera
`i
`Access the digital camera
`via the web browser using
`the internet address
`i
`1108
`Access the images of the
`digital camera via a web /\/
`h tdb th d"t1
`page osfamgra e 1g1a
`
`0012
`
`

`
`US 6,567,122 B1
`
`1
`METHOD AND SYSTEM FOR HOSTING AN
`INTERNET WEB SITE ON A DIGITAL
`CAMERA
`
`FIELD OF THE INVENTION
`The ?eld of the present invention pertains to digital image
`capture devices. More particularly, the present invention
`relates to a method and system for using the electronic
`systems Within a digital camera With the internet.
`
`BACKGROUND OF THE INVENTION
`
`Modern digital cameras for taking pictures of scenes and
`the like typically include an imaging device Which is con
`trolled by a computer running a softWare program. When an
`image is captured, the imaging device is exposed to light and
`generates raW image data representing the image. The raW
`image data is typically stored in a single image buffer Where
`it is then processed and compressed by the processor. Many
`types of compression schemes are used to compress the
`image data, With the joint photographic expert group (JPEG)
`standard being the most popular. After the processor pro
`cesses and compresses the raW image data into JPEG image
`?les, the processor stores the JPEG image ?les into an
`internal memory or on an external memory card.
`Some digital cameras are also equipped With a liquid
`crystal display (LCD) or other type of display screen on the
`back of the camera. Through the use of the LCD, the
`processor can cause the digital camera to operate in one of
`tWo modes, play and record, although some cameras only
`have a record mode. In play mode, the LCD is used as a
`playback screen for alloWing the user to revieW previously
`captured images either individually or in arrays of four, nine,
`or sixteen images. In record mode, the LCD is used as a
`vieW?nder in Which the user may vieW an object or scene
`before taking a picture.
`Besides the LCD, digital camera user interfaces also
`include a number of buttons or sWitches for setting the
`camera into one of the tWo modes and for navigating
`betWeen images in play mode. For example, most digital
`cameras include tWo buttons labeled “—” and “+” that enable
`a user to navigate or scroll through captured images. For
`example, if the user is revieWing images individually, mean
`ing that single images are displayed full-siZed in the LCD,
`pressing one of navigation buttons causes the currently
`displayed image to be replaced by the next image.
`It should be noted that a digital camera has no “?lm”, and
`as such, there is no incremental cost of taking and storing
`pictures. Within the con?nes of memory, the cost taking and
`storing each additional picture is insigni?cant. For a given
`memory siZe, it is possible to take an unlimited number of
`pictures, Wherein the most recent picture replaces the earliest
`picture, for virtually Zero incremental cost. Accordingly, this
`advantage is best realiZed When the camera is used as much
`as possible, taking pictures of practically anything of inter
`est.
`One Way to best utiliZe these unique attributes is to make
`the digital camera and its internally stored images remotely
`accessible. If the pictures are remotely accessible, the cam
`era could be set to continuously take pictures of scenes/items
`of interest. Ideally, a user Would be able to access those
`pictures at any time. The user Would be able to use a Widely
`available communications medium to access the camera
`from virtually an unlimited number of locations.
`The emergence of the internet as a distributed, Widely
`accessible communications medium provides a convenient
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`2
`avenue for implementing remote accessibility. Providing
`remote accessibility via the internet leverages the fact that
`the internet is becoming increasingly familiar to increasing
`numbers of people. Many users have become accustomed to
`retrieving information from remotely located systems via the
`internet. There are many and varied applications Which
`presently use the internet to provide remote access or remote
`connectivity. Internet telephony is one such application,
`such as, for example, Microsoft’s NetMeeting and
`Netscape’s CoolTalk.
`NetMeeting and CoolTalk are both real-time desktop
`audio conferencing and data collaboration softWare appli
`cations speci?cally designed to use the internet as their
`communications medium. Both softWare applications alloW
`a “local” user to place a “call” to a “remote” user located
`anyWhere in the World. With both NetMeeting and CoolTalk,
`the softWare application is hosted on a personal computer at
`the user’s location and on a personal computer at the remote
`user’s location. Both NetMeeting and CoolTalk require a
`SLIP (Serial Line Internet Protocol) or PPP (Point-to-Point
`Protocol) account Where internet access is via a dial-up
`modem, Where the user, as is typical, accesses the internet
`through their respective ISP (internet service provider). Both
`NetMeeting and CoolTalk require personal computers for
`the necessary resources for running the applications (e.g.,
`processing poWer, memory, communications hardWare,
`etc.). In addition, both NetMeeting and CoolTalk require the
`one user to input an IP (Internet Protocol) address for the
`other user in order to establish communication betWeen
`them. To place a call, for example, the local user enters the
`IP address of the remote user in an appropriate ?eld of the
`softWare application and subsequently initiates the call (e. g.,
`by clicking a graphic icon on the personal computer’s
`display), Which in turn, establishes communication betWeen
`the users.
`To facilitate the process of obtaining appropriate internet
`addresses, CoolTalk, for example, alloWs on-line users to list
`their respective IP addresses With a proprietary central
`CoolTalk server. This alloWs a user to obtain a list of
`currently on-line users to Whom communication can be
`established. Upon locating the desired remote user in the
`Web server maintained internet address list, the local user
`places the call.
`In this manner, the proprietary central CoolTalk server
`maintains a user vieWable, user updated, “address book” in
`Which users list their respective internet addresses and in
`Which they search for the internet addresses of others With
`Whom they Wish to communicate. HoWever, as described
`above, both NetMeeting and CoolTalk require active user
`input, in that each require the user to input his current
`internet address and in that each require the user to search
`the address book for the internet address of the individual to
`be contacted. This can be quite problematic in the case
`Where users obtain access to the internet via dial-up
`connections, and hence, have different internet addresses
`each time their respective dial-up connections are estab
`lished.
`In a manner similar to internet telephony, internet desktop
`video conferencing is another application Which uses the
`internet as its communications medium. One such
`application, for example, is CU-SeeMe, by White Pine.
`CU-SeeMe provides real time video conferencing betWeen
`tWo or more users. As With NetMeeting and CoolTalk,
`CU-SeeMe is a softWare application Which runs on both the
`local user’s personal computer and the remote user’s per
`sonal computer. The personal computers provide the
`resources for running the application. As With NetMeeting
`
`0013
`
`

`
`US 6,567,122 B1
`
`3
`and CoolTalk, CU-SeeMe requires the local user to enter the
`IP address of the remote user. CU-SeeMe also facilitates this
`process by allowing on-line users to list their respective IP
`addresses With a proprietary central server such that the
`addresses can be easily indexed and searched.
`Another example of remote access via the internet is
`status queries of remote devices using the internet as the
`communications medium. A typical prior art application
`involves interfacing a remote device With a computer
`system, and providing access to the computer system via the
`internet. For example, a vending machine can be remotely
`accessed to determine its status (e.g., the number of sales
`made, Whether the machine needs re?lls, Whether the
`machine needs maintenance, etc.). The machine is appro
`priately equipped With sensors, sWitches, and the like, Which
`are in turn, interfaced to a computer system using a softWare
`driver. The computer system is coupled to the internet and
`interfaces With the machine through the driver, making the
`relevant information available over the internet using Web
`server softWare. Hence, any interested user (e. g., the vending
`machine service company) is able to remotely ascertain the
`status of the machine via the internet.
`The problem With the above described prior art applica
`tions is that access to the internet and communication
`thereon requires a separate host computer system (e.g., a
`personal computer). Each of the above described applica
`tions (CoolTalk, NetMeeting, and the vending machine
`examples) require a computer system on both sides of the
`internet connection. The tWo computer systems provide the
`computational resources to host the respective softWare
`application, the internet access softWare, and any necessary
`device drivers. Because of this, among other reasons, the
`above applications are not easily transferred to the realm of
`easy-to-use, intuitive, consumer electronic type devices such
`as digital cameras. The separate computer systems are
`expensive.
`Another problem is the fact that the above applications
`require the user to knoW the internet address of the person
`(or device, in the vending machine example) being con
`tacted. The internet telephony applications (e.g., CoolTalk)
`often employ a user vieWable, user updated, address book to
`facilitate the process of locating and obtaining the correct
`internet address, hoWever, they require active user input.
`This is difficult in the case Where users obtain access to the
`internet via dial-up connections, and thus, have changing
`internet addresses.
`In addition, both CoolTalk and NetMeeting operate on top
`of the computer’s operating system, Which is notoriously
`difficult and obtuse to novice users.
`Thus, What is required is an inexpensive method imple
`menting remote access via the internet for digital cameras.
`If internet remote accessibility is relatively inexpensive, a
`large installed base of remotely accessible digital cameras
`Will rapidly develop. This Will give rise to many different
`applications and enhancements being developed, Which in
`turn, Will lead to even greater demand for, and use of,
`remotely accessible digital cameras. What is further required
`is an intuitive, easy to use interface for presenting the digital
`camera’s functionality and capabilities to users.
`Additionally, What is required is an efficient, user
`transparent, process of obtaining the internet address of a
`digital camera, Where the camera accesses the internet via a
`dialup connection, and thus, has a changing internet address.
`The present invention provides a novel solution to the above
`requirements.
`SUMMARY OF THE INVENTION
`The present invention provides a method for making a
`digital camera and its internally stored images remotely
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`4
`accessible. The present invention enables the digital camera
`to be set to continuously take pictures of scenes/items of
`interest and alloW a user to access those pictures at any time.
`The present invention implements remote accessibility via
`the internet. This alloWs the both the user and the digital
`camera to communicate from virtually an unlimited number
`of locations. Hence, both the user and the camera are
`portable, requiring only an internet connection at any loca
`tion to implement remote access. The present invention also
`provides an efficient, user transparent, process of obtaining
`the internet address of a digital camera, Where the camera
`accesses the internet via a dial-up connection, and thus, has
`a changing internet address.
`A digital camera in accordance With the present invention
`does not require a separate, external computer system (e.g.,
`a personal computer) for internet connectivity, thus provid
`ing an inexpensive method for making remotely accessible
`digital cameras Widely available.
`In addition, a digital camera in accordance With the
`present invention is accessed via the Widely used, very
`familiar Web broWser. By functioning With typical, Widely
`used Web broWsers, the present invention provides a simple,
`intuitive, and familiar interface for accessing the digital
`camera’s functionality. Accordingly, the digital camera’s
`controls and functions are intuitively easy to utiliZe, Without
`requiring a extensive learning period for neW users. For
`example, a consumer purchasing a remotely accessible cam
`era is typically able to easily and immediately use the remote
`accessibility functions With minimal set-up.
`In one embodiment, the present invention comprises a
`method and system for implementing internet access to
`images stored in a digital camera including an imaging
`device and a display. The digital camera (e.g., or similar
`image capture unit) is used to capture images and store them
`Within its internal memory. The digital camera accesses a ID
`server via the internet and registers its identity and internet
`address With the Web server.
`A user Wishing to vieW the image (e.g., the camera’s
`oWner or any other user) subsequently enters the identity of
`the digital camera into his Web broWser (e.g., the camera’s
`URL). Using standard internet protocols, the ID server is
`queried With the URL of the digital camera and returns the
`digital camera’s current internet address. The user’s Web
`broWser then accesses the digital camera using the camera’s
`current internet address returned from the ID server, and
`vieWs Web pages hosted by the camera. This process of
`retrieving the current internet address of the digital camera
`from the ID server occurs transparently With respect to the
`user. The Web page provides access to the stored images
`Within the digital camera. By functioning With typical,
`Widely used Web broWsers, the digital camera of the present
`invention provides a simple, intuitive, and familiar interface
`for accessing the digital camera’s functionality. And by
`implementing remote accessibility via the internet, the
`present invention alloWs access to the digital camera from
`virtually an unlimited number of locations.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The present invention is illustrated by Way of example
`and not by Way of limitation, in the ?gures of the accom
`panying draWings in Which like reference numerals refer to
`similar elements and in Which:
`FIG. 1 shoWs a block diagram of a digital camera for use
`in accordance With the present invention.
`FIG. 2 shoWs a block diagram of an imaging device in
`accordance With one preferred embodiment of the present
`invention.
`
`0014
`
`

`
`US 6,567,122 B1
`
`5
`FIG. 3 shows a block diagram of a computer in accor
`dance With one preferred embodiment of the present inven
`tion.
`FIG. 4 shows a memory map of a DRAM in accordance
`With one embodiment of the present invention.
`FIG. 5A shoWs a top vieW diagram depicting the preferred
`hardWare components of the camera from FIG. 1.
`FIG. 5B shoWs a back vieW diagram depicting the pre
`ferred hardWare components of the camera from FIG. 1.
`FIG. 6 shoWs a block diagram of a live vieW generation
`process in accordance With one embodiment of the present
`invention.
`FIG. 7 shoWs a block diagram of a remote access system
`in accordance With one embodiment of the present inven
`tion.
`FIG. 8 shoWs a block diagram of the digital camera from
`FIG. 7 coupled to the internet via an internet service
`provider.
`FIG. 9 shoWs a diagram of the connectivity and applica
`tion softWare of a digital camera in accordance With one
`embodiment of the present invention.
`FIG. 10 shoWs a more detailed diagram of the domain
`name server from FIG. 7.
`FIG. 11 shoWs a How chart of a process in accordance
`With one embodiment of the present invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`In the folloWing detailed description of the present
`invention, numerous speci?c details are set forth in order to
`enable one of ordinary skill in the art to make and use the
`invention and is provided in the context of a patent appli
`cation and its requirements. Although the present invention
`Will be described in the context of a digital camera, various
`modi?cations to the preferred embodiment Will be readily
`apparent to those skilled in the art and the generic principles
`herein may be applied to other embodiments. That is, any
`image capture device Which displays images, icons and/or
`other items, could incorporate the features described here
`inbeloW and that device Would be Within the spirit and scope
`of the present invention. Thus, the present invention is not
`intended to be limited to the embodiment shoWn but is to be
`accorded the Widest scope consistent With the principles and
`features described herein.
`The present invention provides a method for making a
`digital camera and its internally stored images remotely
`accessible by hosting an internet Web site on the digital
`camera. The present invention enables the digital camera to
`be set to continuously take pictures of scenes/items of
`interest and alloW a user to access those pictures at any time.
`The present invention implements remote accessibility via
`the internet, thus alloWing the user to access the digital
`camera from virtually an unlimited number of locations.
`Adigital camera in accordance With the present invention
`does not require a separate, external computer system (e.g.,
`a personal computer) for internet connectivity, thus provid
`ing an inexpensive method for making remotely accessible
`digital cameras Widely available. In addition, a digital cam
`era in accordance With the present invention is accessed via
`the Widely used, very familiar Web broWser. By functioning
`With typical, Widely used Web broWsers, the present inven
`tion provides a simple, intuitive, and familiar interface for
`accessing the digital camera’s functionality. In so doing, the
`controls and functions of the digital camera are intuitively
`easy to utiliZe, and do not require an extensive learning
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`6
`period for neW users. These and other bene?ts of the present
`invention are described in greater detail beloW.
`Referring noW to FIG. 1, a block diagram of a digital
`camera 110 is shoWn for use in accordance With the present
`invention. Camera 110 preferably comprises an imaging
`device 114, a system bus 116 and a computer 118. Imaging
`device 114 is optically coupled to an object 112 and elec
`trically coupled via system bus 116 to computer 118. Once
`a photographer has focused imaging device 114 on object
`112 and, using a capture button or some other means,
`instructed camera 110 to capture an image of object 112,
`computer 118 commands imaging device 114 via system bus
`116 to capture raW image data representing object 112. The
`captured raW image data is transferred over system bus 116
`to computer 118 Which performs various image processing
`functions on the image data before storing it in its internal
`memory. System bus 116 also passes various status and
`control signals betWeen imaging device 114 and computer
`118.
`Referring noW to FIG. 2, a block diagram of one preferred
`embodiment of imaging device 114 is shoWn. Imaging
`device 114 typically comprises a lens 220 having an iris, a
`?lter 222, an image sensor 224, a timing generator 226, an
`analog signal processor (ASP) 228, an analog-to-digital
`(A/D) converter 230, an interface 232, and one or more
`motors 234.
`In operation, imaging device 114 captures an image of
`object 112 via re?ected light impacting image sensor 224
`along optical path 236. Image sensor 224, Which is typically
`a charged coupled device (CCD), responsively generates a
`set of raW image data in CCD format representing the
`captured image 112. The raW image data is then routed
`through ASP 228, A/D converter 230 and interface 232.
`Interface 232 has outputs for controlling ASP 228, motors
`234 and timing generator 226. From interface 232, the raW
`image data passes over system bus 116 to computer 118.
`Referring noW to FIG. 3, a block diagram of one preferred
`embodiment for computer. 118 is shoWn. System bus 116
`provides connection paths betWeen imaging device 114, an
`optional poWer manager 342, central processing unit (CPU)
`344, dynamic random-access memory (DRAM) 346, input/
`output interface (I/O) 348, non-volatile memory 350, and
`buffers/connector 352. Removable memory 354 connects to
`system bus 116 via buffers/connector. 352. Alternately, cam
`era 110 may be implemented Without removable memory
`354 or buffers/connector 352.
`PoWer manager 342 communicates via line 366 With
`poWer supply 356 and coordinates poWer management
`operations for camera 110. CPU 344 typically includes a
`conventional processor device for controlling the operation
`of camera 110. In the preferred embodiment, CPU 344 is
`capable of concurrently running multiple softWare routines
`to control the various processes of camera 110.Within a
`multithreaded environment. DRAM 346 is a contiguous
`block of dynamic memory Which may be selectively allo
`cated to various storage functions. LCD controller 390
`accesses DRAM 346 and transfers processed image data to
`LCD screen 402 for display.
`I/O 348 is an interface device alloWing communications
`to and from computer. For example, I/O 348 permits an
`external host computer (not shoWn) to connect to and
`communicate With computer 118. I/O 348 also interfaces
`With a plurality of buttons and/or dials 404, and an optional
`status LCD 406, Which in addition to the LCD screen 402,
`are the hardWare elements of the camera’s user interface
`408.
`
`0015
`
`

`
`US 6,567,122 B1
`
`7
`Non-volatile memory 350, Which may typically comprise
`a conventional read-only memory or ?ash memory, stores a
`set of computer-readable program instructions to control the
`operation of camera 110. Removable memory 354 serves as
`an additional image data storage area and is preferably a
`non-volatile device, readily removable and replaceable by a
`camera 110 user via buffers/connector 352. Thus, a user Who
`possesses several removable memories 354 may replace a
`full removable memory 354 With an empty removable
`memory 354 to effectively expand the picture-taking capac
`ity of camera 110. In the preferred embodiment of the
`present invention, removable memory 354 is typically
`implemented using a ?ash disk. PoWer supply 356 supplies
`operating poWer to the various components of camera 110.
`In the preferred embodiment, poWer supply 356 provides
`operating poWer to a main poWer bus 362 and also to a
`secondary poWer bus 364. The main poWer bus 362 provides
`poWer to imaging device 114, I/O 348, non-volatile memory
`350 and removable memory 354. The secondary poWer bus
`364 provides poWer to poWer manager 342, CPU 344 and
`DRAM 346.
`PoWer supply 356 is connected to main batteries 358 and
`also to backup batteries 360. In the preferred embodiment,
`a camera 110 user may also connect poWer supply 356 to an
`external poWer source. During normal operation of poWer
`supply 356, the main batteries 358 provide operating poWer
`to poWer supply 356 Which then provides the operating
`poWer to camera 110 via both main poWer bus 362 and
`secondary poWer bus 364. During a poWer failure mode in
`Which the main batteries 358 have failed (When their output
`voltage has fallen beloW a minimum operational voltage
`level) the backup batteries 360 provide operating poWer to
`poWer supply 356 Which then provides the operating poWer
`only to the secondary poWer bus 364 of camera 110.
`Referring noW to FIG. 4, one embodiment of dynamic
`random-access-memory (DRAM) 346 is shoWn. In the pre
`ferred embodiment, DRAM 346 includes RAM disk 532, a
`system area 534, and Working memory 530.
`RAM disk 532 is a memory area used for storing raW and
`compressed image data and typically is organiZed in a
`“sectored” format similar to that of conventional hard disk
`drives. In the preferred embodiment, RAM disk 532 uses a
`Well-knoWn and standardiZed ?le system to permit external
`host computer systems, via I/ O 348, to readily recogniZe and
`access the data stored on RAM disk 532. System area 534
`typically stores data regarding system errors (for example,
`Why a system shutdoWn occurred) for use by CPU 344 upon
`a restart of computer 118.
`Working memory 530 includes various stacks, data struc
`tures and variables used by CPU 344 While executing the
`softWare routines used Within computer 118. Working
`memory 530 also includes several input buffers 538 for
`temporarily storing sets of raW image data received from
`imaging device 114, and a frame buffer 536 for storing data
`for display on the LCD screen 402. In a preferred
`embodiment, each input buffer 538 and the frame buffer 536
`are split into tWo separate buffers (shoWn by the dashed
`lines) to improve the display speed of the digital camera and
`to prevent the tearing of the image in the display 402.
`FIGS. 5A and 5B are diagrams depicting the preferred
`hardWare components of the camera’s 110 user interface
`408. FIG. 5A is back vieW of the camera 110 shoWing the
`LCD screen 402, a four-Way navigation control button 409,
`an overlay button 412, a menu button 414, and a set of
`programmable soft keys 416. FIG. 5B is a top vieW of the
`camera 110 shoWing a shutter button 418, and a mode dial
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`8
`420. The camera may optionally include status LCD 406,
`status LCD scroll and select buttons 422 and 424, a sound
`record button 426, and Zoom-in, Zoom-out buttons 426a and
`426b.
`In the present embodiment, the digital camera is provided
`With several different operating modes for supporting vari
`ous camera functions. In capture mode, the camera 100
`supports the actions of preparing to capture an image, and
`capturing an image through the use of either the LCD screen
`402 alone or the status LCD 406 With the aid of an optional
`optical vieW?nder (not sh