l||||||||||||||||||||||||||||||||||||ll ll|||||||||l|||||||||||||||||||||||
`
`USi){l656'i"122B1
`
`(12) Ulllted States Patent
`Anderson et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 6,567,122 B1
`May 20, 2003
`
`(54) Ml+:'[‘H0l) AND sYS’I‘l£M FOR HOSTING AN
`IIsITIgRNI:;I‘ WEB SITE on A DIGITAL
`CAMERA
`
`S/2001 Ward et al.
`200110010543 Al *
`812001 Bnho, II
`20tJ1,r(_tti149 10 A1 *
`2t'JUl,-'l.ll'J5l'l".-'11 Al
`" 12,-'2U[]I] Karuhe et al.
`
`
`
`343207.90
`7113021?
`3481220
`
`(75)
`
`Inventors: Eric C. Anderson, San Jose, CA (US);
`Mie|1nelA. Ramirez, Palo Alto, CA
`(US); Stephen G. Sullivan, Mountain
`VIEW’ CA (US)
`
`EP
`'5"
`W0
`W0
`
`FOREIGN PATENT DOCUMENTS
`[1 821 522
`211998
`‘l§35‘lll
`3”993
`W0 9{JiU21|CIIEI
`1.11996
`W0 97.-’38.'J1|'.i
`Iii.-"I99"?
`
`
`
`Ilr14Nl5i232
`_
`I-Il]4Ni’:\.92.§2
`II04lJl2.-'38
`
`OTHER IJUBLICATIONS
`
`l’A'l'NEWS: What isn't obvious in the patent world‘? E—Mail
`correspondence.
`
`‘ “ml '39 “’‘'‘‘“‘i“‘~'’
`Prirrtary Examirter—Wendy R. Gather
`Assfismm E.rmi:iner—-Lin Ye
`(74) Airorrifitfi Age:-it, or Ftrm—Sawyer Law Group 11.!’
`5
`( 7)
`ABSTRACT
`The present invention comprises a method and system for
`implementing intemet access to images stored in a digital
`image capture unit
`including an imaging device and a
`display. The image capture unit (e.g., a digital camera} is
`used to capture images and store them within its internal
`menmry. The image capture unit accesses :1 ID server via the
`internel and registers its identity and interact address with
`the web server. A user subsequently accesses the image
`capture unit by entering the 1(l(.l‘lllly ot the tntagceapture
`uml ll']l(l his web browser. The web browser, using standard
`imernet protocols.
`then queries the ID server with the
`identity of the image capture unit and retrieves the interaet
`address. The internet aclclress is subsequently used to access
`a web page hosted by the image capture unit and display the
`web page to the user. The web page provides access to the
`stored images within the image capture unit
`'
`'
`
`22 Claims, 11 Drawing Sheets
`
`(73)
`
`/\ssignee:
`
`ll’/\C Acquisition Subsidiary I,
`Peterborough, NH (US)
`
`( ‘ ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`u.s.c. 154(1)) by 0 days.
`
`(21) App}. No; 09.3044-,644
`(22
`Filed:
`Mar. 18, 1998
`(51)
`Int. Cl.’
`
`(52) U.S. Cl.
`
`H04N 51232; 110414 9104;
`H04-N 7114; G051’ 15316
`348,i21l.3; 34-8i’207.99;
`348114.01; 7091201; "E09121?
`348.3552, 20?,
`(58) Field of Search
`348,314, 14.03, 207.99, 207.1, 207.11, 211.3,
`14.01; 709K201, 217, 219
`
`References Cited
`Us. PM,EN,I_ DOCUMENTS
`5,633,078 A *
`511097 Panllski (:1 at.
`3,649,186 A *
`711%? I-‘erguson
`5__<.J9<.i,2t'J‘:' A *
`l2fl‘J‘J‘.»‘ Rodriguez el al-
`5.-0'2.-U83 A * U200“ Li “I “L
`5-‘J3-W33} *“
`*
`3’2”“'” NW3"-‘“ °‘ 3"
`6"l63’333 A *
`lyznm Bamclough
`6,205,485 B1 *
`3.’2U0l Kikinis
`0,240,430 B1 “‘
`619.001 Peters et al.
`0,353,848 B1 *
`3.12002 Morris
`
`3481232
`. vsrmri
`-- 343.914
`709*?”-J
`70°73‘-‘E
`" 34””
`'i'[}9r'23l
`3433214
`111912113
`
`
`
`(56)
`
`!lI!1
`_
`““::"::=.:‘.'.r.:.",1::'..“.:’;‘“I~’
`IIDE‘
`
`iloéh In
`wIIcd'.:'r
`
`um dig‘
`:mn-m
`Inn hrvn
`:I:il.m|'u-Ni
`Irliunlusar Llm dqiull inmun
`l‘-05
`wiIJ|a[Iprnflri :
`mn:-.u-.a'nty min:
`tun
`
`
`
`Nohly nu apprnprim II!
`lenu by
`nllvlitg rim
`mu iligiuzt
`en in on line
`
`..—J
`
`:LE-snrule Ill Ir|II'IIirIl:'urI
`H1\II'I:m mllhn Iltcdigunl
`rlrntrn
`
`1'
`
`Aux:-an IHI: ID mm with .
`mm: WPII brow!
`5 I
`rll\r§
`{VII
`u|'l
`on
`tamer:
`
`in
`..—J
`
`j.
`
`R:=IwIl 1-a'igiI.nii:nmier.I
`nu Ihc
`browser until‘
`an inwrm-. nddrru
`
`,...J
`
`7?.
`aim-u liln‘ ur'..§.|:u ms.
`da,,_-in-. nmnl emu \I1'l.I
`pup tzmnl by the dntitnl
`ear...-.
`
`nu,
`.-
`
`1”"
`
`I 105
`
`
`
` ‘
`
`0001
`0001
`
`Apple/Twitter
`Apple/Twitter
`Ex. 1019
`Ex. 1019
`IPR2 of U.S. Pat. No. 8,612,515
`IPR2 of U.S. Pat. No. 8,612,515
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 1 of 11
`
`US 6,567,122 B1
`
`FIG.1
`
`s...
`Q34-:
`
`5C
`
`L
`So
`0
`
`112
`
`0002
`0002
`
`

`
`u
`
`...I-H84....-3P
`
`V.3M
`
`1....
`
`m(II20.
`
`11__...l0
`
`.1B22ll)765,6SU
`
`Cm«S
`
`
`
`_§.m.mmhEdwea.m«EHSgam
`
`..h...H3.B>=oOhommmoohmnomnmmwou.a.t$_.EH
`
`
`..3=.m
`
`0003
`0003
`
`N.UHm
`
`mfififi.
`
`uoumnmcmmv
`
`
`
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 3 of 1]
`
`US 6,567,122 B1
`
`EEOum.
`
`
`
`ammuum-maywowwow3 mcofismmagnum
`
`
`
`m3>mQmcmmmfim
`
`Ea
`
`mmmmmm
`
`mmflmfimm
`
`asxomm
`
`mmimflmm
`
`..m..>o.m
`
`mfimbocuom
`
`Eofimfi‘——uwmmnmi—rI@252HE
`
`0004
`0004
`
`Q04
`
`5:95:00
`
`o:
`
`
`
`
`
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 4 of 11
`
`US 6,567,122 B1
`
`
`
`SYSTEM AREA
`
`
`
`534
`
`FIG. 4
`
`0005
`0005
`
`WORKING MEMORY
`
`530
`
`F.EA_M_E B;U_E‘F_EflS_________ _ _.
`
`IIiP.T_J’;B_U1"_FER_1_________ _ _
`
`I1S_P_UT_B_UF_‘FEB_2_________ _ _
`
`IIEPL-T"l;BlJ'§‘_F;E3_R_N_________ __ __
`
`532
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 5 of 11
`
`US 6,567,122 B1
`
`418
`
`0006
`0006
`
`

`
` U.S.Patent
`
`May20,2003
`
`NNN00%wfimummumDOWEm;mid£.E:Hmung:Bummmwfia
`
`
`
`mumhdmnofimnwcowmhummsmBream
`
`Sheet 6 of 11
`
`US 6,567,122 B1
`
`w.wE
`
`ooo7
`0007
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 7 of 11
`
`US 6,567,122 B1
`
`
`
`DIAL UP CONNECTION
`
`DIAL UP CONNECTION
`
`ISP
`
`l1_Q
`
`ISP
`
`E
`
`ID Server
`
`.7_5Q
`
`FIG. 7
`
`0008
`0008
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 8 of 11
`
`US 6,567,122 B1
`
`CAMERA
`
`LOCALLOOP
`
`HE
`flfl T1
`
`vvvvvvvvvvvv
`
`MOm%HMNK
`
`FIG. 8
`
`0009
`0009
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 9 of 11
`
`US 6,567,122 B1
`
`910
`
`APPLICATIONS
`
`fig
`
`web server
`
`motion detection
`
`aim control
`
`OPERATING
`
`
`SYSTEM 9_g_4
`
`
`
`
` PROTOCOL STACK
`E
`
`COMMUNICATIONS
`
`HARDWARE 902
`
`HTTP
`
`HTML
`
`Requests
`
`files
`
`FIG. 9
`
`0010
`0010
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 10 of 11
`
`US 6,567,122 B1
`
`REGISTRY JQL11
`
`
`
`CAMERA
`
`;_Q_0_ ADDRESS
`
`1092, USER INFO 10Qfl
`
`
`
`
`
`FIG. 10
`
`0011
`0011
`
`

`
`U.S. Patent
`
`May 20, 2003
`
`Sheet 11 of 11
`
`US 6,567,122 B1
`
`Hill!
`
`Couple a digital camera to
`
`the telephone system
`
`1101
`
`1102
`
`1103
`
`
`
`Determine whether
`the digital camera
`has been
`initialized
`
`
`
`Initialize the digital camera
`with appropriate
`connectivity information
`
`
`1104
`
`
`
`Notify the appropriate ID
`server by registering that
`the digital camera is on—line
`
`Execute an application
`Program within the digital
`camera
`
`1105
`
`of the digital camera 1 107
`
`1109
`
`_
`C0“:-"me
`
`Access the ID server with a
`user's web brewer to
`retrieve the internet address
`
`1105
`
`Access the digital camera
`via the web browser using
`the internet address
`
`1103
`
`FIG. 11
`
`
`
`Access the images ofthe
`digital camera via a web
`
`page hosted by the digital
`camera
`
`
`
`
`0012
`0012
`
`

`
`US 6,567,122 B1
`
`1
`METHOI) AND SYSTEM FOR HOSTING AN
`INTERNET WEB SITE ON A DIGITAI.
`CAMERA
`
`FIELD OF THE INVENTION
`
`The field of the present invention pertains to digital image
`capture devices. More particularly,
`the present
`invention
`relates to a method and system for using the electronic
`systems within a digital camera with the internet.
`BACKGROUND OF THE INVENTION
`
`Modern digital cameras for taking pictures of scenes and
`the like typically include an imaging device which is con-
`trolled by a computer running a software program. When an
`image is captured, the imaging device is exposed to light and
`generates raw image data representing the image. The raw
`image data is typically stored in a single image bul.l'er where
`it is then processed and compressed by the processor. Many
`types of compression schemes are used to compress the
`im age data, with the joint photographic expert group (JPEG)
`standard being the most popular. After the processor pro-
`cesses and compresses the raw image data into JPEG image
`files,
`the processor stores the JPEG image files into an
`internal memory or on an external memory card.
`Some digital cameras are also equipped with a liquid-
`crystal display (LCD) or other type of display screen on the
`back of the camera. Through the use of the LCD,
`the
`processor can cause the digital camera to operate in one of
`two modes, play and record, although some cameras only
`have a record mode. In play mode, the LCD is used as a
`playback screen for allowing the user to review previously
`captured images either individually or in arrays of four, nine,
`or sixteen images. In record mode, the LCD is used as a
`viewfinder in which the user may view an object or socne
`before taking a picture.
`Besides the LCD, digital camera user interfaces also
`include a number of buttons or switches for setting the
`camera into one of the two modes and for navigating
`between images in play mode. For example, most digital
`cameras include two buttons labeled "-'- ynd “+” that enable
`a user to navigate or scroll through captured images. For
`example. if the user is reviewing images individually, mean-
`ing that single images are displayed full-sized in the LCD,
`pressing one of navigation buttons causes the currently
`displayed image to be replaced by the next image.
`It should be noted that a digital camera has no "film", and
`as such, there is no incremental cost of taking and storing
`pictures. Within the confines of memory, the cost taking and
`storing each additional picture is insignificant. For a given
`memory size, it is possible to take an unlimited number of
`pictures, wherein the most recent picture replaces the earliest
`picture, for virtually zero incremental cost. Accordingly, this
`advantage is best realized when the camera is used as much
`as possible, taking pictures of practically anything of inter-
`ESI.
`
`One way to best utilize these unique attributes is to make
`the digital camera and its internally stored images remotely
`accessible. If the pictures are remotely accessible, the cam-
`era could be set to continuously take pictures of scenesfitcms
`of interest. Ideally, a user would be able to access those
`pictures at any time. The user would be able to use a widely
`available communications medium to access the camera
`from virtually an unlimited number of locations.
`The emergence of the intemet as a distributed, widely
`accessible communications medium provides a convenient
`
`ill
`
`15
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`avenue for implementing remote accessibility. Providing
`remote accessibility via the internet leverages the fact that
`the internet is becoming increasingly familiar to increasing
`numbers of people. Many users have become accustomed to
`retrieving information from remotely located systems via the
`intcrnet. There are many and varied applications which
`presently use the internet to provide remote access or remote
`connectivity. Internet
`telephony is one such application,
`such as,
`for example, Microsoft's NetMeeting and
`Netscape’s Cr:-ol'I‘alk.
`NetMeeting and CoolTal.k are both real-time desktop
`audio conferencing and data collaboration software appli-
`cations specifically designed to use the internet as their
`communications medium. Both software applications allow
`a "local" user to place a ''call'' to a "remote" user located
`anywhere in the world. With both Netlvleeting and Cool'l‘alk,
`the software application is hosted on a personal computer at
`the user’s location and on a personal computer at the remote
`us-.er’s location. Both NetMeeting and CoolTallc require a
`SLIP (Serial Line Internet Protocol} or PPP (Point-to-Point
`Protocol] account where internet access is via a dial-up
`modem, where the user, as is typical, accesses the internet
`through their respective ISP (internet service provider). Both
`NetMeeting and Cool'l'alk require personal computers [or
`the necessary resources for running the applications (e.g.,
`processing power, memory, communications hardware,
`etc.). In addition, both NetMecting and Cool'I'alk require the
`one user to input an lP{InterI1et Protocol) address for the
`other user in order to establish communication between
`
`them. To place a call, for example. the local user enters the
`IP address of the remote user in an appropriate held of the
`software application and subsequently initiates the call (eg.
`by clicking a graphic icon on the personal computer’s
`display), which in turn, establishes communication between
`the users.
`
`To facilitate the process of obtaining appropriate internet
`addresses, Cool'l'a1k, for example, allows on—linc users to list
`their
`respective IP addresses with a proprietary central
`Cool’l‘alk server. This allows a user to obtain a
`list of
`currently on-line users to whom communication can be
`established. Upon locating the desired remote user in the
`web server maintained internet address list, the local user
`places the call.
`In this manner, the proprietary central CoolTa|k server
`maintains a user viewable, user updated, "address book" in
`which users list their respective internet addresses and in
`which they search for the internet addresses of others with
`whom they wish to communicate. However, as described
`above, both NetMeeting and Cool'l"alk require active user
`input,
`in that each require the user to input his current
`internet address and in that each require the user to search
`the address book for the internet address of the individual to
`be contacted.
`'l‘his can be quite problematic in the case
`where users obtain access to the internet via dial-up
`connections, and hence, have dillerent intcrnet addresses
`each time their respective dial-up connections are estab-
`lished.
`
`In a manner similar to internet telephony, internet desktop
`video conferencing is another application which uses the
`internet as its communications medium. One such
`application, for example,
`is CU-SeeMe, by White Pine.
`CU-SeeMe provides real time video conferencing between
`two or more users. As with NetMeeting and (‘.oolTalk,
`CU-SceMe is a software application which runs on both the
`local user's personal computer and the remote user's per-
`sonal computcr. The personal computers provide the
`resources for running the application. As with NetMceting
`
`0013
`0013
`
`

`
`US 6,567,122 B1
`
`3
`and CoolTalk, C U-SeeMe requires the local user to enter the
`II’ address of the remote user. CU-SeeMe also facilitates this
`process by allowing on-line users to list their respective IP
`addresses with a proprietary oentral server such that
`the
`addresses can be easily indexed and searched.
`is
`Another example of remote access via the internet
`status queries of remote devices using the internet as the
`communications medium. A typical prior an application
`involves interfacing a
`remote device with a computer
`system, and providing access to the computer system via the
`internet. For example, a vending machine can be remotely
`accessed to determine its status (e.g., the number of sales
`made, whether the machine needs refills, whether the
`machine needs maintenance, etc.). The machine is appro-
`priately equipped with sensors, switches, and the like, which
`are in turn, interfaced to a computer system using a software
`driver. The computer system is coupled to the intemet and
`interfaces with the machine through the driver, making the
`relevant infonnation available over the internet using web
`server software. Ilence, any interested user (e.g., the vending
`machine service company) is able to remotely ascertain the
`status of the machine via the internet.
`The problem with the above described prior art applica-
`tions is that access to the internet and communication
`thereon requires a separate host computer system (e.g., a
`personal computer). Each of the above described applica- _
`tions (CoolTal.k, Nell‘/Ieeting, and the vending machine
`examples) require a computer system on both sides of the
`internet connection. The two computer systems provide the
`computational resources to host
`the respective software
`application, the internet access software, and any necessary
`device drivers. Because of this, among other reasons, the
`above applications are not easily transferred to the realm of
`easy-to—usc, intuitive, consumer electronic type devices such
`as digital cameras. The separate computer systems are
`expensive.
`Another problem is the fact that the above applications
`require the user to know the internet address of the person
`(or device,
`in the vending machine example) being con-
`tacted. The intemet telephony applications (e.g., C'oolTall-1)
`often employ a user viewable, user updated, address book to
`facilitate the process of locating and obtaining the correct
`internet address, however, they require active user input.
`This is dilficult in the case where users obtain access to the
`internet via dial-up connections, and thus, have changing
`intemet addresses.
`
`ill
`
`15
`
`30
`
`35
`
`40
`
`In addition, both Cool'l‘alk and NetMecting operate on top
`of the computer's operating system, which is notoriously
`diflicult and obtuse to novice users.
`
`Thus, what is required is an inexpensive method imple-
`menting remote access via the internet for digital cameras.
`If internet remote accessibility is relatively inexpensive, a
`large installed base of remotely accessible digital cameras
`wiil rapidly develop. This will give rise to many different
`applications and enhancements being developed, which in
`turn, will
`lead to even greater demand for, and use of,
`remotely accessible digital cameras. What is further required
`is an intuitive, easy to use interface for presenting the digital
`camera’s functionality and capabilities to users.
`Additionally, what
`is
`required is an efiicient, user
`transparent, process of obtaining the intemet address of a
`digital camera, where the camera accesses the intemet via a
`dialu p connection, and thus, has a changing internet address.
`The present invention provides a novel solution to the above
`requirements.
`SUMMARY 01'’ THE. INVENTION
`
`The present invention provides a method for making a
`digital camera and its internally stored images remotely
`
`45
`
`50
`
`55
`
`60
`
`65
`
`0014
`0014
`
`4
`accessible. The present invention enables the digital camera
`to be set to continuously take pictures of scenesiitems of
`interest and allow a user to access those pictures at any time.
`The present invention implements remote accessibility via
`the internet. This allows the both the user and the digital
`camera to communicate from virtually an unlimited number
`of locations.
`I-Ience, both the user and the camera are
`portable, requiring only an internet connection at any loca-
`tion to implement remote access. The present invention also
`provides an eflicient, user transparent, process of obtaining
`the internet address of a digital camera, where the camera
`accesses the internet via a dial-up connection, and thus, has
`a changing internet address.
`Adigital camera in accordance with the present invention
`does not require a separate, external computer system (eg,
`a personal computer) for intemet connectivity, thus provid-
`ing an inexpensive method for making remotely accessible
`digital cameras widely available.
`In addition, a digital camera in accordance with the
`present
`invention is accessed via the widely used, very
`familiar web browser. By functioning with typical, widely
`used web browsers, the present invention provides a simple,
`intuitive, and familiar interface for accessing the digital
`camera’s functionality. Accordingly,
`the digital camera’s
`controls and functions are intuitively easy to utilize, without
`requiring a extensive learning period for new users. For
`example, a consumer purchasing a remotely accessible cam-
`era is typically able to easily and immediately use the remote
`accessibility functions with minimal set-up.
`In one embodiment, the present invention comprises a
`method and system for implementing internet access to
`images stored in a digital camera including an imaging
`device and a display. The digital camera (e.g., or similar
`image capture unit) is used to capture images and store them
`within its internal memory. The digital camera accesses a ID
`server via the intemet and registers its identity and intemet
`address with the web server.
`
`A user wishing to view the image {e.g., the camera’s
`owner or any other user} subsequently enters the identity of
`the digital camera into his web browser (e.g., the camera’s
`URL). Using standard intemet Protocols, the ID server is
`queried with the URI. of the digital camera and returns the
`digital camera’.-3 current
`internet address. The user’s web
`browmr then accesses the digital camera using the camera’s
`current
`intemet address returned from the [D server, and
`views web pages hosted by the camera. This process of
`retrieving the current intemet address of the digital camera
`from the II) server occurs transparently with respect to the
`user. The web page provides access to the stored images
`within the digital camera. By functioning with typical,
`widely used web browsers, the digital camera of the present
`invention provides a simple, intuitive, and familiar interface
`for accessing the digital camera's functionality. And by
`implementing remote accessibility via the internet,
`the
`present invention allows access to the digital camera from
`virtually an unlimited number of locations.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`invention is illustrated by way of example
`The present
`and not by way of limitation, in the figures of the accom-
`panying drawings in which like reference numerals refer to
`similar elements and in which:
`
`FIG. 1 shows a block diagram of a digital camera for use
`in accordance with the present invention.
`FIG. 2 shows a block diagram of an imaging device in
`accordance with one preferred embodiment of the present
`invention.
`
`

`
`US 6,567,122 B1
`
`5
`FIG. 3 shows a block diagram of a computer in accor-
`dance with one preferred embodiment of the present inven-
`lion.
`
`FIG. 4 shows a memory map of a DRAM in accordance
`with one embodiment of the present invention.
`FIG. 5Ashows atop view diagram depicting the preferred
`hardware components of the camera from FIG. 1.
`FIG. 5B shows a back view diagram depicting the pre-
`ferred hardware components of the camera from FIG. 1.
`FIG. 6 shows a block diagram of a live view generation
`process in accordance with one embodiment of the present
`invention.
`
`FIG. 7 shows a block diagram of a remote access system
`in accordance with one embodiment of the present inven-
`tion.
`
`FIG. 8 shows a block diagram of the digital camera from
`FIG. 7 coupled to the internet via an internet service
`provider.
`FIG. 9 shows a diagram of the connectivity and applica-
`tion software of a digital camera in accordance with one
`embodiment of the present invention.
`FIG. 10 shows a more detailed diagram of the domain
`name server from FIG. 7.
`
`FIG. 11 shows a liow chart of a process in accordance
`with one embodiment of the present invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`In the following detailed description of the present
`invention, numerous specific details are set forth in order to
`enable one of ordinary skill in the art to make and use the
`invention and is provided in the context of a patent appli-
`cation and its requirements. Although the present invention
`will be described in the context of a digital camera, various
`modifications to the preferred embodiment will be readily
`apparent to those skilled in the art and the generic principles
`herein may be applied to other embodiments. That is. any
`image capture device which displays images, icons andtor
`other items, could incorporate the features described here-
`inbelow and that device would be within the spirit and scope
`of the present invention. Thus, the present invention is not
`intended to be limited to the embodiment shown but is to be
`accorded the widest scope consistent with the principles and
`features described herein.
`
`The present invention provides a method for making a
`digital camera and its internally stored images remotely
`accessible by hosting an internet web site on the digital
`camera. The present invention enables the digital camera to
`be set
`to continuously take pictures of scenestiiterns of
`interest and allow a user to accem those pictures at any time.
`The present invention implements remote accessibility via
`the intemet, thus allowing the user to access the digital
`camera from virtually an unlimited number of locations.
`A digital camera in accordance with the present invention
`does not require a separate, external computer system {e.g.,
`a personal computer} for internet connectivity, thus provid-
`ing an inexpensive method for making remotely accessible
`digital cameras widely available. In addition, a digital cam-
`era in accordance with the present invention is accessed via
`the widely used, very familiar web browser. By functioning
`with typical, widely used web browsers. the present inven-
`tion provides a simple, intuitive, and familiar interface for
`accessing the digital camera's functionality. In so doing, the
`controls and functions of the digital camera are intuitively
`easy to utilize. and do not require an extensive learning
`
`6
`period for new users. These and other benefits of the present
`invention are described in greater detail below.
`Referring now to FIG. 1, a block diagram of a digital
`camera 110 is shown for use in accordance with the present
`invention. Camera 110 preferably comprises an imaging
`device 114, a system bus 116 and a computer 118. Imaging
`device 114 is optically coupled to an object I12 and elec-
`trically coupled via system bus 116 to computer 118. Once
`a photographer has focused imaging device 114 on object
`112 and. using a capture button or some other means.
`instructed camera 110 to capture an image of object 112,
`computer 118 commands imaging device 114 via system bus
`116 to capture raw image data representing object 112. The
`captured raw image data is transferred over system bus 116
`to computer 118 which performs various image processing
`functions on the image data before storing it in its iotemal
`memory. System bus 116 also passes various status and
`control signals between imaging device 114 and computer
`118.
`
`Referring now to FIG. 2, a block diagram ofone preferred
`embodiment of imaging device 114 is shown.
`Imaging
`device 114 typically comprises a lens 220 having an iris, a
`filter 222, an image sensor 224, a timing generator 226, an
`analog signal processor (ASP) 228, an analog-to-digital
`(AID) converter 230, an interface 232, and one or more
`motors 234.
`
`imaging device 114 captures an image of
`In operation,
`object 112 via rellected light impacting image sensor 224
`along optical path 236. Image sensor 224, which is typically
`a charged coupled device {CCD}, responsive ly generates a
`set of raw image data in CCD format
`representing the
`captured image 112. The raw image data is then routed
`through ASP 228, ND converter 230 and interface 232.
`Interface 232 has outputs for controlling ASP 228, motors
`234 and timing generator 226. From interface 232, the raw
`image data passes over system bus 116 to computer 118.
`Referring now to FIG. 3, a block diagram ofone preferred
`embodiment for computer. 118 is shown. System bus 116
`provides connection paths between imaging device 114, an
`optional power manager 342, central processing unit (CPU)
`344, dynamic random-access memory (DRAM) 346, input!
`output interface (H0) 348, non-volatile memory 350, and
`buffersiconncctor 352. Removable memory 354 connects to
`system bus 116 via huffersfconnector. 352. Alternately, cam-
`era 1l0 may be implemented without removable memory
`354 or bulfersfconnector 352.
`
`Power manager 342 communicates via line 366 with
`power supply 356 and coordinates power management
`operations for camera Ill]. CPU 344 typically includes a
`conventional processor device for controlling the operation
`of camera 110. In the preferred embodiment, CPU 344 is
`capable of concurrently running multiple software routines
`to control
`the various processes of camera llllwithin a
`multithreaded environment. DRAM 346 is a contiguous
`block of dynamic memory which may be selectively allo-
`cated to various storage functions. LCD controller 390
`accesses DRAM 346 and transfers processed image data to
`LCD screen 402 for display.
`IEO 348 is an interface device allowing communications
`to and from computer. For example, IEO 348 permits an
`external host computer
`(not shown)
`to connect
`to and
`communicate with computer 118.
`IEO 348 also interfaces
`with a plurality of buttons andlor dials 404, and an optional
`status LC D 406, which in addition to the LCD screen 402,
`are the hardware elements of the camera's user interface
`408.
`
`Ill
`
`15
`
`'
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`0015
`0015
`
`

`
`US 6,567,122 B1
`
`7
`Non-volatile memory 350, which may typically comprise
`a conventional read-only memory or flash memory, stores a
`set of computer-readable program instructions to control the
`operation of camera 110. Removable memory 354 serves as
`an additional image data storage area and is preferably a
`non-volatile device, readily removable and replaceable by a
`camera 110 user via bu tierstlconnector 352. 'I'hu.s, a user who
`possesses several removable memories 354 may replace a
`full
`removable memory 354 with an empty removable
`memory 354 to effectively expand the picture-taking capac-
`ity of camera 110.
`In the preferred embodiment of the
`present
`invention,
`removable memory 354 is typically
`implemented using a flash disk. Power supply 356 supplies
`operating power to the various components of camera 110.
`In the preferred embodiment, power supply 356 provides
`operating power to a main power bus 362 and also to a
`secondary power bus 364. The main power bus 362 provides
`power to imaging device 114, I10 348, non-volatile memory
`350 and removable memory 354. The secondary power bus
`364 provides power to power manager 342, CPU 344 and -
`DRAM 346.
`
`III
`
`15
`
`8
`420. The camera may optionally include status LCD 4-06,
`status LCD scroll and select buttons 42 and 424, a sound
`record button 426, and zoom-in, zoom-out buttons 426:: and
`4265.
`
`In the present embodiment, the digital camera is provided
`with several different operating modes for supporting vari-
`ous camera functions. In capture mode,
`the camera 100
`supports the actions of preparing to capture an image, and
`capturing an image through the use ofeither the LCD screen
`402 alone or the status LCD 406 with the aid of an optional
`optical viewfinder (not shown). In review mode, the camera
`100 supports the actions of reviewing camera contents,
`editing and sorting images, and printing and transferring
`images. In play mode, the camera 100 allows the user to
`view scrcen—sized images in the LCD screen 402 in the
`orientation that
`the image was captured. Play mode also
`allows the user to hear recorded sound associated to a
`displayed image, and to play back sequential groupings of
`images, which may comprise time lapse, slide show, and
`burst image images. The user preferably switches between
`the capture, review, and play modes, using the mode dial
`420. When the camera is placed into a particular mode, that
`modc’s default screen appears in the LCD screen 402 in
`which a set of mode-specific items, such as images, icons.
`and text, are displayed.Although the digital camera includes
`multiple operating modes, the mode relevant to this descrip-
`tion is capture (record) mode.
`Referring now to FIG. 6, in a preferred embodiment, the
`processing is perfonned by a live view generation process
`612, which is stored in non—volatilc memory 350 and
`executed on C PU 344. However, the image processing can
`also be implemented using hardware. During the execution
`of the live view generation process 612, the CPU 344- takes
`the raw image data from the input buffers 538 and performs
`image processing and color space conversion. Image pro-
`cessing steps can include, for example, gamma correction,
`white balance, and color correction. The conversion process
`performs gamma correction and converts the raw CCD data
`into either a RGB or YCC color format which is compatible
`with the LCD screen 402. (RGB is an abbreviation for Red,
`Green, Blue, and ‘(CC is an abbreviation for Luminance,
`Chrominance-red and Chrominancc- blue). After converting
`the data to YCC‘, the YCC image data is stored in the frame
`buffer 536. The contents of the frame bulTer 536 are then
`displayed onto the LCD screen 402.Althcugh FIG. 6 shows
`the YCC data being displayed on LCD 402,
`it should be
`appreciated that
`the present
`invention is not
`limited to
`functioning only with LCD equipped digital cameras.
`Referring now to FIG. 7, a block diagram of a remote
`access system 700 in accordance with one embodiment of
`the present invention is shown. System 700 includes camera
`100,
`internet service provider (ISP) 710,
`intemet service
`provider 715, and user 720. ISP 710 and ISP 715 are both
`directly coupled to the internet 750. System 700 also
`includes a ID server 760. In the present embodiment, ID
`server 760 includes the functionality of a domain name
`SCTVBI.
`
`ID server 760 functions in pan by facilitating the process
`of locating appropriate intemet addresses. As is well known
`in the art, web sites are found and web pages are accessed
`on the internet 750 via their internet addresses. URLs refer
`to corresponding internet addresses. The URLs are the
`universal naming scheme for identifying and locating all
`web resources. URLs, or internet addresses, fully describe
`where a particular resource (c.g., a web page) resides and
`how to access it. Using well known intemet techniques (e.g.,
`hypertext transfer protocol), resources which exist