0
`6,118,480
`[11] Patent Number:
`[19]
`United States Patent
`
`Anderson et al.
`[45] Date of Patent:
`*Sep. 12, 2000
`
`USOO6] 18480A
`
`[54] METHOD AND APPARATUS FOR
`INTEGRATING A DIGITAL CAMERA USER
`INTERFACE ACROSS MULTIPLE
`OPERATING MODES
`_
`‘
`.
`Inventors. Eric C. Anderson, San Jose, Steve
`S‘W'ors Mo'ga“ H111, Amanda R-
`Maud“, P310 A110, 311 Of Callf-
`
`-
`[75]
`
`5,030,017
`5,742,504
`2...;32253;
`-_.
`,
`5,819.103
`5,822,492
`5154st
`5,861,918
`5,940,121
`
`395/173
`511997 (jasper et al.
`395/94
`4/1998 Meyer ct al.
`2.3399:
`lgulfo .....t......t"1....
`33:75:11)
`_
`.
`asumooca
`....
`
`395/821
`10/1998 Endoh el al.
`
`386/107
`10/1998 VVakui ct al.
`
`.. 34810-4
`1211998 Fellegara et a"
`111999 Anderson et al.
`348/233
`811999 Mcintyre et al,
`....................... 348/207
`
`[*1 Notice:
`
`[73] Assignee: FlashPoint Teclmology, Inc., San Jose,
`cal'f'
`This patent issued on a continued pros-
`ecution application filed under 37 CFR
`1.5301), and is subject t0 the [WWW year
`patent
`term PFOVISIOHS 0f 35 U~S.C~
`154 a 2 .
`( X )
`
`FOREIGN PATENT DOCUMENTS
`8223524
`8/1006
`Japan
`9220186
`11/1992 WIPO
`Primary Examiner—Wendy Garber
`Assistant Examiner—Aung S. Moe
`Attorney, Agent, or Firm—Sawyer Law Group LLP
`[57]
`ABSTRACT
`
`110411 5/225
`H04N 5/262
`
`1211 Appl- N05 08/851961”
`[22]
`Filed:
`May 6 1997
`’
`
`H04N 5/222
`Int. Cl.7
`[51]
`.............................................................. 348/207
`[52] US. Cl.
`[58] Fleld of Search
`348/333, 334,
`348/373, 375, 376, 552, 332, 233, 311,
`231, 232, 207, 239; 358/906, 909,]
`
`[56]
`
`References Cited
`
`U'S' PATENT DOCUMENTS
`6/1990 Hayashi ct al.
`......................... 353/527
`1/1991 Kurahashi et al.
`........ 386,01)
`8/1992 Egawa
`SSS/909.1
`9/1992 lsoguchi et al.
`,. 358/9091
`8/1994 Tf'S‘ak“ Cl 31- -
`_
`$1123:
`tilingler 9‘ Mal """""""""""" 3:3?
`1411996 M3321?! Ct
`'
`" 395i”;
`5/1996 Mathcny ct al.
`.. 305/156
`9/1996 Hirano et al.
`......
`.. 395/139
`
`
`
`
`
`4,935,809
`4,982,291
`5,138,460
`5,146,353
`§’335>072
`:Hggg;3
`5,513,300
`5,517,606
`5.553.277
`
`A method and apparatus for integrating a user interface
`across multiple operating modes of a digital camera includ-
`ing a display. When the digital camera is placed into each
`one of the multiple operating modes, mode-specific items
`corresponding to that mode are displayed on the display. The
`digital camera inCIUdCS a first 1311110“ and a second b11110“ for
`interacting with the multiple operating modes, where the
`first button has a first orientation, and the second button has
`a second orientation. The method and apparatus includes
`mapping an aligned set of mode-specific items in the display
`to the orientation of the first button. After the mode-specific
`items are displayed, the user scrolls from one mode-specific
`item to the next in the aligned $61 by pressing the first button
`and the display indicates which of the mode-specific items
`is a currently active item. When a mode—specific item
`becomesthe active item, additional information correspond-
`ing to the currently active item is displayed in the display in
`:1
`location offset from the active item in a direction of
`orientation corresponding to that of the second button.
`
`31 Clalms, 11 Drawing Sheets
`
`m
`
`10:26AM
`
`Image #314
`12l4/96
`
`0001
`0001
`
`Apple/Twitter
`Apple/Twitter
`Ex. 1020
`EX. 1020
`IPR2 of U.S. Pat. No. 8,612,515
`IPR2 of US. Pat. No. 8,612,515
`
`

`

`U.S. Patent
`
`Sep. 12,2000
`
`Sheet 1 0f 11
`
`6,118,480
`
`L a
`
`:H
`
`Eo
`
`(3
`
`112
`
`0002
`0002
`
`FIG.1
`
`3C
`
`L
`
`

`

`US. Patent
`
`Sep. 12, 2000
`
`Sheet 2 0f 11
`
`6,118,480
`
`0003
`
`mooo
`
`m.
`0E
`
`m:
`
`83.25
`
`GE
`
`.2828
`
`mo_m:<
`
`3.55
`
`8380:.
`
`E
`
`vNN
`
`N:
`
`
`
`36.956
`
`9:5:
`
`
`
`
`
`
`

`

`US. Patent
`
`Sep. 12, 2000
`
`Sheet 3 0f 11
`
`6,118,480
`
`
`
`mQSoomEamE_
`
`#000 mmzmtmm
`
`0004
`
`anxomm
`
`o3a>oEmm
`
`teem:
`
`mEEgéoz
`
`ioEwE
`
`90..
`
`.mzobzoo
`
`Em:
`
`mozoSMm
`
`LmSQEoo
`
` IIIIIIIIIIIIIl_812%Ill-IICESeaml-o3
`
`
`
`3.“m.0_n_
`
`mow
`
`
`
`
`
`

`

`US. Patent
`
`Sep. 12, 2000
`
`Sheet 4 0f 11
`
`6,118,480
`
`WORKING MEMORY
`
`INPUT BUFFERS
`
`FRAME BUFFERS
`
`SYSTEM AREA
`
`534
`
`FIG. 4A
`
`0005
`0005
`
`

`

`Processing
`
`Input Buffer B
`
`Frame Buffer 8
`
`US. Patent
`
`Sep. 12, 2000
`
`Sheet 5 0f 11
`
`6,118,480
`
`538
`
`536
`
`Input Buffer A
`
`Frame Buffer A
`
`Processing
`
`FIG. 4B
`
`0006
`0006
`
`

`

`US. Patent
`
`Sep. 12,2000
`
`Sheet 6 0f 11
`
`6,118,480
`
`
`
`0007
`0007
`
`

`

`US. Patent
`
`Sep. 12,2000
`
`Sheet 7 0f 11
`
`6,118,480
`
`Provide the digital camera with
`at least two navigation buttons
`
`
`
`Map an aligned a set of mode-specific
`items in the display to the orientation
`of the first navigation button
`
`
`
`Press the mapped navigation
`button to scroll from one mode-
`
`
`specific item to the next
`
`
`
`Indicate which of the mode-specific
`items is the currently active item
`
`600
`
`602
`
`604
`
`606
`
`608
`
`
`
`
`
`Display additional information corresponding
`to the currently active item in a location
`in the display that is offset from the
`active item in a direction mapped
`to the orientation of the second button
`
`
`
`
`
`FIG. 6
`
`0008
`0008
`
`

`

`US. Patent
`
`Sep. 12, 2000
`
`Sheet 8 0f 11
`
`6,118,480
`
`430
`
`410a
`
`410D
`
`434
`
`_432
`
`402
`
`
`
`FIG. 8
`
`0009
`0009
`
`

`

`U.S. Patent
`
`Sep. 12, 2000
`
`Sheet 9 of 11
`
`6,118,480
`
`0010
`
`050
`
`528“?@233
`
`:2omwé
`
`9.0E
`
`no;
`
`no:
`
`mov
`
`

`

`US. Patent
`
`Sep. 12,2000
`
`Sheet 10 0f 11
`
`6,118,480
`
`
`
`.03. 05%w. 3m
`
`Bracket Meter
`
`
`
`724
`
`0011
`0011
`
`

`

`US. Patent
`
`Sep. 12, 2000
`
`Sheet 11 0f 11
`
`6,118,480
`
`
`
`DJ
`
`D F
`
`
`
`IG. 11B
`
`730
`
`0012
`0012
`
`

`

`6,1 18,480
`
`1
`METHOD AND APPARATUS FOR
`INTEGRATING A DIGITAL CAMERA USER
`INTERFACE ACROSS MULTIPLE
`OPERATING MODES
`
`FIELD OF THE INVENTION
`
`The present invention relates generally to digital cameras,
`and more particularly to a method and apparatus for inte—
`grating a digital camera user interface across multiple oper—
`ating modes.
`
`BACKGROUND OF THE INVENTION
`
`Most digital cameras today are similar in size to and
`behave like conventional point—and—shoot cameras. Unlike
`conventional cameras, however, most digital cameras store
`digital images in an internal flash memory or on external
`memory cards, and some are equipped with a liquid-crystal
`display (LCD) screen on the back of the camera. Through
`the use of the LCD, most digital cameras operate in two
`modes, record and play, although some only have a record
`mode. In record mode, the LCD is used as a viewfinder in
`which the user may view an object or scene before taking a
`picture. In play mode, the LCD is used as a playback screen
`for allowing the user to review previously captured images
`either individually or in arrays of four, nine, or sixteen
`images.
`Digital camera user interfaces typically include a number
`of buttons or switches for setting the camera into one of the
`two modes and for navigating between images in play mode.
`One type of camera, for instance, includes two navigation
`buttons labeled “—” and “+", a mode button, a display
`button, a zoom button and a delete button. Play mode for this
`camera begins with a default screen displaying a full—sized
`individual image. Other images stored in the camera may
`then be displayed in a baclwvard or forward sequence by
`pressing the “—” and “+” navigation buttons, respectively.
`Pressing the mode button during play mode causes four
`images to be displayed in a 2x2 array, and pressing the mode
`button again causes nine images to be displayed in a 3x3
`away. The user can then “page” through screens of image
`alTays by pressing the navigation buttons, or the user can
`move from image to image in the arrays by first pressing the
`display button and then traversing across the images in the
`rows of the arrays using the navigation buttons. The user
`may have the full-sired image displayed of a chosen image
`by pressing the zoom button or can delete the image by
`pressing the delete button.
`Although digital cameras that have both a record mode
`and a play mode are more versatile than digital cameras
`having only the record mode, two mode digital cameras
`su IIer from several disadvantages associated with the cam-
`era’s user interface. One disadvantage is that having only
`two modes means that either the camera only has a limited
`number of functions, or that several functions must be
`accessed in play mode since the record mode only has one
`function, capturing images. The disadvantages of having
`several functions in one mode is that the functions may have
`to be accessed through multiple levels of navigation screens,
`which complicates the operability of the camera.
`Another disadvantage of conventional cameras is that the
`operation of user interface is non-intuitive, especially for the
`novice user. The user interface is non—intuitive because the
`
`operation of the user interface across difl'erent modes andtor
`navigation screens is inconsistent. Accessing most features
`in the two mode camera described above, for instance,
`requires that the user press the keys of the interface in a
`
`10
`
`15
`
`2t]
`
`40
`
`50
`
`60
`
`2
`certain sequence. Each of these key sequences may be
`diflerent depending on which play—mode navigation screen
`is displayed,
`the navigation screen showing individual
`images or the navigation screen showing arrays of images.
`For example,
`the function of the display button changes
`when the navigation screens change, and in some situations
`where the display button has been depressed,
`the mode
`button either becomes inoperable or the functionality of
`mode button becomes mutually exclusive with the function-
`ality of the zoom button. Furthermore, because each navi—
`gation screen has a difi'erent key sequence, it is not obvious
`to the user how to exit that screen or how to choose a
`particular function. Thus, this type of user interface requires
`that the user memorize a dilferent key sequence for each
`navigation screen before being able to efi'ectively operate the
`camera.
`
`A further disadvantage of conventional digital-camera
`user—interfaces is that the camera is capable of displaying
`only the images themselves, or a combination of an image
`and iLs image number. The user interface is either incapable
`of delivering further
`information regarding displayed
`images and the camera features, or accessing such informa—
`tion requires the user to enter another non—intuitive and
`complicated key sequence.
`Accordingly, what is needed is an improved user interface
`for a multi-mode digital camera. The present
`invention
`addresses such a need.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides a method and system for
`integrating a user interface across multiple operating modes
`of a digital camera wherein mode-specific items are dis-
`played on a display when the digital camera is placed into a
`particular operating mode. The digital camera includes a first
`and a second navigation button for interacting with the
`operating modes, where the first navigation button has a first
`orientation and the second navigation button has a second
`orientation. The method includes the step of mapping an
`aligned set of mode—specific items in the display to the
`orientation of the first navigation button. After the mode-
`specilic items are displayed,
`the user scrolls from one
`mode—specific item to the next in the aligned set by pressing
`the first navigation button, and the display indicates which
`of the mode—specific items is a currently active item. After
`a mode-specific item becomes the active item, additional
`information is displayed corresponding to the currently
`active item in the display in a location that is offset from the
`active item in a direction of orientation corresponding to that
`of the second button.
`In certain modes,
`the additional
`information includes a list of information items that
`is
`
`displayed in an alignment corresponding to the orientation
`of the secoan button, wherein the user can scroll through the
`list of information items using the second navigation bu tton.
`According to the method and apparatus disclosed herein,
`the digital camera is provided with more than two modes
`wherein the user can navigate, manipulate, and view camera
`contents using a consistent and intuitive spatial navigation
`technique. Providing more than one mode in which the user
`can view images and camera contents reduces the complex-
`ity of the user interface, and the spatial navigation frees the
`user from entering long key sequences. The user interface
`also automatically displays context sensitive information
`regarding the active item, which reduces the input required
`from the user and thereby increases the ease of use and
`operation of the digital camera.
`BRIEF DESCRIP‘IION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of a digital camera that operates
`in accordance with the present invention.
`
`0013
`0013
`
`

`

`3
`
`4
`
`6,1 18,480
`
`FIG. 2 is a block diagram of the preferred embodiment for
`the imaging device of FIG. 1.
`FIG. 3 is a block diagram of the preferred embodiment for
`the computer of FIG. 1.
`FIG. 4A is a memory map showing the preferred embodi—
`ment of the Dynamic Random-Access-Memory (DRAM).
`FIG. 4B is a diagram illustrating the input bullets and
`frame buffers.
`
`FIGS. 5A and SB are diagrams depicting the back and top
`view, respectively, of a digital camera.
`FIG. 6 is a flow chart illustrating the process of integrating
`a user interface across multiple operating modes of a digital
`camera according to the present invention.
`FIG. 7 is a block diagram illustrating a preferred embodi-
`ment of the present invention in which the alignment of the
`mode—specific items are mapped to the orientation of the
`horizontal navigation buttons.
`FIG. 8 is a block diagram ofthe user interface illustrating
`that when the mode-specific items are displayed
`horizontally, information corresponding to an active item is
`displayed vertically offset from the row of mode—specific
`items.
`
`10
`
`15
`
`211
`
`FIG. 9 is a diagram illustrating the operation and appear—
`ance of the integrated user interface during review mode in —
`accordance with a preferred embodiment of the present
`invention.
`
`FIGS. 10A and 10B are diagrams illustrating the opera—
`tion and appearance of the integrated user interface during
`menu mode in accordance with a preferred embodiment of
`the present invention.
`FIGS. 11/\ and 11B are diagrams illustrating the operation
`and appearance of the integrated user interface during cap—
`ture mode in accordance with a preferred embodiment of the
`present invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`The present invention relates to an improvement in user
`interfaces of digital imaging devices, including digital cam-
`eras. The following description is presented to enable one of
`ordinary skill in the art to make and use the invention and is
`provided in the context of a patent application and its
`requirements. Various modifications to the preferred
`embodiment will be readily apparent to those skilled in the
`art and the generic principles herein may be applied to other
`embodiments. Thus, the present invention is not intended to
`be limited to the embodiment shown but is to be accorded
`
`the widest scope consistent with the principles and features
`described herein.
`
`invention is a method and apparatus for
`The present
`integrating a digital camera user interface across multiple
`operating modes. According to the present
`invention, a
`method and system is provided for providing a digital
`camera with more than two modes and for providing a
`consistent and intuitive user interface across the multiple
`modes. The operation of the user interface across the mu 1—
`tiple modes includes a user controlled horizontal interaction
`following by a reply from the camera of a vertical display of
`additional infonTtation in response to the user controlled
`horizontal interaction.
`
`A digital camera architecture has been disclosed in
`co—pending U.S. patent application Ser. No. 081666241,
`entitled "A System And Method For Using A Unilied
`Memory Architecture To Implement A Digital Camera
`Device," filed on Jun. 20, 1996. The Applicant hereby
`
`40
`
`50
`
`60
`
`incorporates the co-pending application by reference, and
`reproduces portions of that application herein with reference
`to FIGS. 1—3 for convenience.
`
`Referring now to FIG. 1, a block diagram of a digital
`camera 110 is shown according to the present invention.
`Camera 110 preferably comprises an imaging device 114, a
`system bus 116 and a computer 118. Imaging device 114 is
`optically coupled to an object 112 and electrically coupled
`via system bus 116 to computer 118. Once a photographer
`has focused imaging device 114 on object 112 and, using a
`capture button or some other means, instructed camera 110
`to capture an image of object 112, computer 118 commands
`imaging device 114- via system bus 116 to capture raw image
`data representing object 112. The captured raw image data is
`transferred over system bus 116 to computer 118 which
`performs various image processing fu nctions on the image
`data before storing it in its internal memory. System bus 116
`also passes various status and control signals between imag—
`ing device 114 and computer 118.
`Referring now to F [(1. 2, a block diagram of the preferred
`embodiment of imaging device 114 is shown. Imaging
`device 114 preferably comprises a lens 220 having an iris, a
`filter 222, an image sensor 224, a timing generator 226, an
`analog signal processor (ASP) 228, an analog—to—digital
`(ND) converter 230, an interface 232, and one or more
`motors 234.
`
`U.S. Pat. No. 5,496, l [16, entitled “A System and Method
`For Generating a Contrast Overlay as a Focus Assist for an
`Imaging Device,” is incorporated herein by reference and
`provides a detailed discussion of the preferred elements of
`imaging device 114. Briefly, imaging device 114 captures an
`image of object 112 via reflected light
`impacting image
`sensor 224 along optical path 236. Image sensor 224, which
`is preferably a charged coupled device (CCD), responsively
`generates a set of raw image data in CCD format represent-
`ing the captured image 112. The raw image data is then
`routed through ASP 228, ND converter 230 and interface
`232.
`Interface 232 has outputs for controlling ASP 228,
`motors 234 and timing generator 226. From interface 232,
`the raw image data passes over system bus 116 to computer
`118.
`
`Referring now to FIG. 3, a block diagram of the preferred
`embodiment for computer 118 is shown. System bus 116
`provides connection paths between imaging device 114, an
`optional power manager 342, central processing unit (CPU)
`344, dynamic random-access memory (DRAM) 346, in putt"
`output interface (NO) 348, non—volatile memory 350, and
`buffersfconnector 352. Removable memory 354 connects to
`system bus 116 via bufl'erstconnector 352. Alternately, cam—
`era 110 may be implemented without removable memory
`354 or bufferst'connector 352.
`
`Power manager 342 communicates via line 366 with
`power supply 356 and coordinates power management
`operations for camera 110. CPU 344 typically includes a
`conventional processor device for controlling the operation
`of camera 110. In the preferred embodiment, CPU 344 is
`capable of concurrently running multiple software routines
`to control the various processes of camera 110 within a
`multi-threading environment. DRAM 346 is a contiguous
`block of dynamic memory which may be selectively allo-
`cated to various storage functions. LCD controller 390
`accesses DRAM 346 and transfers processed image data to
`LCD screen 402 for display.
`ItO 348 is an interface device allowing communications
`to and from computer 118. For example, lr‘O 348 permits an
`external host computer (not shown) to connect
`to and
`
`0014
`0014
`
`

`

`6,1 18,480
`
`5
`
`communicate with computer 118. HQ 348 also interfaces
`with a plurality of buttons andtor dials 404, and an optional
`status LCD 406, which in addition to the LCD screen 402,
`are the hardware elements of the camera’s user interface
`408.
`
`6
`the execution of the live view generation program (not
`shown), the CPU 344 takes the raw image data from the
`input buffers 538 in CCD format and performs color space
`conversion on the data. The conversions process performs
`gamma correction and converts the raw CCD data into either
`a RGB 0r YCC oolor format which is compatible with the
`LCD screen 402. After the conversion, CPU 344 stores the
`image data in the frame buffers 536. The LCD controller390
`then transfers the processed image data from the frame
`buffers to the LCD screen 402 {via an optional analog
`converter) for display.
`Referring now to FIG. 4B, the contents of input buffers
`538 and the frame bufl'ers 536 are shown. In a preferred
`embodiment, both the input buffers 538 and the frame
`bulTers 536 utilize two separate buffers, called ping-pong
`buffers, to improve the display speed of the digital camera
`and to prevent the tearing of the image in the display 402.
`As shown, input buffers 538 include an input bufi'er A and an
`input buffer B, and frame bulIers 536 include a frame buffer
`A and a frame buffer I3.
`
`The input buffers A and B alternate between an input cycle
`and a processing cycle. During the input cycle, the input
`buffers 538 are filled with raw image data from the image
`device 114, and during the processing cycle, CPU 344
`processes the raw data and transmits the processed data to
`the frame buffers 536. More specifically, while input bulTer
`A is filling with image data, the data from input buffer B is
`processed and transmitted to frame bufi'er B. At the same
`time, previously processed data in frame bufi'er A is output
`to the LCD screen 402 for display. While input buffer B is
`filling with image data,
`the data from input buffer A is
`processor] and transmitted to frame bufi'cr A. At the same
`time, previously processed data in frame buffer B is output
`to the LCD screen 402 for display.
`According to the present invention, the llexible architec-
`ture of the digital camera is used to provide and integrated
`camera user interface. More specifically, the present inven—
`tion provides a method and system for integrating a digital—
`camera user—interface across multiple operating modes of
`the digital camera.
`FIGS. 5A and SB are diagrams depicting the hardware
`components of the camera's 110 user interface 408. FIG. 5A
`is back view of the camera 110 showing the LCD screen 402,
`a four—way navigation control button 409, an overlay button
`412, a menu button 4.14, and a set of programmable soft keys
`416. FIG. 5B is a top view of the camera 110 showing a
`shutter button 418, and a mode dial 420. The camera may
`optionally include status LCD 406, status LCD scroll and
`select buttons 422 and 424, a sound record button 426, and
`zoom-in, zoom-out buttons 426ar and 42617.
`In One aspect of the present invention, the user interface
`408 includes several dijferent operating modes for support—
`ing various camera functions. However, the modes relevant
`to this description are review mode, menu mode, and capture
`(record) mode. In review mode, the camera 100 supports the
`actions of reviewing camera contents, editing and sorting
`images, and printing and transferring images.
`In menu
`mode, the camera 100 allows the user to manipulate camera
`settings and to edit and organize captured images. In capture
`mode, the camera 100 supports the actions of preparing to
`capture an image, and capturing an image through the use of
`either the LCD screen 402 or the status LCD 406.
`
`The user switches between the review, menu, and capture
`modes, using the mode dial 420. When the camera is placed
`into a particular mode, that mode’s default screen appears in
`the LCD screen 402 in which a set of mode-specific items,
`
`10
`
`15
`
`Non-volatile memory 350, which may typically comprise
`a conventional read—only memory or flash memory, stores a
`set of computer—readable program instructions to control the
`operation of camera 110. Removable memory 354 serves as
`an additional image data storage area and is preferably a
`non-volatile device, readily removable and replaceable by a
`camera 110 user via butfersfconnector 352. Thus, a user who
`possesses several removable memories 354 may replace a
`full removable memory 354 with an empty removable
`memory 354 to elTectiver expand the picture-taking capac-
`ity of camera 110.
`In the preferred embodiment of the
`present
`invention, removable memory 354 is
`typically
`implemented using a flash disk.
`Power supply 356 supplies operating power to the various
`components of camera 110. In the preferred embodiment,
`power supply 356 provides operating power to a main power
`bus 362 and also to a secondary power bus 364. The main
`power bus 362 provides power to imaging device 114, IIO
`348, non—volatile memory 350 and removable memory 354.
`The secondary power bus 364 provides power to power -
`manager 342, CPU 344 and DRAM 346.
`Power supply 356 is connected to main batteries 358 and
`also to backup batteries 360. In the preferred embodiment,
`a camera 110 user may also connect power supply 356 to an
`external power source. During normal operation of power
`supply 356, the main batteries 358 provide operating power
`to power supply 356 which then provides the operating
`power to camera 110 via both main power bus 362 and
`secondary power bus 364. During a power failure mode in
`which the main batteries 358 have failed (when their output
`voltage has fallen below a minimum operational voltage
`level) the backup batteries 360 provide operating power to
`power supply 356 which then provides the operating power
`only to the secondary power bus 364 of camera 110.
`Referring now to FIG. 4A, a memory map showing the
`prefelTed embodiment of dynamic random-access-memory
`(DRAM) 346 is shown.
`In the preferred embodiment,
`DRAM 346 includes RAM disk 532, a system area 534, and
`working memory 530.
`RAM disk 532 is a memory area used for storing raw and
`compressed image data and typically is organiZed in a
`“sectored” format similar to that of conventional hard disk
`
`2t]
`
`40
`
`drives In the preferred embodiment, RAM disk 532 uses a
`well—known and standardized file system to permit external
`host computer systems, via M) 348, to readily recognize and
`access the data stored on RAM disk 532. System area 534
`typically stores data regarding system errors (for example,
`why a system shutdown occurred) for use by CPU 344 upon
`a restart of computer 118.
`Working memory 530 includes various stacks, data struc-
`tures and variables used by CPU 344 while executing the
`software routines used within computer 118. Working
`memory 530 also includes input bufl'ers 538 for initially
`storing sets of raw image data received from imaging device
`114 for image conversion, and frame bulfers 536 for storing
`data for display on the LCD screen 402.
`In a preferred embodiment,
`the conversion process is
`performed by a live view generation program, which is
`stored in non—volatile memory 350 and executed on CPU
`344. However, the conversion process can also be imple-
`mented using hardware. Referring again to FIG. 3, during
`
`50
`
`60
`
`0015
`0015
`
`

`

`6,1 18,480
`
`7
`
`such as images, icons, and text, are displayed. According to
`the present invention, the user may navigate through and
`access the contents and features of multiple camera modes
`using a consistent and intuitive user interface. Throughout
`various operating modes, the user interface includes a user
`controlled horizontal interaction following by a reply from
`the camera of a vertical display of information. Because the
`user interacts with the camera in each of various camera
`modes using the hardware buttons in a similar manner, as
`described herein, the learnability and usability of the camera
`are enhanced.
`
`Referring now to FIG. 6, a flow chart is shown illustrating
`the process of integrating a user interface across multiple
`operating modes of a digital camera in accordance with the
`present invention. Referring to both FIGS. 5A, and 6, the
`process begins by providing the user interface with at least
`two sets of navigation buttons in step 600. As shown in FIG.
`5A, in a preferred embodiment of the present invention, the
`four-way navigation control button 409 provides the user
`interface with four buttons; leftfright buttons 4100 and 41013,
`which have a horizontal orientation, and upfdown buttons
`4110 and 411b, which have a vertical orientation. In accor—
`dance with the present invention, the user uses the four way
`controller 409 in each of the various camera modes as a
`
`global navigational device in a way that provides the user
`with intuitive spatial orientation when navigating through
`the modes, as explained further below.
`Referring again to FIG. 6, after the camera is placed into
`a particular mode, a set of mode—specific items are aligned
`in the LCD screen 402 so that the alignment of the mode-
`specific items maps to the natural spatial orientations of one
`set of navigation buttons on the four way controller in step
`602.
`
`FIG. 7 is a block diagram illustrating a preferred embodi—
`ment of the present invention in which the alignment of the
`mode-specific items 430 are mapped to the orientation of the
`horizontal navigation buttons 410ar and 4102). As shown,
`mapping the alignment of the mode—specific items 430 to the
`orientation of the horizontal navigation buttons 410a and
`410!) causes the mode-specific items 430 to be displayed in
`a rowfs) across the LCD screen 402. Rather than mapping
`the alignment of the mode—specific items 430 to the orien—
`tation of the horizontal navigation buttons 410, the mode—
`specific items 430 may also be mapped to the orientation of
`the vertical navigation buttons 411.5: and 4111). This would
`cause the mode-specific items to be displayed in a column in
`the LCD screen 402. Additionally,
`the alignment of the
`mode—specific items 430 may be mapped to other navigation
`button orientations (e.g. a diagonal orientation)I if so desired.
`Referring again to FIG. 6, after the mode-specific items
`430 are displayed, the user can scroll or navigate from one
`mode—specific item 430 to the next by pressing the mapped
`navigation buttons in step 604. In FIG. 7 for example,
`pressing navigation button 410!) causes a right scrolling
`action, and pressing navigation button 410A causes a left
`scrolling action. As the user scrolls through the mode-
`specific items 430, the camera displays an indication 432 of
`which one of the mode—specific items 430 is a currently
`active item 434 in step 606. This indication 432 may take the
`form of a highlight, a stationary or moving pointer, the
`active item 432 itself may blink, or a dill‘erent
`type of
`mode—specific item may be shown to indicate an active,2
`inactive status.
`
`After a particular mode—specific item 430 has become the
`active item 434, additional information 436 corresponding
`to the active item is displayed in the LCD screen 402 in a
`
`10
`
`15
`
`2t]
`
`—
`
`40
`
`50
`
`60
`
`8
`from the active item 434 in a direction
`location offset
`mapped to the orientation of the second set of navigation
`buttons in step 608.
`FIG. 8 is a block diagram of the user interface illustrating
`that when the mode-specific items 430 are displayed
`horizontally, the information 436 corresponding to the active
`item 434 is displayed in an area of the LCD screen 402 that
`is vertically ofl'set 438 from the horizontal row of mode—
`spccific items, and that the direction of ofl'set 438 is parallel
`to the orientation of the vertical navigation buttons 411a and
`411:5.
`
`According to the present invention, throughout the vari-
`ous operating modes of the camera,
`the integrated user
`interface maintains an interaction model in which the user
`scrolls horizontally to select an active mode-specific item,
`followed by a vertical display of additional information in
`the LCD screen 402 relating to the active itern. And in
`certain modes, the additional information includes a list of
`information items that is displayed in an alignment corre—
`sponding to the orientation of the vertical navigation buttons
`411a and 411b, wherein the user can scroll through the list
`of infom‘lalion items using those buttons.
`By mapping both the modes of navigation and the display
`of mode information to the orientation of the navigation
`buttons 410 and 411 of the four way controller, the user
`essentially only has to learn one major mechanism for
`interacting with the multiple modes of the digital camera.
`That is, since the user interface interacts with each of the
`camera modes using only the fou r—way controller 409, the
`integrated user interface of the present invention signifi-
`cantly reduces the amount of key sequences the user must
`memorize in order to operate the camera. The preferred
`implementations of the review mode, the menu mode, and
`the capture mode are described below to further explain the
`integrated user interface of the present invention.
`ReferTing now to FIG. 9, a diagram illustrating the
`operation and appearance of the integrated user interface
`during review mode is shown in accordance with a preferred
`embodiment of the present invention. Moving the mode dial
`420 (FIG. SB) to access the review mode enables the user to
`view all
`the images in the camera along with specific
`attributes associated with each of the images.
`The mode—specific items displayed across the LCD screen
`402 in review mode are thumbnail images 700 that represent
`sm