(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2004/0246360 A1
`
`Stavely et al.
`(43) Pub. Date:
`Dec. 9, 2004
`
`US 20040246360A1
`
`(54) SYSTEM AND METHOD FOR DISPLAYING
`PREVIEW IMAGES TO A CAMERA USER
`
`(22)
`
`Filed:
`
`Jun. 5, 2003
`
`Publication Classification
`
`(76)
`
`Inventors: Donald J. Stavely, Windsor, CO (US);
`Christopher A. Whitman, Ft. Collins,
`CO (US); Robert E. Sobol, Ft. Collins,
`CO (US); Kevin J. Matherson, Ft.
`Collins, CO (US)
`
`Correspondence Address:
`HEWLETT-PACKARD COMPANY
`Intellectual Property Administration
`P.0. Box 272400
`Fort Collins, CO 80527-2400 (US)
`
`(21) Appl. No.:
`
`10/455,201
`
`Int. Cl.7 ..................................................... H04N 5/222
`(51)
`(52) US. Cl.
`........................................................ 348/333.11
`
`(57)
`
`ABSTRACT
`
`Disclosed are systems and methods for displaying preview
`images to a camera user. In one embodiment, a system and
`method pertain to displaying liveview images in a camera
`display when an image is being composed, and further
`displaying at least one preview image in the camera display,
`the at least one preview image providing an indication of
`image focus or detail.
`
`
` IMAGE
`
`SENSOR
`
`EB
`
`
`
`DRIVER(S) 295
`
`STORAGE
`
`
`PROCESSOR
`
`MEMORY
`
`$3 CAMERA
`
`
`229
`
`CONTROL
`
`SENSOR
`
`INTERFACEng
`
`
`
`DEWCE
`
`INTERFACEggg
`
`
`
`1
`
`Exhibit 1048
`Apple v. Qualcomm
`|PR2018—01277
`
`1
`
`Exhibit 1048
`Apple v. Qualcomm
`IPR2018-01277
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 1 0f 7
`
`US 2004/0246360 A1
`
`[100
`
`
`
`FIG. 1
`
`2
`
`

`

`Patent Application Publication Dec. 9, 2004
`
`Sheet 2 0f 7
`
`US 2004/0246360 A1
`
`>mO_>_.n.=>_
`
`mwm
`
`moSmo
`
`mMmmo<umsz_
`
`aflwmo<mmMFz_Mflm
`
`
`
`Jomkzoomo<¢mm+z_
`
`JMAesmkw>mOZammoomamw<z_
`
`
`
`
`
`rmmjDDOE>>m__>m_mn_mO<_>__
`
`m0<m0._.m
`mowmmoomm_._
`vlomAmvmngNIH
`
`cow
`
`m0<_>__
`
`mszmw
`
`Mam
`
`wsz
`
`mmmzmkm>m
`
`mewzmm
`
`
`
`_____________.
`
`______________"
`
`3
`
`
`
`
`
`
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 3 0f 7
`
`US 2004/0246360 A1
`
`1001
`
`
`
`300
`
`IMAGE TO BE
`CAPTURED COMPOSED
`
`
`302
`
`PROVIDED BY LIVEVIEW IMAGE(S)
`
`
`PREVIEW IMAGE(S) DISPLAYED THAT
`PROVIDE(S) AN INDICATION AS TO
`
`
`IMAGE FOCUS/DETAIL BEYOND THAT
`
` Y
`
` COMPOSITION
`ACCEPTABLE?
`
`
`306
`
`IMAGE CAPTURED
`
`
`
`
`CAPTURE
`
`OTHER |MAGE(S)
`
`
`
`4
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 4 0f 7
`
`US 2004/0246360 A1
`
`2181
`
`IMAGE PREVIEW
`MODULE ACTIVATED
`
`
`
`
`
`
`DISPLAY LIVEVIEW IMAGES
`OF THE VIEWED SCENE
`
`400
`
`402
`
`
`404
`
` RECEIVE
`COMMAND TO DISPLAY A
`
`PREVIEW IMAGE?
`
`
`
`CAPTURE AN IMAGE OF
`THE VIEWED SCENE
`
`
`
`PROCESS CAPTURED IMAGE USING
`RELATIVELY HIGH-QUALITY
`
`
`PHOTOFINISHING TECHNIQUES
`
`
` DISPLAY RELATIVELY HIGH—
`QUALITY, STILL IMAGE TO USER
`IN CAMERA DISPLAY
`
` FURTHER IMAGE(S)
`
`TO BE COMPOSED?
`
`
`
`
`5
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 5 0f 7
`
`US 2004/0246360 A1
`
`2181
`
`IMAGE PREVIEW
`MODULE ACTIVATED
`
`DISPLAY LIVEVIEW IMAGES
`OF THE VIEWED SCENE
`
` 500
` 502
`
`PREVIEW IMAGES?
`
` RECEIVE
`
`COMMAND TO DISPLAY
`
`
`
`
`DIGITALLY ZOOM CAPTURED
`LIVEVIEW IMAGES PRIOR TO THEIR
`
`
`
`DISPLAY IN THE CAMERA DISPLAY
`
` DISPLAY DIGITALLY ZOOMED
`
`LIVEVIEW IMAGES IN RAPID
`
`SUCCESSION IN CAMERA DISPLAY
`
`
` FURTHER |MAGE(S)
`
`TO BE COMPOSED?
`
`6
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 6 0f 7
`
`US 2004/0246360 A1
`
`600
`J
`
`
`
`FIG. 6A
`
`
`
`600
`
`
`
`6&6
`
`FIG. 6B
`
`7
`
`

`

`Patent Application Publication Dec. 9, 2004 Sheet 7 0f 7
`
`US 2004/0246360 A1
`
`218
`
`1
`
`START
`
`IMAGE PREVIEW
`MODULE ACTIVATED
`
`DISPLAY LIVEVIEW IMAGES
`OF THE VIEWED SCENE
`
`700
`
`702
`
`706
`
`708
`
`710 -‘
`
`712
`
`704
`
`RECEIVE
`COMMAND TO DISPLAY A
`
`PREVIEW IMAGE?
`
`v
`
`CAPTURE AN IMAGE OF
`THE VIEWED SCENE
`
`
`
`PROCESS CAPTURED IMAGE USING
`RELATIVELY HIGH-QUALITY
`PHOTOFINISHING TECHNIQUES
`
`
`
`DIGITALLY ZOOM CAPTURED
`
`
`LIVEVIEW IMAGES PRIOR TO THEIR
`
`V DISPLAY IN THE CAMERA DISPLAY
`
`
`
`
`
`
`DISPLAY RELATIVELY HIGH—
`
`
`
`QUALITY, ZOOMED STILL IMAGE TO
`USER IN CAMERA DISPLAY
`
`
`
` FURTHER IMAGE(S)
`TO BE COMPOSED’?
`
`
`END
`
`FIG. 7
`
`8
`
`

`

`US 2004/0246360 A1
`
`Dec. 9, 2004
`
`SYSTEM AND METHOD FOR DISPLAYING
`PREVIEW’ IMAGES TO A CAMERA USER
`
`BACKGROUND
`
`[0001] Most digital cameras include a display, such as a
`back panel liquid crystal display (LCD) or an eyepiece
`microdisplay, that can be used to facilitate composition of an
`image before it
`is captured. In such a case,
`the camera
`operates in a liveview (or “movie”) mode in which many
`images are displayed to the user in rapid succession to
`emulate real time viewing of the subject scene. Although
`presentation of such liveview images provides convenience
`to the user, such images are often of relatively low quality
`as compared to images that are captured and stored in
`camera memory. This phenomenon can be observed by
`comparing the liveview images to a captured image.
`
`[0002] There are several reasons why liveview images
`may be of relatively poor quality. For one, the liveview
`images may be relatively low resolution images in that many
`frames per second must be captured and displayed in the
`camera display to enable the perceived real time viewing of
`the object scene. For example, as many as thirty frames per
`second (fps) or more must be captured and displayed. In that
`image capture, data reading, and display requires processor
`time, such rapid display of liveview images may require
`significant downsampling of the image data and, therefore,
`lower resolution.
`
`[0003] To cite another reason for relatively poor quality of
`liveview images, the photofinishing performed on liveview
`images is typically less effective than that performed on final
`captured images. For instance, the autoexposu re and/or color
`balancing algorithms used to capture and finish the liveview
`images may be inferior to those used to autoexpose and color
`balance a final image. Such “corner cutting” reduces pro-
`cessing time and therefore also enables the rapid display of
`the liveview images.
`
`[0004] Due to the relatively poor quality of the liveview
`images shown during image composition, it can be difficult
`for the user to know whether the camera is properly focused
`For example, it may be difficult to tell whether a person that
`is the intended subject of the image is in focus or whether
`objects behind that person are instead in focus. Exacerbating
`the problem is the small size and relatively low resolution of
`typical camera displays. Typically, such displays are no
`larger than 1 inch by 1.5 inches, with resolutions of 320 by
`240 pixels (quarter—VGA or OVGA). Some microdisplays
`are available with full VGA resolution (640 by 480 pixels).
`[0005] Although the riser can determine whether
`the
`intended subject was in focus after a final image is captured
`by reviewing the captured image immediately after
`its
`capture (and optionally “zooming in” on that captured
`image), it would be desirable to provide a better indication
`of the image focus and/or image details to the user before the
`image is captured so that the user need not review images
`after they are captured and recompose and recapture the
`image in the event that the captured image is considered
`unacceptable for some reason.
`
`SUMMARY
`
`[0006] Disclosed are systems and methods for displaying
`preview images to a camera user. In one embodiment, a
`
`system and method pertain to displaying liveview images in
`a camera display when an image is being composed, and
`further displaying at least one preview image in the camera
`display, the at least one preview image providing an indi-
`cation of image focus or detail.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0007: The disclosed systems and methods can be better
`understood with reference to the following drawings. The
`components in the drawings are not necessarily to scale.
`
`[0008: FIG. 1 is a rear view of an embodiment of an
`example camera that displays preview images.
`
`[0009: FIG. 2 is an embodiment of an architecture of the
`camera shown in FIG. 1.
`
`[0010: FIG. 3 is a flow diagram of a first embodiment of
`a method for displaying preview images to a user.
`
`[0011: FIG. 4 is a flow diagram of a second embodiment
`of a method for displaying preview images to a user.
`
`[0012: FIG. 5 is a flow diagram of a third embodiment of
`a method for displaying preview images to a user.
`
`[0013: FIG. 6A is a schematic view of a liveview image
`that can be displayed in a camera display.
`
`[0014: FIG. 6B is a schematic view of an embodiment of
`a zoomed preview image that can be displayed in a camera
`display.
`
`[0015: FIG. 7 is a flow diagram of a fourth embodiment
`of a method for displaying preview images to a user.
`
`
`
`
`DETAILED DESCRIPTION
`
`[0016: As identified in the foregoing, camera users often
`cannot identify detail from liveview images presented in a
`camera display and,
`therefore,
`typically cannot ascertain
`whether an image subject is or is not in focus. This problem
`is due in part to the relatively low quality of the liveview
`images that are displayed, as well as the relatively small size
`of the typical camera display. As is described in this disclo-
`sure, however, better feedback as to the focus and details of
`a composed image can be provided to the user by displaying
`preview images that convey more useful information to the
`user.
`
`In one embodiment, a relatively high-quality still
`[0017]
`image is shown to the user during image composition. In
`another embodiment, zoomed liveview images are sequen—
`tially shown to the user during image composition. In yet a
`further embodiment, a relatively high-quality, zoomed still
`image is shown to the user during image composition. In
`each case, the preview images provide the user with a better
`indication as to the nature of the image that the user is about
`to capture.
`
`[0018] Described below are systems and methods that
`provide image previews. Although particular embodiments
`are identified in an effort to fully describe the disclosed
`systems and methods, these embodiments are provided for
`purposes of example only.
`
`in which like
`[0019] Referring now to the drawings,
`numerals indicate corresponding parts throughout the sev—
`eral views, FIG. 1 illustrates an embodiment of a camera
`100 that displays previer images to a camera user. In the
`
`9
`
`

`

`US 2004/0246360 A1
`
`Dec. 9, 2004
`
`example of FIG. 1, the camera 100 is a digital still camera.
`Although a digital still camera implementation is shown in
`the figures and described herein, the camera can, alterna-
`tively, comprise any camera that presents images to the user
`in a camera display during image composition
`
`[0020] As indicated in FIG. 1, the camera 100 includes a
`body 102 that is defined by an outer housing 104. The top
`portion of the camera 100 comprises a shutter button 106
`that is used to open the camera shutter (not visible in FIG.
`1). Formed with the camera body 102 is a viewfinder 108
`that includes a View window 110. In cases in which the
`viewfinder 108 is an electronic viewfinder (EVF), the view-
`finder contains a microdisplay (not visible in FIG. 1). In the
`example of FIG. 1,
`the back panel of the camera 100
`includes a display 112 that, for example, comprises a liquid
`crystal display (LCD) or light emitting diode (LED) display.
`[0021] Various control buttons 114 are also provided on
`the back panel of the camera 100. Alternatively, however,
`such buttons may be placed in other locations, such as the
`top of the camera 100. The buttons 114 can be used to, for
`instance, scroll through captured images shown in the dis-
`play 112, make selections from camera menus, etc. Further-
`more, at least one of these buttons 114 may be used during
`an image composition process to command presentation of
`one or more preview images that are indicative of the focus
`and/or details of the image that is about to be captured. Also
`shown in FIG. 1 is a compartment 116 that is used to house
`a battery and/or a memory card.
`
`[0022] FIG. 2 illustrates an example architecture for the
`camera 100. As indicated in this figure,
`the camera 100
`includes a lens system 200 that conveys images of viewed
`scenes to an image sensor 202. By way of example, the
`image sensor 202 comprises a charge-coupled device (CCD)
`or a complementary metal oxide semiconductor (CMOS)
`sensor that is driven by one or more sensor drivers 204. The
`analog image signals captured by the sensor 202 are pro—
`vided to an analog—to—digital (A/D) converter 206 for con—
`version into binary code that can be processed by a processor
`208.
`
`[0023] Operation of the sensor driver(s) 204 is controlled
`through, a camera control interface 210 that is in bi—direc—
`tional communication with the processor 208. Also con-
`trolled through the interface 210 are one or more motors 212
`that are used to drive the lens system 200 (e.g., to adjust
`focus and optical zoom). Operation of the camera control
`interface 210 may be adjusted through manipulation of the
`user interface 212. The user interface 212 comprises the
`various components used to enter selections and commands
`into the camera [00 and therefore at least includes the
`shutter button 106 and the control buttons 114 identified in
`FIG. 1.
`
`[0024] Digital image signals are processed in accordance
`with instructions from the camera control interface 210 and
`
`image processing system(s) 216 stored in permanent (non-
`volatile) device memory 214. The image processing systems
`216 include photofinishing algorithms, such as color bal-
`ancing algorithms. Processed images may be stored in
`storage memory 220, such as that contained within a remov-
`able solid-state memory card (e.g., Flash memory card). In
`addition to the image processing system(s) 216, the device
`memory 214 further comprises an image preview module
`218 (i.e., logic) that, as is described in greater detail below,
`
`is used to display preview images to the user in a camera
`display (e.g., microdisplay or flat panel display). Although
`an image preview module 218 is shown in memory 214, the
`functionality provided by this module can, alternatively, be
`provided by logic incorporated into the processor 208 and/or
`the camera control interface 210, if desired.
`
`[0025] The camera embodiment shown in FIG. 2 further
`includes a device interface 222, such as a universal serial bus
`(USB) connector, that is used to download images from the
`camera to another device such as a personal computer (PC)
`or a printer, and which likewise can be used to upload
`images or other information.
`[0026] FIG. 3 is a flow diagram of a first embodiment of
`a method for displaying preview images to a user. More
`particularly, FIG. 3 provides an overview of operation of a
`camera such that one or more preview images are displayed
`for the user. It is noted that any process steps or blocks
`described in this or other flow diagrams of this disclosure
`may represent modules, segments, or portions of program
`code that includes one or more executable instructions for
`implementing specific logical filnctions or steps in the
`process. Although particular example process steps are
`described, alternative implementations are feasible. More—
`over, steps may be executed out of order from that shown or
`discussed, including substantially concurrently or in reverse
`order, depending on the functionality involved.
`[0027] Beginning with block 300 of FIG. 3, an image that
`is to be captured is composed. Composition may comprise
`one or more of aiming the camera at a subject scene,
`focusing on one or more scene objects, adjusting camera
`zoom such that only the desired objects are contained within
`the image frame, and so forth. It is noted that any focusing
`that occurs during image composition can be automatic (due
`to an autofocus function) or manual. While the image is
`being composed, liveview images may be displayed to the
`user in an appropriate camera display (e.g., EVF microdis-
`play or back panel display) to aid in the composition
`process. In such a case, the liveview images provide the user
`with a rough idea of the objects that will be contained in the
`image and the composition of the image in general.
`[0028] At some point during the image composition pro-
`cess, one or more preview images is/are displayed that
`provides or provide an indication as to the image focus
`and/or detail, as indicated in block 302. As is further
`indicated in block 302, the indication as to image focus/
`detail goes beyond that provided by the liveview images that
`may be presented to the user in the camera display. The
`nature of the preview image(s) depends upon the particular
`configuration of the camera or the mode in which it
`is
`operating.
`In one case,
`the preview image comprises a
`relatively high—quality still image similar to that displayed to
`a user after a final image is captured and stored in camera
`memory. In another case, the preview images are displayed
`that comprise zoomed liveview images that are shown
`sequentially to the user in rapid succession. In a further case,
`the preview image comprises a relatively high—quality,
`zoomed still image. Examples of the display of such preview
`images are described in relation to FIGS. 4-7 below. As is
`described in those examples, the preview image or images
`can be displayed, for example, in response to input of a user
`command.
`
`[0029] After the displayed preview image or images is/are
`reviewed, it is determined whether the image composition is
`
`10
`
`10
`
`

`

`US 2004/0246360 A1
`
`Dec. 9, 2004
`
`acceptable, as indicated in decision block 304. The criteria
`upon which this determination is made can include, for
`instance, the focus of target objects that the user wishes to
`capture, the objects that are visible, the lighting of the target
`objects, the general composition (e.g., artistic feel), etc. If
`the composition is not acceptable for some reason, flow
`returns to block 300 and the image is recomposed prior to
`capturing a final image. With this manner of operation, the
`user need not capture an unacceptable image, review it, learn
`of its unacceptable nature, erase it, and then recompose and
`recapture the image.
`
`[0030] With reference back to block 304, if the composi-
`tion is deemed acceptable, flow continues to block 306 at
`which a final image is captured and, optionally, stored in
`camera memory. At this point, it is determined whether
`another image is to be captured, as indicated in decision
`block 308. If so, flow returns to block 300 and an image is
`again composed. If not, however, flow for the image capture
`session is terminated.
`
`[0031] FIG. 4 is a flow diagram of a second embodiment
`of a method for displaying preview images to a user. More
`particularly, FIG. 4 provides an example of operation of the
`image preview module 218 of the camera 100. Beginning
`with block 400 of FIG. 4, the image preview module 218 is
`activated. This activation occurs when the camera is placed
`in an image capture mode such that the module 218 is active
`during image composition. As in the method described in
`relation to FIG. 3, image composition may comprise one or
`more of aiming the camera at a subject scene, focusing on
`one or more scene objects, adjusting camera zoom such that
`only the desired objects are contained within the image
`frame, and so forth.
`
`[0032] As is indicated in block 402, it is presumed in this
`example that
`liveview images of the viewed scene are
`displayed to the user in a camera display to aid the user in
`composing the image. Although the liveview images need
`not comprise low—quality images, it is assumed the liveview
`images are of relatively low quality due to the speed with
`which images are presented to the user and/or processing
`limitations of the camera. In some embodiments, the rela-
`tively low quality may be the result of aggressive down—
`sampling and/or rapid photofinishing that may be necessary
`to emulate real time viewing of the observed scene.
`
`the
`to decision block 404,
`[0033] With reference next
`image preview module 218 determines whether a command
`to display a preview image is received. Such a command can
`be input by the user in a variety of ways. In some cases, the
`user may press a dedicated preview button provided on the
`camera. In other cases, the user may press the camera shutter
`button to a halfway position (i.e.,
`the 81 position)
`to
`communicate the command. In any case, if such a command
`is not received, no preview images are displayed to the user
`and the image must be composed using either the displayed
`liveview images or a camera viewfinder. Flow then contin-
`ues down to decision block 412 described below.
`
`If a command to display a preview image is
`[0034]
`received at block 404, flow continues to block 406 at which
`the image preview module 218 causes an image to be
`captured of the viewed scene. The nature of the captured
`image may depend upon the configuration and capabilities
`of the camera. For instance, if relatively low resolution (e.g.,
`quarter-VGA or QVGA) liveview images are presented in
`
`the camera display during image composition, the image
`captured in block 406 can comprise a relatively high reso—
`lution (e.g., VGA) image (assuming that the camera display
`has VGA resolution). Such an image can be obtained, for
`instance, by merely downsampling the image data collected
`by the camera image sensor to a lesser degree. In that, as is
`described below, the captured image is going to be presented
`as a still image (i.e., for a relatively long period of time), the
`aggressive downsampling that may be used to display live-
`view images is not necessary in generating the preview
`image of this method.
`
`[0035] Once an image is captured in the manner described
`above, the image is processed using relatively high—quality
`photofinishing techniques, as indicated in block 408. In the
`present context, “high-quality photofinishing techniques”
`identifies those techniques that result
`in relatively high
`image quality, and may be contrasted to the relatively
`low-quality photofinishing techniques that are typically used
`to quickly process liveview images prior to their display. For
`example,
`the color balancing algorithm that
`is used to
`process a final captured image may be used in clock 408.
`Use of such can an algorithms as opposed to the algorithms
`used in the rapid photofinishing performed on liveview
`images, is possible due to the fact that the image is to be
`presented as a still image.
`
`[0036] Referring next to block 410, the module 218 dis-
`plays a relatively high-quality, still image (i.e., a preview
`image) to the user in the camera display. By “high—quality”
`is meant a sharper and/or cleaner image than the liveview
`images. Such improved quality may be the result of
`increased resolution, the application of better photofinishing
`algorithms, or both. By way of example, the preview image
`is displayed as long as the command to display it continues
`to be received. For instance, the preview image may be
`displayed as long as a dedicated preview button or the
`shutter button (in the 81 position) is pressed and held.
`Because of its higher quality, the preview image provides a
`good indication of a final
`image that may be captured.
`Therefore, a preview is provided to the user that is closer to
`what-you-see-is-what-you-get (WYSIWYG) than the live-
`view images.
`
`[0037] As noted above in relation to FIG. 3, if the preview
`image appears acceptable,
`the user can then capture the
`image. If the image is unacceptable, however, the user has
`the opportunity to recompose the image before it is captured.
`With reference then to decision block 412, it is next deter-
`mined whether another image is to be composed. If so, flow
`returns to block 402 and the above-described process is
`performed again. If not, flow for the session is terminated
`until the next time the image preview module 218 is acti-
`vated,
`
`[0038] FIG. 5 is a flow diagram of a third embodiment of
`a method for displaying preview images to a user and, more
`particularly, provides a further example of operation of the
`image preview module 218. Beginning with block 500 of
`FIG. 5, the image preview module 218 is activated. Again,
`this activation occurs when the camera is placed in an image
`capture mode such that the module 218 is active during
`image composition. Once activation has occurred, liveview
`images of the viewed scene are displayed to the user in the
`camera display. With reference next to decision block 504,
`the image preview module 218 determines Whether a com-
`
`11
`
`11
`
`

`

`US 2004/0246360 A1
`
`Dec. 9, 2004
`
`mand to display preview images is received. As in the
`embodiment described above in relation to FIG. 4, such a
`command can be input by the user, for example, by pressing
`a dedicated preview button or the camera shutter button.
`
`If a command to display preview images is
`[0039]
`received, irrespective of the manner in which the command
`was input, flow continues to block 506 at which the image
`preview module 218 digitally zooms the captured liveview
`images prior to their being displayed in the camera display.
`Such zoomng is accomplished through image processing
`alone. ln particular, captured liveview images are cropped,
`and the cropped images are then enlarged so to be of a size
`that will fill the camera display. This process is illustrated by
`FIGS. 6A and 6B. FIG. 6A illustrates a composed image
`600 and, more particularly, a single liveview image that may
`be presented in the camera display. An area 602 may be
`defined that will be used to generate the zoomed image. In
`other words all image data beyond the boundaries of the area
`602 is discarded to therefore crop the image 600. Next, the
`area 602 is enlarged, as depicted in FIG. 6]], so that objects
`604, 606 of the image are likewise enlarged. It is noted that,
`because no optical zooming is performed to achieve this
`zooming,
`the lenses of the camera lens system are not
`displaced and, therefore, a final image may be captured at
`will without
`the need to wait for the lens system to be
`repositioned into an initial position in which the image was
`first composed.
`
`[0040] Referring next to block 508, the image preview
`module 218 displays digitally zoomed liveview images
`(such as the example image of FIG. 6B) in rapid succession
`in the camera display so that a substantially real
`time,
`zoomed-in view of the composed image is shown to the user.
`As noted above, standard liveview images typically com-
`prise relatively low—quality images that may be a result of
`the relative low resolution (e.g.,
`1/4 VGA) of the display.
`Moreover, the size of the display may be very small (e.g.,
`1-3 square inches in area). These factors make the focus of
`the image difficult to ascertain. However, if the liveview
`images are shown in a digitally—zoomed format, as indicated
`in FIG. 6B, the sharpness of the edges of the target objects
`can be determined more easily because the scene objects are
`
`enlarged. Moreover, a greater number of captured image
`
`
`
`data can be used to create the zoomed image,
`in e ect
`improving image resolution. For example, if an approxi-
`mately 2x zoom is performed on a liveview image (i.e., such
`that about half of the rows and half of the columns of the
`image or about 25% of the original image area is used to
`form a resultant zoomed image), a camera display having
`QVGA resolution can display each pixel of an image cap-
`tured by the image sensor sampled with VGA resolution.
`While this is still not the full resolution of the final image,
`it may be sufficient to determine if the subject is in reason—
`able focus. Of course, higher digital zoom factors than 2><
`also possible
`
`[0041] As noted above with reference to the method of
`FIG. 4, the preview images (zoomed liveview images in this
`case) may be displayed to the user as long as the user
`command to do so is communicated, for instance, by depres-
`sion of a dedicated preview button or the shutter button. If,
`after inspecting the zoomed liveview images, the user deter—
`mines that the image that will be captured is acceptable (e .g.,
`in proper focus), the user can at that time release the button
`
`to end the preview, and capture and store the image by fully
`depressing the shutter button.
`
`[0042] With reference next to decision block 512, it is
`determined whether another image is to be composed. If so,
`flow returns to block 502 and the above—described process is
`performed again. If not, flow for the session is terminated
`until the next time the image preview module 218 is acti-
`vated.
`
`[0043] FIG. 7 is a flow diagram of a fourth embodiment
`of a method for displaying preview images to a user. More
`particularly, FIG. 7 provides an example of operation of the
`image preview module 218 in which a relatively high—
`quality, zoomed still image is displayed to the user. Accord—
`ingly,
`the method of FIG. 7 represents a hybrid method
`combining aspects of the methods described in relation to
`FIGS. 4 and 5.
`
`[0044] Beginning with block 700 of FIG. 7, the image
`preview module 218 is activated and, as indicated in block
`702, liveview images of the viewed scene are displayed to
`the user in a camera display to aid the user in composing an
`image. Next,
`the image preview module 218 determines
`whether a command to display a preview image is received,
`as indicated in decision block 704. If such a command is not
`received, no preview image is displayed to the user and the
`image must be composed using either the displayed liveview
`images or a camera viewfinder alone. Flow then continues
`down to decision block 712 described below.
`
`If a command to display a preview image is
`[0045]
`received at block 704, flow continues to block 706 at which
`the image preview module 218 causes an image to be
`captured of the viewed scene. As described in relation to
`FIG. 4, the image can comprise a relatively high resolution
`(e.g., VGA) image. Once an image is captured, the image is
`processed using relatively high-quality photofinishing tech-
`niques, as indicated in block 708. ln some embodiments, the
`image is processed using algorithms that are used to process
`a final captured image, such as color balance, tone repro—
`duction, etc. Use of such algorithms, as opposed to the
`algorithms used to perform rapid photofinishing on liveview
`images, is possible due to the fact that the image is to be
`presented as a still image.
`[0046] With reference to block 710, the image preview
`module 218 digitally zooms the captured image by, for
`instance, cropping and enlarging the image so that it can fill
`the camera display. Once such zooming has been performed,
`the module 218 displays a relatively high-quality, still image
`to the user in the camera display, as indicated in block 712.
`Again,
`this preview image is displayed as long as the
`command to display it continues to be received. For
`instance, the preview image may be displayed as long as a
`dedicated preview button or the shutter button (in the 81
`position) is depressed. As in the method of FIG. 4, in cases
`in which the same photofinishing algorithms used to process
`a final image are used to generate the preview image, the
`preview image provides a good indication of a final image
`that may be captured. Therefore, a preview is provided to the
`user that is closer to what—y0u—see—is—what—you—get (WYSI—
`WYG) than the liveview images. In the embodiment of FIG.
`7, however, the image is further zoomed so that details, such
`as image focus can be readily determined.
`it is then
`[0047] With reference to decision block 714,
`determined whether another image is to be composed. If so,
`
`12
`
`12
`
`

`

`US 2004/0246360 A1
`
`Dec. 9, 2004
`
`flow returns to block 702 and the above-described process is
`performed again. If not, flow for the session is terminated
`until the next time the image preview module 218 is acti-
`vated.
`
`14. A method for displaying preview images, comprising:
`
`displaying liveview images in a camera display when an
`image is being composed;
`
`What is claimed is:
`1. A method for displaying preview images, comprising:
`
`displaying liveview images in a camera display when an
`image is being composed; and
`
`during image composition displayng at least one preview
`image in the camera display, the at least one preview
`image providing an indication of image focus or detail.
`2. The method of claim 1, wherein displaying liveview
`images comprises displaying a plurality of liveview images
`in the camera display in rapid succession to emulate real
`time Viewing of an observed scene.
`3. The method of claim 1, wherein displaying at least one
`preview image comprises displaying a still image that is of
`relatively high quality in relation to the displayed liveview
`images.
`4. The method of claim 1, wherein displaying at least one
`preview image comprises displaying zoomed images in
`rapid succession.
`5. The method of claim 1, wherein displaying at least one
`preview image comprises displaying a zoomed still image
`that is of relatively high quality relative to the displayed
`liveview images.
`6. The method of claim 1, filrther comprising receiving a
`command to display a preview image prior to displaying at
`least one preview image.
`7. The method o