`
`
`(19) United States
`
`
`
`
`
`
`
`
`(12) Patent Application Publication (10) Pub. No.: US 2006/0023083 A1
`
`
`
`
`
`
`
` Yoo (43) Pub. Date: Feb. 2, 2006
`
`
`
`
`US 20060023083A1
`
`
`
`
`(54) METHOD OF CONTROLLING DIGITAL
`PHOTOGRAPHING APPARATUS FOR
`
`
`
`
`EFFICIENT REPRODUCTION OPERATION
`
`
`
`AND DIGITAL PHOTOGRAPHING
`
`
`
`APPARATUS ADOPTING THE SAME
`
`
`
`
`
`
`
`.
`
`
`
`
`
`(75) mentor: Hyun'soo Y00> Seongnam'51(KR)
`
`
`Correspondence Address:
`GARDNER CARTON & DOUGLAS LLP
`
`
`
`
`
`
`
`ATTN: PATENT DOCKET DEPT.
`
`
`
`
`191 N. WACKER DRIVE, SUITE 3700
`
`
`
`CHICAGO, IL 60606 (US)
`
`
`
`
`
`
`
`
`
`
`
`
`
`(73) Assignee: Samsung TechWin Co., Ltd., Chang-
`
`
`won-city (KR)
`
`
`
`
`
`(21) Appl. No.:
`
`
`Filed:
`
`
`
`(22)
`
`
`
`10/966,521
`
`
`
`
`
`Oct. 15, 2004
`
`
`
`
`
`
`
`
`
`(30)
`
`
`
`
`
`
`Foreign Application Priority Data
`
`
`
`
`
`Jul. 27, 2004
`
`
`
`
`(KR) ....................................... 2004-58796
`_
`_
`_
`_
`
`Pubhcatm“ C'aSS‘ficatm“
`
`
`
`
`
`
`(51)
`Int. Cl.
`
`
`
`H04N 5/76
`2006.01
`(52) US. Cl.
`......................(................).................. 348/231.99
`
`
`
`
`
`
`
`ABSTRACT
`(57)
`
`
`
`
`
`
`Amethod of controlling a digital photographing apparatus in
`
`
`
`
`
`
`a moving-image photographing mode is provided. The
`
`
`
`
`
`
`
`method includes creating a moving-image file in a storage
`
`
`
`
`
`
`medium, storing moving-image data in the moving-image
`
`
`
`
`
`
`
`
`file, and reproducing the moving-image data stored in the
`
`
`
`
`
`
`
`moving-image file When in a reproducing mode. The method
`
`
`
`
`
`
`
`
`further includes the operations of storing frame data of the
`
`
`
`
`
`
`
`moving-image data in the moving-image file as still-image
`
`
`
`
`
`
`
`data When in the moving-image photographing mode and
`
`
`
`
`
`
`
`
`
`
`displaying a still image of the frame data stored in the
`
`
`
`
`
`
`
`moving-image file as a representative image of the moving-
`
`
`
`
`
`
`image file When in the reproducing mode.
`
`
`
`Oi
`
`
`
`511
`
`FLASH
`
`CONTROLLER
`
`
`
`CDS-—ADC
`
`
`
`
`
`501
`
`
`
`
`
`
`
`
`
`5‘32
`
`
`
`507
`
`
`
`DSP
`
`
`
`503
`
`
`
`RTC
`
`1
`
`/
`
`
`
`
`
`
`
`
`
`- - -
`DRAM
`EEPROM
`MCI
`
`
`
`
`«5w
`
`
`
`LENS DRIVER
`
`
`
`FLASH
`
`
`
`19
`
`
`
`
`USER
`
`INPUT UNIT
`
`
`
`RSZSZC I/F gm
`
`
`
`
`
`
`21
`
`21 a
`
`
`
`21 0
`
`
`
`
`
`
`VIDEO FILTER
`
`
`
`MICRO
`512
`
`CONTROLLER
`514
`513
`
`
`
`I
`I
`
`
`
`
`
`LCD
`DRIVER
`
`
`
`
`
`SP COLOR LCD PANEL
`
`
`
`
`
`LAMP
`
`
`LIGHT
`SOURCE
`
`
`
`
`
`
`
`
`AUDIO
`PROCESSOR
`
`
`
`
`
`
`
`
`
`
`
`Mle-fi
`
`
`
`
`509
`
`
`
`35
`
`
`
`APPL-1042/ Page 1 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 1 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 1 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`
`
`
`APPL-1042/ Page 2 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 2 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 2 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`FIG. 2
`
`
`
`
`
`17b
`
`
`
`
`
`
`
`
`
`83 3414L 14 MW 39w 39T
`
`
`
`
`
`APPL-1042/ Page 3 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 3 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 3 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`
`\\OE00¢?on,
`
`_.mom5mOwOm.UHmmn_O
`
`
`mommomvom
`
`
`
`:DOEO02:2;ae9
`
`05
`
`\
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`alEEOmmmw§<momommm>Eomzm._
`
`
`
`lllll
`
`EN0
`
`
`
`EN'0.£888a2
`
`
`
`a$3528:98NF
`
`gm:2:
`
`8m.
`
`Smm5
`
`2m.04.NE08.2$8
`E5:89>$5858:2:5%:m2.
`
`
`
`
`
`
`EEG$88081macaw223R:052Eu:
`
`mmmm'dzé8:98_m0:2
`
`APPL-1042/ Page 4 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 4 of 16
`Apple v. Corephotonics
`
`
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 4 0f 9
`
`FIG. 4
`
`
`
`
`
`US 2006/0023083 A1
`
` INITIALIZE
`
`
`
`
`
`PERFORM PREVIEW MODE
`
`
`
`
`
`
`
`SI
`82
`
`
`
`
`
`PHOTOGRAPHING
`
`MODE?
`
`
`
`33 MOVING
`
`
`
`IMAGE
`
`
`
`
`
`
`
`
`PERFORM STILL—IMAGE
`
`
`PHOTOGRAPHING MODE
`
`
`
`
`
`PERFORMMOVING—IMAGE
`
`
`PHOTOGRAPHINGMODE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`PERFORM SETTING MODE
`
`
`
`S7
`
`
`
`
`
`-
`
`TERMINATION
`
`SIGNAL?
`
`
`NO
`
`
`88
`
`
`
`
`IS SIGNAL
`
`
`GENERATED BY REPRODUCING
`
`
`
`MODE BUTTON?
`
`
`
`
`
`
`
`
`
`P
`
`
`
`39
`
`APPL-1042/ Page 5 Of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 5 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 5 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`FIG. 5
`
`/82
`
`
`
`PERFORM AWB
`
`
`
`8201
`
`
`
`PERFORM AE
`
`PERFORM AF
`
`
`
`
`
`8202
`
`
`
`8203
`
`
`
`
`GAMMA CORRECTION
`
`
`
`8204
`
`
`
`SCALING
`
`
`
`8205
`
`
`
`
`
`CONVERT IMAGE DATA
`
`
`
`8206
`
`
`
`
`
`PROCESS IMAGE DATA
`
`
`
`8207
`
`
`
`STORE
`
`
`
`8208
`
`
`
`
`
`SYNTHESIZE OSD DATA
`
`
`
`S209
`
`
`
`
`
`CONVERT IMAGE DATA
`
`
`
`
`I S210
`
`
`
`OUTPUT IMAGE DATA
`
`
`
`821 1
`
`
`
`END
`
`
`
`APPL-1042/ Page 6 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 6 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 6 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`FIG 6
`
`
`/s41
`
`
`
`IS RECORDABLE
`
`
`CAPACITY AVAILABLE?
`
`841 02
`
`
`
`
`
`
`
`
`
`
`
`S4103
`
`
`
`
`
`
`
`
`
`
`
`DRIVE APERTURE AND SET EXPOSURE TIME
`
`
`
`
`
`
`
`
`
`AUTOMATIC FOCUSING MODE?
`
`S4107
`
`
`
`N0
`
`
`
`
`
`
`SET WHITE BALANCE
`
`
`
`S4105
`
`
`
`
`
`
`INDICATE LACK OF
`
`
`
`AUTOMATIC EXPOSURE MODE?
`
`CAPACITY OF
`
`
`MEMORY CARD
`
`
`
`
`NO
`
`
`
`
`
`
`
`PERFORM AUTOMATIC FOCUSING
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CREATE MOVING-IMAGE FILE IN MEMORY CARD
`
`YES
`
`.
`
`
`
`
`
`
`
`
`CAPTURE STILL IMAGE
`
`
`
`
`
`
`
`COMPRESS STILL-IMAGE DATA
`
`
`
`
`
`
`STORE STILL-IMAGE DATA IN STIU.-IMAGE FILE
`
`
`
`APPL-1042/ Page 7 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 7 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 7 0f 9
`
`
`
`US 2006/0023083 Al
`
`
`FIG 7
`
`START
`
`S4201
`
`
`
`
`HAS OSD BEEN SYNTHESIZED?
`
`
`/ S42
`
`
`
`NO
`
`
`
`
`
`
`
`
`
`NO
`
`S4204
`
`
`
`
`
`
`
`S4205 INDICATE LACK
`
`
`OF CAPACITY OF
`
`
`
`MEMORY CARD
`
`
`
`
`
`
`
`
`
`
`
`
`DELETE OSD
`
`
`
`'
`
`
`
`STORABLE TIME > 0?
`
`YES
`
`
`
`S4203
`
`
`
`
`
`
`DISPLAY SYMBOL OF MOVING-IMAGE
`
`
`
`
`PHOTOGRAPHING MODE AND STORABLE TIME
`
`
`
`
`
`
`
`
`
`SET WHITE BALANCE ACCORDING TO SET PHOTOGRAPHING CONDITION
`
`
`
`
`
`
`
`DRIVE APERTURE AND SET EXPOSURE TIME ACCORDING
`
`
`
`
`TO SET PHOTOGRAPHING CONDITION
`
`
`
`
`PERFORM AUTOMATIC FOCUSING ACCORDING TO
`
`
`
`SET PHOTOGRAPHING CONDITION
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`STOP STORING AND COMPLETE FILE
`
`
`
`
`
`
`
`APPL-1042/ Page 8 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 8 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 8 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`FIG. 8
`
`
`
`
`FILE STARTER
`
`
`
`
`HEAD DATA
`
`
`
`81
`
`82
`
`83
`
`84
`
`85
`
`86
`
`APPL-1042/ Page 9 of 16
`Apple v. Corephotonics
`
`87
`
`
`MOVING-IMAGE DATA
`
`
`
`
`AUDIO DATA
`
`
`
`
`MISCELLANEOUS DATA
`
`
`
`
`FILE TERMINATOR
`
`
`
`APPL-1042 / Page 9 of 16
`Apple v. Corephotonics
`
`

`

`
`
`
`
`
`
`Patent Application Publication Feb. 2, 2006 Sheet 9 0f 9
`
`
`
`US 2006/0023083 A1
`
`
`FIG. 9
`
`
`39
`
`
`/
`
`890
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TYPE OF
`MOVING IMAGE
`
`
`
`
`LATEST FILE?
`
`
`
`
`
`DISPLAYIMAGEO
`
`
`
`
`
`STILLilMAG‘EPATASTQBE
`
`
`
`N CORRESPONDING-I
`
`
`
`M.9_v.III9.:.I.MA9§.EIIE
`
`
`
`DISPLAY IMAGE OF
`CORRESPONDING
`
`
`
`
`STILL-IMAGE FILE
`RErFéRfigAIIDITEI'IISDNN
`
`SIGNAL?
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TYPE OF
`
`CORRESPONDING
`
`
`FILE?
`
`
`
`
`
`
`REPRODUCE MOVING-IMAGE DATA
`
`
`
`
`
`AND AUDIO DATA STORED IN THE
`
`
`
`CORRESPONDING MOVING-IMAGE FILE
`
`
`
`a 8905
`
`REWIND
`
`
`
`‘
`
`
`
`
`
`AS SIGNAL
`
`
`BEEN GENERATED B
`
`
`
`
`
`REPRODUCING MODE
`
`
`
`
`BUTTON?
`YES
`3908
`
`
`
`
`
`FAST FORWARD
`
`
`
`
`
`
`
`REPRODUCTION/
`
`
`TERMINATION SIGNAL?
`
`
`
`
`
`
`
`YES
`
`
`
`8910
`
`
`
`
`
`
`TERMINATE REPRODUCTION
`
`
`
`APPL-1042/ Page 10 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 10 of 16
`Apple v. Corephotonics
`
`

`

`
`
`US 2006/0023083 A1
`
`
`Feb. 2, 2006
`
`
`
`METHOD OF CONTROLLING DIGITAL
`
`
`
`PHOTOGRAPHING APPARATUS FOR EFFICIENT
`
`
`REPRODUCTION OPERATION AND DIGITAL
`
`
`
`
`PHOTOGRAPHING APPARATUS ADOPTING THE
`
`
`SAME
`
`
`
`
`
`
`
`
`
`[0001] This application claims the priority of Korean
`
`
`
`
`
`
`
`
`Patent Application No. 2004-58796, filed on Jul. 27, 2004,
`
`
`
`
`
`
`
`
`in the Korean Intellectual Property Office, the disclosure of
`
`
`
`
`
`
`which is incorporated herein in its entirety by reference.
`
`
`
`
`
`BACKGROUND OF THE INVENTION
`
`
`
`
`
`[0002]
`
`
`
`
`
`
`1. Field of the Invention
`
`
`
`
`
`
`
`[0003] The present invention relates to a method of con-
`
`
`
`
`
`
`trolling a digital photographing apparatus and a digital
`
`
`
`
`
`
`
`
`photographing apparatus using the same, and more particu-
`
`
`
`
`
`
`to a method of controlling a digital photographing
`larly,
`
`
`
`
`
`apparatus, which, in a moving-image photographing mode,
`
`
`
`
`
`
`
`
`creates a moving-image file in a storage medium and, when
`
`
`
`
`
`
`in a reproducing mode,
`reproduces moving-image data
`
`
`
`
`
`
`
`stored in the moving-image file, and a digital photographing
`
`
`
`
`apparatus using the same.
`
`
`
`
`
`
`2. Description of the Related Art
`[0004]
`
`
`
`
`
`[0005] A conventional digital photographing apparatus
`
`
`
`
`
`
`
`filed by the present applicant in 2004 is disclosed in US.
`
`
`
`
`
`
`Patent Publication No. 119,876, “Method of Notification of
`
`
`
`
`
`
`Inadequate Picture Quality.” When in a reproducing mode,
`
`
`
`
`
`
`
`the digital photographing apparatus reproduces files from a
`
`
`storage medium.
`
`
`
`
`
`
`
`
`[0006] Files stored in the storage medium are divided into
`
`
`
`
`
`
`
`two types: still-image and moving-image. In the reproducing
`
`
`
`
`
`
`
`mode, an image of a still-image file or an image of an initial
`
`
`
`
`
`
`
`frame of a moving-image file are displayed by a user. In a
`
`
`
`
`
`conventional digital photographing apparatus,
`loading a
`
`
`
`
`
`
`
`
`moving-image file and then finding an initial frame is
`
`
`
`
`
`
`
`required in order to display an image of the initial frame as
`
`
`
`
`
`
`a representative image of the moving-image file.
`
`
`
`
`
`
`
`
`[0007] Therefore, it takes time to display the initial frame
`
`
`
`
`
`
`
`
`In
`as the representative image of a moving-image file.
`
`
`
`
`
`
`
`
`addition, errors may occur when finding an initial frame of
`
`
`
`
`
`
`
`
`
`a moving-image file and displaying the initial frame con-
`
`
`
`
`
`
`
`secutively in response to file select signals consecutively
`
`
`generated by a user.
`
`SUMMARY OF THE INVENTION
`
`
`
`
`
`
`
`
`
`
`
`
`[0008] The present invention provides a method of con-
`
`
`
`
`
`
`trolling a digital photographing apparatus for displaying a
`
`
`
`
`
`
`representative image of a moving-image file quickly and
`
`
`
`
`
`
`stably in a reproducing mode, and a digital photographing
`
`
`
`
`apparatus using the method.
`
`
`
`
`
`
`
`
`[0009] According to an aspect of the present invention,
`
`
`
`
`
`
`there is provided a method of controlling a digital photo-
`
`
`
`
`
`graphing apparatus in a moving-image photographing mode.
`
`
`
`
`
`
`
`The method includes creating a moving-image file in a
`
`
`
`
`
`
`
`storage medium, storing moving-image data in the moving-
`
`
`
`
`
`
`
`
`image file, and reproducing the moving-image data stored in
`
`
`
`
`
`
`
`the moving-image file when in a reproducing mode. The
`
`
`
`
`
`
`
`
`
`method also includes storing frame data of the moving-
`
`
`
`
`
`
`
`
`image data in the moving-image file as still-image data when
`
`
`
`
`
`
`
`in the moving-image photographing mode; and displaying a
`
`
`
`
`
`
`
`
`
`still image of the frame data stored in the moving-image file
`
`
`
`
`
`
`
`as a representative image of the moving-image file when in
`
`
`
`the reproducing mode.
`
`
`
`
`
`
`
`
`[0010]
`In the method, an image of still-image data stored
`
`
`
`
`
`
`in advance in the moving-image photographing mode is
`
`
`
`
`
`
`displayed as the representative image of the moving-image
`
`
`
`
`
`
`
`
`file when in the reproducing mode. Further,
`loading the
`
`
`
`
`
`
`
`moving-image file and finding a set frame so as to display
`
`
`
`
`
`
`
`
`the representative image of the moving-image file are not
`
`
`
`
`
`
`
`required. Consequently,
`the representative image of the
`
`
`
`
`
`
`
`
`moving-image file can be displayed quickly and stably in the
`
`
`reproducing mode.
`
`
`
`
`
`
`[0011] According to another aspect of the present inven-
`
`
`
`
`
`
`tion, there is provided a digital photographing apparatus
`
`
`
`adopting the method.
`
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0012] The above and other features and advantages of the
`
`
`
`
`
`
`
`present invention will become more apparent by describing
`
`
`
`
`
`
`
`in detail exemplary embodiments thereof with reference to
`
`
`
`
`the attached drawings in which:
`
`
`
`
`
`
`[0013] FIG. 1 is a perspective view showing a digital
`
`
`
`
`
`
`photographing apparatus according to the present invention;
`
`
`
`
`
`
`
`
`[0014] FIG. 2 is a back view showing the back of the
`
`
`
`
`digital photographing apparatus of FIG. 1;
`
`
`
`
`
`
`
`[0015] FIG. 3 is a schematic diagram of the entire con-
`
`
`
`
`
`
`figuration of the digital photographing apparatus of FIG. 1;
`
`
`
`
`
`
`
`[0016] FIG. 4 is a flow chart illustrating a main algorithm
`
`
`
`
`
`of a digital signal processor of FIG. 3;
`
`
`
`
`
`
`[0017] FIG. 5 is a flow chart illustrating an algorithm of
`
`
`
`
`performing a preview mode of FIG. 4;
`
`
`
`
`
`[0018] FIG. 6 is a flowchart illustrating an algorithm of
`
`
`
`
`
`performing a still-image photographing mode of FIG. 4;
`
`
`
`
`
`
`[0019] FIG. 7 is a flowchart illustrating an algorithm of
`
`
`
`
`
`performing a moving-image photographing mode of FIG. 4;
`
`
`
`
`
`
`
`[0020] FIG. 8 is a block diagram of the structure of a
`
`
`
`
`
`
`
`moving-image file obtained by performing the moving-
`
`
`
`
`
`image photographing mode of FIG. 4; and
`
`
`
`
`
`[0021] FIG. 9 is a flowchart illustrating an algorithm of
`
`
`
`
`performing a reproducing mode of FIG. 4.
`
`DETAILED DESCRIPTION OF THE
`
`
`INVENTION
`
`
`
`
`
`
`
`
`
`
`
`
`the front part of a digital
`[0022] Referring to FIG. 1,
`
`
`
`
`
`
`photographing apparatus 1 according to the present inven-
`
`
`
`
`
`
`
`tion includes a microphone MIC, a self-timer lamp 11, a
`
`
`
`
`
`
`
`
`
`flash 12, a shutter release button 13, a viewfinder 17a, a flash
`
`
`
`
`
`
`
`
`
`
`light intensity sensor 19, a power switch 31, a lens unit 20,
`and a remote receiver 41.
`
`
`
`
`
`
`
`
`
`
`
`
`[0023]
`In a self-timer mode, the self-timer lamp 11 oper-
`
`
`
`
`
`
`
`
`
`ates for a set period of time from when the shutter release
`
`
`
`
`
`
`button 13 is pressed to when an image starts to be captured.
`
`
`
`
`
`
`
`
`
`When the flash 12 operates, the flash light intensity sensor
`
`
`
`
`
`
`
`
`19 senses the intensity of the light generated by the flash 12
`
`
`
`
`
`
`
`
`
`and relays the sensed intensity of the light to a digital signal
`
`
`
`
`
`
`processor (DSP) 507 of FIG. 3 via a micro-controller 512 of
`
`
`
`
`
`
`
`FIG. 3. The remote receiver 41 receives command signals,
`
`APPL-1042/ Page 11 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 11 of 16
`Apple v. Corephotonics
`
`

`

`
`
`US 2006/0023083 A1
`
`
`Feb. 2, 2006
`
`
`
`
`
`
`
`
`
`for example, a photographing command signal, and relays
`
`
`
`
`
`the photographing command signal to the micro-controller
`512.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0024] The shutter release button 13 has two levels. In
`
`
`
`
`
`
`
`other words, referring to FIGS. 6 and 7, after operating a
`
`
`
`
`
`
`
`wide angle-zoom button 39W and a telephoto-zoom button
`
`
`
`
`
`
`
`
`
`39T when a user lightly depresses the shutter release button
`
`
`
`
`
`
`
`
`
`13 'to a first level, a first level signal $1 from the shutter
`
`
`
`
`
`
`
`
`release button 13 is turned on. When the user fully depresses
`
`
`
`
`
`
`
`
`the shutter release button 13 to a second level, a second level
`
`
`
`
`
`
`
`signal S2 of the shutter release button 13 is turned on.
`
`
`
`
`
`
`
`
`[0025] Referring to FIG. 2, the back of the digital camera
`
`
`
`
`
`
`
`
`
`1 according to the present invention includes a mode dial 14,
`
`
`
`
`
`
`
`functional buttons 15, a manual focusing/deleting button 36,
`
`
`
`
`
`a manual adjusting/reproducing/terminating button 37, a
`
`
`
`
`
`
`
`
`reproducing mode button 42, a speaker SP, a monitor button
`
`
`
`
`
`
`
`
`32, an automatic focusing lamp 33, a viewfinder 17b, a flash
`
`
`
`
`
`
`
`
`
`
`standby lamp 34, a color LCD panel 35, the wide angle-
`
`
`
`
`
`
`
`zoom button 39W, the telephoto-zoom button 39T, and an
`external interface unit 21.
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0026] The mode dial 14 is used for selecting any one of
`
`
`
`
`
`
`
`
`the operating modes of the digital camera 1 such as a simple
`
`
`
`
`
`photographing mode, a program photographing mode, a
`
`
`
`
`
`
`character photographing mode, a night view photographing
`
`
`
`
`
`mode, a manual photographing mode, a moving-image
`
`
`
`
`
`
`
`photographing mode 14MP, a user setting mode 14My, and
`
`
`
`
`a recording mode 14V.
`
`
`
`
`
`
`[0027] After selecting the moving-image photographing
`
`
`
`
`
`
`
`
`
`mode 14MP, when a user presses the shutter release button
`
`
`
`
`
`
`
`
`13, a moving-image file is created in a storage medium, i.e.,
`
`
`
`
`
`
`
`
`
`
`a memory card. The data of the initial frame, which is used
`
`
`
`
`
`
`
`to display a representative image, and moving-image data
`
`
`
`
`
`
`
`
`are stored in the moving-image file. When the user presses
`
`
`
`
`
`
`
`
`the shutter release button 13 again, the moving-image data
`
`
`
`
`
`
`
`
`
`being input stops being stored, and the moving-image file is
`
`
`
`
`
`
`
`set. The moving-image photographing mode 14MP will be
`described in detail later with reference to FIG. 7.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0028] The user setting mode 14MY indicates an operating
`
`
`
`
`
`
`
`
`mode for specifying the photographic settings for a still-
`
`
`
`
`
`
`image or moving-image photographing mode. The recording
`
`
`
`
`
`
`
`
`mode 14V is for recording only sounds, such as a user’s
`
`
`
`
`
`
`
`
`
`voice. After selecting the recording mode 14V, when a user
`
`
`
`
`
`
`
`
`
`presses the shutter release button, an audio file is created in
`
`
`
`
`
`
`
`
`
`
`the memory card and input audio data is stored in the audio
`
`
`
`
`
`
`
`
`
`file. When the user presses the shutter release button 13
`
`
`
`
`
`
`
`
`
`
`again, the audio data stops being stored, and the audio file is
`set.
`
`
`
`
`
`
`
`
`
`
`[0029] The functional buttons 15 are used for operating
`
`
`
`
`
`
`
`
`specific functions of the digital camera 1. The functional
`
`
`
`
`
`
`
`
`buttons 15 are also used as control buttons to manage the
`movement of an active cursor on the menu screen of the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`color LCD panel 35. For example, in the still mode or the
`
`
`
`
`
`
`moving-image photographing mode 14MP, a user may set
`
`
`
`
`
`automatic proximity focusing by pressing a macro/move
`
`
`
`
`
`
`
`
`
`down button 151,. Also, after selecting a specific option from
`
`
`
`
`
`
`a menu/select-confirm button 15M, the macro/move-down
`
`
`
`
`
`
`button 15P can be used to move the cursor down.
`
`
`
`
`
`[0030] When a user presses a voice-memo/move-up but-
`
`
`
`
`
`
`ton 15R, a 10 second recording is possible upon consecutive
`
`
`
`
`
`
`photographing. Also, after selecting a specific option from
`
`
`
`
`the menu/select-confirm button 15M, the voice-memo/move-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`up button 15R can be used to move the cursor up. If the user
`
`
`
`
`
`
`presses the menu/select-confirm button 15M when the active
`
`
`
`
`
`cursor is on a selection menu, the operation corresponding
`
`
`
`
`
`to the selection menu is performed.
`
`
`
`
`[0031] The manual
`adjusting/reproducing/terminating
`
`
`
`
`
`
`
`button 37 is used for manual adjustment of specific condi-
`
`
`
`
`
`
`
`
`tions. In addition, when a user presses the manual adjusting/
`
`
`
`
`
`reproducing/terminating button 37, a selected moving-im-
`
`
`
`
`
`
`
`age file may be reproduced or its reproduction may be
`terminated.
`
`
`
`
`
`
`
`[0032] The manual focusing/deleting button 36 is used for
`
`
`
`
`
`
`manual focusing or deleting in the photographing mode.
`
`
`
`
`
`
`
`
`[0033] The monitor button 32 is used for controlling the
`
`
`
`
`
`
`
`
`
`operation of the color LCD panel 35. For example, in the
`
`
`
`
`
`
`
`
`photographing mode, when the user presses the monitor
`
`
`
`
`
`
`
`button 32, an image of a subject and photographing infor-
`
`
`
`
`
`
`
`
`
`mation are displayed on the color LCD panel 35. When the
`
`
`
`
`
`
`
`
`
`user presses the monitor button 32 again, the color LCD
`
`
`
`
`
`
`
`
`panel 35 is turned off. In the reproducing mode, when the
`
`
`
`
`
`
`
`
`
`user presses the monitor button 32 while an image file is
`
`
`
`
`
`
`being reproduced, photographing information about
`the
`
`
`
`
`
`
`
`
`
`image file is displayed on the color LCD panel 35. When the
`
`
`
`
`
`
`
`
`
`user presses the monitor button 32 again, only pure images
`
`
`are displayed.
`
`
`
`
`
`
`
`
`[0034] The reproducing mode button 42 is used for
`
`
`
`
`
`
`
`switching between a reproducing mode and a preview mode.
`
`
`
`
`
`
`
`[0035] The automatic focusing lamp 33 operates when a
`
`
`
`
`
`
`
`
`focus is well adjusted. The flash standby lamp 34 operates
`
`
`
`
`
`
`
`when the flash 12 of FIG. 1 is in a standby mode. A mode
`
`
`
`
`
`
`
`indicating lamp 14L indicates a selection mode of the mode
`dial 14.
`
`
`
`
`
`
`
`
`
`
`[0036] FIG. 3 is a schematic diagram of the entire con-
`
`
`
`
`
`
`
`
`
`figuration of the digital camera 1 of FIG. 1. The entire
`
`
`
`
`
`
`
`configuration and operation of the digital camera 1 of FIG.
`
`
`
`
`
`
`
`1 will be described with reference to FIGS. 1 through 3 in
`
`
`the following.
`
`
`
`
`
`
`
`
`
`[0037] An optical system (OPS) including the lens unit 20
`
`
`
`
`
`
`
`
`
`and a filter unit optically processes light. The lens unit 20 of
`
`
`
`
`
`
`
`
`
`the OPS includes a zoom lens, a focus lens, and a compen-
`sation lens.
`
`
`
`
`
`
`
`
`
`[0038] When the user presses the wide angle-zoom button
`
`
`
`
`
`
`39W or the telephoto-zoom button 39T included in a user
`
`
`
`
`
`
`
`input unit (INP), a signal corresponding to the wide angle-
`
`
`
`
`
`
`
`
`zoom button 39W or the telephoto-zoom button 39T is
`
`
`
`
`
`relayed to the micro-controller 512. The micro-controller
`
`
`
`
`
`
`
`512 controls a lens driver 510, thereby running a zoom
`
`
`
`
`
`
`
`
`
`motor MZ, which, in turn, moves the zoom lens. In other
`
`
`
`
`
`
`
`words, when the user presses the wide angle-zoom button
`
`
`
`
`
`
`
`
`the focal
`length of the zoom lens becomes short,
`39W,
`
`
`
`
`
`
`
`thereby widening the angle of view. When the user presses
`
`
`
`
`
`
`
`the telephoto-zoom button 39T, the focal length of the zoom
`
`
`
`
`
`
`
`
`lens becomes long, thereby narrowing the angle of view.
`
`
`
`
`
`
`
`
`Since the position of the focus lens is adjusted in a state
`
`
`
`
`
`
`
`
`
`where the position of the zoom lens is set, the angle of view
`
`
`
`
`
`
`
`is hardly affected by the position of the focus lens.
`
`
`
`
`
`
`
`
`[0039]
`In the automatic focusing mode, a main controller
`
`
`
`
`
`
`
`
`
`
`
`built into the DSP 507 controls the lens driver 510 through
`
`
`
`
`
`
`
`the micro-controller 512, thereby driving a focus motor MF.
`
`
`
`
`
`
`
`
`Accordingly, the focus lens is moved, and, in this process,
`
`
`
`
`
`
`
`
`
`
`the position of the focus lens, having the largest high
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`APPL—1042/ Page 12 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 12 of 16
`Apple v. Corephotonics
`
`

`

`
`
`US 2006/0023083 A1
`
`
`Feb. 2, 2006
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`frequency component of an image signal is set. This position
`
`
`
`
`
`
`may, for example, correlate to a certain number of driving
`
`
`
`
`steps of the focus motor MF.
`
`
`
`
`
`
`
`
`[0040] The compensation lens in the lens unit 20 of the
`
`
`
`
`
`
`
`OPS is not separately operated because the compensation
`
`
`
`
`
`
`
`
`lens compensates for the entire refractive index. Areference
`
`
`
`
`
`
`
`numeral MA indicates a motor for driving an aperture (not
`
`shown).
`
`
`
`
`
`
`
`
`
`[0041] An optical low pass filter included in the filter unit
`
`
`
`
`
`
`
`
`of the OPS eliminates high frequency optical noise. An
`infrared cut filter included in the filter unit of the OPS blocks
`
`
`
`
`
`
`
`
`
`
`
`
`
`the infrared component of incident light.
`
`
`
`
`
`
`
`[0042] Aphotoelectric conversion unit (OEC) of a charge
`
`
`
`
`
`
`
`coupled device or a complementary metal oxide (CMOS)
`
`
`
`
`
`
`
`
`semiconductor converts light from the OPS into an analog
`
`
`
`
`
`
`
`
`electrical signal. Here, the DSP 507 controls a timing circuit
`
`
`
`
`
`
`
`502 to control the operations of the OEC and a correlation-
`
`
`
`(CDS-
`double-sampler-and-analog-to-digital
`converter
`
`
`
`
`
`
`
`ADC) 501. The CDS-ADC 501 processes an analog signal
`
`
`
`
`
`
`
`
`from the OEC, eliminates high frequency noise, adjusts
`
`
`
`
`
`
`
`
`
`amplitude, and then converts the analog signal into a digital
`
`signal.
`
`
`
`
`
`
`
`
`[0043] A real time clock (RTC) 503 provides time infor-
`
`
`
`
`
`
`
`
`
`mation to the DSP 507. The DSP 507 processes the digital
`
`
`
`
`
`
`
`signal from the CDS-ADC 501 and generates a digital image
`
`
`
`
`
`composed of luminance and chromaticity values.
`
`
`
`
`
`
`[0044] A light source (LAMP) is operated by the micro-
`
`
`
`
`
`
`controller 512 in response to a control signal generated by
`
`
`
`
`
`
`
`
`
`the DSP 507 including the main controller. The light source
`
`
`
`
`
`
`
`
`(LAMP) includes the self-timer lamp 11,
`the automatic
`
`
`
`
`
`
`
`
`
`
`focusing lamp 33, the mode indicating lamp 14L, and the
`
`
`
`
`
`
`
`
`
`
`flash standby lamp 34. The INP includes the shutter release
`
`
`
`
`
`
`
`
`
`
`
`button 13, the mode dial 14, the functional buttons 15, the
`
`
`
`
`
`
`
`
`monitor button 32, the manual focusing/deleting button 36,
`
`
`
`
`
`
`the manual adjusting/reproducing/terminating button 37, the
`
`
`
`
`
`
`wide angle-zoom button 39W, and the telephoto-zoom button
`
`39T.
`
`
`
`
`
`
`
`
`[0045] A dynamic random access memory (DRAM) 504
`
`
`
`
`
`
`
`
`
`temporarily stores a digital image signal from the DSP 507.
`
`
`
`
`
`
`
`An electrically erasable and programmable read only
`
`
`
`
`
`
`
`memory (EEPROM) 505 stores algorithm and setting data.
`
`
`
`
`
`
`
`A user’s memory card is inserted or removed in a memory
`
`
`
`
`
`
`
`
`
`
`card interface (MCI) 506. The digital image signal from the
`
`
`
`
`
`
`
`
`DSP 507 is input to an LCD driver 514, thereby displaying
`
`
`
`
`
`
`
`an image on the color LCD panel 35.
`
`
`
`
`
`
`
`
`
`
`[0046] The digital image signal from the DSP 507 can be
`transmitted as serial communications via a universal serial
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`bus (USB) connector 21a or via an RSZ32C interface 508
`
`
`
`
`
`
`
`
`
`and an RSZ32C connector 21b. The digital image signal
`
`
`
`
`
`
`
`
`from the DSP 507 can also be transmitted as a video signal
`
`
`
`
`
`
`
`
`
`
`
`via a video filter 509 and a video output unit 21C. Here, the
`DSP 507 includes the main controller.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0047] An audio processor 513 can relay sound from the
`
`
`
`
`
`
`
`
`microphone MIC to the DSP 507 or to speaker SP. In
`
`
`
`
`
`
`
`
`
`addition, the audio processor 513 can output an audio signal
`
`
`
`
`
`
`
`
`
`from the DSP 507 to the speaker SP. The micro-controller
`
`
`
`
`
`
`
`
`512 controls the operation of a flash controller 511 in
`
`
`
`
`
`
`
`
`
`response to a signal from the flash light intensity sensor 19,
`
`
`
`
`
`thereby driving the flash 12.
`
`
`
`
`
`
`
`
`
`[0048] A main algorithm of the DSP 507 of FIG. 3 will
`
`
`
`
`
`
`now be described with reference to FIGS. 1 through 4.
`
`
`
`
`
`
`
`[0049] When power is applied to the digital photographing
`
`
`
`
`
`
`
`
`apparatus 1,
`the DSP 507 is initialized (Sl). After the
`
`
`
`
`
`
`
`initialization ($1), the DSP 507 performs a preview mode
`
`
`
`
`
`
`
`(S2). In the preview mode, an image input is displayed on
`
`
`
`
`
`
`
`
`the display panel 35. An operation related to the preview
`mode will be described in detail later with reference to FIG.
`
`
`
`
`
`
`
`
`5.
`
`
`
`
`
`
`
`
`
`
`
`[0050] When the first level signal $1 from the shutter
`
`
`
`
`
`
`
`
`release button 13 is on after a user pressed the shutter release
`
`
`
`
`
`
`
`
`button 13 to the first level, the DSP 507 identifies a current
`
`
`
`
`
`
`
`operating mode (S3). Hereinafter, a description of the
`
`
`
`
`
`
`
`
`recording mode will be omitted. The DSP 507 performs the
`
`
`
`
`
`
`still-image photographing mode or the moving-image pho-
`
`
`
`
`
`
`tographing mode depending on the chosen current operation
`
`
`
`
`
`
`
`mode (Steps S41 or S42). The still-image photographing
`
`
`
`
`
`
`
`mode (S41) algorithm will be described with reference to
`
`
`
`
`
`
`FIG. 6. The moving-image photographing mode (S42)
`
`
`
`
`
`
`
`algorithm will be described with reference to FIGS. 7 and
`8.
`
`
`
`
`
`
`
`
`
`
`
`[0051] When INP generated signals corresponding to a
`
`
`
`
`
`
`
`
`
`setting mode are input (SS), the setting mode, wherein an
`
`
`
`
`
`
`
`
`operating condition is set in response to the input signals
`
`
`
`
`
`
`
`
`
`
`from the INP, is performed (S6). In the next step (S7), it is
`
`
`
`
`
`
`
`determined whether a termination signal has been generated.
`
`
`
`
`
`
`
`When a termination signal is not generated, the DSP 507
`
`
`
`
`
`continues to perform the following step.
`
`
`
`
`
`
`
`[0052] When a signal is generated by the reproducing
`
`
`
`
`
`
`
`
`mode button 42 in the INP (SS), a reproducing mode is
`
`
`
`
`
`
`
`performed (S9). In the reproducing mode, reproducing is
`
`
`
`
`
`
`
`
`performed in response to input signals from the INP. The
`
`
`
`
`
`
`
`
`reproducing mode (S9) algorithm will be described later
`
`
`
`
`
`
`
`with reference to FIG. 9. When the reproducing mode is
`
`
`
`
`
`
`terminated, the above steps are repeated.
`
`
`
`
`
`
`
`
`[0053] The preview mode (S2) algorithm of FIG. 4 will
`
`
`
`
`
`
`now be described with reference to FIGS. 1 through 3 and
`FIG. 5.
`
`
`
`
`
`
`
`
`
`[0054] The DSP 507 performs automatic white balancing
`
`
`
`
`
`
`
`
`
`(AWB) and sets parameters related to the white balance
`
`
`
`
`
`
`
`
`
`(S201). In the automatic exposure mode (S202), the DSP
`
`
`
`
`
`
`
`
`507 calculates the exposure by measuring incident lumi-
`
`
`
`
`
`
`
`
`nance, drives the aperture driving motor MA according to the
`
`
`
`
`
`
`
`calculated exposure, and sets a shutter speed (S203).
`
`
`
`
`
`
`[0055] The DSP 507 performs gamma correction on input
`
`
`
`
`
`
`
`
`image data (S204) and scales the gamma corrected image
`
`
`
`
`
`
`
`data to meet display standards (S205). The DSP 507 con-
`
`
`
`
`
`
`
`
`
`verts the scaled input image data from an RGB (red, green,
`
`
`
`
`
`and blue)
`format
`into a luminance-chromaticity format
`
`
`
`
`
`
`
`
`(S206). The DSP 507 processes the input
`image data
`
`
`
`
`
`
`
`depending on resolution and display location and also filters
`
`
`
`
`
`the input image data (S207).
`
`
`
`
`
`
`
`
`
`[0056] The DSP 507 temporarily stores the input image
`
`
`
`
`
`
`
`data in the DRAM 504 of FIG. 3 (S208). The DSP 507
`
`
`
`
`
`
`
`synthesizes the data temporarily stored in the DRAM 504 of
`
`
`
`
`
`
`
`
`
`FIG. 3 and on-screen display (OSD) data (S209). The DSP
`
`
`
`
`
`
`
`
`
`507 converts the synthesized image data from the RGB
`
`
`
`
`
`
`
`format into the luminance-chromaticity format (S210) and
`
`
`
`
`
`
`
`
`
`
`outputs the image data in the converted format via the LCD
`
`
`
`
`driver 514 of FIG. 3 (S211).
`
`
`
`
`
`
`
`
`
`APPL—1042/ Page 13 of 16
`Apple v. Corephotonics
`
`APPL-1042 / Page 13 of 16
`Apple v. Corephotonics
`
`

`

`
`
`US 2006/0023083 A1
`
`
`Feb. 2, 2006
`
`
`
`
`
`
`
`
`
`
`[0057] FIG. 6 illustrates an algorithm of performing the
`
`
`
`
`
`
`
`still-image photographing mode of FIG. 4 (S41). The still-
`
`
`
`
`
`
`
`image photographing mode (S41) algorithm will now be
`
`
`
`
`
`
`
`described with reference to FIGS. 1 through 3 and FIG. 6.
`
`
`
`
`
`
`
`
`
`Here, the present position of the zoom lens is alread