USOO7365780B1
`
`(12) United States Patent
`Miyazaki
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,365,780 B1
`Apr. 29, 2008
`
`(54) IMAGE PICKUP APPARATUS FOR
`PRODUCING A DESIRED FRAME OF
`IMAGE SIGNALS
`
`(75) Inventor: Takao Miyazaki, Asaka (JP)
`(73) Assignee: Fujifilm Corporation, Kanagawa (JP)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 798 days.
`(21) Appl. No.: 09/656,995
`(22) Filed:
`Sep. 7, 2000
`(30)
`Foreign Application Priority Data
`Sep. 14, 1999 (JP)
`................................. 11-259867
`
`(51) Int. Cl.
`(2006.01)
`H04N 5/76
`(2006.01)
`H04N 5/235
`(52) U.S. Cl. .................................... 348/231.6; 348/362
`(58) Field of Classification Search ........... 348/231.99,
`348/231.6, 231.1, 231.9, 221.1
`See application file for complete search history.
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`5,272.498 A * 12/1993 Wakabayashi .............. 396/320
`5,576,759 A * 11/1996 Kawamura et al. ... 348/207.99
`6,359,649 B1* 3/2002 Suzuki .................... 348,220.1
`6,518.999 B1* 2/2003 Miyamoto ......
`... 348,220.1
`6,533,976 B1* 3/2003 Strasser et al. ............... 264/87
`6,549,232 B1 * 4/2003 Taniguchi et al. ..... 348,231.99
`6,734,910 B1* 5/2004 Yumoto et al. ........ 348,333.12
`2002/0057352 A1* 5/2002 Yamagishi ............... 348,231.6
`FOREIGN PATENT DOCUMENTS
`
`JP
`
`64-042639
`
`2, 1989
`
`JP
`JP
`JP
`JP
`JP
`
`O1-277829
`A9205605
`10-25737O A
`11-088761
`11-220638 A
`
`11, 1989
`8, 1997
`9, 1998
`3, 1999
`8, 1999
`
`OTHER PUBLICATIONS
`
`Sony Corporation, Digital Still Camera DSC-F1. pp. 18-19, 1996.
`* cited by examiner
`Primary Examiner David Ometz
`Assistant Examiner—Luong T. Nguyen
`(74) Attorney, Agent, or Firm—Birch, Stewart, Kolasch &
`Birch, LLP
`
`(57)
`
`ABSTRACT
`
`An image pickup apparatus capable of outputting one of
`Successive pictures that is picked up at a desired timing.
`When the operator of the apparatus selects a continuous
`shoot mode, sets a mode dial at a “Pre (prior)/Post (poste
`rior) position, and then presses a release button to a
`half-stroke position, the apparatus picks up a desired scene
`at preselected intervals. Up to nine latest frames of image
`data are written to a main memory while being sequentially
`updated. Subsequently, when the operator presses the release
`button to a full-stroke position, up to five additional latest
`frames of image data are written to the main memory. The
`image data stored in the main memory are read out and
`transformed to display data. The display data appear on an
`LCD (Liquid Crystal Display)panel in a multiframe format.
`When the operator, watching pictures appearing on the LCD
`panel, selects desired one of the pictures by operating
`preselected Switches arranged on an operation panel, the
`image data representative of the above picture is recorded in
`an external memory removably mounted to the apparatus.
`
`18 Claims, 22 Drawing Sheets
`
`
`
`
`
`64
`
`12
`
`14
`
`40
`
`42
`
`OPTICS
`
`OPICS
`DRIVER
`
`CCD
`DRIVER
`
`IMER
`
`18
`
`OPERATION
`PANEL
`
`60
`VIEW
`FINDER
`SENSOR
`
`SYSTEM
`CONTROLLER
`
`38
`
`56
`
`LCD DRIVER
`
`
`
`44
`
`DIGITAL
`
`PROCESSOR
`
`46
`
`MEMORY
`NROLER
`52
`
`COMPRESSION/
`EXPANSION CK
`
`
`
`MEMORY
`
`EXTERNAL
`
`16
`
`ENCOOSER
`
`
`Ex.1006 / Page 1 of 35Ex.1006 / Page 1 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 1 of 22
`
`US 7,365,780 B1
`
`O |
`
`
`
`No.
`|×
`
`Z
`
`O
`
`OT}~ 99
`
`|SOCH/E}}d
`
`LS?d | àdd
`
`/\
`
`
`Ex.1006 / Page 2 of 35Ex.1006 / Page 2 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 2 of 22
`
`US 7,365,780 B1
`
`87
`
`}}BC]OONE
`OSIN
`
`99
`
`92
`
`OOT,
`
`HOSS3OOHd
`
`T\/NOIS
`TWILI 9IC]
`
`
`
`OOWSOOOOO
`
`SOILCHO
`
`Z |
`
`
`
`| )40 NOISN\/c}XE
`
`/NOISSEHdWNOO
`
`WELSÅS
`
`HETTIOHINOO
`
`09
`
`8€
`
`NOI_1\/HEjdO
`
`8 |
`
`97
`
`HOEWNI?
`
`H-BAIHO
`OOO
`
`09
`
`HEICINI-}
`MBIA
`
`BOSNES ?N ºg
`
`
`
`
`
`
`
`
`
`
`
`
`Ex.1006 / Page 3 of 35Ex.1006 / Page 3 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 3 of 22
`
`US 7,365,780 B1
`
`Aig. 3
`
`ST(H)
`
`1/3O SEC
`
`EXPOSURE TIME
`ST a 1/3O SEC
`
`EXPOSURE TIME
`ST ) 1/3O SEC
`
`
`
`ras - m an a ran run as as are was
`
`a -n
`
`
`Ex.1006 / Page 4 of 35Ex.1006 / Page 4 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 4 of 22
`
`US 7,365,780 B1
`
`Aig. 4
`
`4O3
`
`
`
`SHOOT MODE
`4OO
`
`TO SINGLE
`SHOOT MODE
`
`NO
`
`CONTINUOUS
`SOO, MODE
`YES
`CONFIRMATION OF SET MODE
`
`4O2
`
`PICKUP FOR MONITORINGN-4O4
`
`
`
`
`
`
`
`CHANGE OR
`SETING
`
`4O8
`
`OETERMINE At
`
`41 O
`
`START TIMER
`
`412
`
`
`
`
`
`
`
`CONTROL OVER PICKUP,
`STORAGE, PICTURE SELECTION 44
`AND RECORDING
`
`416
`
`
`
`
`
`ANOTHER MODE
`SELECTED OR POWER
`SWITCH 62 TURNED
`OFF
`YES
`END
`
`
`Ex.1006 / Page 5 of 35Ex.1006 / Page 5 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet S of 22
`
`US 7,365,780 B1
`
`Fig. 5
`
`FROM STEP 412
`
`yALIDATEACCEPTANCE-500
`OF INTERRUPT
`
`INTERRUPT
`PROCESSING a
`
`5O2
`
`JNVALIDATEACCEPTANCE-504
`OF INTERRUPT
`
`DISPLAY 9 PICTURES PICKED
`UP AT t--8At TO O
`
`5O6
`
`also
`
`SELECTED
`
`
`
`
`
`
`
`508
`
`YES
`RECORD PICTURE SELECTED
`IN MEMORY 16
`
`51 O
`
`TO STEP 416
`
`
`Ex.1006 / Page 6 of 35Ex.1006 / Page 6 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 6 of 22
`
`US 7,365,780 B1
`
`Aig. 6
`START OF INTERRUPT
`PROCESSING a
`
`INITIALIZE COUNTER
`TO "O"
`
`6OO
`
`ACCEPTANCE
`OF INTERRUPT
`VALID
`
`INTERRUPT
`QSTECTED
`
`NO
`
`START PICKUP CONTROL-- 6O6
`
`INCREMENT COUNTER BY 1
`
`608
`
`614
`
`DELETE OLDEST IMAGE
`PRESENT IN MEMORY 24
`
`
`
`
`
`
`
`
`
`
`
`STQBEMASE IN-u512
`MEMORY 24
`616
`
`to Sos YES
`
`TO NEXT STEP
`
`
`Ex.1006 / Page 7 of 35Ex.1006 / Page 7 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 7 of 22
`
`US 7,365,780 B1
`
`Fig. 7
`
`FROM STEP 412
`yALPAIEACCEPTANCE-700
`OF INTERRUPT
`
`INTERRUPT
`PROCESSING a
`
`7O2
`
`INITIALIZE REGISTER
`
`INTERRUP
`PROCESSING b
`
`7O6
`
`INCREMENT REGISTER
`i BY 1
`
`
`
`708
`
`71 O
`
`S52)
`
`YES
`INVALIDATE ACCEPTANCE
`OF INTERRUPT
`
`712
`
`DISPLAY 9 PICTURES PICKED
`UP AT t--4At TO 4At
`
`714.
`
`
`
`
`
`
`
`SELECTED
`9
`YES
`RECORD PICTURE SELECTED
`IN MEMORY 16
`
`6
`71
`
`TO STEP 416
`
`718
`
`
`Ex.1006 / Page 8 of 35Ex.1006 / Page 8 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 8 of 22
`
`US 7,365,780 B1
`
`Fig. 6
`
`INTERRUPT
`PROCESSING b
`
`
`
`ACCEPTANCE
`OF INTERRUPT
`VALID
`YES
`
`8OO
`
`
`
`INTERRUPT
`QETECTED
`YES
`START PICKUP CONTROL-N- 804
`
`INCREMENT COUNTER BY 1
`
`8O6
`
`DELETE OLDEST PICTURE
`PRESENT IN MEMORY 24
`
`8O8
`
`
`
`
`
`
`
`NO
`
`STOBE MAGE IN us12
`MEMORY 24
`
`TO NEXT STEP
`
`
`Ex.1006 / Page 9 of 35Ex.1006 / Page 9 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 9 of 22
`
`US 7,365,780 B1
`
`Aig. 9
`
`YES
`VALIDATE ACCEPTANCE OF INTERRUPTY-902
`
`INITIALIZE REGISTER i TO O"
`
`904
`
`
`
`
`
`INTERRUPT
`DETECTED 2
`YES
`PICKUP CONTROL & STORAGE
`IN MEMORY
`
`906
`
`908
`
`INCREMENT REGISTER i BY 1
`
`91 O
`
`912
`
`REGISTER
`is 92
`YES
`INVALIDATE ACCEPTANCE
`OF INTERRUPT
`
`914
`
`DISPLAY 9 PICTURES PICKED
`UP AT t-O TO 8At
`
`916
`
`
`
`PICTURE
`
`SSLECTED
`YES
`RECORDPSTURE SELECTED --92
`IN MEMORY 16
`
`TO STEP 416
`
`
`Ex.1006 / Page 10 of 35Ex.1006 / Page 10 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 10 of 22
`
`US 7,365,780 B1
`
`Fig. 10
`FROM STEP 412
`yALPAEACCEPTANCE - 1000
`OF INTERRUPT
`
`INTERRUPT
`PROCESSING a
`
`1 OO2
`
`INITIALIZE REGISTER i TO OhN-1 OO4
`
`INTERRUPT
`PROCESSING b
`
`1 OO6
`
`
`
`INCREMENT REGISTER i BY
`
`1
`
`1 OO8
`
`<5d 1 O1 O
`YES
`INVALIDATE ACCEPTANCE
`OF INTERRUPT
`
`1 O12
`
`READ 9 PICTURE OUT OF
`MEMORY 16
`
`1 O14
`
`DISPLAY 9 PICTURESPICKED-1016
`UP A t=-4At TO 4At
`
`PICTURE
`SELESTED
`ES 1 O18
`DELETE PICTURES OHER THAN PICTURE
`SELECTED IN MEMORY 16
`
`1 O2O
`
`TO SEP 416
`
`
`Ex.1006 / Page 11 of 35Ex.1006 / Page 11 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 11 of 22
`
`US 7,365,780 B1
`
`Aig. 11
`
`START OF INTERRUPT
`PROCESSING a
`
`INITIALIZE COUNTER
`TO O"
`
`11 OO
`
`ACCEPTANCE
`OF INTERRUPT
`VALID
`
`INTERRUPT
`QSTECT59
`
`START PICKUP CONTROL-N-1 106
`
`INCREMENT COUNTER BY 1
`11 1 O
`YES
`
`11 O8
`
`1114
`
`DELETE OLDEST IMAGE
`PRESENT IN MEMORY 16
`
`1 112
`
`RECORD IMAGE
`IN MEMORY 16
`1 16
`
`so-S) YES
`
`
`
`
`
`
`
`
`
`
`
`TO NEXT STEP
`
`
`Ex.1006 / Page 12 of 35Ex.1006 / Page 12 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 12 of 22
`
`US 7,365,780 B1
`
`Fig. 12
`
`START OF INTERRUPT
`PROCESSING b
`
`ACCEPTANCE
`OF INTERRUPT
`VALID
`
`YES
`
`
`
`
`
`
`
`INTERRUPT
`QETECTED
`YES
`
`START PICKUP CONTROL
`
`12O3
`
`INCREMENT COUNTER BY 1
`
`1204
`
`12O6
`YES
`
`
`
`12O8
`
`
`
`NO
`
`
`
`DELETE OLDEST PICTURE
`PRESENT IN MEMORY 6
`
`RECORD PICTURE
`IN MEMORY 16
`
`121 O
`
`TO NEXT STEP
`
`
`Ex.1006 / Page 13 of 35Ex.1006 / Page 13 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 13 of 22
`
`US 7,365,780 B1
`
`
`
`
`
`OG BEMOED, 29|×
`
`|SOdE}}}d
`
`
`Ex.1006 / Page 14 of 35Ex.1006 / Page 14 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 14 of 22
`
`US 7,365,780 B1
`
`N
`VN
`
`S.
`
`
`HOSSE OOHc]
`
`T\/] [9IC]
`TV/NS) IS
`
`/NOISSEHdWOO
`
`,\!HOWE'WWELSÅS
`
`HETTIOHINOOBETTIOHINOO
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`HEGIOONE
`
`
`
`OS LNHE/\IHO OOTOOT
`
`97999Z4 \
`
`
`Ex.1006 / Page 15 of 35Ex.1006 / Page 15 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 15 of 22
`
`US 7,365,780 B1
`
`Aig. 75
`
`FROM STEP 412
`
`15OO
`
`VALIDATE ACCEPTANCE OF INTERRUPT
`INTERRUPT PROCESSING a-- 1502
`INITIALIZE REGISTER i TO 'O' Nu-1504
`INTERRUPT PROCESSING bhN-1506
`INCREMENT REGISTER i BY 1
`1508
`
`
`
`<5> 151 O
`YES
`INVALIDATE ACCEPTANCE OF INTERRUPTN-1512
`
`DISPLAY 9 PICTURES PICKED UP AT t- -4At TO 4At Nu 1514
`
`SELECTED
`
`1516
`
`O18
`
`YES
`DISPLAY 9 PICTURES PICKED UP WITH tec - 4AEW TO 4AEV
`
`
`
`EXPOSURE LEVEL s
`SELECTED
`152O
`
`YES
`RECORD IMAGE SELECTED IN MEMORY 16
`
`1522
`
`TO STEP 416
`
`
`Ex.1006 / Page 16 of 35Ex.1006 / Page 16 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 16 of 22
`
`US 7,365,780 B1
`
`START OF INTERRUPT
`
`INITIALIZE COUNTER TO YO
`
`p Aig. 16
`16OO
`
`
`
`
`
`ACCEPTANCE OF
`NERRUPT VALID
`YES
`INTERRUPT
`DETECTED 2
`YES
`START PICKUP CONTROL-Nu 1606
`
`1604
`NO
`
`INCREMENT COUNER BY 1
`1608
`161O
`COUNTER eas YES
`DELETE 9 OLDEST PICTURES
`NO
`PRESENT IN MEMORY 24
`
`1614
`
`SET EXPOSURE LEVE TO - 4AEV
`
`1612
`
`
`
`EXPOSURE LEVEL
`> -- 4AEW
`
`
`
`YES
`TO NEXT STEP
`
`
`Ex.1006 / Page 17 of 35Ex.1006 / Page 17 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 17 of 22
`
`US 7,365,780 B1
`
`Aig. 17
`
`START OF INTERRUPT
`PROCESSING b
`
`INTERRUPT VALID
`
`YES
`
`INTERRUPT
`DETECTED
`
`17O4.
`
`YES
`INCREMENT COUNTER BY 1
`17O6
`171 O
`COUNTER > g.
`YES
`No
`DELETE 9 OLDEST PICTURES
`PRESENT IN MEMORY 24
`
`SET EXPOSURE LEVEL TO - 4AEV
`
`17O8
`
`
`
`STORE PICTURE IN MEMORY 24
`
`
`
`INCREMENT EXPOSURE LEVEL BY AEV
`
`
`
`EXPOSURE LEVEL
`D +4AEy
`YES
`TO NEXT STEP
`
`
`Ex.1006 / Page 18 of 35Ex.1006 / Page 18 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 18 of 22
`
`US 7,365,780 B1
`
`08
`
`
`
`
`Ex.1006 / Page 19 of 35Ex.1006 / Page 19 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 19 of 22
`
`US 7,365,780 B1
`
`HEGJOONE
`
`99 93
`
`}\\}'OWNEWHETTIOHINOO
`
`NIV/W/\HOWNE W
`HETTIOHINOO
`W3LSÅS
`
`/NOISSEHdWNOO
`
`09
`
`
`Ex.1006 / Page 20 of 35Ex.1006 / Page 20 of 35
`
`TESLA, INC.TESLA, INC.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 20 of 22
`
`US 7,365,780 B1
`
`Aig. 20
`
`2OOO
`
`
`
`|
`|
`|
`|
`|
`|
`|
`
`
`
`
`
`
`
`
`
`
`
`| | W)
`|
`| |
`| WZ
`| || 2 |
`| |
`| WAT
`| || 2 |
`|
`| | 2 |
`|
`|
`| ZYZ | 2
`
`
`Ex.1006 / Page 21 of 35Ex.1006 / Page 21 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 21 of 22
`
`US 7,365,780 B1
`
`403
`
`TO SINGLE
`SHOOT MODE
`
`NO
`
`
`
`
`
`Fig. 27
`
`CONTINUOUS
`SOO, MODE
`YES
`MODE SETTING
`
`4OO
`
`4O2
`
`PICKUP FOR MONITORING
`
`4O4.
`
`DETECT COMPOSITION FACTOR
`
`21 OO
`
`NO 418
`
`YES
`
`4O8
`
`41 O
`
`412
`
`COMTROL OVER PICKUP,
`STORAGE, IMAGE SELECTION
`AND RECORDING
`
`21 O2
`
`NO
`
`
`
`416
`
`
`
`
`
`
`
`ANOTHER
`MODE SELECTED
`OR POWER SWITCH 62
`URNEp OFF
`YES
`ENO
`
`
`Ex.1006 / Page 22 of 35Ex.1006 / Page 22 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 22 of 22
`
`US 7,365,780 B1
`
`Fig. 22
`
`FROM STEP 412
`
`22OO
`
`VALIDATE ACCEPTANCE OF INTERRUPT
`INTERRUPT PROCESSING air-22O2
`INITIALIZE REGISTER i TO O' Nu-2204
`INTERRUPT PROCESSING bhN-22O6
`INCREMENT REGISTER i BY 1 h-2208
`
`
`
`<5>-210
`
`YES
`INVALIDATE ACCEPTANCE OF INTERRUPT-N-2212
`
`GENERATE BILEVEL PICTURES OF 9 PICTURES N-2214
`
`DETERMINE CORRELATION BETWEEN INPUT
`BILEVELPICTURE ANDgBILEVEPICTURES hy-2216
`
`DISPLAY 9 PICTURES PICKED UP AT t--4At
`TO 4At AND CAUSE PICTURE WITH GREATEST --2218
`CORRELATION TO BLINK
`
`SELECTED
`
`222O
`
`YES
`RECORD PICTURE SELECTED IN MEMORY 16
`
`2222
`
`TO STEP .416
`
`
`Ex.1006 / Page 23 of 35Ex.1006 / Page 23 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`US 7,365,780 B1
`
`1.
`IMAGE PICKUP APPARATUS FOR
`PRODUCING A DESRED FRAME OF
`IMAGE SIGNALS
`
`BACKGROUND OF THE INVENTION
`
`10
`
`25
`
`30
`
`1. Field of the Invention
`The present invention relates to an image pickup appara
`tus for picking up a scene with an image sensor and storing
`the resulting image signal. More particularly, the present
`invention relates to an image pickup apparatus capable of
`picking up a plurality of Successive pictures in a continuous
`shoot mode.
`2. Description of the Background Art
`A digital still camera extensively used today uses a CCD
`15
`(Charge Coupled Device) image sensor or similar Solid-state
`image sensor in place of the traditional silver halide photo
`sensitive type of film. This kind of camera is capable of
`storing image data output from the image sensor in a
`semiconductor memory or similar storage and reproducing it
`on a monitor in the form of a picture. This allows the
`operator of the camera, watching the monitor, to confirm the
`result of a shot immediately after the shot. However, it is not
`easy for the operator to determine a shutter chance while
`focusing the camera on a desired subject and selecting the
`range of a shot at the same time, and then pick up the scene
`at a desired timing. For example, the operator is apt to miss
`a shutter chance due to the delay of operator's decision or
`action or the delay of operation particular to the camera. This
`brings about a release time lag between the intended time for
`shooting and the time of the actual shot.
`In light of the above, Japanese patent laid-open publica
`tion No. 205605/1997 discloses an image pickup system
`including an image pickup apparatus and a computer con
`nected to each other. Image data generated by the image
`35
`pickup apparatus earlier than the input of a shoot command
`by a period of time corresponding to the release time lag is
`input to the computer. The system measures a release time
`lag particular to the operator of the apparatus and includes
`a memory capable of storing image data to be picked up over
`the time lag. When the operator operates a shutter release
`button of the camera, image data representative of the oldest
`picture existing in an image buffer of the camera is displayed
`and written to an auxiliary memory.
`The release time lag, however, depends on the person to
`operate the image pickup apparatus. The prior art system,
`therefore, must measure the time lag every time the person
`to operate the camera or the shooting conditions change.
`Moreover, even the picture taken with due consideration
`given to the release time lag is not always a picture picked
`up at a desired timing or shutter chance.
`To allow the operator of a digital still camera to surely
`take a picture at a desired timing, the camera may be
`constructed to continuously pick up a desired scene while
`sequentially recording the resulting Successive pictures in a
`memory in the same manner as a movie camera. However,
`simply picking up Successive pictures and storing the whole
`data representative of the pictures not only wastes the
`limited capacity of the memory, but also increases process
`ing loads. This makes it difficult to implement a digital
`camera capable of producing high-quality still pictures.
`
`40
`
`45
`
`50
`
`55
`
`60
`
`SUMMARY OF THE INVENTION
`
`It is therefore an object of the present invention to provide
`an image pickup apparatus capable of Surely outputting a
`picture picked up at a desired timing.
`
`65
`
`2
`An image pickup apparatus of the present invention
`includes an image sensor for picking up a scene in accor
`dance with a control signal to thereby output an image signal
`representative of the scene, and a storage for storing a
`plurality of frames of image signals. A selecting device
`allows the operator of the apparatus to select desired one of
`the frames of image signals stored in the storage. Outputting
`circuitry reads the one frame of image signal selected by the
`operator out of the storage and outputs the one frame of
`image signal. A controller outputs the above control signal
`that causes the image sensor to pick up the scene at prese
`lected intervals. The storage stores latest ones of frames of
`image signals picked up at the preselected intervals while
`sequentially updating them. The controller causes the stor
`age to hold frames of image signals picked up during a
`period of time that is based on the operation of a release
`button. The selecting device allows the operator to select any
`one of the frames of image signals held in the storage.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The objects and features of the present invention will
`become more apparent from the consideration of the fol
`lowing detailed description taken in conjunction with the
`accompanying drawings in which:
`FIG. 1 is an external view showing a digital camera
`embodying the present invention;
`FIG. 2 is a block diagram schematically showing a
`specific circuit configuration of the illustrative embodiment;
`FIG. 3 is a timing chart showing specific timing signals
`appearing in the illustrative embodiment and each defining
`a particular interval between successive shots in a continu
`ous shoot mode;
`FIG. 4 is a flowchart demonstrating a basic routine to be
`executed by the illustrative embodiment;
`FIG. 5 is a flowchart representative of a procedure
`included in the basic routine and executed when a mode dial
`is set at a “Pre (prior) position;
`FIG. 6 is a flowchart representative of interrupt process
`ing a included in the procedure of FIG. 5;
`FIG. 7 is a flowchart representative of a procedure also
`included in the basic routine and executed when the mode
`dial is set at a “Pre/Post (posterior) position;
`FIG. 8 is a flowchart representative of interrupt process
`ing b included in the procedure of FIG. 7:
`FIG. 9 is a flowchart representative of a procedure also
`included in the basic routine and executed when the mode
`dial is set at a “Post' position;
`FIG. 10 is a flowchart showing a procedure representative
`of a modification of the illustrative embodiment;
`FIG. 11 is a flowchart showing interrupt processing a
`included in the procedure of FIG. 10;
`FIG. 12 is a flowchart showing interrupt processing b also
`included in the procedure of FIG. 10;
`FIG. 13 is an external view showing an alternative
`embodiment of the present invention;
`FIG. 14 is a block diagram schematically showing a
`specific circuit configuration of the alternative embodiment;
`FIG. 15 is a flowchart demonstrating a specific operation
`of the alternative embodiment executed when the mode dial
`is set at the “Pre/Post” position:
`FIGS. 16 and 17 are flowcharts respectively showing
`interrupt processing a and interrupting processing b included
`in the procedure of FIG. 15:
`FIG. 18 is an external view showing another alternative
`embodiment of the present invention;
`
`
`Ex.1006 / Page 24 of 35Ex.1006 / Page 24 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`3
`FIG. 19 is a schematic block diagram showing a specific
`circuit configuration of the embodiment of FIG. 18;
`FIG. 20 is a view showing a specific area designated in a
`frame particular to the embodiment of FIG. 18;
`FIG. 21 is a flowchart showing a specific operation of the 5
`embodiment of FIG. 18; and
`FIG. 22 is a flowchart showing part of the operation of
`FIG. 21 specifically.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`10
`
`Referring to FIG. 2 of the drawings, an image pickup
`apparatus embodying the present invention is shown and
`implemented as a digital camera by way of example. AS 15
`shown, the digital camera, generally 10, includes a CCD
`image sensor 14 to which an optical image representative of
`a scene to be picked up is incident via optics 12. An image
`signal output from the image sensor 14 is processed and then
`written to an external memory 16 removably mounted to the 20
`camera 10. An operation panel 18 includes a release button
`22 (see FIG. 1). When the operator of the camera 10 presses
`the release button 22, a release Switch, not shown, is
`operative in response to cause the camera 10 to pick up the
`scene and execute store processing in accordance with a 25
`mode selected by the operator on a single/continuous shoot
`mode dial, not shown, of the camera.
`For example, assume that the operator selects a continu
`ous shoot mode on the shoot mode dial and then sets a mode
`dial 20 (see FIG. 1) assigned to the continuous shoot mode 30
`at its “Pre' position. Then, when the operator presses the
`release button 22 to its half-stroke position, the camera 10
`sequentially stores a plurality of Successive frames of image
`data in a main memory 24 while sequentially updating them.
`After the operator has pressed the release button 22 to its 35
`full-stroke position, the camera 10 allows the operator to
`designate desired one of the frames of image data stored in
`the main memory 24 and records the designated frame of
`image data in the external memory 16.
`When the operator sets the mode dial 20 at its “Pre/Post' 40
`position and then presses the release button 22 to the
`half-stroke position, the camera 10 executes the same pro
`cedure as when the operator sets the dial 20 at the “Pre'
`position. Subsequently, when the operator presses the
`release button 22 to the full-stroke position, the camera 10 45
`further-picks up a preselected number of additional frames
`while storing the resulting image data in the main memory
`24. The camera 10 then allows the operator to select desired
`one of the frames of image data stored in the main memory
`24 and records the designated frame in the removable 50
`memory 16. Further, assume that the operator sets the mode
`dial 20 at its “Post' position. Then, the camera starts picking
`up a preselected number of Successive frames when the
`operator presses the release button 22 to the full-stroke
`position, while storing the resulting image data in the main 55
`memory 24. This also allows the operator to select desired
`one of the frames stored in the main memory 24.
`As stated above, in the continuous shoot mode, the
`camera 10 picks up a plurality of frames and stores them in
`the main memory 24 in a particular manner determined by 60
`the mode elected on the mode dial 20 and the half-stroke
`position of the release button 22. At the same time, the
`camera 10 displays the Successive frames or pictures picked
`up at consecutive times on an LCD (Liquid Crystal Display)
`panel or monitor 26 (see FIG. 1) in a multiframe format. The 65
`operator, watching the LCD panel 26, selects desired one of
`the frames on an “F (forward) switch 28, a “B (backward)
`
`US 7,365,780 B1
`
`4
`switch 30, and an enter/store switch 32. In response, the
`camera 10 writes image data representative of the frame
`selected by the operator in the external memory 16.
`Assume that the operator selects a single shoot mode on
`the previously mentioned single/continuous shoot mode
`dial. Then, the camera 10 picks up a single frame when the
`operator presses the release button 22 to the full-stroke
`position, and stores the resulting image data in the external
`memory 16.
`Referring again to FIG. 2, the optics 12 includes a lens
`system, an orifice diaphragm, and a mechanical shutter
`although not shown specifically. In response to drive signals
`fed from an optics driver 34, the optics 34 adjusts the focal
`position of the lens and the opening of the orifice diaphragm
`and opens and closes the mechanical shutter. In the illustra
`tive embodiment, the camera 10 controls a shutter speed,
`i.e., an exposure time at the time of a shot by controlling the
`mechanical shutter and an electronic shutter available with
`the CCD image sensor 14.
`The CCD image sensor, or bidimensional image sensor,
`14 has photosensitive devices, not shown, arranged horizon
`tally and vertically thereon. A color filter, not shown, is
`positioned in front of the photosensitive devices and made
`up of primary color filter segments R (red), G (green) and B
`(blue) corresponding one-to-one to the photosensitive
`devices. The photosensitive devices each generate a signal
`charge corresponding to a quantity of light incident thereto
`via the color filter. The signal charges are transferred from
`the photosensitive devices to vertical transfer paths and then
`to a single horizontal transfer path of the image sensor. As
`a result, R, G and B pixel signals are output from the image
`sensor 14 in accordance with the filter arrangement. A CCD
`driver 36 delivers a pixel clock, a transfer clock and other
`drive signals to the image sensor 14 in order to drive it under
`the control of a system controller 38.
`The output of the CCD image sensor 14 is connected to
`a CDS (Correlated Double Sampling) circuit 40. The CDS
`circuit 40 is an analog preprocessing circuit for preampli
`fying the input pixel signals to a preselected level while
`canceling reset noise contained in the pixel signals. The
`preprocessed pixel signals are fed from the CDS circuit 40
`to an ADC (Analog-to-Digital Converter) 42. The ADC 42
`converts the levels of the input pixel signals to R, G and B
`image data represented by ten or twelve bits and feeds the
`image data to a digital signal processing circuit 44.
`The digital signal processing circuit 44 executes gamma
`correction with the R, G and B image data in order to correct
`the tonality and levels thereof. In addition, the signal pro
`cessor 44 adjusts the white balance of the image data. The
`processed image data are delivered from the signal processor
`44 to a memory controller 46. When R, G and B image data
`stored in the main memory 24 are to be transferred to the
`removable memory 16 or when they are to be fed to an
`NTSC (National Television System Committee) encoder 48,
`the signal processor 44 transforms the R, G and B image data
`to Y (luminance) and C (chrominance) image data. The Y
`and C image data are input to the memory controller 46.
`Further, the digital signal processor 44 transforms the
`image data output from the ADC 42 or the main memory 24
`to display data capable of being displayed on the LCD panel
`26 and delivers them via the memory controller 46 and a bus
`50 to an LCD driver 56. The LCD driver 56 causes the LCD
`panel 26 to display a picture represented by the display data.
`Therefore, at the preparatory stage for a shot, the LCD panel
`26 is capable of displaying pictures read out of the external
`memory 16 or moving pictures being picked up before the
`operation of the release button 22, as needed. This allows the
`
`Ex.1006 / Page 25 of 35Ex.1006 / Page 25 of 35
`
`TESLA, INC.TESLA, INC.
`
`

`

`5
`operator to manually adjust the angle of field, focus, bright
`ness and so forth while watching the moving pictures. In this
`manner, in the illustrative embodiment, the LCD panel 26
`plays the role of an electronic viewfinder for displaying a
`scene to be picked up beforehand in addition to the role of
`a display for displaying pictures read out of either one of the
`main memory 24 and external memory 16.
`Moreover, the digital signal processor 44 converts the
`image size of image data picked up to the display size of the
`LCD panel 26. For example, assume that the operator selects
`the continuous shoot mode and continuously picks up a
`plurality of frames at preselected intervals of At. Then, the
`signal processor 44 arranges consecutive pictures repre
`sented by the resulting image data horizontally and verti
`cally and generates data for causing the LCD panel 26 to
`display, e.g., nine pictures in a reduced scale. In the "Pref
`Post' continuous shoot mode, the signal processor 44 pro
`cesses Successive frames of image data picked up and
`written to the main memory 24 at consecutive times t-4 At,
`-3 At, ..., 3 At, 4. At and causes the LCD panel 26 to display
`pictures represented by the processed image data in a
`multiframe format. FIG. 1 shows a specific arrangement of
`pictures continuously picked up at the times t-4. At through
`t=4 At and appearing on the LCD panel 26.
`In the “Pre' continuous shoot mode, the digital signal
`processor 44 processes consecutive frames of image data
`picked up at times t-8 At, -7 At. . . . . -At, t-0 so as to
`generate data for displaying the above frames together in a
`reduced scale. Likewise, in the “Post' continuous shoot
`mode, the signal processor 44 processes consecutive frames
`of image data picked up at times t-O, -At, . . . , 7 At, 8 At
`so as to generate data for displaying such frames together in
`a reduced scale.
`The system controller 38 delivers to the digital signal
`processor 44 a control signal for allowing the operator to
`35
`select desired one of the pictures appearing on the LCD
`panel 26. In response, the signal processor 44 changes the
`color and brightness of framework of the individual picture
`in order to distinguish pictures that can be selected from the
`other pictures.
`Another function assigned to the digital signal processor
`44 is calculating, based on the image data output from the
`ADC 42, various estimated values for the adjustment of
`focus, brightness and other shooting conditions. Specifically,
`the signal processor 44 divides a frame into sixty-four
`45
`blocks and calculates estimated values on the basis of
`block-by-block image data. For example, the signal proces
`sor 44 calculates the level of image data block by block by
`addition and then calculates the photometric value of the
`scene in accordance with the resulting Sums and a photom
`etry mode. The signal processor 44 sends the photometric
`value to the system controller 38. The system controller 38
`generates, based on the photometric data, control signals
`indicative of a lens opening and a shutter releasing period of
`time to be assigned to the optics 12 and delivers the control
`signals to the optics driver 34. In addition, the system
`controller 38 feeds a control signal indicative of an elec
`tronic shutter speed to be assigned to the CCD image sensor
`14 to the CCD driver 36. In this sense, the system controller
`38 has an automatic exposure adjusting function.
`Still another function assigned to the digital signal pro
`cessor 44 is shifting the focal position of the lens in order to
`separate the contrast components of the scene from the
`block-by-block image data, calculating estimated contrast
`values, and generating a control signal for locating the lens
`at a position where the estimated contrast value is greatest
`(automatic focusing function). In addition, when the system
`
`55
`
`25
`
`30
`
`40
`
`50
`
`60
`
`65
`
`US 7,365,780 B1
`
`5
`
`10
`
`15
`
`6
`controller 38 specifies an AWB (Auto White Balance) mode,
`the signal processor 44 determines the condition of a light
`Source included in the scene, i.e., color temperature and
`adjusts the color balance of the RGB signals in matching
`relation to the color temperature (AWB adjusting function).
`The memory controller 46 interchanges image data with
`the signal processor 44 and controls the writing and reading
`of image data out of the main memory 24 (store control
`function). Further, the memory controller 46 controls data
`transfer between the various functional blocks connected to
`the bus 50 in response to control signals output from the
`system controller 38. In the illustrative embodiment, the
`main memory 24 is capable of storing nine frames of image
`data picked up. The memory controller 46 feeds an address
`signal and a write control signal to the main memory 24.
`When the operator sets the mode dial 20 at the “Pre”
`position or the “Pre?Post' position, the memory controller
`46 writes, in response to a control signal fed from the system
`controller 38, nine consecutive frames of image data sequen
`tially picked up at the intervals of