(12) United States Patent
`Juen
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,903,162 B2
`Mar. 8, 2011
`
`US007903162B2
`
`(54)
`
`(75)
`(73)
`(*)
`
`(21)
`
`(22)
`(65)
`
`(63)
`
`(60)
`
`ELECTRONIC CAMERATHAT DISPLAY
`INFORMATION REPRESENTATIVE OF TS
`SELECTED MODE
`
`Inventor: Masahiro Juen, Kanagawa-ken (JP)
`Assignee: Nikon Corporation, Tokyo (JP)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`Appl. No.: 11/075,333
`
`Filed:
`
`Mar. 9, 2005
`
`Prior Publication Data
`US 2005/O146623 A1
`Jul. 7, 2005
`
`Related U.S. Application Data
`Continuation of application No. 09/951,417, filed on
`Sep. 14, 2001, now abandoned, which is a continuation
`of application No. 08/937,805, filed on Sep. 25, 1997,
`now abandoned.
`Provisional application No. 60/040,922, filed on Mar.
`27, 1997.
`Foreign Application Priority Data
`
`(30)
`Sep. 25, 1996
`
`(JP) ....................................... 8-253343
`
`(51)
`
`(52)
`(58)
`
`Int. C.
`(2006.01)
`H04N 5/222
`U.S. Cl. ............................... 348/333.01; 348/333.02
`Field of Classification Search ............... 348/220.1,
`348/229.1, 333.01, 333.02
`See application file for complete search history.
`
`
`
`MOVIECAMERA
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`5,153,730 A 10/1992 Nagasaki et al.
`5,404,316 A
`4/1995 Klingler et al.
`5,440,343 A * 8/1995 Parulski et al. ............... 348,316
`5,444,482 A * 8/1995 Misawa et al. ............. 348,220.1
`5,444.483. A
`8, 1995 Maeda
`5,477,337 A 12/1995 Schuler
`5,513,306 A
`4/1996 Mills et al.
`5,793,923 A * 8/1998 Sawanobori .................... 386, 46
`5,923,816 A
`7, 1999 Ueda
`5,943,050 A * 8/1999 Bullocket al. ................ 715.783
`5,956,083. A
`9/1999 Taylor et al.
`6,034,728 A
`3/2000 Arena
`6,342,900 B1* 1/2002 Ejima et al. ................... 345,698
`6,441,854 B2 * 8/2002 Fellegara et al.
`348,333.13
`6,466,263 B1 * 10/2002 Suzuki ...........
`... 348,220.1
`2002/0012051 A1* 1/2002 Mizoguchi.................... 348.220
`* cited by examiner
`Primary Examiner — Kelly L Jerabek
`(74) Attorney, Agent, or Firm — Oliff & Berridge, PLC
`
`
`
`ABSTRACT
`(57)
`An electronic camera is used with a display screen and
`includes an imaging device, a pixel density converter, a mov
`ing image recording device and a still image recording device.
`The imaging device images an object and converts the imaged
`object to image information. The pixel density converter con
`verts the image information converted by the imaging device
`to a pixel density suitable for a scan format of the display
`screen. The moving image recording device Successively
`retrieves the image information from the pixel density con
`Verter and records the image information in the recording
`medium as a series of moving images. The still image record
`ing device retrieves the image information converted by the
`imaging device and records the image information in the
`recording medium as a still image.
`
`8 Claims, 17 Drawing Sheets
`
`26
`
`KKoooooooxx
`{{<1DDDDX
`S
`
`IPR2020-00597
`Apple EX1005 Page 1
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 1 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`100
`
`IMAGING
`MEANS
`
`
`
`
`
`STILLIMAGE
`RECORDING
`MEANS
`
`p as m
`
`v
`
`is was -
`
`RECORDING:
`MEDIUM
`
`
`
`
`
`
`
`IMAGING
`MEANS
`
`
`
`PXELDENSITY
`CONVERSION
`MEANS
`
`
`
`MOVING IMAGE
`RECORDING
`MEANS
`
`RECORDING INSTRUCTION
`OF STILLIMAGE
`
`4
`
`BUFFER
`MEANS
`
`STILLIMAGE
`RECORDING
`MEANS
`
`a
`
`a
`
`as
`
`COMPLETION OF
`RECORDING
`
`RECORDING
`MEDIUM
`
`PIXELDENSITY
`CONVERSION
`MEANS
`
`
`
`
`
`MOVING MAGE
`RECORDING
`MEANS
`
`2
`
`3
`
`-
`
`R
`
`IPR2020-00597
`Apple EX1005 Page 2
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 2 of 17
`
`US 7,903,162 B2
`
`100
`
`
`
`
`
`
`
`
`
`IMAGING
`MEANS
`
`
`
`
`
`STILLIMAGE
`RECORDING
`MEANS
`
`- - - - - - - - -
`
`|
`
`ENCODING
`CONVERSION
`COMPONENT
`
`RECORDING
`MEDIUM
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`PIXELDENSITY
`CONVERSION
`MEANS
`
`
`
`
`
`MOVING IMAGE
`RECORDING
`MEANS
`
`2
`
`3
`
`R
`
`IPR2020-00597
`Apple EX1005 Page 3
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 3 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`IPR2020-00597
`Apple EX1005 Page 4
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 4 of 17
`
`US 7,903,162 B2
`
`IIIIIIIII
`
`oz_omoomm
`
`220m:
`
`wzamoomm"20"
`
`ozamoomm"zo"
`
`
`
`
`
`_......zo_mmmmn_zoom0<§
`
`
`
`
`
`_......wzfizoz_oz<Iowz<m2
`
`
`
`NEEzo_wmmmn_s_oo
`
`
`
`mo<2_wz_>Os_
`
`ozamoomm
`
`mz<m=2
`
`02
`
`oz_o<s=
`
`mz<m_>_
`
`
`
`mo<s=._.__._.w
`
`ozEmOOmm
`
`wz<m§
`
`v.Nmm
`
`m.0.”—
`
`
`
`mo“.Dz<_>_s_oo
`
`dimwzamoomm
`
`mums):
`
`|PR2020-00597
`
`Apple EX1005 Page 5
`
`IPR2020-00597
`Apple EX1005 Page 5
`
`
`
`
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 5 Of 17
`
`US 7,903,162 B2
`
`+ – – – – + – – –
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2020-00597
`Apple EX1005 Page 6
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet60f17
`
`US 7,903,162 B2
`
`-0529.2
`
`._<o_Eo
`
`ozamoowm
`
`2282
`
`$0sz
`
`mamaxma
`
`hzmzomzoo
`
`
`
`zmmmom2.55.2550950:
`
`
`
`.mzéI039
`
`SN.mm
`
`
`
`N..0."—
`
`
`
`zo_wmm>zooozaoozm
`
`Hzmzomgoo
`
`mzm._
`
`E2858
`
`R8
`
`295m295m
`
`
`
`moo:ozamoomm
`
`
`
`mOwwmooEomoE
`
`:
`
`
`EMZEESzoamgzs
`
`
`2:105:szmfigz
`
`2E§85E m:
`
`4/2:
`
`|PR2020-00597
`
`Apple EX1005 Page 7
`
`IPR2020-00597
`Apple EX1005 Page 7
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 7 Of 17
`
`US 7,903,162 B2
`
`
`
`FIG. 8
`
`IPR2020-00597
`Apple EX1005 Page 8
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 8 of 17
`
`US 7,903,162 B2
`
`SYSTEMBUS
`
`6
`
`68 8897
`
`NOISSE}}d W00
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2020-00597
`Apple EX1005 Page 9
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 9 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 10
`FIG.10(A)
`FIG. 10(B)
`
`(3)
`
`HASAMODEBUTTON
`BEEN PRESSED
`(ISIT THE STILLMODE
`
`
`
`HAS THE
`IMAGERECORDING
`BUTTON BEEN PRESSED
`(MOVIEPHOTOGRAPHY
`STARTED)
`YES
`
`S
`
`S2
`
`SET THE CODING CONVERSION COMPONENT IN THE MOVIEMODE
`
`S3
`
`FROM THE CAMERAPARTRETRIEVE IMAGE INFORMATION
`
`S4
`
`DECREASE THE PIXELDENSITY OF IMAGE INFORMATION
`
`S5
`
`PERFORMTHE PREDICTION BETWEENMOVINGCOMPENSATION
`FRAMESANDDETECT THE PREDICTIONERRORBETWEENFRAMES
`
`EXECUTE THEDCT CALCUATIONAND QUANTIZING THEDCT
`COEFFICIENT AND PERFORMHUFFMAN CODING
`
`S6
`
`S7
`
`RECORD THE COOING AND THE LIKE SUCCESSIVELY TO THE
`RECORDING MEDIUM
`
`S8
`
`FIG. 10A
`
`IPR2020-00597
`Apple EX1005 Page 10
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 10 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`HASAMODEBUTTON
`BEEN PRESSED
`(ISIT THESTILLMODE?
`
`YES
`
`HAS THE
`IMAGERECORD BUTTON
`BEEN PRESSEDAGAIN?
`(STILL
`PHOTOGRAPHY?)
`
`SMEMORY
`SUFFICIENT FORTHE
`STILLIMAGE
`
`NO
`
`HAS THE
`IMAGE RECORD BUTTON
`BEEN PRESSEDAGAIN?
`(MOVIEPHOTOGRAPHY
`COMPLETED)
`
`DURING THE
`MOVIERECORDINGS
`THERESTILL
`PHOTOGRAPHY?
`
`
`
`STORE THE IMAGE INFORMATION
`BEFOREPXELDENSITY
`CONVERSIONAND THE PHOTOGRAPHY
`FRAMENUMBERIN MEMORY
`
`WARNING
`PROCESS
`
`ABANDONTHE STILLMODE
`
`S13
`
`S15
`
`
`
`FIG. 10B
`
`IPR2020-00597
`Apple EX1005 Page 11
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 11 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`HAS THE
`IMAGERECORD BUTTON
`BEEN PRESSED
`(STILLPHOTOGRAPHY
`BEGAN)
`
`TAKE THE IMAGE INFORMATIONINFROM THE IMAGING COMPONENT
`
`S17
`
`AKEIMAGE INFORMATION
`IN FROMMEMORY
`
`
`
`SET THE CODNG CONVERSION PARTNTHESTILLMODE
`
`DIRECT THEAPPROPRIATEIMAGE MEMORY FOR PREDICTION
`BETWEEN FRAMES, TO THE MEMORY FORTHEPIXEL REARRANGING
`COMPONENT
`
`PERFORM DCT CALCULATIONS AND QUANTIZING OFDCT
`COEFFICIENT TO THE IMAGE INFORMATION AND PERFORM
`HUFFMAN CODING
`
`
`
`RECORD THE CODNG DATA AND THE KENTO THE
`RECORDING MEDIUM
`
`ISTHERE
`ANYMAGE INFORMATION
`LEFT IN THE MEMORY
`
`FIG. 11
`
`IPR2020-00597
`Apple EX1005 Page 12
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 12 of 17
`
`US 7,903,162 B2
`
`
`
`B
`|
`|
`
`SNET
`
`IPR2020-00597
`Apple EX1005 Page 13
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 13 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 13
`FIG. 13(A)
`FIG. 13(B)
`
`CBEGINNING)
`BEGINNING
`
`(3)
`
`HASAMODEBUTTON
`BEENPRESSED
`(ISIT THE STILLMODE
`
`HAS THE
`IMAGERECORDING
`BUTTON BEEN PRESSED
`(MOVIE PHOTOGRAPHY
`STARTED)
`YES
`
`S
`
`S2
`
`SET THE CODING CONVERSONCOMPONENT TO THE MOVIEMODE
`
`S3
`
`FROM THECAMERAPART TAKETHE IMAGE INFORMATION
`
`INCREASEEACHWALUE OF THE QUANTIZING TABLE OF THE
`CODING CONVERSIONCOMPONENT
`
`PERFORM THE PREDICTION BETWEENMOVINGCOMPENSATION
`FRAMEAND DETECT THE PREDICTIONERRORBETWEEN FRAMES
`
`S4
`
`S5
`
`S6
`
`
`
`GIVE THEDCT CALCULATIONAND QUANTIZING OFDCT
`COEFFICIENT AND PERFORMHUFFMAN CODING
`
`
`
`RECORD THE CODING DATAAND THE LIKE TO THE
`RECORDING MEDIUMNORDER
`
`S8
`
`FIG. 13A
`
`IPR2020-00597
`Apple EX1005 Page 14
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 14 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`HASAMODEBUTTON
`BEEN PRESSED
`(ISIT THE STILLMODE
`
`
`
`YES
`
`HAS THE
`MAGERECORDING
`BUTTON BEEN PRESSEDAGAIN
`(STILL
`PHOTOGRAPHY?)
`
`ISMEMORY
`SUFFICIENT FORTHE
`STILLIMAGE
`
`NO
`
`RECORD THE IMAGE INFORMATION FROM
`THECAMERAPARTANDNUMBER OF
`THE PHOTOGRAPHS
`
`WARNING
`PROCESS
`
`RELEASE THE STILLMODE
`
`S13
`
`S5
`
`FIG. 13B
`
`HAS THE
`IMAGERECORDING BUTTON
`BEEN PRESSEDAGAN
`(MOVIEPHOTOGRAPHY
`COMPLETED)
`
`
`
`DURING THE
`MOVIERECORDINGS
`THERESTIL
`PHOTOGRAPHY
`
`
`
`IPR2020-00597
`Apple EX1005 Page 15
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 15 of 17
`
`US 7,903,162 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`WAS THE
`RECORDING BUTTON
`PRESSED
`(STILLPHOTOGRAPHY
`BEGINS)
`
`TAKETHE IMAGE INFORMATION INFROM THE IMAGINGCOMPONENT
`
`S7
`
`TAKEN IMAGE INFORMATION
`FROM THE MEMORY
`
`SET THE CODING CONVERSION COMPONENTIN THE
`STILLMAGEMODE
`
`DECREASE EACH VALUE OF THE QUANTIZING TABLE OF THE
`CODING CONVERSIONCOMPONENT
`
`DVERT THE IMAGEMEMORY OF THE PREDICTION BETWEEN FRAMES
`TO THE MEMORY OF THE PIXEL REARRANGINGPART
`
`EXECUTEDCT CALCULATIONAND QUANTIZING OFDCT
`COEFFICIENT TO THE IMAGE INFORMATIONAND PERFORM
`HUFFMAN CODING
`
`RECORD THE CODING DATA AND THE LIKE INTO THE
`RECORDING MEDIUM
`
`STHERE
`ANY IMAGE INFORMATION
`LEFT IN THE MEMORY
`
`FIG. 14
`
`IPR2020-00597
`Apple EX1005 Page 16
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 16 of 17
`
`US 7,903,162 B2
`
`
`
`MOVIECAMERA
`
`IMAGE
`RECORDING
`
`KoooooooXX
`{ <1D DX
`S
`
`MOVE CAMERA
`
`MAGE
`RECORDING
`
`FIG. 16
`
`IPR2020-00597
`Apple EX1005 Page 17
`
`

`

`U.S. Patent
`
`Mar. 8, 2011
`
`Sheet 17 Of 17
`
`US 7,903,162 B2
`
`
`
`STILL CAMERA
`
`N
`
`IMAGE
`RECORDING
`
`FIG. 17
`
`IPR2020-00597
`Apple EX1005 Page 18
`
`

`

`1.
`ELECTRONIC CAMERATHAT DISPLAY
`INFORMATION REPRESENTATIVE OF TS
`SELECTED MODE
`
`This is a Continuation of application Ser. No. 09/951,417.
`filed Sep. 14, 2001, which in turn is a Continuation of appli
`cation Ser. No. 08/937,805, filed Sep. 25, 1997 (now aban
`doned). Said application Ser. No. 08/937,805 claims the ben
`efit of Provisional Application No. 60/040,922, filed Mar. 27,
`1997. The entire disclosure of the prior applications are
`hereby incorporated by reference herein in their entireties.
`
`10
`
`INCORPORATION BY REFERENCE
`
`The disclosure of the following priority application is
`herein incorporated by reference: Japanese Application No.
`8-253343 filed on Sep. 25, 1996.
`
`15
`
`BACKGROUND OF THE INVENTION
`
`1. Field of Invention
`This invention relates to an electronic camera that records
`both moving images and still images.
`2. Description of Related Art
`In recent years, electronic cameras have been developed
`that photoelectrically convert an object to image information
`of a moving image, execute image compression Such as high
`efficiency coding on that image information, and record the
`compressed image information in a recording medium.
`As representative of this kind of electronic camera, digital
`Video (DV) cameras are known. In a DV camera, a still image
`recording mode is provided and it is possible to record one
`frame of a still image and combine it with a sound signal over
`a number of seconds.
`In this conventional example, a still image is recorded as a
`Snapshot corresponding to one frame of a moving image.
`However, in this conventional example, a still image is
`recorded in the image quality of one frame of a moving image
`(for example, in the NTSC method of a YC component,
`excluding the retracing period), the vertical degree of resolu
`tion is 480 lines and the horizontal degree of resolution is 500
`lines.
`
`SUMMARY OF THE INVENTION
`
`Therefore, an object of the present invention is to provide
`an electronic camera that can record a still image at a high
`image quality.
`Another object of the present invention is to provide an
`electronic camera that can image still objects or subjects at
`will, even while recording a moving object or subject.
`Yet another object of the present invention is to provide an
`electronic camera that is designed to share the recording
`process for still images and the recording process for moving
`images.
`A still further object of the present invention is to provide
`an electronic camera that can record still images at a high
`image quality, while designing the electronic camera so that it
`is made to share the recording process for still images and the
`recording process for moving images.
`Another object of the present invention is to provide an
`electronic camera that can image still images at will, even
`while recording a moving image.
`Still further, another object of the present invention is to
`provide an electronic camera that can enhance the operational
`quality relating to recording changeover between still images
`and moving images.
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 7,903,162 B2
`
`2
`Accordingly, an electronic camera is used with a display
`screen and includes imaging means, pixel density conversion
`means, a recording medium, moving image recording means
`and still image recording means. The imaging means images
`an object and converts the imaged object to image informa
`tion. The pixel density conversion means converts the image
`information converted by the imaging means to a pixel den
`sity suitable for a scan format of the display screen. The
`moving image recording means successively retrieves the
`image information from the pixel density conversion means
`and records the image information in the recording medium
`as a series of moving images. The still image recording means
`retrieves the image information converted by the imaging
`means and records the image information in the recording
`medium as a still image.
`The imaging means includes an imaging pixel number and
`the scan format includes a scan pixel number wherein the
`imaging pixel number is larger than the scan pixel number.
`The pixel density conversion means reduces the image infor
`mation converted by the imaging means to a pixel density that
`is suitable for the scan format. Preferably, the electronic cam
`era of the present invention includes buffer means that tem
`porarily stores the image information from the imaging
`means upon receipt of a command for recording still images
`when the command for recording is given from an external
`Source during a recording period of the moving image record
`ing means. The still image recording means waits until
`completion of recording by the moving image recording
`means and records the image information stored in the buffer
`means in the recording medium. Preferably, the moving
`image recording means and the still image recording means
`share a coding conversion component for executing high effi
`ciency coding within a field or frame on the image informa
`tion that has been retrieved.
`It is preferable that the electronic camera of the present
`invention include a recording Switch and a changeover
`Switch. The recording Switch receives a recording command
`from an external source. The changeover Switch which
`receives the recording command from the recording Switch
`can be used either for the moving image recording means or
`for the still image recording means in response to a mode
`changeover command from an external source.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The invention will be described in conjunction with the
`following drawings in which like reference numerals desig
`nate like elements and wherein:
`FIG. 1 is a block diagram depicting an exemplary embodi
`ment of an electronic camera of the present invention;
`FIG. 2 is a block diagram depicting another exemplary
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 3 is a block diagram depicting another exemplary
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 4 is a block diagram depicting another exemplary
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 5 is a block diagram depicting another exemplary
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 6 is a block diagram depicting another exemplary
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 7 is a block diagram of a first preferred embodiment of
`the electronic camera of the present invention;
`
`IPR2020-00597
`Apple EX1005 Page 19
`
`

`

`US 7,903,162 B2
`
`3
`FIG. 8 is a perspective view of the first preferred embodi
`ment of the electronic camera of the present invention;
`FIG.9 is a block diagram illustrating a structure of a coding
`conversion component;
`FIG. 10 is flowchart depicting partial operation of the first
`preferred embodiment of the electronic camera of the present
`invention;
`FIG. 11 is flowchart depicting partial operation of the first
`preferred embodiment of the electronic camera of the present
`invention;
`FIG. 12 is a block diagram illustrating a second preferred
`embodiment of the electronic camera of the present inven
`tion;
`FIG. 13 is a flowchart depicting partial operation of the
`second preferred embodiment of the electronic camera of the
`present invention;
`FIG. 14 is a flowchart depicting partial operation of the
`second preferred embodiment of the electronic camera of the
`present invention;
`FIG. 15 is a first example display shown on a display screen
`of the electronic camera of the present invention;
`FIG. 16 is a second example display shown on the display
`screen of the electronic camera of the present invention; and
`FIG. 17 is a third example display shown on the display
`screen of the electronic camera of the present invention.
`
`5
`
`10
`
`15
`
`25
`
`4
`suitable for the scan format. Therefore, the image information
`is created in the imaging means 1, in a pixel density that is
`higher than the pixel density of the scan format.
`At this time, when a moving image is recorded, the pixel
`density conversion means 2 reduces the density of the image
`information that initially has a high pixel density to a pixel
`density appropriate to the scan format. The moving image
`recording means 3 records the image information after this
`conversion to the recording medium R. On the other hand,
`when the still image is recorded, the still image recording
`means 4 records the image information in a state in which the
`pixel density is high in the recording medium R as a still
`image.
`FIG. 2 is a block diagram of another exemplary embodi
`ment of the present invention.
`In FIG. 2, the electronic camera 100 is equipped with a
`buffer means 5 that temporarily stores the image information
`from the imaging means 1 upon receipt of a command for
`recording still images when the command for recording is
`given from an external Source during a recording period of the
`moving image recording means 3. The still image recording
`means 4 waits for completion of recording by the moving
`image recording means 3 and records the image information
`stored in the buffer means 5 in the recording medium R.
`When the still image recording command is Supplied from
`an external source during the moving image recording period,
`the buffer means 5 temporarily stores the image information
`from the imaging means 1. The still image recording means 4
`waits for completion of recording of the moving image
`recording means 3 and records the image information stored
`in the buffer means 5 in the recording medium R. By doing
`this, it is possible to reliably image snapshots even during
`recording of moving images.
`FIG. 3 is a block diagram of another exemplary embodi
`ment of the present invention.
`In FIG.3, the moving image recording means 3 and the still
`image recording means 4 share a coding conversion compo
`nent 6 for executing high efficiency coding within a field or
`frame on the image information that has been retrieved.
`The moving image recording means 3 and the still image
`recording means 4 share the coding conversion component 6
`that performs high efficiency coding (i.e., compression) of the
`image information. For example, in a moving image coding
`conversion section, processes are performed Such as a DCT
`(Discreet Cosine Transform) calculation, predictions
`between the frames, variable length coding, and the like. On
`the other hand, in a still image coding conversion processes
`are performed such as a DCT calculation, variable length
`coding and the like. Therefore, the processes within a frame
`or field in the moving image coding conversion section are the
`same as the processes for the still image coding conversion
`section. It is possible to simplify the calculation process algo
`rithms, the circuit structure of the electronic camera and the
`like by providing the coding conversion component 6 to per
`form these common processes.
`FIG. 4 is a block diagram of another exemplary embodi
`ment of the present invention.
`In FIG. 4, the imaging means 1 images the object and
`converts it to image information. An image compression
`means 7, which can be any conventional image compression
`device known in the art, compresses image information
`imaged by the imaging means 1. The moving image recording
`means 3 Successively retrieves the image information com
`pressed by the image compression means 7 to record it in the
`recording medium R as moving images. The still image
`recording means 4 retrieves the image information com
`pressed by the image compression means 7 to record it in the
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENTS
`
`35
`
`40
`
`45
`
`FIG. 1 is a block diagram of an exemplary embodiment of
`30
`the present invention.
`In FIG. 1, an electronic camera 100 includes an imaging
`means 1 that images an object or living Subject (hereinafter
`referred to as “object’) and converts an image thereof to
`image information. A pixel density conversion means 2 con
`verts the image information converted by the imaging means
`1 to a pixel density Suitable for a scan format of a display
`screen. A moving image recording means 3 Successively
`retrieves the image information in which the pixel density has
`been converted by the pixel density conversion means 2 and
`records it in a recording medium R as a series of moving
`images. A still image recording means 4 retrieves image
`information converted by the imaging means 1 to record it in
`the recording medium Ras a still image.
`When performing the recording of a moving image, first,
`the image information from the imaging means 1 is converted
`via the pixel density conversion means 2 to a pixel density that
`is compatible with a scan format of a display screen 25
`(shown in FIG. 8). Although not by way of limitation, the
`display screen 25 can be an electronic viewfinder, a monitor
`screen attached to the case of the electronic camera, a device
`displaying the playback of the image information from the
`recording medium R (for example, a television or a computer
`monitor) or an image display device connected to an image
`output terminal of the electronic camera.
`The moving image recording means 3 retrieves the image
`information after pixel density conversion, creates a moving
`image, and records the moving image in the recording
`medium R. On the other hand, when performing the recording
`of a still image, the image information is not retrieved by the
`pixel density conversion means 2 but rather by the still image
`recording means 4. The still image recording means 4 records
`the image information in the recording medium R.
`The imaging means 1 has a pixel number that is larger than
`the pixel number of the scan format. Accordingly, the pixel
`density conversion means 2 reduces the image information
`converted by the imaging means 1 to a pixel density that is
`
`50
`
`55
`
`60
`
`65
`
`IPR2020-00597
`Apple EX1005 Page 20
`
`

`

`US 7,903,162 B2
`
`10
`
`15
`
`25
`
`30
`
`5
`recording medium R as a still image. A compression rate
`changing means 8 which can be any conventional compres
`sion rate changing device known in the art increases the
`compression rate of the image compression means 7 during
`recording of the moving image recording means 3 and lowers
`the compression rate of the image compression means 7 dur
`ing recording of the still image recording means 4. The com
`pression rate is the ratio of the amount of information before
`compression to the amount of information that remains after
`compression. The compression rate of the image compression
`means 7 is raised during recording of a moving image, and the
`compression rate is lowered during recording of still images.
`FIG. 5 is a block diagram of another exemplary embodi
`ment of the present invention.
`In FIG. 5, the electronic camera is equipped with the buffer
`means 5 that temporarily stores the image information from
`the imaging means 1 upon receipt of the command for record
`ing still images when the command for recording is given
`from the external Source during the recording period of the
`moving image recording means 3. The image compression
`means 7 waits for completion of recording by the moving
`image recording means 3 and compresses the image informa
`tion stored in the buffer means 5. The still image recording
`means 4 retrieves the image information from the buffer
`means 5 that has been compressed by the image compression
`means 7 and records it in the recording medium R as a still
`image.
`When the still image recording command is externally
`Supplied during the moving image recording period, the
`buffer means 5 temporarily stores image information from the
`imaging means 1. In this state, the image compression means
`7 waits for the completion of recording of the moving image
`recording means 3 and compresses the image information
`stored in the buffet means 5 (using the still image compres
`sion rate Supplied by compression rate changing means 8).
`The still image recording means 4 records the image infor
`mation compressed in this manner in the recording medium
`R.
`FIG. 6 is a block diagram of another exemplary embodi
`ment of the present invention.
`In FIG. 6, the electronic camera includes a recording
`switch 10a that receives a recording command from the exter
`nal source and a changeover switch 10b in which the record
`ing command received by the recording Switch 10a can be
`used either for the moving image recording means 3 or for the
`still image recording means 4 in response to a mode
`changeover command from the external Source. As a result of
`changing over by the changeover Switch 10b, the recording
`switch 10a has a dual use as the switch operating the still
`image recording means 4 and the moving image recording
`means 3.
`The preferred embodiments of the electronic camera of the
`present invention are described below based on the drawings.
`FIG. 7 is a block diagram of a first preferred embodiment of
`55
`the present invention. FIG.8 shows an outer appearance of the
`first embodiment of the present invention.
`In FIGS. 7 and 8, on a side surface of a main body 11 of the
`electronic camera, a camera part 11a is installed so that it
`freely rotates, and a photographic lens 12, that performs
`60
`image resolution of the object image, is attached to the cam
`era part 11a.
`Light passing through the photographic lens 12 is refracted
`within the camera part 11a, and received by a photoreceptor
`Surface of an imaging element 13, which is composed of a
`CCD image sensor. For example, the number of pixels of the
`imaging element 13 is 960 in lengthx1280 in width, which is
`
`45
`
`6
`twice the degrees in both length and width of the effective
`resolution in a NTSC method.
`The photoelectric output of the imaging element 13 is
`connected to a picture image signal processor 15 that per
`forms white balance adjustment, gamma correction, or the
`like via an A/D converter 14.
`The image information of the picture image signal proces
`Sor 15 is input to an image density converter 16 and a memory
`I/O component 17.
`The image density converter 16 performs conversion of the
`pixel density by executing interpolation, dividing into iden
`tical blocks, thinning, and the like, to the pixel value of the
`image information.
`The memory I/O component 17 controls input and output
`of the image information to a system bus 19 of a micropro
`cessor 18.
`The output of the image density converter 16 and the
`memory I/O component 17 is input to a coding conversion
`component 21 via an interface component 20.
`The interface component 20 communicates with the micro
`processor 18 via the system bus 19.
`To the system bus 19, a memory 22, disk drive part 23, the
`liquid crystal display screen 25, and a touch panel 25a are
`respectively connected.
`The memory 22, in conjunction with being used in the
`information processing of the microprocessor 18, is also used
`as a buffer for temporarily storing image information.
`A magnetooptical recording medium 24 is externally
`installed to a disk drive component 23.
`The liquid crystal display screen 25 is arranged on the rear
`surface side of the main body 11, and the touch panel 25a is
`provided over the surface of the liquid crystal display screen
`25.
`An image recording button 26, and a mode button 27 are
`arranged on the main body 11 and are connected to the micro
`processor 18.
`FIG. 9 is a block diagram describing the structure of the
`coding conversion component 21.
`In FIG. 9, the image information input via the interface
`component 20 (FIG. 7) is provided to a pixel arranging com
`ponent 31 and a moving vector detection component 33. The
`output of the pixel arranging component 31 is connected
`respectively to a first input of a subtracting device 32 and a
`first input of a first switch 34.
`The output of the subtracting device 32 is connected to a
`second input of the first switch 34, and the output of the first
`switch 34 is connected to a quantizer 36 via a DCT calculator
`35. The output of the quantizer 36 is connected to a reverse
`quantizer 37 and a variable length coder 38. The output of the
`variable length coder38 is connected to a first input of the data
`multiplexer 39.
`On the other hand, the output of the reverse quantizer 37 is
`connected to a first input of an adding component 41 via a
`inverse DCT calculator 40. The output of adding component
`41 is connected to an image memory 42 having the storage
`capacity of a frame of image data. The image information
`accumulated in the image memory 42 is input to a second
`input of the moving vector detection component 33 and a first
`input of a motion compensation component 43.
`The output of the moving vector detection component 33,
`in conjunction with being connected to a second input of the
`motion compensation component 43, is connected to a second
`input of the data multiplexer 39 via a second switch 45.
`The prediction-between-the-frames result output from the
`motion compensation component 43, in conjunction with
`
`35
`
`40
`
`50
`
`65
`
`IPR2020-00597
`Apple EX1005 Page 21
`
`

`

`US 7,903,162 B2
`
`7
`being input to a second input of the Subtracting device 32, is
`input to a second input of the adding component 41 via a third
`switch 44.
`On the other hand, the control output of the compression
`mode controller 46 connected to the system bus 19, is con- 5
`nected to the pixel arranging part 31, the first switch 34, the
`third switch 44, the second switch 45, the control header
`generator 47, and the like.
`The input/output of the control header generator 47 are
`connected individually to the quantizer 36, the variable length 10
`coder 38 and to a third input of the data multiplexer 39.
`The output of the data multiplexer 39 is connected to the
`system bus 19.
`With respect to FIGS. 1-6, the imaging means 1 includes
`the photographic lens 12, the imaging element 13, the A/D is
`converter 14, and the picture image signal processor 15. The
`pixel density conversion means 2 includes the image density
`converter 16. The moving image recording means 3 includes
`the coding conversion component 21, the disk drive compo
`nent 23 and a command controlling the recording operation of
`the moving image of the mi