United States Patent
`
`[19]
`
`[11] Patent Number:
`
`6,094,219
`
`Roberts et al.
`
`[45] Date of Patent:
`
`*Jul. 25, 2000
`
`US006094219A
`
`[54] ELECTRONIC STILL VIDEO CAMERA
`WITH DIRECT PERSONAL COMPUTER (PC)
`COMPATIBLE DIGITAL FORMAT OUTPUT
`
`[75]
`
`Inventors: Marc K. Roberts, Burke; Matthew A.
`Chikosky, Springfield; Jerry A. Speasl,
`Vienna, 311 Of Va-
`
`[73] Assignee: St. Clair Intellectual Property
`Consultants, Inc” Grosse Poime’ Mich.
`
`*
`
`Notice:
`
`atent is sub'ect to a terminal dis-
`This
`P
`J
`Claimer.
`
`[21] Appl' No‘: 08/651562
`
`FOREIGN PATENT DOCUMENTS
`
`0390421/A1
`90303076
`
`3/1990 European Pat. Off.
`3/1990 European Pat. Off.
`
`.
`.
`
`OTHER PUBLICATIONS
`
`Eikonix, New Release, Atlanta, GA, Sep. 29, 1988.
`L
`F
`W Id El
`'
`I
`'
`A .1990
`’pp
`aser Ocus
`or
`’
`ectromc magmg’
`pr
`Personal VisionTM, Live Video/Frame Grabber For Macin-
`tosh II, Orange Micro, Inc., 1989.
`
`.72.
`
`(List continued on next page.)
`
`Primary Examiner—Tuan Ho
`Attorney, Agent, or Firm—Harness, Dickey & Pierce, P.L.C.
`
`Related U-S- Appiicatioil Data
`.
`.
`.
`.
`[63] Conilnuailon Oi aPPi1°ai1011 N0~ 08/098787: iui 29: 1993:
`P t. N . 5,576,757,
`h’ h "
`1'
`1'
`1
`1'
`1'
`N: 0(7)/878,603, Mg] 1%,
`1159320,Ogfigggolggd:) Vgfigdllcaislog
`continuation of application No. 07/615,848, Nov. 20, 1990,
`Pat. No. 5,138,459.
`Int. Cl? ..................................................... H04N 5/225
`[51]
`[52] U.s. Cl.
`........................... 348/207; 348/220; 348/552
`Of Search .....................................
`348/231’ 222’ 384’ 552; 360/132’ 133’
`135; 358/906’ 9091; 386/27’ 48’ 109’ 112’
`117’ 118’ 131; H04N 5/225
`References Cited
`Us. PATENT DOCUMENTS
`
`[56]
`
`4,074,324
`4,131,919
`4,302,776
`4,420,773
`4,456,931
`4,571,638
`4,614,977
`4,758,883
`4,803,554
`4327347
`4,829,383
`
`2/1978 Barrett.
`12/1978 Lloyd etal..
`11/1981 Taylor.
`12/1983 Toyonda et al..
`6/1984 Toyoda et al.
`.
`2/1986 Schneider et a1.
`9/1986 Kawahara et a1,
`7/1988 Kawahara et al.
`2/1989 Pape .
`5/1989 Beii ~
`5/1989 Harase.
`
`.
`,
`.................... .. 348/230
`
`An electronic still camera comprising a lens, shutter, and
`exposure control system, a focus and range control circuit,
`a solid state imaging device incorporating a Charge Coupled
`.
`.
`.
`.
`.
`.
`Device (CCD) through which an image is focused, a digital
`C0iiii0i unit through which timing and Coiiiioi of an image
`for electronic processing is accomplished, an Analog-to-
`3195;]: ($93)tflggvegegtgirgulifgafgrjgergthjggalggggfugj
`Coguectmg a Completegmw 0? an imagezs digital equivalent
`a frame buffer for Collecting all rows of an imagess
`equivalent and a selectively adjustable digital image com-
`pression and decompression algorithm that compresses the
`size of a digital image and selectively formats the com-
`pressed digital image to a compatible format for either the
`IBM Personal Computer and related architectures or the
`Apple Macintosh PC architecture as selected by the operator
`so that the digital image can be directly read into most Word
`processing, desktop publishing, and data base software
`packages including means for executing the appropriate
`selected decompression algorithm; and a memory input/
`output interface that provides both temporary storage of the
`digital image and controls the transmission and interface
`with a standard Personal Computer (PC) memory storage
`device such as a digital diskette. The digital diskette is
`removably inserted into the housing of the camera prior to
`use in recording digital image data.
`
`(List continued on next page.)
`
`26 Claims, 11 Drawing Sheets
`
`15
`
`16
`
`FLASH
`
`2
`[r4
`
`9
`
`T0
`7. 8 51
`10-13
`
`+v
`ENABLE 81
`DA” ;'NE5
`22
`
`19
`
`
`
`DATA
`“N55
`\
`FUNCTION ‘
`DECODEH
`& ADDRESS
`A
`ADDRESS :51
`CONTROL
`:___M_______
`LINES
`2°
`
`CPU
`
`speeo
`F25 F1000
`M
`FLASH +11
`=
`_‘ SHUTTER &
`EXPOSURE
`CONTROL
`FORMAT
`17
`+v
`IBM
`SHOOT
`(E;
`"V
`F°°”5 “
`CONTROL
`“ANGE
`
`
`
`
`
`]___ +v FULL
`+v HAL;
`1
`23
`\
`onsx
`FORMAT 4:
`ennon
`
`21
`sen:
`TEST
`FAILURE
`
`;
`
`FRAME —:Tljjv-——
`COUNTER
`*'
`+
`& STATUS
`H1GH/ LOW COLOR
`BLACK &
`INDICATOR
`I
`WHITE
`L 14A
`1
`\14a
`MED 1
`\
`RESOLUTION
`MODE
`SWITCH
`SWITCH
`
`Apple 1032
`
`U.S. Pat. 9,189,437
`
`Apple 1032
`U.S. Pat. 9,189,437
`
`

`
`6,094,219
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`6/1989 Sasaki.
`4,837,628
`7/1989 Musee et al..
`4,847,677
`2/1990 Yamawaki.
`4,903,132
`2/1990 Koshiishi.
`4,905,092
`7/1990 Asaida.
`4,943,850
`11/1990 Tani.
`4,972,266
`5/1991 Sasson .
`5,016,107
`......................... .. 348/233
`5/1991 Sasaki et al.
`5,018,017
`7/1991 Watanabe et al.
`.................... .. 348/231
`5,032,927
`7/1991 Sasaki et al.
`.
`5,034,804
`8/1992 Roberts et al.
`5,138,459
`.
`11/1992 Kuchta et al.
`5,164,831
`5,170,262 12/1992 Kinoshita et al.
`5,231,501
`7/1993 Sakai .
`
`.
`
`.
`
`OTHER PUBLICATIONS
`
`Article—Computer Graphics World, Feb. 1990, Section:
`Vol. 13; No. 2; pp.69; ISSN:0271-4159 “The Still Video
`Picture; Numerous Uses For Still Video Technology”, Phil-
`lip Robinson.
`
`“HoW Sony Beat Digital—Camera Rivals”, The Wall Street
`Journal, Jan. 25, 1999, B1.
`
`MACINTOSH® System Software User’s Guide, Version
`6.0, 1988.
`
`F. Izawa et al., “Digital Still Video Camera Using Semicon-
`ductor Memory Card”, IEEE Transactions on Consumer
`
`Electronics, 36(1990)Feb. No. 1. New York, U.S..
`
`F. Izawa et al., IEEE Transactions on Consumer Electronics,
`
`Feb. 1990, “Digital Still Video Camera Using Semiconduc-
`
`tor Memory Cord”.
`
`Samuel D. Holland et al., NASA Tech Briefs, Jun. 30, 1993,
`
`p.39, “Digital Electronic Still Camera”.
`
`Electronics World & Wireless World, Oct.
`
`1990.
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 1 of 11
`
`6,094,219
`
`
`
`TEMPORARY
`STORAGE
`
`'
`
` SHUTTER.
`EXPOSURE.
`
`,
`& FOCUS
`
`I CONTROL
`
`
`CONTROL PANEL
`‘I
`
`FIG.
`
`MASS MEMORY
`DEVICE
`
`5a
`
`PRIOR ART
`
`1
`
`r 7
`
`IMAGE
`
`8
`
`9
`
`FRAME COMPRESSION
`PIXEL
`BUFFER BUFFER PROCESSOR
`10
`11
`12
`
`
`13
`
`DISK IIO
`INTERFACE
`
`
`
`
`PANEL
`
`
`DIGITAL CONTROL
` CONTROL
`UNIT
`DISK DRIVE
`17
`
`
`1‘
`ASSEMBLY
`
`
`POWER
`SUPPLY
`
`OPERATOR VARIABLE
`CONTROL SWITCHES
`
`FIG. 2
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 2 of 11
`
`6,094,219
`
`56
`
`AUDIO Fll|.E INFO DATA
`::? [:NEXT FILE
`
`IMAGE FILE INFO DATA
`
`57
`
`FORMAT
`APPLE=0O\?
`i B & w=o
`IBM =o1f/ COLOR = V)
`
`OTHER=10
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 3 0f 11
`
`6,094,219
`
`NORMAL
`
`ACTIVATE BACKGROUND
`DIAGNOSTICS
`
`
`
`LOOK-UP ERROR
`
`CODE & DISPLAY
`
`
`
`
`. DISK INSERT
`
`
`DISPLAY C/P
`
`
`
`POWER-ON SENSOR
`ACTIVE
`
`
`
`NITIATE SELF TEST
`DIAGNOSTICS
`
`
`
`
`
`
`DIAGNOSTICS
`
`ABNORMAL CHECK
`POWER
`
`SUPPLY
`OUTPUT
`
`NORMAL
`
`
`
`
`
`
`' NORMAL
`
`
`
`
`ABNORMAL
`CHECK DISK
`
`DRIVE
`
`
`
`FIG. 3
`
`
`
`
`
`
`PERFORM I/O
`DIAGNOSTICS
`
`‘°*5”°”W*L
`
`ABNORMAL
` PERFORM CPU
`DIAGNOSTICS
`
`

`
`U.S. Patent
`
`Jul. 25, 2000
`
`Sheet 4 of 11
`
`6,094,219
`
`F'G- 5 A
`
`FRAME
`PIXEL
`BUFFER BUFFER
`
` iPLEXER }~-*°-’5———¥—- -i 5
`
`
`
`
`cco AFIRAY=
`!‘§§”‘*3
`
`TO
`COMPRESSION
`PROCESSOR
`12
`
`
`
`480 PIXELS
`
`VERTICAL ADDRESS
`& CONTROL LINES
`
`/——j
`HORIZONTAL ADDRESS
`a CONTROL LINES
`
`FIG. 4
`
`FIG. 5B
`
`PS
`
`.1
`
`PIXEL SELECT
`
`sEn____,3
`
`SAMPLE ENABLE
`
`CE
`
`A/D CONVERT
`ENABLE
`
`CC
`
`CONVERT
`COMPLETE
`
`SC
`
`SAMPLE CLEAR
`
`PB
`
`PIXEL BUFFER
`ENABLE
`
`RST
`
`RESET
`
`-
`
`PB
`
`FRAME BUFFER
`ENABLE
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 5 0f 11
`
`6,094,219
`
`SPEED
`F25 F1000
`
`FLASH +v
`
`=
`
`—‘ SHUTTER &
`EXPOSURE
`CONTROL
`
`17
`
`FORMAT
`IBM APPLE
`SHOOT
`+6V__I " ‘
`I
`‘L +V
`FOCUS 5‘
`“~65
`CONTROL
`
`15
`
`16
`
`FLASH
`
`+v
`
`/
`
`ENABLE 51
`DATA WES
`
`FUNCTION
`& AOORESS
`
`22
`
`CONTROL
`LINES
`
`+v FULL
`
`+v HALF
`:1
`23
`
`\
`
`I
`
`
`
`FRAME
`COUNTER
`& STATUS
`INDICATOR
`1
`
`\
`
`DISK
`FORMAT E
`ERROR
`
`21
`
`SELF
`TEST
`FAILURE
`
`-,—
`
`HIGH
`
`+V
`LOW COLOR
`
`‘
`MED 1
`
`14A
`
`+V
`BLACK &
`WHITE
`\14a
`
`RESOLUTION
`SWITCH
`
`MODE
`SWITCH
`
`FIG. 6
`
`
`
`
`
`
`pIcFRAME
`
`OPCODE
`
`PICTURE DATA
`
`
`
`OPCODE
`
`FIG, 5A
`
`FlG.6B
`
`
`
`PICTURE DATA
`END OF PICTURE
`
`
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 6 0f 11
`
`6,094,219
`
` 'SHOOT' 6
`33 X
`+V
`
`REMOTE
`CAMERA JACK
`
`
`
`31
`
`REM°TE
`COMMAND |
`\\
`1'
`'/—/—"'>
`
`.
`E
`’
`
`+v FULL 'SHOOT'
`30 _/E‘
`E W lSWlTCH
`
`"V “ALF
`
`......... _.
`
`'
`
`'
`........... ..
`
`+V +V 32
`
`CAMERA BODY
`
`FIG‘ 6C
`
`,:__
`
`TO/FROM
`
`COMPRESSION 12
`PROCESSOR
`
`.
`
`ENABLE &
`
`‘CONTROL LINES
`;=
`T0/FROM .
`FRAME ..._;....-34-........._-
`BUFFER
`’
`11
`
`TO/FROM
`
`CONTROL
`PAZNEL
`
`FUNCTION &
`ADDREss
`
`‘9
`
`i
`
`DECODER
`
`ADDREss
`&L,aé‘sTA :CPU
`
`20
`
`9
`
`;
`
`23$,’
`CRY
`“EM
`
`24
`
`so
`
`A
`
`Au
`
`XILI RY I/O
`--‘ INTERFACE
`I
`D|SK I/O INTERFACE
`
`TO
`29
`
`I
`
`TOIFFIOM Y 5
`DISK DRIVE ASSEMBLY
`
`FIG. 7
`
`

`
`U.S. Patent
`
`Jul. 25, 2000
`
`Sheet 7 of 11
`
`6,094,219
`
`FRAME BUFFER
`STACK
`11A
`
`FROM 10
`PIXEL BUFFER
`
`F?
`
`
`
`IMAGE
`“'” FRAMES
`
`MOST RECENT
`IMAGE FRAME
`(LAST)
`
`FIRST IMAGE
`
`
`FRAME
`
`PROCESSOR
` RAM MEMORY
`FIG. 13
`
`—>To 12
`COMPRESSION
`
`INPUT IMAGE FRAME
`
`RGB TO
`
`CHROMINANCE/LUMINANCE
`CONVERSION
`
`
`
`
`
`
`
`PERFORM DISCRETE
`COSINE' TRANSFORM
`
`(DCT)
`
`
`
`
`
`FORMAT OUTPUT
`
`
`
`COEFFICIENTS
`
` PERFORM HUFFMAN
`CODING
`
`
`
`PERFORM OUTPUT
`FORMATTING
`
`
`
`OUTPUT COMPRESSED
`IMAGE TO MEMORY
`
`
`
`FIG. 8
`
`__..
`g_fl©
`
`§—' .@_..
`
`Commercial Video Diskette Video Format
`Still Video
`(Analog format)
`Translator
`Camera
`
`Diskette
`(Digital format)
`
`FIG. 10
`
`1
`
`PC
`
`

`
`
`
`uu<uEm:z_O:xma
`
`U.S.Patent
`
`mdd
`
`Um._.2
`
`mmoouma
`
`an
`
`
`
`SE284<:o_o
`
`..l_z:
`
`><dm_o
`
`JOCHZOU
`
`fl._mz<._
`
`$5:02.N
`
`memo
`
`Sm_2wmm<
`
`
`
`$2..3.“
`
`mamawas
`
`5m2wmm<
`
`
`
`Nu._m<_:<>¢o»$m,_o
`
`
`
`,8:o:>>m.5528
`
`NTOV36¢
`
`Jul.25,2000
`
`mS&:o<55.
`
`Sheet80f11
`
`
`«SENmm2.V.m_ozo_mmmEs_oom_2<EdxaE<um»:
`
`
`
`
`_m0mafi2:mum.mu<u_mm:z_mommmuomm5&8muuaammcmEm>zouEoouwo
`
`«muaddfieUm»:/\w«)mS._So89>
`.addum»:
`
`:2:
`
`._oEzou._<:o_o._oEzou\x/._.<s=_E
`
`
`><._._m_oidz<._«-9.whiz.omo_>\w
`
`
`
`
`
`..<sEou_
`
`93
`
`
`
`52..2.M
`
`mace$5626..2SI38
`>.asmmm<5._.sm--
`
`
`6,094,219
`
`93.«-32.mmzozzm.SE28
`
`
`m:m<_c<>copémmo=u:
`
`
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Jul. 25, 2000
`
`Sheet 9 of 11
`
`6,094,219
`
`
`
`INITIALIZE I/O & READ DISK
`
`
`FORMATTED CHECK DISK
`BOOT SECTOR
`
`
`
`
`
`READ DISK SIZE AND TYPE
`
`POLL CONTROL PANEL
`
`FORMAT SETTINGS
`
`
`
`
`NOT
`FORMATTED
`
`
`
`
`
`
`DISPLAY NDT FORMATTED
`CODE
`
`
`
`
`
`
`
`
`
`
`
`DOES DISK
`FORMAT AGREE
`DISPLAY
`
`WITH CIP
`ERRDR
`SETTING?
`CODE
`
`
`
`HANG UNTIL FORMAT
`MODE SELECT
`
`LOOK-UP APPROPRIATE
`
`FORMAT UTILITY AND OS
`
`PERFORM FORMAT
`TNITIAUZATION
`
`i
`
`2
`
`DISDLAY FRAME
`STORAGE CAPACITY
`
`
`
`TO
`
`OF FIG. 3
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 10 of 11
`
`6,094,219
`
`17
`
`\
`
`APPLE V1 3,
`IBM v2 ?
`
`.
`
`C
`
`600 20-2 XY
`20-2
`
`9
`
`2°
`
`;
`
`11
`
`12
`
`SIGNAL
`
`PROCESSOR
`
`13
`
`5
`
`DISK DRIVE
`ASSEMBLY
`
`FIG_ 14 A
`
`

`
`U.S. Patent
`
`Jul. 25,2000
`
`Sheet 11 of 11
`
`6,094,219
`
`FULL F_RAME BUFFER
`SIGNAL DETECTED
`
`TRANSFER FRAME BUFFER
`CONTENTS TO MEMORY
`BLOCK IN II CHANNEL 13
`
`READ SWITCH 17
`POSITION
`
`DETERMINE
`PC FORMAT
`
`
`
`
`
`
`
`
`
`
`ACCESS IBM
`FORMAT MEMORY
`LOCATION
`
`ACCESS APPLE
`FORMAT MEMORY
`LOCATION
`
`
`DETERMINE
`IMAGE DATA FILE
`DETERMINE
`
`SIZE
`IMAGE DATA FILE
`
`SIZE
`
`'
`READ
`COMPRESSION,
`MODE. AND
`FORMAT SWITCH
`CODES FROM CPU
`20
`
`%
`
`‘
`
`
`
`
`READ
`COMPRESSION.
`‘MODE, AND
`FORMAT SWITCH
`CODES FROM CPU
`20
`_
`
`
`.
`
`WRITE SWITCH
`CODES AND OTHER
`WRITE SWITCH
`
`FILE INFO TO HEADER
`CODES AND OTHER
`FILE INFO TO HEADER
`
`PACK IMAGE DATA
`ewes INTO IBM
`
`
`
`
`FORMAT wum
`opcooe AS SHOWN
`
`PACK IMAGE DATA
`BYTES INTO APPLE
`FORMAT WITH OPCODE
`
`ACCESS OTHER PC
`FORMAT MEMORY
`LOCATION
`
`DETERMINE
`IMAGE DATA FILE
`SIZE
`
`READ
`COMPRESSION,
`MODE, AND
`FORMAT SWITCH
`CODES FROM CPU
`20
`
`WRITE SWITCH
`CODES AND OTHER
`FILE INFO TO HEADER
`
`
`PACK IMAGE DATA
`BYTES INTO OTHER
`PC FORMAT WITH
`OPCODE AS SHOWN
`IN FIG. 8B
`
`
`
`
`
`
`AS SHOWN IN FIG. 6B YES
`
`TRANSFER FORMATTED
`FILE TO DISKETTE 60
`
`FIG’
`
`IREADY FOR NEXT IMAGE
`
`
`

`
`6,094,219
`
`1
`ELECTRONIC STILL VIDEO CAMERA
`WITH DIRECT PERSONAL COMPUTER (PC)
`COMPATIBLE DIGITAL FORMAT OUTPUT
`
`This is a continuation of U.S. patent application Ser. No.
`08/098,787 filed Jul. 29, 1993 now U.S. Pat. No. 5,576,757,
`which is a continuation of U.S. patent application Ser. No.
`07/878,603, filed May 5, 1992, now abandoned, which is a
`continuation of U.S. patent application Ser. No. 07/615,848,
`filed Nov. 20, 1990 and now U.S. Pat. No. 5,138,459.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`This invention generally relates to an electronic still video
`camera and in particular to an improved electronic still
`camera which converts a still picture of an object or scene
`into an operator selectable compressed digital signal format
`for storage utilizing a compression/decompression
`algorithm, such as the Joint Photographic Experts Group
`(JPEG) algorithm standard for example,
`formatted into
`Personal Computer (PC) compatible format retaining the
`images’ color information, and stored on a PC compatible
`memory diskette. For example, the diskette can be a three
`and a half (31/2) inch digital diskette. The digital diskette is
`removeable from the electronic camera for direct insertion
`
`into a PC which contains the previously loaded correspond-
`ing decompression algorithm whereby the digital image is in
`a format compatible for
`immediate use with word
`processing, desk top publishing, data base, and multi-media
`applications.
`2. Description of the Prior Art
`FIG. 1 is a schematic block diagram showing structure of
`a conventional prior art electronic still camera system, in
`which a CCD image sensor element la converts a still image
`of an object into an analog color video signal when the
`shutter control circuitry 2a is activated. The output color
`video signal of the image sensor element is then routed to the
`signal processing subsystem 3a where the signal is con-
`verted to National Television System Committee (NTSC) or
`other composite video formats (such as the European video
`standard Phase Alternating Line-PAL) and logged in analog
`format onto a mass memory storage device such as an analog
`video floppy disk, Electrically Erasable Programmable Read
`Only Memory (EEPROM), analog audio cassette, bubble
`memory, or other storage device 5a. Power is supplied by a
`rechargeable/removeable battery system 4a.
`An electronic camera that converts an image into elec-
`tronic image signals and transferred to a memory storage
`device is disclosed in the following: U.S. Pat. No. 4,131,
`919; U.S. Pat. No. 4,456,931; U.S. Pat. No. 4,758,883; U.S.
`Pat. No. 4,803,554; and U.S. Pat. No. 4,837,628.
`for
`Conventional prior art electronic still cameras,
`example of the types disclosed in the aforementioned
`references, produce an electronic signal corresponding to a
`desired image in analog format such as the National Tele-
`vision System Committee (NTSC) or similar on magnetic or
`electronic storage media for either permanent or temporary
`storage to facilitate viewing on a television or video monitor.
`With the current state of the art, it is expensive and time
`consuming to convert the analog image equivalent to a
`digital format for direct utilization with PC software appli-
`cations. Currently,
`to convert an image captured on an
`electronic still camera to a PC compatible format one must
`convert the signal back to either a composite NTSC or RGB
`video signal and use a conversion device such as a “frame
`grabber” (a digital circuit board installed into PCs that
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`convert video images into PC compatible formats) of the
`type sold commercially by Aapps Corporation, Orange
`Micro, RasterOps, and others or convert the image to a
`hard-copy print (a photograph) and utilize an electronic
`“scanner”, a piece of equipment that connects to a PC, which
`converts an image into a digital format. The later technique
`is employed extensively within the desktop publishing
`industry.
`
`SUMMARY OF THE INVENTION
`
`It is the object of this invention to provide an improved
`electronic still camera with operator selectable picture com-
`pression in one of a plurality of operator selectable digital
`data formats recordable on a standard removeable magnetic
`diskette common to personal computers.
`It
`is a further object of this invention to provide an
`improved electronic still camera that provides digital image
`files for immediate and direct incorporation into popular
`word processing, desktop publishing, and other software
`programs on PCs.
`It is another object of this invention is to provide an
`improved electronic still camera that, under user selection,
`can record and store still images selectively compressed in
`a directly insertable digital memory storage device into a PC
`in either color or black and white formats thus facilitating
`storage of a large number of images with the signal flag
`indicating the degree of compression selected by the opera-
`tor as well as the color/black and white mode selection being
`stored as digital values on the digital memory storage device
`with each image frame.
`An additional object of this invention to provide an
`electronic still camera device that can rapidly capture a
`series of images automatically as well as singularly. Also,
`this camera provides multiple outputs in both video format
`for monitor and display of images and digital formats to
`facilitate data transmission, additional processing, or storage
`to a variety of storage media.
`It is still another object of this invention is to provide a
`more efficient electronic still camera that can take a still
`
`picture with operator selectable high, medium, or low reso-
`lution in either color or black and white by electronic shutter
`and exposure control by utilizing a variety of electro-optical
`sensors including Charge Coupled Devices (CCD), Infrared
`(IR), and Ultra Violet
`(UV) which can be directly or
`remotely controlled by analog, digital, or radio frequency
`(RF) control signals.
`A further object of this invention is to provide a program-
`mable video picture translator device for efficiently convert-
`ing electronic still images in analog composite video format
`into digital data format readable by a PC. This translator
`device also provides additional video inputs and outputs for
`capturing video images, monitoring video images on moni-
`tors and displays, and can transmit either compressed or
`unprocessed digital image data through a variety of output
`I/O channels in various formats such as serial, parallel, etc.
`Also,
`this invention can incorporate sound/voice with
`images thru additional interface circuitry and audio digitiz-
`ers.
`
`Finally, it is the object of this invention to provide an
`electronic still camera that is efficient in design and permits
`extended periods of portable operation and which provides
`the user with operational status through the use of continu-
`ous internal self-test software routines and operator displays.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a schematic block diagram of a conventional
`prior art electronic still camera.
`
`

`
`6,094,219
`
`3
`FIG. 2 is a schematic block diagram of the of the overall
`structure of an electronic still camera embodying the present
`invention.
`
`FIG. 2A is an illustration showing one embodiment of an
`audio data file, data format flag, compression level, and
`color/black and white mode selection values stored on a
`digital memory diskette storage device.
`FIG. 3 is a flowchart showing the power-up and continu-
`ous self-test sequence in accordance with one aspect of the
`present invention.
`FIG. 4 is an example of a 1/2“ CCD array utilizable in
`accordance with one aspect of the present invention.
`FIG. 5A is a schematic block diagram showing the image
`signal to digital signal conversion logic in accordance with
`one aspect of the present invention.
`FIG. 5B is a logic and timing diagram for the image signal
`to digital signal conversion logic in accordance with one
`aspect of the present invention.
`logic in
`FIG. 6 is an example of the control panel
`accordance with one aspect of the present invention.
`FIG. 6A is an example of one embodiment of switch logic
`of the control panel switches and controls utilizable in
`accordance with one aspect of the present invention.
`FIG. 6B is an example of the PICT image file format
`based upon the published standard provided by Apple
`Computer, Inc.
`FIG. 6C is an alternate embodiment of the current inven-
`
`tion embodying remote operation.
`FIG. 7 is a simplified block diagram of the digital control
`unit in accordance with one aspect of the present invention.
`FIG. 8 is a flowchart showing the steps of the image
`compression algorithm in accordance with one aspect of the
`present invention.
`FIG. 9 is a block diagram of a video format translator
`device in accordance with one aspect of the present inven-
`tion.
`
`FIG. 10 is a block diagram illustrating the operation of a
`translator device in accordance with one aspect of the
`present invention.
`FIG. 11 is an alternative embodiment of the video format
`
`translator in accordance with another aspect of the present
`invention showing additional video inputs and data outputs.
`FIG. 12 is an alternate embodiment of the invention
`
`showing an optional diskette format utility flowchart.
`FIG. 13 is an alternate embodiment of a frame buffer
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`utilizable in accordance with another aspect of the present
`invention showing a frame buffer stack permitting multiple
`shot mode.
`
`50
`
`FIG. 14A is a block diagram of an embodiment of the
`format select logic in accordance with one aspect of the
`present invention.
`FIG. 14B is a flow diagram illustrating the steps of the
`format selection logic operations
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENT
`
`FIG. 2 is a schematic block diagram of the preferred
`embodiment of an electronic still camera in accordance with
`
`the principals of the invention. Referring to FIG. 2, an image
`optical pick-up element 1, which for example could be a
`Charge Coupled Device (CCD) (or an Infrared (IR) or
`Ultraviolet (UV) sensor), converts a still image of an object
`into an electric signal when a picture “shoot” command is
`
`55
`
`60
`
`65
`
`4
`initiated by the operator via control panel 2. When taking a
`picture, focusing and shutter speed are controlled by a lens
`system and shutter speed selection mechanism under control
`of the digital control unit 9. The camera, like other still video
`cameras, employs an electronic shutter system that controls
`a charge storage time in a CCD array onto which an image
`of an object is focused through the lens system.
`When the “shoot” control 6 is half depressed (see FIG. 6),
`a power supply voltage is supplied from the rechargeable
`batteries 4 to the electronic circuits and digital control unit
`9, control panel 2, and the disk drive assembly 5. The
`exposure control circuitry not shown generates appropriate
`horizontal and vertical transfer pulses as well as field shift
`pulses under control of the reference clock timing and
`control signals provided by the digital control unit 9 type for
`driving the CCD device and pre-processing circuitry. This
`design may be of any type well known in the art for example
`those cited in U.S. Pat. Nos. 4,131,919 and 4,456,931 and
`any similar designs well known in the prior art.
`An alternate embodiment of the present invention that
`provides remote operation of the camera is shown in FIG.
`6C. When remote “Shoot” control 30 is activated by any
`means for example manually, or by radiant, or electronic
`energy, a control signal is generated and routed through the
`external jack 31, located on the external camera body. The
`external control 30 is electrically connected to the external
`jack 31 by a twisted-pair conductive cable assembly that is
`familiar to those skilled in the art. Upon receipt of the
`externally generated “shoot” command, the relay switch 32
`is activated and provides internal switch closure. This clo-
`sure of switch 32 then initiates the process previously
`described and provides the half V+ voltage previously
`described. The full V+ is provided via the fixed delay 33, the
`value chosen to allow the diskette drive assembly 5 (FIG. 2)
`and associated control circuitry to initialize prior to receiv-
`ing image data.
`When the “shoot” control is fully depressed in either
`embodiment, the shutter controller 15 (FIG. 6) generates a
`shutter pulse that generates control signals for the A/D
`converters 8 allowing the image/picture data signal in the
`sample and hold circuitry of the pixel multiplexer 7 to be
`converted into a digital signal. Control and address instruc-
`tions of the type well known in the art are generated from the
`digital control unit 9 to facilitate the storage of the digital
`image data within the pixel buffer 10 and frame buffer 11.
`Upon completion of image conversion, the contents of the
`frame buffer are transferred to the compression processor 12
`which for example may be of the many versions currently
`offered commercially such as C-Cube’s (San Jose, Calif.)
`four chip Application Specific Integrated Circuit (ASIC) set.
`In the compression processor 12,
`the Joint Photographic
`Experts Group (JPEG), a part of the International Standards
`Organization (ISO) which is a subset of the International
`Telegraph and Telephone Committee (CCITT), image com-
`pression algorithm fully described in Report #JTC1/SC2/
`WG8 dated 1985 is performed under control of the digital
`control unit 9 to compress the size of the image. Avariable
`selectable compression ratio of up to 50:1 is performed on
`the digital image frame. Other compression ratios are opera-
`tor selectable via the control panel 2 switches 14A and 14B
`(FIG. 6). The compressed digital frame is then formatted
`into either an IBM PC/Clone (such as GIFF) or Apple
`Macintosh (such as PICT II) image file format depending on
`the setting selected by the operator for a user switch 17 (FIG.
`6) position on the control panel 2. After formatting, the file
`is written into a temporary memory buffer within the disk
`input/output (I/O) interface circuit 13 which, under the
`
`

`
`6,094,219
`
`5
`command of the digital control unit 9, controls the high
`density (1.4 Mbyte storage capacity) disk drive unit 5.
`Following file transfer to the diskette e.g., the frame counter
`display 22 on the control panel 2 is updated by appropriate
`control signals and the camera is ready to undergo the same
`procedure for the next
`image. Power to the electronic
`circuits and disk drive system is terminated following
`release of the “shoot” control switch 6.
`
`In accordance with the preferred embodiment of this
`invention,
`it is permissible for the user to select various
`resolution quality image recording levels with the higher
`levels being at
`the expense of memory diskette storage
`capacity. The position of switches 14A and 14B for example
`could represent a unique digital mark or word that denotes
`the respective switch position and is sensed during initial
`power application and periodically during operation. FIG.
`6A illustrates typical logic AND gate circuits 60a and 60b
`utilizable in conjunction with switches 14A and 14B or
`switch 17 to generate appropriate signals to designate
`respective switch positions and generate appropriate control
`signals from. The switch positioned in the High position for
`high resolution allows only four to five images to be stored,
`while Med. switch position for medium resolution allows
`approximately twenty five images to be stored, and Low for
`low resolution allows up to fifty images to be stored on a
`single diskette. Also, by selecting black and white mode
`instead of color via switch 14B, the operator may select
`additional storage capacity since storage is increased by a
`factor greater than three (one element per pixel versus three
`for color). Various image resolution combinations are per-
`missible because the operator can select a different resolu-
`tion and mode setting for each image prior to image signal
`capture. This is accomplished by marking or “tagging” each
`image frame data information signal with the resolution and
`mode of each image as it is written onto the memory diskette
`in any suitable manner, for example as shown in FIG. 2A.
`With reference to FIG. 2A, diskette 50 has tracks 51a, 52b,
`.
`.
`. 5211. With reference to track 52b there is shown a
`
`representative portion of segment 53 depicting a typical
`image file information format having digital bit 54 depicting
`color mode, and digital bits 55 representing compression
`resolution level markings or tags. With reference to color
`mode tag 54 it can be seen that if switch 14B is in the color
`position tag 54 is recorded as a logical “one” or true-
`conversely if bit 54 is recorded as a logical “zero” it
`corresponds to the black and white position of switch 14B.
`Similarly as shown switch 14A would record in memory
`position 55 a binary “zero” for low resolution, a binary
`“one” for medium resolution and a binary “two” for high
`resolution selections by the operator. By incorporating this
`“tagging” approach,
`it is possible for the decompression
`algorithm, loaded into any PC prior to use or written onto the
`memory storage diskette along with the image data,
`to
`automatically determine the appropriate level of compres-
`sion associated with image file and execute decompression
`efficiently.
`Still another alternate embodiment in accordance with this
`
`invention incorporates an acoustic digitizer circuit which
`digitizes sound. There are several digitizers commercially
`available such as the Apple Computer Inc. Musical Instru-
`ment Data Interface (MIDI) adaptor. The output of this
`digitizer may be selectively connected to the CPU 20 (FIG.
`7) via an additional I/O interface similar to the auxiliary I/O
`interface 80. The sound or audio associated with each image
`can be recorded, digitized, and stored on the diskette device
`on available tracks in an identical manner previously
`described (FIG. 2A). An image file in accordance with this
`
`6
`embodiment would be appropriately marked or tagged with
`the corresponding digitized audio file 56 (FIG. 2A). Upon
`playback on a sound configured PC, both the image and the
`corresponding audio would then be viewed and heard simul-
`taneously.
`It should be noted that a major advantage a camera in
`accordance with the present invention has over conventional
`still video cameras is that a camera according to this
`invention is capable of storing multiple digital images in
`semiconductor memory temporarily at a rapid rate while,
`simultaneously, the image compression processor 12, file
`formatter software algorithm, and disk I/O interface 13 that
`stores formatted files continue to function in concert
`
`together at a slower rate. This efficient design coupled with
`VLSI
`low power, high speed semiconductor memory
`devices (10 & 11 FIG. 5A and 24 FIG. 7) allows this
`operational capability.
`Like most other still video and conventional film cameras,
`when the “shoot” control 6 (FIG. 6) is fully depressed, a
`control signal is generated from the digital control unit 9 that
`generates a trigger signal on the control panel 2 to cause a
`flash unit 16 (FIG. 6) to irradiate a flash of light onto the
`subject image.
`During initial camera operation, the user first inserts a
`diskette such as a standard three and a half inch or similar
`
`storage medium. Various memory diskette sizes and formats
`are suitable for the invention. However, for the preferred
`embodiment either a double-density (800 Kbytes of storage)
`or a high-density (1.4 Mbytes of storage) diskette in a three
`and a half inch format which are readily available from
`various commercial sources such as Sony, Maxell, and
`Verbatim. The user must then select the desired PC format
`
`(IBM PC/Clone or Apple Macintosh, etc.) via switch 17
`(FIG. 6) on the control panel 2. As shown in FIG. 3.; after
`turning on the power switch or inserting a diskette 50, the
`digital control unit 9 performs a self test of all internal
`circuitry, battery, disk drive unit, and control panel. Should
`any failures be detected, an appropriate error indicator is
`illuminated on the control panel. During the power-on
`sequence (see FIG. 3 and FIG. 12), the inserted diskette 50
`is automatically checked for formatting consistencies in
`accordance with the format selected by the format switch 17
`on the control panel 2 (IBM/Apple/etc.) and for available
`storage space by checking the boot block on the diskette, a
`technique that will be familiar to those skilled in the art.
`Should any inconsistencies be detected, an error indicator is
`illuminated on the control panel (ie, disk full, unformatted,
`etc.). The operator frame counter display 22 (FIG. 6) is then
`updated to show the maximum number of pictures available
`based upon indicated operator selections (color/black and
`white), diskette type (double versus high density), and
`capacity (partially full versus empty diskette). During
`operation, the operator can selectively erase a frame and
`record over it if desired by selecting the erase mode of
`operation from the control panel and toggling the forward/
`reverse control.
`
`The optics for the preferred embodiment of the invention
`is a commercially available one-half inch (1/2‘") color CCD
`device having a pixel grid array of 780x488 as pictorially
`depicted in FIG. 4. This results in 380,640 pixel elements
`which results in a commercially acceptable quality resolu-
`tion image as will be understood by those skilled in the art.
`In a color
`imaging device (CCD array) photoelectric
`elements, such as photodiodes, are arranged in a two dimen-
`sional array with optical filters for R (red), G (green), and B
`(blue). Various arrangeme