EXHIBIT 1063
`
`U.S. PATENT NO. 5,748,326 TO THOMPSON-BELL et al.
`
`(“THOMPSON-BELL”)
`
`TRW Automotive U.S. LLC: EXHIBIT 1063
`PETITION FOR INTER PARTES REVIEW
`OF U.S. PATENT NUMBER 8,599,001
`IPR2015-00436
`
`

`
`11111111111 II IIIII Ill II Ill llll II IIII Ill llllll Ill lllll llll
`
`US005748326A
`[111 Patent Number:
`[45] Date of Patent:
`
`5,748,326
`May 5, 1998
`
`United States Patent [19]
`Thompson-Bell et al.
`
`[54]
`
`INSTANT SPECIAL EFFECTS ELECTRONIC
`CAMERA
`
`[75]
`
`Inventors: Ian Thompson-Bell, Lillington;
`Michael Roger Cane, Cambridge;
`Michael Andrew Beadman, Royston,
`all of United Kingdom; David J,
`Ciganko, Hamburg, N.Y.; Stephen
`John Love, Over, United Kingdom;
`Paul Diminic Priestman, London,
`England
`
`[73] Assignee: Fisher-Price Inc,, E. Aurora, N.Y.
`
`[21] Appl. No.:
`
`656,285
`
`[22] PCT Filed:
`
`Dec. 2, 1994
`
`[86] PCT No.:
`
`PCT/US94/13803
`
`§ 371 Date:
`
`Jun.6,1996
`
`§ 102( e) Date: Jun. 6, 1996
`
`[87] PCT Pub. No.: W095/16323
`PCT Pub. Date: Jun. 15, 1995
`Foreign Application Priority Data
`
`[30]
`
`[GB] United Kingdom ................... 9325076
`
`Dec. 7, 1993
`Int. CI.6
`.............................. H04N 1/21; G03B 15/00
`[51]
`[52] U.S. CI ......................... 358/296; 358/909.1; 396/661
`[58] Field of Search ..................................... 358/296, 335,
`358/909.1, 906; 386/121; 355/18, 19, 21;
`396/239
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,057,830
`4,074,324
`4,131,919
`4,161,749
`4,262,301
`4,286,849
`4,420,773
`4,456,931
`4,489,351
`
`11/1977 Adcock ....................................... 358/4
`2/1978 Barrett ..................................... 178/6.6
`12/1978 Lloyd et al. .. .............................. 360/9
`7/1979 Edichman ................................. 358n5
`4/1981 Edichman ................................... 358/4
`9/1981 Uchidoi et al ............................ 354/23
`12/1983 Toyoda et al ........................... 358/906
`6/1984 Toyoda et al ............................. 358/83
`12/1984 d'Alayer de Costemore d' Arc .... 358/
`335
`
`4,541,010
`4,577,229
`4,614,966
`4,758,883
`4,827,347
`4,903,132
`4,930,014
`4,937,676
`4,942,477
`5,016,107
`5,173,732
`5,231,511
`5,301,026
`5,477,264
`
`9/1985 Alston ....................................... 358/43
`3/1986 de la Cierva, Sr. et al ............... 358/21
`9/1986 Yunoki et al. .. ........................ 358/909
`7/1988 Kawahara et al ......................... 358/41
`5/1989 Bell ......................................... 358/224
`2/1990 Yamawaki ............................... 358/212
`5/1990 Maeda et al ............................ 358/180
`6/1990 Finelli et al. .. ......................... 358/229
`7/1990 Nakamura ................................. 358/80
`5/1991 Sasson et al ............................ 358/479
`12/1992 Kazami et al ............................ 355/55
`7/1993 Kodama et al ......................... 358/906
`4/1994 Lee .......................................... 358/183
`12/1995 Sarbadhikari et al. ................. 348/231
`
`FOREIGN PATENT DOCUMENTS
`
`0 398 295
`0 574 581
`2 263 841
`WO 91/14336
`WO 92/11731
`
`11/1990
`9/1991
`8/1993
`9/1991
`7/1992
`
`European Pat. Off ..
`European Pat. Off ..
`United Kingdom .
`WIPO.
`WIPO.
`
`OTHER PUBLICATIONS
`
`1990 IEEE, International Symposium on Circuits and Sys(cid:173)
`tems, vol. 3 of 4., New Orleans, LA, May 1-3, 1990.
`"PASIC: A Processor-AID Converter-Sensor Integrated
`Circuit", K. Chen et al.
`International Search Report received in International Appli(cid:173)
`cation No. PCT/US94/13803, dated Apr. 25, 1995.
`
`Primary Examiner-Peter S. Wong
`Assistant Examiner-Gregory J. Toatley, Jr.
`Attorney, Agent, or Firm-Morgan, Lewis & Bockius LLP
`
`[57]
`
`ABSTRACT
`
`An instant special effects camera which provides children in
`the age range of five years and up with an opportunity to take
`photos and see the results instantly. The camera is a battery
`operated electronic black and white camera with an integral
`direct thermal printer. A replaceable paper cassette is
`included. To improve the ease of use and reduce cost, a
`minimal number of simple controls are provided. A picture
`may be taken simply by aiming the camera through a double
`view finder and pressing the shutter button. No setting up or
`flash is required. Plug-in special effects cartridges may be
`provided to increase the number of special effects.
`
`8 Claims, 11 Drawing Sheets
`
`I PRESS SHUTTER {POWER UP) I
`I
`SET EXPOSJRE
`
`CAPTURE B BIT GREY IMAGE
`
`I CONTRAST ENHANCEMENT
`
`I
`MAGNIFY. DITHER & COMPP.ESS l
`
`PRINT FOOTER
`
`'-----'! TIMEOUTFOR REPE~T PICTURE I
`i
`POWER DOWN
`
`1063-001
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 1 of 11
`
`5,748,326
`
`/3
`
`..
`
`~
`
`RAM
`
`A
`
`,r
`
`I 4
`
`MICROPROCESSOR
`
`CCD
`ARRAY
`
`i - -~ -~
`
`.. CONVERTOR
`
`ND
`
`I
`
`-....
`
`THERMAL
`PRINT
`HEAD
`
`-
`
`6 I I
`
`PRINTER
`MECHANISM
`
`FIG. 1
`PRIOR ART
`
`1063-002
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 2 of 11
`
`5,748,326
`
`11
`I
`I
`ANALOGUE
`OUTPUT
`
`HORIZONTAL SHIFT REGISTER
`
`I
`
`I
`
`• • • •
`
`VERTICAL
`SHIFT
`REGISTER
`
`•
`•
`•
`•
`
`8
`
`VERTICAL
`SHIFT
`REGISTER
`
`•
`
`•
`•
`•
`
`8
`
`7
`
`7/
`
`CCD
`CONTROL
`
`\
`
`\
`10
`
`CONTROL
`
`FIG. 2
`PRIOR ART
`
`1063-003
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 3 of 11
`
`5,748,326
`
`/14
`
`CONVENTIONAL
`160 X 160
`CCD
`ARRAY
`
`AID
`CONVERTOR
`
`TRI-STATE
`BUFFER
`
`CONTROL
`LOGIC
`
`16~ ~------,
`MEMORY
`CONTROL
`LOGIC
`
`ADDRESS
`
`RN/
`
`INCREMENT CLEAR
`
`17
`
`1~
`
`2~
`
`\_25
`
`FIG. 3
`
`DIGITAL
`DATA
`
`~23
`
`BUSY
`
`i
`
`~22
`"----Q TRANSFER
`~
`21
`READ
`"------20
`SHU TIER
`~
`'19
`
`1063-004
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 4 of 11
`
`5,748,326
`
`CUSTOM
`CCD
`ARRAY
`
`RANDOM
`ACCESS
`MEMORY
`
`PLUG·IN
`MODULE
`
`t
`V 29
`
`,'
`
`PRINT
`HEAD
`
`-~
`
`t
`. ~"---1---------- 1
`
`32
`
`1 ~
`MICROPROCESSOR
`
`IEFF~
`SWITCHES
`
`••
`
`s HUTTER
`SWITCH
`
`~32
`
`8
`
`l+-j
`I
`I
`I
`"'-2a
`
`-p
`
`PRINTER
`MECHANISM
`
`30
`V
`
`,'
`
`FIG. 4
`
`1063-005
`
`

`
`[>109
`
`8
`
`111
`
`DATA
`LATCH
`
`8
`
`DO-D7
`
`""---112
`
`COLUMN SHIFT
`REGISTER
`
`105
`1 O? -----r-
`COLUMN
`INTEGRATING AMPS
`
`AID - 8 BIT
`
`--· - -103
`
`160 X 190
`IMAGE ARRAY
`
`ROW
`SHIFT
`REGISTER
`
`121
`
`TIMER
`CONTROL
`
`101
`
`1
`
`100
`
`AB-A 14
`
`I 15
`15 BIT
`PRESETIABLE ~
`BINARY COUNTER
`
`AO-A?
`
`'113
`
`----ii
`
`RAM
`CONTROL
`
`2
`
`NJE
`CONTROL I /AS
`
`'J,115 i - - - - -
`
`119
`
`I 1
`
`EXPOSURE I
`CONTROL
`
`Lt
`
`FIG. 5
`
`ADDRESS/ ~
`MODE DECODE
`
`// 117
`
`/FAM
`/FRMC
`AH
`MODE
`CONTROL AL
`
`/WE
`!OE
`
`~ • 00
`•
`'"'C
`~
`
`~ a.
`
`l
`--'""
`....
`!
`
`00
`[
`~
`UI
`
`s, ....
`....
`
`01
`'!..J
`~
`QC
`._.
`~
`N
`~
`
`1063-006
`
`

`
`-~
`
`IMAGE SENSOR
`ARRAY
`/AL,/AH ,!WE -
`
`/MOE,FRM.FAMC
`
`.....
`
`/
`
`/
`100
`
`~ ....
`
`EFFECTS
`CARTRIDGE
`/AL,/AH -
`.....
`!WE,/COE
`
`SHUTIER, EFFECTS (6)
`TONE (3)
`
`........_
`
`"
`
`/ /
`133
`
`131
`'--..._
`
`141
`'"-...
`
`-..._
`
`BATIERY
`6'AA(15VNOM)
`OR 6' NICAD (1.2 V NOM)
`
`8
`
`15
`
`2
`
`.... DATA
`....-
`,, ___ _..,.. ADDRESS RAM
`- /AS,NJE
`...
`
`32K
`
`8
`
`,, - DATA
`...
`
`7
`
`jl
`
`5
`
`MICROCONTAOLLER
`/AL,/AH,!WE,
`/COE,/MOE.FRMJRMC
`
`...
`...
`- I/ANALOGUE IN
`...
`0
`1,
`
`ON
`
`PSU
`
`0
`I -.....
`
`125
`
`/
`
`/
`
`B
`8
`
`/127
`
`/
`
`...
`
`~
`
`____.
`
`DATA
`PRINT HEAD
`BOOT
`
`.
`
`~135
`
`9
`/13
`
`/
`
`1
`
`,___.,.
`
`AUDIONISUAL
`OUTPUT DEVICE
`
`B
`
`2
`
`~ ...
`
`DC MOTOR
`ENCODER, HOME
`
`JL ~137
`
`/129
`
`'
`
`5V LOGIC ETC.
`
`FIG. 6
`
`~ •
`00.
`•
`
`~ e. ~ a
`
`~
`~
`,..f.11
`
`~
`
`\C i
`
`00. ;
`a
`a,,
`~
`
`~
`~
`
`Ol
`'!..J
`~
`QO
`"' ~
`N
`~
`
`1063-007
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 7 of 11
`
`5,748,326
`
`PRESS SHUITER (POWER UP)
`
`SET EXPOSURE
`
`CAPTURE 8 BIT GREY IMAGE
`
`PRINT HEADER
`
`CONTRAST ENHANCEMENT
`
`MAGNIFY, DITHER & COMPRESS
`
`APPLY EFFECTS
`
`PRINT IMAGE
`
`PRINT FOOTER
`
`.._ __ ____. TIMEOUT FOR REPEAT PICTURE
`
`POWER DOWN
`
`FIG. 7
`
`1063-008
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 8 of 11
`
`5,748,326
`
`SP EEO ---
`
`h
`
`ERROR
`
`PWM
`TIMER
`
`-
`
`I
`
`DC MOTOR
`
`ENCODER -
`
`ENCODER
`TIMER
`
`FIG. 8
`
`SHUITER PRESS
`
`SAMPLE IMAGE LINE
`
`N
`
`TEST
`EXPOSURE
`±30
`
`r - - - - - - - - -1 y
`IMAGE FRAME
`
`N
`
`TEST
`EXPOSURE
`±5
`
`y
`
`FIG. 9
`
`1063-009
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 9 of 11
`
`5,748,326
`
`216
`
`216A
`
`210
`\ '
`
`212
`
`204
`
`[~----1-!--f 208
`t-~-JJ~ H H · 3
`
`/200
`
`202
`
`FIG. 10
`
`1063-010
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 10 of 11
`
`5,748,326
`
`/212
`
`206
`
`206A
`
`2168
`
`216
`
`200
`
`210
`
`218
`
`202_/
`
`FIG. 11
`
`204
`
`CJ
`
`200
`
`202
`
`FIG. 12
`
`"---- 220
`
`1063-011
`
`

`
`U.S. Patent
`
`May 5, 1998
`
`Sheet 11 of 11
`
`5,748,326
`
`co
`T-
`N
`
`co
`c.o
`T -
`('\J
`
`(
`
`r
`
`-
`
`-,
`
`r- -
`
`---,
`
`gfl
`
`I
`
`C, -LL
`
`0
`
`C'\J
`0
`N
`
`1063-012
`
`

`
`5,748,326
`
`1
`INSTANT SPECIAL EFFECTS ELECTRONIC
`CAMERA
`
`BACKGROUND OF THE INVENTION
`
`10
`
`The present invention relates generally to a hand-held
`electronic imaging camera and, more particularly, to an
`electronic camera capable of recording an image of a scene
`and thereafter electronically manipulating the image and
`producing a hard copy print on a paper sheet. The electronic
`camera is designed to be operated by a child, and captures
`the image with a charge coupled device (CCD). The hard
`copy printout is preferably produced with a thermal printer.
`Electronic imaging cameras capable of recording an
`image of a scene and providing a hard copy printout using
`a thermal printer are known in the art. For example, U.S. Pat.
`No. 4,074,324 to Barrett discloses an instant electronic
`camera which focuses an image on a CCD having a planar
`array of photosensors. Signals from the CCD are digitized
`and placed in a shift register memory. The contents of the
`shift register memory are then output to a dot matrix printer
`having heat-sensitive paper. Other electronic cameras with
`printer devices are shown, for example, in U.S. Pat. No.
`4,262,301 to Erlichrnan, published European Patent Appli(cid:173)
`cation No. 574,581 to King Jim Co., published PCT Appli(cid:173)
`cation No. WO 92/11731 to Eastman Kodak Co., and
`published European Application No. 398,295 to Minolta
`Camera.
`In a typical electronic camera of this type, the camera
`optical system focuses an image on a conventional CCD
`chip having an array of photosensors. The photosensors
`produce analog signals proportional to the intensity of
`incident light. These analog signals are digitized by an
`analog-to-digital converter and stored in a random access
`memory. The capture, conversion and storage of the image
`is normally controlled by a microprocessor. The micropro(cid:173)
`cessor can then control the print head of an associated printer
`mechanism to provide a hard copy of the captured image.
`Optional software for the microprocessor can process the
`image stored in the random access memory to enhance the
`quality of the printed image or to produce special effects
`such as an outline image.
`Electronic cameras of this type have several disadvan(cid:173)
`tages. Because the CCD array operates at a relatively high
`speed, and the printer typically operates at a relatively low
`speed, it is often necessary to store the entire captured image
`in the random access memory. A typical conventional CCD
`array can capture 80,000 or more picture elements (pixels),
`each of which is stored in memory. This requires a relatively
`large memory which adds to the cost of the camera. The
`system described in PCT Application No. WO 92/11731
`attempts to overcome this disadvantage by coupling the
`CCD array directly to a printer. However, this system
`introduces additional disadvantages and limits the available
`options.
`For many applications, it is not necessary to capture
`80,000 or more pixels to produce a satisfactory image
`quality. For example, for a child's electronic camera, a CCD
`device with a 160x 160 array of photosensors (25,600 pixels)
`or a 190x160 array of photosensors (30,400 pixels) may
`provide sufficient picture resolution. Using a lower resolu(cid:173)
`tion CCD array can save costs for both the CCD chip and the
`random access memory.
`To produce a satisfactory printed image quality, it is
`necessary to produce the appearance of shades of gray in the 65
`hard copy print out. However, a thermal printer is only
`capable of producing black or white dots. As a result, the
`
`2
`microprocessor must manipulate the data in the random
`access memory to produce the appearance of shades of gray
`in the printout. Algorithms for producing this effect, known
`as dithering techniques, are known in the art. A typical
`5 dithering technique would operate on a block of pixels one
`line wide and two or three lines high. Thus, to create the first
`line of the printed image, the microprocessor needs to
`operate on only the first two or three lines of the captured
`image. Therefore, if a system could be arranged so that only
`two or three lines of data had to be stored in the random
`access memory at a given time, the size of the random access
`memory could be reduced by a factor of ten or more, with
`a consequent savings in cost.
`Because the CCD array produces analog outputs at a
`relatively high rate, it is usually necessary for both the
`15 digital-to-analog converter and the random access memory
`to operate at high speed. Cost would be reduced if the CCD
`array could be arranged to capture an image at high speed,
`but output the image at relatively low speed, therefore
`allowing a slower analog-to-digital converter and random
`20 access memory to be used.
`It is a primary objective of the present invention to
`overcome tlle described disadvantages of the prior art as
`well as other prior shortcomings, and to provide a relatively
`low cost electronic camera for children which is capable of
`25 providing plain prints as well as prints with special effects
`features.
`BRIEF SUMMARY OF THE INVENTION
`The present invention provides a low cost instant special
`effects camera suitable for use by children, and provides an
`affordable alternative to film cameras. In the preferred
`embodiment, an image sensor includes an array of photo(cid:173)
`sensors which provide analog image outputs proportional to
`the intensity of light incident on the respective photosensors.
`The image sensor preferably includes timing logic for con-
`35 trolling operation of the photosensor array, as well as an
`analog to digital converter for digitizing the analog image
`outputs and interface logic. Electronic exposure control may
`also be provided to allow the use of low cost fixed aperture
`camera optics.
`A memory stores the digitized image data from the image
`sensor for later processing by a microcontroller. To allow the
`use of a low pin count, low cost microcontroller, the
`microcontroller accesses data in the memory through the
`image sensor interface and a multiplexed address/data bus.
`45 In operation, the microcontroller retrieves data from the
`memory and applies contrast enhancement, magnification,
`dithering and data compression algorithms to prepare the
`data for printing. The print-formatted data is then stored
`back in the memory.
`The microcontroller applies selected special effects to the
`print-formatted data as it is retrieved from memory for
`printing. Information for a plurality of standard special
`effects, including processing algorithms and/or data, may be
`provided in ROM internal to the microcontroller. Additional
`55 special effects information may be provided by optional
`ROM packs which may be inserted in the camera. A manual
`switch may be provided on the camera housing to permit a
`user to select specific special effects. Additionally, random
`selection of the special effects information may be chosen.
`An integral printer is provided in the camera body, and
`paper may be supplied by replaceable paper cassettes.
`Audible and/or visual indications maybe provided to alert
`the user to the status of the camera processing.
`BRIEF DESCRIPTION OF THE DRAWINGS
`The objects, advantages and features of the present inven(cid:173)
`tion will become apparent to the skilled artisan from the
`
`30
`
`40
`
`50
`
`60
`
`1063-013
`
`

`
`5,748,326
`
`3
`following detailed description, when read in light of the
`accompanying drawings, in which:
`FIG. 1 is a schematic block diagram of a typical prior art
`electronic camera with a hard copy output;
`FIG. 2 is a block diagram of a conventional CCD imaging 5
`array;
`FIG. 3 is a block diagram of a custom CCD imaging array
`for use in an electronic camera;
`FIG. 4 is a block diagram of one embodiment of an
`improved electronic imaging camera using a custom CCD
`array;
`FIG. 5 is a block diagram of a preferred custom imaging
`sensor;
`FIG. 6 is a block diagram of a preferred embodiment of
`an electronic imaging camera using the imaging sensor of
`FIG. 5;
`FIG. 7 is a flow chart illustrating the operation of the
`electronic imaging camera of FIG. 6;
`FIG. 8 illustrates a pulse width modulation technique for
`controlling printing operation;
`FIG. 9 is a flow chart illustrating an exposure control
`scheme for use with the electronic imaging camera of FIG.
`6;
`
`20
`
`Referring to FIG. 1, a typical electronic camera utilizes a
`conventional CCD array 1 to capture an image focused on
`the CCD array by camera optics. The analog output of the
`CCD array 1 is digitized by an ND converter 2 and stored
`in random access memory 3. A microprocessor 4 controls a
`print head 5 and printer mechanism 6 to provide a hard copy
`of the captured image. The microprocessor 4 may optionally
`include software to process the image stored in the random
`access memory 3 to enhance the quality of the hard copy
`image or to produce special effects such as an outline image.
`As illustrated in FIG. 2, a conventional CCD array
`includes a plurality of photosensors 7 arranged in a matrix
`of rows and columns. Each photosensor represents a single
`pixel in the image. A vertical shift register 8 is associated
`with each column of photosensors. During operation, the
`analog image data from the photosensors 7 is gated into the
`vertical shift registers 8 by the CCD control 10. At this point,
`each vertical shift register contains one column of analog
`image information. Subsequently, the CCD control 10 shifts
`the data in the vertical shift registers 8, by one pixel in an
`upward direction. As a result, the topmost pixel of each
`column is shifted into the horizontal shift register 9 so that
`the horizontal shift register 9 then contains one row of image
`data. The contents of the horizontal shift register are then 60
`shifted to the right by one pixel at a time to the analog output
`terminal 11 by the CCD control 10. in this way, a row of
`image data is clocked out of the CCD array one pixel at a
`time. The horizontal shift register 9 is then filled with the
`next line of data by shifting the data in all the vertical shift 65
`registers 8 up one pixel. This line of pixel data is again
`output through the analog output terminal 11 by successive
`
`FIG. 10 is a front view of a camera housing for the
`electronic imaging camera of FIG. 6;
`FIG. 11 is a rear view of the camera housing of FIG. 9;
`FIG. 12 is a side view of the camera housing of FIG. 9;
`and
`FIG. 13 is a bottom view of the camera housing of FIG.
`
`9.
`
`DEfAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`30
`
`35
`
`4
`shifting of the horizontal shift register 9. This process is
`repeated until all lines of pixel data have been output from
`the analog output terminal 11.
`Referring now to FIG. 3, the custom CCD array consists
`of a conventional CCD array 12 having, for example, a
`160xl60 pixel matrix, an analog to digital (ND) converter
`13, a tri-state buffer 14, control logic 15 and memory control
`logic 16. The busy signal 22, the transfer signal 21, the read
`signal 20 and the shutter signal 19 are used to control the
`10 operation of the device and are normally connected to an
`external microprocessor. The digital data signals 23, the
`address signals 17 and read/write signals 18 are used to
`transfer data to an external random access memory.
`In operation, when the shutter signal 19 is asserted, the
`15 control logic 15 controls the CCD array 12 to capture a
`single image focused on the array by the camera optics. A
`filter may be provided to select light frequencies to which
`the photosensors are sensitive. During this process, the
`control logic 15 asserts the busy signal 22 to inform the
`external microprocessor that it is busy. When the image has
`been captured, the busy signal 22 is not asserted. When the
`transfer signal 21 is asserted, the control logic 15 transfers
`a predetermined number of lines of data from the CCD array
`12 via the ND converter 13 and tri-state buffer 14 to an
`25 external random access memory. The control logic 15 also
`controls the address in the external random access memory
`at which each pixel is stored by controlling the memory
`control logic 16 which generates the address signals 17 and
`the read/write signal 18 which are also connected to the
`external random access memory. The control logic 15 asserts.
`the busy signal 22 during the transfer. This process may be
`repeated until all the data from the CCD array 12 has been
`transferred.
`Between each transfer of a predetermined number of
`lines, or once all the data has been transferred to the external
`random access memory, the data in the external random
`access memory can be read by asserting the read signal 20.
`When the read signal 20 is asserted, the control logic 15 and
`40 the memory control logic 16 control the address signals 17
`and the read/write signal 18 to access a memory location in
`the external random access memory. While the read signal
`20 is asserted, the tri-state buffer 14 is disabled to prevent the
`output of the ND converter 13 from interfacing with the data
`45 read from the external random access memory. The address
`from which data is read is determined by the increment
`signal 24 and clear signal 25. When the clear signal 25 is
`asserted, the address is set to zero. Each time the increment
`signal 24 is asserted the address is incremented by one. In
`50 this way, an external microprocessor or other control circuit
`can access any of the data in the external random access
`memory.
`Turning to FIG. 4, an improved electronic imaging cam(cid:173)
`era includes a custom CCD array 26, such as that illustrated
`55 in FIG. 3, external random access memory 27, a micropro(cid:173)
`cessor 28, a print head 29, a printer drive mechanism 30 and
`an optional plug-in module 31 which may comprise random
`access memory only, or a combination of random access
`memory and read-only memory.
`In operation, the microprocessor 28 commands the cus(cid:173)
`tom CCD array 26 to capture an image when the shutter
`switch is operated. Once the image has been captured the
`custom CCD array 26 informs the microprocessor 28 that
`this operation is complete. When no plug-in module 31
`provided, the microprocessor 28 then commands the custom
`CCD array 26 to transfer a predetermined number of lines of
`image data into the random access memory 27. The number
`
`1063-014
`
`

`
`5,748,326
`
`5
`of lines to transfer is determined by the functions the
`electronic imaging camera is expected to be able to perform
`without the benefit of the plug-in module 31. The amount of
`random access memory 27 is chosen to be just sufficient to
`hold the predetermined number of image data lines. In one 5
`embodiment, eight lines of data are transferred to the ran(cid:173)
`dom access memory 27. Where one line of image data
`consists of 160 pixels, the 8 lines of image data requires 8
`times 160 bytes, or 1,280 bytes. A low cost 2 kilobyte
`random access memory 27 can therefore be used. Transfer-
`ring the image 8 lines at a time allows a simple dithering
`algorithm to be employed which will allow an acceptable
`but not high quality gray-scale hard copy to be produced. As
`each group of 8 lines of image data is transferred, the
`microprocessor 28 in cooperation with custom CCD array
`26 accesses the image data one byte at a time, carries out the 15
`dithering algorithm, if required, then controls the print head
`29 and the printer drive mechanism 30 to produce a hard
`copy image. Lines are transferred eight at a time to random
`access memory 27, manipulated and printed by the micro(cid:173)
`processor 28, in cooperation with the print head 29 and 20
`printer drive mechanism 30 until the entire captured image
`has been printed.
`In another embodiment, 4 kilobytes of random access
`memory 27 is provided and lines of image data are trans(cid:173)
`ferred in a block of 16 lines or two blocks of 8 lines to the 25
`random access memory 27. This allows the microprocessor
`28 to employ a more sophisticated dithering algorithm
`which produces a correspondingly higher quality hard copy
`image.
`To allow additional features and functions to be provided 30
`a plug-in module 31 may be connected to the electronic
`imaging camera. In one embodiment, the plug-in module 31
`contains 32 kilobytes of random access memory. This allows
`the entire image to be transferred from the custom CCD
`array 26 to the plug-in module 31 before the image is 35
`printed. This allows more complicated effects to be pro(cid:173)
`duced which require the microprocessor to be able to access
`the entire image or large portions of the image. In addition,
`because the entire image is stored, extra copies of the image
`can be printed. Each copy can be identical to the previous 40
`one or modified, if required by pressing one of the effects
`switches 32. The effects that can be selected include, but are
`not limited to, binary image, outline image, contrast
`enhancement and the addition of a "speech bubble" such as
`are used in newspaper cartoons.
`In another embodiment, the plug-in module contains read
`only memory, the contents of which represent a number of
`pre-stored images. These pre-stored images could include
`picture frames, places of interest, film or pop stars, animals
`or other images of an educational or entertainment nature. A 50
`particular image can be selected either by the operation of a
`switch incorporated in the plug-in module 31 or by the
`effects switches 32. The image could be printed directly or
`used as a background over which a captured image could be
`superimposed.
`Turning now to F1G. 5, a block diagram of the preferred
`custom image sensor is illustrated. Preferably, the image
`sensor array is constructed in accordance with PCT Pub(cid:173)
`lished Application No. WO 91/04633 to VLSI Vision Ltd.
`("VVL"). A test circuit for such an image sensor array is 60
`disclosed in PCT Published Application No. 91/04498. This
`type of imaging array is available from VVL as part of a
`monochrome monolithic camera under the trade name ASIS-
`1070. Customization of the array is available to suit a
`particular application.
`Briefly, unlike the CCD array of F1G. 2, the VVL image
`sensor array does not utilize vertical shift registers to clock
`
`6
`the data to an output port. Rather, a relatively compact array
`of pixels is provided with a series of horizontal word lines
`and vertical bit lines. Each pixel in a row is connected to a
`common horizontal word line which, in turn, is connected to
`driver control circuitry such as a shift register. Each vertical
`column of pixels is connected to a vertical bit line which is
`coupled to one input of an associated switch sense amplifier.
`A second input of the switch sense amplifiers is coupled to
`a switching control circuit. The output terminals of the
`switch sense amplifiers are connected to a common read-out
`line. In operation, the signals from the photosensors are
`effectively sequentially multiplexed onto the read out line
`through the switch sense amplifiers under direction of the
`driver control circuitry and the switching control circuit. For
`a more detailed description of such an image sensor array
`and its operation, reference may be had to the published
`VVL patent applications.
`F1G. 5 illustrates a modified version of the VVL ASIS-
`1070 which forms an image sensor 100. The sensor 100
`includes an image array similar to the ASIS-1070 image
`array, together with all the timing logic to control the array.
`In addition to the imaging array, the sensor 100 includes an
`analog to digital converter and all the logic necessary to
`interface with static RAM and a microcontroller. The design
`of the image sensor array is intended to allow the use of a
`low pin count, low cost rnicrocontroller to process the image
`data and control the printer. The sensor array interface
`supports a minimum pin count interface between a system
`microcontroller and the system peripherals by combining the
`address and data bus and decoding the high and low address
`locally to the peripherals. The image is stored in static RAM
`and is accessed using a multiplexed address/data bus to
`provide an interface with the microcontroller.
`An array 101 of photosensors having ap. array size, for
`example, of 160x190 pixels, is provided with associated
`control circuits and switch sense amplifiers. In operation,
`row shift register 103 and column shift register 105 sequen-
`tially switch the data from the individual pixels through a
`bank of integrating amplifiers 107 to an output terminal 109.
`An eight bit analog to digital converter 111 digitizes the
`pixel data into eight bit data, and places the data in parallel
`on a data bus D0-D7 through a bidirectional data latch 112.
`A fifteen bit presettable binary counter 113 is provided to
`generate address signals for the individual data words on
`45 address bus Ao-A7 , A8-Aw A RAM interface is provided
`for write enable (WE) and address strobe (AS) signals which
`control transfers between the image sensor array and the
`system memory. The interface between the image sensor
`array and the RAM is a simple read/write interface using the
`address strobe line to latch the current address and the write
`enable line to control the read or write mode. Since the speed
`of the microcontroller interface will be relatively slow in
`comparison to the rate at which data becomes available on
`the multiplexed address/data bus during a read operation,
`55 this simple interface permits the use of a low cost RAM.
`A mode controller 117 is included to allow the image
`sensor array to operate in a selected one of several available
`operating modes, as discussed more fully below. Automatic
`exposure control logic and timer control circuit 121 are
`provided to control the sensor exposure time and to syn(cid:173)
`chronize system operation. The use of electronic exposure
`control circuit 119, which operates over a relatively wide
`range, permits the camera to use a low cost fixed aperture
`lens.
`Turning now to F1G. 6, the image sensor array is arranged
`in a system including a static RAM 125, a microcontroller
`127, and a power supply unit 129. The microcontroller 127
`
`10
`
`65
`
`1063-015
`
`

`
`5,748,326
`
`8
`7
`The DC motor will be turned on at the maximum pulse
`can be, for example, a commercially available Zilog Z86C76
`width (controlled by an internal timer interrupt) until the
`microcontroller. The system also includes a plurality of
`time between the encoder pulses is within a set range. If the
`switches 131 for controlling the shutter as well as the special
`time between encoder pulses becomes too short, then the
`effects and tone settings. An optional effects cartridge 133 in
`the form of an insertable memory package may also be 5 motor will be slowed by increasing the amount of OFF time
`in the pulse code modulation. Conversely, if the time is too
`provided. An eight dot print head 135 is provided for
`printing hard copies of images on thermal paper.
`long, then the motor speed will be increased by increasing
`Alternatively, an ink-jet or other appropriate type of printer
`the ON time of the modulation signals. The encoder feed-
`may be used. Movement of the print head and paper trans-
`back may be used to synchronize the print strobe to the
`port are controlled by a DC motor encoder 137. An audio/ 10 motor position, with an absolute line to line registration
`video output device 139 allows a user to monitor system
`being provided by the home sensor input.
`operation through audible tones and/or a visible display such
`The effects cartridge 133 interfaces with the microcon-
`as an LCD screen or indicator lights. Additionally, a low cost
`troller 127 through the same multiplexed address/data bus
`electronic view finder could be provided which may be
`lines through which the image sensor array 100 and the
`driven from either the rnicrocontroller or the memory. The
`microcontroller 127 interface. A separate effects cartridge
`system may be powered by a battery 141, which may take 15 enable line is provided to enable the cartridge interface. This
`the form, for example, of 6 AA cells (1.5 v nominal) or 6
`allows the system to distinguish between acces