PCT
`
`WORLD INTELLECTUAL PROPERTY ORGANIZATION
`International Bureau
`
`INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
`wo 88/04082
`
`(11) International Publication Number:
`
`(51) International Patent Classification 4 :
`
`G06F 15/64, 15/70
`
`At
`
`(43) International Publication Date:
`
`2 June 1988 (02.06.88)
`
`(21) International Application Number:
`
`PCT/ A U87 /00383
`
`(22) International Filing Date: 16 November 1987 (16.11.87)
`
`(31) Priority Application Number:
`
`PH 9145
`
`(32) Priority Date:
`
`25 November 1986 (25.11.86)
`
`(81) Designated States: AT (European patent), AU, BE (Eu(cid:173)
`ropean patent), BR, CH (European patent), DE (Eu(cid:173)
`ropean patent), DK, FI, FR (European patent), GB,
`GB (European patent), HU, IT (European patent),
`JP, KP, KR, LU (European patent), MC, NL (Euro(cid:173)
`pean patent), NO, RO, SE (European patent), SU,
`us.
`
`(33) Priority Country:
`
`AU Published
`With international search report.
`
`(71) Applicant (for all designated States except US): ZONE
`TECHNOLOGY PTY. LIMITED [AU/AU]; Suite 7,
`41-45 Rickard Road, Bankstown, NSW 2220 (AU).
`
`(72) Inventors; and
`(75) Inventors/Applicants (for US only): AKNAR, Atila [TR/
`AU]; 87A Harrow Road, Auburn, NSW 2144 (AU).
`SOUSSA, Andre [AU/AU]; 23/6 Horner Avenue,
`Mascot, NSW 2020 (AU).
`
`(74) Agents: MAXWELL, Peter, Francis et al.; Halford &
`Maxwell, Level20, National Mutual Centre, 44 Mar(cid:173)
`ket Street, Sydney, NSW 2000 (AU).
`
`(54) Title: DIGITAL IMAGE ACQUISITION SYSTEM
`
`/_
`4.2 r-
`1
`I
`I
`I
`I
`
`~ 5o
`
`I
`I
`I
`I
`I
`I
`I
`I
`~-----------------------
`
`68
`
`' t.
`
`(57) Abstract
`
`NODULATED
`OUTPUT
`
`DIGITAL
`mourpvr
`
`INPUTS
`/NCLUDIWG
`SHaKE
`Otn'ECTO!fS
`AND
`!SATELLITE
`CAHGJIIAS
`
`}
`
`A dynamic random access memory (RAM) image sensor (80) in co-operation with driver/de-scramble circuitry (88),
`microprocessor (84) and grey level difference controller (85) provides a digital image having, for example, a 32 grey level
`resolution. The digital image can be processed by pixel comparator (86) and microprocessor (84) to detect changes be(cid:173)
`tween image frames, for example, to indicate motion of an object. The comparator (86) can operate at real time rates, e.g.
`50 frames/second. The result of such detected changes andjor the image can then be transmitted through interfaces (90),
`(92), (94), (96) or (98) while interface (100) provides communication of external sources with the camera. Bidirectional
`voice communication is also possible through the interfaces (90)-(100) in analogue or digital format with voice circuit (72)
`and speaker/microphone (74). This provides a camera with "inbuilt" processing capabilities providing autonomy. The
`camera can then be incorporated into a system having at least one camera, at least one base station and a communication
`link connecting the camera and base station.
`
`Petitioners - Exhibit 1019 Page 1
`
`

`
`FOR THE PURPOSES OF INFORMATION ONLY
`
`Codes used to identify States party to thePCT on the front pages of pamphlets publishing international appli(cid:173)
`cations under the PCT.
`
`AT Austria
`AU Australia
`BB Barbados
`BE Belgium
`BG Bulgaria
`BJ Benin
`BR Brazil
`CF Central African Republic
`CG Congo
`CH Switzerland
`CM Cameroon
`DE Germany, Federal Republic of
`DK Denmark
`Finland
`FI
`
`ER France
`GA Gabon
`GB United Kingdom
`HU Hungary
`IT
`Italy
`Japan
`JP
`KP Democratic People's Republic
`of Korea
`KR Republic ofKorea
`Lr Liechtenstein
`LK Sri Lanka
`LU Luxembourg
`MC Monaco
`MG Madagascar
`
`'
`
`ML Mali
`MR Mauritania
`MW Malawi
`NL Netherlands
`NO Norway
`RO Romania
`SD Sudan
`SE Sweden
`SN Senegal •
`su Soviet Union
`TD Chad
`TG Togo
`us United States of America
`
`;
`
`Petitioners - Exhibit 1019 Page 2
`
`

`
`W088/04082
`
`-1-
`
`Per 1 A U87/00383
`
`DIGITAL IMAGE ACQUISITION SYSTEM
`
`TECHNICAL FIELD
`
`The present invention relates to an imaging system,
`
`and in particular to an imaging syste~ employing an
`
`"intelligent" camera. The intelligent camera can be used
`
`with a dynamic RAM acting as an image sensor. The dynamic
`
`5
`
`RAM image sensor enables a fully digital system to be
`
`implemented.
`
`There are a variety of situations in which an imaging
`
`system can be employed. These range from security systems
`
`through to robotic systems.
`
`In general any imaging system
`
`10
`
`in which an image needs to be transmitted to a central or
`
`alternative location can employ the present invention.
`
`BACKGROUND ART
`
`In known systems, for example closed circuit
`
`television systems, a camera unit such as a vidicon
`
`15
`
`captures the image and then transmits it in analogue form
`
`to a station via coaxial cable. Any processing that needs
`
`to be performed is usually done at the station. This is at
`
`a normally remote central location where with the
`
`provision of an analogue to digital converter (ADC) and
`
`20
`
`computer any necessary processing functions are performed.
`
`The output from the camera may also be converted into
`
`digital form before being transmitted over the
`
`communication link. The bandwidth of the communication
`
`link places a further limitation and expense on this type
`
`Petitioners - Exhibit 1019 Page 3
`
`

`
`wo 88/04082
`
`-2-'
`
`PCf{AU87j00383
`
`of system.
`
`It is also known to use motion detection software or
`
`hardware in security systems to indicate the presence of
`
`an intruder or of some disturbance in a given observed
`
`5
`
`space. These know systems generally employ a remote
`
`-..
`
`camera which communicates via a communication link with a
`
`central observation and. processing facility. The central
`
`processing facility performs the motion detection with a
`
`computer. The communication bandwidth required between
`
`10
`
`the camera and the facility may need to be of the order of
`
`several MHz to provide analysis in real time as required
`
`for these types of situations.
`
`In addition available
`
`cameras only provide an analogue output requiring an
`
`analogue to digital converter to provide the digital
`
`15
`
`format needed for processing by the computer.
`
`A known imaging device which provides a digital
`
`output is a dynamic RAM having a transparent window as
`
`disclosed in US patent specification 4441125 to Parkinson.
`
`This image sensor uses the light sensitive semi-conductor
`
`20
`
`memory elements of the dynamic RAM to provide a black and
`white image or it can be employed to provide a variable
`
`grey scale output. This image sensor has been described
`
`for use in low cost applications such as robots and toys.
`
`It is much cheaper and of small size·compared with other
`
`25
`
`imaging devices such as vidicons and CCDs (charged coupled
`
`devices). The Parkinson specification describes various
`
`modes for operating the dynamic RAM as an image sensor.
`
`The sensitivity of the sensor can be controlled by varying
`
`the rate of scanning of the array or by changing the
`
`Petitioners - Exhibit 1019 Page 4
`
`

`
`wo 88/04082
`
`-3-
`
`Per I A U87f00383
`
`threshold value for the determination of the logic state
`
`of the cells of the RAM. By scanning the cells with a
`
`threshold value which follows a repeating sequence of
`
`voltage steps sha.des of grey can be determined for an
`
`5
`
`~mage. This can also be achieved by scanning the cell
`
`arrays at various rates (periods).
`
`DISCLOSURE OF INVENTION
`
`The present invention overcomes the disadvantages in
`
`the prior art referred to above by providing a novel
`
`10
`
`method of operating an image sensor employing a dynamic
`
`RAM and also an imaging unit employing a camera or imaging
`
`device which has associated with the imaging device
`
`processing capabilities giving autonomy to the actual
`
`imaging device to provide an "intelligent" camera. The
`
`15
`
`intelligent camera can then be employed in a system
`
`providing intelligent bi-directional communication with a
`
`base station.
`
`In accordance with one aspect of the invention there
`
`is provided a method of image acquisition using a dynamic
`
`20
`
`random access memory CRAM)
`
`image sensor having a
`
`transparent window through which a lens can focus an image
`
`on an array of radiation sensitive cells of said dynamic
`
`RAM image sensor including the steps of: setting the cells
`
`of said dynamic RAM to a fully charged state, scanning the
`
`25
`
`said image sensor to provide a series of images of
`
`variable exposure lengths, s~oring the said series of
`
`images of variable exposure lengths in a buffer, and
`
`processing said series of images of variable exposure
`
`lengths to provide a measure of the difference between
`
`Petitioners - Exhibit 1019 Page 5
`
`

`
`W088/04082
`
`-4-
`
`PCf/ AU87j00383
`
`successive scans of the imaging device to form a binary
`
`encoded intensity level for each pixel to constitute a
`
`single frame of imaqe.
`
`According to a further aspect of the invention there
`
`5
`
`is provided an intelligent camera including optical
`
`sensor means, means for providing a digital output of said
`
`optical sensor m~ans, means for processing said digital
`
`output and means for providing external communication of
`
`said digital output.
`
`10
`
`In a still further aspect of the invention there is
`
`provided an imaging system including an intelligent camera
`
`means, said camera means including optical sensor means,
`
`means for prov~ding ·a digital output of said optical
`
`sensor means, means for processing said digital output and
`
`15
`
`means for external communication of said digital output,
`
`base station means including input and output means, and
`
`means for communicating between said intelligent camera
`
`means and said base station means.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`20 .
`
`A preferred embodiment of the invention will now be
`
`described in respect to the following drawings in which:
`
`Fig. 1 is a schematic block diagram of the image
`
`sensor according to one aspect of the instant
`
`invention:
`
`25
`
`Fig. 2 (a) and (b) are schematic block diagrams of
`
`embodiments of the intelligent camera according
`
`::r
`
`to another aspect of the instant invention:
`
`Figs. 3 and 4 are schematic block diagrams showing
`
`more detail of Figs. 2 (a) and (b):
`
`Petitioners - Exhibit 1019 Page 6
`
`

`
`WOSS/04082
`
`-5-
`
`PCf I A U87/00383
`
`Fig. 5 is a schematic block diagram of the imaging
`
`system employing the intelligent camera of
`
`Figure 2;
`
`Fig. 6 is a flow chart of an embodiment of sequence
`
`logic for operation of the camera in the syste~
`
`of Fig. 5;
`
`Fig. 7 is a schematic block diagram of a base station
`
`used in the system of Fig. 5; and
`
`Fig. 8 is a schematic block diagram of a mobile or
`
`local base station used in the system of Fig. 5.
`
`MODES FOR CARRYING OUT THE INVENTION
`
`With reference to Fig. 1, an image is focused by lens
`
`2 onto sensor 3 using a dynamic random access memory (RAM)
`such as disclosed in u.s. patent specification 4441125.
`This is scanned by interface electronics 4 to obtain an
`
`image with a plurality of intensity variations, in this
`
`case an eight level grey scale. The dynamic RAM image
`
`sensor disclosed in said US specification provides an
`
`output representing either a black or white value of a bit
`
`cell. To provide an eight level grey scale using a 64Kxl
`
`bit dynamic RAM the sensor 3 is connected to eight 64Kxl
`
`bit dynamic RAMs 8 acting as a temporary storage buffer 9.
`
`Circuitry 6 permits a sequence of operations whereby the
`
`5
`
`10
`
`15
`
`20
`
`..
`
`25
`
`initial exposure of the image for a predetermined length
`
`of time is written into the first RAM 8 of the buffer 9.
`
`Subsequent exposures of varying exposure length are then
`
`written into successive remaining RAMs 8. By increasing
`
`the exposure length e.g. in a linear or geometric
`
`sequence, a series of eight levels can be derived to
`
`Petitioners - Exhibit 1019 Page 7
`
`

`
`W088/04082
`
`-6-
`
`PCf/ AU87f00383
`
`provide a grey scale. The exposure length and the
`
`relation betwe.en successive exposures is under software
`
`control of a microprocessor (not shown). The data stored
`
`in the temporary storage buffer 9 is then used to provide
`
`5
`
`a single image frame having the desired eight possible
`
`intensity l,evels by these intensity levels for each pixel
`
`being then encoded as 3 bit l's compliment binary data.
`
`This is achieved through the use of an 8 to 3 priority
`
`encoder 10. The resultant image data is then channeled to
`
`10
`
`video RAMs 11 ready to be stored for further processing or
`
`to be displayed.
`
`The video RAMs 11 consist of 12 64K x 1 dynamic RAMs
`
`which are of the same type of RAM as us·ed in the buffer 9
`
`for temporary storage. These RAMs are arranged in a 4 x 3
`
`15
`
`matrix that makes it possible to store four frames with
`
`64K image pixels where each pixel is represented by 3 bit
`
`binary data.. The video RAMS can then be accessed by some
`
`external device to provide the image in a digital format.
`
`The use of the 4 x 3 matrix also enables further
`
`20
`
`processing to be achieved by a microprocessor. This may
`
`include the detection of motion between individual frames
`
`or the processing of the image data to provide bandwidth
`
`compression.
`
`Another method of providing grey levels does not
`
`25
`
`require a one-to-one relationship between the number of
`
`storage RAMs and the number of grey levels desired as
`
`described above. That is, for a 32 level grey scale, 32
`
`64Kxl bit memory devices would be required in such a
`system. However, this can be reduced to 5 (32=2 5 > 64Kxl
`
`Petitioners - Exhibit 1019 Page 8
`
`

`
`W088/04082
`
`-7-
`
`PCf I A U87/00383
`
`bit RAMs by the inclusion of a grey level difference
`
`controller as shown in Fig. 4. This technique involves
`
`setting initially the levels of the memory array to all
`
`"l"s corresponding to a purely white scene. Scans are
`
`5
`
`performed as in the previous technique but the binary
`
`value of each scan is now compared by the difference
`
`controller with the previous scan value for each pixel in
`
`turn to determine the difference. The appropriate binary
`
`digit in the memory array is then changed to correspond to
`
`10
`
`the difference measured. Thus at the end of the 32nd scan
`
`of the sensor array the.memory array will reflect the
`
`determined grey level as a stored 5 bit binary number.
`
`This technique provides a saving in memory required as
`
`well as avoiding the need for a 2n level to n bit encoder.
`
`15
`
`The difference controller involves counters,
`
`multiplexers and logic for which the sequence of
`
`operations is as follows. The counters initially set to
`
`all l's are decremented with each successive scan of the
`
`image array. The scan of the image array is synchronised
`
`20
`
`with the addressing of the memory element corresponding
`
`with an associated pixel of the_ image array. The value of
`
`the pixel read out from the image array is used to drive
`
`the Write control line of the memory array. Thus the
`
`value in the counters is written or not written depending
`
`25
`
`on whether a '1' (no change) or a '0' (change) has been
`
`read from the appropriate pixel. At the end of the scan
`
`sequence (in this case) of 32 steps the memory stores the
`
`determined 32 level grey scale as a 5 bit binary value for
`
`each pixel.
`
`Petitioners - Exhibit 1019 Page 9
`
`

`
`W088/04082
`
`-8-
`
`PCI'/AU87/00383
`
`As disclosed in the abovementioned US patent the
`
`image sensor's sensitivity can be varied by.altering the
`
`threshold value provided to the sense amplifiers of the
`
`converted memory de.vice. Further sensitivity control can
`
`5
`
`be provided by varying the scan rate. With these features
`
`and the operation of the sensor according to the present
`
`invention an image sensor with digital output having
`
`variable sensitivity and controllable intensity resolution
`
`is provided.
`
`10
`
`Block diagrams of two embodiments of an intelligent
`
`camera are shown in Figs. 2 (a) and (b). Fig. 2(a) shows
`an analogue embodiment employing a ceo or vidicon as the
`imaging sensor 20, driven by driver circuitry 22. The
`
`analogue out.put of the camera is converted by AOC 24 into
`
`15
`
`digital format for processing by module 26 which then
`
`communicates bi-directionally with the external world
`
`through interface 28.
`
`Fig. 2(b) employs an image sensor 30 having a digital
`
`output such as described with reference to Fig. 1. The
`
`20
`
`driver circuitry and processing module 32 are combined in
`
`a single block which can include a microprocessor and
`
`ancillary logic. Module 34 provides a bi-directional
`
`digital interface with the external world.
`
`Fig. 3 shows an expanded detail of the analogue
`
`25
`
`embodiment of Fig. 2(a). A CCO .camera 40 provides its
`
`analogue output to vertical/horizontal separator 42 before
`
`being fed to analogue to digital converter 44. The memory
`
`module 46 stores the digitised value of the image from
`
`camera 40. The microprocessor 48 communicates with memory
`
`Petitioners - Exhibit 1019 Page 10
`
`

`
`W088/04082
`
`-9-
`
`Per I A U87/00383
`
`46 via bus 47. This memory module 46 stores at least two
`
`frames of the image for processing by pixel comparator
`
`circuitry 50. The image of two successive frames are fed
`
`to pixel comparators 52 and 54 respectively. These
`
`5
`
`comparators 52 and 54 can compare the image on an
`
`10
`
`15
`
`20
`
`individual pixel, line or block basis providing a tally in
`
`counters 56 and 58. The result of these comparisons can
`
`then be stored in the microprocessor 48.during the
`
`horizontal and/or vertical blanking intervals. Under the
`
`control of microprocessor 48 motion detection and
`
`adjustment of the parameters controlling the sensitivity
`
`of the comparison for ambient lighting conditions are ·
`
`performed.
`
`The pixel comparator 50 operates at high speed to
`
`enable a 50 frame per second throughput. Thus it operates
`
`in real time freeing the microprocessor 48 to perform
`
`software support and the control of functions within its
`
`speed capabilities. This combination of hardware
`
`comparator 50 and microprocessor 48 provides a real time
`
`image processing environment at the camera. The
`
`microprocessor 48 performs calculations based on the
`
`parameters chosen for allowable pixel, line, or block
`
`changes as the case may be. These paramete.rs are under
`
`software control as well as external control <via buffers
`
`25
`
`and multiplexers 68).
`
`If the microprocessor 48 detects a relevant condition
`
`e.g. movement indicating intrusion in a security
`
`environment, the microprocessor 48 can signal this fact to
`
`the external world via RS232/422 drivers 60, modem 62,
`
`Petitioners - Exhibit 1019 Page 11
`
`

`
`W088/04082
`
`-10-
`
`PCf/AU87f00383
`
`buffers 64 providing a TTL (Transistor Transistor Logic,
`
`or +SV logic '1') output or output drivers 66 signalling a
`
`local alarm output. These output devices can signal the
`
`detection of an alarm condition and/or send the i~age as a
`
`5
`
`digital output. The camera output can also be provided as
`
`an analogue signal from line 61.
`
`The output signal can then prompt an external device
`
`<see Figs. 5, 7 or 8) to communicate with the intelligent
`
`camera via buffers and multiplexers 68. These buffers 68
`
`10
`
`can also provide input from other sensors such as smoke
`
`detectors, pressure or contact switches, or other image
`
`sensors.
`
`The microprocessor 48 can also control the auto dial
`
`15
`
`circuitry 70 to dial up the relevant emergency utility in
`
`the event of a fire or intrusion detection.
`
`The camera can also be provided with voice circuit 72
`
`which provides acoustic input or output from loudspeaker
`
`and microphone 74. This acoustic input/output can be
`
`20
`
`processed by microprocessor 48, for example, to detect a
`
`person's presence in a fire or input/output directly via
`
`the modem 62 to provide two way contact.
`
`The image sensor as described with respect to Figure
`
`1 can be incorporated in an intelligent camera of the type
`
`25
`
`shown in FigG 2(b). This is shown in greater detail in
`
`Figure 4. The digital output from the RAM image sensor 80
`
`having an image focused thereon by lens 81, is connected
`
`to the memory module 82. The memory module 82 is
`
`connected with the microprocessor 84 and with pixel
`
`30
`
`comparator 86. The pixel comparator 86 is also subject to
`
`Petitioners - Exhibit 1019 Page 12
`
`

`
`wo 88/04082
`
`-11-
`
`PCT I A U87/00383
`
`control by the microprocessor 84 as indicated by bus 87.
`
`The microprocessor 84 can be further connected with a
`
`semi-conductor or other random access memory device or
`
`with a disk by a bus.
`
`5
`
`The microprocessor co-ordinates under software
`
`control the operation of the camera to provide various
`
`functions among which is the con~rol of the pixel
`
`comparator which is a hardware device comprising a circuit
`
`for detecting motion operating at a higher rate than can
`
`10
`
`be achieved with a microprocessor alone. The image sensor
`
`is then controlled by the drivers 88 through line 89 which
`
`in turn are controlled by the microprocessor 84 in the
`
`manner described above with r~spect to Fig. 1 in co(cid:173)
`
`operation with grey level difference controller 85.
`
`15
`
`Circuitry 88 also includes "de-scramble" circuitry.
`
`This circuitry corrects those defects of the dynamic RAM
`
`(as an image array) such as the image being composited
`
`from two or more separate arrays, the fully charged state
`
`of cells may be a logically different value in the
`
`20
`
`separate arrays requiring a logical inversion to be done
`
`and/or the arrays being non-rectilinear. In turn, the
`
`memory is connected to external buffer 90 to provide a
`
`parallel digital output or to DAC 98 to provide an analog
`
`output. A serial output is provided through Modem 94 or
`
`25
`
`RS232/422 driver 92 from the microprocessor.
`
`The operation of the intelligent camera is controlled
`
`by software which can be either self contained or modified
`
`by communication from some external source received
`
`through buffer 100.
`
`Petitioners - Exhibit 1019 Page 13
`
`

`
`WOSS/04082
`
`-12-
`
`PCf/ AU87f00383
`
`Fig. 6 shows a possible progra,m sequence in a
`
`security environment. The logic assumes that the memory
`
`stores two frames: frame 1 and frame 2. These. are written
`
`to alternatively as each new frame is generated. Frame 1
`
`5
`
`is digitised (step 1), compared with frame 2 and stored in
`
`memory (step 2). The microprocessor compares the result
`
`in comparison with the sensitivity setting chosen for the
`
`given ambient conditions e.g. a 5% charge per line (step
`
`3).
`
`If there is any difference determined <step 4) (the
`
`10
`
`YES output>, the microprocessor follows the sequence of
`
`steps 9-12 otherwise the next step (step 5) is performed.
`
`This means that at "start-up" the logic will automatically
`
`indicate a difference as a frame 2 will not initially have
`
`been stored. This can be used as an operational check by
`
`15
`
`the cam~ra software and/or a base station <to be described
`
`below). Frame 2 is digitised and compared with stored
`frame 1 (steps 5 and 6 >. The microproc.essor again
`compares the result dependent on the sensitivity (step 7).
`
`If there is any difference determined (step 8) <the YES
`
`20
`
`output), the microprocessor follows the sequence of steps
`
`9-12 otherwise the sequence of steps 1-8 are repeate~
`
`based on a new frame 1.
`
`The sequence of steps 9-12 is variable. The
`
`microprocessor determines the course of action to be taken
`
`25
`
`<step 9). This can include the auto·dial of a remote unit
`
`and the transmission of an alarm signal indicating that a
`
`difference has been detected (step 10). This may be
`
`followed by transmission of the last frame or could await
`
`some reply from an external "base station" to be described
`
`Petitioners - Exhibit 1019 Page 14
`
`

`
`W088/04082
`
`-13-
`
`PCf I A U87f00383
`
`below. The camera can come under the control of the
`
`external base station (step 11). The camera can remain
`
`under external control (the NO output> until a decision is
`
`made to resume normal operation (the YES output> <step
`
`5
`
`12).
`
`In the latter case, operation resumes at the start
`
`of the sequence (step 1) and proceeds as before.
`
`An intelligent camera is therefore provided, that is,
`
`an image sensor has coupled therewith processing means
`
`embodied in microprocessor and/or pixel comparator
`
`10
`
`circuitry to provide a versatile and cheap component for
`
`use in such situations.as security systems or other forms
`
`of surveillance, remote sensing, medical applications and
`
`the like. The inclusion of a microprocessor·or the pixel
`
`comparator circuitry to provide motion detection has
`
`15
`
`several advantages over anything previously done in the
`
`art.
`
`When the camera is used as an image sensor in a
`
`security system, processing can be performed at the camera
`
`rather than as in prior art devices at some remote site so
`
`20
`
`that the only need for communication is for example of a
`
`change in a scene w~ich can be communicated over a much
`
`narrower bandwidth channel than that required for any
`
`prior art device. Thus a standard telephone line can be
`
`used using the modern output or some other narrow band
`
`25
`
`channel. This in turn does not preclude the use of a
`
`channel having a much broader band of frequency such as a
`
`optical fibre or coaxial cable from being used but it
`
`provides the necessary versatility whereby the intelligent
`
`camera can be used in a variety of situations.
`
`Petitioners - Exhibit 1019 Page 15
`
`

`
`WOSS/04082
`
`-14-
`
`PCf/ AU87f00383
`
`The intelligent camera can then be incorporated in an
`
`imaging system as shown with respect to Figs. 5 and 7
`
`including one or more intelligent cameras 102 connected by
`
`respective bi-directional links 104 with a base station
`
`5
`
`106 which can be connected to one or more monitoring
`
`devices 108 which allow the image from the respective
`
`camera or the parameters controlling the respective camera
`
`to be displayed. The base station 106 can also be
`
`provided with an operating keyboard 109 or any similar
`
`10
`
`input device as known in the art.
`
`The base station may also be connected with a local
`
`or portable base station 110 which in combination with an
`
`intelligent camera can provide a videophone console. The
`
`link 104 between the cameras and the base station can be a
`
`15
`
`3KHz telephone line, a 64 KHz ISDN link, an optical fibre
`
`link or a PABX or any other electromagnetic, for example
`
`radio or microwave, wireless connection. The base station
`
`106 is made up of circuit board slots 112 carrying the
`
`necessary number of circuits to accommodate the desired
`
`20
`
`capacity of the system while also providing expandability.
`
`An operator at the base station can simply monitor
`
`the event occurring under the supervision of the remote
`
`intelligent camera or can actively intervene in the
`
`function thereof by altering the programme steps to be
`
`25
`
`executed by the intelligent camera. Equally the base
`
`station could be under the control of a computer without
`
`substantial human intervention. This would depend on the
`
`application in which the system was employed.
`
`Though a bi-directional link provides the greatest
`
`Petitioners - Exhibit 1019 Page 16
`
`

`
`W088/04082
`
`-15-
`
`PCf/ AU87f00383
`
`versatility this does not preclude the use of a one way
`
`link. The camera would then operate in a self-contained
`
`mode.
`
`An expanded block diagram of a possible base station
`
`5
`
`configuration is shown in Fig. 8. This is a block diagram
`
`of the mobile base station 110 of Fig. 5.
`
`The major components of the mobile base station are
`
`central processing unit (C.P.U.) 120, graphics processor
`
`122, and arithmetic logic unit (A.L.U.) 124. The CPU 120
`
`10
`
`communicates via address and data buses with memory 125
`
`including program ROM 126, and RAM 130, and with
`
`modem/drivera 132. The graphics processor 122 has
`
`address, data and control buses communicating with video
`
`and image storage RAMs 134. The ALU 124 is used with the
`
`15
`
`graphics processor 122 for image processing and
`
`communicates with RAMs 134 via double bi-directional
`
`buffers 136. The latch 138 controls the selection of the
`
`appropriate ALU function. The output of the ALU 124
`
`drives video DAC 140 to provide the video output.
`
`20
`
`The user controls the operation of the mobile base
`
`station via keypad 142. The user can dial a given
`
`destination and can also perform the selection of various
`
`functions such as zoom or the inclusion of text with the
`
`image. The buffer 144 provides an interface between CPU
`
`25
`
`120, graphics processor 122, ALU 124 (via latch 138), or
`
`memory 125 <via decoding logic 146). The decoding logic
`
`146 also provides functional control of graphics processor
`
`122.
`
`The base station of Fig. 8 can be then connected via
`
`Petitioners - Exhibit 1019 Page 17
`
`

`
`WOSS/04082
`
`-16-
`
`PCf/ AU87f00383
`
`link 104 with base station 106 to a complimentary base
`
`station to provide a videophone link.
`
`The intelligent camera can be used in a security
`environment e.g. domestic, industrial, judicial or
`.
`military. Equally the image sensor can be sensitive to
`
`5
`
`..
`
`other than visible radiation, for example, infrared or
`
`ultraviolet to be used in remote sensing or night vision
`
`activities. Also a low light level image sensor can be
`
`employed. With the provision of external connections
`
`10 ·
`
`available with the intelligent camera more than one image
`
`sensor can be operated from the one intelligent camera
`
`source. This would be particularly advantageous in a
`
`remote sensing environment. Here the camera could be
`
`carried on any suitable vehicle such as a space vehicle
`
`15
`
`e.g. a satellite in earth orbit, an aerial conveyance e.g ..
`
`aeroplane or blimp, submarine, boat or land vehicle.
`
`By providing intelligence in the camera a cheap and
`
`efficient imaging system is provided. The number of
`
`applications for the image sensor, in.telligent camera or
`
`20
`
`the system incorporating the intelligent camera is quite
`
`large. Thus the above embodiments of the invention it
`
`will be understood do not restrict the spirit and scope of
`
`the invention and are by way of example only. Other
`
`embodiments would be readily apparent to those skilled in
`
`25
`
`the art.
`
`..
`
`Petitioners - Exhibit 1019 Page 18
`
`

`
`W088/04082
`
`-17-
`
`PCf I AU87f00383
`
`CLAIMS
`
`1.
`
`A method of image acquisition using a dynamic random
`
`access memory (RAM) as an image sensor having a transparent
`
`window through which a lens can focus an image on an array
`
`of radiation sensitive cells of said dynamic RAM including
`
`the steps of:
`
`(i)
`
`setting the cells of said dynamic RAM to a
`
`fully charged state;
`
`(ii)
`
`scanning said image sensor to provide a series
`
`of digital images of variable exposure lengths;
`
`(iii) storing the series of images of variable
`
`exposure lengths in a storage·buffer;
`
`<iv) processing said series of images of variable
`
`exposure lengths to provide a resultant single frame of
`
`image having a plurality of levels of intensity, and
`
`(v) storing the resultant single frame of image in a
`
`memory means.
`
`2.
`
`A digital image sensor including:
`
`(i) a dynamic random access memory <RAM)
`
`image sensor
`
`having a transparent window through which a lens can focus
`
`an image on an array of radiation sensitive cells of said
`
`dynamic RAM;
`
`(ii) means for setting the cells of said dynamic RAM
`
`to a fully charged state;
`
`<iii) means for scanning the dynamic RAM in a
`
`sequence of steps to provide a series of images of
`
`variable exposure lengths;
`
`<iv) means for storing said series of images of
`
`Petitioners - Exhibit 1019 Page 19
`
`

`
`W0-88/04082
`
`-18-
`
`PCf/AU87J00383
`
`variable exposure lengths;
`
`(v) means for processing said series of images of
`
`variable exposure lengths to provide a resultant single
`
`frame of image having a plurality of intensity levels; and
`
`(vi) means for storing the resultant single frame of
`
`image.
`
`3.
`
`A digital image sensor as claimed in claim 2 further
`
`including means for storing a plurality of frames of
`
`images.
`
`4.
`
`An intelligent camera including:
`
`(i)
`
`image means for providing an image;
`
`(ii) means for providing a digital output of the
`
`image means:
`
`<iii) means for storing said digital output of the
`
`image means;
`
`<iv> processing means for processing said digital
`
`output of the image means to provide a result and for
`
`responding to the result; and
`<v> means for communicating an output dependent on
`
`said response.
`
`5.
`
`An intelligent camera as claimed in claim 4 wherein
`
`the image means is a digital image sensor as claimed in
`
`Claim 2.
`
`6.
`
`An intelligent camera as claimed in claim 4 wherein
`
`the image means is an analogue imaging device.
`
`7.
`
`An intelligent camera a.s claimed in claim 5 wherein
`
`the processing means includes a microprocessor.
`
`8.
`
`An "intelligent camera as claimed in claim 7 wherein
`
`said pro