US007593034B2
`
`(12) United States Patent
`DeKeyser
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,593,034 B2
`*Sep. 22, 2009
`
`(54) LOOP RECORDING WITH BOOKMARKING
`(76) Inventor: Paul DeKeyser, 55 Hidden Trail, Irvine,
`CA (US) 92603
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is Subject to a terminal dis-
`claimer.
`
`(21) Appl. No.: 12/268,286
`(22) Filed:
`Nov. 10, 2008
`O
`O
`Prior Publication Data
`US 2009/OO51768 A1
`Feb. 26, 2009
`
`(65)
`
`Related U.S. Application Data
`(63) Continuation-in-part of application No. 1 1/770,920,
`filed on Jun. 29, 2007, which is a continuation-in-part
`of application No. 1 1/846,217, filed on Aug. 28, 2007.
`(60) Provisional application No. 60/824,097, filed on Aug.
`31, 2006, provisional application No. 60/824,095,
`filed on Aug. 31, 2006.
`
`(51) Int. Cl.
`(2006.01)
`H04N 9/247
`(2006.01)
`H04N 7/8
`(52) U.S. Cl. ...................................................... 348/143
`
`(56)
`
`(58) Field of Classification Search .................. 348/143
`See application file for complete search history.
`References Cited
`U.S. PATENT DOCUMENTS
`5,523,799 A
`6/1996 Hattori et al.
`6,351,798 B1
`2/2002 Aono .......................... T12/11
`7, 195,164 B2 * 3/2007 Patel .......................... 235/454
`FOREIGN PATENT DOCUMENTS
`
`4/2003
`4? 2006
`
`EP
`1064783
`WO
`2006/044476 A2
`* cited by examiner
`Primary Examiner Nhon T Diep
`(74) Attorney, Agent, or Firm Fish & Associates, PC
`
`(57)
`
`ABSTRACT
`
`A Surveillance apparatus continuously records imaged data
`from a camera into a circular buffer in a local memory. When
`a record signal is received, the system records the video
`stream that was recorded before the record signal was
`received, and the video stream that is recorded after the record
`signal was received. The recorded segment is then write
`protected, so that the Surveillance apparatus does not over
`write the recorded segment. The recorded segment could then
`be sent to a remote memory via a wireless connection to free
`up local memory for future recording sessions.
`
`20 Claims, 4 Drawing Sheets
`
`320
`
`169
`
`N.
`
`
`
`310
`
`163
`
`CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
`DeKeyser
`{variable CCCCCCCCCCCCAAAAAAAAAAAAAAAICCCCC
`buffer)
`400 -1 BBBBBBBBBBBBBBB) coccoccocccoccccccoccc.cc. ... CCCCCCC
`
`
`
`

`

`U.S. Patent
`
`Sep. 22, 2009
`
`Sheet 1 of 4
`
`US 7,593,034 B2
`
`
`
`110
`
`1OO
`
`162 163 164
`
`166
`
`FIG. 1
`
`
`
`
`
`
`
`--- ---
`
`or TRANSMIT
`
`200
`
`FIG. 2A
`
`

`

`U.S. Patent
`U.S. Patent
`
`Sep. 22, 2009
`Sep. 22, 2009
`
`Sheet 2 of 4
`Sheet 2 of 4
`
`US 7,593,034 B2
`US 7,593,034 B2
`
`FIG. 2B
`
`320
`320
`
`
`
`
`163
`
`163
`
`FIG. 3
`FIG. 3
`
`Motorola v. Stellar
`
`Motorola Exhibit 1010
`Page 003
`
`

`

`U.S. Patent
`
`Sep. 22, 2009
`
`Sheet 3 of 4
`
`US 7,593,034 B2
`
`
`
`AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
`De Keyser
`(Variable AAAAAAAAAAAAAAAAAAAAAAA
`ouffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`De Keyser
`(Variable
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`FIG. 4A
`
`AAAAAAAAAAA
`
`FIG. 4B
`
`AAAAAAAAAAAAAAA
`
`FIG. 4C
`
`AAAAAAAAAAAAAAAABBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBB
`
`FIG. 4D
`
`

`

`U.S. Patent
`
`Sep. 22, 2009
`
`Sheet 4 of 4
`
`US 7,593,034 B2
`
`DeKeyser
`(variable
`buffer)
`
`
`
`400
`
`
`
`DeKeyser
`(Variable
`buffer)
`
`400
`
`
`
`AAAAAAAAAAAAAAA
`
`BBBBBBBBBBB
`
`FIG. 4E
`
`AAAAAAAAAAAAAAA
`
`BBBBBBBBBBBBBBB
`
`FIG. 4F
`
`
`
`CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
`De Keyser
`(Variable CCCCCCCCCCCCAAAAAAAAAAAAAAA CCCCC
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`BBBBBBBBBBBBBBBCCCCCCCCCCCCCCCCCCCCCCCC. ... CCCCCCC
`
`FG. 4G
`
`(CCCCCCC (AAAAAAAAAAAAAAA) CCCCC
`
`BBBBBBBBBBBBBBB)
`
`FIG. 4H
`
`

`

`1.
`LOOP RECORDING WITH BOOKMARKING
`
`US 7,593,034 B2
`
`This application is a continuation-in-part of U.S. patent
`application Ser. No. 1 1/770,920, filed Jun. 29, 2007, which
`claims the benefit of U.S. provisional patent 60/824,097, filed
`Aug. 31, 2006, and this application is a continuation-in-part
`of U.S. patent application Ser. No. 1 1/846,217, filed Aug. 28,
`2007, which claims the benefit of U.S. provisional patent
`60/824,095, filed Aug. 31, 2006. These and all other refer
`enced extrinsic materials are incorporated herein by reference
`in their entirety. Where a definition or use of a term in an
`incorporated reference is inconsistent or contrary to the defi
`nition of that term provided herein, the definition of that term
`provided herein applies and the definition of that term in the
`reference does not apply.
`
`10
`
`15
`
`I. FIELD OF THE INVENTION
`
`The field of the invention is video camera recording tech
`nology.
`
`II. BACKGROUND
`
`25
`
`40
`
`45
`
`Conventional camcorders use a variety of storage formats
`including digital video cassettes, mini-DV cassettes, or
`DVD-R discs that offer a limited amount of memory to store
`data. One of the major shortcomings of the existing cam
`corder technology is that the memory runs out too soon. Once
`a portion of the memory has been recorded, there is less
`memory available for further recording. Then when the
`30
`memory is full, users have to return to their home/work com
`puter or media station to transfer the recorded data from the
`camera to free up the memory. This creates inconvenience
`and inflexibility for recording on the go.
`WO 2006/044476 to Vanman describes an electronic cam
`35
`era mounted to a police vehicle with a circular buffer that is
`constantly recording. When the camera reaches the end of the
`memory it records from the beginning of memory, erasing the
`earliest recorded data. Such technology is often employed
`with Surveillance cameras for long and continuous recording
`with little or no supervision. However, Vanman does not
`distinguish or differentiate any data that is of importance. To
`save data in the buffer, the user of the Vanman device needs to
`transfer important portions of the buffer wirelessly to a cen
`tral office or physically to a DVD disc, or else risk having the
`interesting data be recorded over during loop recording. Such
`transfers are processor intensive and may not be possible
`when the central office is out of range or an empty DVD disc
`is unavailable.
`Vanman and all other extrinsic materials identified herein
`are incorporated by reference in their entirety. Where a defi
`nition or use of a term in an incorporated reference is incon
`sistent or contrary to the definition of that term provided
`herein, the definition of that term provided herein applies and
`the definition of that term in the reference does not apply.
`EP 1064783 to Mann describes a camera mountable to a
`pair of eyeglasses that continuously saves recorded images to
`a circular buffer in a computer on the users waist. When a
`user wants to save a piece of recorded video, the user must
`stop recording and offload the data at another location before
`the user can record again. Mann also discusses streaming the
`images directly to a wireless memory that may have a larger
`capacity; however, this means that the camera does not work
`in the absence of a wireless connection. U.S. Pat. No. 5,523,
`799 to Hattori et al. also describes storing data in a memory
`having an archival portion. However, Hattori fails to address
`sending data to a remote memory.
`
`50
`
`55
`
`60
`
`65
`
`2
`Thus, there is still a need for a recording camera that
`provides better recording and editing functions.
`
`III. SUMMARY OF THE INVENTION
`
`The present invention provides apparatus, systems, and
`methods in which a Surveillance apparatus processes images
`by (1) continuously recording a stream of imaged data, (2)
`write protecting segments of the recorded stream, and (3)
`sending write protected segments from a local memory to a
`remote memory using a wireless transmitter.
`The Surveillance apparatus generally has a camera func
`tionally coupled to a local memory with a circular buffer. As
`used herein, the term “a local memory functionally coupled to
`the camera' means that the memory that is distanced less than
`20 cm from the camera, and is coupled to the camera using
`entirely physical connectors (e.g., wires, pins, conductive
`paths, etc.). This contrasts with a "remote memory function
`ally coupled to the camera', which would be a memory that is
`distanced from the camera by at least 20 cm, or is coupled to
`the camera using a wireless connection. The circular buffer is
`preferably organized into a series of memory segments that
`loops back on itself and is organized into both available
`segments and write-protected segments. This allows a record
`ing facility to record the data stream available in portions of
`the circular buffer while skipping over write-protected matter.
`Preferably, the local memory is large enough to store at least
`5 or 10 minutes of imaged data.
`Preferably, the recording facility continuously records the
`data stream into the circular buffer any time the surveillance
`apparatus is powered on. As used herein, the term "continu
`ous” with respect to recording a video data stream means that
`data is recorded at least every half second over a given ten
`second period. When a signal to record is sent to the surveil
`lance apparatus, a protecting facility designates a segment of
`the circular buffer to be write-protected to prevent that seg
`ment from being overwritten during the next recording loop.
`Part of the write-protected portion could be a pre-recorded
`subset that is recorded before the signal is received, while part
`of the write-protected portion could be a post-recorded subset
`that is recorded after the signal is received. The pre-recorded
`Subset could be as long as 5 seconds, 10 seconds, 30 seconds,
`or more. Preferably, various aspects of both the pre-recorded
`Subset and the post-recorded Subset can be configured with a
`user interface. While the write-protected portions could be
`electronically indexed using a memory heap or a clustered
`index, the write-protected portions are preferably stored as
`separate files in the memory. Such files could be stored in
`physically dis-contiguous parts of the circular buffer. Addi
`tionally, the indexing is preferably performed while the
`recording facility is still recording data into the memory.
`The signal to record is preferably automatically triggered
`by a sensor that detects an image in the camera or a sound by
`the camera's microphone. For example, the signal to record
`could be triggered by a human face, an open book, a computer
`screen, a whistle, a verbal command, a recognized object, or
`a pattern of knocks. Alternatively, a user interface could allow
`a human user to manually send the signal to record and could
`even allow the human user to designate a length of time of the
`pre-recorded subset or the post-recorded subset. A user could
`send two signals, one to start recording and another to stop
`recording, but preferably the user merely sends a signal to
`start recording for a specified period of time. In an exemplary
`embodiment, when the specified period of time has almost
`expired, say, for example, 5 seconds, 10 seconds, or longer,
`the user could extend the length of specified time by sending
`another trigger to the Surveillance apparatus. For example, the
`
`

`

`US 7,593,034 B2
`
`5
`
`10
`
`15
`
`3
`Surveillance apparatus could send a warning 10 seconds
`before it is scheduled to stop recording by vibrating against
`the user; in response the user could say "don't stop’ or merely
`cough to extend the length of the write-protected portion of
`memory.
`While the surveillance apparatus could be a mounted on a
`hand-held video camera, the Surveillance apparatus is prefer
`ably a small device that can be mounted inconspicuously on a
`person. For example, contemplated Surveillance apparatus
`mounts area pair of wearable Sunglasses or eyeglasses, a lapel
`pin, a collar button, a hat or visor, a hair pin, or a front of a
`purse.
`Since the Surveillance apparatus is typically too small to
`house a large amount of memory, the Surveillance apparatus
`also preferably has a wireless transmitter that is also func
`tionally connected to the local memory. A sending facility
`uses the wireless transmitter to transmit write-protected por
`tions of the circular buffer to a remote memory that is not
`physically connected to the local memory in Some way. For
`example, the wireless transmitter could send write-protected
`portions of the circular buffer to a mobile phone, or the
`Surveillance apparatus could be plugged into a mobile phone
`which is then used as a wireless transmitter to forward a
`write-protected portion to another remote memory. In a pre
`ferred embodiment, after a write-protected portion of the
`circular buffer is transferred to a remote memory, the protect
`ing facility could remove the corresponding portion from
`protection so that the recording facility could use that portion
`to record data.
`Various objects, features, aspects and advantages of the
`present invention will become more apparent from the fol
`lowing detailed description of preferred embodiments of the
`invention, along with the accompanying drawings in which
`like numerals represent like components.
`
`4
`clocks, tripods, head gear, hand grips, or security camera
`mounts. As used herein the term "camera' means any device
`or collection of devices that includes an image capturing
`component that captures image data, and a converting com
`ponent that converts the image data into digital data, possibly
`at least one data stream. An image capturing component could
`include one or more charge-couple devices (CCD) compli
`mentary metal-oxide-semiconductors (CMOS), CMOS focal
`plane arrays (CFP), radiometers, or other manners of image
`obtaining devices. Camera 120 should be interpreted euphe
`mistically to include all such variants. Likewise, a Suitable
`converting component could include one or more analog-to
`digital converters, Software codecs, or integrated circuits.
`Camera 120 contains an imager lens 122 used to focus
`images for camera 120. Conventional lenses allow one or
`more of the following adjustments: aperture (to control the
`amount of light), Zoom (to control the field-of-view), or shut
`ter speed (to capture continuous motion). In preferred
`embodiments, these adjustments are automatically controlled
`by the camcorder electronics, generally to maintain constant
`exposure onto the imager without the manual adjustment
`from a user. It is contemplated that the preferred embodi
`ments offer direct user control of all major optical functions.
`As with most modern digital recorders and camcorders, an
`analog-to-digital (ADC) converter is used to digitize the ana
`log imager waveform output into a discrete digital-Video sig
`nal. Thus, the recorder can be used to record analog or digital
`formats.
`Viewfinder image lens 130 is calibrated to have the same
`field of view as camera 120. Preferably, viewfinder image lens
`130 is embedded in between the two glass lenses of eye
`glasses 110. Preferably viewfinder image lens 130 is a Zoom
`lens with preferred standard Zoom ration of 3x in or out of the
`focal length of the camera. A more sophisticated viewfinder
`image lens 130 is contemplated to have a greater Zoom range
`and also has nighttime vision or is able to render images under
`different light conditions. Within the lenses, viewfinder
`image lens 130 is outlined by tinted area or graticle and the
`outline graticle is embedded with glowing fiber optic fila
`ment. Eye-glasses are made preferably from opaque, translu
`cent, or possibly photo gray-type tint of glasses. Alterna
`tively, glasses change color slightly when energized.
`Where the camera is a hand-held camera and is not embed
`ded in a pair of eyeglasses, viewfinder image lens 130 can be
`permanently fixed to camera 120, or it can be interchangeable
`with lenses of different focal lengths and other properties
`depending on the need and circumstances of use.
`Recorder 160 is any recording device that records video
`and/or audio/video data, including conventional recorders.
`Recorder 160 preferably includes a processor 162 with soft
`ware or hardware that accomplishes the functions described
`herein, or one or more physical memories that are collectively
`referred to herein as memory 166. Typically, the recorder or
`the camera converts analog images into a digital format to be
`stored in the memory, or also preferably records both audio
`and video input analog signals from the camera to the
`memory. Those skilled in the art will also appreciate that the
`concepts described herein with respect to video and/or audio/
`Video data can be applied to recordation of purely audio, or in
`fact any other type of data stream; this specification should be
`interpreted as expressly including Such application. A wearer
`could clip recorder 160 as a belt clip or another compact
`device. Contemplated recorders include MP3 players, purses,
`or buttons. It is also contemplated that recorder 160 could also
`comprise a cell or mobile phone having a suitable recorder
`application installed that is configured to communicate with
`the other components of apparatus 100.
`
`25
`
`30
`
`IV. BRIEF DESCRIPTION OF THE DRAWING
`
`35
`
`FIG. 1 is a camera mounted on a pair of glasses connected
`to a circular buffer in a local memory that is controlled by a
`r1ng.
`40
`FIGS. 2A and 2B show user interface buttons for the ring of
`FIG 1.
`FIG. 3 shows a diagram representation of the circular
`buffer of FIG. 1.
`FIG. 4A-4H show representations of the circular buffer of
`45
`FIG. 1 while the surveillance apparatus is in use.
`
`V. DETAILED DESCRIPTION
`
`In FIG. 1, an example surveillance apparatus 100 generally
`comprising eyeglasses 110 having a camera 120 mounted at
`the nose bridge, and an optional viewfinder 130 applied onto
`one of the lenses. A data and power cord 140 couples the
`camera 120 to a belt-worn recorder 160, which cooperates
`with a ring-shaped signaling device 150 and a remote
`memory 170. Those skilled in the art will appreciate that the
`term “surveillance' is used herein in its broadest possible
`sense, to include not only professional or commercial types of
`Surveillance, but also any other type of observation, including
`for example an ordinary person watching a baseball game or
`birthday party.
`The eyeglasses 110 are used here euphemistically to rep
`resent any type of camera mount. In a preferred embodiment,
`the camera mount is disguised to be a common object worn by
`a person or lying around a house, but could also be shaped and
`sized to look like a camera. Contemplated mounts include
`lapel pins, hair clips, shirt buttons, purses, staplers, desk
`
`50
`
`55
`
`60
`
`65
`
`

`

`US 7,593,034 B2
`
`5
`
`10
`
`15
`
`5
`Although not expressly shown, recorder 160 also includes
`an appropriate power Supply or connection, Supporting elec
`tronics, or a display or other interface. The power source can
`vary considerably. For example, in embodiments where the
`recorded is relatively large, a Suitable power Source can
`include a rechargeable battery. On the other hand, when the
`recorder is relatively small, an appropriate power source can
`include an external power source (e.g., transformer for wall
`outlet or cigarette lighter adapter). Whether embodied in con
`trol buttons or in some other manner, it is also contemplated
`that recorder can include Some sort of security control requir
`ing a password and some sort of automatic turnoff feature that
`activates after a certain amount of inactivity. Authentication
`or authorization of user access provides for ensuring a proper
`user of apparatus 100 retains desired control. For example,
`once a user is authenticated, the user can control indexing,
`editing, transmitting, or adjusting content data in memory.
`Recorder 160 would typically record images in digital
`format, but analog or combination formats are also contem
`plated. Preferably, the recorder's electronics are preferably
`all on a unitary printed circuit board with different functions,
`or facilities, encoded on a programmable chip or disk. For
`example, a recording facility 163 could record the data stream
`from camera 120 to local memory 166, a protecting facility
`164 could protect segments (not shown) of recorded data on
`memory 166, or a sending facility 165 could transmit pro
`tected segments (not shown) of recorded data to remote
`memory 170. While the different facilities are preferably part
`of a single hardware or Software program, the facilities could
`be split into different components as necessary. Other facili
`ties could be installed, for example a facility that allows
`editing of the received image data or protected data. It is
`contemplated that such facilities could be purchased through
`or installed on a cell phone, possibly through an on-line
`application store.
`The contemplated memory could vary depending on the
`particular configuration of the recorder. Particularly suitable
`memories include commercially available micro hard drives
`with a 1-inch disc (which can preferably have a capacity of
`more than 1 GB), flash memory cards with a capacity of up to
`40
`128 MB and more, or other transient and/or permanent
`memory units. Likewise, Suitable memory can also include
`SDRAM, MRAM, racetrack memory, SIMM, DIMM, etc.
`with a capacity of at least 32 MB, more preferably at least 64
`MB, or most preferably above 128 MB. In preferred embodi
`ments, memory 164 is a SDRAM capable of storing at least
`1000 frames of data. Once received by memory 164, frames
`are preferably compressed by employing conventional com
`pression rates and methods to achieve at least a 50:1 ratio.
`In preferred embodiments, image data received by recorder
`160 is stored in a circular buffer 167 on memory 166. Pref.
`erably, all of the free space in memory 166 is used to create
`circular buffer 167, however, multiple circular buffers could
`be created in the memory where there exist multiple cameras
`connected to a single recorder. Once the recorder is turned on,
`image data is continuously stored in circular buffer 167 for
`access. If no record or protect button is pushed, the recorder
`will loop back and store the image data for a said length of
`time. Recording, book-marking and protecting are used syn
`onymously herein. Recording, book-marking and protecting
`means that a portion of the imaged data is write-protected
`upon an activation of a signal by a user and can not then be
`overwritten unless the write-protection is later removed. Con
`sequently, protected data cannot be overwritten by newly
`stored imaged data in the circular buffer.
`The circular buffer is preferably large enough to store at
`least 3 minutes of data, more preferably 5 minutes and most
`
`30
`
`6
`preferred 10 minutes of data. However, it is contemplated that
`depending on the size and capacity of the device, any length
`longer or shorter is possible. It is preferred when the recorder
`is turned on the entire circular buffer is treated and stored as
`a single file. Thus, if no recording is protected or bookmarked,
`then the entire file will be erased and the recording will start
`at the beginning of the circular buffer.
`Signaling device 150 is shown in the figure as a ring that
`communicates wirelessly (e.g., BlueTooth, Skinplex, wire
`less USB, 802.11, 802.15, UWB, Z-Wave, IrDa, Zigbee, etc.)
`with the recorder, possibly as part of a personal area network
`(PAN). The ring can have any suitable interface, shown in
`FIGS. 2A and 2B, including for example buttons on its outer
`periphery, or a sensor along its inner edge. In FIG. 2A, ring
`150 has user interface 200, with a start signal button 210, a
`stop signal button 220, a transmit button 230, a Zoom in button
`240, or a Zoom out button 250. Alternatively, the buttons
`could have decorative symbols in lieu of words of function as
`shown in FIG. 2B, or could even have arbitrary symbols
`surrounding the entirety of signaling device 150. These but
`tons allow a user to manipulate and control image data and to
`generate protected data.
`In an alternative embodiment, turning the ring in one direc
`tion might produce a start signal, and continuing to turn the
`ring in that direction might extend backwards the time period
`that is protected. Where a default time period for storing
`pre-start signal data is used, extending the time can be con
`sidered overriding the default. Similarly, turning the ring in
`the opposite direction might produce a stop signal, and where
`a default time period for storing post-start signal data is used,
`extending the time can be considered overriding that default.
`Electronics for such a ring or other control device are readily
`available, and for example are similar to those used in key
`fobs. Indeed, signaling device 150 should be interpreted
`euphemistically to include key fob type device.
`It is contemplated that the signaling device could be inte
`grated into other items as an accessory and that is wearable on
`an individual, for example alapel pin or a pen within a pocked
`protector. It is also contemplated that the switch could be
`portable or can be hidden or attached to other devices such as
`a vehicle, furniture, etc. The signal could also be generated in
`non-tactile ways, for example by an audio command or
`whistle, or by an automatic sensor. Preferably, the user could
`configure the audio signal to match only his/her voice.
`At any moment, the user can signal recorder 160 to place a
`“bookmark” in the recording. This signal can be sent by
`pressing a button that will then transmit a signal through wires
`140 that attach to the glasses then to the recorder. The wires
`140 could be fiber optic wires that are small and thin to avoid
`detection. In an exemplary embodiment, the user could con
`trol the entire system using signaling device 150, for example
`by turning the camera on and off, recordingaportion of image
`data, stop the recording, Zooming in and out of image data; or
`transmitting protected data into the remote memory 170.
`While remote memory 170 is shown in the figure as a
`mobile or cell phone, remote memory 170 should be inter
`preted euphemistically to include any memory that is not
`connected to surveillance apparatus 100, for example, a DVD
`writer, a wireless network attached storage (NAS) device, a
`wireless storage area network (SAN) device, a home com
`puter, or even a second Surveillance apparatus. Preferably,
`sending facility 165 sends protected segments of circular
`buffer 169 wirelessly to remote memory 170 whenever
`remote memory 170 is within range of wireless transceiver
`169, possibly as part of a PAN using one or more wireless
`communication technologies (e.g., BlueTooth, Skinplex,
`wireless USB, 802.11, 802.15, UWB, Z-Wave, IrDa, Zigbee,
`
`25
`
`35
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`7
`etc.). However, sending facility 165 could also respond to
`manual commands, for example through a button on signal
`ing device 150, recorder 160, or the mobile phone itself. In an
`alternative embodiment, the mobile phone does not act as a
`remote memory depository, and instead forwards the pro
`tected segment to a remote memory via a mobile internet or
`wi-fi connection. Preferably, once protected data is trans
`ferred to a remote memory, the protected memory areas then
`will go back to become free memory areas that are available
`for further loop recording.
`Write-protected data could be sent to the remote memory
`by an image sensor that outputs data directly in “block”
`format typically converted with a raster-to-block converter.
`Further compression could be used before transmitting the
`data if wireless bandwidth is an issue. Either DCT or wavelet
`transformed data on native sensor formats could be used. The
`data is preferably transmitted via the Internet, but could also
`be transmitted using radio waves, a pager, a two-way pager, a
`physical cable, email, text message, picture message, or any
`other Suitable communication mechanism.
`FIG. 3 shows a diagram representation of circular buffer
`167 in memory 166, with unprotected segment 320 and write
`protected segment 330. Write-protected segment 330 is char
`acterized as a predefined portion of the recording data. The
`recording facility 163 continuously records the data stream
`310 into circular buffer 167. The recording facility 163
`records over unprotected segment 320 of circular buffer 167,
`while skipping over protected segments 330 of circular buffer
`167. It is contemplated that the portion of the circular buffer
`that is marked as write-protected data cannot be overwritten
`once the recorder loops back to the beginning of the media.
`FIGS. 4A-4H show an alternative diagram representation
`of a circular buffer 300 as it is being used.
`In FIG. 4A the recording facility (not shown) records data
`stream 'A' into circular buffer 400. The
`character is used
`to designate blank memory, or unprotected memory that can
`be overwritten. The ellipsis “ . . . . is used to show that the
`memory can be very large relative to the number of positions
`shown in the figure. It is contemplated, for example, that
`memory 400 can be up to several hundred megabytes, 1 GB,
`2 GB, 4 GB, 8 GB, or even more. Such memory is preferably
`of a flash type, non-volatile RAM, preferably in the form of a
`standard flash memory card. In a preferred embodiment, cir
`cular buffer 400 comprises a logical representation of a physi
`cal memory area. Buffer 400 can be configured to store data in
`the physical memory by taking into account wear-leveling
`across the physical memory.
`In FIG.4B the protecting facility (not shown) has protected
`a recent period of data stream 'A' as a function of a start
`signal, shown by the character “I’. The start signal can be
`triggered in any Suitable manner, including for example
`manual operation of a trigger or a Switch by a user. For
`example, the ring of FIG. 1 could be used as a Switch, or any
`other wearable accessory could have a Switch integrated into
`it. In other examples, start signals can be triggered by detec
`tion of a particular circumstance by a motion, Sound or other
`sensor. In an exemplary system, software can operate upon
`content in the data stream, Such as by monitoring an entrance
`to a building using a data stream received from one or more
`cameras, and could then send a start signal when the image
`shows a person loitering in a certain area of the screen.
`The “I” character is used to designate the start of protected
`memory. Concomitantly, the portion of the data stream prior
`to the protected portion has once again been marked ' ' to
`show that it is unprotected. In protecting recent data, the
`system can protect a default historical time period before the
`start signal is sent and protect a default period after the start
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 7,593,034 B2
`
`8
`signal is sent (Such as 30 seconds, 2 minutes, etc). All Suitable
`defaults are contemplated. Alternatively, the historical time
`period being protected could be altered in some manner, Such
`as by Software or by a user operating a history button. For
`example, if a user hits a start button, the system might default
`to protecting the last 30 seconds and the next 60 seconds; or
`it might protect the last 15 seconds and the next 2 minutes.
`Preferably, before the protecting facility stops protecting
`data, the system sends a signal to the user that the system is
`about to stop write-protecting data. For example, the system
`could send an audio chirp signal, or in the case of a pair of
`eyeglasses, a portion of the glasses could slightly vibrate to
`signal that the system will stop recording in 10 seconds. If the
`user wishes to protect an additional 60 second time period, the
`user could hit a “more time' button. In this manner a user
`could protecta 5 or 10 minute period, or an even much longer
`portion of a data stream prior to a start signal. Indeed, if
`memory 400 is interpreted as a multi gigabyte flash memory,
`it is entirely possible that one could back up sufficiently to
`protect an hour or more of Such a data stream.
`In FIG. 4C the protecting facility has received a “stop'
`signal Some time after receiving the start signal, thereby
`lengthening the protected portion of the “A” data stream. The
`stop signal is shown as character'' and could be automati
`cally generated from Software or hardware as a function of a
`default time after the start signal, or could be manually sent by
`the user of the system. All suitable defaults are contemplated,
`i