(12) United States Patent
`DeKeyser
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,485.471 B2
`*Nov. 1, 2016
`
`US009.4854.71B2
`
`(56)
`
`(52) U.S. Cl.
`CPC ....................................... H04N 7/18 (2013.01)
`(58) Field of Classification Search
`CPC ......................... H04N 7/188: G08B 13/19676
`See application file for complete search history.
`References Cited
`U.S. PATENT DOCUMENTS
`5.204,909. A
`4, 1993 C
`5,381.526. A
`1/1995 Ellson
`5,418,529 A
`5/1995 De Luigi et al.
`5,523,799 A
`6/1996 Hattori et al.
`5,689,442 A 11/1997 Swanson et al.
`5,790,427 A
`8, 1998 Greer et al.
`6,163,338 A 12/2000 Johnson et al.
`6,317,817 B1
`1 1/2001 Shichiku et al.
`6,351,798 B1
`2/2002 Aono
`(Continued)
`
`4. W I
`
`OWa.
`
`(54) WRITE-PROTECTED RECORDING
`(71) Applicant: STELLAR, LLC, Irvine, CA (US)
`(72) Inventor: Paul DeKeyser, Irvine, CA (US)
`(73) Assignee: Stellar, LLC, Irvine, CA (US)
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 732 days.
`This patent is Subject to a terminal dis-
`claimer
`
`(21) Appl. No.: 13/790,553
`(22) Filed:
`Mar. 8, 2013
`
`(65)
`
`Prior Publication Data
`US 2013/0188048 A1
`Jul. 25, 2013
`
`Related U.S. Application Data
`(63) Continuation of application No. 12/560.584, filed on
`Sep. 16, 2009, now Pat. No. 8,692,882, which is a
`continuation of application No. 12/268,286, filed on
`Nov. 10, 2008, now Pat. No. 7,593,034, which is a
`continuation-in-part of application No. 1 1/770,920,
`filed on Jun. 29, 2007, now Pat. No. 8,310,540,
`application
`No.
`13/790,553,
`which
`is
`a
`continuation-in-part of application No. 1 1/846,217,
`filed on Aug. 28, 2007, now Pat. No. 8,928,752, said
`application No. 12/268,286 is a continuation-in-part
`of application No. 1 1/846,217.
`(60) Provisional application No. 60/824,097, filed on Aug.
`31, 2006, provisional application No. 60/824,095,
`filed on Aug. 31, 2006.
`
`(51) Int. C.
`H04N 9/247
`H04N 7/8
`
`(2006.01)
`(2006.01)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`WO
`
`10, 1992
`O510968
`12/1992
`92.22983
`(Continued)
`Primary Examiner — Nhon Diep
`(74) Attorney, Agent, or Firm — Fish & Tsang, LLP
`(57)
`ABSTRACT
`A Surveillance apparatus continuously records imaged data
`from a camera into a circular buffer in a local memory. When
`a record signal is received, the system records the video
`stream that was recorded before the record signal was
`received, and the video stream that is recorded after the
`record signal was received. The recorded segment is then
`write-protected, so that the Surveillance apparatus does not
`overwrite the recorded segment. The recorded segment
`could then be sent to a remote memory via a wireless
`connection to free up local memory for future recording
`sessions.
`
`13 Claims, 4 Drawing Sheets
`
`DeKeyser
`(Variable
`buffer)
`
`400
`
`
`
`De Keyser
`(variable
`buffer)
`
`
`
`400
`
`AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
`AAAAAAAAAAAAAAAAAAAAAAA
`
`(AAAAAAAAAAAAAAAABBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBB
`
`

`

`US 9,485.471 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,370,198
`6,618,546
`6,831,652
`6,950,600
`7,162,607
`7, 195,164
`7.587,323
`
`4, 2002
`9, 2003
`12, 2004
`9, 2005
`1/2007
`3, 2007
`9, 2009
`
`Washino
`Ichioka et al.
`Orr
`Dietz
`Macy et al.
`Patel
`Matz et al.
`
`2002fOOO5895 A1
`2004/O183912 A1
`2006, O158968 A1
`2007/O132773 A1
`2007/0174538 A1
`
`1, 2002
`9, 2004
`T/2006
`6, 2007
`7/2007
`
`Freeman et al.
`Szolyga et al.
`Vanman et al.
`Plante
`Christoffersson et al.
`
`FOREIGN PATENT DOCUMENTS
`
`WO
`WO
`WO
`
`99.49656
`99.56216
`2006/044476
`
`9, 1999
`11, 1999
`4/2006
`
`

`

`U.S. Patent
`
`Nov. 1, 2016
`
`Sheet 1 of 4
`
`US 9,485.471 B2
`
`
`
`100
`
`162 163 164
`
`166
`
`FIG. 1
`
`
`
`FIG. 2A
`
`

`

`U.S. Patent
`U.S. Patent
`
`Nov. 1, 2016
`Nov. 1, 2016
`
`Sheet 2 of 4
`Sheet 2 of 4
`
`US 9,485.471 B2
`US 9,485,471 B2
`
`
`163
`
`320
`320
`
`
`
`163
`
`FIG. 3
`FIG. 3
`
`Motorola v. Stellar
`
`Motorola Exhibit 1001
`Page 004
`
`

`

`U.S. Patent
`
`Nov. 1, 2016
`
`Sheet 3 of 4
`
`US 9,485.471 B2
`
`
`
`AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
`DeKeyser
`(variable AAAAAAAAAAAAAAAAAAAAAAA
`buffer)
`
`400
`
`
`
`DeKeyser
`(Variable
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`FIG. 4A
`
`AAAAAAAAAAA
`
`FIG. 4B
`
`AAAAAAAAAAAAAAA
`
`FIG. 4C
`
`(AAAAAAAAAAAAAAAABBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB
`BBBBBBBBBBBBB
`
`FIG. 4D
`
`

`

`U.S. Patent
`
`Nov. 1, 2016
`
`Sheet 4 of 4
`
`US 9,485.471 B2
`
`DeKeyser
`(variable
`buffer)
`
`
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`400
`
`
`
`DeKeyser
`(variable
`buffer)
`
`
`
`400
`
`AAAAAAAAAAAAAAA
`
`(BBBBBBBBBBB
`
`FG. 4E
`
`AAAAAAAAAAAAAAA
`
`(BBBBBBBBBBBBBBB
`
`FIG. 4F
`
`CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
`CCCCCCCCCCCCAAAAAAAAAAAAAAA CCCCC
`
`BBBBBBBBBBBBBBBCCCCCCCCCCCCCCCCCCCCCCCC. . . CCCCCCC
`
`FIG. 4G
`
`CCCCCCCAAAAAAAAAAAAAAA CCCCC
`
`(BBBBBBBBBBBBBBB)
`
`FIG. 4H
`
`

`

`1.
`WRITE-PROTECTED RECORDING
`
`US 9,485,471 B2
`
`2
`images directly to a wireless memory that may have a larger
`capacity; however, this means that the camera does not work
`in the absence of a wireless connection. U.S. Pat. No.
`5,523,799 to Hattori et al. also describes storing data in a
`memory having an archival portion. However, Hattori fails
`to address sending data to a remote memory.
`Thus, there is still a need for a recording camera that
`provides better recording and editing functions.
`
`10
`
`III. SUMMARY OF THE INVENTION
`
`This application is a continuation of U.S. patent applica
`tion Ser. No. 12/560,584, filed Sep. 16, 2009, which is a
`continuation of U.S. patent application Ser. No. 12/268,286,
`filed Nov. 10, 2008, now issued U.S. Pat. No. 7,593,034,
`which is a continuation-in-part of U.S. patent application
`Ser. No. 1 1/770,920, filed Jun. 29, 2007, now issued U.S.
`Pat. No. 8,310,540, which claims the benefit of U.S. provi
`sional patent 60/824,097, filed Aug. 31, 2006. This appli
`cation and Ser. No. 12/268,286 are also continuations-in
`part of U.S. patent application Ser. No. 1 1/846,217, filed
`Aug. 28, 2007, which claims the benefit of U.S. provisional
`patent 60/824,095, filed Aug. 31, 2006. These and all other
`referenced extrinsic materials are incorporated herein by
`reference in their entirety. Where a definition or use of a term
`in an incorporated reference is inconsistent or contrary to the
`definition of that term provided herein, the definition of that
`term provided herein applies and the definition of that term
`in the reference does not apply.
`
`I. FIELD OF THE INVENTION
`
`15
`
`The field of the invention is video camera recording
`technology.
`
`25
`
`II. BACKGROUND
`
`30
`
`35
`
`Conventional camcorders use a variety of storage formats
`including digital video cassettes, mini-DV cassettes, or
`DVD-R discs that offer a limited amount of memory to store
`data. One of the major shortcomings of the existing cam
`corder technology is that the memory runs out too soon.
`Once a portion of the memory has been recorded, there is
`less memory available for further recording. Then when the
`memory is full, users have to return to their home/work
`computer or media Station to transfer the recorded data from
`the camera to free up the memory. This creates inconve
`nience and inflexibility for recording on the go.
`WO 2006/044476 to Vanman describes an electronic
`camera mounted to a police vehicle with a circular buffer
`that is constantly recording. When the camera reaches the
`end of the memory it records from the beginning of memory,
`erasing the earliest recorded data. Such technology is often
`employed with Surveillance cameras for long and continuous
`45
`recording with little or no supervision. However, Vanman
`does not distinguish or differentiate any data that is of
`importance. To save data in the buffer, the user of the
`Vanman device needs to transfer important portions of the
`buffer wirelessly to a central office or physically to a DVD
`50
`disc, or else risk having the interesting data be recorded over
`during loop recording. Such transfers are processor intensive
`and may not be possible when the central office is out of
`range or an empty DVD disc is unavailable.
`Vanman and all other extrinsic materials identified herein
`are incorporated by reference in their entirety. Where a
`definition or use of a term in an incorporated reference is
`inconsistent or contrary to the definition of that term pro
`vided herein, the definition of that term provided herein
`applies and the definition of that term in the reference does
`not apply.
`EP 1064783 to Mann describes a camera mountable to a
`pair of eyeglasses that continuously saves recorded images
`to a circular buffer in a computer on the user's waist. When
`a user wants to save a piece of recorded video, the user must
`65
`stop recording and offload the data at another location before
`the user can record again. Mann also discusses streaming the
`
`40
`
`55
`
`60
`
`The present invention provides apparatus, systems, and
`methods in which a Surveillance apparatus processes images
`by (1) continuously recording a stream of imaged data, (2)
`write protecting segments of the recorded stream, and (3)
`sending write protected segments from a local memory to a
`remote memory using a wireless transmitter.
`The Surveillance apparatus generally has a camera func
`tionally coupled to a local memory with a circular buffer. As
`used herein, the term “a local memory functionally coupled
`to the camera' means that the memory that is distanced less
`than 20 cm from the camera, and is coupled to the camera
`using entirely physical connectors (e.g., wires, pins, con
`ductive paths, etc.). This contrasts with a “remote memory
`functionally coupled to the camera', which would be a
`memory that is distanced from the camera by at least 20 cm,
`or is coupled to the camera using a wireless connection. The
`circular buffer is preferably organized into a series of
`memory segments that loops back on itself and is organized
`into both available segments and write-protected segments.
`This allows a recording facility to record the data stream
`available in portions of the circular buffer while skipping
`over write-protected matter. Preferably, the local memory is
`large enough to store at least 5 or 10 minutes of imaged data.
`Preferably, the recording facility continuously records the
`data stream into the circular buffer any time the surveillance
`apparatus is powered on. As used herein, the term "continu
`ous' with respect to recording a video data stream means
`that data is recorded at least every half second over a given
`ten second period. When a signal to record is sent to the
`Surveillance apparatus, a protecting facility designates a
`segment of the circular buffer to be write-protected to
`prevent that segment from being overwritten during the next
`recording loop. Part of the write-protected portion could be
`a pre-recorded subset that is recorded before the signal is
`received, while part of the write-protected portion could be
`a post-recorded Subset that is recorded after the signal is
`received. The pre-recorded subset could be as long as 5
`seconds, 10 seconds, 30 seconds, or more. Preferably, vari
`ous aspects of both the pre-recorded subset and the post
`recorded Subset can be configured with a user interface.
`While the write-protected portions could be electronically
`indexed using a memory heap or a clustered index, the
`write-protected portions are preferably stored as separate
`files in the memory. Such files could be stored in physically
`dis-contiguous parts of the circular buffer. Additionally, the
`indexing is preferably performed while the recording facility
`is still recording data into the memory.
`The signal to record is preferably automatically triggered
`by a sensor that detects an image in the camera or a Sound
`by the camera's microphone. For example, the signal to
`record could be triggered by a human face, an open book, a
`computer screen, a whistle, a verbal command, a recognized
`object, or a pattern of knocks. Alternatively, a user interface
`could allow a human user to manually send the signal to
`record and could even allow the human user to designate a
`length of time of the pre-recorded subset or the post
`
`

`

`US 9,485,471 B2
`
`10
`
`15
`
`3
`recorded Subset. A user could send two signals, one to start
`recording and another to stop recording, but preferably the
`user merely sends a signal to start recording for a specified
`period of time. In an exemplary embodiment, when the
`specified period of time has almost expired, say, for
`example, 5 seconds, 10 seconds, or longer, the user could
`extend the length of specified time by sending another
`trigger to the Surveillance apparatus. For example, the
`Surveillance apparatus could send a warning 10 seconds
`before it is scheduled to stop recording by vibrating against
`the user; in response the user could say “don’t stop’ or
`merely cough to extend the length of the write-protected
`portion of memory.
`While the surveillance apparatus could be a mounted on
`a hand-held video camera, the Surveillance apparatus is
`preferably a small device that can be mounted inconspicu
`ously on a person. For example, contemplated Surveillance
`apparatus mounts are a pair of wearable Sunglasses or
`eyeglasses, a lapel pin, a collar button, a hat or visor, a hair
`pin, or a front of a purse.
`Since the Surveillance apparatus is typically too small to
`house a large amount of memory, the Surveillance apparatus
`also preferably has a wireless transmitter that is also func
`tionally connected to the local memory. A sending facility
`uses the wireless transmitter to transmit write-protected
`portions of the circular buffer to a remote memory that is not
`physically connected to the local memory in Some way. For
`example, the wireless transmitter could send write-protected
`portions of the circular buffer to a mobile phone, or the
`Surveillance apparatus could be plugged into a mobile phone
`which is then used as a wireless transmitter to forward a
`write-protected portion to another remote memory. In a
`preferred embodiment, after a write-protected portion of the
`circular buffer is transferred to a remote memory, the pro
`tecting facility could remove the corresponding portion from
`protection so that the recording facility could use that
`portion to record data.
`Various objects, features, aspects and advantages of the
`present invention will become more apparent from the
`following detailed description of preferred embodiments of
`40
`the invention, along with the accompanying drawings in
`which like numerals represent like components.
`
`4
`Vation, including for example an ordinary person watching
`a baseball game or birthday party.
`The eyeglasses 110 are used here euphemistically to
`represent any type of camera mount. In a preferred embodi
`ment, the camera mount is disguised to be a common object
`worn by a person or lying around a house, but could also be
`shaped and sized to look like a camera. Contemplated
`mounts include lapel pins, hair clips, shirt buttons, purses,
`Staplers, desk clocks, tripods, head gear, hand grips, or
`security camera mounts. As used herein the term "camera'
`means any device or collection of devices that includes an
`image capturing component that captures image data, and a
`converting component that converts the image data into
`digital data, possibly at least one data stream. An image
`capturing component could include one or more charge
`couple devices (CCD) complimentary metal-oxide-semi
`conductors (CMOS), CMOS focal plane arrays (CFP), radi
`ometers, or other manners of image obtaining devices.
`Camera 120 should be interpreted euphemistically to include
`all Such variants. Likewise, a Suitable converting component
`could include one or more analog-to-digital converters,
`Software codecs, or integrated circuits.
`Camera 120 contains an imager lens 122 used to focus
`images for camera 120. Conventional lenses allow one or
`more of the following adjustments: aperture (to control the
`amount of light), Zoom (to control the field-of-view), or
`shutter speed (to capture continuous motion.). In preferred
`embodiments, these adjustments are automatically con
`trolled by the camcorder electronics, generally to maintain
`constant exposure onto the imager without the manual
`adjustment from a user. It is contemplated that the preferred
`embodiments offer direct user control of all major optical
`functions. As with most modern digital recorders and cam
`corders, an analog-to-digital (ADC) converter is used to
`digitize the analog imager waveform output into a discrete
`digital-Video signal. Thus, the recorder can be used to record
`analog or digital formats.
`Viewfinder image lens 130 is calibrated to have the same
`field of view as camera 120. Preferably, viewfinder image
`lens 130 is embedded in between the two glass lenses of
`eyeglasses 110. Preferably viewfinder image lens 130 is a
`Zoom lens with preferred standard Zoom ration of 3x in or
`out of the focal length of the camera. A more Sophisticated
`viewfinder image lens 130 is contemplated to have a greater
`Zoom range and also has nighttime vision or is able to render
`images under different light conditions. Within the lenses,
`viewfinder image lens 130 is outlined by tinted area or
`graticle and the outline graticle is embedded with glowing
`fiber optic filament. Eye-glasses are made preferably from
`opaque, translucent, or possibly photo gray-type tint of
`glasses. Alternatively, glasses change color slightly when
`energized.
`Where the camera is a hand-held camera and is not
`embedded in a pair of eyeglasses, viewfinder image lens 130
`can be permanently fixed to camera 120, or it can be
`interchangeable with lenses of different focal lengths and
`other properties depending on the need and circumstances of
`SC.
`Recorder 160 is any recording device that records video
`and/or audio/video data, including conventional recorders.
`Recorder 160 preferably includes a processor 162 with
`software or hardware that accomplishes the functions
`described herein, or one or more physical memories that are
`collectively referred to herein as memory 166. Typically, the
`recorder or the camera converts analog images into a digital
`format to be stored in the memory, or also preferably records
`both audio and video input analog signals from the camera
`
`25
`
`30
`
`35
`
`IV. BRIEF DESCRIPTION OF THE DRAWING
`
`45
`
`FIG. 1 is a camera mounted on a pair of glasses connected
`to a circular buffer in a local memory that is controlled by
`a ring.
`FIGS. 2A and 2B show user interface buttons for the ring
`of FIG. 1.
`FIG. 3 shows a diagram representation of the circular
`buffer of FIG. 1.
`FIG. 4A-4H show representations of the circular buffer of
`FIG. 1 while the surveillance apparatus is in use.
`
`50
`
`55
`
`V. DETAILED DESCRIPTION
`
`In FIG. 1, an example surveillance apparatus 100 gener
`ally comprising eyeglasses 110 having a camera 120
`mounted at the nose bridge, and an optional viewfinder 130
`applied onto one of the lenses. A data and power cord 140
`couples the camera 120 to a belt-worn recorder 160, which
`cooperates with a ring-shaped signaling device 150 and a
`remote memory 170. Those skilled in the art will appreciate
`that the term "surveillance' is used herein in its broadest
`possible sense, to include not only professional or commer
`cial types of surveillance, but also any other type of obser
`
`60
`
`65
`
`

`

`US 9,485,471 B2
`
`5
`to the memory. Those skilled in the art will also appreciate
`that the concepts described herein with respect to video
`and/or audio/video data can be applied to recordation of
`purely audio, or in fact any other type of data stream; this
`specification should be interpreted as expressly including
`such application. A wearer could clip recorder 160 as a belt
`clip or another compact device. Contemplated recorders
`include MP3 players, purses, or buttons. It is also contem
`plated that recorder 160 could also comprise a cell or mobile
`phone having a suitable recorder application installed that is
`configured to communicate with the other components of
`apparatus 100.
`Although not expressly shown, recorder 160 also includes
`an appropriate power Supply or connection, Supporting
`electronics, or a display or other interface. The power Source
`can vary considerably. For example, in embodiments where
`the recorded is relatively large, a Suitable power source can
`include a rechargeable battery. On the other hand, when the
`recorder is relatively small, an appropriate power source can
`include an external power Source (e.g., transformer for wall
`outlet or cigarette lighter adapter). Whether embodied in
`control buttons or in some other manner, it is also contem
`plated that recorder can include some sort of security control
`requiring a password and some sort of automatic turnoff
`feature that activates after a certain amount of inactivity.
`Authentication or authorization of user access provides for
`ensuring a proper user of apparatus 100 retains desired
`control. For example, once a user is authenticated, the user
`can control indexing, editing, transmitting, or adjusting
`content data in memory.
`Recorder 160 would typically record images in digital
`format, but analog or combination formats are also contem
`plated. Preferably, the recorder's electronics are preferably
`all on a unitary printed circuit board with different functions,
`or facilities, encoded on a programmable chip or disk. For
`example, a recording facility 163 could record the data
`stream from camera 120 to local memory 166, a protecting
`facility 164 could protect segments (not shown) of recorded
`data on memory 166, or a sending facility 165 could transmit
`protected segments (not shown) of recorded data to remote
`memory 170. While the different facilities are preferably
`part of a single hardware or Software program, the facilities
`could be split into different components as necessary. Other
`facilities could be installed, for example a facility that allows
`editing of the received image data or protected data. It is
`contemplated that such facilities could be purchased through
`or installed on a cell phone, possibly through an on-line
`application store.
`The contemplated memory could vary depending on the
`particular configuration of the recorder. Particularly suitable
`memories include commercially available micro hard drives
`with a 1-inch disc (which can preferably have a capacity of
`more than 1 GB), flash memory cards with a capacity of up
`to 128 MB and more, or other transient and/or permanent
`memory units. Likewise, Suitable memory can also include
`SDRAM, MRAM, racetrack memory, SIMM, DIMM, etc.
`with a capacity of at least 32 MB, more preferably at least
`64 MB, or most preferably above 128 MB. In preferred
`embodiments, memory 166 is a SDRAM capable of storing
`at least 1000 frames of data. Once received by memory 166,
`frames are preferably compressed by employing conven
`tional compression rates and methods to achieve at least a
`50:1 ratio.
`In preferred embodiments, image data received by
`recorder 160 is stored in a circular buffer 167 on memory
`166. Preferably, all of the free space in memory 166 is used
`to create circular buffer 167, however, multiple circular
`
`40
`
`45
`
`6
`buffers could be created in the memory where there exist
`multiple cameras connected to a single recorder. Once the
`recorder is turned on, image data is continuously stored in
`circular buffer 167 for access. If no record or protect button
`is pushed, the recorder will loop back and store the image
`data for a said length of time. Recording, book-marking and
`protecting are used synonymously herein. Recording, book
`marking and protecting means that a portion of the imaged
`data is write-protected upon an activation of a signal by a
`user and can not then be overwritten unless the write
`protection is later removed. Consequently, protected data
`cannot be overwritten by newly stored imaged data in the
`circular buffer.
`The circular buffer is preferably large enough to store at
`least 3 minutes of data, more preferably 5 minutes and most
`preferred 10 minutes of data. However, it is contemplated
`that depending on the size and capacity of the device, any
`length longer or shorter is possible. It is preferred when the
`recorder is turned on the entire circular buffer is treated and
`stored as a single file. Thus, if no recording is protected or
`bookmarked, then the entire file will be erased and the
`recording will start at the beginning of the circular buffer.
`Signaling device 150 is shown in the figure as a ring that
`communicates wirelessly (e.g., BlueTooth, Skinplex, wire
`less USB, 802.11, 802.15, UWB, Z-Wave, IrDa, Zigbee,
`etc.) with the recorder, possibly as part of a personal area
`network (PAN). The ring can have any suitable interface,
`shown in FIGS. 2A and 2B, including for example buttons
`on its outer periphery, or a sensor along its inner edge. In
`FIG. 2A, ring 150 has user interface 200, with a start signal
`button 210, a stop signal button 220, a transmit button 230,
`a Zoom in button 240, or a Zoom out button 250. Alterna
`tively, the buttons could have decorative symbols in lieu of
`words of function as shown in FIG. 2B, or could even have
`arbitrary symbols Surrounding the entirety of signaling
`device 150. These buttons allow a user to manipulate and
`control image data and to generate protected data.
`In an alternative embodiment, turning the ring in one
`direction might produce a start signal, and continuing to turn
`the ring in that direction might extend backwards the time
`period that is protected. Where a default time period for
`storing pre-start signal data is used, extending the time can
`be considered overriding the default. Similarly, turning the
`ring in the opposite direction might produce a stop signal,
`and where a default time period for storing post-start signal
`data is used, extending the time can be considered overriding
`that default. Electronics for such a ring or other control
`device are readily available, and for example are similar to
`those used in key fobs. Indeed, signaling device 150 should
`be interpreted euphemistically to include key fob type
`device.
`It is contemplated that the signaling device could be
`integrated into other items as an accessory and that is
`wearable on an individual, for example a lapel pin or a pen
`within a pocked protector. It is also contemplated that the
`switch could be portable or can be hidden or attached to
`other devices such as a vehicle, furniture, etc. The signal
`could also be generated in non-tactile ways, for example by
`an audio command or whistle, or by an automatic sensor.
`Preferably, the user could configure the audio signal to
`match only his/her voice.
`At any moment, the user can signal recorder 160 to place
`a “bookmark” in the recording. This signal can be sent by
`pressing a button that will then transmit a signal through
`wires 140 that attach to the glasses then to the recorder. The
`wires 140 could be fiber optic wires that are small and thin
`to avoid detection. In an exemplary embodiment, the user
`
`10
`
`15
`
`25
`
`30
`
`35
`
`50
`
`55
`
`60
`
`65
`
`

`

`7
`could control the entire system using signaling device 150,
`for example by turning the camera on and off, recording a
`portion of image data, stop the recording, Zooming in and
`out of image data; or transmitting protected data into the
`remote memory 170.
`While remote memory 170 is shown in the figure as a
`mobile or cell phone, remote memory 170 should be inter
`preted euphemistically to include any memory that is not
`connected to Surveillance apparatus 100, for example, a
`DVD writer, a wireless network attached storage (NAS)
`device, a wireless storage area network (SAN) device, a
`home computer, or even a second Surveillance apparatus.
`Preferably, sending facility 165 sends protected segments of
`circular buffer 167 wirelessly to remote memory 170 when
`ever remote memory 170 is within range of wireless trans
`ceiver 169, possibly as part of a PAN using one or more
`wireless communication technologies (e.g., BlueTooth,
`Skinplex, wireless USB, 802.11, 802.15, UWB, Z-Wave,
`IrDa, Zigbee, etc.). However, sending facility 165 could also
`respond to manual commands, for example through a button
`on signaling device 150, recorder 160, or the mobile phone
`itself. In an alternative embodiment, the mobile phone does
`not act as a remote memory depository, and instead forwards
`the protected segment to a remote memory via a mobile
`internet or wi-fi connection. Preferably, once protected data
`is transferred to a remote memory, the protected memory
`areas then will go back to become free memory areas that are
`available for further loop recording.
`Write-protected data could be sent to the remote memory
`by an image sensor that outputs data directly in “block”
`format typically converted with a raster-to-block converter.
`Further compression could be used before transmitting the
`data if wireless bandwidth is an issue. Either DCT or wavelet
`transformed data on native sensor formats could be used.
`The data is preferably transmitted via the Internet, but could
`also be transmitted using radio waves, a pager, a two-way
`pager, a physical cable, email, text message, picture mes
`sage, or any other Suitable communication mechanism.
`FIG. 3 shows a diagram representation of circular buffer
`167 in memory 166, with unprotected segment 320 and
`write-protected segment 330. Write-protected segment 330
`is characterized as a predefined portion of the recording data.
`The recording facility 163 continuously records the data
`stream 310 into circular buffer 167. The recording facility
`163 records over unprotected segment 320 of circular buffer
`167, while skipping over protected segments 330 of circular
`buffer 167. It is contemplated that the portion of the circular
`buffer that is marked as write-protected data cannot be
`overwritten once the recorder loops back to the beginning of
`the media.
`FIGS. 4A-4H show an alternative diagram representation
`of a circular buffer 300 as it is being used.
`In FIG. 4A the recording facility (not shown) records data
`stream “A” into circular buffer 400. The “
`character is
`used to designate blank memory, or unprotected memory
`that can be overwritten. The ellipsis “ . . .
`. is used to show
`that the memory can be very large relative to the number of
`positions shown in the figure. It is contemplated, for
`example, that memory 400 can be up to several hundred
`megabytes, 1 GB, 2 GB, 4 GB, 8 GB, or even more. Such
`memory is preferably of a flash type, non-volatile RAM,
`preferably in the form of a standard flash memory card. In
`a preferred embodiment, circular buffer 400 comprises a
`logical representation of a physical memory area. Buffer 400
`can be configured to store data in the physical memory by
`taking into account wear-leveling across the physical
`memory.
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 9,485,471 B2
`
`10
`
`15
`
`8
`In FIG. 4B the protecting facility (not shown) has pro
`tected a recent period of data stream “A” as a function of a
`start signal, shown by the character “I’. The start signal can
`be triggered in any Suitable manner, including for example
`manual operation of a trigger or a Switch by a user. For
`example, the ring of FIG. 1 could be used as a Switch, or any
`other wearable accessory could have a Switch integrated into
`it. In other examples, start signals can be triggered by
`detection of a particular circumstance by a motion, Sound or
`other sensor. In an exemplary system, Software can operate
`upon content in the data stream, such as by monitoring an
`entrance to a building using a data stream received from one
`or more cameras, and could then send a start signal when the
`image shows a person loitering in a certain area of the
`SCC.
`The “I” character is used to designate the start of protected
`memory. Concomitantly, the portion of the data stream prior
`to the protected portion has once again been marked ' ' to
`show that it is unprotected. In protecting recent data, the
`system can protect a default historical time period before the
`start signal is sent and protect a default period after the start
`signal is sent (Such as 30 seconds, 2 minutes, etc). All
`suitable defaults are contemplated. Alternatively, the histori
`cal time period b