US007868912C1
`
`(12) EX PARTE REEXAMINATION CERTIFICATE (10201st)
`United States Patent
`US 7,868,912 C1
`(10) Number:
`Venetianer et al.
`(45) Certificate Issued:
`Jun. 25, 2014
`
`(54) VIDEO SURVEILLANCE SYSTEM
`EMPLOYING VIDEO PRIMITIVES
`
`(75)
`
`Inventors: Peter L. Venetianer, McLean, VA (US);
`Alan J. Lipton, Herndon, VA (US);
`Andrew J. Chosak, Arlington, VA (US);
`Matthew F. Frazier, Arlington, VA
`(US); Niels Haering, Reston, VA (US);
`Gary W. Myers, Ashburn, VA (US);
`Weihong Yin, Herndon, VA (US);
`Zhong Zhang, Herndon, VA (US)
`
`now abandoned, which is a continuation-in-part of
`application No. 09/694,712, filed on Oct. 24, 2000,
`now Pat. No. 6,954,498.
`
`(51)
`
`Int. Cl.
`H04N 7/18
`
`(2006.01)
`
`(52) U.S. Cl.
`USPC .......................................................... 348/143
`
`(58) Field of Classification Search
`None
`
`See application file for complete search history.
`
`(73) Assignee: ObjectVideo, Inc., Reston, VA (US)
`
`(56)
`
`References Cited
`
`Reexamination Request:
`No. 90/012,878, May 24,2013
`
`Reexamination Certificate for:
`Patent No.:
`7,868,912
`Issued:
`Jan. 11, 2011
`Appl. No.:
`11/098,385
`Filed:
`Apr. 5, 2005
`
`Related U.S. Application Data
`
`1 1/057,154,
`(63) Continuation-in-part of application No.
`filed on Feb. 15, 2005, which is a continuation-in-part
`ofapplication No. 09/987,707, filed on Nov. 15, 2001,
`
`To view the complete listing of prior art documents cited
`during the proceeding for Reexamination Control Number
`90/012,878, please refer to the USPTO’s public Patent
`Application Information Retrieval (PAIR) system under the
`Display References tab.
`
`Primary Examiner 7 Adam L Basehoar
`
`(57)
`
`ABSTRACT
`
`A video surveillance system extracts video primitives and
`extracts event occurrences from the video primitives using
`event discriminators. The system can undertake a response,
`such as an alarm, based on extracted event occurrences.
`
`15
`
`
`
`
`14
`
`video
`sensors
`
`video
`recorders
`
`1 1
`
`
`,
`camputer system
`
`
`
`
` medium
`
`computer-readable ‘
`
`:10 devices
`
`16
`
`other
`sensors
`
`7
`
`17
`
`Canon Ex. 1032 Page 1 of 3
`
`Canon Ex. 1032 Page 1 of 3
`
`

`

`1
`
`EX PARTE
`
`US 7,868,912 C1
`
`2
`
`REEXAMINATION CERTIFICATE
`
`ISSUED UNDER 35 U.S.C. 307
`
`THE PATENT IS HEREBY AMENDED AS
`INDICATED BELOW.
`
`Matter enclosed in heavy brackets [ ] appeared in the
`patent, but has been deleted and is no longer a part of the
`patent; matter printed in italics indicates additions made
`to the patent.
`
`5
`
`10
`
`AS A RESULT OF REEXAMINATION, IT HAS BEEN
`DETERMINED THAT:
`
`15
`
`The patentability of claims 1-4 and 6-22 is confirmed.
`Claim 5 is cancelled.
`
`New claims 23-36 are added and determined to be 20
`patentable.
`
`30
`
`23. A video system comprising:
`a first processor which analyzes a video to determine
`attributes of objects detected in the video, the first pro— 25
`cessor being in communication with afirst communica—
`tions link to transfer the determined attributes over the
`communications link; and
`in
`a second processor, separate from the first processor,
`communication with the first communications link to
`receive the determined attributes transferred from the
`firstprocessor over thefirst communications link, which
`determines afirst event that is not one ofthe determined
`attributes by analyzing a combination of the received 35
`determined attributes and which provides, in response to
`a determination ofthefirst event, at least one ofan alert
`to a user, informationfor a report, and an instructionfor
`taking an action, wherein analyzing the combination of
`the received determined attributes comprisesfiltering,
`wherein thefirst processor determines attributes indepen—
`dent of a selection of the first event by the second pro—
`cessor, and
`wherein the second processor determines the first event
`without reprocessing the video analyzed by thefirstpro— 45
`cessor.
`
`40
`
`24. A video system, comprising:
`an input in communication with a communications chan—
`nel;
`aprocessor configured to receivefrom the input a stream of 50
`detected attributes received over the communications
`
`channel, the attributes being attributes of one or more
`objects detected in a video, the processor configured to
`determine an event that is not one of the detected
`attributes by analyzing a combination of the received 55
`attributes and configured to provide, upon a determina—
`tion of the event, at least one of an alert to a user,
`informationfor a report and an instructionfor taking an
`action, wherein analyzing the combination of the
`received attributes comprisesfiltering,
`wherein the attributes received over the communications
`
`60
`
`channel are independent ofthe event to be determined by
`the processor, and
`wherein the processor is configured to determine the event
`without reprocessing the video.
`25. A method ofdetecting an eventfrom a video, compris—
`ing:
`
`65
`
`receiving a stream ofdetected attributes over a communi—
`cations channel,
`the detected attributes representing
`attributes ofan objectpreviously detected in the video at
`a remote location;
`performing an analysis ofa combination ofthe detected
`attributes to detect an event that is not one ofthe detected
`attributes without reprocessing the video, wherein the
`analysis of the combination of the detected attributes
`comprisesfiltering,
`upon detecting the event, providing at least one ofan alert
`to a user, informationfor a report and an instructionfor
`taking an action,
`wherein the detected attributes received in the stream of
`attributes are independent ofa selection ofthe event to
`be detected.
`
`26. A video system comprising:
`a first processor which analyzes a video to determine
`attributes ofobjects detected in the video, the first pro—
`cessor being in communication with afirst communica—
`tions link to transfer the determined attributes over the
`communications link; and
`in
`a second processor, separate from the first processor,
`communication with the first communications link to
`receive the determined attributes transferred from the
`firstprocessor over thefirst communications link, which
`determines afirst event that is not one ofthe determined
`attributes by analyzing a combination of the received
`determined attributes and whichprovides, in response to
`a determination ofthefirst event, at least one ofan alert
`to a user, informationfor a report, and an instructionfor
`taking an action,
`wherein the attributes ofobjects detected in the video com—
`prise first and second objects, and the first event is the
`first and second objects coming together,
`wherein thefirst processor determines attributes indepen—
`dent of a selection of the first event by the second pro—
`cessor, and
`wherein the second processor determines the first event
`without reprocessing the video analyzed by thefirstpro—
`cessor.
`
`27. A video system, comprising:
`an input in communication with a communications chan—
`nel;
`a processor configured to receivefrom the input a stream of
`detected attributes received over the communications
`
`channel, the attributes being attributes offirst and sec—
`ond objects detected in a video, theprocessor configured
`to determine an event that is not one of the detected
`attributes by analyzing a combination of the received
`attributes and configured to provide, upon a determina—
`tion of the event, at least one of an alert to a user,
`informationfor a report and an instructionfor taking an
`action, the event being thefirst and second objects com—
`ing together,
`wherein the attributes received over the communications
`
`channel are independent ofthe event to be determined by
`the processor, and
`wherein the processor is configured to determine the event
`without reprocessing the video.
`28. A method ofdetecting an eventfrom a video, compris—
`ing:
`receiving a stream ofdetected attributes over a communi—
`cations channel,
`the detected attributes representing
`attributes offirst and second objects previously detected
`in the video at a remote location;
`performing an analysis ofa combination ofthe detected
`attributes to detect an event that is not one ofthe detected
`
`Canon EX. 1032 Page 2 of 3
`
`Canon Ex. 1032 Page 2 of 3
`
`

`

`US 7,868,912 C1
`
`3
`the event
`attributes without reprocessing the video,
`being thefirst and second objects coming together
`upon detecting the event, providing at least one ofan alert
`to a user, informationfor a report and an instructionfor
`taking an action,
`wherein the detected attributes received in the stream of
`attributes are independent ofa selection ofthe event to
`be detected.
`
`29. A method comprising:
`analyzing a video to detectfirst and second objects;
`creating a stream ofattributes at a first location by deter—
`mining attributes of the detected first object and
`attributes ofthe detected second object by analyzing the
`video;
`transmitting the stream of attributes to a second location
`removedfrom thefirst locationfor subsequent analysis,
`wherein the stream of attributes are transmitted to the
`second location over a communications channel, and
`wherein the stream of attributes is suflicient to allow the
`subsequent analysis to detect an event of the video to
`provide at least one ofan alert to a user, informationfor
`a report and an instruction for taking an action, the
`event not being one of the determined attributes,
`the
`event being thefirst and second objects coming together,
`wherein the stream ofattributes is suflicient to allow detec—
`tion of the event that is not one of the determined
`attributes without reprocessing the video of the first
`location.
`
`30. A video device, comprising:
`a processor at a first location which analyzes a video to
`detect first and second objects and to determine
`attributes of the first object detected in the video and
`attributes ofthe second object detected in the video;
`an output configured to transmit the attributes determined
`by the processor over a communications link,
`wherein the output is configured to transmit the attributes
`to a second location removedfrom the processorfor a
`subsequent analysis ofa combination ofthe attributes at
`the second location,
`wherein the processor determines attributes independently
`ofa subsequent analysis ofa combination ofattributes to
`determine an event that is not one of the determined
`attributes, the event being the first and second objects
`coming together and
`wherein the attributes are sufiicient to allow detection ofan
`event to provide at least one ofan alert to a user, infor—
`mation for a report and an instruction for taking an
`action,
`the event not being one of the determined
`attributes and being determinable by analyzing the com—
`bination ofthe attributes,
`wherein the attributes are sufiicient to allow detection ofan
`event without reprocessing the video ofthefirst location.
`3]. A video system comprising:
`a first processor which analyzes a video to determine
`attributes of objects detected in the video, the first pro—
`cessor being in communication with afirst communica—
`tions link to transfer the determined attributes over the
`communications link; and
`in
`a second processor, separate from the first processor,
`communication with the first communications link to
`receive the determined attributes transferred from the
`firstprocessor over thefirst communications link, which
`determines afirst event that is not one ofthe determined
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`4
`
`attributes by analyzing a combination of the received
`determined attributes and whichprovides, in response to
`a determination ofthefirst event, at least one ofan alert
`to a user, informationfor a report, and an instructionfor
`taking an action, wherein analyzing the combination of
`the received determined attributes comprisesfiltering,
`wherein the attributes ofobjects detected in the video com—
`prise first and second objects, and the first event is the
`first and second objects coming together,
`wherein thefirst processor determines attributes indepen—
`dent of a selection of the first event by the second pro—
`cessor, and
`wherein the second processor determines the first event
`without reprocessing the video analyzed by thefirstpro—
`cessor.
`
`32. A video system, comprising:
`an input in communication with a communications chan—
`nel;
`a processor configured to receivefrom the input a stream of
`detected attributes received over the communications
`
`channel, the attributes being attributes offirst and sec—
`ond objects detected in a video, theprocessor configured
`to determine an event that is not one of the detected
`attributes by analyzing a combination of the received
`attributes and configured to provide, upon a determina—
`tion of the event, at least one of an alert to a user,
`informationfor a report and an instructionfor taking an
`action, the event being thefirst and second objects com—
`ing together, wherein analyzing the combination ofthe
`received attributes comprisesfiltering,
`wherein the attributes received over the communications
`
`channel are independent ofthe event to be determined by
`the processor, and
`wherein the processor is configured to determine the event
`without reprocessing the video.
`33. A method ofdetecting an eventfrom a video, compris—
`ing:
`receiving a stream ofdetected attributes over a communi—
`cations channel,
`the detected attributes representing
`attributes offirst and second objects previously detected
`in the video at a remote location;
`performing an analysis ofa combination ofthe detected
`attributes to detect an event that is not one ofthe detected
`attributes without reprocessing the video, wherein the
`analysis of the combination of the detected attributes
`comprisesfiltering, the event being thefirst and second
`objects coming together,
`upon detecting the event, providing at least one ofan alert
`to a user, informationfor a report and an instructionfor
`taking an action,
`wherein the detected attributes received in the stream of
`attributes are independent ofa selection ofthe event to
`be detected.
`
`34. The video system of claim 23, wherein the filtering
`comprises filtering the combination of the received deter—
`mined attributes to determine ifthefirst event occurred.
`35. The video system of claim 24, wherein the filtering
`comprisesfiltering the combination ofthe received attributes
`to determine ifthe event occurred.
`36. The method ofclaim 25, wherein thefiltering comprises
`filtering the combination of the detected attributes to deter—
`mine ifthe event occurred.
`*
`*
`
`*
`
`*
`
`*
`
`Canon EX. 1032 Page 3 of 3
`
`Canon Ex. 1032 Page 3 of 3
`
`