EN 'l‘ltlE llNlTEl) STATES PATENT ANB TRADEMARK ()FFECE
`
`) )
`
`inventor:
`
`Alan .lt LIPTGN et al.
`
`Control No: Unassigned
`
`P3611? NOS
`issued:
`Title:
`
`)
`799325923
`i
`April 26, will
`VlBEQ SURVEILLANCE ;
`SYSTEM EMPLOYING
`)
`VEBEG PRlMITlVES
`
`) > )
`
`Filing Date:
`
`September 29, 26%
`
`Mail Stop Ex Forte Reexarn
`Central Reexamination Unit
`
`Office oi‘Patent Legal Administration
`United States Patent 8; Trademark Gfilee
`
`PG. Box MSG
`
`Alexandria, Virginia 223 l3‘ l450
`
`ATTACHMENT T0 REQEJEST FQR EX PARTE REEXAMENATEGN {FGRM PEG-
`
`
`i?orsnant to the provisions of 35 USS. §§ 362-367 and 37 CPR. § LEE), the
`
`undersigned, on behalf of an anonymous Requesters requests ex parte reexamination of claims
`
`l-4l. ofU.S. Fatent No. 7,932,923 (“the ‘923 Patent”).
`
`Canon EX. 1013 Page 1 of 96
`
`Canon Ex. 1013 Page 1 of 96
`
`

`

`111nm 1111 conrsnrs
`
`CLAIMS FOR WHICH REEXAMINATION IS REQUESTED ............
`I.
`........................ 1
`II COPY OF ‘923 PATENT PURSUANT TO 37 C.PR § 1. 5111(b)(4)...
`1
`III. CERTIFICATION REGARDING 35 US.C § 315(c)(1) AND 35 U.S.C. § 325(c)(1) ........ 1
`IV. PROCEEDINGS RELATED TO THE “923 PATENT .......................................................... 1
`
`V. TIIE ‘923 PATENT AND ITS PROSECUTION ................................................................... 3
`
`VI. CITATION OF PRIOR PATENTS AND PRINTED PUBLICATIONS ......._
`
`.......... . ........ 21
`
`STATEMENTS POINTING OUT SUESTANTIAL NEW QUESTIONS OF
`VII.
`PATENTABILITY ......23
`
`A Proposed Rejection 1: C1ai111s I 41 are anticipated by Day—Iunder
`35 U. S C §10203) ........................ 24
`13
`Proposed Rejection2:CIain1s 14 and 35 are unpntentable as obvious over Day-I under
`35 U. S C. § 103111) ........................................................................................................................ 29
`C Proposed Rejection 3: Claims 10,19 31 and 41are unpatentable as obvious overDay-I
`and Brill under 35 U. S.C § 103(a) ........................................................................................... 31
`D Proposed Rejection 4: C1ai111s 11 and 32 are unpatenteble as obvious in View ofDay~I
`and Day—II under 35 U. S.C. § 1113 ..............
`..................................................................... 33
`E.
`Proposed Rejection 5: C1aims 17, 9—l3 and 15—28 areanticipated by Courtney ‘755
`under 35 U. SCC§ 102(1)) .......................................................................................................... 36
`P.
`Proposed Rejection 6: C1ai111 141s unpatentable as obviousin View of Courtney ‘755
`under 35 U. SC § 103(a)...
`..40
`G Proposed Rejection 7:C12ii111s1to 7 9111 13:111111 15 11)2Sare ant1c1pated by Shotton et
`a1. under 35 U S C. § 102(1)) .........
`...........
`..........
`41
`II. Proposed Rejection 8: Claim 141s unpatentableas obvious1n ViewofShotton et 111.
`under 35 U. S C. § 103(a)..
`... ...
`. .. ..
`... .46
`1.
`Proposed Rejection 9. Cldiins S and29to41are unpetentoble as obvious1n view61° the
`combination of Shotton et a1. and E1111 et 31 under 35 U. S C. § 103(3) ................................... 47
`I.
`Proposed Rejection 10: Claims 1 to 41 are unpatentable as obvious in View of the
`combination of Courtney ‘584 and E1111 et a1. under 35 USC. § 103(a) ................................. 55
`VIII. EXPLANATION OF PERTINENCY AND MANNER OE APPLYING CITED PRIOR
`
`ART TO EVERY CLAIM FOR WHICH REEXAMINATION IS REQUESTED UNDER 37
`CPR§ 1 510(b)(2) ........... ......................................................................................................................... 60
`
`IX COMMENTS ON PATENT OWNER’S AMENDMENT AND REPLY IN RELATED
`A. Comments On Patent Oivners Remarks ........j...............................-.....
`............................. 61
`1
`Courtney 755 ...................................................
`.....
`............ 62
`2.
`Shotton ..........................................................
`.................................................................. 68
`
`3.
`
`E1111 ............................................................
`
`.....
`
`......
`
`......
`
`71
`
`Courtney ‘584 in View of E1111 ....................................................................................... 75
`4
`B. Comments On New C1ain1s
`....... 76
`
`77
`“the plura1ity of attributes of the object includes at least one spatial attribute” ......
`l
`“the plura1ity of attributes of the obj eet includes at 10101 of the object” ....................... 78
`2,
`“the plurality of attributes of the object includes a size of the object” .................
`78
`3.
`“the plura1ity of attributes of the object includes at least one of a. velocity and a speed
`4.
`ot‘tbe object”....................... ..........
`.........
`78
`
`1
`
`Canon EX. 1013 Page 2 of 96
`
`Canon Ex. 1013 Page 2 of 96
`
`

`

`85
`
`“the plurality of attributes of the object includes a position of the object” .................. 79
`5.
`“the plurality of attributes of the object includes a trajectory of the object” ................ 8t)
`6,
`“the plurality of attributes of the object includes a classification of the obj ect” .......... 8i)
`7.
`“the plurality of attributes of the object includes a shape of the object” ...................... 8l
`8.
`“each of the plurality of attributes is an observable characteristic of the object” ......... 8i
`9.
`“computer system is application specific hardware” ................................................ 8l
`it).
`“retrieving a new user rule that was previously specified”....................................... 82
`l l.
`“the plurality of detected attributes are independent of which event is identified”.. 82
`12,
`“plurality of detected attributes are selected from a group consisting of at least one
`iii.
`of a size, a shape, a color, a texture, a position, a velocity, and a speed of the detected
`object” 86
`id.
`“identifying the event of the object occurs in real time”
`l5.
`“storing detected attributes in a memory; wherein analyzing the detected attributes
`occurs after the detected attributes have been stored in the memory” 86
`l6.
`“selecting user rule comprises selecting subset of the plurality of attributes for
`analysis” ........................................................................................................................'........ 87
`l7,
`“plurality of attributes that are detected are defined in a device prior to a selection of
`a subset of the plurality of attributes” ................................................................................... 87
`l8.
`“no analysis is performed on at least some of the detected attributes to detect an
`event” 87
`l 9.
`“plurality of attributes include plural physical attributes; new user rule applied to a
`plural number of physical attributes” .................................................................................... 87
`2t).
`“plurality of attributes include plural temporal attributes; new user rule applied to a
`plural number of physical attributes” .................................................................................... 88
`2i.
`“storing detected attributes in memory; identifying event of the object by analyzing
`only a subset of the attributes stored in memory”................................................................. 88
`22.
`“video camera operable to obtain the video” ............................................................ 88
`23.
`“identifying first event in real time by analyzing, of the plurality of attributes, only a
`first selected subset of the plurality of attributes” ................................................................ 88
`24.
`“selecting new user rule comprises analyzing, of the plurality of attributes, only a
`selected subset of the plurality of attributes” ........................................................................ 89
`25.
`“memory is configured to store at least some of. the attributes for at least two
`months; identifying the event by analyzing only a selected subset of the plurality of
`89
`attributes including the attributes stored for at least two months” ...................................
`26.
`“identifying event without reprocessing video” .................................................-...... 88
`2‘7.
`“identifying event by analyzing at least two selected physical attributes of the
`plurality of attributes” ...........................................................................,....... ,
`............. 89
`28.
`“identify event by analyzing a selection of individual ones of the detected plural
`attnbutes’ 9t)
`29,
`“plural attributes detected are defined in video device independent of selection of the
`detected plural attrrbutcs’,,,,,,,,,-. .........V...........
`9t)
`3t}.
`“configured as video surveillancedeuce” 9%
`3i,
`“videosensors” 96
`32.
`New independent Claims ...................................
`.......... ........... 9i
`
`ii
`
`Canon EX. 1013 Page 3 of 96
`
`Canon Ex. 1013 Page 3 of 96
`
`

`

`14131111181 GE? ATTACHMENTS
`
`Attachment A: Copy of US. Patent No. 7,932,923, for which reexamination is requested
`
`Attachment B: Day et a1, “Object Oriented Conceptual Modeiing of Video Data,” Proceedings
`
`on the Eieventh internationai Conference on Data Engineering, iEEE, March
`
`1995, pp. 491408.
`
`(“1I)ay~1”)
`
`Attachment C: Day et a1., “Spatio—Temporai Modeling of Video Data for Gin—Line Object
`
`Griented Query Processing,” Proceedings of the internationai Conference on
`
`Muitimedia Computing and Systems, iEEE, May 1995, pp. 98—105.
`
`(“Day—11”)
`
`Attachment 1): United States Patent No. 5,969,755 to Courtney (“Courtney "155”)
`
`Attachment E: Shotton et at, “ij ect Tracking and Event Recognition in Bioiogicai
`
`Microscopy Videos,” Fifth internationai Conference on Pattern Recognition
`
`(1131311913110), September 209%. (“Shorten”)
`
`Attachment 1?: United States Patent No. 6,628,835 to Briii (“Briii”)
`
`Attachment C: European Patent Appiication No. E? t) 967 584 to Courtney (“Courtney ‘584”)
`
`Attachment 1-1: Claim Chart - Ciaims 1-41 are anticipated by Bay~1untier 35 U.S.C. § 1112(1))
`
`Attachment 1: Ciaim Chart — Ciaims 14 and 35 are ohvious in view of Day=i under 35 U.S.C. §
`
`193
`
`Attachment .5: Ciaim Chart -— Ciairns 1t), 19, 31 and 41 are obvious in View 0f Day~1 and Briii
`
`under 35 U.S.C. § 1113
`
`Attachment K: Ciaim Chart - Ciaims 11 and 32 are obvious in View of Day-1 and Day—11
`
`Attachment L: Ciaim Chart m Ciaims 1. to 7, 9 to 13, and, 15 to 28 are anticipated by Courtney
`
`‘755 under 35 USC. § 111203)
`
`Attachment M: Ciaim Chart — Ciaim 14 is obvious in view of Courtney ‘75 5 under 35 USC. §
`
`1113
`
`Attachment N: Ciaim Chart _ Ciairns 1 to 7, 9 to 13, and 15 to 28 are anticipated by Shotton
`
`under 35 USC. § 102(1))
`
`Attachment 0: Ciaim Chart — Ciairn 14 is obvious in view of Shotton under 35 U.S.C. § 1113
`
`Attachment 1’: Ciaim Chart Ciaims 8 and 29 to 41 are obvious in View of Shotton and Briii
`
`under 35 U.S.C. § 1113
`
`iii
`
`Canon EX. 1013 Page 4 of 96
`
`Canon Ex. 1013 Page 4 of 96
`
`

`

`Attachment Q: Claim Chart — Claims 1 to 41 am obvious in View 0f Ceufiney ‘584 and Brill
`
`under 35 USC. § 103
`
`iv
`
`Canon EX. 1013 Page 5 of 96
`
`Canon Ex. 1013 Page 5 of 96
`
`

`

`i. QLAEMS FGR 'WHECE REEXAMENATEON ES REQ‘UESTEB
`
`Reexamination is requested ot‘eiaims 1-41 ot‘US. Patent No. 7,932,923 (“the ‘923
`
`Patent”)
`
`Pursuant to 37 CFR, § i.510(h)(5), the attached Certificate of Service indicates that a
`
`copy of this Request, in its entirety, has been served on Patent Owner at the foiiowing address of
`
`the attorney of record for Patent Owner, in accordance: with 37 CPR. § i.33(e).
`
`RQTHWELL, FIGG, ERNST & MANBECK, RC,
`
`607 14th Street, NW
`SUITE 8%
`
`WASHEGTQN DC ZGGGS
`
`Aiso submitted herewith is the fee set forth in 37 GER. § 129(c)(1),
`
`n. core or 4923 rarest: rn'nsnasr re 3’? can, a Ti.5fitt(h)(4}
`
`A copy of the entire patent is attached to this Request as Attachment A, as required by 37
`
`CPR. § i.51t)(h)(4). Requester is not aware of any disciaimer, certificate of correction, or
`
`reexamination certificate issued with respect to the ‘923 Patent.
`
`iii. CERTEFECATEGN REGWENG 35 ELSE. § 315(c)(3) ANB 35 {153‘ § 325(c)(1)
`
`As required by 37 CPR. §i,5 it}(h)(6), Requester certifies that the statutory estoppei
`
`provisions of 35 U.S.C. 3 i5(e)(i) or 35 U,S,C, 325(c)( 1) do not prohibit the Requester from
`
`tiiing this ex parte reexamination request.
`
`EV. PRGCEEDENGS RELATEB T9 TEE ‘923 E’ATENT
`
`A request for inter partes reexamination of the ‘923 Patent was flied on February 29,
`
`2,912, naming Bosch Security Systems, inc, a subsidiary of Robert Bosch GMBH, as requester.
`
`On May 23, 2012, the Patent Office granted the request for inter partes reexamination. That
`
`interpartes reexamination proceeding was assigned reexamination Controi No. 95/601,914 (“the
`
`‘914 reexamination”).
`
`in the Order granting the interpartes reexamination, the Patent Office
`
`determined the foiiowing issues proposed in the request had a reasonable likelihood of prevaiiing
`
`(are):
`
`Canon EX. 1013 Page 6 of 96
`
`Canon Ex. 1013 Page 6 of 96
`
`

`

`issue (A): Whether there is an REP as to the proposed rejection of claims l—7, 943, and
`
`iii—28 as anticipated by Courtney—US (Courtney “755)
`issue (B): Whether there is an RLP as to the proposed rejection of claim id as obvious
`
`over CourtneynUS
`issue (D): Whether there is an RLP as to the proposed rejection of claims l—7, 9-13, and
`
`l5-28 as anticipated by Shotton
`issue (l3): Whether there is an RLP as to the proposed rejection of claim l4 as ohvious
`
`over Shotton
`
`issue (F): Whether there is an ELF as to the proposed rejection of claims 8 and 29-4l as
`
`obvious over Shotton and Brill
`issue (i): Whether there is an RLP as to the proposed rejection of claims 1441 as obvious
`
`over Cr.n:ii't‘ne§,r--El3 (Courtney ‘584) and Brill
`(May 23, EQlZ Oflice Action, Reexamination Control No. 95/0tll ,9l4, at pd.)
`On December 3, 2612, the Patent Owner tiled a “Fetition to Terminate Reexamination
`
`Proceeding Under 35 U.S.C, § 31763) and 37 CFR §§ L182, 1.907(h)” in the ‘9l4
`reexamination. As grounds for the petition, Patent Owner identified a “Stipulation and
`(Proposed) Order of Dismissal” submitted in Civil Action No, 3zl lcv2l7 (ED, Va), styled
`Objectl/ideo, Inc. in Robert Bosch GmbH, et‘ all According to the petition,
`The Order stated: (l) “The parties jointly request that this Court
`dismiss all claims asserted between them, with prejudice to the
`right to pursue any such claims in the future,” (2) “The parties
`firrther stipulate and request that the Court order that the Bosch
`Defendants, namely Rohert Bosch Omhli and Bosch Security
`Systems, lnc., have not sustained their burden of proving invalidity
`of any of the claims l—29 of US. Patent No. 6,976,683, any of the
`claims 1-37 ofU.S. Patent No. 6,696,945, any of the claims l—ZZ
`of US. Patent No, 7,868,912, any of claims l—éll of US, Patent
`No. 7,932,923, and any of the claims l—Ztl of US. Patent No.
`£63,324? and (3) “This Order is a final and non—appealable
`decision.”
`
`(December 3, 2012 Petition, Control No. 95;’t)ill,9l4, at pp. 2—3)
`
`1 The petition indicated that the action in the Eastern District of Virginia “had been stayed in its
`entirety pending the disposition of an lTC investigation (lslofii’i’l-TAJQS)?’ (Petition at p, 1.)
`
`IN)
`
`Canon EX. 1013 Page 7 of 96
`
`Canon Ex. 1013 Page 7 of 96
`
`

`

`The petition proceeded to allege that,
`
`{in November l3, ZillZ, the Ufa. District Court for the Eastern
`Bistrict of Virginia signed the Order containing the above—quoted
`language. Exhibit 6 at 3 (“TT E St) 0RDEREE.”),
`
`(December 3, ZGlZ Petition, Control No. 95/00l3l4, at p. 3)
`
`On February l3, 2913, the Patent Office issued a Eecision Granting Petition to Terminate
`
`Inter Petites Reexamination Proceeding.
`
`Frior to the tiling of the petition, ?atent aner filed an Amendment and Reply on August
`
`27, 2Gl2 in the ‘9l.4 reexamination, which had not been acted upon by the Examiner at the time
`
`the ‘9 l4 reexamination was terminated.
`
`V. THE ‘923 PATENT AND TTS TRGSE€UTEGN
`
`The following summary of the ‘923 Patent and its Prosecution is incorporated herein
`
`substantially as set forth in the ‘9l4 reexamination request.
`
`The ‘l l 6 application, was filed on September 29, 26%. As originally filed, the ‘ 1 l6
`
`application contained twenty—six claims, of which claims l, 22, 25, and 26 were the only
`
`independent claims. Application claims l, 22, 25, and 26 as filed are reproduced below:
`
`i. A computer-readable medium comprising software for a
`video surveillance system, comprising code segments for operating
`the video surveillance system. based on video primitives.
`
`22, A computerereadahle medium comprising software for
`a video surveillance system, comprising:
`
`code segments for accessing archived video primitives; and
`
`for extracting event occurrences
`code segments
`accessed archived video primitives.
`
`from
`
`25, A. method comprising the step of operating a video
`surveillance system based on video primitives.
`
`26. A method comprising the steps of:
`
`accessing archived video primitives; and
`
`extracting
`primitives.
`
`event
`
`occurrences
`
`from accessed
`
`video
`
`Canon EX. 1013 Page 8 of 96
`
`Canon Ex. 1013 Page 8 of 96
`
`

`

`According to the prosecution history of the ‘ l 16 application, the applicants held an
`“discussed new claims 27~7tl.”
`interview with the Examiner on Nevernber 24, 2&9 and
`{interview Summary mailed December 2, 2009, page 1.) On Dec
`tiled a “Preliminary Amendment and Interview Summary” cancelling original claims l to 26 and
`adding new claims 27 to 58, Of the newly added claims, claims 27, 36, 48, and 56 are
`independent claims. Claims 27, 36, 48, and 50 as presented and are reproduced below:
`
`ember 30, 2669, the applicants
`
`27. A method comprising:
`
`detecting an object in a video;
`detecting a plurality of attributes of the object by analyzing
`the video, each attribute representing a characteristic of the
`detected object;
`
`selecting a new user rule; and
`identifying an
`after detecting the plurality of attributes,
`event of the object that is not one of the detected attributes of the
`object. by applying the new user rule to the plurality of detected
`attributes;
`wherein the plurality of attributes that are detected are
`independent of which event is identified,
`
`36. A video device comprising:
`
`means for detecting an object in a video;
`means for detecting a plurality of attributes of the object by
`analyzing the video, each attribute representing a characteristic of
`the detected object;
`a memory storing the plurality of detected attributes; and
`means for identifying an event of the object that is not one
`of the detected attributes of the object by applying a selected new
`user ntle to the plurality of attributes stored in memory,
`wherein the means for identifying an event is capable of
`identifying the event independent of when the attributes are stored
`in memory.
`
`48. A method comprising:
`
`Canon EX. 1013 Page 9 of 96
`
`Canon Ex. 1013 Page 9 of 96
`
`

`

`e which detects an object upon
`providing a video devie
`detects plural attributes of the
`analyzing a video and which
`detected chiset upon analyzing the video; and
`then, selecting a. rule, whiten is not a rate used to (latent any
`individual. attribute, as a new user rule, the new user rule providing
`an. analysis eta coinhiiuitiongot" the attributes to detest an event that
`is; unions of the defeated attributes,
`wherein the attributes to he detected are independent of the
`event to he detected.
`
`computerwreadable storage medium
`5%. A non—transitory
`an executed by a computer system
`containing instructions that wh
`lement the following method
`cause said computer system to imp
`comprising:
`detecting an object in a video;
`detecting a plurality of attributes of the object by analyzing
`ting a characteristic of the
`the video, each attribute represen
`detected object;
`selecting a new user rule; and
`
`after detecting the plurality
`event of the object that is not one o
`object by applying the new user ru
`attributes;
`
`identifying an
`of attributes,
`f the detected attributes of the
`le to the plurality of detected
`
`attributes that are detected are
`wherein the plurality of
`independent of which event is identified.
`
`The “Preliminary
`
`Amendment and interview Summary” filed Eeeember 3t), 2609 also
`included a purported summary ofthe November 24, 2069 interview, reproduced below:
`The Applicant
`thanks Examiner Vo for his time during the
`personal interview of November 24, 2069. During the interview,
`the Applicant discussed draft claims iii-fill} presented for the
`Examinerls consideration to help enpedite allowance of the
`application. Applicant discussed distihguishlng features of the
`invention, and how those features were attempted to be capmred
`by the draft claim language,
`(Preliminary Amendment and interview
`30, 2069, page ill.)
`
`Summary filed December
`
`Canon EX. 1013 Page 10 of 96
`
`Canon Ex. 1013 Page 10 of 96
`
`

`

`Thereafter, the Examiner issued a first Qffice Action, mailed on June l7, Zillt), and
`
`rejected claims 27 to 58 under 35 USS. § 163m) as being unpatentahle over US. Patent No.
`
`7,553,635 (“hack et at”) in View of US. Patent No. 5,72l,454 (“Qian et at”). According to the
`
`prosecution history of the ‘ l id application, the applicants conducted a second interview with the
`
`Examiner on July 22, 2616, where the parties “ldliscussed Qian reference and claimed
`
`limitations” with respect to claims 27 and 45. (interview Summary mailed July 26, 2016, page
`
`i.)
`
`On {Ectoher l3, 261%, the applicants tiled an “Amendment and interview Summary”
`
`where independent claims 27, 36, and 59 were amended, dependent claims 35 and 58 were
`
`amended into independent form, and new claims 59 to ‘76 were added. The “Amendment and
`
`interview Summary” also included the cancellation of claims 23, 42, and 5t and the amendment
`
`of dependent claims 30, Si, 39, 53, and 54.
`
`independent claims 27, 35, 3:5, 48, 5t), and 59 as
`
`presented are reproduced helow:
`
`27. A method comprising:
`
`detecting an object in a Video;
`
`detecting a plurality of attributes of the ohjeet by analyzing
`the video, each attribute representing a characteristic of the
`detected object;
`
`selecting a new user role after detecting the plurality of
`mum; and
`
`after detecting the plurality of attributes and after selecting
`of the new user rule, identifying an event of the object that is not
`one of the detected attributes of the object by applying the new
`user rule to the plurality of detected attributes;
`
`wherein the plurality of attributes that are detected are
`independent of which event is identified, m
`
`wherein the step of identifying the event
`event without reprocessing the video.
`
`identities the
`
`35. A; the method of claim 27, further comprising:
`
`detecting first and second ohj ects in a Video;
`
`detecting a plurality of attributes of each of the detected
`first and second objects by analyzing the Video, each attribute
`representing a characteristic of the respective detected object;
`
`selecting a new user rule; and
`
`6
`
`Canon EX. 1013 Page 11 of 96
`
`Canon Ex. 1013 Page 11 of 96
`
`

`

`after detectin
`,
`identi
`or“ attributes
`iuralit
`
`
`event that is not one of the detected attributes of the first and
`
`the
`
`second objects by applying the new user rule to the piurality of
`detected attributes;
`
`wherein the plurality of attributes that are detected are
`independent of which event is identified.
`
`identifying an. event comprises
`wherein the step of
`identifying an event of the first object interacting with the second
`object by anaiyaing the detected attributes of the first and second
`objects, the event not being one of the detected attributes;
`
`36‘ A video device comprising:
`
`means for detecting an object in a video;
`
`means for detecting a plurality of attributes of the object by
`analyzing the video? each attribute representing a characteristic of
`the detected obj set;
`
`a memory storing the pluratity of detected attributes; and
`
`means for seiecting a new user rule, the means for selecting
`a new user 'ruie capable of selecting the new user rule after the
`glurality of detected attributes are stored in memory; and
`
`means for identifying an event of the object that is not one
`of the detected attributes of the object by applying a seiected new
`user rule to the plurality of attributes stored in memory,
`
`wherein the means for identifying an event is capable of
`identifying the event independent of when the attributes are stored
`in memory and is caable of identi without
`reprocessing the video.
`
`48‘ A method comprising:
`
`providing a video device which detects an object upon
`analyzing a video and which detects plural attributes of the
`detected object upon analyzing the video; and
`
`then, selecting a rule, which is not a rule used to detect any
`individual attributes as a new user rule, the new user rule providing
`an analysis of a combination of the attributes to detect an event that
`is not one of the detected attributes,
`
`wherein the attributes to be detected are independent of the
`event to be detected
`
`Canon EX. 1013 Page 12 of 96
`
`Canon Ex. 1013 Page 12 of 96
`
`

`

`St). A non~transitory computenreadable storage medium
`containing instructions that when executed by a computer system
`cause said computer system to implement the following method
`comprising:
`detecting an object in a video;
`detecting a plurality of attributes of the object by analyzing
`the video, each attribute representing a characteristic of the
`detected object;
`selecting a new user rule after detecting the plurality of
`attributes; and
`after detecting the plurality of attributes and after selecting
`the new user rule, identifying an event of the object that is not one
`of the detected attributes of the object by applying the new user
`rule to the plurality of detected attributes, t e event of the object
`enlistentundnnhnmwtnunmsduvnn
`wherein the plurality of attributes that are detected are
`independent of which event is identified.
`
`the norntransitery enriiptitere‘eedible enrage-
`ft
`Sit
`rnediuni ef~eletnileieteutwthemethmtennnemeetedmby—the
`he:tightenheyisteinsterthee-eeeeprisee alanine-lug ‘insn‘uctiensm
`
`detecting first and second objects in a video;
`detecting a plurality of attributes of each of the detected
`first and second objects by analyzing the video, each attribute
`representing a characteristic of the respective detected object;
`selecting a new user rule; and.
`thundering the strainer eatiteddhnten,idmszi:i:1f:.triru..san
`err—nines ALGil.emitted:.iihistlt‘wfitxljitfi, sinstunner“ .-1;ln-,fi taint
`
`enactmeumnennnlll.ltilligufléfintldtflttlhfi.will}: shredded
`detected attributes;
`entwiiltspluihnei nannies thinat{amstart in.
`inhusndsntntwith}; errantlentil-entitled,
`wherein the step of
`identifying an event comprises
`identifying an event of the first object interacting with the second
`object by analyzing the detected attributes of the first and second
`objectsfi the event not being one of the detected attributes:
`
`59. A video device comprising:
`
`8
`
`Canon EX. 1013 Page 13 of 96
`
`Canon Ex. 1013 Page 13 of 96
`
`

`

`means for detecting first and second objcats in a video;
`utes of the object by
`means for detecting a plurality of attrib
`analyzing the video, each attribute representing a characteristic of
`the respective detected object;
`a memory storing the plurality of detected attributes;
`f the first object interacting
`means for identifying an event o
`lected new user rule to the
`with the second object by applying a se
`the event not being one of
`plurality of attributes stored in memory,
`the detected attributes,
`wherein the means for identifying an event is capable of
`identifying the event independent of when the attributes are stored
`
`and
`
`in memory.
`
`Subsequently, the applicants filed an “Amendment and interview Summary” on Qctoher
`of the July 22, Zillil interview, reproduced below:
`l3, Edit} that included a. purported summary
`The Applicant
`thanks Examiner Vo for his time during the
`personal
`interview of July 22,2(lltl. During the interview,
`the
`Applicant discussed the Office Action, the applied references to
`Pack et al. and Qian et al. While no agreement was reached
`regarding the differences of the invention, the interview" was still.
`helpful to help focus the remaining issues with respect to the
`pending claims.
`(Amendment and Interview Summary tiled
`Qctober l3, Zilli), page l4.)
`
`According to the prosecution history ofthe ‘ l in application, the applicants conducted a
`ere “[tlhe applicants discussed the
`third interview with the Examiner on November l7, 26H), wh
`’ (interview Summary mailed November
`emental Amendment and
`
`23, Kill), page l.) On December
`
`interview Summary,” which
`
`independent claims?
`2, Edit), the applicants filed a “Suppl
`included a purported summary of the November l7, Zillil interv
`The Applicant
`thanks Examiner Vo thr his time during the
`personal interview of November iliflli} with. Patrick Muir. and
`Peter Venetianer. During the interview, the Examiner requested
`certain amendments to the claims for formal purposes. Claims 27,
`35, 36, 4i, 43, 48, 58, 59, 64~66 have been amended to address
`formal issues consistent with this discussion. in addition, 27, 36,
`48, and 5% have been amended to add further recitations regarding
`ted by Examiner Vo during the
`the recited attributes as sugges
`interview.
`(Supplemental Amendment and interview Sunm’iary,
`filed December 2, Edit), page l4.)
`
`iew, reproduced below:
`
`9
`
`Canon EX. 1013 Page 14 of 96
`
`Canon Ex. 1013 Page 14 of 96
`
`

`

`Amendrn
`
`ty at”
`
`35; 36; 48, 5t), 58, and 59 as set forth in the Suppiernentat
`Independent eiairns 27,
`d December 2; 2910 are reproduced
`ent and interview Summary, tile
`heiew:
`27. A method comprising:
`detecting an ohjeet in a video;
`e object by anaiyzing
`detecting a plurality of attributes of th
`the video, instituthnmuteniutstmtsnhuinuatheadmaster
`physienjm3.131%memugfigmrrtu attribute;
`each attribute
`representing a characteristic ofthe detected object;
`seieoting a new user ruie after detecting the pintaii
`attributes; and
`after detecting the piuraiity of attributes an
`at the new user ruie,
`identifying an event of the object that is
`detected attributes of the object by appiying the n
`the piuraiity of detected attributes;
`utes that are detected are
`wherein the piuraiity of attrib
`independent of which event is identified, and
`wherein, the step of identifying the event of the object
`identifies the event without reprocessing the video.
`
`d after seiecting
`
`net one of the
`ew user rule to
`
`35. A method comprising:
`detecting first and second objects in a video;
`detecting a pim‘airity oi“ zittrihutes of each of the detected
`first and second etzieets by analyzing the video, each attribute
`representing a characteristic {tithe respemive detected object;
`selecting a new user rule; and
`
`event that is not ene of the
`second objects by appi
`detected attributes;
`
`e piuraiity of attributes that are detected are
`wherein th
`independent of which event is identified,
`wherein the step (if identifying an event figmghleg
`comprises identityingen figgtunt efthe first titties:
`with the SEGt‘mti ehj'eet by ana‘iyaing thedetected attributes et‘the
`first and amend ohieets,
`the: tight event: net. being {me at“ the
`
`t interacting
`
`detected attributes.
`
`it}
`
`Canon EX. 1013 Page 15 of 96
`
`Canon Ex. 1013 Page 15 of 96
`
`

`

`36. A video device comprising:
`means for detecting an object in a video;
`means for detecting a plurality of attributes of the objact by
`analyzing the video, atmitawihnnneutubaninsistiinsnhnta
`shawlunilinsnaadnuamnouleahrfian each attribute
`teristic of the detected object;
`representing a charac
`plurality of detected attributes;
`a memory storing the
`
`means for selecting a new user allzifisfiiifieiiteaiiavifl=
`‘v
`u :I '.
`that the.
`tWWfiMWfiWMfiWWWfiWRM-flfle a
`guaranty oft-termed.attributes are stored in memory; and
`means for identifying an event of the object that is not: one»
`of. the detected attributes {tithe object by applying. a seleeteti new
`user rule to the plurality of attributes stored in nine-trinity, sessions
`the—Wishaei. I Z ‘i‘ ‘ uwieeeatwasagahleaaitm identifying the
`event multinational oi”When the attributes are stored in memory and
`is militant tin; identifying the event; without xeproeessing the
`
` -
`
`video.
`
`43. A method comprising:
`deo device which detects an object upon
`providing a vi
`analyzing a video and which detects plural attrihutes of the
`detected object upon analyzing the videog tinglggjgggigmnhgtg
`ti: itiaatwimniianbutt anti
`intuauisnbwtshiwanauuhttu
`then selecting a rule, which is not a rule used to detect any
`individual attribute? as a new user rule, the new user rule providing
`an analysis of a combination ofthe attributes to detect an event that
`is not one of the detected attributes,
`wherein the attributes to be detected are indepe
`event to be detected.
`
`ndent of the
`
`50. A non—transitory computer-readable storage medium
`containing instructions that when executed by a computer system
`cause said computer system to implement the following method
`comprising:
`detecting an object in a video;
`detecting a plurality of attributes of the object by