PETITION FOR INTER PARTES REVIEW OF U.S. PATENT NO. 8,185,964
`
`Exacq Technologies, Inc.
`Exhibit 1001
`
`                        
`
`

`
`US008185964B2
`
`(12) Ulllted States Patent
`Marchese
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,185,964 B2
`*May 22, 2012
`
`(54) DIGITAL VIDEO SYSTEM USING
`NETWORKED CAMERAS
`
`(76)
`
`Inventor:
`
`Joseph Robert Marchese, Ray, MI (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`
`5,155,585 A
`5,311,306 A
`5,313,280 A
`5,512,974 A
`5,561,476 A
`5,625,410 A
`5,649,185 A *
`5,663,951 A
`
`10/1992 Ishikawa
`5/1994 Tanaka et al.
`5/1994 Straus
`l.
`4/1996 Ab
`t
`10/1996 Keresfiagl ef ale
`4/1997 Washino et al.
`7/1997 Antognini et al.
`9/ 1997 132111116615 61 31.
`
`.............. .. 726/2
`
`peitent is subject to a terminal dis-
`
`GB
`
`FOREIGN PATENT DOCUMENTS
`2329541
`3/1999
`
`(21) Appl. No.: 12/708,394
`
`(22)
`
`Filed:
`
`Feb- 18, 2010
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`(65)
`
`Prior Publication Data
`
`International Search Report for PCT/US01/08133, Jul. 26, 2001, 3
`
`US 2010/0212024 A1
`
`Aug. 19, 2010
`
`pages‘
`
`(60)
`
`(51)
`
`Related U.S. Application Data
`(63) Continuation of application No. 11/ 125,795, filed on
`May
`10,
`2005, now abandoned, which is
`a
`continuation of application No. 09/808,543, filed on
`Mar. 14, 2001, now Pat. No. 6,891,566.
`Provisional application NO. 60/189,1 62, filed on Mar.
`14 2000.
`’
`Int CL
`(2006.01)
`H04L 29/06
`(52) U.s.C1.
`....................................................... .. 726/29
`(58) Field of Classification Search ....................
`772266//2279,
`S
`1.
`.
`fif f
`1
`h h.
`ee app lcanon
`e or Comp ete Seam lstory‘
`References Cited
`U.S. PATENT DOCUMENTS
`4 513 318 A
`4/1985 Wilens
`et al.
`4:575:124 A
`3/1986 Morrfsgz
`4,628,342 A
`12/1986 Desmons et al.
`4,814,869 A
`3/1989 Oliver
`4,991,193 A
`2/1991 Cecil et al.
`
`(56)
`
`(Continued)
`
`Pnmary Emmmer i David Garcla Cervem
`(74) Attorney, Agent, or Firm — Brooks Kushman P.C.
`
`ABSTRACT
`(57)
`A digital video system including a computer connected via a
`network to a number of video servers and cameras. The coni-
`puter includes a program that provides a grid of display win-
`dows, each of which displaysfan image received from the
`earlrliera elllssocialted with that window.
`plrogram sequen-
`311351:gafggefig;jefgfgieglgvfgeevgsggglnfifafaglggg
`aeeeee the eamerae at different frame refee. Tphegeregram
`stores image streams in a single file, concatenating each suc-
`cessive image onto the end ofthe file. The file is then indexed
`using S01 and E01 markers to permit fast access to individual
`images within the file. The program can monitor received
`video and automatically start recording upon detecting
`motion within the video stream. Motion detection is imple-
`~
`~
`niented by comparing color component values for pixels from
`d1ff€1e111 1111ageS~
`
`4 Claims, 19 Drawing Sheets
`
`Client
`
`-
`Image Viewer "\ 52
` .ini file
`"\53
`T
`4o
`
`
`
`20
`
`54
`A M J
`r‘ V.
`E "'
`
`E
`
`—»
`
`
`Stream Recorder
`50»—\
`Client
`56
`
`_
`Dis In
`NeE:gfr,1[(Jel:x$:?ni:r)ver
`Chem C°mP“1°"
`-I
`Se
`TM, ,.,
`’_cm am am
`22
`44
`Cum Cum on.
`L,,T
`
`
`Networked Storage
`W __
`34
`Disk ..
`Disk --
`
`’"T"7-’
`
`"
`
`Axis Video Server
`30
`2400 or Other
`26 /'
`29
`
`r
`
`Ethernet Network 10/100 and
`Network Hubs LAN, WAN
`
`"
`Axis Video Server
`
`
`2400 or Other
`32
`=°°°°”\26
`
`Camem,AX15
`2lxx or other
`
`7
`24
`
`Standard B/W,Color
`Cameras
`
`E
`24
`
`24.,
`
`39
`
`Elhemet
`
`Camera, Axis
`
`Zlxx or other 71*‘
`
`38
`
` )
`
`Ethernet
`Camera, Axis
`2 lxx or other
`
`
`
`Standard B/W, Color
`Cameras
`
`24
`
`Exacq
`Ex. 1001
`
`Page 1
`
`Exacq
`Ex. 1001
`Page 1
`
`

`
`US 8,185,964 B2
`Page 2
`
`2004/0214559 A1
`§88§‘?8i2‘§3§§ iii
`2005/0200714 A1
`2005/0201273 A1
`2005/0231596 A1
`2005/0268141 A1
`2006/0059255 A1
`2006/0067304 A1
`2006/0106729 A1
`2006/0159032 A1
`2006/0279774 A1
`2007/0011450 A1
`2007/0124455 A1
`2007/0237141 A1
`2008/0189405 A1
`2009/0019141 A1
`
`1
`
`10/2004 Date et al.
`13/3882‘
`ifiiféiigii a al
`9/2005 Vlarchese
`9/2005 Shimizu
`10/2005 Vlarchese
`12/2005 Alben et al
`3/2006 VI0t0yama‘et 31
`3/2006 \/IcD0Wa11eta_1.
`5/2006 Roberts Jr
`1
`7/2006 Ukrainetz 61 al
`12/2006 \/Iatsuoka et 31.
`1/2007 VlcCreight et al
`5/2007 Vlotoyama et all
`10/2007 Vlarchese
`1
`8/2008 Zarenin et al
`1/2009 Bush 6, 31
`
`FOREIGN pATE1\T DOCUMENTS
`
`JP
`W0
`W0
`
`2004178565
`W098/34360
`W001/59405
`
`6/2004
`8/1998
`9/2001
`
`OTHER PUBLICATIONS
`Supplemental European International Search Report for EP 01 91
`6650 Feb.4 2009 lpage.
`Bisdiakian et aal «-0111 the Effectiveness Ofpriorities in Token Rin for
`Multimedia Traffic ” in Proc 18th Annual Conference Local Cgom-
`2
`.'
`P“1e1.Ne1‘.”°11‘S‘M1““e3P°118’M1‘1’Se? 1993/1313 2531'
`.
`A Brief Histo
`of the C Win Pro ect retrieved from http://c Win.
`.
`W
`Yg
`J
`‘
`Yg
`°°““1‘131°1Y‘1‘1’“1‘1‘1“‘14‘29?f1‘18P3‘»3:e3‘
`,,
`M31511311,K‘ M°K“51°1“ 3131‘ AF3S1F11° 8Y51°mf°1UN1X‘ ACM
`Transactions on Computer Systems, vol. 2, No. 3, Aug. 1984, pp.
`181'187‘
`,
`AR(4) Man Page, retrieved Sep. 2, 2003 from http://docs.sun.com/
`db/doc/801-6680-01/6111cic0ml?aflIieW, 4 pages.
`Tar(1) Man Page for Solaris 2.4, retrieved Sep. 2, 2003 from http://
`d0cs.sun.coIIfldb/doc/801-6680-01/6i11qc0m1?a:VieW, 8 pages.
`AR(1) Man Page, retrieved Sep. 2, 2003 from http://docs.sun.com/
`db/doc/801-6680-01/6111qc0m1?a:view, 3 pages.
`Beausoft Main Page Archive (Feb. 29, 2000), retrieved from http://
`Web.archive.org/web/2000229205711/http://beaus0ft.com/, 2 pages.
`-
`-
`as
`»
`
`.
`'
`’
`'
`’
`'
`JPEG Standard, ISO/IEC IS 10918-1 ITU-T Recommendation T.81,
`SeP‘1992a185P3‘éeS‘_
`_
`WebcamWatcher Online Help, WebcamWatcher Version 3.0, Copy-
`nght 2001 Beau Software, date unknown, 6 pages.
`Beausoft Webcam Watcher Description Page (Feb. 29, 2000),
`retrieved from http://web.archive.org/Web/2000620224026/WWW.
`webcam-watcher.com/wcwindex.html, 4 pages.
`
`* cited by examiner
`
`Exacq
`Ex. 1001
`
`Page 2
`
`~~~~~~~~~~ ~~ 717/178
`
`...... .. 370/352
`
`...... .. 370/352
`
`U.S. PATENT DOCUMENTS
`5,666,152 A
`9/1997 Stoker
`5‘724‘475 A
`3/1998 K3313“
`5‘745‘151 A
`4/1998 11°
`5751555 A
`5/1998 11011133“
`5785872 A
`7/1998 M1Y3Z31‘1 3131‘
`...... .. 370/401
`5,790,548 A *
`8/1998 Sistanizadeh et al.
`557905664 A *
`8/1998 C01ey et 3—1~
`~~~~~~~~~~~~~~~~~ ~~ 709/203
`5805801 A
`9/1998 H°11°W3Y 3131‘
`3861924 A
`1/1999 P3“ 3131‘
`5a903a762 A *
`5/1999 S3-k3-H1010 et 31~
`9001428 A
`12/1999 M313“m“13 3131‘
`9002995 A
`12/1999 81121113 3131‘
`6‘°14‘183 A
`1/2000 H°3“g
`9092978 A
`7/2000 A31°1f33°“
`6,101,182 A *
`8/2000 Sistanizadeh et al.
`6,115,035 A
`9/2000 Compton et al.
`6,175,622 B1
`1/2001 Chiniwala et al.
`6,178,419 B1
`1/2001 Legh-Sniith et al.
`6,233,428 B1
`5/2001 F1-yer
`6,269,309 B1
`7/2001 Buckingham
`6,396,533 B1
`5/2002 Hudson
`6,449,426 B1
`9/2002 Suga et al.
`6,452,925 B1 *
`9/2002 Sistanizadeh et al.
`6516340 B2
`2/2003 BOYS
`6,539,124 B2
`3/2003 Sethuraman et al.
`655745612 B1 *
`6/2003 B3-Tani et 31~
`~~~~~~~~~~~~~~~~~ ~~ 705/59
`6’583’813 B1
`6/2003 Enright et 31'
`6,591,022 B2
`7/2003 Dewald
`6 760 324 B1*
`7/2004 Scott etal.
`.................. .. 370/352
`’
`’
`6,763,023 B1
`7/2004 Gleeson et al.
`6,891,566 B2
`5/2005 Marchese
`6,895,511 B13‘
`5/2005 Borsato etal.
`6,928,656 B1 =x<
`8/2005 Addl-ngton
`7,136,838 131* 11/2006 Peinado etal.
`7,185,240 B2
`2/2007 Sal-to et 31.
`7,289,995 B2
`10/2007 Motoyama et 31.
`7,392,310 B2
`5/2003 Motoyama et 31,
`7,451,312 B2 * 11/2008 Medvinsky et al.
`7,478,152 B2
`1/2009 Holt et al.
`7,500,003 B2
`3/2009 Motoyama et a1.
`7,523,481 B2 *
`4/2009 Creamer 91 31~
`~~~~~~~~~~~~ ~~ 725/105
`7a596a749 B2
`9/2009 M°1°y31113 91 31‘
`7,610,380 B2
`10/2009 Igarashi et al.
`A1 at
`2001/0011253 A1*
`8/2001 Coley et al.
`2001/0033335 A1
`10/2001 Kubota et al.
`2002/0003575 A1*
`1/2002 Marchese ................... .. 348/231
`2003/0050718 A1
`3/2003 Tracy et 31.
`348/207.99
`2003/0197785 A1* 10/2003 White et al.
`. . . .. 713/201
`2004/0030926 A1*
`2/2004 Clark . . . . . . .
`2004/0078825 A1*
`4/2004 Murphy ................... .. 725/109
`2004/0128315 A1
`7/2004 Motoyama Gt 31.
`2004/0128365 A1
`7/2004 Motoyama et al.
`2004/0209617 A1
`10/2004 Hrastar
`
`.................. .. 726/5
`
`. 725/111
`............... .. 705/59
`
`........ .. 713/168
`
`................... .. 705/59
`
`
`
`Exacq
`Ex. 1001
`Page 2
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 1 of 19
`
`US 8,185,964 B2
`
`
`
`aofitfifi$mD
`
`QN|\\1E2
`
`._U
`
`
`mm Esfiegg8
`
`._E020
`
`_H__H__U
`
`mmEmE_..8
`
`Siam0:Lwov:o>3oZ
`
`c§_:E_§ue
`
`aa
`
`
`
`omfiofim_u8:o>:oZ
`
`
`
`
`
`2;.8CA:v:o>3oZ650:5
`
`mmDGGG"Esem
`
`Stow82>m_x<
`
`E58SE\ mm
`
`Z<>>..Z<1_3:3V2382
`
`@@R810.852m
`
`
`
`ms?‘55830
`
`
`
`5030055096525
`
`cm.5&0Soofi
`E>.5m82>£x<
`
`/kwmm.L\GGGG.©
`
`@
`
`
`
`Efiofimm_x<.SoEmO
`
`Hofiofim
`
`
`m...%m..mWm§uEwUwm.28S.28avm£553ww
`
`
`
`
`
`
`o_o_oU.>>\mEfiucfimm_x<5.5850..........SSOhoXK—N12200h>>\mEmwsfim
`
`Exacq
`Ex. 1001
`
`Page 3
`
`Exacq
`Ex. 1001
`Page 3
`
`
`
`
`
`
`

`
`U.S. Patent
`
`aM
`
`22:2Y
`
`1f02LI.6em
`
`
`
` U:.m>E~W829800amok:< Siamo3wm_Q
`
`
`
`1.}8SU
`
`2B469:
`
`
`
`%mmasosemismmce3,5
`
`9%:m§%._o
`
`was@8323
`
`E3932233
`
`$>.8m@335
`
`
`
`95:905:32
`
`Gma8%
`
`ouooEmommohucm
`
`
`
`oomucotmnumbmflmma
`
`32%S8BabSAEQEQ
`
`
`
`Sm.8230:52Hotfim
`
`ooEu.:BEx§
`
`
`
`
`
`U<2330980053%
`
`
`
`Efimobmaoqsmq
`
`atom§on<sumo
`
`
`
`E0808?8:8:was
`
`
`
`Ho.8.m<r3620Emb
`
`,o2mmmmQH.
`
`ESiammfim
`
`E33>
`
`
`
`.HO.«m.H®>.H®wHmoh
`
`383%
`
`mwfitomHow:&i<
`
`ozéo.0éficmu
`
`$>.5m\§oEmU
`
`EmE.595
`
`
`
`mofiwrwomnnfiwfl:5
`
`
`
`LambBsmmqov
`
`
`
`ENEEQoowtflfl
`
`
`
`mmfiomS0850gum
`
`
`
`Eooomo§8U\o§u:a>
`
`£332
`
`
`
`msotsmamnion
`
`
`
`mfiofimv30%.
`
`9%:o§N=§_£so
`
`Sfiwoicam
`
`NNE
`
`Exacq
`Ex. 1001
`
`Page 4
`
`Exacq
`Ex. 1001
`Page 4
`
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 3 of 19
`
`US 8,185,964 B2
`
`
`
`Egon:oEo_>_Beam
`
`8mm89
`
`
`
`_>>OfiET/>swim
`
`flifl
`9.%Qmooqogomogmcog3EDtfim
`
`
`
`wan:Eooum
`
`
`
`mouoouomS0302
`
`m.m.E
`
`mmfitom
`
`_m>.§.q_05$8895EEooom:<Eooom
`
`
`
`Efiofidmmofifm:4Eoooam
`
`~..uo:o§
`
`
`
`
`
`EsuosomV625%o3m=mEooom
`
`
`
`3miuumv§>ow:._>>
`
`
`
`
`
`FCOn—CO.50—\4BosmMDdum\
`
`52:30CSZ8xmefl
`
`
`
`
`
`clmmoomvuwfifizfimflfl
`
`mfimooqmfim
`
`omsmmEfiwoi
`
`3%
`
`..._uuE~Ubmb
`
`Exacq
`Ex. 1001
`
`Page 5
`
`
`
`
`
`uombdononfim3:0%£o_£QoSmrEoU
`
`
`
`
`
`
`
`wuiuouamsmmuenflmfismmce
`
`Exacq
`Ex. 1001
`Page 5
`
`
`
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 4 of 19
`
`US 8,185,964 B2
`
`Exacq
`Ex. 1001
`
`Page 6
`
`w M
`
`E
`
`oHmmmézasum
`
`oHEooumfimobm
`
`MDMHHsszeusfiéosm
`
`oHmusooom_m>.$Ed:mohm
`ownmoum_a.CB:_EEot<So::ooom
`
`
`mbmhnmqoummofiofimokoam
`
`3.5.552Houozéosm
`
`
`
`mbmeneBe:z:o.Eo£
`
`ea:.2macms:efio/mmggom/E5
`
`Efiwogm/OHommnfimfllfiofimo
`
`NHuco2>>2>Em9sm
`
`
`
`T2nE<833.2
`
`EDP/,”UH£mmommm_mowmE—Eooom
`
`8%uEooafiwam
`
`
`
`Hos.n_o>>o_B@momoaoumfin
`E2&oom:mEm:s&oD
`mmA<mH$oswomommSEOm:E
`
`
`NomonoéfinDiombzfizm
`wxéfifius_oooee%§mE
`
`
`
`mbmeHseomsouozaosm
`
`
`
`E282”>?tom2sam
`
`mamanm3m=§m2eém
`
`mbmhHwoumotmofiaqm
`
`amaoooooomans_oo2§%£E
`
`gongn.o6%eSn§§9mm
`
`qomowowooma.n§oo§ma2>
`
`HHofiooopomnocmmufiofimo
`
`nmoommoomav
`
`EofiomS250.
`
`avooflnmHHo_oUmomm:ou%OSoEmU
`
`2SHuommue
`
`owHnoise:
`
`
`
`ownE:oUE>O:mmxm§
`
`
`
`mbmrwn£o§o=o::Booom.$oam
`
`A<§mOZHesmaouea
`
`FNEEE:
`
`82T£B><§%5
`
`NH£B>>§aom
`
`owacflHEgan
`
`03%Hmtomo>uomqEEm
`
`vnmm8o<ImommEH
`
`NHE>>OQ|m®w§.DH
`
`
`
`mama“$ae%:_fiE.a§m
`
`
`
`Nmmusaauommaflam
`
`
`
`EA”3m5m:%§Wum
`
`Exacq
`Ex. 1001
`Page 6
`
`

`
`U.S. Patent
`
`M
`
`n
`
`fl.05
`
`U
`
`8
`
`2B469:5
`
`
`
` %UmmoqEopmzm
`
`M.9smE
`
`ao>E8<yI
`
`m:>>oQ=:m:52E52
`
`Mm3oZ3maoomMommflomBeam.SmmfifiomEm
`
`
`EfiomzmQQHDQmommfiwBum msseafiWvo>E8<
`2,ism95%
`
`mmitom:o§N:mEE
`
`Exacq
`Ex. 1001
`
`Page 7
`
`Exacq
`Ex. 1001
`Page 7
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 6 of 19
`
`US 8,185,964 B2
`
`
`
`sotsmgofiom>>O£m
`
`canE6&9SiamEg<
`
`BENZ
`
`
`
`Sofimv28950
`
`
`
`EfiomnowomanGvmfimrw
`
`E82
`
`>62Eu<momo_Uwomb
`
`ShowEfiom
`
`
`
`USN‘6>.5m320D
`
`
`
`mfiomS0850copfioommm
`
`8%
`
`8%
`
`N.bafimomgfimfl
`
`oz
`
`$5Hofiommfinma
`
`.35Ho33:0numb
`
`Eiom36:0
`
`£3;Stem\§%._Q
`
`uofiofimEmfloqmm
`
`Efiom
`
`m®>EuiomSofia
`
`oz
`
`3%E3%
`
`
`
`mnséHoiomo%
`
`Q.589
`
`
`
`
`
`mofisz$5830~9u._%_Q
`
`....m.§~
`
`NHDSNUNGOwomb
`
`
`
`20:3959S250bxaafl
`
`
`
`S250uowoofiomMom
`
`
`
`AmmioomvBarra.5EmUorr
`
`Exacq
`Ex. 1001
`
`Page 8
`
`Exacq
`Ex. 1001
`Page 8
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`2:
`
`«Wmqoficqoo
`
`
`
`“Mamasmmcemoumuoaofiwaomoumioaomhwno
`
`
`pomta.‘atomE950%.3®M—:55no:>>m.oE.mm8_u_umU<2
`
`maskm:Em.5>.5m
`
`
`
`mqumcomE013950baud35%:notkm
`
`
`
`
`
`ZOMUE>.Em3&5E>.Em3&5E>.EmwasdfimzE§EEaUEm.m.HoQ._.mUEmNHDQHNUEmE>.EmNHQQHMUEm
`
`2
`
`1OmKm._,_~
`
`EhS
`
`0
`
`
`
`Wmashn_:Em53:30
`
`
`
`Em_._mEEEmEm3:5>.=8_m3mEEmUEmEm80:30Emmis035%?
`
`
`
`EqoumoSmmmobunm3EEo..:<8$59503&5305Emma:EESEU.oSmZ
`
`
`
`
`
`
`
`:m:EmE_Boo8SmtomSE83m5mEnofimomEs“Nah53>om:mqoumomuoqHow3250mésmmé.:§5E:nHE398.oo~EE.EH99Emb
`
`
`
`
`
`
`
`
`
`
`Eass:SE83
`
`
`
`
`mqouoqfi%£2322mwE_Boo8@508U8:6:_.m>.Hofi.d38:68wasH8382NBAHowmzom
`
`2B
`
`5
`
`4OM,m.MNKN
`
`Exacq
`Ex. 1001
`
`Page 9
`
`Exacq
`Ex. 1001
`Page 9
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 8 of 19
`
`US 8,185,964 B2
`
`
`
`Emma>m2%_D
`
`90382
`
`8%
`
`
`
`
`
`smmce@36206mD
`
`
`
`$6850ZWWKSui
`
`.835Ema$5
`
`
`
`.,..oESn2ummufl
`
`
`
`>m6_m2Q@:o%:m
`
`
`
`mumswm.33
`
`.6mDE528SEEM
`
`oomfiozd
`
`>£%2D
`
`
`
`ou@_>e2o925:2mzfimfifl
`
`atomqo2o_>23&5
`
`
`
`856.23$25060
`
`
`
`@629223%233.@:mqo2§Eo22
`
`
`
`
`
`n_oo_b2%_Dtfim
`
`eoomsiéé
`
`Sofimu
`
`NE@362023.3
`
`~.m_O.5:OU
`
`
`
`oofismom6mD
`
`mo628::@582
`
`
`
`6m:>2@6262?momma:
`
`
`
`o(_OU®M—@3620.6mD
`
`m.mE
`
`
`
`_.C.m®.E@LUCSGQ
`
`
`
`26206@Soo.m
`
`
`
`20:32@36206mD
`
`oz
`
`Eofimubm
`
`mENEEQ9E332
`
`
`
`OOUT/.«OQENHQ
`
`
`
`MHDSMU:TF\d.mm—
`
`:o2_mon2@36206m
`
`mmaomoi
`
`Exacq
`Ex. 1001
`
`Page 10
`
`Exacq
`Ex. 1001
`Page 10
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 9 of 19
`
`US 8,185,964 B2
`
`
`
`.33.owns:25:m:_>.5o€Ho:m._u>E8m..:
`
`
`
`
`
`
`
`
`
`$_$2>uwwfifltfim
`
`
`
`mwfiqsiE.$£>E
`
`msoomEm
`
`
`
`
`
`H0305owmcfl22:54mu:no
`
`
`
`to:o§8UnoKQZxoufiownE._Qtwant
`
`its“onmoon
`
`
`
`dOCmoEQQ¢wuucfimi
`
`
`
`3:500.5...oflubfimflgum
`
`
`
`
`
`
`
`
`
`53%855::3BEmo.EoEowwz:gum
`
`3.m.§~
`
`.330055033we
`
`ofifimibmEgmfi
`
`
`
`a33580:2:38:52:mono:8Bmb
`
`ofifimwasmo.momsmm$55HowmO>
`
`.>>2>om\.oo:m>_u<
`
`:mi8m
`
`SfioeM(55.3
`
`maoubflum
`
`pom£3Eooom0:3niofiom
`
`
`
`3&5.m$>.8mmqfiehfi
`
`83%23>:mfirsmod.
`
`
`
`mfimobmwasmowmfiwo>E8<
`
`
`
`cmmv_o:UbmD
`
`
`
`noEmobmo>EoH<
`
`9:89¢mufifim
`
`
`
`oouhEofioécoi
`
`
`
` aouoflommi:Emommfia:msmog
`
`Exacq
`Ex. 1001
`
`Page 1 1
`
`Exacq
`Ex. 1001
`Page 11
`
`
`
`
`
`

`
`U.S. Patent
`
`M
`
`2
`
`210
`
`91
`
`00SU
`
`2B469,581.}
`
`
`
`WEgon::m:52.$.§o_>%_E:
`
`0:mmm
`
`282qoiaéoo
`
`mym:§5E3EL
`
`Masaas..&a8mM$5
`
`
`
`.04.bogootfi
`
`Exacq
`Ex. 1001
`
`Page 12
`
`Exacq
`Ex. 1001
`Page 12
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 11 of 19
`
`US 8,185,964 B2
`
`B32abflomSm:
`
`232floflomSmb
`
`
`
`:o$o2om::3Zaoflflon
`
`83$32am5.5
`
`SHOE
`
`
`
`:e_32om5:92mac:m3=<
`
`5?:590
`
`Egonwoman:
`
`SHOWE328SEEM
`
`9.Efiom
`
`atomE32
`
`
`
`qotfloflu:mE9:<aocofiflE3932
`
`
`
`
`
`
`
`xonflodmE9=<
`
`
`
`xonfl35:32
`
`
`
`12%oEF\BmQ82cm
`
`
`
`®QH.~H\®fi~Q82cm
`
`
`
`mfimxucEo..:<o_Eom
`
`
`
`
`
`22.::o.:b_oU$830
`
`Bo_oD8=<mfiom
`
`ESP
`
`
`
`
`
`WHSOOO«Q®>®.H®§.J.H.
`
`
`
`:o.:b_outogsupoo,
`
`2::
`
`
`
`GOEBQQcbofiom
`
`£2.m.E
`
`59:oE<mfiom
`
`.5851
`
`2580E95MOE
`
`
`
`xowa:Saofiom
`
`:3.m.§~
`
`Exacq
`Ex. 1001
`
`Page 13
`
`Exacq
`Ex. 1001
`Page 13
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 12 of 19
`
`US 8,185,964 B2
`
`03.2:5258m
`
`HODwasAMDso393Efiom
`
`AMDSQO9:EEopofifimm
`
`bbgoa
`
`uofiomSow3388owns:
`
`
`
`EmaE859mtom:._KOO
`
`Sumo:&_2:_BSmfifim9:?
`
`Eqofifioomm
`
`
`
`E039Eommcfim§%%KOO
`
`Samoa3womzmumfiMOO
`
`oqoE2:808E.2233
`
`
`
`£8.30mobe:<asmm332EMOOofi._uo>>2>E3888
`
`
`
`
`
`558.5flowEfiwoiOLE
`
`
`
`mo>mmmzmqoumowasbbmoa
`
`m::Boo8H8Efiofifimm
`
`
`
`
`
`80¢owns:93:3.KOO
`
`
`
`
`
`owns:2355.>>2uE>>
`
`2.m.E
`
`
`
`.>£%:uHQcom:Ebqoo
`
`
`30:?»3Boss?
`
`
`
`%.mEm=uE8§%%waswomwmmEobm
`
`$8
`
`Exacq
`Ex. 1001
`
`Page 14
`
`Exacq
`Ex. 1001
`Page 14
`
`
`

`
`U.S. Patent
`
`a
`
`22:2y
`
`m
`
`HM3
`
`ooaS
`
`2B4%
`
`
`
`M%m§_Eooom
`
`oz
`
`
`
`Woccsomowns:Eooom
`
`aomO.bEoE_
`
`22%$0
`
`w_MD:oaO.bEoE_
`
`SowAMDmam:
`
`Bwaam$0aoaoaofiofl
`
`o:n=u8m8E8£
`
`035:3»80
`
`
`
`omhwmHSfiom9qouooqaov$58533.58Bow%$20U=u§Eomo_O$E8£UmmmSmowns:
`
`
`
`
`
`.1,0m93m3
`
`
`
`Umowfiflzfinwa
`
`Exacq
`Ex. 1001
`
`Page 15
`
`Exacq
`Ex. 1001
`Page 15
`
`

`
`U.S. Patent
`
`M
`
`0
`
`S
`
`2B4
`
`
`
`Laosusomowns:EooomW8%
`
`
`
`...om££Eooom
`
`ozucmzEU:omO..oE8:_
`
`AmD:omO.oEoEH
`
`89¢wfimbmain
`
`293$80QOQOHQEQQH
`
`
`
`
`
`ummcfiBUH89m.598tnozpomam?»ozmcmomaofioaflQSfiwoiSmobm
`
`
`
`
`
`
`9@3320uofiumH9.so:oo::oU
`
`aofiogswHowes
`
`
`
`
`
`
`32:3Hoxmm 6:EmEom2U.bEoEH%.QovimfiBumM593:2OmmmMomowns:35$Sqoumonmmm
`
`9O%m%awNNE
`
`1:%Q83ED
`
`Umo?
`
`.%§£3&5
`
`mo?
`
`Exacq
`Ex. 1001
`
`Page 16
`
`Exacq
`Ex. 1001
`Page 16
`
`
`
`

`
`U.S. Patent
`
`M
`
`1m
`
`H
`
`S
`
`2Bm
`
`
`
`H8%Wosusomowns:Qooom
`
`8%
`
`oZ
`
`
`
`.,,w,Emobmo
`
`20:3;£8:01%non:oflwmfiwomuofiuouflw
`
`mg:30
`
`BEBEH3206:EmEomo_U$E3EwmEv:mEEur.
`..mStow8qouoossoo
`
`mmOmmmSmowns:ombwm
`
`O1,93ME8mo?
`0.50.:3&5
`
`
`
`Umomfifl3&5
`
`Exacq
`Ex. 1001
`
`Page 17
`
`
`
`
`
`momfiflEooom293$BCqogoaofiofl
`
`ozusmmBO:omO.bEB£
`
`AMDSQOBEBE
`
`89¢AMDmain
`
`Exacq
`Ex. 1001
`Page 17
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 16 of 19
`
`US 8,185,964 B2
`
`
`
`oqusomomwfim.D.HOo®M—Scam
`
`
`
`
`
`3.mE
`
`
`
`oqoimofifioo_wCOd_.©.U.
`
`in335::8
`
`:8
`
`Eouaoflmo35$
`
`
`
`JmfiuomuQ.:H.E9.m%mEoSFEoou:oO
`
`
`
`oEE.\o§QMomEvtxfiE0588E35
`
`
`
`mmm.mmuEE;EE,u\.EE\bO§Emrcfim
`
`.§c.:om
`
`
`
`8%25¢53>ommqdOn:ofifiommsom
`
`dfifim89¢
`
`
`
`3>62ofioau£3E<ommognopo:50
`
`
`
`.oEw:.:m._xo:25
`
`:30.5385nasm5_2s&<:
`
`.o__.T_oozm8:3E<§._.a%__%om
`
`one58:?.=8E<o_E8c>>=30
`
`.33
`
`
`
`ea320.=moE<osgfimofiu:mU
`
`Exacq
`Ex. 1001
`
`Page 18
`
`Exacq
`Ex. 1001
`Page 18
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 17 of 19
`
`US 8,185,964 B2
`
`3.mE
`
`SuobmxmESPmam
`
`32:258qouooqqoo329
`
`
`
`29335905585B3450
`
`
`
`232:55859qouooqqoo
`
`qomO..oEBE
`
`EDEQOBEEE
`
`oiésmseefl
`
`
`
`moasqmzOwHowHoafiwbHomom
`
`
`
`
`
`vfl.=.EUommcflgum
`
`
`
`owns:Eooomoom
`
`2ma53
`
`
`
`8%%m9EQooom
`
`oz
`
`
`
`bbsms8u2uc8E<Md...EU
`
`
`
`fiqomowmcflB29800
`
`amasfim\smumum.aa_Egan
`
`Exacq
`Ex. 1001
`
`Page 19
`
`Exacq
`Ex. 1001
`Page 19
`
`
`
`
`
`

`
`U.S. Patent
`
`May 22, 2012
`
`Sheet 18 of 19
`
`US 8,185,964 B2
`
`§~.
`ME
`
`8%
`
`
`
`~._Sn.Q_oxE(BEm
`
`oz
`
`2+fimd
`
`
`
`Evanmam8Eobsmto>qoU
`
`6x538:8E08805
`
`Eoaomfiov
`
`
`
`Eoaomfiov288055
`
`_+Eficsoomamwe
`
`?§E-c=mE3%m<
`
`Exacq
`Ex. 1001
`
`Page 20
`
`35mom9van:55Eco
`
`
`
`«SQommmwaowm.E_omb
` oz
`
`3%
`
`
`
`oucogomom9ommdfiOmmzmou
`
`
`
`fimusmswam
`
`E8508owsfim0%>900
`
`
`
`heblmsmBbsm
`
`
`
`
`
`HBQDOUooqugflomEufiobfl
`
`
`
`
`
`aocoebflcotow/Htfim
`
`Exacq
`Ex. 1001
`Page 20
`
`
`
`
`
`

`
`U.S. Patent
`
`ym
`
`n
`
`91LI.6m
`
`9
`
`00SU
`
`2R.4
`
`N.98weSoisooHaoSSrmSimE0882:
`
`
`
`Em:AmoESmSim
`
`£5SmmfimSouomEm
`
`
`
`
`
`:3»mvSSmSmdmmdfiE856
`
`
`
`
`
`%..%~swam%5oE.oonopomomblmfimnew
`
`
`
`USoisoomoSSrm0SimEmoam
`
`1.,Soisoomom0Emom
`
`i£..5mAo8M\U
`
`S$32
`
`.982
`
`Exacq
`Ex. 1001
`
`Page 21
`
`oZ
`
`~..oAmoSSmSim
`
`
`
`BuoooioSoisoom.O.mo>Sm
`
`9mESE._C_EEm:
`
`
`
`mi500QHEOM
`
`Exacq
`Ex. 1001
`Page 21
`
`
`
`
`
`

`
`1
`DIGITAL VIDEO SYSTEM USING
`NETWORKED CAMERAS
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application is a continuation of U.S. application Ser.
`No. 11/125,795 filed May 10, 2005, now abandoned, which is
`a continuation of U.S. application Ser. No. 09/808,543, filed
`Mar. 14, 2001, now U.S. Pat. No. 6,891,566, which claims the
`benefit of Provisional Patent Application 60/189,162 filed
`Mar. 14, 2000. The entire disclosure of these applications are
`hereby incorporated by reference.
`
`TECHNICAL FIELD
`
`This invention relates to systems for accessing, recording,
`and displaying camera images from any of a number of
`remotely located cameras and, more particularly, to such
`systems that provide access to images from one or more
`remote cameras over a public or private computer network.
`
`BACKGROUND OF THE INVENTION
`
`With the continuing expansion and availability of public
`and private computer networks it is becoming increasingly
`common to use these networks for remote video and image
`surveillance. Historically, analog systems have been used for
`CCTV systems for purposes such as surveillance. They
`include an analog video camera, a video cable, and a monitor/
`TV and/or a VCR recording device. Multiple cameras can be
`hooked to multiple recording VCRs for complete coverage of
`one or more target areas. Specialized equipment known as a
`multiplexer or ‘MUX’ can be used to allow multiple cameras
`to be hooked to a single recording/view device. The multi-
`plexer takes all video feeds in a sequential fashion, recording
`from one camera at a time. This allows the quantity of cam-
`eras to share a single recording tape. Besides the limitations
`of a serial tape system, additional limitations are introduced
`when the sequencing rate of the multiplexer is too slow to
`allow sufficient video record/view speed of a given camera
`view. Multiplexers are typically expensive and have limited
`expandability without purchasing additional complete sys-
`tems. Also,
`the configuration of these systems usually
`requires a skilled technician to be available at the systems site
`which increases the total cost of implementing such systems.
`Digital systems have become more prevalent with the
`advent of standardized digital componentry. These systems
`utilize the same analog cameras and cabling, but introduce a
`capture card based collector. This collector can be a propri-
`etary digital device or a PC based computer, either of which
`has analog video inputs directly connected to it. These inputs
`convert the video to digital for viewing and recording and
`may even retransmit the signal to analog tape for recording
`purposes. A factor limiting these digital systems is that an
`autonomous computer is required relatively near the video
`sources, sometimes with user intervention required at regular
`intervals. These machines are also hardware bound. The num-
`
`ber of capture cards is limited to the specific design of the
`collecting equipment. These systems are usually proprietary
`to a particular manufacturer and can be very expensive.
`Remote viewing is usually not available. Failover or redun-
`dancy function is also limited and expensive, due to the fact
`that the system is usually duplicated for redundancy. As with
`the analog systems discussed above, these systems also have
`configuration requirements that typically require a skilled
`technician.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 8,185,964 B2
`
`2
`
`There now exists commercially available networkable
`cameras that can be accessed over networks running TCP/IP,
`including both LANs and global networks such as the Inter-
`net. Ethernet-based digital video servers are now common
`that are small, autonomous, and usually contain a web-based
`configuration utility, as well as administration software.
`These cameras can be accessed and, in the case of pan/tilt/
`zoom (PTZ) cameras, controlled over the network using an
`assigned IP address and standard CGI-based URL syntax or
`other manufacturer-specified addressing protocols. This
`allows an authorized user to control the product from any-
`where via the Internet or a dialup connection, and allows live
`images and image streams (video) to be accessed remotely
`using standard web browsers.
`The video servers exist in two forms. One is a camera
`
`server that is a complete product containing both a camera
`and a web server with an Ethernet port. The other is a com-
`ponent based video server with inputs for one or more analog
`video feeds, which the user can connect to conventional cam-
`era PAL or NTSC video feeds. The inputted analog video
`feeds are converted to digital signals and sent from the video
`servers’ Ethernet port. Thus, the video servers (whether inte-
`grated in as part ofa camera server or as a standalone unit) can
`be connected to the Ethemet-based networks commonly used
`in businesses and other computer enabled sites. These video
`servers can be connected to these network segments and are
`fully compatible with existing data on these networks. The
`video data can be received by standard PC computers which
`require no special hardware other than an Ethernet connec-
`tion. The cameras can be easily configured by a novice user
`who has very basic experience with the Internet.
`Ethernet video servers connect to an Ethernet connection
`
`and deliver digital video based on user requests or internal
`scripting agents. A user requests video images via standard
`CGI enhanced URL syntaxes. These syntaxes control the
`image metrics and other features of the requested video
`stream. The images are sent to the user as either static JPG
`snapshots, or as continuous JPG streams. Rates to 30 FPS are
`easily attainable. Since these images are delivered by Ether-
`net, the camera servers are very robust. Although a requested
`image may not be received completely in an expected time
`frame, the video server will wait for the user to complete its
`requests and processing. This virtually guarantees delivery of
`video, except where a connection to the video server is ter-
`minated.
`
`When the user requests a video image or stream, the user is
`actually requesting a static image that appears to exist as a file
`in a directory structure on the video server. When the user
`requests a copy of this image,
`the video server actually
`updates it with a new image from the camera source, and the
`user receives a picture that is up to date. Subsequent requests
`are to the identical file name, and the server do es the updating
`of its content.
`
`Although IP-based network cameras and camera servers
`have now evolved to a relatively advanced state, the use of a
`browser-based interface to this hardware has seemingly
`impeded development of user interfaces that provide simpli-
`fied, automated control over the acquisition of snapshot and
`streaming images over the network. Access to the camera
`images typically requires knowledge of the manufacturer’s
`CGI-based syntax to access snapshot or streaming images.
`For example, to access a particular camera, the user may have
`to specify to the browser an address in the form of http//Uid:
`PW@111.111.111.111/cgi-bin/
`fullsize.jpg?camera:1&compression:1. While this may be
`handled easily enough for a single camera by bookmarking or
`pulling the URL out of the browser’s history buffer, the task
`
`Exacq
`Ex. 1001
`
`Page 22
`
`Exacq
`Ex. 1001
`Page 22
`
`

`
`US 8,185,964 B2
`
`3
`becomes more difficult when the user desires to change the
`access parameters or where different cameras need to be
`accessed. Where the identified camera cannot be accessed,
`such as for example due to an improper address being speci-
`fied, the user may simply receive a standard “404 not found”
`error mes sage that is not helpful in diagnosing either the error
`or actual reason why access was not available.
`Moreover, browser-based access is typically limited to
`either a snapshot mode or streaming images. In the snapshot
`mode, a single image is returned when the appropriate URL is
`entered into the browser. Subsequent images from the camera
`are then accessed using the browser’s “reload” or “refresh”
`button. In the streaming mode, once the appropriate URL is
`specified, the remote server or camera simply begins stream-
`ing image files back to the browser. This results in relatively
`high network utilization that may be undesirable in a shared
`network environment.
`
`It is therefore a general object of this invention to provide
`an improved user interface and approach to the network trans-
`mission of images from commercially available network
`cameras.
`
`SUMMARY OF THE INVENTION
`
`In accordance with the invention, there is provided a digital
`video system which includes a client computer, one or more
`video servers accessible by the client computer over a net-
`work, and a plurality of cameras connected to the video serv-
`ers. The one or more video servers provide an interface
`between the cameras and client computer, with images from
`the cameras being accessed by the video servers and then sent
`to the client computer upon request by the client computer.
`The client computer provides a user interface display on the
`computer that includes a display window for each of the
`cameras accessed over the network and that displays in each
`of the display windows an image received from the camera
`associated with that display window.
`In accordance with another aspect of the invention, there is
`provided a computer readable medium for use by the client
`computer in providing the user interface display. The com-
`puter readable medium includes a digital storage device and a
`user interface program stored on the digital storage device in
`computer readable form. The program is operable upon
`execution by the computer to access camera data uniquely
`identifying the cameras and to attempt access to the cameras
`over the network using the camera data. The program is
`further operable to verify access to those ones of the cameras
`that are accessible over the network and to generate the user
`interface display and to display in each of the display win-
`dows an image received from the camera associated with that
`display window.
`In accordance with another aspect of the invention, there is
`provided a computer readable medium and method for use by
`a computer in detecting motion in a sequence of color video
`images received by the computer. The computer readable
`medium includes a digital storage device containing a pro-
`gram that is operable to carry out the motion detection. The
`program selects one of the video images as a reference image
`and another of the video images as a selected image to be
`compared to the reference image. The program then accesses
`a color component value for each of a number of pixels from
`the reference image and for each of a number of correspond-
`ing pixels from the selected image, with the program being
`operable to perform pixel comparisons using the color com-
`ponent values and to generate a motion detect signal when the
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`difference in color component values for corresponding pix-
`els from the reference and selected images differ by more than
`a preselected amount.
`In accordance with yet another aspect of the invention,
`there is provided a computer readable medium and method
`for use by a computer in recording a sequence of images, each
`of which comprises an individual image file in which the
`image is represented in a graphics file format that includes a
`first marker identifying the start of the image and a second
`marker identifying the end of the image. The computer read-
`able medium includes a digital storage device containing a
`program that is operable to carry out the recording. The pro-
`gram stores the images together as a single file that comprises
`the group of images concatenated together in sequential
`order. The program is operable to index the file using the first
`and second markers. This index can then be used to provide
`quick access to individual images stored within the single file.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`Preferred exemplary embodiments of the invention will
`hereinafter be described in conjunction with the appended
`drawings, wherein like designations denote like elements,
`and wherein:
`
`FIG. 1 is a block diagram showing a preferred embodiment
`of a digital video system of the present invention;
`FIGS. 2 and 3 together depict the process flow of the user
`interface client application of FIG. 1;
`FIG. 4 shows the contents of the initialization file used by
`the user interface client application of FIG. 1;
`FIG. 5 is a diagram depicting the main menu structure of
`the user interface client application;
`FIG. 6 is a flow chart showing the process used by the user
`interface client to provide hardware setup information;
`FIG. 7 is a diagram depicting the server setup form dis-
`played by the user interface client;
`FIG. 8 is a diagram depicting the camera setup form dis-
`played by the user interface client;
`FIG. 9 is a flow chart showing the process used to display
`a motion form that allows the user to display and record video
`streams from one of the cameras;
`FIG. 10 is a flow chart showing the process flow for the
`image viewer program of FIG. 1;
`FIG. 11 is a diagram depicting the menu structure of the
`image viewer program;
`FIG. 12a is a flow chart of the autoindexing setup process
`used by the image viewer program;
`FIG. 12b is a flow chart of the archive delete process used
`by the image viewer program;
`FIG. 13 is an overview of an OCX control used by the user
`interface client and stream recorder client applications of
`FIG. 1;
`FIG. 14a is a flow chart of a portion ofthe OCX control that
`is used to access individual snapshot images from the cameras
`used in the digital video system of FIG. 1;
`FIG. 14b is a flow chart of a portion ofthe OCX control that
`is used to intermittently access images from a streaming
`image server;
`FIG. 14c is a flow chart of a portion ofthe OCX control that
`is used to access full video streams from a streaming image
`server;
`FIG. 15 is a flow chart of a portion of the OCX control that
`is used in the processing and recording of received images
`and image streams;
`FIG. 16 is a flow chart showing the process flow for the
`stream recorder client application of FIG. 1; and
`
`Exacq
`Ex. 1001
`
`Page 23
`
`Exacq
`Ex. 1001
`Page 23
`
`

`
`US 8,185,964 B2
`
`5
`FIGS. 17a and 17b together depict the motion detection
`routine used by the user interface client application of FIG. 1.
`
`DETAILED DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`Referring to FIG. 1, there is shown a network setup of a
`digital video system 20 of the present invention. The video
`system 20 includes a client computer 22, a plurality of cam-
`eras 24, and one or more standalone video servers 26. The
`client computer is connected to the cameras 24 and video
`servers 26 via a network 28 which can include a private
`network segment 30 and a public network such as the Internet
`32. Other networked components can be used such as a net-
`worked storage device 34 and a networked file server 36.
`Some of the cameras 24 comprise camera servers 38 which
`include both a video server and camera in a single integrated
`unit. The camera servers 38 can be, for e