US007253732B2
`
`(12; United States Patent
`Osann, Jr.
`
`(10) Patent No.:
`
`(45) Date of Patent:
`
`US 7,253,732 B2
`Aug. 7, 2007
`
`?.duniel1 ................... .. 340.-‘.541
`8-"1996
`8.-"1997 Tapp
`348.-“I54
`12-"1998
`[less ........ ..
`340.-‘"541
`9-"1999 Katz et al.
`..
`348.-"163
`1091999 Baxter
`.. 340.-‘S65
`ll.-"2001
`'l'hon1as0n ..
`340.-‘"505
`7.12002 Wen
`3485153
`8.-"2002 Xin
`348.-'l55
`l.-‘"2003 Menard et a].
`455.-"569
`
`
`
`5.546.071 A "‘
`5.657.076 A "
`5.850.180 A *
`5.956.081 A 5‘
`5.966.074 A "
`6.317.039 131*
`6.424.371 1315‘
`6429.893 1-3] "
`2003.-"00|3503 AI "‘
`
`(54) HOME INTRUSION CONFRONTATION
`AVOIDANCE SYSTEM
`
`(751
`
`lnventor: Robert Osann, .lr.. [0494 Ann Arbor
`_’\ve.. Clupertino. (‘A (US) 15014
`
`( 5‘ J Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.(.'. 1540:) by 152 days.
`
`(21) App1.No.: 111006.263
`
`(22)
`
`Filed:
`
`Dec. 7, 2004
`
`(65)
`
`Prior Publication Data
`
`US 200510184867 Al
`
`Aug. 25. 2005
`
`Related U.S. Application Data
`
`(63)
`
`(Tontinuation-in-part ol‘ application No. 091949.551.
`filed on Sep. 10. 2001. now Pat. No. 6.993.417.
`
`(51)
`
`Int. Cl.
`G08B 13/00
`
`(52) U.S. (Tl.
`
`(200601)
`3401541; 3401539. 1 6‘, 34(l1‘539.25:
`3481143‘. 3481152: 3481153
`
`(58)
`
`(56)
`
`3-’l01'539.25.
`Field of Classification Search
`340153916. 539.18. 539.14. 541: 348.1143.
`348.1152. 153. 154. 155
`See application file for complete search history.
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`* cited by examiner
`
`Prirtrary E.\'rrrrrincr—Jeflery Hofsass
`A.vsr'.s'.*rrm 1'.'.\'ar:rfner
`lidny Lahbees
`
`(57)
`
`ABSTRACT
`
`A system is described that enables the user to deal with an
`intrusion into tl1eir home without having to personally
`confront the intruder. Given the night-time nature ol‘ many
`intruder events. :1 display and control unit is disclosed that
`is suitable for residing on a bedside table. typically in the
`Master Iiodmom. perfornling a remote viewing and control
`function. Various locations within the panicular home are
`represented by buttons such that the user can easily choose
`the location(s) to be viewed and can verify. among other
`things.
`the presence of an intruder. Motion detection is
`various rooms may be included and viewing can be
`enhanced by lights controlled lrom this unit. User interface
`features are included that are simple to operate when the user
`is ltaltlawake. Surveillance and control features may be
`combined with conunon bedside appliance functions includ-
`ing a clock-radio. a television. or a telephone.
`
`4.160.273 A *
`
`8.-‘"1979 Riley et al.
`
`340-"539.l6
`
`17 Claims, 35 Drawing Sheets
`
`Home/PC/Internet Connectivity
`
`Utility
`Company
`Power
`fuleter
`
`
`
`Standard
`or
`Smart
`
`Page 1 of51
`Page 1 of 51
`
`RPX Exhibit 1004
`
`RPX Exhibit 1004
`RPX v. MD Security
`
`RPX V. MD Security
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet] of 35
`
`US 7,253,732 B2
`
`.=Em:E.r
`
`imamhsm
`
`_nE:m.=sn_
`
`
`
`>.._>_..om::oo..mE3:=on=mEo_._
`
`§moE._u:._.0.3.
`
`tmEmm:_Eou:_
`
`
`.«_Em:u..p2.3
`
`.o>_uoo¢_o>_ouomBiom
`
`
`
`
`
`:=_uu..m
`
`._o::oo
`
`omcum
`
`.o>_uuom_
`
`.«_Em:m._.—
`
`HSana
`
`.u£2_am.._oz_\e26..
`E.__._s
`
`.£___:...
`
`acaqaoo
`
`._2son_
`
`.222
`
`Eaucsm
`
`._O
`
`taem
`
`Page 2 of51
`Page 2 of 51
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 2 of 35
`
`US 7,253,732 B2
`
`._m_son_
`
`
`
`
`
`2E_on_o<_>m_._2_;w
`
`
`
`r_9._.sm__m>>
`
`
`
`
`
`
`.,___h,..%as,__h...%2as,
`22.".._2_;m22.”.Eesm§_._sm__&s
`
`Nunsur-
`
`
`
`Eoo._mE_._om$m._so2mn_._8$m3co_.o_>_E250_9o2mn_
`
`
`
`
`
`
`
`
`
` 2mconamm._mEmoEssam._mEm0
`
`:3
`
`EBxmmaw
`
`m._3m._maEm._.
`
`E
`
`2
`
`«B
`
`3
`
`Page 3 of51
`Page 3 of 51
`
`
`
`
`
`.88wco_6_>_mS..m._maEm._.
`
`
`
`

`
`U.S. Patent
`
`uA
`
`0.5
`
`..,.._,
`
`7.002
`
`53fl03
`
`US 7,253,732 B2
`
`
`
`
`
`E_on_o<_>m_§_am
`
`
`
`mo_n_E....xm>m_._m_o
`
`
`
`
`
`.mH.w_n__._0u_:>w_._8_2.,w__m>>
`
`W3S2
`
`B
`
`3
`
`Page 4 of51
`Page 4 of 51
`
`lllllllIIllllllDuulllnuDuIlll
`
`mo.:.m_,m
`
`
`
`_os2moBmcmw
`
`
`
`:o__.o_>.mS_m.mn_Em._.
`
`_D.=_.:OU
`
`_§_aoSom_u_>
`
`
`
`mcesmm._mEmo
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 4 of 35
`
`US 7,253,732 B2
`
`
`
`
`
`E_on_o<_>m_§_>>w
`
`
`
`o_n_Eaxm>a_am_n_Ema.§_.smmm_r__._m\y,_\,3w
`
`
`
`
`
`
`
`
`
`um»m_am_n_L_2mEm.mn_new
`
`IIE__§_aoS82>
`
`_O.=.:OO
`
`mcosam
`
`co:69:.3:3ea
`
`_._o§>w.8m._2m_oEEm
`
`Page 5 of51
`Page 5 of 51
`
`vu.=.m_.m
`
`
`
`._o..om.,mQ._om:mw
`
`
`
`co=o_>_m:3_w_maEm._.
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 5 of 35
`
`US 7,253,732 B2
`
`._m..son_.Qson_2E_on_
`
`
`o<_>m_m_omam8m_
`
`
`
`
`
`m.m_n___m>>.2m_n___m>>w_omamowm_
`
`
`
`
`
`ma..:m_.m
`
`CO_”—O_>_
`
`
`
`._OuO®“_.@DLnvmcGm._Ou00”_.®Quowcww
`
`0..._..z.m:_mQF_w.._.CO_uO_>_0...3m._maEo._.
`
`
`
`
`.22oom_om_m_oSn_wommu.>_mE_aoanu.>
`
`
`_2EmoonEwEmoEmrcmo
`
`w
`
`
` MIj_n_n:m.;._.n_
`I=Em:u._._.
`
`
`
`.§_.§.mBmcmw
`
`E250
`
`Page 6 of51
`Page 6 of 51
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 6 of 35
`
`US 7,253,732 B2
`
`Esau
`
`
`
`
`
`2E_on_o<_>m_o_omao8m_
`
`
`
`
`
`o§n___ssm_8.a8.a..m_2%.Es.....§on_
`
`_w:o_._.._O_2Eoo3on,aE_aom_omEmomm
`
`
`
`_O.__...._OO.
`
`mcotam
`
`
`
`
`._2om.,mn_xomw_.3.5:..Bo.2mn_xofi.Emcmw
`
`
`:o;os_v_._o>a,mz:o_..o_2vzofimz2a.EmaEm._..8$m
`
`_mS..Emn_Eo._..E
`
`
`
`
`
`Iq_.E_._m.._.sn_
`
`.._Em:2._.
`
`._o._Eoo
`
`.o>_ooom
`
`E950
`
`._om:mm.
`
`Page 7 of51
`Page 7 of 51
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 7 of 35
`
`US 7,253,732 B2
`
`
`
`>.._>_..om::oo..mEm..c=0n=mEo_._
`
`au_>..owMafia
`
`
`
`omcom
`
`.o>_ouou_
`
`.:Em:a._._.
`
`
`
`_nE:w.=sn_
`
`
`
`_...ousmwm
`
`m:_:_
`
`a___5
`
`mcaafioo
`
`.o3on_
`
`.222
`
`Emucfim
`
`.6
`
`:26
`
`Page 8 of51
`Page 8 of 51
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 3 of 35
`
`US 7,253,732 B2
`
`
`
`6o_mc$b_>_..omc:oomo:m___o>.5woo_u_>
`
`
`
`
`
`_I
`
`E
`
`,
`
`
`
`Eaves.uuE._..3:_X32>mo_u:<mu
`mmN\
`
`.30..
`
`On
`
`I.2=E.2__"_
`
`._u::._..:$__n_
`
`93+
`
`32>
`
`:o_mmm:.Eoo
`
`
`
`uout3:__m._m_o
`
`0_:UO5_
`
`.o>_uuom
`
`.._Em:w.F
`
`_._n_:mSr...
`
`._9_mu._m
`
`xom
`
`_:%.:sm
`
`.3
`
`:2.»
`
`Page 9 of51
`Page 9 of 51
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 9 of 35
`
`US 7,253,732 B2
`
`
`
`
`
`8=___e8_moEmmemu_._w._w_\__D5:5$_8zo<_>m_w_a_.._:_>_9a_>_fi2_cooOn.
`
`
`
`
`
`uumhfl
`
`E33...;
`
`omcmm
`
`.w>_3mm
`
`_:EmE_._._._.
`
`....§_2_am.=oz_
`.33.$..n_
`
`a2:5
`
`aoutoE_
`
`m_:uo_2
`
`.o>_muom_
`
`=Em:w._._.
`
`
`
`nSamflan..._Em:a._._.
`
`_a>_moam_
`
`.o>_moum
`
`=Em:w._._.
`
`
`
`.20.mm:.§$£m_
`
`Page 10 of 51
`Page 10 of 51
`
`
`
`
`
`
`

`
`U.S. Patent
`
`02
`
`flB
`
`US 7,253,732 B2
`
`
`
`QWCQW—..........Um_..__flWfl-.—M.F=.._Q0 ufigflo|
`
`
`
`_uuO._I.~_.=._m:E._..u___._auu¢.=Em:E.r.u>_ouom
`
`_.m_n.1.3..En.
`
`
`
`
`
`J3anwao:_._
`.9son_A02m:_Eou:_
`
`UflO.._Lmxaflm
`UNOJxom._0>>Ol
`33tufiwmc_Eooc_
`
`9.3
`
`
`
`
`
`xom__9_mm_m_tmEm.,
`
`_.,.EHE.ma.§._m_o0.._Em..E._.
`
`.m:_uuom..U501...§__mo._m=En:E._.
`
`
`
`
`
`
`azuuuxW3:3EotzodmcumEu.:_._o_uao._
`
`Page 11 of 51
`Page 11 of 51
`
`
`
`
`
`UflOI_amcum$0.330
`
`
`
`.—_Em:m._._..o>_ouoz
`
`3ouzuwm
`
`iwcamEatzo
`
`
`
`.~_Em_._E._..u>_ouum_
`
`1E.so
`
`two;
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 11 of 35
`
`Us 7,253,732 B2
`
`
`
`
`
`cam_p_%§m5Eozmmvxom._®v_mw._mtwEw
`
`
`
`mmmbtuewmc_Eou..__
`
`
`
`
`
`umumo_.__._._u3on_03mc_Eooc_2....
`
`
`
`
`
`.U0—._8WH—._O.—.=.—U'1
`
`HIIIIII
`-‘n:.'lIIIII
`
`
`
`J_Em:n...—..o>_ouom
`
`.a_.§.._
`
`.§..m_o
`
`two...
`
`
`
`EsauIlli.23..
`
`
`
`.23..
`
`
`
`..e_s..,_mlIIIi30..
`
`
`
`Page 12 of 51
`Page 12 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 12 of 35
`
`Us 7,253,732 B2
`
`two...
`
`two...
`
`two...
`
`
`
`xom__ov_mo._m__8m_u_._Ew:_w._mv_mm:m_tmEw
`
`
`
`
`
`"-
`
`
`
`éncom2._..2=.o5.3_9_u...:m
`
`
`
`
`
`u.a_o.=Em._E».us_uoom
`
`2o._=mE
`
`
`
`E.En=Eu:a..._..a>_ouom
`
`
`
`
`
`Eugen:._2:._o5...:.3_uo._m
`
`
`
`
`
` mcoszmwoos.mm_2o_ao2:...._9son_mm
`
`
`
`02.m:_Eou:_
`
`E34xom
`
`
`
`23..uaucsm
`
`
`
`.23...3_mo._m
`
`m_.__Eou:_
`
`U3
`
`._9$on_
`
`ac...
`
`
`
`
`
`Jason:__m_:_..o.53BxuofiL.
`
`
`
`2.En.=EmcE.—..w>_muo¢
`
`.23..
`
`Page 13 of 51
`Page 13 of 51
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 13 of 35
`
`US 7,253,732 B2
`
`
`
`
`
`_._o_.o_>__mco_EO:_9._=o
`
`
`
`._9om.~®n_Bmcmw
`
`2Rama
`
`_§_aoE:eoemm82>
`
`83%82%:_mm:.8>___mE__n:
`
`
`
`
`
`..e_oomo___._m_Em_._tmem
`
`mcogm//
`_o._Eoom.mEmom:_..w_xm_
`
`
`
`
`
`
`
`mocBm_n_§_=Em:a..._.co_Hm_ow_o__:m
`
`
`
`._o.=:oo
`
`
`
`.o>_ooom_mE._wr_._...
`
`a\.
`
`/
`_mEmu<
`
`Page 14 of 51
`Page 14 of 51
`
`\2.
`
`m._a.m._maEmF\mm
`
`
`
`
`
`

`
`U.S. Patent
`
`A
`
`m0
`
`-1.3MMw_.n..S
`
`US 7,253,732 B2
`
`.m§on_
`
`5:30__m>>
`
`2E8o<_>m_him$28
`
`wu§son_
`
`H,Qomflmomm
`
`32.3.
`
`
`
`Q_:w.m.son_seam
`
`m.3m..mn_E£.
`
`Page 15 of 51
`Page 15 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 15 of 35
`
`Us 7,253,732 B2
`
`
`
`
`
`A__o\$oE5a._>:8EooHoEoE=o&mEo:
`
`ooutfls
`
`2:322
`
`Ensmtsm
`
`
`
`_._Em:E._...__o.a3
`
`
`
`_u>_oummm.___._8_._
`
`._9.uo.._m
`
`xomm:_:_o2._
`
`II9.4
`
`o:_._.._oLuzon.xcanEoo
`
`uaucsm>25:
`
`
`
`
`$a_u_m_ooouta.:.__._2Eomo«sues...305.
`
`
`..§%_..3.82:.tmem__o.a8
`
`
`
`._E«:oo2:605.«..u»..wmw....um
`
`me.2.»dz\3mE_..n_
`
`\
`
`2ezua
`
`
`_._Em:E._.._3wmI.._3u>>
`tmfim
`
`
`_o>_3am\EumumLo
`
`
`
`ansm:5._3o_23o_u_
`
`
`
`macaw_._u._nu:m.m
`
`Page 16 of 51
`Page 16 of 51
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 16 of 35
`
`US 7,253,732 B2
`
`
`
`_92.._..o_8n_.m:_n_.._2__sw-m:o_:8o._o<s_m_
`
`
`
`
`
`E..\\\\\\\\\\.\\\.
`
`1\\\\\\\\\\\.\\\\N\\N\N\\\‘\.
`
`Eo.._.uE
`
`\x.\\\\\K\\\.\.
`
`Page 17 of 51
`Page 17 of 51
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 17 of 35
`
`Us 7,253,732 B2
`
`
`
`
`
`EEHa.x$§.x.§s.§.x.x.x..\...xEE\\...N$“EE“$3..
`
`wcmm
`
`wEo._n_ow:>9
`
`
`:_3o._wm:o_:..oo._o<s_m
`
`\\\.\\\\.\\\\N.
`
`Page 18 of 51
`Page 18 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 13 of 35
`
`US 7,253,732 B2
`
`
`
`
`
`....._=o._n_m._3m._mn_Eo._.mctsocwm:o_uaoo._o<_>_m_
`
`
`
`
`
`3o.:.w_.m
`
`Page 19 of 51
`Page 19 of 51
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 19 of 35
`
`US 7,253,732 B2
`
`
`
`:o_umo_:_..EEoo._._o§ozm_>_o._Eoob__muo._umma._a><.w.==Eon_Ew._.
`
`
`
`
`
`
`
`=:aE:o._>:m_350.
`
`mm
`
`Page 20 of 51
`Page 20 of 51
`
`

`
`
`
`7SmESQ__§>smcmw
`
`
`
`1,._m3on_m._:mo_omoo<
`
`U.S. Patent
`
`
`
`H0300:oo_O->>o_o
`
`8__son:_>>
`
`
`
`h....».«.Mufl.flfi«u...fi..M.?.w.
`
`S
`
`.mm
`
`53
`
`US 7,253,732 B2
`
`3628.
`
`938.0
`
`an2__wE
`
`Hsm
`
`Page 21 of 51
`Page 21 of 51
`
`
`

`
`U.S. Patent
`
`M
`
`.muw_.flS
`
`:1.3
`
`US 7,253,732 B2
`
`
`
`some:8o-;o_8_>>m$_o.__>>£5,o<_>m_
`
`
`
`
`
`
`m..m_SO:25
`
`
`
`
`mmm_m.__>>1,._m2_..on_Lomcwwmo04m._:mo_0
`
`8>5E_>>
`
`x:2&3
`
`82235.
`
`
`
`co_Hmo_c:EEoommm_m._>>
`
`Page 22 of 51
`Page 22 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 22 of 35
`
`US 7,253, 32 B2
`
`
`
`
`
`€m>oEmm$m_n_._w>ooV
`
`O<
`
`._9.son_
`
`
`
`m_oEawomm_3%:xom:o=oE:.
`
`
`
`
`
`E_on_o<_>m_co-%<\m_.E._on_
`
`«N9...m_.._
`
`Page 23 of 51
`Page 23 of 51
`
`
`
`

`
`U.S. Patent
`
`H.mBm
`
`US 7,253,732 B2
`
`
`
`E::o=8_.__E%_o<_>m_m_n_m:on_
`
`
`
`
`
`muo.:.m_.m
`
`Emofimx
`_aco_EoE
`
`1,R0...mcozamM_2EooR
`
`
`asHmmmwmm=§_.m.mw.
`o<E.m$_2_§
`
`
`
`Page 24 of 51
`Page 24 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 24 of 35
`
`Us 7,253,732 B2
`
`
`
`
`
`:o_..w_:mcm_._._.m_>co=_8_.__E%_o<_>m_
`
`mmm_w.__>>
`
`mcoommm
`
`
`
`m_omton_\/m
`
`»
`
`3..:_aF
`
`lllllllIn
`
`£.'kV:,\‘§\\\‘i‘&i'kVN
`
`Page 25 of 51
`Page 25 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 200?
`
`Sheet 25 of 35
`
`US 7,253,732 B2
`
`
`
`vzozzozo:_:o>>on_m:_m3o_ooz58.30o__u:<
`
`
`
`
`
`._m.son_
`
`O<.m=:O__m>>
`
`._Ea:a.F.u>_aoa¢
`
`
`
`s_..._%m.9son_
`
`maEma
`
`HIIIIIIII'I|II.'llII.I.|lI.|lI.__EzmummUR
`
`..a____._E<
`
`.._..=._o>:oo<6.R.
`
`_IIIIIIIIIIIIIIIIIIIIIIIIL
`
`an
`
`Page 26 of 51
`Page 26 of 51
`
`
`
`

`
`U.S. Patent
`
`m
`
`SU
`
`3
`
`2
`
`ml»eno.:.m_.m
`
`
`
`929.8233Mn,LomcwwEo2mE_m,
`
`
`
`
`
`Ema
`
`A3
`
`flnewomu_>EW....8>m_n_m_o
`
`Ma3mwEEm._.tm3on_E
`
`N
`
`co=o_>_
`
`.o..om..mn_
`
`Page 27 of 51
`Page 27 of 51
`
`»:
`
`
`
`o..w_n_Exam
`
`
`
`
`
`E_on_o<_>m_>m._%_oooU_>M.;B_>>w
`
`
`
`
`
`

`
`U.S. Patent
`
`A
`
`C_.nS
`
`...l
`
`US 7,253,732 B2
`
`xEm_>_
`
`
`
`79__Ee9m9_n_mE532_m__mmEE
`
`7.,S_eE8my_m:o_ao
`
`a._o.=:oo_.
`
`um_o>_ooom_,_Ewtzo
`
`gEmcmw
`
`Page 28 of 51
`Page 28 of 51
`
`Swcom
`
`mS..Emn_Em._.
`
`
`
`
`
`_@son_$m_n___m>>m_oEQmomm_
`
`o<
`
`
`
`xEm_>_UOEEm._mo._n_
`
`
`
`
`
`.6cmomm_>co_..mN__m__ow>_n_Emww<
`
`
`

`
`U.S. Patent
`
`A
`
`W
`
`g.mRm
`
`US 7,253,732 B2
`
`0.1
`
`§son_
`
`3
`
`an2:5
`
`
`
`__m>>a__%m_
`
`7”,\MaQ
`
`xomco=o::_..
`
`|
`
`:o_m:3xm
`
`
`
`
`
`xom:o=o:=_..w._oEmoow_u_>
`
`
`
`
`
`%_”2m_._..o_._Bxm_._ou_
`
`Page 29 of 51
`Page 29 of 51
`
`
`
`\.Hm_._.o__9xm_
`
`hm
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 29 of 35
`
`US 7,253,732 B2
`
`
`
`
`
`EmEmom_o;:_n__uo_mmo_._o0
`
`Egon.o<
`
`xomco_..oc:_..:mm._8$mmmwE_
`
`am_oE_n_
`
`__-----.———__....._---—-.-.’
`
`Page 30 of 51
`Page 30 of 51
`
`aneawa
`
`m..m_n_momn_
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 30 of 35
`
`Us 7,253,732 B2
`
`
`
`82>_omE:o_29m_n_;2_;m
`
`
`
`
`
`
`
`m:o=moo._
`
`
`
`
`
`o_mm_.m=m5508_®Cwn_>>®_>v__:O>”__._:o®wEoofiwm.Bmm_>_Eo.tBEo_>_
`
`
`
`
`
`newomu_>.o__>m_am_o:o_§c9.Eoo._m_o2E_v_o><I
`
`
`
`
`
`
`
`
`
`_o:mn__EEoo3m_Em._mwm_m.,m.wc__m>zmfiwI
`
`
`
`
`
`32m._n_§_am
`
`23EmaEm._.
`
`._omcmmc0522
`
`.3093
`
`m:o._q.%_.%..u%_mjEo.8mE_
`
`
`ma.o_U:<
`
`Page 31 of 51
`Page 31 of 51
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 31 of 35
`
`Us 7,253,732 B2
`
`
`
`ucmEo92c_o__u:<._o_mcozanmmm8<826x_m._..2..._m:m
`
`
`
`
`
`
`
`o_._o_._n_..6co9oEm_8__on_Emoo.:_..:omwEo2oE_
`
`
`
`
`
`S....._a_,,_
`
`
`
`
`
`a,,_._M_,__.o,__.,w.m,%..._N,__.,,_,_....,.n_m,__“.2Vm_n_m._.m_u_m_umm_
`
`
`
`
`
`2....2,,,_,_....wm__m,_._fl,.,.__M_,,,_.w“E926;o_>x_=o
`
`2:
`
`.3
`
`
`
`3>m_%_o82>
`
`_9_mn_Eu.
`
`pm
`
`Page 32 of 51
`Page 32 of 51
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 32 of 35
`
`Us 7,253,732 B2
`
`
`
`m_._o_._n_>o_._w9oEm
`
`
`
`ucmEn.EmE_o__u_._<8__&Eu8a_s8m
`
`anu.:.m_.m
`
`
`
`
`
`HO»mcozanmmooo<«D0.__n_
`
`mcouzmocowumEm_._
`
`
`
`
`§m_n_m_ucomcozzncom.8EBmo_u:_:o_.os_
`
`2:.39m_%__oco32».3
`
`Em..m>w3m_>x_:O
`
`m_o_m._.%_m8m
`
`.3
`
`
`
`.3>m_am_oomu_>
`
`
`
`_w_._mn_fi_u_
`
`Page 33 of 51
`Page 33 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 33 of 35
`
`Us 7,253,732 B2
`
`
`
`mcocm.6cm9mEm_
`
`mcocn_o..o_5_mmu.:_w_.m
`
`
`
`ucmEou._2c.oamx.2m_2Eoomcotsm“mm95...
`
`
`
`
`
`m.:o::mmeowuwEm_._
`
`
`
`
`9m_..._m_ucowcouancow._3m.2wo__o:_:o__.o_>_
`
`2::=9m_am_nco26%.3
`swim;m_>x_=o
`
`mas.%_%mm_
`
`newmza.Em._O>mam
`
`ma
`
`
`
`3>m_am_oomn._>
`
`_2_mn_5:
`
`Page 34 of 51
`Page 34 of 51
`
`
`
`

`
`U.S. Patent
`
`Aug. 7, 2007
`
`Sheet 34 of 35
`
`Us 7,253,732 B2
`
`
`
`oco_._n_\6_._m9m:..m_
`
`mcocn_Eu__>_vmu..=w_.m
`
`m.:2._:mo:oNumEu3
`
`
`
`
`§m_..._m__ucomcozancom.8m._2wo_u_.__co__os_
`
`2::2§m_n_.....__ucoBocm.3
`
`m_n_m._.%_%mm_
`
`
`
`_..._<3:.._...Ea_<
`
`2....mana.o=.u¢
`
`5
`
`
`
`wem_z:._.ucm40>
`
`
`
`
`
`newEou._Bc_o__umm.6»m_2E8
`
`\1%
`
`mcousmEmmE_._.
`
`
`
`3>m._nm_oomu_>
`
`_m:mn_EE
`
`Page 35 of 51
`Page 35 of 51
`
`
`

`
`U.S. Patent
`
`Aug. 7, 200?
`
`Sheet 35 of 35
`
`US 7,253,732 B2
`
`
`
`mecca..6_._m9mEm_
`
`
`
`newEoo.mE_m_o.E8m_8s_
`
`mcor_ao.o__2mmo.:.u_m
`
`mcozzmmeow839..
`
`
`§m_n_m_ucomconsacom.3m._2mo__S__cones.
`
`
`
`:2§§_a_,.._.:,,..__,_,..E.m..w>m>>m_>v__:O
`
`ozfl%_m_8m_
`
`2
`
`
`
`3>m._%_n_omu_>
`
`_mcmn_Eu.
`
`Page 36 of 51
`Page 36 of 51
`
`
`

`
`US 7,253,732 B2
`
`1
`HOME INTRUSION CON l1‘R()N'['A'fl()N
`AVOIDANCE SYSTEM
`
`CROSS REFERENCE TO RELATED
`Al-‘P[.ICATl()NS ANI) |){)CUMl'£N'l‘S
`
`This application is a Co11tinuation—In—Part of U.S. Utility
`patent application Ser. No. 09i'949_.551 filed Sep. 10. 2001
`11ow U.S. Pat. No. 6,993,417, and originally entitled “Energy
`Smart I [otne System”, commonly assigned with the present
`invention and incorporated herein by reference.
`This application is also based on Disclosure Document
`Ser. No. 533894 filed on Dec. 10, 2002 under the USPTO
`Disclosure Document Program, entitled “Video Security and
`Power Control System", incorporated by reference herein. A
`separate transmittal
`letter requesting that
`this Disclosure
`Document be retained has been filed with this application.
`
`10
`
`15
`
`l"II€l.[) OI‘ 'I‘IIl'l IN\-"liN'I‘I()N
`
`This invention generally relates to the field of electronic
`systems for homes and buildings,
`including systems for
`home networking, home energy and appliance controls, and
`home securityfsurveillance systems. with special emphasis
`on energy monitoring, feedback and profiling, and in par-
`ticular. the use of electrical junction boxes for purposes they
`do not normally perform. Although many of the features of
`this invention will be described in relation to a residential
`home environment, it is understood that they are generally
`applicable to many oflice and industrial building applica-
`tions as well.
`
`BACKGROUND
`
`Many products have been introduced over the last 25
`years for controlling electrical and electronic devices and
`appliances within homes and buildings. It is well known to
`use a variety of communications mediums to enable this
`control (power lines, phone lilies, and purpose built network
`connectivity such as cabled [Ethernet or wireless networks).
`More recently,
`it
`is known to extend this control
`to
`connection via the Intemet allowing a further degree of
`remote control and communication. In addition. surveillance
`capabilities have been added by using video cameras that
`can transmit
`images to monitors in other parts of the
`hometbuilding as well as supplying these images to remote
`locations via the I11ter11et. Also.
`there is discussion that
`future home and building appliances (washing machines.
`refrigerators, etc.) will cotuiect to the Internet such l.hat they
`can connnunicate over the Internet directly. Among other
`possible remote interactions, they can communicate their
`condition and signal the need for service before breakdowns
`occur, as well as enable diagnostics to be performed
`remotely via the Internet.
`The move toward home and building automation has not
`necessarily been prioritized according to how the general
`public accepts new things
`especially in light of the fact
`that old habits are hard to break regarding how one deals
`with power consuming devices in homes and buildings.
`While most people may not be ready to have their lights and
`appliances controlled automatically, there are other 1notiva-
`tions that may move them toward installing a homefbuilding
`monitoring and control system:
`Saving money given increasing energy costs
`Securityfsurveillancei'Remote Care
`The pervasive nature of home networking a11d Internet
`connectivity
`Expansion of home entertainment capabilities
`
`2
`
`Interaction of Mon.itoring)'l"'eedbacl\‘ with Automated and
`Manual Control
`
`The psychological element is extremely critical hi the
`adoption rate of any system involving monitoring andfor
`control. Letting a conlputer Control one’s hoinefbtlilding
`appliances that in the past were controlled manually.
`is a
`sensitive issue. A monitoring and feedback system is much
`less disturbing or threatening, but [or users who wish to add
`some amount ofautomatic control, there must he a carefully
`planned interaction between the two. It is not uncommon for
`sotne lights ir1 homes, and especially in oflice buildings, to
`be controlled by circuits containing motion detectors. Invari-
`ably. there are occurrences where the motion detector causes
`the lights to be shut ofl'at the wrong time. This can easily get
`annoying since. as is commonly known_. it takes a multitude
`of positive interactions to overcome the emotional effect of
`a single negative interaction.
`Altemately. let's say that there exists a local PC (Personal
`Computer) running software for home automation and con-
`trol. and a centrally controlled light switch that
`is pro-
`grammed to shut elf at
`l:(lO AM regardless of switch
`position to ensure that it is not left on all night accidentally.
`Now, let’s say the user has stayed up late and is in the
`room with this switch. At the programmed time. the auto-
`matic control system will shut ofl‘ the power at the switch.
`(It may signal the user some time prior to shutting otf by
`[lashing the lights). To prevent the switch in question from
`causing the user great aggravation, it must have the ability
`to override the auto shutofl‘event. Ifthe switch has a transmit
`
`30
`
`capability such as that described below for EMAC [I Energy
`Monitoring And Control) points. the user could. for instance.
`toggle the switch or push a mode button after the [lashing
`warning (or if the light has turned off already). and that
`action would be transmitted back to the central controlling
`PC to allow a revised scenario to occur. liven if the override
`
`can be perforlned locally without interaction with the central
`PC. it is useful to transmit back to the central PC that the
`
`event has happened to aid in avoiding similar user aggra-
`vation in the future. For instance, the central control system
`could “team” and. in this case, delay the auto shutolf of that
`particular light switch until l :00 AM or later. or switch to a
`motion detector—controlled mode after 1:00.
`
`40
`
`50
`
`The most common mechanism today for controlling lights
`is based on motion detectors incorporated into the control-
`ling switch assembly or alternately incorporated into the
`light socket assembly. These work fairly well
`in some
`circumstances—especially in spaces where people seldom
`go such as attics and closets. However,
`in primary living
`areas, they can often cause a negative interaction with the
`user. For instance, the inventor installed a light switch with
`motion detector at the entry to his living room. Ut1fortu-
`nately, the detector’s range does not cover the entire room,
`thus occasionally leaving the inventor ‘‘iii the dark". Were
`there a multitude of motion detectors scattered around this
`same room communicating through a data comm1mica-
`tions link such that the light control circuit was guided in a
`more informed manner (as described later in this inven-
`tion)—the inventor would be more positively illuminated.
`
`60
`
`Interaction of Monitoringr”Feedback with Audioflxfideo
`Functionality
`Although this invention deals primarily with energy use,
`monitoring, feedback. at1d control, the overall system i11 a
`given home or building may also deal with the distribution
`and control of multi—media information including audio and
`video. Over time. the connnunications link between the
`l-EMAC poi11ts of this invention and the cenl.ral controlling
`device (usually a PC or Residential Gateway). will h.ave
`Page 37 of 51
`Page 37 of 51
`
`

`
`US 7,253,732 B2
`
`3
`more and lnore bandwidth capability. such that this link also
`becomes the primary means for distributing digital n1ulti—
`media information throughout the home or building. Thus.
`there will be a coexistence, if not a functional link, between
`the elements ofthis invention focused on energy monitoring.
`feedback, and control, and elelnents focused on audiofvideo
`integration and control. This transmission of audiofvideo
`information can be for communications. security. or enter-
`tainment purposes.
`
`No Feedback on Energy Consumption
`At
`the time of this writing. energy costs have risen
`substantially a11d are likely to continue to do so. One of the
`first. a11d most important problems consumers are faced with
`is knowing exactly where. and how much power is being
`consumed in specific areasfappliances in their homes and
`buildings. Today’s home and building automation systems
`are lnuch more focused on controlli11g than on providing
`energy usage feedback. Meanwhile. the typical occupant
`may have little or no idea of where the energy is actually
`being consumed.
`
`Simplistic Control ofHeatir1g and Cooling Systems based on
`Limited Information
`
`'I‘uday‘s typical control system for heating and cooling.
`the traditional thermostat. does not take advantage of net-
`worked connectivity and the information gathering that it
`affords. thereby missing the opportunity to provide a much
`more comfortable and energy efficient t.her'rnal environ.1nent.
`liven today's “progranunable” themiostat observes only the
`temperature at it’ s own location. It is therefore very common
`for rooms or oflices not containing the thermostat to be
`overheated or overcooled. Such rooms or oflices waste
`
`energy if they are not occupied. or make the occupants
`uncomfortable if they are occttpied.
`
`10
`
`15
`
`30
`
`4
`
`centrally located in the holne (usually in a hallway near a
`primary entrance or in the kitchen), and sometimes includ-
`ir1g video surveillance capability. Unfortunately. these sys-
`tems don‘t help when the occupant is awakened in the
`middle of the night.
`liilher the alarm
`Most confrontations happen at night.
`goes off or the occupant is awakened by a noise. Either way.
`the occupant is in their bed in the master bedroom and is
`grugy and barely awake. liven the brightest persons don’t
`think clearly at moments like these. Absolute “push-button”
`simplicity is required to enable a quick and accurate decision
`to be made. If there is a suspected intruder. there should be
`a direct way to call 911 and also confirm the intrusion with
`the security service provider. It may be also desirable that an
`intercom is available to broadcast a message to the intruder
`that the police have been informed and that they should
`leave immediately.
`
`SU MMARY
`
`this invention
`the home system described hi
`Overall,
`relates to the energy distribution systems in a home or
`building. Much of the uniqueness in this invention deals
`with the combining ofdiverse ftmctionalities that heretofore
`have not been combined in similar ways. Although the
`digital communications networks or links described in this
`invention are typically based on communication by sending
`signals through existing electrical power wiring (hence the
`term “powerline con1munications”)_. not all embodiments are
`restricted to this tbnn of communications. However, when
`powerline communication is utilized herein. the result is a
`system that uses electrical wiring for energy distribution.
`monitoring, and control as well as security. audioilvideo
`communications and entertaimnent. and general network
`communications such as file transfers and Internet connec-
`
`Security Systems
`The Intemational Association of Chiefs of Police esti-
`mates that between 95% and 93% of all ho1ne—alar1n calls are
`
`tivity.
`linergy consumption in lnost homesfbuildings today is
`made up of both electrical power and some form of oilfgas
`based power. Some homes and buildings use electrical
`power only. This invention deals with both, although many
`of the features described can be optionally used in ditferent
`combinations as desired by the customer.
`A primary aspect of this invention is to provide a form of
`“biofeedback" for home and building energy consumption.
`By providing easy to understand information to consumers,
`they can adjust their usage of energy and still have normal
`control of their power-consulning devices
`over time tran-
`lnlruder Confrontation Avoidance
`sitioning to automated control as they desire. Also. some
`specific capabilities of this invention enhance the effective-
`Hundreds of innocent people are killed every year
`ness ofautomated energy controls.
`because they confronted an intruder in their home. The
`Iilectrical energy is
`typically consumed by devices
`occupant may have owned a gun—the intruder may have
`attached to electrical junction boxes. These junction boxes
`carried one
`-either way. the result was the same. i lundreds
`are typically proliferated throughout a home or building. As
`more are killed accidentally by friends and relatives because
`a result,
`they become not only convenient
`locations to
`they are assumed to be intruders. Most of these instances
`measure and display electrical power consumption—they
`could have been avoided if the “Security Quickfiew" tech-
`also provide at convenient means to proliferate temperature
`nology described herein had been available that was easy to
`sensors. motion detectors. at1d video cameras. The same
`use. given the occupant is probably it1 bed and only l1alf-
`awake.
`communications mechanism used for transmitting power-
`related data is typically used for these additional function-
`Conventional security systems don’t avoid confrontation.
`alities which aid in the enhancement of energy control (both
`When a conventional alarm is set off". the occupant needs to
`lhennal and electrical) while enhancing secttrity at the same
`decide whether the alann is false or not. if false. they 11eed
`time.
`to call
`their security service provider to prevent police
`This invention has the following primary goals regarding
`dispatch and possible false alann fees. The result is that they
`energy feedback:
`walk about the house checking for an intruder. So much for
`1) Provide “instant feedback” at the point ofusage.
`safety.
`2) Provide electrical energy usage profiling with multi-
`Some security systems have integrated t.l1e security con-
`trol panel
`into a “smart” home” control center.
`typically
`dimensional graphics on a centrally located PC. or
`Page 38 of 51
`Page 38 of 51
`
`false. costing police departments nationwide about $600
`million a year. If a Security Conlparty. or the Police. could
`remotely view the interior of the home or building where the
`alarm has jtlst been activated_. most of this money could be
`saved. Security companies ofier video surveillance, but the
`systems are complex and expensive and not easily adapted
`to existing homes without extensive additional wiring and
`adding provisions for mounting and powering the video
`cameras.
`
`40
`
`50
`
`60
`
`

`
`US 7,253,732 B2
`
`5
`lnclude both spatial ttsage and
`Residential Gateway.
`usage over time. Transfer related information via the
`Internet as necessary and desired.
`3) Provide thermal profiling on a centrally located PC _.
`Residential Gateway, or Smart Thermostat. U se multi-
`dimensional graphics as useful or appropriate. Include
`both spatial profiling and profiling over time.
`4) Provide more intelligent and eflicient thennal energy
`usage by combining a multi dimensional thermal pro-
`file with an enhanced and more intelligent (thermostat)
`control system for heating and cooling.
`Ailother object o f this invention is to allow easy retrofit of
`all components into existing homesfbuildings with minimal
`or no modification to the homefbuilding or special skills
`required on the part of the installer. This goal
`is greatly
`facilitated by attachment to and communications through
`existing electrical junction boxes.
`Another object of this invention is to provide integration
`of the energy feedback and profiling mechanisms with
`various known andfor new types of control mechanisms.
`A homefbuilding system according to this invention pro-
`vides a ttnique solution for energy profiling and feedback.
`while including network connectivity, energy control. sur-
`veillance. communications, and entertainment functionality
`as deemed necessary. useful, or desired. This invention
`essentially creates a “bio-feedback” mechanism for energy
`use, covering both electrical and thermal energy. through a
`system architecture that enables a more thorough and broad-
`based gathering of energy related information. This infor-
`mation is used by the occupant to allow manual control of
`power consumption in a more infonned and effective man-
`ner, and also to allow either partial or fully automatic control
`of energy consumption to be more effectively performed as
`well.
`
`10
`
`15
`
`30
`
`40
`
`6
`because the level of power consumption is high enough to
`cause a control capability to be too expensive or inappro-
`priate.
`Wall switches for controlling lights are also convenient
`and effective locations for mounting video security cameras.
`There is usually a wall switch at the entrance to a room and
`usually it has a relatively commanding view. The easy
`proliferation of video cameras throughout a home or build-
`ing, by way of installation at existing jluiction boxes, has
`considerable security benefit. In particular, such a system
`could allow a Security Company or even the Police to view
`inside and around the home or building in the case of an
`alarm being set off‘. so that a “false alarm" condition can be
`determined without having to visit the location.
`A variation on the system enables the user to deal with an
`intrttsion into their home without having to personally
`confront the intruder. Given the night—time nature of many
`intruder events. a Display and Control console is disclosed
`dial is suitable for residing on a bedside table, typically in
`the Master Bedroom. perfonning a remote viewing and
`control
`function. Wdeo cameras are placed around the
`ltouse, commonly residing at jtmction box locations as
`described above. Various locations within the particulat'
`home are represented by buttons such that the user can easily
`choose the location(s) to be viewed and can verify. among
`other things, the presence of an intruder. Motion detection in
`various rooms may be included (again. commonly installed
`at junction boxes) which may alternately control which
`rooms are viewed. and viewing ca11 be enhanced by lights
`controlled from the Display and Control unit. the power
`control circuits for these lights actually residing at
`the
`junction boxes that power the lights. Wireless or powerline
`comrnttrlications are used between junction boxes and the
`Display ai1d Control console. User interface features are
`included that are simple to operate when the user is l1alf—
`awake. Surveillance and control features may be combined
`with conmion bedside appliance functions including a clock-
`radio, a television. or a telephone.
`Wall switches are also convenient locations for incorpo-
`rating intercom functionality. Wall mounted power plug
`receptacles typically have a high degree of proliferation
`within any rootn as a result of convention and also building
`codes. Power plug receptacles are therefore especially useful
`for gathering temperature information since their prolifera-
`tion allows gathering a thorough profile of the temperature
`distribution within any room. Power plug receptacles are
`also very convenient locations to offer network connection
`jacks where any computer or network compatible device or
`appliance may be attached. They are also convenient loca-
`tions for adding motion detectors in order to provide a
`proliferation of detectors in order to enable thorough cov-
`erage of rooms not easily covered from a single vantage
`point.
`EMAC‘ points dealing specifically with electrical power
`consumption may als