Page 1 of 30
`
`RPX Exhibit 1002
`RPX v. MD Security
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 1 of 18
`
`US 2005/0267605 Al
`
`SN
`
`wu___5u
`
`.222,..ISam2.o....2__o_._n_
`
`cananHE-
`
`rm..5...
`
`HN0.Il.unm¢
`
`u..mUu__:u8mmm
`
`
`
`au2__m___u?_:_woucm__n_.._u_mmEw_._._mu
`
`
`
`rnem"mummm_2__a.Em
`
`__m._fin$u_u._o_..,__..m.m._u_3u_§§upus.u$_2§uh
`
`
`
`.N_OhcnU
`
`
`
`$22_2_E¢uuiau
`
`u_..___.2.5n_
`
`ownac___a.som
`
`
`
`323..u
`
`Ru
`
`.nIV0:e...mcan9.“mma.m_mE8
`canIau___.au._€Eu_n_um
`umI.$__mmnm
`
`Exmunmon
`
`3_._.u_..._
`
`ofimtoon3n
`
`
`
`manan
`
`2u_.,-2u3_.
`
`Eou._2..__
`
`
`
`outfitm____.N
`
`
`
`U2.ownavianRnEn
`
`
`
`__u._.EouExammm_25>
`
`I
`
`
`
`._......:_......1.
`
`can
`
`ouzou
`
`
`
`:o=mu__.=_EEoum$_u_E~nfiW_.
`
`$o_n..ou
`
`mcaza
`
`B
`
`
`
`“N-WUW_0E..>mafi
`
`.\.EuEmu
`
`Page 2 of 30
`Page 2 of 30
`
`
`
`...__._DK«E.
`
`
`
`
`

`
`
`
`
`
`__...I__.__O_u.mu_E1_F___._co00::mmco_.mu_...SEEao.u.son_ac:._u_>>O.L
`
`
`
`
`
`SFmaoosmomt3_..__
`
`
`
`ESBbcoo:_m_2
`
`N.O_n_
`
`m__.._uoEBurma
`
`ucu€%aSiam3..
`
`021’
`
`02m
`
`US 2005/0267605 Al
`
`aP.
`
`n0..UaC
`
`D.
`
`H0..ua
`
`a__._uoEM.a__2E8U3_._..-o__E.qP.._u_.&Ea32>3...
`.womu_.>
`
`H.noa
`
`.mo_.WL’
`
`Afln..25....
`
`BF
`
`B.
`
`bofiufi
`
`.ommuooaEu=2
`
`o_a.aoE
`
`on“
`
`m___._uoE.H
`
`3.%a_:uoE
`
`
`
` uumtm.=.__%_.__O_..Nnu__.._q.__.._.___-_._OOUcmwWm_0h_.?>____mm
`
`
`
`%8mesonDmmflofi«mus.
`
`2:
`
`yenEm:
`
`
`
` 03..__I1xnlv36g..a=.:......_n-nDI
`
`Page 3 of 30
`
`_._o=wo__.__._EEooHm3
`
`.flan.
`
`m_:ooE.m_...
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 3 of 18
`
`US 2005/0267605 A1
`
`I")
`If)
`
`52
`
`FIG.3
`
`device
`
` Display
`
`51
`
`("4
`V‘!
`
`Page 4 of 30
`Page 4 of 30
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 4 of 18
`
`US 2005/0267605 A1
`
`281
`
`
`EBBEO
`[Imago
`
`mam
`Ba
`Camera
`Control
`
`3u.lluh
`
`Program
`
`
`
`
`
`
`
`FIG.4
`
`Page 5 of 30
`Page 5 of 30
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 5 of 18
`
`US 2005/0267605 Al
`
`
`
`mo_>.wo._mc9.m3Ema<
`
`.33
`
`S:
`
`
`
`.355cocoz
`
`fuznm
`
`nm£..:__5_..u__¢
`
`3u._.Ec_
`
`m:_mm3o._n_co_..n.3=:EEaU
`
`
`u_:uoE3a.tuE_
`
`
`
`
`uu_:uQnu:Fsom
`
`2.:hsom
`
`Page 6 of 30
`Page 6 of 30
`
`an
`
`
`
`‘/I0::.n..$on_
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 6 of 18
`
`US 2005/0267605 Al
`
`
`
`
`
`hows...“$u_....=_.5nun3u._._n.E_
`
`
`
`u__._uaEcanmcmmnouofi
`
`flsvafi
`
`8.5mm553333mo..UE
`
`
`
`
`
`wow._.3._.__Em__.P_._mm..._._s.r..5o._
`
`:o:u.u_E._EE....u
`
`
`
`homnum»m3...._._.5
`
`u_:uoE
`
`now2:
`
`
`
`:22?_m.
`
`
`
`u__.__voE..mEu:.:.u7
`
`
`
`
`
`=a:u3:=EEoumma_E__.:___nElllllllllill.
`
`P
`03
`Page 7 of 30
`
`
`
`
`
`D.IIIIIII...llllll....I|I2._:u..:.._
`
`
`
`
`
`
`
`
`

`
`Patent Application Publication
`
`Dec. 1, 2005 Sheet 7 of 18
`
`US 2005/0267605 Al
`
`.65..
`
`
`
`o_..__.oEuoucum
`
`.E.._._E...cE.“E
`
`u_3U0_EHomeum
`
`:n
`
`
`
`00300w_mou_Eom
`
`nOE
`
`2...
`
`on...
`
`
`
`E53...uu_....un_
`
`u__.__uoE
`
`mmu_u.._._E..u.m
`
`ouu.t3u_
`
`u_:voE
`
`:o:uu__..:EEaU
`
`
`
`nu:union
`
`uou.t2E
`
`
`
`2...:prion
`
`Page 8 of 30
`Page 8 of 30
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 8 of 18
`
`US 2005/0267605 Al
`
`53.:
`
`".255
`
`E98“
`
`.5.»\\..
`..uu_E5.=.L._"E\__3.”\\..\2E..
`_..mo_E__355;xxx....
`
`ca\\\began.....
`
`82.3\\\..\\u$.._a_3xxxx..\Sm\\\xxx.___
`u_:uaE\\\\\\.._
`\\\\...~
`\\\.\\..
`
`x.\v_:uoE._om:nm
`\\~..can
`\\\..
`
`I|I.l||..I\\\\L\\\\\.._..
`lIlI.I'..l|.III.I|IIlII|.uuuu1\x\
`
`
`\\\\\.__
`
`\\\\\\\_..__..
`
`§_2_.s
`
`235.".
`
`u_.._3E
`
`
`
`03362moEEom
`
`mOE
`
`
`
`M5332;u..._.auD
`
`u_:uoE
`
`:a_.8__=:EEoU
`
`2.:tsom
`
`33.3.5
`
`uuu.toE_
`
`u:._vuE
`
`u-.._.=Om
`
`Page 9 of 30
`Page 9 of 30
`
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 9 of 18
`
`US 2005/0267605 Al
`
`m3Hu.__.5.._._...
`
`
`
`
`
` __u_:voE._om_._umI_mam&Eufiuu__
`
`_._o__..uo_E_EEoU
`
`
`
`_..._uuua._.fi._.=.
`
`m_._§...5a
`
`u_:uoE
`
`
`
`u__.__uaEHomnuw
`
`_$£2__5.//._
`
`__
`
`_IIIIIIIiIIIIIIIIIIIIIIII
`
`NE
`
`flu
`
`
`
`u_:voEEmcumH
`
`.
`
`_|
`
`..:..u/“.3.8Em_
`
`....au...2..___
`
`_
`
`_
`
`
`
`awardhomcum
`
`uu£._3..___
`
`
`
`
`
`mo_>mubcsommnewmocw___m>Smm.9»
`
`
`
`
`
`u__6oEhomcum_:lllllllllllllllllllllII.._
`
`aoN
`
`
`
`«E.:..sam
`
`Page 10 of 30
`Page 10 of 30
`
`
`
`
`

`
`Patent Application Publication
`
`Dec. 1,2005
`
`Sheet 10 of 18
`
`US 2005/0267605 A1
`
`:5:
`
`:2:
`
`9.2
`
`E
`
`
`
`o_=u.aEBmcum
`
`$o_2_.5
`
`
`
`3385.8m.._uw
`
`umu_u.__..>
`
`
`
`
`
`mosmuazzommncmoo:m___.m>5w
`
`3OE
`
`82
`
`...%_..:_..5
`
`B330
`
`£:toE
`
`H
`
`3:
`
`_.6__S:.=._EEoU
`
`ecu3u.tu=.:.
`
`m_._$..aEa
`
`u_=vaE
`
`can
`
`
`
`us:._u.so._
`
`Page 11 of 30
`Page 11 of 30
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 11 of 18
`
`US 2005/0267605 Al
`
`
`
`
`
`mo_>mu_o.E8b_x_.__Ew
`
`2.05
`
`
`
`
`
`_mo_>mv_O:.CO0c2_..smEm:
`
`E:6.46..
`
`can
`
`
`
`up:._u_..E._
`
`.._D..50m
`
`uu£._m..c_
`
`2.05
`
`Page 12 of 30
`Page 12 of 30
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 12 M18
`
`US 2005/0267605 Al
`
`
`
`oz:._u.5om
`
`can23..
`
`can3:b..s._
`
`2.:Biom
`
`3a._h.E_
`
`Sn
`
`ac:biog
`
`....uu._._..::_
`
`
`
`3.:3.50;o_:voE
`
`_EEoU
`
`82
`
`U}.
`
`Page 13 of 30
`Page 13 of 30
`
`
`
`mosmu20%.mc__Egon.E.oE83%_9Eoo022.oE
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 13 of 18
`
`US 2005/0267605 Al
`
`
`
`2.:uu.._5Dm2.5839;
`
`8"
`
`own
`
`5.3%2.:E39;
`
`3n._.5=._
`
`53am
`
`3.:
`
`
`
`
`
`mo_>mugmxmmam._m>,.on_2OE
`
`
`
`=o_:a_E.EEou
`
`
`
`us:..u.5om
`
`Page 14 of 30
`Page 14 of 30
`
`8"
`
`minEam2OE
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 14 of 18
`
`US 2005/0267605 Al
`
`mo:
`
`
`
`=_2__5_.:__:_u
`
`9:
`
`
`
`._u:P__u3=o_=u...__.=._EEDU
`
`u..__n.tu.___.__
`
`
`
`on:......_=o_m
`
`En
`
`
`
`
`
`mo_.>muEOo._0E_owu_>-o_u:<S.OE
`
`
`
`€u:=n__o._.Ea¢
`
`
`
`
`
`3358._._n_:_.3:
`
`
`
`9......._..:._6m
`
`Page 15 of 30
`Page 15 of 30
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 15 of 18
`
`US 2005/0267605 Al
`
`
`
`:a.:_.5_E._.._ou
`
`_H_Ommma
`
`82
`
`
`
`
`
`wo_>muEoo.mE_o_n:<2.05
`
`
`
`
`
`u..__>un_us:._u.so._
`
`u__.fioE59:~33
`
`
`
`u__._vcEuu....,t3£
`
`mc_mmouEn_=o__u..E=._EEaU
`
`Page 16 of 30
`Page 16 of 30
`
`
`
`2..__.u_$o.__
`
`
`

`
`Patent Application Publication
`
`D
`
`.1
`
`5
`
`81_..l0(01H8_.flS
`
`US 2005/0267605 Al
`
`
`
`7...,Ehcou
`
`
`
`W530..u_:UaE
`
`omOE
`
`
`
`
`
`2.:52837.5..“_o.==oU
`
`con
`
`man
`
`2%vcw.590
`
`Sm
`
`
`
`3.:._?_SOm
`
`9OE
`
`So.13u.t3=_
`
`32
`
`
`
`ac:._u._samu_:vaE
`
`_o._.EoU
`
`Page 17 of 30
`Page 17 of 30
`
`
`
`
`
`uasuu_o._E8._u._=aD
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 17 of 18
`
`US 2005/0267605 Al
`
`Eum$_2_§r.m
`
`.m:95
`
`mm2m:pamm
`
`.8230
`
`o_:uoE
`
`oow._._9.c_
`
`2:35
`
`«mu
`
`mmo_E_z.Em
`
`mcocm
`
`m__.._ooE
`
`m.....m_2_>>mm
`
`2250
`
`0.238
`
`
`
`_o:_._oo_.__m5_
`
`___.5
`
`Page 18 of 30
`Page 18 of 30
`
`_.m.0_n_
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 18 of 18
`
`US 2005/0267605 Al
`
`
`
`
`
`menumc_v=onwutauEȣ.G._
`
`:o_.uc£.
`
`
`
`82 .5_§_.zES
`
`
`
`max;E3...__..m
`
`oz
`
`82
`
`.mo
`
`
`
`.32..3_§_:._
`
`
`
`9%canmubcuE._o.to___
`
`
`
`ER.S__.Ea
`
`
`
`“£2.33:3_..:__....tum
`
`Eu=._:_......3_._m
`
`.
`
`
`OONH»...._.>»uMHOEVM
`
`
`_._:uEoumauournfiu_um
`
`3:
`
`fiflmu.“
`
`:2
`
`Page 19 of 30
`Page 19 of 30
`
`
`
`
`
`

`
`US 2005/0267605 A]
`
`Dec. 1, 2005
`
`HOME ENTERTAINMENT, SECURITY,
`SURVEILLANCE, AND AUTOMATION CONTROL
`SYSTEM
`
`(TR()SS-Rljl"ERENCl-.1 TO RI;‘I.ATl_-"D
`APPLICATIONS
`
`[0001] Provisional Application No. 6U]534,736
`
`STATEMENT REGARDING FEDERALLY
`SPONSORI.-".I) RESEARCII OR DEVI.-'.I.()PML7N'I‘
`
`[0002] Not Applicable
`
`IN(I()RP()R/\TI()N-BY-REI7liRl:ZN('Tl£ OI"
`MATERIAL SUBMITTED ON A COMPACT
`DISC
`
`[0003] Not Applicable
`
`BA(.'K(}ROUN[) OI: TIIIE INVl:lNTl()N
`
`[0004]
`
`]. liield ol‘ the Invention
`
`[0005] The present invention relates to home electronic
`system for entertainment, security, surveillance, automation
`control, and communication, local home network or via
`Internet, and more particularly to home security, surveil-
`lance, and automation control system capable of controlling
`home electronic devices from remote location, retrieving
`information from a plurality ot‘ cameras and sensors, and
`transmitting audio, video, and control signals between a
`main control unit of the home system, a user input device,
`and at least one remote home electronic device via power
`line commu nication network or wireless network.
`
`[0006]
`
`2. Description of Related Art
`
`[0007] Over the last few years, there has been a growing
`demand for home electronic devices, such as entertainment
`devices, home network devices, security devices, and auto-
`mation control devices.
`
`[0008] There are more and more such devices and systems
`installed within homes and buildings.
`It is tough job to
`install, optimize, control, and maintain the devices and
`systems. Those devices and systems also required additional
`new wires to setup and connect to its subsystems.
`
`[0009] The most of home electronic devices and systems
`installed now do not have the ability to be controlled by
`remote user via Internet or home network. The systems and
`devices do not take advantage of TCPEIP network.
`
`[0010] The most of home security surveillance systems
`installed do not take advantage of video surveillance. A user
`may get security video surveillance system and service from
`a security companies, but the systems are more expensive
`and complex. It is needed to add extensive new wire for the
`user to install this security system.
`
`house or building or at remote locations via Internet, such as
`home
`video—audio
`intercom communication,
`real—lime
`video—audio chat via Internet, video conference, video su r-
`veillance, and TVJDVIJ entertainment program.
`
`[0013] The conventional home automation control devices
`are very complicated to control.
`In addition,
`the home
`control devices also need the installation of a discrete set of
`control wires and a user house will be damaged.
`
`Power line communication systems and method
`[0014]
`have been used in a variety of applications, such as control
`of home lights, door openers, and electrical switches for
`many years. Power line communication systems and method
`are relatively inexpensive and reliable.
`
`[0015] There are many dil]’erent protocols to provide
`power line communications.
`
`BRIEF SUMMARY OF THE INVENTION
`
`It would be advantageous if a home system includ-
`[0016]
`ing TV, DVD, at video-audio intercom, a security, a video
`surveillance, baby care and childcare, and home control. It
`is an all-in-one system.
`
`is difiicult for conventional home
`[0017] As a result, it
`electronic systems to assist the home user in carrying out
`daily activities without this all-in-one system.
`
`[0018] Accordingly, it would be desirable to provide an
`improved and multifunction home electronic system for
`entertainment, security, and automation control. This all-in-
`one system is more flexible and simpler to install and use
`than conventional systems. Moreover,
`the system takes
`advantage of power line communication without new wire
`and can be controlled over Internet or home network.
`
`invention is directed to provide a
`[0019] The present
`system and method 01‘ controlling remote home electronic
`devices coupled to home network and transmitting audio,
`video, control data between a main home control unit, user
`input device, and at least one remote home electronic device
`using power line communication or wireless communication
`that provide no new wire connection.
`
`For the most part, this invention takes advantage of
`[0020]
`existing home power wiring to transmit audio, video, and
`control data. The power line communication provides a best
`solution for user to install, setup, and use new home devices
`without new wiring in home or building. Not all the embodi-
`ments ol‘ the invention are restricted in to the power line
`communication. In order to take advantage ol‘ legacy audio-
`video devices, such as wireless camera, the present inven-
`tion also provides wireless communication to transmit
`audio, video, and control data.
`
`[0021] Another object of the present invention is to pro-
`vide remote control and data transfer over Internet or home
`network for user to monitor user home, control home
`electronic devices, and communicate with the devices while
`user is at remote location via Internet.
`
`[0011] The use ol’ video and audio devices, such as video
`and audio conferencing devices, video and audio intercom
`devices, and camera devices, has increased dramatically in
`recent years.
`
`[0012] When these audio and video devices are integrated
`into an existing house or building, the installation of new
`control wires can be very complicated and costly. There is an
`ever-growing need for transmitting live video, audio, and
`control data between dilIerent rooms or locations in the
`
`[0022] Another object (II the present invention is to pro-
`vide a multifunction home electronic system that has enter-
`tainment modulcs, security and surveillance devices, auto-
`mation control devices, and home communication devices,
`such as home video-audio intercom. The system should be
`easily installed and maintained.
`Page 20 of 30
`Page 20 of 30
`
`

`
`US 2005/0267605 A1
`
`Dec. 1, 2005
`
`[0023] Another object of the present invention is to pro-
`vide easily installation, maintenance, and operation. In addi-
`tion, the system can be easily upscale or downscale accord-
`ing to user desire.
`
`[0024] Additional advantages, objects, and features of the
`invention will he set forth in part in the description which
`follows.
`
`In another aspect of the present invention, there is
`[0025]
`provided an integration of the system for home entertain-
`ment, security, surveillance, automation control, and com-
`munication with existed home electronic devices using
`power line communication interface device via power line
`home network.
`
`invention, a
`In a further aspect of the present
`[0026]
`method in controlling and operating a system for home
`entertainment, security, and automation control is provided.
`According to the method of the present invention, a user
`may select and control the system to provide entertainment
`or security or and automation control function using a user
`input device, such as remoter controller, cell phone, wireless
`PDA, and PC via Internet.
`
`In yet another aspect of the present invention, a
`[0027]
`baby watcher and childcare remote devices are provided
`which monitor and watch baby or child. In the illustrated
`embodiment, the devices comprise a camera and a plurality
`of sensors. Amain control unit receives live video and audio
`
`data from these devices via power line communication link
`and Sends the data to the display device. The video and audio
`data may be received from remote location via Internet.
`
`invention,
`In still another aspect of the present
`[0028]
`there is provided a security and surveillance device, includ-
`ing a plurality of sensors and cameras installed in corre-
`spondence to a place to be monitored for detecting infor-
`mation about
`intruder, a device processing unit and a
`communication interface that is connected to at least one of
`
`the plurality of sensors and cameras and communication
`network for transmitting detecting information to a main
`control unit of the system via the communication network.
`
`In another aspect ol‘ the present invention, home
`[0029]
`automation control remote devices are provided, including a
`plurality of light or switch control devices, an MC control
`device, a sprinkler control device, doorfgate control, VCR
`control, and a damper control device. Each device comprises
`a power line communication interface and control module.
`The device receives data or control signals from a main
`control unit via communication network, such as power line
`communication or wireless con1munication.
`
`invention,
`In still another aspect of the present
`[0030]
`there are also provided a plurality of video and audio remote
`devices, comprising a plurality of audio-video intercom
`devices, audio intercom devices, a plurality of power line
`speakers, and a plurality of power line phone devices,
`wherein the devices comprising a power line communication
`interface. The llrst power line phone device sends and
`receives audio data from a main control unit of the system
`or second power line phone device via power line commu-
`nication. The power line speakers comprising a speaker and
`a power line communication interface module receive audio
`signals from the main control unit via power line commu-
`nication network. The first audio-video intercom device
`
`transmits audio and video data to and from a main control
`unit of the system or second power line phone device via
`power line communication.
`
`In another aspect of the present invention, there is
`[0031]
`provided an entertainment module, comprising T\/fcable TV
`module, I)Vl),*'VCI) player module, and Radio tuner.
`
`In another aspect of the present invention, there is
`[0032]
`provided an audio-video recorder, comprising hard drive
`capable of recording audio and video data. Thus, with the
`recorder, a user may record TV, DVD, and Radio program
`for later viewing. Further, the live video data from surveil-
`lance camera or other camera can be recorded and the user
`has a chance to review them later. In addition, the audio-
`video data file downloaded from Internet, video-audio inter-
`com, and telephone also can be recorded.
`
`is to be understood that both the foregoing
`It
`[0033]
`general description and the following detailed description of
`the present invention are exemplary and explanatory and are
`intended to provide further explanation of the invention as
`claimed.
`
`[0034] These and other objects, advantages and features of
`this invention will be apparent from the following descrip-
`tion taken with reference to the accompanying drawing,
`wherein is shown a preferred embodiment of the invention.
`
`BRIEF DESCRIPTION OF THE SEVERAL
`VIEWS OI‘ 'l‘Ill_-I DRAWING
`
`[0035] FIG. 1 is a schematic illustration of a home enter-
`tainment, security, surveillance, and automation control sys-
`tem over home network communication link according to an
`example of the present invention;
`
`[0036] FIG. 2 is a functional block diagram of a main
`control unit in accordance with an exemplary embodiment
`of the present invention;
`
`[0037] FIG. 3 depicts a display device fonned by a LCD
`screen,
`two speakers, and one camera according to the
`invention;
`
`[0038] FIG. 4 depicts a remote controller according to the
`invention;
`
`[0039] FIG. 5 depicts one embodiment of baby watcher
`device according to the invention;
`
`[0040] FIG. 6 is another embodiment of baby watcher
`device according to the invention;
`
`[0041] FIG. 7 depicts one embodiment of childcare device
`according to the invention;
`
`[0042] FIG. 8 is another embodiment of childcare device
`according to the invention;
`
`[0043] FIG. 9 illustrates one embodiment of surveillance
`and security device according to the invention;
`
`[0044] FIG. 10 illustrates another embodiment of surveil-
`lance and security device according to the invention;
`
`[0045] FIG. 11 shows a block diagram of Light switch
`control device according to the invention;
`
`[0046] FIG. 12 shows a block diagram of sprinkler control
`device according to the invention;
`Page 21 of 30
`Page 21 of 30
`
`

`
`US 2005/0267605 A1
`
`Dec. 1, 2005
`
`[0047] FIG. 13 shows a block diagram of /\C control
`device according to the invention;
`
`[0048] FIG. 14 shows on screen program menus;
`
`[0049] FIG. 15 shows a block diagram of power line
`phone device according to the invention;
`
`[0050] FIG. 16 shows a block diagram of smart plug and
`Power speaker device according to the invention;
`
`[0051] FIG. 17 shows a block diagram of audio-video
`intercom device according to the invention;
`
`[0052] FIG. 18 shows a block diagram of audio intercom
`device according to the invention;
`
`[0053] FIG. 19 shows a block diagram of damper control
`device according to the invention;
`
`[0054] FIG. 20 shows a block diagram of door and gate
`control device according to the invention;
`
`[0055] FIC'. 21 shows a block diagram of three wireless
`remote devices interacting with the main control unit;
`
`[0056] FIG. 22 Shows a flow chart illustrating a method of
`implementing the present invention for home entertainment,
`security, surveillance, automation control system over home
`network communication link;
`
`[)l_-lS(_‘RIP'l'I()N 0|’ 'l‘IIl£ PRl_il*‘l_".RRI-_-ll)
`EMBODIMENT
`
`[0057] Referring now to the drawing, and in particular to
`FIG. 1, a preferred embodiment of a system 10 for home
`entertainment, aucliofvideo communication, security, sur-
`veillance, and automation control. The system 10 illustrated
`generally includes a plurality of remote devices that are
`capable of video, audio, and control communication; a
`display device 50 that
`is capable of displaying text and
`image data; a plurality of user input devices that are capable
`of receiving commands from a user; a main control unit 100
`that is capable of enabling a user to set, program, and control
`the system, receiving various data from at least one remote
`device or from one of user input devices, and sending the
`audio—video data to the display device or the control data to
`at least one remote device; and a communication link 200
`that is capable of transmitting various data including text,
`image, voice, and control data between the main Control unit
`and at least one remote device.
`
`[0058] The plurality of remote devices include: a baby
`watcher 210; a childcare device 211; surveillance and secu-
`rity device 2l2; a switch control device 220; a sprinkler
`control device 222; an AK.‘ control device 226; a damper
`control device 228; power line phone 230; power line
`speaker 240; door,t'gate control device 229; at least one smart
`appliance plug 260; at least one audio—video intercom device
`270; at least one audio intercom device 275; at least one
`wireless control device 254; a Rlilwireless phone device
`252; and a wireless camera and sensor device 250. The
`audio, video, and sensor data are received and transmitted
`between the main control unit and various remote devices
`
`via power line communication link andtor RFtwireless com-
`munication.
`
`[0059] The user input devices include a remote controller
`281, a wireless PDA 282, a cell phone 283, a remote
`computer 291, a camera 284, a wireless camera 285, a
`Page 22 of 30
`Page 22 of 30
`
`wireless microphone and speaker 286, a microphone 287,
`and a VCR 288. The user input devices receive user com-
`mands or user control signals and then transmit them to the
`main control unit 100. Further, the remote conlroller281, the
`wireless PDA 282, the cordless phone 283, and a wireless.
`microphone 285 wirelessly send user control signals to the
`main control unit.
`
`[0060] A Ltser sends control signals to the main control
`unit 100 by pressing keys buttons provided on one of a
`remote control 281, cell phone 283, and wireless PDA 282.
`A user sets the main control unit
`to different mode by
`pressing a corresponding button provided on the user input
`device. Tl‘1e main control unit may receive audio, video, and
`control data or signals from the digital camera or webcam
`284, microphone 28?, cable modem, and telephone line.
`There is interface connected to cell phone, not shown in
`FIG. 1. There is another interface connected to PDA, not
`shown ir1 FIG. 1.
`
`[0061] The microphone 287 sends audio data to the system
`via wired connection for audio communication. Based on
`the microphone 287 or wireless microphone 286 and speaker
`286, the user may implement audio communication, such as
`the running Internet voice chat, audio intercom, audio—video
`intercom, and making telephone call. Iiurther, the user may
`use wireless microphone and speaker 286 to implement
`audio communication while the user is preparing a dinner in
`the kitchen of a home.
`
`interactive and
`[0062] The remote computer 291 is
`interoperable with the main control unit 100 for audio,
`video, sensor, and control data communication through
`external Internet network 290 or Public Switched Telephone
`Network 292. The remote computer comprises application
`software that is capable of control the computer to receive
`audio, video, and sensor data from the system and send
`control data to the system.
`
`[0063] The system is also provided the ability to imple-
`ment audio—video two way communications with remote PC
`261, such as video conference or Internet audio-video chat.
`Additionally, the application software is needed to run such
`program.
`
`the
`[0064] Turning to FIG. 1 and FIG. 14, preferably,
`remote controller 281 is provided to control the system 10.
`The wireless PDA 282 and the cell phone 283 are also
`provided the ability to control
`the system. A user may
`program the system via on-screen program menus.
`
`[0065] Referring again to FIG. 1, the main control unit
`100 generates a control signal for controlling at
`least one
`remote device, such as surveillance & security 212, and
`handling video, audio, and sensor data from the remote
`device.
`
`[0066] The communication link 200 is power line com-
`munication network that is capable of transmitting various
`data via power tine without additional hardwire connection.
`The protocols used include home plug 1.0, X10, and CEbus.
`
`In addition, the RF.=’wireless communication 190 is
`[0067]
`employed to implement audio, video, sensor, and control
`data communication between the main control unit 100 and
`at least one Rlfllwireless remote device, such as the wireless
`camera device 250.
`
`

`
`US 2005/0267605 A1
`
`Dec. 1, 2005
`
`[0068] Turning to FIG. 2, the main control unit 100 is
`multifunction system. The main control unit is configured to
`control the system and perform communication with at least
`one of the plurality of remote devices and user input devices
`via the power line communication link or wireless commu-
`nication link. The main control unit 100 comprises hardware
`and software that control the processing of data to and from
`the unit.
`
`[0069] The main control unit 100 includes: a system and
`data bus 110 for transmitting data and system control signals
`between the modules; a microprocessor 150 which is con-
`nected to the bus; a mass storage module 103 that
`is
`connected to the microprocessor over the bus;
`a
`tuner
`module 105 that
`is coupled to the microprocessor; an
`audio—video controller module 104 that is connected to the
`microprocessor over the bus; a wireless and IR interface
`module 102 that is connected to the microprocessor over the
`bus; and a power line communication interface module 101
`that is connected to the microprocessor over the bus.
`
`In addition, the main control unit 100 also includes:
`[0070]
`a hard drive 106 that
`is capable of storing system and
`application software; a memory 107; a communication port
`module 130; and a power supply and backup battery module
`109.
`
`the microprocessor 150 is capable of
`[0071] Basically,
`executing instruction stored in the memory 107 or user
`command to control the system 10 and provide functionality
`including that provided by certain embodiments of the
`present invention.
`
`[0072] The memory 107 includes RAM, ROM, and
`l$l£.PR()M. Typically it
`is capable of storing boot code
`instructions or other system information.
`
`[0073] The communication port module 130 includes: a
`RS-232; USB 2.0 whose rate is 480 Mbps; 1394 whose rate
`is 400 Mbps; a DVI, a phone port; and Ethernet port.
`Preferably, the communication port module,
`the Ethernet
`port and the phone port, allows connection to an Ethernet
`based network, such as a broadband connection to a WAN or
`the Internet. The RS-232 port is legacy port that allows
`connection to various electronic devices. Further, the IEEE—
`1394 port allows connection to external audio—video device
`and the DVI port communicates with external video device.
`
`[0074] The system provides real—time Internet connectiv-
`ity to external network, such as WAN. The Internet connec-
`tivity includes PSTN and Ethernet. For example, based on
`the communication port module, the PSTN telephone jack
`and the Ethernet port are provided in order to communicate
`with remote PC 291 and Internet. Auser may use Broadband
`to transmit various data to Internet via Ethernet port. The
`slow connection uses dial-up ISP via phone line jack to
`transmit various data. In addition, the user also may make
`phone call via the wireless MIC and speaker 286 or audio
`intercom device 275 or power line phone 230.
`
`[0075] The hard drive 106 is configured to store operating
`system, various application software, and database for the
`plurality of remote devices.
`
`the mass storage module 103 com-
`In addition,
`[0076]
`prises: a hard drive; a flash memory; and a DVD random
`access memory. Preferably,
`the module has the ability to
`record various data and play the data back later. The data
`Page 23 of 30
`Page 23 of 30
`
`least one of the remote devices, such as the
`include: at
`surveillance and security device or the baby watcher device;
`the audio—video intercom device; the audio intercom device;
`the power line phone device; one of the user input devices,
`such as cordless phone 283; TV and Radio module; and
`audio—video file from the Internet. With the mass storage
`module, the user may record favor TV or play DVDNCD
`program. In addition, the telephone calls, audio—video data
`from the intercom device or power line device, and audio-
`video files downloaded from the Internet can be recorded to
`the mass storage module. Finally, the mass storage module
`is provided to record video, audio, and sensor data from at
`least one of the surveillance and security devices.
`
`[0077] The DVD random access memory in the module
`103 is coupled to the microprocessor 150 via the bus 110 and
`designed for playing digital versatile disk (DVD) and video
`compact disk {VCD}. With the DVD random access
`memory, the user may enjoy DVD and VCD programs using
`LCD display device 50.
`
`[0078] The TV and Radio tuner module 105 is coupled to
`the microprocessor via the bus and designed for receiving
`TV, cable TV, and Radio signals. The TV and Radio tuner
`module is capable ol‘ receiving broadcasting signals, such as
`TV, cable TV, and Radio.
`
`[0079] The TV and Radio tuner 105 receives various
`broadcasting signals includes cable and satellite signals. A
`user may set system 10 to TV or Radio mode, and then the
`main control unit sends signals to the tuner module and
`video—audio controller. On the other hand,
`the video and
`audio signals are outputted through the LCD display 50 and
`speaker 53, respectively. The display device can also receive
`signals from DVDNCD player module 103 if a user sets the
`main control unit to DVDFVCD player mode. The system 10
`will work as home entertainment center now.
`
`[0080] The audio—video controller module 104 is coupled
`to the microprocessor, the DVD module, and the TV and
`Radio tuner module via the bLLs. The controller interface
`module is capable ot‘ receiving signals from the bus, the
`DVD module, and the TV and Radio tuner module, and then
`sending audio and video data to the LCD display device to
`display associated images and texts. The control module also
`receives video data from the camera 53 in LCD display
`device 50, in FIG. 3.
`
`[0081] The RI‘U"wirele.ss and IR irlterlace module 102 is
`coupled to the bus U0 and configured to transfer various
`data to the microprocessor. The protocols of the interface
`module 102 comprise an IEEE 802.11 standard to imple-
`ment wireless communication and cordless telephone stan-
`dard. The interface module 102 also includes an IR and RF
`transceiver that is capable of wirelessly sending and receiv-
`ing various data between the module l02 and at least one of
`user input devices. The interface module receives control
`signals from the remote controller or the cell phone or a
`wireless FDA and then the microprocessor outputs a control
`signal to perform a desired function in response to the user
`signals.
`
`the interface module 102 is
`[0082] On the other hand,
`configured to provide an interface between the main control
`unit and at least one of the remote devices, such as the baby
`watcher device 210. The module wirelessly receives video,
`audio, sensor, and control data from at least one of the
`
`

`
`US 2005/0267605 A]
`
`Dec. 1, 2005
`
`plurality of wireless remote devices, such as Rlfitwireless
`camera 250. Meanwhile, the module sends control data to at
`least one of the devices. For example, the module sends
`control signals to the wireless control device 254 to control
`lamp. Finally, in order to use the interface module 102, the
`associated software driver is also provided.
`
`[0083] The power line communication interface module
`101 is coupled to the bus and configured to transfer audio,
`video, sensor, and control data between the power line
`communication interface module and at
`least one of the
`plurality of remote devices, such as surveillance and security
`device over the power line communication link. The power
`line communication interface module is capable of provid-
`ing one or more communication protocols such as power
`line home plug 1.0, X10, and CEbus.
`
`[0084] Referring to FIG. 1 and FIG. 3, a display device 50
`according to the present embodiment includes a LCD dis-
`play screen 51, two speakers 52, and a camera 53. The
`display device will receive audio and video data from the
`main control unit 100 or TV and Radio tuner module or
`
`DVDNCD player module, in FIG. 2. The camera 53 is
`capable of sending video data to the main control unit. With
`the display device 50, a user may watch TV, DVD, and VCD
`program. On the other hand, the display device 50 displays
`live image from the cameras in the remote devices such as
`the surveillance and security device,
`the baby watcher
`device, the childcare device, and the audio-video intercom
`device.