I|||||||||||||||||||||ll||l||||||||||l||||||||||||||||||||||||||||||||||||l|||||||||||l|||
`
`US 2Ut}5026?6[]5A1
`
`(19; United States
`(12) Patent AppliC3ti0fl PlIbliC3ti0I1 (10) Pub. No.: US 2005/0267605 A1
`Lee et al.
`(43) Pub. Date:
`Dec. 1, 2005
`
`(54) HOME EN'l"l‘3RTAlNMF-NT, SECURITY,
`SURVEILLANCE, AND AU'Il0MATl0N
`CONTROL SYSTEM
`
`(52) U.S. CI.
`
`....................................... ,. 700x19; 340510.11
`
`(76)
`
`1
`_
`_
`Inventors: Paul K. Lee. Areodia, (.A (US);
`Xiuyzm Zhang, Richardson. TX (US)
`
`(57)
`
`ABSTRACT
`
`'
`
`,
`
`,
`
`FIE CREEK
`
`TX
`
`11;’030,2fi2
`
`(21) App1_ No_;
`1
`1'11i‘«d3
`
`(23)
`
`J3|1- 5- 2005
`.
`1
`.
`Relawd Uh‘ Apphcmwn Data
`(60) Provisional application No. 60z‘534,736, filed on Jan.
`7 2U04_
`’
`
`pu],|ic3um, C|_a§§ific-afion
`
`A system and method of home entertainment. security,
`surveillance, and automation control includes a plurality of
`remote devices, a display device, and various user input
`devices téflpifllblc of iieejeiving a home useris command;
`
`Iv
`t’1'1a1t'1 Loonlro Uni! Capa.
`IUCU CS
`fl Cf
`'
`Syslcnl.
`controlling and programmmg the system, and a communi-
`cation link capable of transferring various data and control
`signals between the main unit and the plurality of remote
`devices. The horiie user's command enables to select the
`remote devices, to transmit various automation control sig-
`rials and to establish exchanges of various data between the
`mail‘ gantry] mm and al Ieasl .0“: or ll“: plurality of wmnlc
`devices. Finally, the communication link between the main
`control unit and the remote devices includes power line
`communication network over existing home AC,‘ power line.
`The home user is also able to control and communicate with
`
`(51)
`
`Int. CL? ......................... .. G051} 11101; GOSB 15:00
`
`the system at remote location over the Internet.
`
`to
`
`KJ
`
`2*“
`
`:;:,:m._‘
`""9
`
`Egrggrmu
`‘W
`
`‘am
`
`.I.'
`
`.'lll|.I iI:'-I l-
`'
`E3 Mdiommo
`Intercom
`no
`
`200
`
`
`
`-
`
`2 I
`
`'
`
`-
`
`222
`
`226
`
`2 =
`
`2”
`.
`
`I
`
`|
`I
`I
`
`I
`I
`
`2m
`snug
`watcher
`
`device
`
`":il"'"" ‘S
`«mic-Y
`I
`2.,‘t":.‘3.
`dew“
`Sprintder
`fiflrllml
`davlee
`23.”.
`device
`
`E:.T"p;'
`
`Pm-aertine
`
`I 230
`
`230
`
`230
`
`POI 1002
`
`2 _
`
`2
`
`Doeirigate
`
`22::
`Pnuuortlne
`
`Speaker
`240
`
`- I
`no -
`
`
`
`-
`
`Wire! 3
`
`sake:
`
`as
`
`2.6?
`
` '
`--
`
`50
`
`Speak:
`52
`
`Display device
`
`Q ‘ Md”
`L-:3‘.-ogm
`ms
`2-"5
`I
`2'i"5
`
`camera
`
`23.:
`
`253
`
`"
`
`casnzim
`
`speaker
`52
`
`AN?
`V
`
`wnlwuer
`
`phone
`
`2
`
`9°
`
`2
`
`»
`
`i
`
`92
`
`‘I
`
`29‘
`
`‘
`
`321‘? °‘’"‘‘‘‘’
`
`RFMfiralIu
`3333.‘;as
`
`25:
`rim-ireieas
`"W
`device
`
`..
`
`.
`Té,i;F.hn-irelesscommunication
`
`1
`
`POI 1002
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 1 of 18
`
`US 2{}0SX0267605 A1
`
`o_.N
`
`E3u__:uSn
`
`_.N
`
`ao____§uX552:3.Ian_u.__a_.—n_
`
`Samcan9Ba.5
`
`._-Z4.
`
`2aEw..,.._
`
`an
`
`_n3_.a__&uumu_E_...r.<mw._
`
`u.uucn:_u>._:9.3mEoEuu
`.w_o._.coo
`
`=_._:E.ucaznoo:_.m_wan
`
`
`vmnmwm_o._.s..uEau__>o_u__.2...0.23%.?
`mm$!_.:___<u_muusuu
`
`
`Dflu0...:E2501
`
`..E__:._..fii Qux
`
`Enj,'0En.
`
`mam
`
`Bxmmam
`
`can9“mm0.2wE3
`.nI5.“.
`
`o%_>.o§._<
`
`Eo22..__
`
`
`
`oufiuuEnl .223manmhnBane8.25....
`
`0?.manmu_>o_uEuo.
`
`m._uEuo
`
`wua0.
`
`EuEo
`
`«mm1EmmmT...
`=o=mo__:....EEoom$_o_§m$Qcan9.5:
`
`
`
`
`
`
`au__..au___2au_n_ownanown
`
`
`mmIBxnunm
`
`agzuan
`
`
`
`:1mwv_u.ou
`
`2
`
`
`
`

`
`LI.aP.
`
`n.Am
`
`m.maC
`
`hU
`
`Dm...u3
`
`02.19
`
`S
`
`2tm
`
`001
`
`US 2{}05I0267605 A1
`
`
`
`%_.._O_ww2r_=_.._..__-_._D0mEwwm_m._2<uE
`
`K.canmmw_u.__:Sam
`
`h8.
`
`mumtfifi
`
`a_:uoE
`
`wno
`
`
`
`amu._2mmm»:
`
`outsu
`
`mn:
`
`
`
`PH_._O_.“flu_c_.=._..=._..._a00...:.u_.._.an_
`
`3.
`
`
`
`0__...Uo.._._womt3_.__
`
`_.._O=.mU__.__.__.—._En_U
`
`3_._atom
`
`
`
`ucm.:,.._o._..m...u2.on_
`
`a_:uoEbuses
`
`8..
`
`
`
`
`
`:5._o=:ooc_mE
`
`N.0_u_
`
`m3,
`
`m39>
`
`
`
`P.23¢ucwoo_u_>we
`
`55......
`
`a%_...o___.=<
`
`.u=D.=_._O0
`
`o__..uoE
`
`eIf
`
`8.
`
`B.
`
`>._oEwS_
`
`u_:_uoE
`
`o>_.n_Yam
`
`0_:Un:._._
`
`._amma8a2u=2
`
`u_:.aoE
`
`of
`
`.m_...
`
`=.o-=.
`
`.43.
`
`.-..r.A
`
`3
`
`
`
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 3 of 18
`
`US 2{}0SI0267605 A1
`
`gr)
`to
`
`N
`In
`
`FIG.3
`
`device
`
` Display
`
`51
`
`("4
`V‘!
`
`4
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 4 of 18
`
`US 2005X0267605 A1
`
`281
`
`\
`
`
`
`EBBO
`BQQEO
`
`
`EBBBE
`69%
`
`
`
`
`
`
`
`Camera
`
`
`
`FIG.4
`
`Scnsur
`
`Sulib}!
`
`Control
`
`5
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 5 of 18
`
`US 2005X0267605 A1
`
`
`
`m.o_>m_u._w_._Bm3Ema<mon
`
`«Bu
`
`.6:
`
`
`
`uomuumvusom
`
`
`
`..8.._3_._o_.o2
`
`$£?__3Em
`
`o...u.t3c_
`
`m:_mmyuo.x__._o:fi._=:EEoU
`
`
`..._:voEuua.tu_.a_
`
`
`
`
`»uM>un_2....hack
`
`3.:hxscm
`
`2"
`
`
`
`/2.:._u.$_am
`
`6
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 6 of 18
`
`US 2{}0SX0267605 A1
`
`
`
`.033muu_u._.__5
`
`u_=uo_._..
`
`$.23,
`
`Eflcau
`
`u__.fioE
`
`Sn
`
`
`
`...:.__Fsam
`
`u__.._2..Ema 9:885
`
`35.3.5
`
`
`
`uu_>um_5:03333m0GE
`
`
`
`woeu=:._~3om
`
`_._E.ao_c_._EE3
`
`7
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 7 of 18
`
`US 2{}05X0267605 A1
`
`
`
`o_=_.oEhomcum
`
`
`
`u_:uoEuomcum
`
`:n
`
`on...
`
`on.
`
`
`
`m_.._nmuuoEu.._.r..vn.._
`
`23.02
`
`:o_fiu_:_..EEOU
`
`3.:Exam
`
`u..=..._._3£
`
`
`
`nu:Fsom
`
`
`
`wo_>wu0._mOU__._._0m
`
`nGE
`
`8
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 8 of 18
`
`US 2{}0SX0267605 A1
`
`§._2_3
`
`236E
`
`uancum
`
`..,c_§...>
`
`u_...._uaE
`
`.545.»
`
`
`
`uo_>o_u2moEEowm.05
`
`Sm
`
`
`
`m_.__a...3aou_>uD
`
`u_3uoE
`
`:o:n3=_..EEo0
`
`3.5uoaom
`
`..,.é.tu_5
`
`3n._._uE_
`
`u__..uoE
`
`can
`
`union
`
`9
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 9 of 18
`
`US 2{}0SX0267605 A1
`
`
`
`o__._voEuoncuw
`
`_$..._».._.$I/._
`
`._.
`
`__Fu=am
`
`_
`
`
`
`_uuu._.»u=..__53:30$2.§U__
`
`2:.8EEn:um.....
`
`uuuHE:_51.
`
`
`
`NHO‘EufiuuEuEaU
`
`oua+r..E_
`
`:o_..3_c=EEaU
`
`2.3uu£._.3£
`
`3.3.3:.
`
`o_..._uaE
`
`
`
`
`
`.wo_>oubtsomwcammocm___m>._:mmOE
`
`H:r|||||||||||||||||||||II
`
`
`
`u?uaE._ou_._ummlIIIIIIIIIIIIIIIIIIIIIII_uu_.u.....s=
`
`
`
`u_:voE..o2.uwV
`
`«.9:/fl.3uuwfiwcm
`
`mm...
`
`aan
`
`2.5Baum
`
`10
`
`10
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 10 of 18
`
`US 2{}0SX0267605 A1
`
`
`
`u_3_.oE.5w._._u.W
`
`$~_u.r..__,
`
`
`
`u_:_SEBmcvm
`
`$u_u._.5
`
`3305:5
`
`Eufiav
`
`u__:.cE
`
`NS.
`
`
`
`
`
`mo_>m_...bczommnewmucm___w>Sw
`
`2.05
`
`:o_Ho__._:EEaU
`
`canmoans:
`
`m._._.nm3o._n
`
`u_=_.oE
`
`um:
`
`can
`
`us:biog
`
`11
`
`11
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 11 of 18
`
`US 2{}0SX0267605 A1
`
`
`
`
`
`mo_>mn_O._E0uE_v_c_aw
`
`2.05
`
`
`
`8__$u.258__2_.smEm::OE
`
`
`
`..é___._......_o._
`
`Sn
`
`
`
`u_.____3.50..
`
`1
`
`H2._
`
`Ha__
`
`fizsm
`
`_E.EoU
`
`v_:voE
`
`Eh:cu
`
`u__.__._oE
`
`8.
`
`2...:
`
`Do_
`
`12
`
`12
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 12 of 18
`
`US 2005/0267605 A1
`
`
`
`3.:.—u_$on_
`
`can
`
`
`
`ofi33...u..so._
`
`ucosn
`
`2.:Siam
`
`ouu.....3=_
`
`Sn
`
`
`
`3.;.533
`
`_o._Ecu
`
`u_:woE
`
`U....a.
`
`13
`
`
`
`mo_>w_u95%mg:Egon..2GE
`
`
`
`mo_>mv_o_Eoo02
`
`2CE
`
`13
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 13 of 18
`
`US 2005/0267605 A1
`
`
`
`2.5puiumon:._u3o..._
`
`
`
`
`
`uuxaonn....=__3.59..
`
`Sn
`
`9"
`
`oon.t3a_
`
`33cm
`
`2.:
`
`
`
`:o:3E:EEou
`
`
`
`us:..u_so._
`
`uua.t3:_
`
`14
`
`an
`
`
`
`mo_>m._u§_$%Egon.2_oE
`
`9.3:252dz
`
`14
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 14 of 18
`
`US 2{}05I0267605 A1
`
`
`
`
`
`mo_>wuEo8mE_omu_>-o_u:¢SOE
`
`,3:
`
`
`
`...,.._:5_EEaU
`
`u_._9Eo._o_E
`
`uua.tu=.:
`
`15
`
`
`
`2....._u3om
`
`
`
`
`
`.._.O.._.._v._.____3.50%
`
`_._a:fi._S..EEoU
`
`15
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 15 of 18
`
`US 2{}05X0267605 A1
`
`
`.._2__5_c.=.._aU
`D_H:Il¢:H_
`
`_l|.:H_H:H_
`
`E3
`
`SM:
`
`
`
`
`
`2:uoE..a.._.33
`
`8.:
`
`‘-3.:
`
`2."
`
`.02
`
`:o_.=..u_:=EE_uU
`
`2.5..u__5om
`
`oust»gum
`
`S"
`
`16
`
`
`
`2....h._$c.__
`
`
`
`wu_>muE0235o__u:<M:.03
`
`
`
`
`
`16
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005
`
`Sheet 16 of 18
`
`US 20090267605 A1
`
`
`
`
`
`2.:beamuu_>u_.Ho.:=oU
`
`can
`
`own
`
`2%van.500.
`
`.6:E2u_=uoE
`
`Ehuau
`
`095%..u.=.__
`
`
`
`JIJIE
`
`omOE
`
`Ra.t2E
`
`3.30..
`
`3.:
`
`..nm:um
`
`Sn
`
`u_._:Siam
`
`3.05
`
`
`
`uu_.»u_u_o..EooE_E..d
`
`Se
`
`17
`
`17
`
`
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 17 of 18
`
`US 2{}05I0267605 A1
`
`mmu
`
`mmw_m.._>Zu_m
`
`EmEmo
`
`m_:uoE
`
`Smm$_2_>?m_m
`.m.Ea
`m__.:uoE £mecca
`mmm_2_2<..._m_35
`
`
`
`EzcooEms.
`
`o_:uoE
`
`
`
`m$_2_2.&mmontage.
`
`
`
`.2280m3noE
`
`18
`
`_.NOE
`
`18
`
`
`
`

`
`Patent Application Publication Dec. 1, 2005 Sheet 18 of 18
`
`US QWSX0267605 A1
`
`N_um=o_.u_.=.c
`
`
`
`
`
`m5__.comuutoo_.:._o._hum
`
`82
`
`
`
`a..__u_._on3.c3_._.:....._.fi.u_
`
`:o__a_._£
`
`..
`
`eon.
`
`
`
`hon“82.6....
`
`..
`
`
`
`9%canmubouFnfiuuum
`
`oz
`
`9...:E3m__..m
`
`E2
`
`.mo
`
`8:
`
`63
`
`32
`
`—51/Eu._._:_2._.....=m
`
`19
`
`19
`
`
`
`
`
`

`
`US 2005/(}2676U5 A1
`
`Dec. 1, 2005
`
`HOME ENTERTAINMENT, SECURITY,
`SURVEILLANCE, AND AUTOMATION CONTROL
`SYSTEM
`
`(IR()SS-REIVERENCE ’I'() REl..A'I‘lE.I)
`APPLICATIONS
`
`[0001] Provisional Application No. 6{l;’534,736
`
`STATEMENT REGARDING FEDERAI.I,Y
`SPONSORED RESEARCH OR DEVELOPMENT
`
`[0002] Not Applicable
`
`INCORPORATlON-BY-REFERENCE or
`MATERIAL SUBMI‘I'I'El) on A COMPACT
`DISC
`
`[0003] Not Applicable
`
`BACKGROUND 01’ THE INVI_-‘.N'I"I()N
`
`[0004]
`
`1. Field of the Invention
`
`[0005] The present invention relates to home electronic
`system for entertainment, security, surveillance, automation
`control, and communication,
`local home network or via
`Internet, and more particularly to home security, surveil-
`lance, and automation control system capable of Controlling
`home electronic devices from remote location, retrieving
`information from a plurality of cameras and sensors, and
`transmitting audio, video, and control signals between a
`main control unit of the home system, a user input device,
`and at least one remote home electronic device via power
`line communication network or wireless network.
`
`[0006]
`
`2. Description of Related Art
`
`[0007] Over the last few years, there has been a growing
`demand for home electronic devices, such as entertainment
`devices. home network devices, security devices, and auto-
`mation control devices.
`
`[0008] There are more and more such devices and systems
`installed within homes and buildings.
`It
`is tough job to
`install, optimize, control, and maintain the devices and
`systems. Those devices and systems also required additional
`new wires to setup and connect to its subsystems.
`
`[0009] The most of home electronic devices and systems
`installed now do not have the ability to be controlled by
`remote user via Internet or home network. The systems and
`devices do not take advantage of 'l'CPfIP network.
`
`[0010] The most of home security surveillance systems
`installed do not take advantage of video surveillance. A user
`may get security video surveillance system and service from
`a security companies, but the systems are more expensive
`and complex. It is needed to add extensive new wire for the
`user to install this security system.
`
`[0011] The use of video and audio devices, such as video
`and audio conferencing devices, video and audio intercom
`devices, and camera devices, has increased dramatically in
`recent years.
`
`[0012] When these audio and video devices are integrated
`into an existing house or building, the installation of new
`control wires can be very complicated and costly. There is an
`ever-growing need for transmitting live video, audio. and
`control data between different rooms or locations in the
`
`house or building or at remote locations via Internet, such as
`home video-audio intercom communication,
`real-time
`video-audio chat via Internet, video conference, video sur-
`veillance, and TV} DVD entertainment program.
`
`[0013] The conventional home automation control devices
`are very complicated to control.
`In addition,
`the home
`control devices also need the installation of a discrete set of
`
`control wires and a user house will be damaged.
`
`[0014] Power line communication systems and method
`have been used in a variety of applications, such as control
`of home lights, door openers, and electrical switches for
`many years. Power line communication systems and method
`are relatively inexpensive and reliable.
`
`[0015] There are many di|1"erent protocols to provide
`power line communications.
`
`BRIEF SUMMARY OF THE INVENTION
`
`It would be advantageous it‘ a home system includ-
`[0016]
`ing TV, DVD, a video-audio intercom, a security, a video
`surveillance. baby care and childcare, and home control. It
`is an all-in-one system.
`
`is dillicult for conventional home
`[0017] As a result, it
`electronic systems to assist the home user in carrying out
`daily activities without this all—in-one system.
`
`[0018] Accordingly, it would be desirable to provide an
`improved and multifunction home electronic system for
`entertainment, security, and automation control. This all-in-
`one system is more flexible and simpler to install and use
`than conventional systems. Moreover,
`the system takes
`advantage of power line communication without new wire
`and can be controlled over Internet or home network.
`
`invention is directed to provide a
`[0019] The present
`system and method of controlling remote home electronic
`devices coupled to home network and transmitting audio,
`video, control data between a main home control unit, user
`input device, and at least one remote home electronic device
`using power line communication or wireless communication
`that provide no new wire connection.
`
`[0020] For the most part, this invention takes advantage of
`existing home power wiring to transmit audio, video, and
`control data. The power line communication provides a best
`solution for user to install, setup, and use new home devices
`without new wiring in home or building. Not all the embodi-
`ments of the invention are restricted in to the power line
`communication. In order to take advantage of legacy audio-
`video devices, such as wireless camera, the present inven-
`tion also provides wireless communication to transmit
`audio, video, and control data.
`
`[0021] Another object ol‘ the present invention is to pro-
`vide remote control and data transfer over Internet or home
`network for user to monitor user home, control home
`electronic devices, and communicate with the devices while
`user is at remote location via Internet.
`
`[0022] Another object of the present invention is to pro-
`vide a multifunction home electronic system that has enter-
`tainment modules, security and surveillance devices, auto-
`mation control devices, and home communication devices,
`such as home video-audio intercorn. The system should be
`easily installed and maintained.
`
`20
`
`20
`
`

`
`US 2005/(}2676U5 A1
`
`Dec. 1, 2005
`
`[0023] Another object of the present invention is to pro-
`vide easily installation, maintenance, and operation. In addi-
`tion, the system can be easily upscale or downscale accord-
`ing to user desire.
`
`[0024] Additional advantages, objects, and features of the
`invention will be set forth in part in the description which
`follows.
`
`In another aspect of the present invention, there is
`[0025]
`provided an integration of the system for home entertain-
`ment, security, surveillance, automation control, and com-
`munication with existed home electronic devices using
`power line communication interface device via power line
`home network.
`
`invention, a
`In a further aspect of the present
`[0026]
`method in controlling and operating a system for home
`entertainment, security, and automation contml is provided.
`According to the method of the present invention, a user
`may select and control the system to provide entertainment
`or security or and automation control function using a user
`input device, such as remoter controller, cell phone. wireless
`PDA, and PC via Internet.
`
`In yet another aspect of the present invention, a
`[0027]
`baby watcher and childcare remote devices are provided
`which monitor and watch baby or child. In the illustrated
`embodiment, the devices comprise a camera and a plurality
`of sensors. A main control unit receives live video and audio
`
`data from these devices via power line communication link
`and sends the data to the display device. The video and audio
`data may be received from remote location via Internet.
`
`invention,
`In still another aspect of the present
`[0028]
`there is provided a security and surveillance device, includ-
`ing a plurality of sensors and cameras installed in corre-
`spondence to a place to be monitored for detecting infor-
`mation about
`intruder, a device processing unit and a
`communication interface that is connected to at least one of
`
`transmits audio and video data to and from a main control
`unit of the system or second power line phone device via
`power line communication.
`
`In another aspect of the present invention, there is
`[0031]
`provided an entertainment module, comprising TWcable TV
`module, DVDNCD player module, and Radio tuner.
`
`In another aspect of the present invention, there is
`[0032]
`provided an audio-video recorder, comprising hard drive
`capable of recording audio and video data. Thus, with the
`recorder, a user may record TV, DVD, and Radio program
`for later viewing. l-‘urther, the live video data from surveil-
`lance camera or other camera can be recorded and the user
`has a chance to review them later. In addition, the audio-
`video data file downloaded from Internet, video-audio inter-
`com, and telephone also can be recorded.
`
`is to be understood that both the foregoing
`It
`[0033]
`general description and the following detailed description of
`the present invention are exemplary and explanatory and are
`intended to provide further explanation of the invention as
`claimed.
`
`[0034] These and other objects, advantages and features of
`this invention will be apparent from the following descrip-
`tion taken with reference to the accompanying drawing,
`wherein is shown a preferred embodiment of the invention.
`
`BRIEF DES(.‘RIP'FlON 017 Tl-IE SEVERAI.
`VIEWS OF THE DRAWING
`
`[0035] FIG. 1 is a schematic illustration of a home enter-
`tainment, security, surveillance, and automation control sys-
`tem over home network communication link according to an
`example of the present invention;
`
`[0036] FIG. 2 is a functional block diagram of a main
`control unit in accordance with an exemplary embodiment
`of the present invention;
`
`the plurality of sensors and cameras and communication
`network for transmitting detecting information to a main
`control unit of the system via the communication network.
`
`[0037] FIG. 3 depicts a display device formed by a LCD
`screen,
`two speakers, and one camera according to the
`invention;
`
`In another aspect of the present invention, home
`[0029]
`automation control remote devices are provided, including a
`plurality of light or switch control devices, an NC control
`device, a sprinkler control device, cloorlgate control, VCR
`control, and a damper control device. Each device comprises
`a power line communication interface and control module.
`The device receives data or control signals from a main
`control unit via communication network, such as power line
`communication or wireless communication.
`
`invention.
`In still another aspect of the present
`[0030]
`there are also provided a plurality of video and audio remote
`devices, comprising a plurality of audio-video intercom
`devices, audio intercom devices, a plurality of power line
`speakers, and a plurality of power line phone devices,
`wherein the devices comprising a power line communication
`interface. The lirst power line phone device sends and
`receives audio data from a main control unit of the system
`or second power line phone device via power line commu-
`nication. The power ljne speakers comprising a speaker and
`a power line communication interface module receive audio
`signals from the main control unit via power line commu-
`nication network. The first audio-video intercom device
`
`[0038] FIG. 4 depicts a remote controller according to the
`invention;
`
`[0039] FIG. 5 depicts one embodiment of baby watcher
`device according to the invention;
`
`[0040] FIG. 6 is another embodiment of baby watcher
`device according to the invention;
`
`[0041] FIG. 7 depicts one embodiment of childcare device
`according to the invention;
`
`[0042] FIG. 8 is another embodiment of childcare device
`accordirlg to the invention;
`
`[0043] FIG. 9 illustrates one embodiment of surveillance
`and security device according to the invention;
`
`[0044] FIG. 10 illustrates another embodiment of surveil-
`lance and security device according to the invention;
`
`[0045] FIG. 11 shows a block diagram of Light switch
`control device according to the invention;
`
`[0046] FIG. 12 shows a block diagram of sprinkler control
`device according to the invention;
`
`21
`
`21
`
`

`
`US 2005/(}267605 A1
`
`Dec. 1, 2005
`
`[0047] FIG. 13 shows a block diagram of AC control
`device according to the invention;
`
`[0048] FIG. 14 shows on screen program menus;
`
`[0049] FIG. 15 shows a block diagram of power line
`phone device according to the invention;
`
`[0050] FIG. 16 shows a block diagram of smart plug and
`Power speaker device according to the invention;
`
`[0051] FIG. 17 shows a block diagram of audio-video
`intercom device according to the invention;
`
`[0052] FIG. 18 shows a block diagram of audio intercom
`device according to the invention;
`
`[0053] FIG. 19 shows a block diagram of damper control
`device according to the invention;
`
`[0054] FIG. 20 shows a block diagram of door and gate
`control device according to the invention;
`
`[0055] FIG. 21 shows a block diagram of three wireless
`remote devices interacting with the main control unit;
`
`[0056] FIG. 22 shows a flow chart illustrating a method of
`implementing the present invention for home entertainment,
`security, surveillance, automation control system over home
`network communication link;
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENT
`
`[0057] Referring now to the drawing. and in particular to
`FIG. 1, a preferred embodiment of a system 10 for home
`entertainment, audiolvideo communication, security, sur-
`veillance, and automation control. The system 10 illustrated
`generally includes a plurality of remote devices that are
`capable of video, audio, and control communication; a
`display device 50 that
`is capable of displaying text and
`image data; a plurality ofuser input devices that are capable
`of receiving commands from a user; a main control unit 100
`that is capable of enabling a user to set, program, and control
`the system, receiving various data from at least one remote
`device or from one of user input devices, and sending the
`audio-video data to the display device or the control data to
`at least one remote device; and a communication link 200
`that is capable of transmitting various data including text,
`image, voice, and control data between the main control unit
`and at least one remote device.
`
`[0058] The plurality of remote devices include: a baby
`watcher 210; a childcare device 211; su rveillartcc and secu-
`rity device 212; a switch control device 220; a sprinkler
`control device 222; an MC control device 226; a damper
`control device 228; power line phone 230; power line
`speaker 240; doorfgate control device 229; at least one smart
`appliance plug 260; at least one audio-video intercom device
`270; at least one audio intercom device 275; at least one
`wireless control device 254; a RF;’wireless phone device
`252; and a wireless camera and sensor device 250. The
`audio, video, and sensor data are received and transmitted
`between the main control unit and various remote devices
`
`via power Line communication link andtor RFfwireless com-
`munieation.
`
`[0059] The user input devices include a remote controller
`281, a wireless PDA 282, a cell phone 283, a remote
`computer 291, a camera 284, a wireless camera 285, a
`
`wireless microphone and speaker 286, a microphone 287,
`and a VCR 288. The user input devices receive user com-
`mands or user control signals and then transmit them to the
`main control unit 100. Further, the remote controller 281, the
`wireless PDA 282, the cordless phone 283, and a wireless
`microphone 285 wirelessly send user control signals to the
`main control unit.
`
`[0060] A user sends control signals to the main control
`unit 100 by pressing keys buttons provided on one of a
`remote control 281, cell phone 283, and wireless PIJA 282.
`A user sets the main control unit
`to different mode by
`pressing a corresponding button provided on the user input
`device. The main control unit may receive audio, video, and
`control data or signals from the digital camera or webcam
`284, microphone 28?, cable modem, and telephone line.
`There is interface connected to cell phone, not shown in
`FIG. 1. There is another interface connected to PI)/\, not
`shown in FIG. 1.
`
`[0061] The microphone 28'? sends audio data to the system
`via wired connection for audio communication. Based on
`
`the microphone 287 or wireless microphone 286 and speaker
`286, the user may implement audio communication, such as
`the running Internet voice chat, audio intercom, audio-video
`intercom, and making telephone call. Further, the user may
`use wireless microphone and speaker 286 to implement
`audio communication while the user is preparing a dinner in
`the kitchen of a home.
`
`interactive and
`[0062] The remote computer 291 is
`interoperable with the main control unit 100 for audio,
`video, sensor, and control data communication through
`external Internet network 290 or Public Switched Ielephorte
`Network 292. The remote computer comprises application
`software that is capable of control the computer to receive
`audio, video, and sensor data from the system and send
`control data to the system.
`
`[0063] The system is also provided the ability to imple-
`ment audio-video two way comrnunications with remote PC
`261, such as video conference or Internet audio—video chat.
`Additionally, the application software is needed to run such
`program.
`
`the
`[0064] Turning to FIG. I and FIG. 14, preferably,
`remote controller 281 is provided to control the system 10.
`The wireless PDA 282 and the cell phone 283 are also
`provided the ability to control
`the system. A user may
`program the system via on-screen program menus.
`
`[0065] Referring again to FIG. 1, the main control unit
`100 generates a control signal for controlling at least one
`remote device, such as surveillance & security 212, and
`handling video, audio, and sensor data from the remote
`device.
`
`[0066] The communication link 200 is power line com-
`munication network that is capable of transmitting various
`data via power line without additional hardwire connection.
`The protocols used include home plug L0, X10, and Clibus.
`
`In addition, the RF/wireless communication 190 is
`[0067]
`employed to implement audio, video, sensor, and control
`data communication between the main control unit 100 and
`at least one RF/wireless remote device, such
`the wireless
`camera device 250.
`
`22
`
`22
`
`

`
`US 2005/(}2676U5 A1
`
`Dec. 1, 2005
`
`the main control unit 100 is
`[0068] Turning to FIG. 2,
`multifunction system. The main control unit is configured to
`control the system and perform communication with at least
`one of the plurality of remote devices and user input devices
`via the power line communication link or wireless cornmt.t-
`nication link. The main control unit 100 comprises hardware
`and software that control the processing of data to and from
`the unit.
`
`[0069] The main control unit 100 includes: a system and
`data bus 110 for transmitting data and system control signals
`between the modules; a microprocessor 150 which is con-
`nected to the bus;
`a mass storage module 103 that
`is
`connected to the microprocessor over the bus; a tuner
`module 105 that
`is coupled to the microprocessor; an
`audio-video controller module 104 that is connected to the
`
`:1 wireless and IR interface
`microprocessor over the bus;
`module 102 that is connected to the rnicroprocessor over the
`bus; and a power line communication interface module 101
`that is connected to the microprocessor over the bus.
`
`In addition, the main control unit 100 also includes:
`[0070]
`a hard drive 106 that
`is capable of storing system and
`application software; a memory 107; a communication port
`module 130; and a power supply and backup battery module
`109.
`
`[0071] Basically, the microprocessor 150 is capable of
`executing instruction stored in the memory 107 or user
`command to control the system 10 and provide functionality
`including that provided by certain embodiments of the
`present invention.
`
`[0072] The memory 107 includes RAM, ROM, and
`EIEPROM. Typically it
`is capable of storing boot code
`instructions or other system infonnation.
`
`[0073] The communication port module 130 includes: a
`RS-232; USB 2.0 whose rate is 480 Mbps; 1394 whose rate
`is 400 Mbps;
`a DVI, a phone port; and Ethernet port.
`Preferably, the communication port module, the Ethernet
`port and the phone port, allows connection to an Ethernet
`based network, such as a broadband connection to a WAN or
`the Internet. The RS-232 port
`is legacy port that allows
`connection to various electronic devices. liurther, the IEEE-
`1394 port allows connection to external audio-video device
`and the DVI port communicates with external video device.
`
`[0074] The system provides rcal—time Internet connectiv-
`ity to external network, such as WAN. The Internet connec-
`tivity includes PSTN and Ethernet. For example, based on
`the communication port module, the PSTN telephone jack
`and the Ethernet port are provided in order to communicate
`with remote PC 291 and Internet. Auser may use Broadband
`to transmit various data to Internet via Ethernet port. The
`slow connection uses dial-up ISP via phone line jack to
`transmit various data. In addition, the user also may make
`phone call via the wireless MIC and speaker 286 or audio
`intercom device 275 or power line phone 230.
`
`[0075] The hard drive 106 is configured to store operating
`system, various application software, and database for the
`plurality of remote devices.
`
`the mass storage module 103 com-
`In addition,
`[0076]
`prises: a hard drive; a flash memory; and a DVD random
`access memory. Preferably, the module has the ability to
`record various data and play the data back later. The data
`
`least one of the remote devices, such as the
`include: at
`surveillance and security device or the baby watcher device;
`the audio-video intercom device; the audio intercom device;
`the power line phone device; one of the user input devices,
`such as cordless phone 283; TV and Radio module; and
`audio-video file from the Internet. With the mass storage
`module, the user may record favor TV or play DVDNCD
`program. In addition, the telephone calls, audio-video data
`from the intercom device or power line device, and audio-
`video files downloaded from the Internet can be recorded to
`the mass storage module. Finally, the mass storage module
`is provided to record video, audio, and sensor data from at
`least one of the surveillance and security devices.
`
`[0077] The DVD random access memory in the module
`103 is coupled to the microprocessor 150 via the bus 110 and
`designed for playing digital versatile disk (DVD) and video
`compact disk (VCD). With the DVD random access
`memory, the user may enjoy DVD and VCD programs using
`LCD display device 50.
`
`[0078] The TV and Radio tuner module 105 is coupled to
`the microprocessor via the bus and designed for receiving
`TV, cable TV, and Radio signals. The TV and Radio tuner
`module is capable of receiving broadcasting signals, such as
`TV, cable TV, and Radio.
`
`[0079] The TV and Radio tuner 105 receives various
`broadcasting signals includes cable and satellite signals. A
`user may set system 10 to TV or Radio mode, and then the
`main control unit sends signals to the tuner module and
`video-audio controller. On the other hand,
`the video and
`audio signals are outputted through the LCD display 50 and
`speaker 53, respectively. The display device can also receive
`signals from DVDNCD player module 103 if a user sets the
`main controlunit to DVDNCD player mode. The system 10
`will work as home entertainment center now.
`
`[0080] The audio-video controller module 104 is coupled
`to the microprocessor, the DVD module, and the TV and
`Radio tuner module via the bus. The controller interface
`
`module is capable of receiving signals from the bus, the
`DVD module, and the TV and Radio tuner module, and then
`sending audio and video data to the LCD display device to
`display associated images and texts. The control module also
`receives video data from the camera 53 in LCD display
`device 50, in FIG. 3.
`
`[0081] The Rlifwireless. and IR interface module 102 is
`coupled to the bus 110 and configured to transfer various
`data to the microprocessor. The protocols of the interface
`module 102 comprise an IEEE 802.11 standard to imple-
`ment wireless communication and cordless telephone stan-
`dard. The interface module 102 also includes an IR and RF
`
`transceiver that is capable of wirelessly sending and receiv-
`ing various data between the module 102 and at least one of
`user input devices. The interface rnodule receives control
`signals from the remote controller or the cell phone or a
`wireless PDA and then the microprocessor outputs a control
`signal to perform a desired function in response to the user
`signals.
`
`the interface module 102 is
`[0082] On the other hand,
`configured to provide an interface between the main control
`unit and at least one of the remote devices, such as the baby
`watcher device 210. The module wirelessly receives video,
`audio, sensor, and control data from at
`least one of the
`
`23
`
`23
`
`

`
`US 2005/(}2676U5 A1
`
`Dec. 1, 2005
`
`plurality of wireless remote devices, such as RFiwireless
`camera 250. Meanwhile, the module sends control data to at
`least one of the devices. For example,
`the