MWWMWWMWW 10000000“
`
`U8007136709BZ
`
`US 7,136,709 132
`(10) Patent No.:
`(12) Umted States Patent
`
`Arling et al.
`(45) Date of Patent:
`Nov. 14, 2006
`
`(54) HOME APPLIANCE CONTROL SYSTEM
`AND METHODS IN A .VETWORKED
`ENVIRONMENT
`
`(75}
`
`Inventors: Paul I). Arllng. Irvine. CA (US);
`Jeremy Black. Santa Ana. CA (US):
`Christopher Chambers. Stanton. CA
`(US); Mauro Dresti. West Covina. CA
`(US): Patrick H. Hayes. Mission Viejo.
`CA (US): Robert [.illeness. Cypress.
`CA (US): Wayne Scott. Newpon
`Beach. (.‘A (US): Allen Yuh. Diamond
`Bar‘ CA (”3)
`
`(73} Assignee: Universal Electronics Inc.. Cypress.
`CA (US)
`
`(‘1‘) Notice:
`
`Snbjectto any disclaimer. the term ol'this
`patent is extended or adjusted under 35
`U.S.C. 15403] by 18 days.
`
`[21} Appl. No.‘. 101978.860
`
`[58}
`
`70010—13.
`Field of Classification Search
`200107. 19, 20. 65; 7091001224. 217—219.
`709l249. 250: 2100—6. 8—11. 15—19. 105.
`”1101305. 306. 311 315: 340500. 531. 539.1,
`
`(56)
`
`3405539-14-3-1‘3‘5
`See application file for complete search history.
`References Cited
`..
`‘
`'
`‘
`..
`‘
`U-S‘ Part-NI IXXUMRN | 5
`4.804389 A
`131990 Yee
`
`(Continued)
`FOREIGN PA’l‘FNl' DOCUMENTS
`
`EP
`
`(1561435 A2
`
`argon}
`
`_
`(Contained)
`
`OTHER PUBLI(.‘M‘]()NS
`
`Pronto UserGuide. Universal Electronics Inc.. 1999. pp. 1-56.
`Primers Examiner—Crystal .l. Barnes
`[74} Attorne'i'. Agent. or Firm—Gary R. Jarosik
`
`(22)
`
`Filed:
`
`Nov. 1, 2004
`
`[57]
`
`ABSTRACT
`
`(65}
`
`Prior Publication Data
`US 200510096253 A1
`May 5. 2005
`
`(60}
`
`(5])
`
`Related [1.5. Application Data
`_
`‘
`_
`_
`.
`Provtstonal application No. 60517-233- hled 0'1 N0“
`45 2003-
`.
`Int. Cl-
`0053 I933
`0053 [5/02
`(1053 um
`0053 23/02
`0083 1/03
`H04Q 7/00
`
`{2006-01}
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`(52} U.S. (.‘l.
`
`700165;?001’91701111’17:
`.
`than 9: 5001120; 34013.1: 3401539. 14
`
`A home control and automation system and method. The
`system generally includes one or more wireless remote
`controls.
`a plurality of appliances (including network
`enabled appliances and traditional legacy appliances in the
`exunplary system). associated conlrol centric devices. and
`associated content centric devices. Various methods for
`control and operation of appliances in the networked home
`control and automation environment are disclosed. Specifi-
`cally. methods are disclosed which enable advanced home
`control featttrcs such as location based control setup and
`operation. network enabled legacy appliances and system
`integration. save and recall capabilities for appliance and
`media states. generic command based appliance controls.
`dynamiclcomplex macro command generation. and lnteniet
`based control capabilities from remote locations are dis—
`closed in conjunction with the system of the current invert-
`lion.
`
`16 Claims, 6 Drawing Sheets
`
`
`
`Roku EX1016
`
`US. Patent No. 9,716,853
`
`Roku EX1016
`U.S. Patent No. 9,716,853
`
`

`

`U .S. PATENT DOCUMENTS
`_
`Skinner
`MacFadyen et a1.
`Welly
`1121110an
`Baskm 91 111-
`Golds1em
`Lenchlk
`Sclkef
`Hamlin
`Rothmuller
`Small et 31-
`Kuma!
`I-MNSE‘L 1']-
`1211191519181-
`Nelson
`Aim? el 41-
`Ivie et al.
`Fora-311
`Women
`Lee at a].
`394314
`50110111 ‘4 31-
`hue 01 3]-
`31111-119 et a1.
`Dlehl et 41-
`Montalbano
`Husrnqellerelal-
`11611111110101.
`Nakano 91 111-
`Mankom
`Goulden et 41-
`Yuen ct al-
`11-9119 11l-
`Schem e1 111-
`Barbee ct 31'
`Ethcrcdgc
`353.13....“ E. a].
`27:; z :3-
`'
`Lea
`13:1”:
`.
`1, P0
`Va" RY“
`15331:: :1‘ :11
`Rmn ct a],
`Ludee et a].
`
`41'1991
`311992
`4.-"1992
`311994
`411994
`4.11995
`911996
`101'1996
`11.11996
`611997
`61'1997
`711997
`711997
`911997
`1.11998
`3.11998
`3.11998
`511998
`61'1998
`611998
`811998
`911998
`9-"1998
`101’ 1998
`11.11998
`1111998
`ll-"1998
`511999
`511999
`6.11999
`911999
`|01'1999
`|0.-"1999
`12-"1999
`1211999
`1.12000
`212000
`212000
`312000
`7.32000
`812000
`812000
`1012000
`I01"2000
`1012000
`10:"2000
`1112000
`
`5.005.084 A
`5.101.191 A
`5.109.222 A
`5.293.357 A
`5.307.055 A
`5.410.326 A
`5.552.806 A
`5.565.888 A
`5.574.964 A
`5.635.989 A
`5.642.303 A
`5.648.760 A
`5.652.613 A
`5.671.267 A
`5.710.605 A
`5.724.106 A
`5.727.055 A
`5.751.372 A
`5.761.606 A
`5.767.919 A
`5.793.438 A
`5.801.787 A
`5.815.086 A
`5.828.419 A
`5.835.864 A
`5.838.775 A
`5.855.006 A
`5.900.875 A
`5.901.366 A
`5.915.026 A
`5.956.025 A
`5.970.206 A
`5.974.222 A
`6.002.394 A
`6.002.450 A
`6.018.372 A
`6.020.881 A
`6.028.599 A
`6.040.829 A
`6.085.236 A “
`6.097.441 A
`6.104.334 A
`6.127.941 A
`6.130.726 A
`6.133.909 A
`6.137.549 A
`6.148.241 A
`
`US 7,136,709 32
`Page 2
`
`
`
`1041210
`621121
`
`1112000 Schcin ct ill.
`6.151.059 A
`112001 Elheredge
`6.112.614 E.
`112001 Alexander 61 a].
`6.111.931 B.
`212001 Ketcham
`6.195.589 B
`412001 Choi 6161.
`6.211.856 B1
`41200]
`Immidis e161.
`5.219.694 B
`112001 Allport
`6.256.019 B1
`812001
`13611566 ct a].
`6.218.499 131
`91200] Kushiro eta].
`6.285.357 B.
`112002 Schcin at 8.1.
`6.341.314 131
`412002 Barnett et 61.
`6.369.340 B.
`412002 Shima el a].
`6.381.507 B.
`62002 Sam
`6.408.435 B
`812002 Huang ct a1.
`6.431.336 B1
`212002 Obeneutrer 61 31.
`6.438.523 B 1
`912002 Sharood el al.
`6.453.687 B. 1
`1012002 Godfrey c1111.
`6.463.463 B1
`312003
`2166111 el al.
`6.532.589 B.
`31200.1 Kawajiri
`6.538.556 B1
`512003 Kelnink eta].
`6.563.430 B.
`612003 131661116161.
`6.577.350 B-
`612004 Howard ...................... 3451158
`6.141.632 B 1
`612004 Davies at al.
`6.153.190 B1
`912004 Krzyzanowski ct 111.
`6.792.323 B1
`1012004 Balasubramaniam el 111.
`6.803._728 B1
`212005 Park ........................... 34011.1
`6.850.149 B. 1
`.. 3401533
`612005 11:16 der Meulen .
`6.906.611 B. 1
`
`.. 332.1100
`812005 Roberlsei a].
`6.931.142 B. 1
`
`1112005 Diong ...........
`1091224
`6.965.935 B 1
`
`512006 Dubmvsky el al.
`.. 109.1225
`1,051,101 B 1
`612003 Ghulam ...................... 3451113
`200310111316 411
`1112003 Wilding Ct 31.
`200310212163 .41
`200310233432 A1“ 1212003 Davis 01 a].
`................ 1091222
`
`112004 Krzyzanowski cl :1.
`200410133104 .411
`1091250
`200410203387 A11 1012004 (3161mm:
`4551412
`200510035846 .41
`212005 Zigmond el al.
`2005100180811 111 1
`412005 Davis at a].
`................ 3451163
`
`.
`1091220
`
`FOREIGN PATENT DOCUMENTS
`0961191 A2
`1211999
`EP
`0987888 A1
`312000
`EP
`1204275 112
`5.2002
`El,
`2343013 .4
`412000
`GB
`2001209551 11
`812001
`JP
`wo 00140016
`112000
`wo
`we 00158935
`1012000
`we
`1110 0120512 A1
`3.2001
`wo
`“ cited by examiner
`
`

`

`U.S. Patent
`
`Nov. 14,2006
`
`Sheet 1 of 6
`
`US 7,136,709 B2
`
`500
`
`I Server
`
`Translation I
`
`Command Passing
`
`E:
`
`/ mmm
`
`\
`
`\\
`6) A
`®
`-.| 12
`
`x,
`
`x
`
`“I
`
`u'
`
`I]
`
`'n
`'1
`
`AN1
`
`G)
`®
`
`---
`\—\
`Orlrul
`
` "
`
`r/
`\ (CC-x
`
`C
`
`F‘Ctlilll
`
`4"
`
`\
`
`I
`
`1‘
`
`J'
`
`f
`
`/r‘
`
`H. ugh—- ,
`
`‘N.
`
`I,
`
`\
`
`14
`
`HUB
`
`Source 2
`
`Appliance 2
`Server i Content
`
`Networked
`
`12.16
`
`FIGURE 1
`
`

`

`US. Patent
`
`Nov. 14,2006
`
`Sheet 2 of6
`
`US 7,136,709 32
`
`38
`
`Power source
`
`
`
`
`
`Microcopmcessor
`
`Key matrix
`
`Visual feedback
`device
`
`36
`
`Audio feedback
`device
`
`Transmitting
`circuit
`
`32
`
`Non-
`volatile
`
`memow
`
`34
`
`Clock and
`timer logic
`
`2?
`
`30
`
`24
`
`FIGURE 2
`
`

`

`US. Patent
`
`Nov. 14,2006
`
`Sheet 3 of6
`
`US 7,136,709 32
`
`I:
`
`55
`I Transmitter
`
`- momma
`
`memory
`
`ROM
`memory
`
`memory
`
`56
`
`52
`
`51
`
`' ible
`LED
`
`§
`
`58
`
`
`
`ES
`'3
`Ea.
`
`3 E5
`
`Clock and
`timer logic
`
`53
`
`50
`
`FIGURE 3
`
`h
`
`62
`
`”mm“ I
`
`|=|
`Crystal
`
`

`

`US. Patent
`
`Nov. 14,2006
`
`Sheet 4 of6
`
`US 7,136,709 BZ
`
`Virtual Nclwqu
`Layer
`JP Registry
`
`Conum Manager
`
`Comm! Gateway
`
`Content
`Delivery
`
`
`
`Conical
`Somcing
`I
`4—
`
`FIGURE4
`
`7’4
`
`

`

`U.S. Patent
`
`Nov. 14, 2006
`
`Sheet 5 of6
`
`US 7,136,709 B2
`
` PC with Home
`
`Automation
`
`FIGURE 5
`
`

`

`U.S. Patent
`
`Nov. 14,2006
`
`Sheet 6 of6
`
`US 7,136,709 B2
`
`602
`
`Recietire User Input
`
`503
`
`604
`
`601
`
`
`
`
`
`
`
`
`
`
`
`
`
`Portable Defies.
`
` 620
`
`Normalize input
`
`Action descriptor
`
`Local andror remote
`databasels}
`-
`Key codes
`-
`Key.I labels
`-
`Phonics
`Thesaurusrdict‘aonary
`cross-referenced to
`action descriptors
`
`100
`
`650
`
`3/
`
`Control Pod
`
`Select device
`(location and
`aoriuity based}
`
`Translate action
`and retrieve
`Looal andror remote
`
`command data.
`database
`based on action
`
`'
`Ration descriptors
`descnptor and
`-
`Davloetypai’model
`device
`cross-rererenced to
`command codes
`
`
`
`
`
`Issue device
`
`FIGURE 6
`
`

`

`US 7,136.?09 32
`
`1
`HOME APPLIANC E CONTROL SYSTEM
`AND METHODS IN A NETWORKED
`ENVIRONMENT
`
`RELATED APPLICATION DATA
`
`This application clainrs the benefit of US. Provisional
`Application Ser. No. 604517.283 filed on Nov. 4. 2003.
`which application is hereby incorporated by reference in its
`entirety.
`
`It]
`
`BACKGROUND
`
`The following relates generally to home control systems
`and, more particularly. relates to a system and associated
`methods for controlling and operating a plurality of home
`appliances from a variety of dilferent locations in a net-
`worked home control and automation environment.
`
`Current home appliances and associated remote controls
`(“legacy” appliances) have limited functional abilities and
`minimal
`interoperability features. Emerging advances in
`wireless and distributed computing technologies. coupled
`with network enabled home appliances (suclt as those that
`may be addressed. accessed. monitored. and managed
`remotely over networks and the Internet) and industry wide
`interoperability standards (e.g.. Universal Plug and Play
`(“UPnP”) and Home Audio Video interoperability (“HAW“)
`standards) provide a rough framework for network enabled
`Ironic environments having increasingly integrated home
`control capabilities. functions. and features. A background
`and overview of home interoperability technologies and
`projected features may be found in the Intel Technical
`Journal. Volume 6. Issue 4. published Nov. 15. 2002 entitled
`“Interoperable l-Iome Infrastructure” which is fully incorpo-
`rated by reference herein.
`Though promising in their goals and objectives. the UPnP.
`l-lAV'i. Intel Interoperability Infrastructure. etc. do not cur-
`rently provide for many advanced control based features
`relating to networked home control and automation envi-
`ronments. Accordingly. it is desired to provide a system and
`method that functions to enable advanced home control
`
`features such as location based control setup and operation.
`network enabled legacy appliances and system integration.
`save and recall capabilities for appliance turd media states.
`genetic cormnand based appliance controls. dynamicr’com-
`plex macro command generation. and lntemet based control
`capabilities froln remote locations. Additional
`inventive
`features and functions will also be evident from the home
`appliance control system and methods hereinafter described.
`
`SUMMARY
`
`In accordance with these needs and desires. a control
`system and associated methods for control and operation are
`described for use in a networked home control and automa-
`tion environment.
`Generally.
`the system includes one or more wireless
`remote controls, a pltlralily ofappliances (including network
`enabled appliances and traditional legacy appliances in the
`exemplary system). associated control centric devices (gen-
`erally devices whose chief function is providing control
`based liJnctions and services. including but not limited to
`control pods. control servers. device state monitors. etc.) and
`associated content centric devices [generally devices whose
`chief function is providing content based l'tutctions and
`services.
`including but not
`limited to content managers.
`content servers, content renderers. etc).
`
`21']
`
`I.) 1):
`
`3t]
`
`35
`
`5th
`
`55
`
`till]
`
`2
`
`Additionally, various methods for control and operation
`of appliances in the networked home control and automation
`environment are disclosed. Specifically. methods that lime-
`tion to enable advanced home control
`features such as
`
`location based control setup and operation. network enabled
`legacy appliances and system integration. save and rmall
`capabilities for appliance and media states. generic com-
`mand based appliance controls. dynamicloomplex macro
`command generation. and Internet based control capabilities
`from remote locations are disclosed in conjunction with the
`system of the current invention.
`A better understanding of the objects. advantages. fea-
`tures. properties and relationships of the subject system and
`methods will be obtained from the following detailed
`description and accompanying drawings which set
`forth
`illustrative embodiments which are indicative of the various
`
`ways in which the principles of the system and method may
`be employed.
`
`BRIEF DESCRIPTION OF" THE DRAWINGS
`
`For a better understanding of the system and method
`described hereinafter. reference may he had to preferred
`embodiments shown in the following drawings in which:
`FIG. 1 illustrates an exemplary networked home control
`and automation system:
`FIG. 2 illustrates a block diagram of components of an
`exemplary remote control:
`FIG. 3 illustrates a block diagram of components of an
`exemplary control device;
`FIG. 4 illustrates an exemplary network enablement
`device:
`
`FIG. 5 illustrates a VPN implemented with the networked
`home control environment: and
`FIG. 6 illustrates an exemplary system for implementing
`a generic command structure within a home appliance
`network.
`
`DETAILED DESCRIPTION
`
`With reference to the Figures. an integrated home control
`system and associated control and operation methods are
`described for use in a networked home control and automa-
`tion environment.
`
`The system envisaged by the current invention provides
`for both the interoperability of various network enabled and
`legacy home appliances. and advanced command and con-
`trol functions for such appliances. To this end. the networked
`home control and automation system (shown generally in
`FIG. 1) includes one or more remote controls 10. a plurality
`of appliances 12 (including network enabled appliances and
`traditional
`legacy appliances in the exemplary system).
`associated control centric devices 14 (generally devices
`whose chief lilnction. is providing control based functions
`and services.
`including. but not
`limited to. control pods.
`control servers, device state monitors. etc.) and associated
`content centric devices 16 (generally devices whose chief
`function is providing content based functions and services.
`including. but not
`limited to. content managers. content
`servers. content renderers. etc.].
`By way of example only. the appliances 12 may include.
`but are not
`limited to.
`televisions. VC Rs. DVRs. DVD
`players. cable converter boxes. amplifiers. CD players. game
`consoles. home lighting. drapery. fans. HVAC systems.
`thermostats. personal computers. security systems. network
`enabled automobiles. etc. According to the exemplary sys-
`tem. some or all of the above devices. appliances. and
`
`

`

`US 7.136.209 32
`
`4
`
`24 (a so called “microcontroller”] and. as such. they are
`shown separately in FIG. 2 only for the sake of clarity.
`To identify home appliances by type and make (and
`sometimes model) such that the remote control device It) is
`adapted to transmit recognizable command codes in the
`format appropriate for such identified appliances 12. data
`may be entered into the universal remote control device 10.
`Since methods for setting up a remote control to control the
`operation of specific home appliances are well-known. such
`methods need not be described in greater detail herein.
`Nevertheless.
`for additional
`information pertainirtg to
`remote control setup. the reader may turn to US. Pat. Nos.
`4.959.810. 5.614.906. and 6.225.938. It will also be appre~
`ciated that the remote control 10 may be set up to control an
`appliance ]2 by being taught the command codes needed to
`control such appliance as described in US. Pat. No. 4.623.
`887.
`
`1t]
`
`3
`components are configured to be network enabled and
`interoperable (eg. as defined and described in the UPnP
`and/or HAW specifications which can be found at
`tlte
`upnporg Web site and the haviorg Web site respectively.
`which specifications are incorporated herein by reference in
`their entirety) such that basic device addressing, accessibil-
`ity. monitoring. remote management. and other network
`communication based features are possible in a home con—
`trol and autontation environment. The networked home
`
`control and automation environment 100 itself may utilize
`well known centralized networking methods. ad hoc net-
`working methods (including peer-to-peer networking). pow-
`erline or phoneline based networking methods. or a combi-
`nation of the above (whether wired or wireless)
`to
`accomplish the features and goals of the present invention.
`Additionally.
`it will be appreciated that particular appli-
`ances. devices. and components of the exemplary system
`may incorporate some or all of the features, Functions. and
`capabilities of other individual devices such that a minimal
`number of separate physical devices are required in a given
`home environment to accomplish the goals of the current
`invention. For instance. devices such as a Media Center PC
`or network enabled TV (eg. one compliant with the UpnP
`andlor HAW specifications) ntay include.
`in additional to
`standard computing andt'or audiot'video playback fitnctions.
`system wide control capabilities. content tnanagctnent and
`rendering abilities. and location based services. As such it
`will be appreciated that the various system elements defined
`attd described herein should be considered as functional
`modules capable of implementation individually or collec-
`tively in a single physical device or a software module in a
`software product. or one or more elements may be imple-
`mented in separate physical devices or software tnodttles.
`without departing front the scope and spirit of the present
`invention.
`
`Looking now to FIG. 2. for use in transmitting command
`codes. generic commands. macro commands. etc. to one or
`more of the appliances (both network enabled attd legacy)
`the remote control 10 may include. as needed for a pru'ticular
`application. a processor 24 coupled to a memory device
`(such as ROM memory 26. RAM memory 27. andfor a
`non-volatile memory 34). a key matrix 28 (cg. physical
`buttons. a touch screen display. or a combination thereof). an
`internal clock attd timer 3|).
`transmission circuit(s) 32.
`receiver circttit(s} 33. andlor transceiver circuit[s) (e.g.. IR
`andi’or RF). a means 36 to provide feedback to the user (cg.
`LED. display. speaker. andi‘or the like). and a power supply
`38 as generally illustrated in FIG. 2. As will be understood
`by those of skill in the art. the memory device may include
`executable instructions that are intended to be executed by
`the processor 24 to control
`the operation of the remote
`control 10. Ill this manner. the processor 24 may be pro-
`grammed to control
`the various electronic components
`within the remote control 10. e.g..
`to monitor the power
`supply 38. to cause tlte transmission of signals. etc.
`the non-volatile readt'write memory 34. for example an
`lit-EPROM. battery-backed up RAM. Smart Card. memory
`stick. or the like. may be provided to store setup data attd
`parameters as necessary. It is to be additionally understood
`that the memory devices may take the form of any type of
`readable media. such as. for example. ROM. RAM. SRAM.
`FLASH. EEI’ROM. Stuart Card. memory stick. a chip. a
`hard disk. a magnetic disk. andfor an optical disk. Still
`further.
`it will be appreciated that some or all of the
`illustrated memory devices 26. 27. and 34 may be physically
`incorporated within the same IC chip as the microprocessor
`
`20
`
`3t]
`
`35
`
`To cause the remote control 10 to perform an action. the
`remote control 10 is adapted to be responsive to events. such
`as a sensed user interaction with the key matrix 28. receipt
`ofa transmission. etc. in response to an event. appropriate
`instructions within the memory 26 may be executed. For
`example. when a command key is activated on the remote
`control 10. the remote control ll] may retrieve a command
`I.) .1:
`. code corresponding to the activated cotrmtand key front
`memory 26 and transmit the command code to a device in
`a format recognizable by the device. It will be appreciated
`that the instructions within the memory 26 can be used not
`only to cause the transmission of command codes andt'or
`data to the appliances 12 but also to perform local opera-
`tiotts. e.g.. location based features and ftutctions as described
`in greater detail below. While not
`limiting. other local
`operations that may be perforated by the remote conuol 10
`include displaying inl‘urmationldata, favorite channel setup.
`macro button setup. function key relocation. etc. Examples
`of local operations can be found in US. Pat. Nos. 5.481.256.
`5.959.751. and 6.014.092. Additional examples of remote
`controls 10 may be found in commonly owned. U .8. Pat. No.
`6.225.938 and U.S. application Ser. Nos. 60l264.?fi?.
`091905.423. 09.005432. and 09l905.396.
`Remote control 10 may also include. as needed for a
`particular application. CCU or other imaging sensors. micro-
`phone. andt'or touchscreen display for receipt of various
`types of user input for effecting operations of the remote
`. control. Remote control 10 may also be configured to
`include appliance. control server. and cotttent server func-
`tiotts. as will be described in greater detail below. For
`instance. remote control 10 may be implemented on a laptop
`computer. smart panel. tablet PC. wireless enabled PDA.
`mobile phone. etc which may all include programming to
`cause remote control 10 to playback music. videos. pictures
`and the like. monitor appliance feature and state tables for
`advanced control functions. and include programming for
`location determination methods. Remote control 10 may
`thus be viewed as a wireless appliance having functions
`similar to less portable appliances of the networked control
`environment. and as such the following discussions and
`descriptions of the remote controls. and controlling devices
`itt general. should be taken in the broadest sense possible.
`Each network enabled appliance of the system (including
`legacy appliances that
`ltave been network enabled as
`described itt greater detail below) include. or are assigned a
`unique address. According to the exemplary embodiment.
`this address is in the form ofa Uniform Resource Identifier
`[URI] which can be any Uniform Resource Locator (URL)
`or Uniform Resource Name (URN). typically assigned via a
`control server of the system. such that all appliances in
`
`5th
`
`55
`
`64]
`
`65
`
`

`

`US 7,136.?09 32
`
`5
`communication with the control server may be accessed
`from at least the control server. It will be appreciated that
`multiple appliances may include control and addressing
`functions in a given system such that each individually
`addressed appliance may be accessed by multiple control
`servers, control pods. or other control devices. Additionally.
`it will be understood that networked devices need not
`
`include fitlly functional web server applications or similar
`features. but may be configured to simply broadcast andfor
`listen on specified [P ports to accomplish system connec-
`tivity and communications
`Network enabled appliances of the system additionally
`include basic featttre and state reporting functions for
`enabling other appliances, control scrvcr(s). and retnote
`control(s) to readily ascertain the available control functions
`of an appliances. and the current state of the control flinc-
`tions. As will be appreciated by those skilled in the art. art
`Extensible Markup Language (XML) or similar format may
`be used to transmit and receive such inlbrmation between
`
`appliances. servers. and remote controls. It is also possible
`to modify the UR] or other unique identifier assigned each
`appliance such that contained in each appliance address is art
`indication ofthe available functions. and even an indication
`of current appliance state. One method of implementing
`such a system would be to include appropriate device code
`identifiers (e.g.. an IR command library, individual IR code,
`andi'or graphical user interface element reference numb-crisp
`in the UK] for each appliance, thus broadcasting capabilities
`[and thus available features) of the device to any control
`server with access to the associated device library. One
`exatnple
`appliance
`address
`(URI) may
`be
`“httpdr’
`123.456.789.0fwxyz." where “123.456.7890" is the main
`appliance address. and “wxyz” in the reference number
`corresponding to an IR command code set for that particular
`appliance.
`For enabling frequent feature set and state updates of
`appliances present in the networked control environment on
`associated control servers and remote controls. well known
`multicasting methods for appliance advertising and discov-
`ery may be used (e.g.. IP Multicasting). In this way appli-
`ances. servers. and remote controls may easily monitor and
`register feature set and state changes on the networked
`control environment.
`As described above and shown in FIG. 1, the control and
`content servers (including control pods. commandi’state
`monitors. content renderers. etc.) of the present invention
`may be separate devices. may be incorporated into one or
`more of the appliances such that no individual “server
`devices“ are present. etc.
`thctionally. content centric
`devices can serve as a repository for digital media files
`(audio, video. photo. and multimedia content). offer search
`and cataloging based services, and serve tiles to one or more
`appliances for playback. Generally computing based devices
`such as Media Center PCs. “Content Servers.“ and “Con-
`tent Renderers.“ as defined and described in. for example.
`the UPnP specification. are examples of content centric
`devices in a home control and automation enviromnent.
`(.‘ontrol centric devices generally function to receive.
`save. process. and transmit media and state data for appli-
`ances and devices of the home control and automation
`
`environment. Various types of command data (IR. RF.
`I’owerline commands. Plioneline commands. etc.) may be
`saved by commandi'state monitors as described in greater
`detail below. Whether implemented on a single device. or
`distributed across multiple devices in the home control and
`automation cnvimnrnent, these control devices are capable
`of perforating logic based operations on saved command
`
`6
`remote control
`and state data for use with appliances,
`interfaces. and desired user functions. Preset control instruc-
`
`tions on control devices may dictate how and when com-
`mand and state data is captured and processed. or user
`interaction with an appliance or remote control device may
`dictate the manner of command and state data capture and
`processing. Saved auditor processed command and state
`playback may likewise be efiectttated by preset instructions.
`automated system processes. or user interaction with appli-
`ances and devices of the system.
`Generally. the functions perfortned by a particular control
`device will depend on included firmware. software and
`programming, additional components. and level of integra~
`tion with other appliances of the system. As such the general
`control device as shown tn’td described in FIG. 3 may be
`configured and modified as further described herein to
`function as a location signaling device. network enablement
`device. cornmandr’state monitor, control pod. network bridge
`(such as for example an IR. RF. X-IO. or Simple Control
`Protocol (SCP) bridge). or any combinatiott of the above.
`The control device may also be fully incorporated into any
`of the appliances of the home environment as a functional
`element (i.e., as a service or application software running on
`the appliance).
`For use in accomplishing one or more of the above
`described control
`featttres in the networked control and
`
`automation system. a control device 14 is described. The
`control device 14 may be a device separate and apart from
`the other systent appliances or may be integrated into one or
`more of the appliances as is illustrated in FIG. I. In either
`case. the control device 14 may include. as needed for a
`particular application. a processor 50 coupled to a memory
`device (such as ROM memory 52, RAM memory 51. andr’or
`non-volatile rcadfwrite memory 56). an internal clock and
`timer 53. receiver circuit[s) 54. transmission circttit[s) 55
`auditor transceiver circuitfs) (e.g._. IR andfor RF). a means 58
`to provide feedback to the user (cg. LED. display. speaker.
`andror the like), a power supply 62. and inputroutput means
`64. (eg. serial
`Ir'O port, wireless transceiver. bar code
`scanner. X—lO bridge. SCP Bridge. Ethernet port. etc). as is
`generally illustrated in FIG. 3. The memory device may
`include executable instrLIctions
`that are intended to be
`
`It]
`
`21']
`
`I.) 1):
`
`3t]
`
`35
`
`5th
`
`executed by the processor 5|) to control the operation of the
`control device 14. In this manner, the processor 50 may be
`. programmed to control the various electronic components
`within the control device 14. e.g..
`to monitor the power
`supply 62. to cause the transmission ot‘signals. to provide
`audio or visual prompts to a user. etc. The non-volatile
`readfwrite memory 56. for example an EEPROM. battery—
`backed up RAM. Smart Card. memory stick. or the like. may
`also be provided to store setup data and parameters as
`necessary. While the memory 52 is illustrated and described
`as a ROM memory. memory 52 can also be comprised ofany
`type of readable media. such as ROM. RAM. SRAM,
`FLASH. EEPROM. or the like. Preferably. the memory 56
`is non-volatile or battery-backed such that data is not
`required to be reloaded after battery changes. In addition. the
`memories 51. 52 and 56 may take the form of a chip. a hard
`disk. a magnetic disk. andt'or an optical disk. It will also be
`appreciated that in cases where control device capability is
`integrated into an appliance. some or all of the functional
`elements described above in conjunction with FIG. 3 may be
`combined with similar elements already present
`in the
`appliance for other purposes.
`It will be appreciated that the abovementioned transmitter
`55. receiver 54, andfor inputr’output means 64 may be used
`to connect control device 14 to one or more networked
`
`55
`
`till]
`
`

`

`US 7,136,?09 32
`
`7
`appliances, content servers. computers. the lntcrnct. or other
`devices and appliances ofa networked home control envi-
`ronment. As such prograrmning and instructions on the
`control device may control the operation of other devices
`and appliances in tlte system. access content and command
`data stored or maintained either entirely or in part at a
`location physically separate front the control device 14 (such
`as for example in a server or personal comptrter located
`elsewhere in the ironic or rcntotely via the Internet}. and
`communicate wirelessly with a remote control
`tntit
`to
`accomplish command and control features of the current
`invention.
`in order to enable location based control and automation
`ftmctions, a remote control position determination system
`and method is described in conjunction with the networked
`control environment of the present invention. In general. the
`remote control position determination system includes one
`or more location signaling devices within multiple control
`environments (or control zones). each control environment
`including home appliances operable by the remote control.
`In one exemplary system of the remote control position
`determination system. a location signaling device (i.e.. one
`implementation of control device 14) is placed within each
`control environment in order to send one or more signals to
`the remote control for location determination operations.
`Various methods for determining the location ofthe retnote
`control relative to the various control environments and
`
`mncs. or similarly determining the proximity of various
`home appliances to the remote control are disclosed. as well
`as methods for using determined location infonnation to
`dynamically reconfigure default command set andi'or macro
`conunands on the remote control to control a desired appli-
`ance or multi-appliance function. An exemplary remote
`control position determination system and method is
`described in greater detail in US. provisional patettt entitled
`“System And Method for Controlling Device Location
`Determination” (Ser. No. 68611588) which is owned by a
`common assignee and incorporated herein by reference in its
`entirety.
`By implementing a remote control location determination
`system with the networked home control environment of the
`present invention. many additional functions and features
`can be accomplished. For instance. a remote control may
`determine its location based on appliance signaling and
`unique identifiers.
`then the location data for the remote
`control may be formatted and broadcast as a data transmis-
`sion (i.e.. XML format or in a URI as described below) to all
`appliances in the envirorunent. In this way. specific location
`based services and functions may be performed by any and
`all devices in the networked environment on an ongoing
`basis based on the broadcast remote control location state
`data. It will be appreciated that the determined state data
`may be published as a device feature or state of the remote
`control (or by any other appliance in the system having
`access to remote location data) using for example Simple
`Service Discovery Protocol (881)?) XML. or other methods
`as described in the UPnP specification.
`It may also be
`pos