a2) United States Patent
`US 7,379,778 B2
`(10) Patent No.:
`’
`
`
` Hayesetal. 45) Date of Patent: May 27, 2008
`
`
`US007379778B2
`
`(54) SYSTEM AND METHODS FOR HOME
`APPLIANCE IDENTIFICATION AND
`CONTROL IN A NETWORKED
`ENVIRONMENT
`
`(75)
`
`Inventors: Patrick H. Hayes, Mission Viejo, CA
`(US); Jeremy Black, Santa Ana, CA
`(US)
`(73) Assignee: Universal Electronics, Inc., Cypress,
`CA (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`(21) Appl. No.: 11/491,758
`
`(22)
`
`Filed:
`
`Jul. 24, 2006
`,
`
`(65)
`
`:
`sas
`Prior Publication Data
`US 2006/0259184 Al
`Nov. 16, 2006
`
`Related U.S. Application Data
`(60) Division of application No. 11/047,441, filed on Jan.
`31, 2005, now Pat. No. 7,155,305, which is acon-
`tinuation-in-part of application No. 10/978,860, filed
`.
`uo
`on Nov. 1, 2004, now Pat. No. 7,136,709.
`(60) Provisional application No. 60/517,283,filed on Nov.
`4. 2003
`°
`Int. cl
`GO6F 1900
`GO6F 7/00
`
`,
`
`(51)
`
`2006.01
`(
`01)
`(2006.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`4,623,887 A
`11/1986 Welles, II
`4,894,789 A
`1/1990 Yee
`4,959,810 A
`9/1990 Darbee et al.
`5,005,084 A
`4/1991 Skinner
`
`Continued
`
`)
`(
`FOREIGN PATENT DOCUMENTS
`0561435 A2
`9/1993
`0967797 A2
`12/1999
`
`EP
`EP
`
`.
`(Continued)
`OTHER PUBLICATIONS
`Universal Electronics Inc., PRONTO User Guide, 1999,
`(Continued)
`
`Pp.
`
`pp. 1-56.
`
`Primary Examiner—Michael D. Masinick
`(74) Attorney, Agent, or Firm—Greenberg Traurig LLP
`
`(57)
`
`ABSTRACT
`
`A home control and automation system and method. The
`system generally includes one or more wireless remote
` SoHtrols, a plurality of appliances
`(including network
`enabled appliances andtraditional legacy appliances in the
`exemplary system), associated control centric devices, and
`associated content centric devices. Various methods for
`control and operation of appliances in the networked home
`control and automation environmentare disclosed. Specifi-
`cally, methods are disclosed which enable advanced home
`control features such as location based control setup and
`operation, network enabled legacy appliances and system
`integration, save and recall capabilities for appliance and
`media states, generic command based appliance controls,
`dynamic/complex macro command generation, and Internet
`based control capabilities from remote locations are dis-
`closed in conjunction with the system of the current inven-
`tion.
`
`20 Claims, 7 Drawing Sheets
`
`(52) US. CM vee 700/66; 700/90; 700/220;
`700/221; 340/572.1; 340/10.1
`(58) Field of Classification Search .................. 700/90,
`700/220, 221, 66; 340/572.1, 10.1
`See application file for complete search history.
`
`
`
` activation
`RFID
`al
`~~ signi
`
`
`
`
`Roku EX1050
`U.S. Patent No. 9,716,853
`
`

`

`US 7,379,778 B2
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`1/2001 Alexanderet al.
`6,177,931 Bl
`2/2001 Ketcham
`6,195,589 Bl
`4/2001 Choi et al.
`6,211,856 Bl
`3/1992 MacFadyenet al.
`5,101,191 A
`4/2001 Lazaridis et al.
`6,219,694 Bl
`4/1992 Welty
`5,109,222 A
`5/2001 Hayesetal.
`6,225,938 Bl
`3/1994 Hallenbeck
`5,293,357 A
`7/2001 Allport
`6,256,019 BL
`4/1994 Baskin et al.
`5,307,055 A
`8/2001 Darbee et al.
`6,278,499 Bl
`4/1995 Goldstein
`5,410,326 A
`9/2001 Kushiroetal.
`6,285,357 Bl
`1/1996 Darbeeetal.
`5,481,256 A
`1/2002 Schein etal.
`6,341,374 B2
`9/1996 Lenchik
`5,552,806 A
`4/2002 Barnettetal.
`6,369,840 B1
`10/1996 Selker
`5,565,888 A
`6/2002 Sato
`6,408,435 BL
`11/1996 Hamlin
`5,574,964 A
`
`
`
`5,614,906 A 8/2002_Huangetal.3/1997 Hayeset al. 6,437,836 Bl
`5,635,989 A
`6/1997 Rothmuller
`6,448,886 B2*
`9/2002 Garberet al. eee 340/10.1
`5,642,303 A
`6/1997 Small et al.
`6,463,463 Bl
`10/2002 Godfreyetal.
`5,648,760 A
`7/1997 Kumar
`6,466,971 Bl
`10/2002 Humpleman etal.
`5,652,613 A
`7/1997 Lazarusetal.
`6,532,589 Bl
`3/2003 Proehletal.
`5,671,267 A
`9/1997 Augustetal.
`6,563,430 Bl
`5/2003 Kemink etal.
`5,710,605 A
`1/1998 Nelson
`6,577,350 Bl
`6/2003 Proehletal.
`5,724,106 A
`3/1998 Autry etal.
`6,587,067 B2
`7/2003 Darbee et al.
`5,751,372 A
`5/1998 Forson
`6,753,790 B2
`6/2004 Davieset al.
`5,761,606 A
`6/1998 Wolzien
`6,774,811 B2*
`8/2004 Kaufman etal. ...... 340/825.49
`5,767,919 A
`6/1998 Leeetal.
`6,792,323 B2
`9/2004 Krzyzanowskietal.
`
`5,793,438 A 6,823,188 BL*11/2004 Stern ...ceceeeeceen 455/456.18/1998 Bedard
`
`5,801,787 A
`9/1998 Schein et al.
`6,832,251 Bl
`12/2004 Gelvin etal.
`5,828,419 A
`10/1998 Bruette et al.
`6,996,402 B2*
`2/2006 Logan et al. wee 455/456.1
`5,835,864 A
`11/1998 Diehlet al.
`2003/0076240 Al
`4/2003 Baeetal.
`5,838,775 A
`11/1998 Montalbano
`2004/0203592 Al
`10/2004 Kermodeetal.
`5,855,006 A
`12/1998 Huemoelleret al.
`2005/0035846 Al
`2/2005 Zigmondetal.
`5,900,875 A
`5/1999 Haitanietal.
`2005/0138785 Al
`6/2005 Mooreetal.
`5,901,366 A
`5/1999 Nakanoet al.
`2005/0242167 Al
`11/2008 Kaarioetal.
`5,910,776 A*6/1999 Black wees 340/10.1
`5,915,026 A
`6/1999 Mankovitz
`FOREIGN PATENT DOCUMENTS
`5,938,757 A
`8/1999 Bertsch
`3/2000
`0987888 Al
`EP
`5,956,025 A
`9/1999 Gouldenetal.
`
`
`5,959,751 A 1204275 A2—5/20029/1999 Darbeeetal. EP
`
`
`5,970,206 A 1023650 B1=9/200310/1999 Yuen et al. EP
`
`
`5,974,222 A
`10/1999 Yuen et al.
`GB
`2343073 A
`4/2000
`6,002,394 A
`12/1999 Scheinet al.
`JP
`02001209551 A
`8/2001
`6,002,450 A
`12/1999 Darbeeetal.
`wo
`WO 00/40016
`7/2000
`6,014,092 A
`1/2000 Darbeeet al.
`wo
`WO 00/58935
`10/2000
`6,018,372 A
`‘1/2000 Btheredge
`wo
`WO 01/20572 Al
`3/2001
`6,020,881 A
`2/2000 Naughtonet al.
`6,028,599 A
`2/2000 Yuenet al.
`OTHER PUBLICATIONS
`6,040,829 A
`3/2000 Croy etal.
`“The untold RFID Story: Product innovations in Electronics” —
`6,097,441 A
`8/2000 Allport
`IBM Business Consulting Services, ibm.com/bes, Sep. 2004.
`6,104,334 A
`8/2000 Allport
`“Interacting with Home and Home Appliances in a Hand-Held
`6,127,941 A
`10/2000 Van Ryzin
`Terminal”, Aaltonen et al. Nokia Research Center.
`6,130,726 A
`10/2000 Darbee etal.
`“A Method of Appliance Detection Based on Features of Power
`6,133,909 A
`10/2000 Schein et al.
`Waveform” -Masahito et al. Tokyo University of Technology
`6,137,549 A
`10/2000 Rasson etal.
`School of Computer Science, 2004 IEEE
`6,151,059 A
`11/2000 Schein etal.
`B
`1/2001 Etheredge
`6,172,674
`
`* cited by examiner
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 1 of 7
`
`US 7,379,778 B2
`
`500
`
`Command
`Passing
`Server
`
` Translation /
`
`
`
`Networked Appliance 4
`
`!
`
`\
`
`\
`
`\
`
`
`
`Network
`
`Enablement
`
`HUB
`
`ControlFD»/
`
`‘N
`
`/
`
`~
`
`“eee 7
`
`”
`
`14
`
`Server /
`Content
`Source 1
`
`Device ‘
`
`
`a
`Source 2
`
`12,16 — G[netRoane|~
`
`Networked
`Appliance 2
`Server / Content
`
`\
`
`\
`
`Control POD /
`
`!
`
`/
`
`/
`
`‘N
`
`N“
`
`~
`
`~~ see oO
`
`7
`
`4
`-~ 12,14
`
`FIGURE 1
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 2 of 7
`
`US 7,379,778 B2
`
`38
`
`Power source
`
`timer logic
`
`Microcoprocessor
`
`Clock and
`
`30
`
`24
`
`FIGURE 2
`
`28
`
`Key matrix
`
`Visual feedback
`device
`
`
`
` —
`
`Crystal
`
`36
`
`
`Audio feedback
`device
`
`
`Transceiver
`
`Receiving
`circuit
`
`Transmitting
`circuit
`
`
`
`Non-
`volatile
`
`memory
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 3 of 7
`
`US 7,379,778 B2
`
`58 —9
`
`Transmitter
`
`r Receiver
`[teNon-volatile
`
`ROM
`
`33
`
`2Qa
`QoQ
`Oo
`
`22
`
`Clock and
`timer logic
`
`isible
`LED
`
`3
`
`51
`
`53
`
`50
`
`FIGURE 3
`
`64
`
`Input/Output
`
`Cc
`Crystal
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 4 of 7
`
`US 7,379,778 B2
`
`Network Enablement
`
`Virtual Network [ayer
`
`70
`
`
`
` IR Blaster
`
`Controller
`
`
`
`
`Content
`
`
` IP Registry Ethernet
`Delivery
`
`BUS
`
`Control Manager
`
`Content Gateway
`
`=
`Ethernel
`Content
`vr
`Networ
`
`
`
`|
`
`Sourcing
`
`FIGURE4
`
`74
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 5 of 7
`
`US 7,379,778 B2
`
` Remote
`
`Device
`
`10
`
`500 Internet Based
`
`Server
`
`
`
`
`PC with Home
`
`Automation
`
`Software
`
`
`FIGURE 5
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 6 of 7
`
`US 7,379,778 B2
`
`601
`
`602
`
`Recieve User Input
`
`603
`
`604
`
`
`
`
`
`— 610
`
`
`
`
`i
`
`\
`
`!
`
`Local and/or remote
`database(s)
`e
`Key codes
`Normalize input
`
`e=Keytabels ;
`
`:
`.
`*
`Phonics
`i
`:
`Portable Device
`*
` Thesaurus/dictiona
`;
`yo
`:
`cross-referenced to action
`i
`descriptors
`\
`
`606
`
`<>
`
`:
`
`612
`
`|
`'
`
`AN
`
`650
`
`: a
`
` Contral Pod
`
`:
`
`i
`
`!
`
`i
`
`'
`
`i
`
`:
`
`100
`
`deser
`jon
`Action descriptor
`
`°
`
`620
`
`Select device
`(location and
`activity based)
`
`Translate action
`oonte
`ita.
`peedonaction
`“dewice
`
`
`
`Issuedevice
`
`command
`
`!
`'
`
`:
`i
`
`i
`
`i
`:
`;
`i
`
`i
`
`——>
`
`660
`
`Local and/or remote
`database
`¢
`Action descriptors
`.
`Device type/model
`cross-referenced to
`= command codes
`
`S 662
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 7 of 7
`
`US 7,379,778 B2
`
` Lx:signal
`
`Figure 7
`
`

`

`US 7,379,778 B2
`
`1
`SYSTEM AND METHODS FOR HOME
`APPLIANCE IDENTIFICATION AND
`CONTROL IN A NETWORKED
`ENVIRONMENT
`
`RELATED APPLICATION DATA
`
`This application claims the benefit of and is a divisional
`of U.S. application Ser. No. 11/047,441, filed Jan. 31, 2005,
`which is a continuation-in-part of U.S. application Ser. No.
`10/978,860, filed Nov. 1, 2004, which, in turn, claims the
`benefit of U.S. Provisional Application Ser. No. 60/517,283,
`filed on Nov. 4, 2003, which applications are hereby incor-
`porated by reference in their entirety.
`
`BACKGROUND
`
`The following relates generally to home control systems
`and, more particularly, relates to a system and associated
`methods for controlling and operating a plurality of home
`appliances from a variety of different locations in a net-
`worked homecontrol and automation environment.
`Current home appliances and associated remote controls
`(“legacy” appliances) have limited functional abilities and
`minimal
`interoperability features. Emerging advances in
`wireless and distributed computing technologies, coupled
`with network enabled home appliances (such as those that
`may be addressed, accessed, monitored, and managed
`remotely over networks and the Internet) and industry wide
`interoperability standards (e.g., Universal Plug and Play
`(“UPnP”) and Home Audio Video interoperability “SHAV1’)
`standards) provide a rough framework for network enabled
`home environments having increasingly integrated home
`control capabilities, functions, and features. A background
`and overview of home interoperability technologies and
`projected features may be found in the Intel Technical
`Journal, Volume6, Issue 4, published Nov. 15, 2002 entitled
`“Interoperable HomeInfrastructure” which is fully incorpo-
`rated by reference herein.
`Though promising in their goals and objectives, the UPnP,
`HAVi, Intel Interoperability Infrastructure, etc. do not cur-
`rently provide for many advanced control based features
`relating to networked home control and automation envi-
`ronments. Accordingly, it is desired to provide a system and
`method that functions to enable advanced home control
`
`features such as location based control setup and operation,
`network enabled legacy appliances and system integration,
`save and recall capabilities for appliance and mediastates,
`generic command based appliance controls, dynamic/com-
`plex macro command generation, and Internet based control
`capabilities from remote locations. Additional
`inventive
`features and functions will also be evident from the home
`
`appliance control system and methodshereinafter described.
`
`SUMMARY
`
`In accordance with these needs and desires, a control
`system and associated methods for control and operation are
`described for use in a networked home control and automa-
`tion environment.
`
`the system includes one or more wireless
`Generally,
`remote controls, a plurality of appliances (including network
`enabled appliances andtraditional legacy appliances in the
`exemplary system), associated control centric devices (gen-
`erally devices whose chief function is providing control
`based functions and services, including but not limited to
`control pods, control servers, device state monitors, etc.) and
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`associated content centric devices (generally devices whose
`chief function is providing content based functions and
`services,
`including but not limited to content managers,
`content servers, content renderers, etc.).
`Additionally, various methods for control and operation
`of appliances in the networked homecontrol and automation
`environmentare disclosed. Specifically, methods that func-
`tion to enable advanced home control features such as
`location based control setup and operation, network enabled
`legacy appliances and system integration, save and recall
`capabilities for appliance and media states, generic com-
`mand based appliance controls, dynamic/complex macro
`command generation, and Internet based control capabilities
`from remote locations are disclosed in conjunction with the
`system of the current invention.
`A better understanding of the objects, advantages, fea-
`tures, properties and relationships of the subject system and
`methods will be obtained from the following detailed
`description and accompanying drawings which set forth
`illustrative embodiments whichare indicative of the various
`ways in which the principles of the system and method may
`be employed.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`For a better understanding of the system and method
`described hereinafter, reference may be had to preferred
`embodiments shown in the following drawings in which:
`FIG.1 illustrates an exemplary networked home control
`and automation system;
`FIG. 2 illustrates a block diagram of components of an
`exemplary remote control;
`FIG. 3 illustrates a block diagram of components of an
`exemplary control device;
`FIG. 4 illustrates an exemplary network enablement
`device;
`FIG.5 illustrates a VPN implemented with the networked
`home control environment;
`FIG.6 illustrates an exemplary system for implementing
`a generic command structure within a home appliance
`network; and
`FIG.7 illustrates an exemplary networked home control
`environment incorporating RFID enabled devices.
`
`DETAILED DESCRIPTION
`
`With reference to the Figures, an integrated homecontrol
`system and associated control and operation methods are
`described for use in a networked home control and automa-
`tion environment.
`
`The system envisaged by the current invention provides
`for both the interoperability of various network enabled and
`legacy home appliances, and advanced command and con-
`trol functions for such appliances. To this end, the networked
`home control and automation system (shown generally in
`FIG. 1) includes one or more remote controls 10, a plurality
`of appliances 12 (including network enabled appliances and
`traditional
`legacy appliances in the exemplary system),
`associated control centric devices 14 (generally devices
`whose chief function is providing control based functions
`and services, including, but not limited to, control pods,
`control servers, device state monitors, etc.) and associated
`content centric devices 16 (generally devices whose chief
`function is providing content based functions and services,
`including, but not
`limited to, content managers, content
`servers, content renderers, etc.).
`
`

`

`US 7,379,778 B2
`
`3
`By way of example only, the appliances 12 may include,
`but are not
`limited to,
`televisions, VCRs, DVRs, DVD
`players, cable converter boxes, amplifiers, CD players, game
`consoles, home lighting, drapery,
`fans, HVAC systems,
`thermostats, personal computers, security systems, network
`enabled automobiles, etc. According to the exemplary sys-
`tem, some or all of the above devices, appliances, and
`components are configured to be network enabled and
`interoperable (e.g., as defined and described in the UPnP
`and/or HAVi specifications which can be found at
`the
`upnp.org Web site and the havi.org Web site respectively,
`which specifications are incorporated herein by reference in
`their entirety) such that basic device addressing, accessibil-
`ity, monitoring, remote management, and other network
`communication based features are possible in a home con-
`trol and automation environment. The networked home
`
`control and automation environment 100 itself may utilize
`well known centralized networking methods, ad hoc net-
`working methods (including peer-to-peer networking), pow-
`erline or phoneline based networking methods, or a combi-
`nation of the above (whether wired or wireless)
`to
`accomplish the features and goals of the present invention.
`Additionally,
`it will be appreciated that particular appli-
`ances, devices, and components of the exemplary system
`may incorporate someorall of the features, functions, and
`capabilities of other individual devices such that a minimal
`numberof separate physical devices are required in a given
`home environment to accomplish the goals of the current
`invention. For instance, devices such as a Media Center PC
`or network enabled TV (e.g., one compliant with the UpnP
`and/or HAVi specifications) may include, in additional to
`standard computing and/or audio/video playback functions,
`system wide control capabilities, content management and
`rendering abilities, and location based services. As such it
`will be appreciated that the various system elements defined
`and described herein should be considered as functional
`
`modules capable of implementation individually or collec-
`tively in a single physical device or a software module in a
`software product, or one or more elements may be imple-
`mented in separate physical devices or software modules,
`without departing from the scope andspirit of the present
`invention.
`
`Looking now to FIG.2, for use in transmitting command
`codes, generic commands, macro commands, etc. to one or
`more of the appliances (both network enabled and legacy)
`the remote control 10 may include, as neededfor a particular
`application, a processor 24 coupled to a memory device
`(such as ROM memory 26, RAM memory 27, and/or a
`non-volatile memory 34), a key matrix 28 (e.g., physical
`buttons, a touch screen display, or a combination thereof), an
`internal clock and timer 30,
`transmission circuit(s) 32,
`receiver circuit(s) 33, and/or transceiver circuit(s) (e.g., IR
`and/or RF), a means 36 to provide feedbackto the user(e.g.,
`LED, display, speaker, and/or the like), and a power supply
`38 as generally illustrated in FIG. 2. As will be understood
`by those of skill in the art, the memory device may include
`executable instructions that are intended to be executed by
`the processor 24 to control the operation of the remote
`control 10. In this manner, the processor 24 may be pro-
`grammed to control
`the various electronic components
`within the remote control 10, e.g., to monitor the power
`supply 38, to cause the transmission of signals, etc.
`The non-volatile read/write memory 34, for example an
`EEPROM,battery-backed up RAM, Smart Card, memory
`stick, or the like, may be provided to store setup data and
`parameters as necessary. It is to be additionally understood
`that the memory devices may take the form of any type of
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`readable media, such as, for example, ROM, RAM, SRAM,
`FLASH, EEPROM, Smart Card, memory stick, a chip, a
`hard disk, a magnetic disk, and/or an optical disk. Still
`further,
`it will be appreciated that some or all of the
`illustrated memory devices 26, 27, and 34 may be physically
`incorporated within the same IC chip as the microprocessor
`24 (a so called “microcontroller’) and, as such, they are
`shownseparately in FIG. 2 only for the sake of clarity.
`To identify home appliances by type and make (and
`sometimes model) such that the remote control device 10 is
`adapted to transmit recognizable command codes in the
`format appropriate for such identified appliances 12, data
`may be entered into the universal remote control device 10.
`Since methods for setting up a remote control to control the
`operation of specific home appliances are well-known, such
`methods need not be described in greater detail herein.
`Nevertheless,
`for additional
`information pertaining to
`remote control setup, the reader may turn to U.S. Pat. Nos.
`4,959,810, 5,614,906, and 6,225,938. It will also be appre-
`ciated that the remote control 10 may be set up to control an
`appliance 12 by being taught the command codes needed to
`control such appliance as described in U.S. Pat. No. 4,623,
`887.
`
`To cause the remote control 10 to perform an action, the
`remote control 10 is adapted to be responsive to events, such
`as a sensed user interaction with the key matrix 28, receipt
`of a transmission, etc. In response to an event, appropriate
`instructions within the memory 26 may be executed. For
`example, when a commandkeyis activated on the remote
`control 10, the remote control 10 may retrieve a command
`code corresponding to the activated command key from
`memory 26 and transmit the command code to a device in
`a format recognizable by the device. It will be appreciated
`that the instructions within the memory 26 can be used not
`only to cause the transmission of command codes and/or
`data to the appliances 12 but also to perform local opera-
`tions, e.g., location based features and functions as described
`in greater detail below. While not
`limiting, other local
`operations that may be performed by the remote control 10
`include displaying information/data, favorite channel setup,
`macro button setup, function key relocation, etc. Examples
`of local operations can be found in U.S. Pat. Nos. 5,481,256,
`5,959,751, and 6,014,092. Additional examples of remote
`controls 10 may be found in commonly owned,U.S. Pat. No.
`6,225,938 and U.S. application Ser. Nos. 60/264,767,
`09/905,423, 09/905,432, and 09/905,396.
`Remote control 10 may also include, as needed for a
`particular application, CCD or other imaging sensors, micro-
`phone, and/or touchscreen display for receipt of various
`types of user input for effecting operations of the remote
`control. Remote control 10 may also be configured to
`include appliance, control server, and content server func-
`tions, as will be described in greater detail below. For
`instance, remote control 10 may be implemented on a laptop
`computer, smart panel, tablet PC, wireless enabled PDA,
`mobile phone, ete which may all include programming to
`cause remote control 10 to playback music, videos, pictures
`and the like, monitor appliance feature and state tables for
`advanced control functions, and include programming for
`location determination methods. Remote control 10 may
`thus be viewed as a wireless appliance having functions
`similar to less portable appliances of the networked control
`environment, and as such the following discussions and
`descriptions of the remote controls, and controlling devices
`in general, should be taken in the broadest sense possible.
`Each network enabled appliance of the system (including
`legacy appliances that have been network enabled as
`
`

`

`US 7,379,778 B2
`
`5
`described in greater detail below) include, or are assigned a
`unique address. According to the exemplary embodiment,
`this address is in the form of a Uniform Resource Identifier
`
`(URJ) which can be any Uniform Resource Locator (URL)
`or Uniform Resource Name (URN), typically assigned via a
`control server of the system, such that all appliances in
`communication with the control server may be accessed
`from at least the control server. It will be appreciated that
`multiple appliances may include control and addressing
`functions in a given system such that each individually
`addressed appliance may be accessed by multiple control
`servers, control pods, or other control devices. Additionally,
`it will be understood that networked devices need not
`include fully functional web server applications or similar
`features, but may be configured to simply broadcast and/or
`listen on specified IP ports to accomplish system connec-
`tivity and communications.
`Network enabled appliances of the system additionally
`include basic feature and state reporting functions for
`enabling other appliances, control server(s), and remote
`control(s) to readily ascertain the available control functions
`of an appliances, and the current state of the control func-
`tions. As will be appreciated by those skilled in the art, an
`Extensible Markup Language (XML)or similar format may
`be used to transmit and receive such information between
`appliances, servers, and remote controls. It is also possible
`to modify the URI or other unique identifier assigned each
`appliance such that contained in each appliance address is an
`indication of the available functions, and even an indication
`of current appliance state. One method of implementing
`such a system would be to include appropriate device code
`identifiers (e.g., an IR commandlibrary, individual IR code,
`and/or graphical user interface element reference number(s))
`in the URI for each appliance, thus broadcasting capabilities
`(and thus available features) of the device to any control
`server with access to the associated device library. One
`example
`appliance
`address
`(URI) may be
`“http://
`123.456.789.0/wxyz,” where “123.456.789.0” is the main
`appliance address, and “wxyz” in the reference number
`corresponding to an IR commandcodesetfor that particular
`appliance.
`For enabling frequent feature set and state updates of
`appliances present in the networked control environment on
`associated control servers and remote controls, well known
`multicasting methods for appliance advertising and discov-
`ery may be used (e.g., IP Multicasting). In this way appli-
`ances, servers, and remote controls may easily monitor and
`register feature set and state changes on the networked
`control environment.
`As described above and shownin FIG.1, the control and
`content servers (including control pods, command/state
`monitors, content renderers, etc.) of the present invention
`may be separate devices, may be incorporated into one or
`more of the appliances such that no individual “server
`devices” are present, etc. Functionally, content centric
`devices can serve as a repository for digital media files
`(audio, video, photo, and multimedia content), offer search
`and cataloging based services, and servefiles to one or more
`appliances for playback. Generally computing based devices
`such as Media Center PC’s, “Content Servers,” and “Con-
`tent Renderers,” as defined and described in, for example,
`the UPnP specification, are examples of content centric
`devices in a home control and automation environment.
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`Control centric devices generally function to receive,
`save, process, and transmit media and state data for appli-
`ances and devices of the home control and automation
`
`65
`
`environment. Various types of command data (IR, RF,
`
`6
`Powerline commands, Phoneline commands, etc.) may be
`saved by command/state monitors as described in greater
`detail below. Whether implemented on a single device, or
`distributed across multiple devices in the home control and
`automation environment, these control devices are capable
`of performing logic based operations on saved command
`and state data for use with appliances, remote control
`interfaces, and desired user functions. Preset control instruc-
`tions on control devices may dictate how and when com-
`mand and state data is captured and processed, or user
`interaction with an appliance or remote control device may
`dictate the manner of commandandstate data capture and
`processing. Saved and/or processed command and state
`playback may likewise be effectuated by preset instructions,
`automated system processes, or user interaction with appli-
`ances and devices of the system.
`Generally, the functions performedbya particular control
`device will depend on included firmware, software and
`programming, additional components, and level of integra-
`tion with other appliances of the system. As such the general
`control device as shown and described in FIG. 3 may be
`configured and modified as further described herein to
`function as a location signaling device, network enablement
`device, command/state monitor, control pod, network bridge
`(such as for example an IR, RF, X-10, or Simple Control
`Protocol (SCP) bridge), or any combination of the above.
`The control device may also be fully incorporated into any
`of the appliances of the home environment as a functional
`element(i.e., as a service or application software running on
`the appliance).
`For use in accomplishing one or more of the above
`described control features in the networked control and
`automation system, a control device 14 is described. The
`control device 14 may be a device separate and apart from
`the other system appliances or may be integrated into one or
`more of the appliancesasis illustrated in FIG. 1. In either
`case, the control device 14 may include, as needed for a
`particular application, a processor 50 coupled to a memory
`device (such as ROM memory 52, RAM memory 51, and/or
`non-volatile read/write memory 56), an internal clock and
`timer 53, receiver circuit(s) 54, transmission circuit(s) 55
`and/or transceiver circuit(s) (e.g., IR and/or RF), a means 58
`to provide feedback to the user (e.g., LED, display, speaker,
`and/or the like), a power supply 62, and input/output means
`64,
`(e.g., serial I/O port, wireless transceiver, bar code
`scamner, X-10 bridge, SCP Bridge, Ethernetport, etc.), as is
`generally illustrated in FIG. 3. The memory device may
`include executable instructions that are intended to be
`executed by the processor 50 to control the operation of the
`control device 14. In this manner, the processor 50 may be
`programmed to control the various electronic components
`within the control device 14, e.g., to monitor the power
`supply 62, to cause the transmission of signals, to provide
`audio or visual prompts to a user, etc. The non-volatile
`read/write memory 56, for example an EEPROM,battery-
`backed up RAM, Smart Card, memory stick,or the like, may
`also be provided to store setup data and parameters as
`necessary. While the memory 52 is illustrated and described
`as aROM memory, memory 52 can also be comprised of any
`type of readable media, such as ROM, RAM, SRAM,
`FLASH, EEPROM,orthe like. Preferably, the memory 56
`is non-volatile or battery-backed such that data is not
`required to be reloadedafter battery changes. In addition, the
`memories 51, 52 and 56 maytake the form of a chip, a hard
`disk, a magnetic disk, and/or an optical disk. It will also be
`appreciated that in cases where control device capability is
`integrated into an appliance, some orall of the functional
`
`

`

`US 7,379,778 B2
`
`8
`7
`to the device address. By way of example only, the device
`elements described above in conjunction with FIG. 3 may be
`address for a specific appliance may be formatted as follows
`combined with similar elements already present
`in the
`to indicate additional information in conjunction with the
`appliance for other purposes.
`It will be appreciated that the abovementioned transmitter address:_http://Address/Location/StateData/ServicesData,
`
`where “Address” is the network address of the device,
`55, receiver 54, and/or input/output means 64 may be used
`to connect control device 14 to one or more networked
`“Location” is the physical location relating to the environ-
`ment the device is in, “StateData” includes one or more
`appliances, content servers, computers, the Internet, or other
`indications of the device state, and “ServicesData” includes
`devices and appliances of a networked home control envi-
`ronment. As such programming and instructions on the
`an indication of the services offered by the device. Other
`control device may control the operation of other devices
`methods of publishing determined location state data are
`and appliances in the system, access content and command
`possible given the disclosure and such methods are well
`data stored or maintained either entirely or in part at a
`within the routine skill of a programmerskilled in theart.
`location physically separate from the control device 14 (such
`Based on the present location of the remote control in an
`as for example in a server or personal computer located
`environment, only those appliance within a specified prox-
`elsewhere in the home or remotely via the Internet), and
`imity to the remote control may be caused to report their
`function and state data, or commands transmitted from the
`communicate wirelessly with a remote control unit
`to
`accomplish command and control features of the current
`remote control may be prioritized for appliances that are
`invention.
`determinedto be in close proximity to the remote control at
`In order to enable location based control and automation
`any given time. Dynamic and/or complex macro commands
`(as described in greater detail below) may be configured to
`cause appliance states to change any time a particular
`location is reported by the remote control (e.g.,
`lighting
`fixtures may be configured to receive location data based on
`the remote control location determination and modify their
`power state or brightness level continuously based on
`remote control location).
`The remote control location determination data may also
`be used to provide error correction or checking mechanisms
`for commands issued in a home automation environment.
`For instance, if a remote control location outside the home
`control environment is detected (for example if the remote
`control is connected to the home network from a remote
`location via the Internet) and a command from the home
`automation system ac