US007379778B2
`
`(12) United States Patent
`US 7,379,778 B2
`(10) Patent No.:
`(45) Date of Patent:
`May 27, 2008
`Hayes et al.
`
`(54)
`
`(75)
`
`SYSTEM AND METHODS FOR HOME
`APPLIANCE IDENTIFICATION AND
`CONTROL IN A NETWORKED
`ENVIRONMENT
`
`Inventors: Patrick H. Hayes, Mission Viejo, CA
`(US); Jeremy Black, Santa Ana, CA
`(US)
`
`(73)
`
`Assignee: Universal Electronics, Inc., Cypress,
`CA (US)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21)
`
`Appl. No.: 11/491,758
`
`(22)
`
`Filed:
`
`Jul. 24, 2006
`
`(65)
`
`(60)
`
`(60)
`
`(51)
`
`(52)
`
`(58)
`
`Prior Publication Data
`
`US 2006/0259184 A1
`
`Nov. 16, 2006
`
`Related US. Application Data
`
`Division of application No. 11/047,441, filed on Jan.
`31, 2005, now Pat. No. 7,155,305, which is a con-
`tinuation-in-part of application No. 10/978,860, filed
`on Nov. 1, 2004, now Pat. No. 7,136,709.
`
`Provisional application No. 60/517,283, filed on Nov.
`4, 2003.
`
`Int. Cl.
`
`G06F 19/00
`G06F 7/00
`
`(2006.01)
`(2006.01)
`
`US. Cl
`
`.......................... 700/66; 700/90; 700/220;
`700/221; 340/572.1; 340/101
`Field of Classification Search .................. 700/90,
`700/220, 221, 66; 340/5721, 10.1
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`4,623,887 A
`4,894,789 A
`4,959,810 A
`5,005,084 A
`
`ll/l986 Welles, II
`1/1990 Yee
`9/1990 Darbee et 31.
`4/1991 Skinner
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`
`0561435 A2
`0967797 A2
`
`9/1993
`12/1999
`
`(Continued)
`OTHER PUBLICATIONS
`
`Universal Electronics Inc., PRONTO User Guide, 1999, pp. 1-56.
`
`(Continued)
`
`Primary ExamineriMichael D. Masinick
`(74) Attorney, Agent, or FirmiGreenberg Traurig LLP
`
`(57)
`
`ABSTRACT
`
`A home control and automation system and method. The
`system generally includes one or more wireless remote
`controls, a plurality of appliances
`(including network
`enabled appliances and traditional legacy appliances in the
`exemplary system), associated control centric devices, and
`associated content centric devices. Various methods for
`control and operation of appliances in the networked home
`control and automation environment are disclosed. Specifi-
`cally, methods are disclosed which enable advanced home
`control features such as location based control setup and
`operation, network enabled legacy appliances and system
`integration, save and recall capabilities for appliance and
`media states, generic command based appliance controls,
`dynamic/complex macro command generation, and Internet
`based control capabilities from remote locations are dis-
`closed in conjunction with the system of the current inven-
`tion.
`
`20 Claims, 7 Drawing Sheets
`
`
`
`Roku EX1050
`
`US. Patent No. 9,716,853
`
`

`

`US 7,379,778 B2
`
`Page 2
`
`US. PATENT DOCUMENTS
`
`5,101,191 A
`5,109,222 A
`5293357 A
`5,307,055 A
`5,410,326 A
`5,481,256 A
`5,552,806 A
`5,565,888 A
`5,574,964 A
`5,614,906 A
`5,635,989 A
`5,642,303 A
`5,648,760 A
`5,652,613 A
`5,671,267 A
`5,710,605 A
`5,724,106 A
`5751372 A
`5,761,606 A
`5,767,919 A
`5793438 A
`5,801,787 A
`5,828,419 A
`5,835,864 A
`5,838,775 A
`5,855,006 A
`5,900,875 A
`5901366 A
`5,910,776 A *
`5,915,026 A
`5,938,757 A
`5,956,025 A
`5,959,751 A
`5,970,206 A
`5,974,222 A
`6,002,394 A
`6,002,450 A
`6,014,092 A
`6,018,372 A
`6,020,881 A
`6,028,599 A
`6,040,829 A
`6,097,441 A
`6,104,334 A
`6,127,941 A
`6,130,726 A
`6,133,909 A
`6,137,549 A
`6,151,059 A
`B
`6,172,674
`
`1
`
`3/1992 MacFadyen et al.
`4/1992 Welty
`3/1994 Hallenbeck
`4/1994 Baskin et a1.
`4/1995 Goldstein
`“1996 Darbee etal
`9/1996 Lenchik
`10/1996 Selker
`11/1996 Hamlin
`3/1997 Hayes etal.
`6/1997 Rothmuller
`6/1997 Small etal.
`7/1997 Kumar
`7/1997 Lazams et al~
`9/1997 August et al~
`“1998 Nelson
`3/1998 Autry etal.
`5/1998 FOISOH
`6/1998 Wolzien
`6/1998 Lee etal.
`8/1998 Bedard
`9/1998 Schein et al~
`10/1998 Bruette etal
`11/1998 Diehl etal.
`11/1998 Montalbano
`12/1998 Huemoeller et al~
`5/1999 Haitani etal.
`5/1999 Nakano et 31~
`6/1999 Black ........................ 340/10.1
`6/ 1999 Mankovitz
`8/1999 Bertsch
`9/1999 Goulden et a1.
`9/1999 Darbee et a1.
`10/1999 Yuen et a1.
`10/1999 Yuen et a1.
`12/1999 Schein et a1.
`12/1999 Darbee et a1.
`1/2000 Darbee et a1.
`1/2000 Etheredge
`2/2000 Naughton et al.
`2/2000 Yuen et a1.
`3/2000 CTOY et 31~
`8/2000 AIIPOIT
`8/2000 AIIPOIT
`10/2000 V311 Ryzin
`10/2000 Darbee et 31~
`10/2000 Schein et 3L
`10/2000 Rasson et 31~
`11/2000 Schein et al.
`1/2001 Etheredge
`
`6,177,931 B1
`6,195,589 B1
`6,211,856 B1
`6,219,694 B1
`6,225,938 B1
`6,256,019 B1
`6,278,499 B1
`6,285,357 B1
`6,341,374 B2
`6,369,840 B1
`6,408,435 B1
`6,437,836 B1
`6,448,886 B2
`6,463,463 B1
`6,466,971 B1
`6,532,589 B1
`6,563,430 B1
`6,577,350 B1
`6,587,067 B2
`6,753,790 B2
`6,774,811 B2
`6,792,323 B2
`6,823,188 B1
`6,832,251 B1
`6,996,402 B2
`2003/0076240 A1
`2004/0203592 A1
`2005/0035846 A1
`2005/0138785 A1
`2005/0242167 A1
`
`.............. 340/10.1
`
`1/2001 Alexander et a1.
`2/2001 Ketcham
`4/2001 Choi et 31.
`4/2001 Lazaridis et a1.
`5/2001 Hayes et a1.
`7/2001 Allport
`8/2001 Darbee et a1.
`9/2001 Kushiro et a1.
`1/2002 Schein et a1.
`4/2002 Barnett et a1.
`6/2002 Sato
`8/2002 Huang et a1.
`9/2002 Garber et a1.
`10/2002 Godfrey et a1.
`10/2002 Humpleman et a1.
`3/2003 Proehl et a1.
`5/2003 Kemink et a1.
`6/2003 Proehl et a1.
`7/2003 Darbee et al.
`6/2004 Davies et a1.
`...... 340/825.49
`8/2004 Kaufman et a1.
`9/2004 Krzyzanowski et a1.
`11/2004 Stern ....................... 455/456.1
`12/2004 Gelvin et a1.
`2/2006 Logan et a1.
`4/2003 Bae et a1.
`10/2004 Kermode et a1.
`2/2005 Zigmond et a1.
`6/2005 Moore et al.
`11/2005 Kaario et a1.
`
`............ 455/456.1
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`GB
`JP
`W0
`W0
`W0
`
`0987888 A1
`1204275 A2
`1023650 Bl
`2343073 A
`02001209551 A
`WO 00/40016
`WO 00/58935
`WO 01/20572 A1
`
`”000
`5/2002
`”003
`“000
`”001
`7/2000
`10/2000
`”001
`
`OTHER PUBLICATIONS
`“The untold RFID Story: Product innovations in Electronics” 7
`IBM Business Consulting Services, ibm.com/bcs, Sep. 2004.
`“Interacting with Home and Home Appliances in a Hand-Held
`Terminal”, Aaltonen et al. Nokia Research Center.
`“A Method of Appliance Detection Based on Features of Power
`Waveform” -Masahito et al. Tokyo University of Technology
`School of Computer Science, 2004 IEEE
`
`* cited by examiner
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 1 of 7
`
`US 7,379,778 B2
`
`500
`
`
`
`Translation /
`Command
`
`Passing
`Server
`
`
`
`
`Enablemeni
`Device
`
`Server/
`Content
`
`Source 1
`
`Networked
`Appliance 2
`Server / Content
`
`Sourcez
`12-16
`
`HUB
`
`\
`
`FIGURE 1
`
`I
`
`//
`Control PODI
`,CC<— ,
`\
`/
`\
`/
`\
`
`I
`
`x
`
`\—_”
`
`/ 12,14
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 2 of 7
`
`US 7,379,778 B2
`
`38
`
`Power source
`
`28
`
`33
`
`Transceiver
`Receiving
`circuit
`
`,
`
`Transmitting
`circuit
`
`32
`
`Non-
`
`
`
`volatile
`
`memory
`
`34
`
`ROM
`memory
`
`26
`
`RAM
`memory
`
`27
`
`device
`
`E
`Crystal
`
`Clock and
`timer logic
`
`30
`
`24
`
`FIGURE 2
`
`howwa
`
`,o
`
`9 §9
`
`.9
`2
`
`Key matrix
`
`Visual feedback
`
`device
`
`36
`Audio feedback
`
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 3 of 7
`
`US 7,379,778 B2
`
`55
`I Transmitter
`
`.v.
`
`I Receiver
`
`Non-volatile
`memory
`
`ROM
`memory
`
`RAM
`memory
`
`54
`
`56
`
`52
`
`51
`
`-
`
`ible
`'
`LED
`
`3
`
`58
`
`
`
`.2
`E
`
`Clock and
`timer logic
`
`53
`
`50
`
`FIGURE 3
`
`I—
`0U)U)
`
`mo 9o
`
`.
`
`oo 9
`
`_£>\\\\\
`
`62
`
`64
`
`Input/Output
`
`[:2]
`Crystal
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 4 of 7
`
`US 7,379,778 B2
`
`
`
`
`lR Blaster
`
`
`Controller
`
`
`
`
`Virtual Network [Sayer
`Content
`
`lP Registry
`Delivery
`
`
`Control Manager
`Content Gateway
`
`
`
`FIGURE 4
`
`74
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 5 of 7
`
`US 7,379,778 B2
`
`
`
`500
` Internet Based
`
`Server
`
`
`
`
`
`
`PC with Home
`Automation
`
`
`FIGURE 5
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 6 of 7
`
`US 7,379,778 B2
`
`601
`
`
`
`
`
`602
`
`
`
`
`606
`
`Recieve User Input
`
`603
`
`604
`
`
`
`
`i
`=
`:
`
`E
`5
`
`5
`
`i
`
`5
`5
`.
`
`Normalize input
`
`-
`Portable Devrce
`
`
`
`6““
`
`650
`
`i g/
`
`Control Pod
`
`5
`
`g
`
`g
`E
`5
`3
`
`5
`
`g
`
`1 00
`
`Action descn tor
`
`p
`
`620
`
`Select device
`(location and
`activity based)
`
`
`
`Translate action
`
`003;?"223‘2‘2;
`'
`,
`b::se;i°;‘o::r"%n
`degice
`
`Issuedevice
`
`command
`
`670
`
`FIGURE 6
`
`O 610
`
`Local and/or remote
`database(s)
`0
`Key codes
`u
`Key labels
`.
`Phonics
`- .
`Thesaurus/dictionary
`cross-referenced to action
`descriptors
`
`612
`
`- 660
`
`Local and/or remote
`database
`.
`Action descriptors
`0
`Device type/model
`cross-referenced to
`- command codes
`
`I 662
`
`g
`
`5
`:
`:
`
`:
`5
`
`5
`;
`
`z
`
`5
`’
`l
`
`5
`
`‘
`5
`5
`E
`
`i
`
`5
`
`5
`5
`
`5
`
`2
`
`

`

`U.S. Patent
`
`May 27, 2008
`
`Sheet 7 of 7
`
`US 7,379,778 B2
`
` \
`
`RFID activation
`\_.2 signal
`
`
`
`Figure 7
`
`

`

`US 7,379,778 B2
`
`1
`SYSTEM AND METHODS FOR HOME
`APPLIANCE IDENTIFICATION AND
`CONTROL IN A NETWORKED
`ENVIRONMENT
`
`RELATED APPLICATION DATA
`
`This application claims the benefit of and is a divisional
`ofU.S. application Ser. No. 11/047,441, filed Jan. 31, 2005,
`which is a continuation-in-part of US. application Ser. No.
`10/978,860, filed Nov. 1, 2004, which, in turn, claims the
`benefit of US. Provisional Application Ser. No. 60/517,283,
`filed on Nov. 4, 2003, which applications are hereby incor-
`porated by reference in their entirety.
`
`BACKGROUND
`
`The following relates generally to home control systems
`and, more particularly, relates to a system and associated
`methods for controlling and operating a plurality of home
`appliances from a variety of different locations in a net-
`worked home control and automation environment.
`
`Current home appliances and associated remote controls
`(“legacy” appliances) have limited functional abilities and
`minimal
`interoperability features. Emerging advances in
`wireless and distributed computing technologies, coupled
`with network enabled home appliances (such as those that
`may be addressed, accessed, monitored, and managed
`remotely over networks and the Internet) and industry wide
`interoperability standards (e.g., Universal Plug and Play
`(“UPnP”) and Home Audio Video interoperability (“HAVi”)
`standards) provide a rough framework for network enabled
`home environments having increasingly integrated home
`control capabilities, functions, and features. A background
`and overview of home interoperability technologies and
`projected features may be found in the Intel Technical
`Journal, Volume 6, Issue 4, published Nov. 15, 2002 entitled
`“Interoperable Home Infrastructure” which is fully incorpo-
`rated by reference herein.
`Though promising in their goals and objectives, the UPnP,
`HAVi, Intel Interoperability Infrastructure, etc. do not cur-
`rently provide for many advanced control based features
`relating to networked home control and automation envi-
`ronments. Accordingly, it is desired to provide a system and
`method that functions to enable advanced home control
`
`features such as location based control setup and operation,
`network enabled legacy appliances and system integration,
`save and recall capabilities for appliance and media states,
`generic command based appliance controls, dynamic/com-
`plex macro command generation, and Internet based control
`capabilities from remote locations. Additional
`inventive
`features and functions will also be evident from the home
`
`appliance control system and methods hereinafter described.
`
`SUMMARY
`
`In accordance with these needs and desires, a control
`system and associated methods for control and operation are
`described for use in a networked home control and automa-
`tion environment.
`
`the system includes one or more wireless
`Generally,
`remote controls, a plurality of appliances (including network
`enabled appliances and traditional legacy appliances in the
`exemplary system), associated control centric devices (gen-
`erally devices whose chief function is providing control
`based functions and services, including but not limited to
`control pods, control servers, device state monitors, etc.) and
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`associated content centric devices (generally devices whose
`chief function is providing content based functions and
`services,
`including but not limited to content managers,
`content servers, content renderers, etc.).
`Additionally, various methods for control and operation
`of appliances in the networked home control and automation
`environment are disclosed. Specifically, methods that func-
`tion to enable advanced home control features such as
`
`location based control setup and operation, network enabled
`legacy appliances and system integration, save and recall
`capabilities for appliance and media states, generic com-
`mand based appliance controls, dynamic/complex macro
`command generation, and Internet based control capabilities
`from remote locations are disclosed in conjunction with the
`system of the current invention.
`A better understanding of the objects, advantages, fea-
`tures, properties and relationships of the subject system and
`methods will be obtained from the following detailed
`description and accompanying drawings which set forth
`illustrative embodiments which are indicative of the various
`
`ways in which the principles of the system and method may
`be employed.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`For a better understanding of the system and method
`described hereinafter, reference may be had to preferred
`embodiments shown in the following drawings in which:
`FIG. 1 illustrates an exemplary networked home control
`and automation system;
`FIG. 2 illustrates a block diagram of components of an
`exemplary remote control;
`FIG. 3 illustrates a block diagram of components of an
`exemplary control device;
`FIG. 4 illustrates an exemplary network enablement
`device;
`FIG. 5 illustrates a VPN implemented with the networked
`home control environment;
`FIG. 6 illustrates an exemplary system for implementing
`a generic command structure within a home appliance
`network; and
`FIG. 7 illustrates an exemplary networked home control
`environment incorporating RFID enabled devices.
`
`DETAILED DESCRIPTION
`
`With reference to the Figures, an integrated home control
`system and associated control and operation methods are
`described for use in a networked home control and automa-
`tion environment.
`
`The system envisaged by the current invention provides
`for both the interoperability of various network enabled and
`legacy home appliances, and advanced command and con-
`trol functions for such appliances. To this end, the networked
`home control and automation system (shown generally in
`FIG. 1) includes one or more remote controls 10, a plurality
`of appliances 12 (including network enabled appliances and
`traditional
`legacy appliances in the exemplary system),
`associated control centric devices 14 (generally devices
`whose chief function is providing control based functions
`and services, including, but not limited to, control pods,
`control servers, device state monitors, etc.) and associated
`content centric devices 16 (generally devices whose chief
`function is providing content based functions and services,
`including, but not
`limited to, content managers, content
`servers, content renderers, etc.).
`
`

`

`US 7,379,778 B2
`
`3
`By way of example only, the appliances 12 may include,
`but are not
`limited to,
`televisions, VCRs, DVRs, DVD
`players, cable converter boxes, amplifiers, CD players, game
`consoles, home lighting, drapery,
`fans, HVAC systems,
`thermostats, personal computers, security systems, network
`enabled automobiles, etc. According to the exemplary sys-
`tem, some or all of the above devices, appliances, and
`components are configured to be network enabled and
`interoperable (e.g., as defined and described in the UPnP
`and/or HAVi specifications which can be found at
`the
`upnp.org Web site and the havi.org Web site respectively,
`which specifications are incorporated herein by reference in
`their entirety) such that basic device addressing, accessibil-
`ity, monitoring, remote management, and other network
`communication based features are possible in a home con-
`trol and automation environment. The networked home
`
`control and automation environment 100 itself may utilize
`well known centralized networking methods, ad hoc net-
`working methods (including peer-to-peer networking), pow-
`erline or phoneline based networking methods, or a combi-
`nation of the above (whether wired or wireless)
`to
`accomplish the features and goals of the present invention.
`Additionally,
`it will be appreciated that particular appli-
`ances, devices, and components of the exemplary system
`may incorporate some or all of the features, functions, and
`capabilities of other individual devices such that a minimal
`number of separate physical devices are required in a given
`home environment to accomplish the goals of the current
`invention. For instance, devices such as a Media Center PC
`or network enabled TV (e.g., one compliant with the UpnP
`and/or HAVi specifications) may include, in additional to
`standard computing and/or audio/video playback functions,
`system wide control capabilities, content management and
`rendering abilities, and location based services. As such it
`will be appreciated that the various system elements defined
`and described herein should be considered as functional
`
`modules capable of implementation individually or collec-
`tively in a single physical device or a software module in a
`software product, or one or more elements may be imple-
`mented in separate physical devices or software modules,
`without departing from the scope and spirit of the present
`invention.
`
`Looking now to FIG. 2, for use in transmitting command
`codes, generic commands, macro commands, etc. to one or
`more of the appliances (both network enabled and legacy)
`the remote control 10 may include, as needed for a particular
`application, a processor 24 coupled to a memory device
`(such as ROM memory 26, RAM memory 27, and/or a
`non-volatile memory 34), a key matrix 28 (e.g., physical
`buttons, a touch screen display, or a combination thereof), an
`internal clock and timer 30,
`transmission circuit(s) 32,
`receiver circuit(s) 33, and/or transceiver circuit(s) (e.g., IR
`and/or RF), a means 36 to provide feedback to the user (e.g.,
`LED, display, speaker, and/or the like), and a power supply
`38 as generally illustrated in FIG. 2. As will be understood
`by those of skill in the art, the memory device may include
`executable instructions that are intended to be executed by
`the processor 24 to control the operation of the remote
`control 10. In this manner, the processor 24 may be pro-
`grammed to control
`the various electronic components
`within the remote control 10, e.g., to monitor the power
`supply 38, to cause the transmission of signals, etc.
`The non-volatile read/write memory 34, for example an
`EEPROM, battery-backed up RAM, Smart Card, memory
`stick, or the like, may be provided to store setup data and
`parameters as necessary. It is to be additionally understood
`that the memory devices may take the form of any type of
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`readable media, such as, for example, ROM, RAM, SRAM,
`FLASH, EEPROM, Smart Card, memory stick, a chip, a
`hard disk, a magnetic disk, and/or an optical disk. Still
`further,
`it will be appreciated that some or all of the
`illustrated memory devices 26, 27, and 34 may be physically
`incorporated within the same IC chip as the microprocessor
`24 (a so called “microcontroller”) and, as such, they are
`shown separately in FIG. 2 only for the sake of clarity.
`To identify home appliances by type and make (and
`sometimes model) such that the remote control device 10 is
`adapted to transmit recognizable command codes in the
`format appropriate for such identified appliances 12, data
`may be entered into the universal remote control device 10.
`Since methods for setting up a remote control to control the
`operation of specific home appliances are well-known, such
`methods need not be described in greater detail herein.
`Nevertheless,
`for additional
`information pertaining to
`remote control setup, the reader may turn to US. Pat. Nos.
`4,959,810, 5,614,906, and 6,225,938. It will also be appre-
`ciated that the remote control 10 may be set up to control an
`appliance 12 by being taught the command codes needed to
`control such appliance as described in US. Pat. No. 4,623,
`887.
`
`To cause the remote control 10 to perform an action, the
`remote control 10 is adapted to be responsive to events, such
`as a sensed user interaction with the key matrix 28, receipt
`of a transmission, etc. In response to an event, appropriate
`instructions within the memory 26 may be executed. For
`example, when a command key is activated on the remote
`control 10, the remote control 10 may retrieve a command
`code corresponding to the activated command key from
`memory 26 and transmit the command code to a device in
`a format recognizable by the device. It will be appreciated
`that the instructions within the memory 26 can be used not
`only to cause the transmission of command codes and/or
`data to the appliances 12 but also to perform local opera-
`tions, e. g., location based features and functions as described
`in greater detail below. While not
`limiting, other local
`operations that may be performed by the remote control 10
`include displaying information/data, favorite channel setup,
`macro button setup, function key relocation, etc. Examples
`oflocal operations can be found in US. Pat. Nos. 5,481,256,
`5,959,751, and 6,014,092. Additional examples of remote
`controls 10 may be found in commonly owned, US. Pat. No.
`6,225,938 and US. application Ser. Nos. 60/264,767,
`09/905,423, 09/905,432, and 09/905,396.
`Remote control 10 may also include, as needed for a
`particular application, CCD or other imaging sensors, micro-
`phone, and/or touchscreen display for receipt of various
`types of user input for effecting operations of the remote
`control. Remote control 10 may also be configured to
`include appliance, control server, and content server func-
`tions, as will be described in greater detail below. For
`instance, remote control 10 may be implemented on a laptop
`computer, smart panel, tablet PC, wireless enabled PDA,
`mobile phone, etc which may all include programming to
`cause remote control 10 to playback music, videos, pictures
`and the like, monitor appliance feature and state tables for
`advanced control functions, and include programming for
`location determination methods. Remote control 10 may
`thus be viewed as a wireless appliance having functions
`similar to less portable appliances of the networked control
`environment, and as such the following discussions and
`descriptions of the remote controls, and controlling devices
`in general, should be taken in the broadest sense possible.
`Each network enabled appliance of the system (including
`legacy appliances that have been network enabled as
`
`

`

`US 7,379,778 B2
`
`5
`described in greater detail below) include, or are assigned a
`unique address. According to the exemplary embodiment,
`this address is in the form of a Uniform Resource Identifier
`
`(URI) which can be any Uniform Resource Locator (URL)
`or Uniform Resource Name (URN), typically assigned Via a
`control server of the system, such that all appliances in
`communication with the control server may be accessed
`from at least the control server. It will be appreciated that
`multiple appliances may include control and addressing
`functions in a given system such that each individually 10
`addressed appliance may be accessed by multiple control
`servers, control pods, or other control devices. Additionally,
`it will be understood that networked devices need not
`
`5
`
`15
`
`include fully functional web server applications or similar
`features, but may be configured to simply broadcast and/or
`listen on specified IP ports to accomplish system connec-
`tivity and communications.
`Network enabled appliances of the system additionally
`include basic feature and state reporting functions for
`enabling other appliances, control server(s), and remote 20
`control(s) to readily ascertain the available control functions
`of an appliances, and the current state of the control func-
`tions. As will be appreciated by those skilled in the art, an
`Extensible Markup Language OiML) or similar format may
`be used to transmit and receive such information between 25
`
`appliances, servers, and remote controls. It is also possible
`to modify the URI or other unique identifier assigned each
`appliance such that contained in each appliance address is an
`indication of the available functions, and even an indication
`of current appliance state. One method of implementing 30
`such a system would be to include appropriate device code
`identifiers (e.g., an IR command library, individual IR code,
`and/or graphical user interface element reference number(s))
`in the URI for each appliance, thus broadcasting capabilities
`(and thus available features) of the device to any control 35
`server with access to the associated device library. One
`example
`appliance
`address
`(URI) may be
`“http://
`123.456.789.0/wxyz,” where “123.456.789.0” is the main
`appliance address, and “wxyz” in the reference number
`corresponding to an IR command code set for that particular 40
`appliance.
`For enabling frequent feature set and state updates of
`appliances present in the networked control environment on
`associated control servers and remote controls, well known
`multicasting methods for appliance advertising and discov- 45
`ery may be used (e.g., IP Multicasting). In this way appli-
`ances, servers, and remote controls may easily monitor and
`register feature set and state changes on the networked
`control environment.
`As described above and shown in FIG. 1, the control and 50
`content servers (including control pods, command/state
`monitors, content renderers, etc.) of the present invention
`may be separate devices, may be incorporated into one or
`more of the appliances such that no individual “server
`devices” are present, etc. Functionally, content centric 55
`devices can serve as a repository for digital media files
`(audio, video, photo, and multimedia content), offer search
`and cataloging based services, and serve files to one or more
`appliances for playback. Generally computing based devices
`such as Media Center PCs, “Content Servers,” and “Con-
`tent Renderers,” as defined and described in, for example,
`the UPnP specification, are examples of content centric
`devices in a home control and automation environment.
`
`60
`
`Control centric devices generally function to receive,
`save, process, and transmit media and state data for appli-
`ances and devices of the home control and automation
`
`65
`
`environment. Various types of command data (IR, RF,
`
`6
`Powerline commands, Phoneline commands, etc.) may be
`saved by command/state monitors as described in greater
`detail below. Whether implemented on a single device, or
`distributed across multiple devices in the home control and
`automation environment, these control devices are capable
`of performing logic based operations on saved command
`and state data for use with appliances, remote control
`interfaces, and desired user functions. Preset control instruc-
`tions on control devices may dictate how and when com-
`mand and state data is captured and processed, or user
`interaction with an appliance or remote control device may
`dictate the manner of command and state data capture and
`processing. Saved and/or processed command and state
`playback may likewise be effectuated by preset instructions,
`automated system processes, or user interaction with appli-
`ances and devices of the system.
`Generally, the functions performed by a particular control
`device will depend on included firmware, software and
`programming, additional components, and level of integra-
`tion with other appliances of the system. As such the general
`control device as shown and described in FIG. 3 may be
`configured and modified as further described herein to
`function as a location signaling device, network enablement
`device, command/state monitor, control pod, network bridge
`(such as for example an IR, RF, X-lO, or Simple Control
`Protocol (SCP) bridge), or any combination of the above.
`The control device may also be fully incorporated into any
`of the appliances of the home environment as a functional
`element (i.e., as a service or application software running on
`the appliance).
`For use in accomplishing one or more of the above
`described control features in the networked control and
`
`automation system, a control device 14 is described. The
`control device 14 may be a device separate and apart from
`the other system appliances or may be integrated into one or
`more of the appliances as is illustrated in FIG. 1. In either
`case, the control device 14 may include, as needed for a
`particular application, a processor 50 coupled to a memory
`device (such as ROM memory 52, RAM memory 51, and/or
`non-volatile read/write memory 56), an internal clock and
`timer 53, receiver circuit(s) 54, transmission circuit(s) 55
`and/or transceiver circuit(s) (e.g., IR and/or RF), a means 58
`to provide feedback to the user (e.g., LED, display, speaker,
`and/or the like), a power supply 62, and input/output means
`64,
`(e.g., serial I/O port, wireless transceiver, bar code
`scanner, X-lO bridge, SCP Bridge, Ethernet port, etc.), as is
`generally illustrated in FIG. 3. The memory device may
`include executable instructions that are intended to be
`
`executed by the processor 50 to control the operation of the
`control device 14. In this manner, the processor 50 may be
`programmed to control the various electronic components
`within the control device 14, e.g., to monitor the power
`supply 62, to cause the transmission of signals, to provide
`audio or visual prompts to a user, etc. The non-volatile
`read/write memory 56, for example an EEPROM, battery-
`backed up RAM, Smart Card, memory stick, or the like, may
`also be provided to store setup data and parameters as
`necessary. While the memory 52 is illustrated and described
`as a ROM memory, memory 52 can also be comprised of any
`type of readable media, such as ROM, RAM, SRAM,
`FLASH, EEPROM, or the like. Preferably, the memory 56
`is non-volatile or battery-backed such that data is not
`required to be reloaded after battery changes. In addition, the
`memories 51, 52 and 56 may take the form of a chip, a hard
`disk, a magnetic disk, and/or an optical disk. It will also be
`appreciated that in cases where control device capability is
`integrated into an appliance, some or all of the functional
`
`

`

`US 7,379,778 B2
`
`7
`elements described above in conjunction with FIG. 3 may be
`combined with similar elements already present
`in the
`appliance for other purposes.
`It will be appreciated that the abovementioned transmitter
`55, receiver 54, and/or input/output means 64 may be used
`to connect control device 14 to one or more networked
`
`appliances, content servers, computers, the Internet, or other
`devices and appliances of a networked home control envi-
`ronment. As such programming and instructions on the
`control device may control the operation of other devices
`and appliances in the system, access content and command
`data stored or maintained either entirely or in part at a
`location physically separate from the control device 14 (such
`as for example in a server or personal computer located
`elsewhere in the home or remotely via the Internet), and
`communicate wirelessly with a remote control unit
`to
`accomplish command and control features of the current
`invention.
`In order to enable location based control and automation
`
`functions, a remote control position determination system
`and method is described in conjunction with the networked
`control environment of the present invention. In general, the
`remote control position determination system includes one
`or more location signaling devices within multiple control
`environments (or control zones), each control environment
`including home appliances operable by the remote control.
`In one exemplary system of the remote control position
`determination system, a location signaling device (i.e., one
`implementation of control device 14) is placed within each
`control environment in order to send one or more signals to
`the remote control for location determination operations.
`Various methods for determining the location of the remote
`control relative to the various control environments and
`
`zones, or similarly determining the proximity of various
`home appliances to the remote control are disclosed, as well
`as methods for using determined location information to
`dynamically reconfigure default command set and/or macro
`commands on the remote control to control a desired appli-
`ance or multi-appliance function. An exemplary remote
`control position determination system and method is
`described in greater detail in co-pending US. patent appli-
`cation Ser. No. 10/978,971 entitled “System And Method for
`Controlling Device Location Determination” which is
`owned by a common assignee and incorporated herein by
`reference in its entirety.
`By implementing a remote control location determination
`system with the networked home control environment of the
`present invention, many additional functions and features
`can be accomplished. For instance, a remote control may
`determine its location based on appliance signaling and
`unique identifiers,
`then the location data for the remote
`control may be formatted and broadcast as