111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US009716853B2
`
`c12) United States Patent
`Arling et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,716,853 B2
`*Jul. 25, 2017
`
`(54) SYSTEM AND METHOD FOR OPTIMIZED
`APPLIANCE CONTROL
`
`(71) Applicant: Universal Electronics Inc., Santa Ana,
`CA (US)
`
`(72)
`
`Inventors: Paul D. Arling, Irvine, CA (US);
`Ramzi Ammari, Newport Coast, CA
`(US); Arsham Hatambeiki, Irvine, CA
`(US); Graham Williams, Corona Del
`Mar, CA (US)
`
`(73) Assignee: Universal Electronics Inc., Santa Ana,
`CA (US)
`
`(58) Field of Classification Search
`CPC ............ GOSC 2201/20; GOSC 2201/21; GOSC
`2201/33; GOSC 2201/40; GOSC 2201/41;
`(Continued)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,529,556 B1
`6,968,399 B2
`
`3/2003 Perdue et a!.
`1112005 Noda et a!.
`(Continued)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`EP
`wo
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`FOREIGN PATENT DOCUMENTS
`
`1722341 A1
`20111053008 A2
`
`1112006
`5/2011
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 14/948,927
`
`(22) Filed:
`
`Nov. 23, 2015
`
`(65)
`
`(63)
`
`(51)
`
`(52)
`
`Prior Publication Data
`US 2016/0080679 Al Mar. 17, 2016
`Related U.S. Application Data
`Continuation of application No. 13/933,877, filed on
`Jul. 2, 2013, now Pat. No. 9,219,874, which is a
`(Continued)
`
`Int. Cl.
`G05B 11101
`H04N 5144
`
`(2006.01)
`(2011.01)
`(Continued)
`
`U.S. Cl.
`CPC ........... H04N 514403 (2013.01); G08C 17102
`(2013.01); G08C 23104 (2013.01); H04B
`11205 (2013.01);
`
`IS A/US, Int. Search Report and Written Opinion of the Int. Search(cid:173)
`ing Authority issued on Int. Appln. No. PCT/US12/62161, received
`Jan. 23, 2013, 12 pages.
`
`(Continued)
`
`Primary Examiner- Firmin Backer
`Assistant Examiner- Adnan Aziz
`(74) Attorney, Agent, or Firm- Greenberg Truarig, LLP
`
`(57)
`
`ABSTRACT
`
`A device receives a request from a controlling device, such
`as a remote control, smart phone, or the like, where the
`request is intended to have one or more target devices
`perform one or more functional operations. The device
`responds to the request by applying the optimum method(cid:173)
`ology to propagate one or more commands to each intended
`target appliance to cause each intended target appliance to
`perform the intended one or more functional operations.
`
`(Continued)
`
`8 Claims, 13 Drawing Sheets
`
`122
`
`1l3j
`l
`
`~ 100
`
`\~/ 116
`'I' \\
`\
`
`124 --
`
`:104
`
`102
`
`Roku EX1001
`U.S. Patent No. 9,716,853
`
`

`

`US 9,716,853 B2
`Page 2
`
`Related U.S. Application Data
`
`continuation of application No. 13/657,176, filed on
`Oct. 22, 2012, now Pat. No. 9,215,394.
`
`8,373,556 B2
`2003/0095156 A1
`2004/0163073 A1
`2004/0210933 A1
`2006/0116148 A1 *
`
`212013 LaLonde et a!.
`5/2003 Klein et a!.
`8/2004 Krzyzanowski et a!.
`10/2004 Dresti et a!.
`6/2006 Bah!
`
`H04W 28/18
`455/517
`
`G08C 23/04
`370/318
`G08C 17/00
`700/11
`
`2006/0168618 A1
`2006/0227032 A1
`2007/0165555 A1 *
`
`7/2006 Choi
`10/2006 Vidal
`7/2007 Deng
`
`2007/0225828 A1 *
`
`9/2007 Huang
`
`2008/0005764 A1
`2009/0239587 A1
`2010/0134317 A1
`2010/0138764 A1
`201110273287 A1
`2011/0289113 A1
`2012/0242526 A1
`2012/0249890 A1
`2012/0274547 A1
`2012/0278693 A1
`2012/0291128 A1
`2012/0330943 A1
`2013/0107131 A1
`2014/0085059 A1
`
`1/2008 Arling eta!.
`9/2009 Negron eta!.
`6/2010 Breuil eta!.
`6/2010 Hatarnbeiki et a!.
`1112011 LaLonde et a!.
`1112011 Arling eta!.
`9/2012 Perez eta!.
`10/2012 Chardon et al.
`1112012 Raeber eta!.
`1112012 Black et al.
`1112012 Jayawardena et a!.
`12/2012 Weber eta!.
`5/2013 Barnett et a!.
`3/2014 Chen eta!.
`
`OTHER PUBLICATIONS
`
`(60)
`
`Provisional application No. 61/552,857, filed on Oct.
`28, 2011, provisional application No. 61/680,876,
`filed on Aug. 8, 2012.
`
`(51)
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2006.01)
`
`Int. Cl.
`G08C 17102
`G08C 23104
`H04B 1120
`H04N 211422
`H04N 211436
`H04N 5160
`(52) U.S. Cl.
`CPC ........... H04N 5160 (2013.01); H04N 2114222
`(2013.01); H04N 21142204 (2013.01); H04N
`21143615 (2013.01); G08C 2201/40 (2013.01);
`G08C 2201/92 (2013.01); H04N 2005/4426
`(2013.01); H04N 2005/4435 (2013.01); H04N
`2005/4442 (2013.01)
`(58) Field of Classification Search
`CPC . GOSC 2201/91; H04L 12/281; H04L 12/282;
`H04L 12/2814; H04L 12/2818; H04L
`12/2803; H04L 12/2809
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`7,379,778 B2
`7,519,393 B2
`7,589,642 B1
`
`5/2008 Hayes et a!.
`4/2009 Bah! et a!.
`9/2009 Mui
`
`IS A/US, Int. Search Report and Written Opinion of the Int. Search(cid:173)
`ing Authority issued on Int. Appln. No. PCT/US14/38151, received
`Jun. 27, 2014, 10 pages.
`European Patent Office, extended European Search Report issued on
`European patent application No. 12844121.9, dated Mar. 5, 2015, 6
`pages.
`European Patent Office, extended European Search Report issued on
`European patent application No. 14801064.8, dated Apr. 16,2016,
`8 pages.
`* cited by examiner
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 1 of 13
`
`US 9,716,853 B2
`
`120 --
`
`122
`
`108
`
`106
`
`104 __ /
`
`· ..
`
`' -102
`
`Figure 1
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 2 of 13
`
`US 9,716,853 B2
`
`108 \
`
`112
`' lt i>
`··-,_
`;~7
`
`';•, ·,
`
`/
`
`•,
`
`·106
`
`l w 0>,
`
`ooooo
`
`,; :©~!-
`
`~~
`
`lJ
`
`!
`'-.
`
`204
`
`!nlemet
`
`212
`
`1 t·;.:.:-:-:-:.,_
`
`,,;;-;=, ·;g::::-''-"""''"-:lr,ffit
`
`~/
`
`~
`
`110
`
`200 _,//
`
`'--._ 202
`
`'207
`
`Figure 2
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 3 of 13
`
`US 9,716,853 B2
`
`106
`
`- 114
`
`---304
`
`118-
`
`100'
`
`\
`
`~-/-116
`~\
`\
`
`WAN
`(e.g. Internet,
`cable piant,elc.)
`
`104 /
`
`102
`
`-207
`
`Figure 3
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 4 of 13
`
`US 9,716,853 B2
`
`108 -~
`
`106
`
`420
`
`408
`
`114
`
`406 .· .
`
`.. 204
`
`402
`
`202
`
`Figure 4
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 5 of 13
`
`US 9,716,853 B2
`
`114
`
`510 -
`
`508 ..
`
`506
`
`External
`power supply
`
`118
`
`208
`
`512
`
`514
`
`. 516
`
`502
`
`Processor
`
`$':
`('i)
`3
`0 <
`
`' 500
`
`100
`
`504
`
`t
`
`it
`
`116
`
`Figure 5
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 6 of 13
`
`US 9,716,853 B2
`
`106
`
`TV
`
`/108
`
`DVD
`
`408
`
`CD
`
`610
`
`STB
`
`r~:i~~~~~~ei
`W~¥, pa\.!~~; F·
`Wtif•••
`
`512.
`
`508 -,
`
`l
`\
`506 --~ /j \
`;' 514 ·.
`.
`· .• \I 114
`i----,
`,.,...,,..,~,-,.,..,..,..,.,.,..,.,~"""'=-'~,...,~~ I= ....... -!.....-......-,
`
`Universal control engine core
`
`§;?_Q
`
`.··620
`
`AVR
`
`670
`
`210
`
`t
`. \ {\
`
`\
`\
`
`\,,,
`
`\
`>-,~
`
`[- wiFi--J~-----------------1[-!R~e~~ J
`504 .· t
`\/\
`~ \
`\
`\
`
`·- .. 510
`
`\
`\
`
`200
`
`·------104
`
`102 ___ .. ··
`
`Figure 6
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 7 of 13
`
`US 9,716,853 B2
`
`702
`
`720
`
`716·· ..
`
`700 ·· .. ,
`
`s::
`0
`·.;:::
`u
`c:
`::l
`u..
`
`I
`
`I
`
`I
`
`',
`
`'
`~
`
`···-. •.'
`'·
`
`· .....
`
`Power on
`
`Power off
`
`Volume up
`
`Volume down
`
`Mute
`
`Play
`Pause
`FF
`Rew
`
`Sound field A
`
`Sound field B
`
`Input 1
`
`Input 2
`
`Etc .....
`
`.. ,
`'
`
`\:.
`
`I
`
`TV
`CEC
`CEC
`IR
`IR
`IR
`n/a
`n/a
`n/a
`n/a
`CEC
`CEC
`CEC
`CEC
`
`AVR i
`CEC
`CEC
`CEC
`CEC
`CEC
`n/a
`n/a
`n/a
`
`n/a
`IP
`
`704
`/ 710
`/ 708
`.................. '~: .. ,_. .................. ··:·.;··········/····························;·: ............................................................................................. .
`!\!
`~ooliaoce
`Appliance
`\":
`STB/DVR
`CEC
`CEC
`n/a
`n/a
`n/a
`CEC
`CEC
`CEC
`CEC
`IP
`
`Etc ....
`
`CD
`IR
`
`IR
`
`n/a
`
`n/a
`
`n/a
`IR
`IR
`IR
`
`IR
`
`n/a
`
`DVD
`CEC
`CEC
`n/a
`n/a
`n/a
`CEC
`CEC
`CEC
`CEC
`n/a
`n/a
`n/a
`n/a
`
`IP
`n/a
`n/a
`
`IP
`
`IR
`!R-
`
`'
`
`I
`
`•,
`
`I
`
`i\
`
`n/a
`
`n/a
`
`n/a
`
`I
`I
`
`I
`
`706
`
`712
`
`714
`
`718
`
`Figure 7
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 8 of 13
`
`US 9,716,853 B2
`
`816
`· .. __
`
`118
`
`USB
`
`J
`
`:~)>::~.
`
`WiFi
`
`,814
`
`Power
`SL!pply
`
`I
`
`Processor
`
`/' 800
`
`I
`;
`
`806
`
`/
`
`!
`
`8 10
`
`Display
`interface
`
`-
`
`Blue-
`tooth
`
`818
`
`. .
`
`820
`
`/ Ur
`
`Touch
`
`screen -
`
`interface
`
`-
`
`I
`
`'
`
`·-808
`
`Camera
`
`----·
`
`/
`
`/
`'
`822
`
`//········
`
`824
`
`Accele:·-
`ometer,
`GPS,
`
`ambient -
`
`light
`sensor,
`Ni'C,
`etc.
`
`Hard kevs
`
`812
`
`2_Q2.
`
`Built-in memory
`
`I
`
`External memory
`
`I
`
`~12
`
`I
`
`. 804
`
`Figure 8
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 9 of 13
`
`US 9,716,853 B2
`
`Appliance command
`database server
`
`Set up app
`
`UCE programming
`
`I
`I
`I
`I
`1
`
`I
`I
`1
`
`1
`I
`1
`I
`I
`1
`I
`I
`1
`
`Set up UCE
`I
`.-:------",.t,__---. 902
`Request user to ./
`power all
`appliances on
`
`I
`I
`I
`I
`
`1
`
`4
`
`I
`.--De-t-er-,f ..... i-ne_C_E_C....,__::9
`
`Scan for
`r-~r-~
`I
`connected CEC
`enabled
`.c,----~---
`appliances
`appliances
`
`!96
`
`t
`908
`1
`r-S-ca-n-:fo_r_o_H_Ie-r'~}O
`r--0-e-te"""n-n-in-e--,·-""'
`HDMi (non-CECl ---------------r-----------li HDMi attached
`· •---------··r··-----------~.........._a.:...;pp:.....l_ia_nc_.e_s ...........~
`appliances
`I
`I
`
`912
`---'
`
`~
`Display list of
`located
`appliance~
`t____, 914
`.----......._
`User identifies
`non-CEC and non-
`HDMi appliances
`
`,/
`
`1
`I
`I
`
`1
`I
`I
`1
`
`Store final ~O
`con:mand
`matrix
`
`~?o I
`.------__,922
`;--'
`Receive
`I
`codesets, issue
`l+------c-1---t test commands
`I
`I
`
`926
`---'
`
`.----::--.,-------..~~8 I
`.-----=-'t'--:-----. 916
`Retrieve
`Obtain
`__ _
`command sets 4:-----------l·------------ command sets
`for appliances
`1
`for appliances
`-!.
`Test and
`confirm codsets
`~
`Build command
`matrix, transfer
`to UCE
`~
`Configure
`activities
`~
`Done
`
`207\
`
`)
`
`<----=>-- / ~/
`
`.--....,...--.,..--___, ~}4 I
`Retrieve
`I
`alternate
`~
`I
`command sets
`'~--------~~8-u_!i_d_co-n-lm-.-at-ld~~f--2-8--+----4
`I
`I
`I
`I
`I
`I
`I
`I
`
`matrix
`
`Figure 9
`
`932
`----'
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 10 of 13
`
`US 9,716,853 B2
`
`Set up app
`
`UCE programming
`
`Identify video ~'
`rendering
`device and
`content route
`
`1010
`__ _..
`
`1012
`
`-~'
`
`1014
`__ /
`
`1018
`
`_ _._/
`
`1020
`
`Identify audio
`rendering
`device and
`content route
`
`N
`
`Download
`activity matrix
`to UC.E
`
`1016
`issue comm;mds ~'
`and report
`status as
`required
`
`1022
`
`_._/
`
`Store finalized
`activity matrix
`
`Figure 10
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 11 of 13
`
`US 9,716,853 B2
`
`1100
`
`I
`
`1104
`
`-"~ ....
`
`I
`
`Appliance
`
`Activity= "Listen to music"
`Activity == "Watch a movie"
`Activity = "Watch TV"
`TV
`STB/OVR
`
`DVD
`
`-
`-
`-
`-
`S/PDIF2
`:
`\ -
`'t
`c:
`Active ,
`Off
`Volume
`0 ~------+-+-----+-------4-------~----~ri
`·.;:::;
`u Transport
`Off
`Active
`§ r-------+-~----+-----~;-----~~------~
`u.
`~~
`
`' 1101
`
`I
`/
`
`AVR
`
`On
`
`1102
`
`/'
`,__
`,....._
`,_.....
`
`r-
`w
`I
`I
`
`L
`
`-1110
`
`1118
`
`Power
`
`Input
`
`On
`
`HDMI1
`
`On
`--
`
`Off
`--
`
`I
`
`I
`I
`
`I
`
`I
`
`...,
`Q)
`...,
`ro
`(/)
`:<'1
`
`/i
`
`1106
`
`/
`;
`i./
`
`1108
`
`1116
`
`1112
`
`1114
`
`Figure 11
`
`1202
`
`'
`
`__ ;·
`
`,.
`
`Appliance
`
`Power
`
`Input
`...
`
`...,
`Q)
`...,
`ro
`(/)
`I
`
`Current appliance state
`
`TV
`
`On
`
`.HDM12\
`:
`
`: !
`
`I
`\ I
`\I
`
`STB/DVR
`
`Off
`--
`
`ovo
`
`On
`--
`
`AVR
`??
`
`??
`
`---·-
`
`..-1210
`
`.·" 1212
`
`l
`I
`
`I
`I
`
`I
`I
`
`1206
`
`1208
`
`1204
`
`Figure 12
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 12 of 13
`
`US 9,716,853 B2
`
`---1300
`
`Retrieve corresponding
`data element from
`preferred command
`matrix
`
`y
`
`1302
`
`Transmit function
`request to appliance
`using indicated method
`
`Retrieve corresponding
`data element from
`alternate command
`matrix
`
`1316
`
`y
`
`1306
`
`-1308
`
`1310
`
`---1312
`
`Generate error message 1314
`
`Figure 13
`
`

`

`U.S. Patent
`
`Jul. 25, 2017
`
`Sheet 13 of 13
`
`US 9,716,853 B2
`
`"Watch TV"
`
`.A.ccess appliance
`state matrix for
`"Watch TV"
`
`y
`
`...__ 1400
`
`-1402
`
`--1404
`
`Send TV "Power on"
`{CEC)
`
`Set transport
`commands :: DVR
`
`Send TV "Mute"
`(IR}
`
`y
`
`\
`'---1408
`
`\'--1410
`
`Send TV "lnputl"
`(CEC}
`
`\ -'---1412
`
`y
`
`\
`"--1414
`
`\
`'-...__--1418
`
`N
`
`---1420
`
`Send DVD "Power
`oft" (CEC}
`
`Send .IWR
`"Power on"
`(IR.)
`
`Send AVR
`Input"'
`S/PDIF2
`(IR)
`
`Send STB "Power
`on" (CEC)
`
`Set vo!Llme
`commands::: AVR
`
`'--1428
`
`Figure 14
`
`

`

`US 9,716,853 B2
`
`1
`SYSTEM AND METHOD FOR OPTIMIZED
`APPLIANCE CONTROL
`
`RELATED APPLICATION INFORMATION
`
`This application claims the benefit of and is a continuation
`of U.S. application Ser. No. 13/933,877, filed on Jul. 2,
`2013, which application claims the benefit of and is a
`continuation of U.S. application Ser. No. 13/657,176, filed
`on Oct. 22, 2012, which application claims the benefit of
`U.S. Provisional Application No. 61/552,857, filed Oct. 28,
`2011, and U.S. Provisional Application No. 61/680,876,
`filed Aug. 8, 2012, the disclosures of which are incorporated
`herein by reference in their entirety.
`This application is also related to U.S. patent application
`Ser. No. 12/621,277, filed on Nov. 18, 2009 and entitled
`"System and Method for Reconfiguration of an Entertain(cid:173)
`ment System Controlling Device," which in turn is a con(cid:173)
`tinuation-in-part of U.S. patent application Ser. No. 12/569,
`121 (now U.S. Pat. No. 8,243,207), filed on Sep. 29, 2009
`and entitled "System and Method for Activity Based Con(cid:173)
`figuration of an Entertainment System," the disclosures of
`which are incorporated herein by reference in their entirety.
`This application is also related to U.S. patent application
`Ser. No. 13/198,072, filed on Aug. 4, 2011 and entitled
`"System and Method for Configuring the Remote Control
`Functionality of a Portable Device," the disclosure of which
`is incorporated herein by reference in its entirety.
`This application is also related to U.S. patent application
`Ser. No. 13/240,604, filed on Sep. 22, 2011 and entitled
`"System and Method for Configuring Controlling Device
`Functionality," the disclosure of which is incorporated
`herein by reference in its entirety.
`
`BACKGROUND
`
`Controlling devices, for example remote controls, for use
`in issuing commands to entertainment and other appliances,
`and the features and functionality provided by such control(cid:173)
`ling devices are well known in the art. In order to facilitate
`such functionality, various communication protocols, com(cid:173)
`mand formats, and interface methods have been imple(cid:173)
`mented by appliance manufacturers to enable operational
`control of entertainment and other appliances, also as well
`known in the art. In particular, the recent proliferation of
`wireless and wired communication and/or digital intercon(cid:173)
`nection methods such as WiFi, Bluetooth, HDMI, etc.,
`amongst and between appliances has resulted in a corre(cid:173)
`sponding proliferation of such communication protocols and
`command formats. While many of these newer methods may
`offer improved performance and/or reliability when com(cid:173)
`pared to previous control protocols, appliance manufacturer
`adoption of such newer methods remains inconsistent and
`fragmented. This, together with the large installed base of
`prior generation appliances, may cause confusion, mis(cid:173)
`operation, or other problems when a user or manufacturer of
`a controlling device, such as a remote control, attempts to
`take advantage of the enhanced features and functionalities
`of these new control methods.
`
`SUMMARY OF THE INVENTION
`
`2
`formats in a reliable manner which is largely transparent to
`a user and/or seamlessly integrated with legacy appliance
`control technology.
`To this end, the instant invention comprises a modular
`hardware and software solution, hereafter referred to as a
`Universal Control Engine (UCE), which is adapted to pro(cid:173)
`vide device control across a variety of available control
`methodologies and communication media, such as for
`example various infrared (IR) remote control protocols;
`1° Consumer Electronic Control (CEC) as may be implemented
`over a wired HDMI connection; internet protocol (IP), wired
`or wireless; RF4CE wireless; Bluetooth (BT) wireless per(cid:173)
`sonal area network(s); UPnP protocol utilizing wired USB
`15 connections; or any other available standard or proprietary
`appliance command methodology. Since each individual
`control paradigm may have its own strengths and weak(cid:173)
`nesses, the UCE may be adapted to combine various control
`methods in order to realize the best control option for each
`20 individual command for each individual device.
`The UCE itself may be adapted to receive commands
`from a controlling device, for example a conventional
`remote control or a remote control app resident on a smart
`device such as a phone or tablet, etc., utilizing any conve-
`25 nient protocol and command structure (IR, RF4CE, BT,
`proprietary RF, etc.) As will become apparent, the control(cid:173)
`ling device may range from a very simple unidirectional IR
`device to a fully functional WiFi enabled smart phone or the
`like. The UCE may receive command requests from such a
`30 controlling device and apply the optimum methodology to
`propagate the command function( s) to each intended target
`appliance, such as for example a TV, AV receiver, DVD
`player, etc. In this manner the UCE may enable a single
`controlling device to command the operation of all appli-
`35 ances in a home theater system while coordinating available
`methods of controlling each particular appliance in order to
`select the best and most reliable method for issuing each
`command to each given device. By way of example without
`limitation, a UCE may utilize IR commands to power on an
`40 AV receiver appliance while CEC commands or another
`method may be used to select inputs or power down the
`same AV receiver appliance; or CEC commands may be
`used to power on and select inputs on a TV appliance while
`IR commands may be used to control the volume on the
`45 same TV appliance.
`As will become apparent, a UCE may comprise modular
`hardware and software which may be embodied in a stand(cid:173)
`alone device suitable for use in an existing home theater
`equipment configuration, or may be incorporated into any
`50 one of the appliances such as a STB, TV, AV receiver, HDMI
`switch etc. Further, when incorporated into an appliance,
`UCE functionality may be provisioned as a separate hard(cid:173)
`ware module or may be incorporated together with other
`hardware functionality, e.g., as part of an HDMI interface IC
`55 or chip set, etc.
`A better understanding of the objects, advantages, fea(cid:173)
`tures, properties and relationships of the invention will be
`obtained from the following detailed description and accom(cid:173)
`panying drawings which set forth illustrative embodiments
`60 and which are indicative of the various ways in which the
`principles of the invention may be employed.
`
`This invention relates generally to enhanced methods for
`appliance control via use of a controlling device, such as a
`remote control, smart phone, tablet computer, etc., and in 65
`particular to methods for taking advantage of improved
`appliance control communication methods and/or command
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`For a better understanding of the various aspects of the
`invention, reference may be had to preferred embodiments
`shown in the attached drawings in which:
`
`

`

`US 9,716,853 B2
`
`3
`FIGS. 1 and 2 illustrate exemplary systems in which a
`standalone UEC device may be utilized to command opera(cid:173)
`tion of several appliances;
`FIGS. 3 and 4 illustrate exemplary systems in which UEC
`functionality may be incorporated into an appliance which is
`part of a home entertainment system;
`FIG. 5 illustrates a block diagram of an exemplary UEC
`device;
`FIG. 6 illustrates a graphical representation of an exem(cid:173)
`plary UCE-based control environment;
`FIG. 7 illustrates an exemplary preferred command
`matrix for use in a UCE-based control environment, for
`example as illustrated in FIG. 6;
`FIG. 8 illustrates a block diagram of an exemplary smart
`device which may support a remote control app and a setup 15
`method for use in configuring a UCE;
`FIG. 9 illustrates an exemplary series of steps which may
`be performed in order to set up and configure an exemplary
`UCE;
`FIG. 10 illustrates an exemplary series of steps which may 20
`be performed in order to define to a UCE an appliance
`configuration which corresponds to a user activity;
`FIG. 11 illustrates exemplary activity configuration matri(cid:173)
`ces such as may be defined during the steps of FIG. 10;
`FIG. 12 illustrates an exemplary current appliance state 25
`matrix which may be maintained by a UCE for use in
`determining the commands necessary to invoke one of the
`states defined by the matrix of FIG. 11;
`FIG. 13 illustrates an exemplary series of steps which may
`be performed by a UCE in issuing a function command to an 30
`appliance; and
`FIG. 14 illustrates an exemplary series of steps which may
`be performed by a UCE in establishing appliance states
`matching a desired activity defined in one of the matrices of
`FIG. 11.
`
`4
`transmit all commands destined for AV receiver 120 exclu(cid:173)
`sively as IR signals, while commands destined for the other
`appliances 106 through 110 may take the form of either CEC
`or IR signals as appropriate for each command. By way of
`example without limitation, certain TV manufacturers may
`elect not to support volume adjustment via CEC. If the
`illustrative TV 106 is of such manufacture, UCE 100 may
`relay volume adjustment requests to TV 106 as IR signals
`114, while other requests such as power on/off or input
`10 selections may be relayed in the form of CEC commands
`over HDMI connection 112.
`It will however be appreciated that while illustrated in the
`context of IR, RF, and wired CEC signal transmissions, in
`general, transmissions to and from UCE device 100 may
`take the form of any convenient IR, RF, hardwired, point(cid:173)
`to-point, or networked protocol, as necessary for a particular
`embodiment. Further, while wireless communications 116,
`118, etc., between exemplary devices are illustrated herein
`as direct links, it should be appreciated that in some
`instances such communication may take place via a local
`area network or personal area network, and as such may
`involve various intermediary devices such as routers,
`bridges, access points, etc. Since these items are not neces(cid:173)
`sary for an understanding of the instant invention, they are
`omitted from this and subsequent Figures for the sake of
`clarity.
`Since smart device remote control apps such as that
`contemplated in the illustrative device 104 are well known,
`for the sake of brevity the operation, features, and functions
`thereof will not be described in detail herein. Nevertheless,
`if a more complete understanding of the nature of such apps
`is desired, the interested reader may turn to, for example, the
`before mentioned U.S. patent application Ser. No. 12/406,
`601 or U.S. patent application Ser. No. 13/329,940, entitled
`35 "Graphical User Interface and Data Transfer Methods in a
`Controlling Device," both of common ownership and incor(cid:173)
`porated herein by reference in their entirety.
`Turning now to FIG. 2, in a further illustrative embodi(cid:173)
`With reference to FIG. 1, there is illustrated an exemplary
`ment, UCE 100 may receive wireless request signals from a
`40 remote control 200 and/or an app resident on a tablet
`system in which a UCE device 100 may be used to issue
`computer 202. As before, command transmissions to appli(cid:173)
`commands to control various controllable appliances, such
`ances 106,108,110 may take the form of wired CEC com(cid:173)
`as a television 106, a cable set top box combined with a
`mands or wireless IR commands. However, in this example
`digital video recorder ("STB/DVR") 110, a DVD player
`remote control 200 may be in bi-directional communication
`108, and anAVreceiver 120. While illustrated in the context
`of a television 106, STB/DVR 110, a DVD player 108, and 45 208 with UCE 100 and accordingly the UCE may delegate
`an AV receiver 120, it is to be understood that controllable
`the transmission ofiR commands 210 to the remote control
`device 200, i.e., use remote control 200 as a relay device for
`appliances may include, but need not be limited to, televi(cid:173)
`sions, VCRs, DVRs, DVD players, cable or satellite con(cid:173)
`those commands determined to be best executed via IR
`transmissions. As also generally illustrated in FIG. 2, a setup
`verter set-top boxes ("STBs"), amplifiers, CD players, game
`consoles, home lighting, drapery, fans, HVAC systems, 50
`app 214 executing on a smart device such as tablet computer
`thermostats, personal computers, etc. In the illustrative
`202 may be utilized in conjunction with an Internet (212,
`example of FIG. 1, appliance commands may be issued by
`204) accessible server 206 and associated database 207 to
`initially configure UCE 100 for operation with the specific
`UCE 100 in response to infrared ("IR") request signals 116
`group of appliances to be controlled, i.e., to communicate to
`received from a remote control device 102, radio frequency
`("RF") request signals 118 received from an app 124 resi- 55
`UCE 100 a matching command code set and capability
`dent on a smart device 104, or any other device from which
`profile for each particular appliance to be controlled, for
`UCE 100 may be adapted to receive requests, using any
`example based on type, manufacture, model number, etc., as
`will be described in greater detail hereafter.
`appropriate communication method. As illustrated, trans(cid:173)
`With reference to FIG. 3, in a yet further illustrative
`mission of the requested appliance commands from the UCE
`to appliances 106,108,112,120 may take the form of wireless 60
`embodiment UCE functionality 1 00' may be embedded in an
`IR signals 114 or CEC commands issued over a wired HDMI
`appliance, for example STB/DVR 310. In this example,
`interface 112, as appropriate to the capabilities of the par(cid:173)
`remote control 102 and/or smart device 104 may transmit
`ticular appliance to which each command may be directed.
`wireless request signals directly to STB/DVR 310 for action
`by the built-in UCE function 100', which actions may, as
`In particular, in the exemplary system illustrated, AV
`receiver 120 may not support HDMI inputs, being connected 65
`before, comprise CEC command transmissions via HDMI
`to audio source appliances 108,110 via, for example S/PDIF
`connection 112 or IR command transmissions 114, originat(cid:173)
`interfaces 122. Accordingly UCE 100 may be constrained to
`ing in this instance from an IR blaster provisioned to the
`
`DETAILED DESCRIPTION
`
`

`

`US 9,716,853 B2
`
`5
`STB/DVR appliance 310. In this configuration, a set up
`application resident in STB/DVR 310 may be utilized to
`configure UEC 100', using for example an Internet connec(cid:173)
`tion 304 accessible through a cable modem and/or cable
`distribution system headend.
`In the further illustrative embodiment of FIG. 4, UCE
`functionality 100' may be embedded in an AV receiver 420
`which may serve as an HDMI switch between various
`content sources such as a STB/DVR 110 or a DVD player
`108 and a rendering device such as TV 106. In addition to 10
`HDMI inputs, AV receiver 420 may also support various
`other input formats, for example analog inputs such as the
`illustrative 404 from CD player 408; composite or compo(cid:173)
`nent video; S/PDIF coaxial or fiberoptic; etc. In this embodi- 15
`ment, request signals 406 may be directed to AV receiver
`420, for example from remote control 402, for action by
`UCE function 100'. As before, resulting appliance com(cid:173)
`mands may be transmitted using CEC signals transmitted
`over HDMI connections 112, or via IR signals 114 trans- 20
`mitted from an associated IR blaster. As appropriate for a
`particular embodiment, initial configuration ofUCE 100' to
`match the equipment to be controlled may be performed by
`an Internet-connected app resident in AV receiver 420, or by
`an app resident in tablet computer 202 or other smart device, 25
`as mentioned previously in conjunction with FIG. 2.
`As will be appreciated, various other configurations are
`also possible without departing from the underlying UCE
`concept, for example UCE function 100' may be incorpo(cid:173)
`rated into an Internet-capable TV, an HDMI switch, a game 30
`console, etc.; appliance command set and capability data(cid:173)
`base 207 may be located at a cable system headend, may be
`stored locally (in all or in part), which local storage may take
`the form of internal memory within the UCE itself or in an 35
`appliance such as a TV, STB or AV receiver, or may take the
`form of a memory stick or the like attachable to a smart
`device or appliance; etc.
`With reference to FIG. 5, an exemplary UCE device 100
`(whether stand alone or an appliance supporting UCE func- 40
`tionality) may include, as needed for a particular application,
`a processor 500 coupled to a memory 502 which memory
`may comprise a combination of ROM memory, RAM
`memory, and/or non-volatile read/write memory and may
`take the form of a chip, a hard disk, a magnetic disk, an 45
`optical disk, a memory stick, etc., or any combination
`thereof. It will also be appreciated that some or all of the
`illustrated memory may be physically incorporated within
`the same IC chip as the processor 500 (a so called "micro(cid:173)
`controller") and, as such, it is shown separately in FIG. 5 50
`only for the sake of clarity. Interface hardware provisioned
`as part of the exemplary UCE platform may include IR
`receiver circuitry 504 and IR transmitter circuitry 506; an
`HDMI interface 508; a WiFi transceiver and interface 510;
`an Ethernet interface 512; and any other wired or wireless 55
`I/0 interface(s) 514 as appropriate for a particular embodi(cid:173)
`ment, by way of example without limitation Bluetooth,
`RF4CE, USB, Zigbee, Zensys, XlO/Insteon, HomePlug,
`HomePNA, etc. The electronic components comprising the
`exemplary UCE device 100 may be powered by an external 60
`power source 516. In the case of a standalone UCE device
`such as illustrated in FIG. 1 or 2, this may comprise for
`example a compactAC adapter "wall wart," while integrated
`UCE devices such as illustrated in FIG. 3 or 4 may draw
`operating power from the appliance into which they are 65
`integrated. It will also be appreciated that in the latter case,
`in certain embodiments processor 500 and/or memory 502
`
`6
`and/or certain portions of interface hardware items 504
`through 514 may be shared with other functionalities of the
`host appliance.
`As will be understood by those skilled in the art, some or
`all of the memory 502 may include executable instructions
`that are intended to be executed by the processor 500 to
`control the operation of the UCE device 100 (collectively,
`the UCE progrming) as well as data which serves to
`define the necessary control protocols and command values
`for use in transmitting command signals to controllable
`appliances (collectively, the command data). In this manner,
`the processor 500 may be programmed to control the various
`electronic components within the exemplary UCE device
`100, e.g., to monitor the communication means 504,510 for
`incoming request messages from controlling devices, to
`cause the transmission of appliance command signals, etc.
`To cause the UCE device 100 to perform an action, the UCE
`device 100 may be adapted to be responsive to events, such
`as a received request message from remote control 102 or
`smart device 104, changes in connected appliance status
`reported over HDMI interface 508, WiFi interface 510, or
`Ethernet interface 512, etc. In response to an event, appro(cid:173)
`priate instructions within the UCE programming may be
`executed. For example, when a command request is received
`from a smart phone 104, the UCE device 100 may retrieve
`from the command data stored in memory 502 a preferred
`command transmission medium (e.g., IR, CEC over HDMI,
`IP over WiFi, etc.) and a corresponding command value and
`control protocol to be used in transmitting that command to
`an intended target appliance, e.g., TV 106, in a format
`recognizable by that appliance to thereby control one or
`more functional operations of that appliance. By way of
`further example, the status of connected appliances, e.g.,
`powered or not powered, currently selected input, playing or
`paused, etc., as may be discerned from interfaces 508
`through 514, may be monitored and/or tabulated by the UCE
`programming in order to facilitate adjustment of appliance
`settings to match user-defined activity profiles, e.g. "Watch
`TV", "View a movie", etc.
`An overview of an exemplary UCE control environment
`is presented in FIG. 6. The UCE programming of an
`exemplary UCE device 100 may comprise a universal
`control engine core 650 together with a series of scalable
`software modules 652 through 660, each module supporting
`a