(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2009/0254500 A1
`Stecyk
`(43) Pub. Date:
`Oct. 8, 2009
`
`US 20090254500A1
`
`(54) CONTROL SYSTEM FOR NETWORKOF
`INPUT DEVICES WITH AUTOMATIC
`AUDIO/VIDEO RECEIVER DETECTION AND
`CONTROL CONFIGURATION
`
`(76)
`
`Inventor:
`
`Polly Stecyk, Fountain Valley, CA
`(US)
`Correspondence Address:
`ORRICK, HERRINGTON & SUTCLIFFE, LLP
`IP PROSECUTION DEPARTMENT
`4 PARK PLAZA, SUTE 1600
`IRVINE, CA 92614-2558 (US)
`
`(21)
`
`Appl. No.:
`
`12/099,387
`
`(22)
`
`Filed:
`
`Apr. 8, 2008
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`G06F 5/18
`(52) U.S. Cl. .......................................................... 706/12
`(57)
`ABSTRACT
`Apparatus, methods, and systems for centrally and uniformly
`controlling the operation of a variety of devices, such as
`communication, consumer electronic, audio-video, analog,
`digital, 1394, and the like, over a variety of protocols within
`a network system and, more particularly, a control system and
`uniform user interface for centrally controlling these devices
`in a manner that appears seamless and transparent to the user.
`In a one embodiment, the control system will detect the
`change of state of an audio output sensor coupled to the audio
`output port.
`
`18. - Cable
`
`— 38
`
`
`
`20s.
`
`22
`
`PC
`
`AV Device (
`32 - (DBS)
`
`31
`
`Afw Device - - -
`(VCR)
`
`33
`
`
`
`30
`
`43
`
`44
`
`D-AW
`Dewice
`(D-AWDisc)
`
`s
`8
`
`49
`*
`
`D-AW
`Dewice
`(D-Cabled
`Sat)
`46
`40
`
`AJW Dewice &
`(DVD)
`
`- 38 -
`
`31
`
`— 38
`
`-r 4
`Y.
`^ g- --
`D-AFW Dewice
`(D-WCR)
`
`49
`
`D-AFW
`Device
`(D-DVD)
`
`IRC
`AFW Dewice
`
`IRC —
`Afw Device
`s
`AWREC
`(AWR)
`
`35
`
`31
`
`37
`
`f
`47
`
`1394 evice
`
`49
`
`/
`
`48 - 1394 Device
`
`
`
`45-r
`
`D-AW
`Device
`(D-AWR)
`
`Roku EX1006
`U.S. Patent No. 9,716,853
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 1 of 20
`
`US 2009/0254500 A1
`
`
`
`— 38
`
`
`
`20
`
`- 16
`
`11
`
`13
`
`22
`
`PC
`
`AFW Device
`(DBS)
`AFW Device
`(VCR)
`
`32 --
`
`---
`
`33
`
`38
`
`-
`-
`-
`
`W
`
`DTW
`
`AV Device -
`(DVD)
`Y
`
`M
`
`-
`
`34
`-
`
`30
`
`«
`
`Main
`
`- 14
`
`sub
`
`------ 15
`—& Audio
`
`- - - - -
`
`- -
`
`: -
`Device
`(Cam)
`43
`
`---
`
`42
`
`44
`
`DAV Device
`(D-VCR)
`
`49
`
`(D-DVD)
`
`8.
`
`(D-Av Disc)
`
`31
`
`(AWR)
`
`37
`
`-
`
`A.
`47
`
`-----
`
`394 Device
`*-
`
`-----.
`
`49
`/
`
`;
`
`/
`
`FIG. 1
`
`48 - 1394 Device
`-
`
`
`
`-
`
`Dav
`Device
`(D-AVR)
`
`49
`^
`/
`
`45 ---
`
`D-AW
`S Devi
`(CE,
`Saty
`
`46
`40
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 2 of 20
`
`US 2009/0254500 A1
`
`10
`
`12
`
`1.1
`
`:
`
`KS
`&
`con:
`
`30
`
`32
`
`DBS TUNER
`
`k:
`
`x
`
`33
`
`
`
`34
`
`DVD PLAYER
`
`
`
`
`
`DEWICE
`
`AWDEVICE
`
`TUNER 61
`
`Aitenia
`
`6
`2
`
`WCR
`
`WD
`63 PLAYER 64
`
`IRC
`AV Receiver
`
`ICCM
`8ITAL
`DVD 68 AWDISC 69
`
`IRC AW
`O-WHS
`Digital
`EC 65 VCR 66-AE 67
`Receiver
`
`37
`
`17
`
`FIG. 2A
`
`( 40
`
`41
`
`D-VHS WCR
`
`4 s
`
`D-CABLE OR
`SATELITE
`RECEIVER
`4. 3
`
`D-DVD
`PLAYER
`
`45
`D- AIW REC
`
`44
`
`D-AWDISC
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 3 of 20
`
`US 2009/0254500 A1
`
`30 y
`
`32
`
`-
`- A
`DBS TUNER
`
`- S -
`
`VCR
`34 N
`
`DVD PLAYER
`
`IRC
`AWDEVICE
`
`IRC
`AV Receiver
`- S -
`Antenna
`
`
`
`-
`
`
`
`
`
`
`
`
`
`
`
`-
`
`D-CABLE OR
`SATELITE
`RECEIVER
`
`ICOM
`
`Receiver
`
`|COM
`
`ICOM
`
`ICON
`
`CON
`
`XICONK:
`:
`x
`X
`K:
`D-VHS
`DWC)
`IRCAW
`digital CABL
`Antenna 62 voR 63 player 4 Device 65 WCR 66 or Satelite
`
`DEWICE
`
`TUNER 61
`ICON
`
`DIGITAL
`DIGITAL
`DVD 68 Av DISC 69
`
`
`
`FIG 2B
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 4 of 20
`
`US 2009/0254500 A1
`
`
`
`WC
`
`CON
`2 vor
`
`ICCN
`Antenna
`icon
`DIGITAL
`68 AWDISC 89
`
`DBS
`TUNER 61
`ces
`O3ITAL
`y
`
`30
`
`32 y
`
`DBS TUNER
`
`33
`
`WCR
`
`34
`
`DVD PLAYER
`
`35
`IRC
`AWDEVICE
`
`IRC
`AV Receiver
`
`37
`
`Antenna
`
`17
`
`?" 41
`
`82
`
`84
`
`86
`
`D-VHS WCR
`
`52
`
`/1 60
`
`CKN
`63 PLAYER
`
`OWD
`
`CON
`
`: CON :
`CON
`X
`K3
`Digital CAEL
`O-WHS
`Ig
`RCAW
`86 Satelite 67
`Receiver
`64 Device 65 WCR
`
`46
`D-CABE OR
`SATELITE
`RECEIVER
`43
`
`D- DVD
`PLAYER
`45
`D- AW REC
`
`44
`
`D-AWDISC
`
`FIG. 2C
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 5 of 20
`
`US 2009/0254500 A1
`
`30 y
`
`32
`
`DBS TUNER
`
`33
`
`WCR
`
`34
`
`DVD PLAYER
`
`35
`
`IRC
`AWDEVICE
`
`IRC
`AW Receiver
`37
`Antenna
`
`17
`
`KK
`
`D
`
`DD
`
`PLAY FORWARD STOP
`REWIND
`Transport Menu
`
`II
`
`PAUSE
`
`R
`
`46
`
`
`
`D-CABLE OR
`SATELITE
`RECEIVER
`43
`
`D-DVD
`PLAYER
`
`45
`
`o vec 44
`
`D-AWREC
`
`D-AWDSC
`
`FIG. 2D
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 6 of 20
`
`US 2009/0254500 A1
`
`
`
`PPWIDEO
`
`ICCN
`
`PPDEVICE
`is 1 Allen
`
`2 v
`
`it
`tria,
`DVD 68 AV DISC
`
`30
`32 y
`
`DBS TUNER
`
`33
`
`WCR
`
`34
`
`DVD PLAYER
`
`3
`5
`
`N
`AWDEVICE
`
`IRC
`AV Receiver
`N- 37
`
`Antenna
`
`17
`
`40
`?
`41
`
`D-VHS WCR
`
`46
`
`D-CABLE OR
`SATELITE
`RECEIVER
`
`43
`
`PLAYER
`
`45
`
`D-AWREC
`
`44
`
`D-AWDSC
`
`a-s
`
`3 p.2Era E. 5 RF 67 egeye
`
`55
`
`FIG. 2E
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 7 of 20
`
`US 2009/0254500 A1
`
`
`
`- 1011
`
`&
`
`FIG. 2F
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 8 of 20
`
`US 2009/0254500 A1
`
`
`
`Control (Digital Module) Circuit Board
`
`TV Micro
`
`134
`
`RBlaster
`Controller
`
`IRBlaster
`
`FIG. 3A
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 9 of 20
`
`US 2009/0254500 A1
`
`
`
`1.
`EWSG
`
`s
`
`etector B
`
`Remote
`20
`
`Control (Digital Module) Circuit Board
`
`TV Micro
`
`134
`
`RBlaster
`Controller
`
`RRepeater
`
`FIG. 3B
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 10 of 20
`
`US 2009/0254500 A1
`
`
`
`---
`R
`EWSG
`Remote
`20 -
`
`Detector
`
`HTNS Controller
`
`452
`
`Control (Digital Module) Circuit Board
`
`RBlaster
`Controller
`
`134
`
`R Blaste,
`
`FIG. 3C
`
`IR Repeater
`412
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 11 of 20
`
`US 2009/0254500 A1
`
`
`
`454
`HTNS COntroller
`
`Control (Digital Module) Circuit Board
`
`TV Micro
`
`RBlaster
`Controller
`
`134
`
`RBlaster
`135
`
`Screen S
`
`FIG. 3D
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 12 of 20
`
`US 2009/0254500 A1
`
`
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 13 of 20
`
`US 2009/0254500 A1
`
`(In9)
`
`| ||
`
`0 || ||
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 14 of 20
`
`US 2009/0254500 A1
`
`)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 15 of 20
`
`US 2009/0254500 A1
`
`
`
`(In?)
`
`(Jaun_L
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 16 of 20
`
`US 2009/0254500 A1
`
`Device Type
`
`200
`
`Select the manufacturer and model of the < device type). If the
`manufacturer or model is not listed, select Other. If you do not
`have a <device types, select None for the manufacturer.
`
`&Manufacture's Name>
`
`
`
`<Model No.
`
`Manufacturer
`
`<Back
`
`Nexts
`
`2O2
`
`204
`
`cance
`
`F G 7A
`
`200'
`Device Type
`Select the manufacturer < device types. If the manufacturer is not
`listed, select Other. If you do not have a <device types, select
`None for the manufacturer.
`
`2O6
`
`<Manufacture's Name>
`
`Manufacturer
`
`System settings optimized for model <mfg model
`no.Y., other models may still be compatible.
`
`<Back
`
`Next
`
`Cancel
`
`Review
`Please review all the devices to ensure proper connections. Inputs
`without devices have been turned off. To turn an input on, press
`ENTER. To make changes, select Back. Select Next to finish. - 224
`NAME
`TV input
`AVR input
`1394 Mare
`X Ant A \ ANT-A Y Tw
`WCR
`X
`Cable 222 ANT-B 223 TW
`X AWDISK
`
`&Back
`
`220
`
`225
`
`Next
`
`Cancel
`
`X Ant-DTW
`X WCR
`x
`3S
`x VCR2
`Input-4
`X Camcord
`X
`w.
`Comp-2
`INP-DTV
`X PC
`
`ANT-DTW
`INPUT-1
`INPUT-2
`NPUT-3
`NPUT-4
`INPUT-5
`COMP-1
`COMP-2
`NP-DTW
`WGA
`
`Ty
`WCR1
`AUX
`WCR2
`
`DVD
`
`FIG. 7C
`
`Finish
`You have completed system setup. To change the inputs or
`device names select Edit. To make changes in the future, go to
`Setup in the TW menu, and select Edit.
`If there are no changes now, select Finish. To finish setup of the
`TWyou may need to go to the TW menu to set the clock or
`memorize channels for the Antennas.
`
`226
`
`Edit
`
`Finish
`
`FIG. 7B
`
`FIG. 7D
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 17 of 20
`
`US 2009/0254500 A1
`
`Select the edit you would like to do to setup.
`
`To add a device to an unused input.
`O Add
`O Change To change the name or connection
`of a device already connected.
`O Delete
`To delete a device or completely
`delete setup.
`O
`To review all the devices Or turn an
`Review
`input off or on
`To restart initial setup
`
`O Initial
`
`Next>
`
`Cancel
`
`FIG. 8A
`
`230
`
`Connection for <Device Type-
`Select the inputs on the TV and AV Receiver connected to the
`< device type>. Check the audio and video Connections to the TV
`and AVR. Connecting only audio to the AVR is recommended.
`The AVR may need Configuring with digital audio.
`24
`234 -
`3"-240
`X
`/1
`va
`sBack
`<nput> Yeo
`<Input>
`X
`232 TV input I Audio
`AVR input Audio
`
`Next
`
`236
`
`242
`
`Cancel
`
`FIG. 8B
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 18 of 20
`
`US 2009/0254500 A1
`
`
`
`
`
`Se
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 19 of 20
`
`US 2009/0254500 A1
`
`AW Receiver
`Select the manufacturer AWReceiver. If the manufacturer is not 400
`listed, select Other, then select Learn to setup control. If you do
`not have a AW Receiver, select Mone for the manufacturer.
`404 - 406
`
`<Manufacture's Name>
`
`Learn
`
`&Back
`
`Manufacturer
`System settings optimized for model <mfg model
`no.>, other models may still be compatible.
`
`Next
`
`Cancel
`
`FIG. 10A
`
`AV Receiver inputs
`Select the number of inputs for the AV Receiver.
`
`401
`
`-4.08
`
`it.
`
`Inputs
`
`kBack
`
`Next)
`
`Cance
`
`412
`
`416
`
`AV Receiver Input Learn
`To Learn input if key for the AV Receiver use ADJUST to select
`Inputi, press Enter. Press the Input-it key on the AV Receiver
`remote until a check appears,
`- 410
`Input 1
`Input 1
`
`| input 3
`Input 3
`
`| input 2
`Input 2
`
`402
`
`<Back
`
`Next>
`
`| input 6
`| input 5
`| input 4
`Input 6
`Input 5
`Input 4
`Use Adjust Up! Down to change input names.
`
`Cancel
`
`FIG. 10C
`
`403
`
`AW Receiver Learn
`To Learn <function> key for the AV Receiver use ADJUST to
`select <function>, press Enter. Press the <function> key on the
`AV Receiver remote until a check appears.
`N - 414
`o Analog to Digital
`Power (on)
`Power (off)
`oDigital to Analog
`Volume (up)
`Volume (on)
`Mute
`
`<Back
`
`Next
`
`Cancel
`
`FIG. 1 OB
`
`FIG. 1 OD
`
`

`

`Patent Application Publication
`
`Oct. 8, 2009 Sheet 20 of 20
`
`US 2009/0254500 A1
`
`ReCOrd/Connect
`
`250
`The current antenna or device is the recording source. To record now, select
`recording device and duration, then press REC. To record later, also select
`the Start Time and DAy, then select the Add button. For antennas, select the
`channel for recording. To see a list of future recording, select the List Button.
`To finish, select the Quit button. To connect the 1394 source on the TV to
`another 1394 device, select device and duration, then press CONNECT.
`252
`254
`256
`258
`260
`
`/
`
`VCR
`
`/
`
`2 HrS
`
`/
`
`12:00pm
`
`/ / <Back
`
`MOn
`
`OO3
`
`Device
`
`Duration
`
`Start Time Set Day
`
`Channel
`
`Next>
`
`CanCel
`
`FIG. 11
`
`

`

`US 2009/0254500 A1
`
`Oct. 8, 2009
`
`CONTROL SYSTEM FOR NETWORK OF
`INPUT DEVICES WITH AUTOMATIC
`AUDIO/VIDEO RECEIVER DETECTION AND
`CONTROL CONFIGURATION
`
`FIELD OF THE INVENTION
`0001. The invention relates to the field of consumer elec
`tronics systems and, more particularly, to apparatus, methods,
`and systems for centrally controlling the operation of devices
`within a network of consumer electronics systems and auto
`matically detecting and configuring the control of an audio
`video receiver coupled to the network.
`
`BACKGROUND OF THE INVENTION
`0002 The United States and other countries are quickly
`transitioning to digital television (DTV) to take advantage of
`high definitionTV broadcasts. The US, in particular, is slowly
`moving away from and will ultimately abandon the analog
`television system. The use of an analog TV will eventually
`require the addition of set-top-box down-converters to
`change the digital broadcasts to the lower-performance ana
`log format such TVs were designed to receive.
`0003 Digital systems and related standards, e.g., IEEE
`1394, provide no way to control conventionally wired, IR
`signal controlled, analog audio-video (AV) devices (IRC
`devices), such as analog VCRs, DVD players, cable and sat
`ellite boxes, and AV receivers, and does nothing to eliminate
`the myriad of cables, connectors and remotes necessary to
`connect and control a mixed analog and digital home theater
`network system. The interconnection and control of Such
`systems can be quite complex and unwieldy. For example,
`simply Switching from a cable broadcast to playing a movie
`on a DVD player may involve numerous device specific
`remote controls and several iterations through the different
`layers of control on Such remotes. Such a task may require the
`user to switch between video inputs on the TV, switch
`between layers on a universal TV remote control to power on
`and play the DVD player, and then, if the user has an AV
`receiver (AVR), switch between layers on the TV remote and
`shut down the audio output from the TV and switch to an AVR
`remote control to power up and outputaudio through the AVR
`or, if the AVR is the current audio output device, use the AVR
`remote control to switch between AVR inputs to output the
`DVD player's audio from the AVR. Completing such tasks is
`often fraught with frustration especially when the user is not
`immediately Successful in being able to watch and listen to a
`movie being played on the DVD player.
`0004. The detection of an AVR coupled to the network and
`the initial set-up or programming of a device specific layer on
`a universal TV remote is also often fraught with frustration
`especially when the user is not immediately successful in
`being able to control the device.
`0005 Thus, it is desirous to be able to centrally and seam
`lessly control a variety of electronic devices over a variety of
`protocols from a single input device, provide an easy to use
`user interface (UI) wherein the complexities of the control of
`Such devices is transparent to the user, and automatically
`detect and configure system control of an AVR coupled to the
`network.
`
`SUMMARY OF THE INVENTION
`0006. The embodiments described herein are directed to
`novel apparatus, methods, and systems for centrally and uni
`
`formly controlling the operation of a variety of devices over a
`variety of protocols within a network system and, more par
`ticularly, a control system and uniform user interface for
`automatic device control configuring and centrally control
`ling these devices in a manner that appears seamless and
`transparent to the user. For example, in an entertainment
`system or a home theater network system (HTNS) compris
`ing a mix of analog IR controlled (IRC) and digital 1394
`audio-video (AV) devices, control and operation of the IRC
`and 1394 versions of an AV device appears the same to the
`user and the control of IRC devices can be automatically
`configured upon detection of their connection to the system.
`0007. In one embodiment, a primary display and control
`unit (PDCU), e.g., a television, of the HTNS will automati
`cally presume the existence of an AVR coupled to an audio
`output port of the PDCU, and then automatically configure
`the control system to control the AVR. In the alternative, the
`PDCU will automatically sense or detect the existence of of
`an AVR coupled to an audio output port of the PDCU, and
`then automatically configure the control system to control the
`AVR. The PDCU preferably incorporates a switch, mechani
`cal or the like, at the audio output port that changes states
`when an AV cable is coupled to the audio output port. The
`change in state of the switch is detected by the TV control
`module.
`0008. The user is prompted to identify the AVR device in
`the control system from a list of known devices. If the AVR is
`not included in the list, the control system is configured to
`learn input and function key control signal codes.
`0009. In another embodiment, a HTNS comprises a
`PDCU and a mix of IRC and 1394 AV devices and other
`inputs. The PDCU may comprise an AV system such as a
`television and, preferably, a digital television (DTV), having
`appropriate circuitry and programmable logic for operation
`of a preferred control system. Alternatively, the PDCU may
`comprise a primary display unit such as a TV or a “dumb”
`monitor or display, and a dedicated controller or computer
`housed in a separate chassis from the primary display unit and
`comprising appropriate programmable logic for operation of
`a control system. Preferably, the PDCU includes several I/O
`ports to which external or peripheral devices, such as the IRC
`and 1394 AV devices, may be coupled.
`0010. In another embodiment, the PDCU includes a con
`text sensitive control system that enables centralized and
`seamless integrated control of both 1394 and IRC-type
`devices, as well as internal TV-type inputs and other input
`devices and system hardware interconnected to the PDCU. As
`such, the PDCU is the command center or hub of the HTNS or
`other network systems that may comprise, in addition to
`entertainment AV type devices, home appliances and home
`lighting, heating, air conditioning, security-type systems, and
`the like. The control system preferably includes a control
`module that is capable of interpreting an input command Such
`as an event signal from a system remote, determining what
`action needs to take place, for example, navigate through
`menus on the screen of the PDCU or operate an attached AV
`device, determining what devices to connect and how to con
`nect them, and then preparing and sending device appropriate
`messages or commands to the input devices. Preferably, for
`supported IRC devices, the control module includes a library
`of IR codes and is capable of translating an input command,
`Such as a digital input command, into a message comprising
`IR codes from the IR code library appropriate for the device,
`and then blasting the command message to the IRC device to
`
`

`

`US 2009/0254500 A1
`
`Oct. 8, 2009
`
`drive the IRC device. As noted above, the control system can
`also preferably learn the IR codes of a variety of IRC devices.
`All Such operations, however, are advantageously transparent
`to the consumer or user.
`0011. In another embodiment, the control system includes
`a versatile icon based graphical user interface (UI) to provide
`a uniform, on-screen centralized control system for the net
`work system. The UI enables the user to transparently control
`multiple input devices such as internal TV-type devices, AV
`devices, and other input devices over different protocols
`while operating on a single layer of a system remote control,
`e.g., the TV layer of a universal TV remote. For example,
`operation of an IRC DVD player and a 1394 DVD player
`appears identical to the user. The UI also advantageously
`provides on-screen, real time visual recognition of the state of
`the system, device availability, operation or connection
`options, active connections, navigation, and the like.
`0012. In operation, the user selects the “device' button on
`the remote, which causes the control system to display a
`device selection menu on the screen of the PDCU. The device
`selection menu preferably comprises a device window, a
`Video window, an audio window, and, when a recording or
`other peer-to-peer connection is active, a connection window.
`The user next navigates through the device selection window
`and highlights a device icon, Such as a VCR icon, to play a
`movie on the VCR. The user may move or jump to an audio
`selection window and highlight an AV receiver (AVR) icon
`for audio output from an AVR. Selection of the VCR and AVR
`from the device selection menu by pressing the “enter” or
`Some other appropriate key on the system remote control
`while the corresponding icons are highlighted (selected),
`causes the control system to performall necessary Switching,
`make all necessary connections and display a transport menu
`on the screen of the PDCU. The transport menu is a device
`control menu preferably comprising device appropriate con
`trol function buttons such as “play”, “FF", “RW, and the
`like. Alternatively, device specific control menus, i.e., device
`Supplied, may be displayable and operable through the con
`trol system. Lastly, the user selects the play button in the
`transport menu by pressing the “enter” or “play' buttons on
`the system remote control to play the movie. The steps taken
`by a user would be the same whether the device is an IRC or
`a 1394 device. As noted above, the control system interprets
`and acts on the user's selections, performing all necessary
`Switching and making all necessary connections, in a manner
`that is transparent to the user.
`0013. A further embodiment includes a control system
`with connection permutation sensitivity. In particular, once a
`device such as the VCR is selected, the control system will
`automatically control it and the rest of HTNS based on stored
`device and device connection configuration data. For
`instance, if the VCR is connected to both an AVR and the
`PDCU, wherein the audio from VCR is to be outputted by the
`AVR while the video is outputted by the PDCU, upon selec
`tion of the VCR and AVR, the control system will automati
`cally turn off the audio output from the PDCU and turn on the
`AVR to output the audio from the VCR when the VCR or
`switch inputs within the AVR if it is the current audio output
`or sink device. Thus, the control system handles all of the
`necessary Switching transparently to the user. This situation
`dependent, context sensitive method tends to be Superior to
`the "macro’ command capability of Some remotes because
`the control sequences of the control system are not dependent
`on the network devices being in a particular state at the
`
`beginning of the sequence. Further, this aspect of the control
`system enables seamless peer-to-peer communication and
`operation Such as recording between devices even when the
`PDCU is not physically involved in the connection.
`0014. In yet another embodiment, the control system
`includes a configuration setup Subsystem with automatic IRC
`device control configuration. It provides users with the capa
`bility to setup the configuration or device interconnections of
`the network system in a first time out of the box initial setup
`mode or the capability to change/modify/delete existing con
`figurations in an edit mode. In the initial setup mode, the user
`is provided with a pre-set configuration of IRC device input
`connections on the PDCU and instructed to connect the IRC
`devices to the PDCU accordingly. The user then logs in each
`IRC device within the network system and the control system
`builds a device list and device connection database. If the
`network system includes IRC devices interconnected to the
`PDCU through other input connections, the user may enter
`the edit mode of the Subsystem to customize the input con
`nections of such devices as well as delete individual device or
`entire system configuration data. The navigation through the
`configuration setup Subsystem is text and screen driven. In an
`alternative, navigation through the configuration setup Sub
`system may be by Voice recognition or the configuration setup
`Subsystem may be graphically driven.
`0015. If the command codes are not known for a connected
`IRC device or AVR, the configuration setup subsystem can
`automatically learn the control commands of the IRC device
`or AVR. During setup, the setup subsystem will display a
`message prompting the user to select the LEARN function
`and then display a message prompting the user to select an
`input or a function key for which the user wishes to learn the
`command. Once an input or function key is selected, the user
`is prompted to hold down the corresponding input or function
`key on the AVR remote until a visual indicator is provided that
`indicates the command code has been learned by the control
`system. As the input or function key on the AVR remote is
`depressed, the command signal from the AVR remote is
`detected by the IR detector of the PDCU, decoded and stored
`in memory. Once an IR code is found that can controls the
`input or function key of the AVR, the subsystem will provide
`a visual indication the command code has been learned by the
`control system.
`0016 Other aspects and features of the present invention
`will become apparent from consideration of the following
`description taken in conjunction with the accompanying
`drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0017 FIG. 1 is a diagram showing an example of a device
`interconnect configuration for a home theater network sys
`tem.
`0018 FIG. 2A is a schematic showing an example of a
`home theater network system comprising a television having
`a variety of IRC and 1394 AV devices connected to the tele
`vision. A graphical user interface of the control system is
`shown on the display of the television providing visual rec
`ognition of the current system state, user navigation through
`device and audio menus, device connection options, and
`active device connections.
`0019 FIG. 2B is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control system shown on the display of the
`television provides visual recognition of current system state,
`
`

`

`US 2009/0254500 A1
`
`Oct. 8, 2009
`
`user navigation through device and audio menus, device con
`nection options, and active device connections.
`0020 FIG. 2C is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control system shown on the display of the
`television provides visual recognition of current system state,
`user navigation through device and audio menus, device con
`nection options, and active device connections.
`0021
`FIG. 2D is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control system shown on the display of the
`television provides a device appropriate control (transport)
`menu for operation of a selected device.
`0022 FIG. 2E is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control system shown on the display of the
`television provides PIP device connection options.
`0023 FIG. 2F is a graphical representation of a preferred
`embodiment of the graphical user interface of the control
`system.
`0024 FIG. 3A is a schematic of a remote control and a
`television.
`0.025
`FIG. 3B is a schematic of the remote control and an
`alternative embodiment of the television shown in FIG. 3a
`including IR pass-through circuitry.
`0026 FIG. 3C is a schematic of a remote control and a
`primary display and control unit comprising a television and
`a separate HTNS controller.
`0027 FIG. 3D is a schematic of a remote control and a
`primary display and control unit comprising a monitor or
`display and a separate HTNS controller.
`0028 FIG. 4 is a plan view of a remote control for the
`home theater network system.
`0029 FIG. 5A is a schematic of a control system for the
`home theater network system.
`0030 FIG. 5B is a schematic of an alternate embodiment
`of a control system for the home theater network system with
`a audio output sensor.
`0031
`FIG. 6 is a schematic of a user interface module of
`the control system.
`0032 FIG. 7A is a diagram showing a device entry menu
`for a setup configuration Subsystem.
`0033 FIG. 7B is a diagram showing a preferred embodi
`ment of the device entry menu.
`0034 FIG. 7C is a diagram showing a device connection
`review menu for the setup configuration Subsystem.
`0035 FIG. 7D is a diagram showing a finish menu for the
`setup configuration Subsystem.
`0036 FIG. 8A is a diagram showing an edit menu for the
`setup configuration Subsystem.
`0037 FIG. 8B is a diagram showing a device connection
`customization menu for the setup configuration Subsystem.
`0038 FIG. 9A is a diagram showing a process followed
`when an audio-video receiver (AVR) is coupled to the net
`work.
`0039 FIG.9B is a diagram showing a process followed to
`identify and configure the control of an IRC AVR.
`0040 FIG. 10A is a diagram showing a preferred embodi
`ment of the AVR entry menu for a setup configuration sub
`system.
`FIG. 10B is a diagram showing an AVR input selec
`0041
`tion menu for a setup configuration Subsystem.
`0042 FIG. 10C is a diagram showing an AVR input learn
`menu for a setup configuration Subsystem.
`
`0043 FIG. 10D is a diagram showing an AVR function
`learn menu for a setup configuration Subsystem.
`0044 FIG. 11 is a diagram showing a menu for initiating
`recording or peer-to-peer connections.
`
`DETAILED DESCRIPTION OF THE INVENTION
`0045 Referring in detail to the figures, novel apparatus,
`methods, and systems for centrally and uniformly controlling
`the operation of a variety of devices over a variety of protocols
`within a network system are described. In particular, a control
`system and user interface that provides uniform, seamless and
`transparent centralized control of a network of devices over a
`variety protocols are described. In one embodiment, a pri
`mary display and control unit (PDCU), e.g., a television, will
`automatically detect a audio-video receiver (AVR) couple to
`the network and learn the IR control commands of the AVR.
`More particularly, the PDCU preferably incorporates a
`Switch, mechanical or the like, at the audio output port that
`changes states when an AV cable is coupled to the audio
`output port. The change in state of the switch is detected by
`the TV control module. Once the existence of an AVR is
`detected, the user is prompted to identify the device in the
`control system from a list of known devices. If the AVR is not
`included in the list, the control system is configured to learn
`the AVR input and function key command signal codes.
`0046. It will be understood by those skilled in the art that
`numerous configurations of a network system are possible.
`For example, a network system may comprise a mix of com
`munication devices, consumer electronic systems, audio/
`Video (A/V) devices, high and low speed devices, analog and
`digital devices, globally and locally controlled devices, and
`AV and non-AV devices, and the like, and may comprise both
`analog IR controlled and digital 1394 AV and other input-type
`devices. For exemplary purposes only, the apparatus, Systems
`and methods will be described primarily in the context of a
`Home Theater Network System (HTNS).
`0047. In a preferred embodiment, a HTNS comprises a
`PDCU, which functions as the hub or command center of the
`HTNS, and a mix of IR controlled (analog) and 1394 (digital)
`AV devices, and other inputs. The AV devices and other inputs
`may be interconnected in a variety of ways to each other and
`to the PDCU. The PDCU preferably includes an integrated
`control system with a graphical user interface (UI) for making
`connections between components of the HTNS and control
`ling their operation. The control system provides the user
`with centralized control of all of the supported devices in the
`HTNS and, in an alternative embodiment, enables pass
`through control of non-Supported devices while avoiding sig
`nal jamming.
`0048 Preferably, the PDCU comprises an AV system such
`as a television and, more preferably, a digital television
`(DTV), comprising appropriate circuitry and programmable
`logic for operation of a control system. Alternatively, the
`PDCU may comprise a primary display unit such as a TV or
`a "dumb' monitor or display, and a dedicated controller or a
`computer housed in a separate chassis from the primary dis
`play unit and comprising appropriate programmable logic for
`operation of a control system. For exemplary purposes only,
`however, the description that follows is primarily directed to
`a DTV.
`0049. Preferably, the control system integrates IEEE 1394
`and EIA-775 technology as well as the Home Audio Video
`Interoperability (HAVi) networking software technology and
`AV/C, which compliment IEEE 1394 technology. The control
`
`

`

`US 2009/0254500 A1
`
`Oct. 8, 2009
`
`system also preferably incorporates a bi-directional 1394 bus
`interface, which is compliant with IEEE 1394-1995 and IEC
`61883-1, exchanges MPEG-2 video with other devices in
`accordance with IEC 61883-4, at HD and SD resolutions as
`described in IEC61883-2, 3, 4, and exchanges digital audio as
`described in IEC 61883-6, which specifications are all incor
`porated herein by reference. The control system als