(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2003/0075983 A1
`Stecyk et al.
`(43) Pub. Date:
`Apr. 24, 2003
`
`US 20030075983A1
`
`(54) CONTROL SYSTEM AND USER INTERFACE
`FOR NETWORK OF INPUT DEVICES
`(75) Inventors: Polly Stecyk, Fountain Valley, CA
`(US); Brian Peterson, Cypress, CA
`(US); Brian Maxon, Riverside, CA
`(US); Pavel Houda, Laguna Hills, CA
`(US); George E. Palmer, Huntington
`Beach, CA (US); Shenta T. Pu, Irvine,
`CA (US); Martin Zanfino, Coto de
`Caza, CA (US); Robert A. Perry,
`Mission Viejo, CA (US)
`Correspondence Address:
`LYON & LYON LLP
`633 WEST FIFTH STREET
`SUTE 4700
`LOS ANGELES, CA 90071 (US)
`(73) Assignee: Mitsubishi Digital Electronics America,
`Inc.
`
`(21) Appl. No.:
`(22) Filed:
`
`10/138,464
`May 2, 2002
`Related U.S. Application Data
`(60) Provisional application No. 60/288,317, filed on May
`3, 2001.
`
`Publication Classification
`
`(51) Int. Cl." ........................................................ H02.J 1100
`(52) U.S. Cl. ................................................................ 307/38
`
`(57)
`
`ABSTRACT
`
`Apparatus, methods, and Systems for centrally and uni
`formly controlling the operation of a variety of devices, Such
`as communication, consumer electronic, audio-video, ana
`log, digital, 1394, and the like, over a variety of protocols
`within a network System and, more particularly, a control
`System and uniform user interface for centrally controlling
`these devices in a manner that appearS SeamleSS and trans
`parent to the user. In a preferred embodiment, a command
`center or hub of a network System includes a context and
`connection permutation Sensitive control System that
`enables centralized and Seamless integrated control of all
`types of input devices. The control System preferably
`includes a versatile icon based graphical user interface that
`provides a uniform, on-Screen centralized control System for
`the network System. The user interface, which includes a
`Visual recognition System, enables the user to transparently
`control multiple input devices over a variety of protocols
`while operating on a Single control layer of an input com
`mand device. In an alternative embodiment, the control
`System also enables gated Signal pass-through control while
`avoiding Signal jamming.
`
`17
`
`ANT
`
`58
`
`12
`
`34
`
`AWDEVICE
`(DBS)
`
`AWDEVICE
`(VCR)
`
`ANDENCE
`(DVD)
`
`30
`
`
`
`J-1 ANDEVICE
`
`ANDEVICE
`
`15
`
`14
`
`MAN
`
`SUB
`
`D-AWDEVICE
`CAM
`(CAM) 49
`
`43
`- 9
`DANDEVICE
`>1 (D-DVD)
`D-AWDEVICE
`49
`(D-VCR) N DANDEVICE
`(D-AVR)
`)
`45
`
`44
`
`DAWDEVICE
`(D-AWDISC)
`
`49
`DAWDEVICE
`(D-CABLEISAT)
`
`
`
`Roku EX1022
`U.S. Patent No. 10,334,311
`
`

`

`Patent Application Publication
`
`Apr. 24, 2003 Sheet 1 of 19
`
`US 2003/0075983 A1
`
`/90
`
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Apr. 24, 2003 Sheet 2 of 19
`
`US 2003/0075983 A1
`
`
`
`
`
`
`
`
`
`V? "5) IAI
`
`
`
`WNNE INW
`
`

`

`Patent Application Publication
`
`Apr. 24, 2003 Sheet 3 of 19
`
`US 2003/0075983 A1
`
`| #
`
`
`
`80A SHA-0
`
`ELITEIWS
`80 ET8WO-C]
`
`
`
`{{? "5) I.H.
`
`
`
`
`
`
`
`09:
`
`WNNHINW
`
`//
`
`

`

`Patent Application Publication Apr. 24, 2003 Sheet 4 of 19
`
`US 2003/0075983 A1
`
`| #7
`
`
`
`HON SHA-0
`
`g, ' 80318,00
`
`
`
`„O? "5)I, H.
`
`
`
`WNNHINW
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 5 of 19
`
`US 2003/0075983 A1
`
`g, L_80=18,00
`
`/ #7
`
`{{OASHA-0
`
`
`
`
`
`
`
`OSIC] NW-0
`
`WNNHINW
`
`
`
`([? "5) I.H.
`
`

`

`Patent Application Publication
`
`US 2003/0075983 A1
`
`/ #7
`
`(NSER) \ 80ASHA-0
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Apr. 24, 2003 Sheet 7 of 19
`
`US 2003/0075983 A1
`
`
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 8 of 19
`
`US 2003/0075983 A1
`
`
`
`-
`
`REloit RESG
`- 1 N 105
`
`DETECTOR
`
`20
`
`12
`
`
`
`
`
`-
`
`
`
`REvolt RESS
`
`CONTROL(DIGITAL MODULE)CIRCUITBOARD
`
`TVMICRO
`
`RBLASTER
`CONTROLLER
`
`MEMORY
`
`IRBLASTER
`
`DETECTORA
`
`CONTROL (DIGITALMODULE) CIRCUITBOARD
`
`TVMICRO
`
`RBLASTER
`CONTROLLER
`
`MEMORY
`
`105
`
`FIG. BB
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 9 of 19
`
`US 2003/0075983 A1
`
`
`
`12'
`
`452
`
`-
`
`REvolt RESS
`
`---
`
`DETECTOR
`
`HTNS CONTROLLER
`
`DETECTOR
`
`S 104
`
`103
`
`450
`
`TVMCRO
`
`CONTROL (DIGITAL MODULE CIRCUITBOARD
`
`IRBLASTER
`CONTROLLER
`
`MEMORY
`
`12
`
`105
`
`FIG. BC
`
`-
`
`REvolt RESG
`
`
`
`
`
`
`
`-
`
`20
`
`
`
`454
`HTNS CONTROLLER
`
`
`
`
`
`DETECTOR
`
`S 104
`103
`AMPN/
`
`DECODER
`
`
`
`
`
`
`
`
`
`
`
`CONTROL (DIGITALMODULE CIRCUITBOARD
`
`IRBLASTER
`CONTROLLER
`
`MEMORY
`
`SCREENS
`
`108
`
`FIG. BD
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 10 of 19 US 2003/0075983 A1
`
`
`
`CABLEDBSDTW
`VCR DVD
`weaupo
`
`WCHIP
`
`INFO
`
`ODO
`PIPIDEVICE FORMATICONNECT
`
`FIG. 4
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 11 of 19
`
`US 2003/0075983 A1
`
`Rs.
`EWSG
`
`103
`
`-- R
`DETECTOR
`
`REMOTE
`
`20
`
`101
`--------
`
`105
`
`TVMICRODECODER
`
`148
`INTERNAL
`DEVICES
`
`Pc
`
`-
`
`DIGITAL MODULE
`110
`ver
`
`TV
`CONTROL
`MODULE
`
`
`
`DIGITALTUNER
`
`J. L.
`MPEGDECODER
`AC-3DECODER
`
`INTERNAL
`DEVICES
`(TUNERS.)
`
`DEVICE
`weir CONTAINERLIST
`SYSTEM
`(DMS)
`
`DEVICE
`INTERCONNECT
`DIOs
`
`1394
`CONTROL
`MODULE
`
`EXTERNAL
`DEVICES
`(1394)
`
`113
`
`IRCONTROL
`MODULE
`IRLIBRARY
`T. Gr
`
`BLASTER
`DRIVER
`
`RBLASTER
`CONTROLLER
`
`RBLASTER
`
`126
`
`EXTERNAL
`1961DEVICESRC)
`FIG. 5
`
`

`

`Patent Application Publication Apr. 24, 2003 Sheet 12 of 19 US 2003/0075983 A1
`
`
`
`EVENT --
`-MENU
`- DIRECT ACTION
`
`111
`
`AVCM
`(SYSTEM | (MENUACTION)
`STATE)
`
`GRAPHICAL
`U
`(GUI)
`
`(DIRECT
`ACTION)
`
`(MENU
`ACTION)
`
`DEVICE
`
`(DMS)
`
`(WHAT TO CONNECT)
`(HOW TO CONNECT)
`
`CONTAINERLIST
`
`DEVICE
`NTERCONNECT
`
`INTERNAL
`DEVICES
`(ANT; TUNER)
`148
`
`EXTERNAL
`DEVICES
`(IRC)
`136
`
`EXTERNAL
`DEVICES
`(1394)
`126
`
`FIG. 6
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 13 of 19 US 2003/0075983 A1
`
`200
`
`DEVICETYPE
`
`SELECT THEMANUFACTURER AND MODEL OF THE CDEVICETYPEX. IF THE
`MANUFACTURERORMODELIS NOT LISTED, SELECTOTHER: IF YOU DO NOT
`HAVEACDEVICETYPEX, SELECT NONE FOR THE MANUFACTURER.
`2O2
`204
`
`<MANUFACTURERSNAMEX
`
`KMODELNO, >
`
`CBACK
`
`MANUFACTURER
`
`MODELNO,
`
`NEXT
`
`FIG. 7A
`
`CANCE
`
`200
`
`
`
`DEVICETYPE
`
`SELECT THE MANUFACTURER <DEVICEYPEX, IFTHE MANUFACTURERIS
`NOT LISTED, SELECTOTHER, IF YOU DO NOT HAVE A<DEVICETYPEX,
`SELECTNONE FORTHE MANUFACTURER.
`206
`
`CMANUFACTURERSNAMEX
`
`MANUFACTURER
`
`SYSTEMSETTINGSOPTIMIZED FORMODELCMFGMODEL
`NO, X, OTHERMODELSMAYSTILL BECOMPATIBLE,
`
`<BACK
`
`NEXTX
`
`CANCEL
`
`FIG. 7B
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 14 of 19 US 2003/0075983 A1
`
`
`
`REVIEW
`
`220
`
`PLEASEREVIEWALL THE DEVICESTOENSUREPROPER CONNECTIONS, INPUTS
`WITHOUT DEVICES HAVE BEENTURNED OFF. TOTURN AN INPUT ON, PRESS
`ENTER, TOMAKECHANGES, SELECTBACK. SELECTNEXT TOFINISH.
`223
`225
`TV INPUT - AVRINPUT-
`ANTA
`TV
`
`1394 NAME
`DVCR
`
`224
`
`AWDISK
`
`NEXTX
`
`TV
`TV
`WCR
`AUX
`
`WCR2
`
`ANTB
`ANT-DTV
`INPUT-
`NPUT2
`
`INPUT-3
`
`INPUT-4
`
`INPUT-5
`COMP
`COMP-2
`
`INP-DTW
`WGA
`
`FIG. 8
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 15 of 19 US 2003/0075983 A1
`
`FINISH
`
`YOU HAVE COMPLETED SYSTEMSETUP TO CHANGETHE INPUTS OR
`DEVICENAMESSELECTEDIT, TOMAKECHANGESINTHE FUTURE GOTO
`SETUPIN THE TVMENU, AND SELECTEDIT.
`
`IF THERE ARENOCHANGES NOW, SELECT FINISH, TOFINISH SETUP OF THE
`TW YOU MAYNEED TO GO TO THE TWMENUTOSET THE CLOCKOR
`MEMORIZE CHANNELS FORTHEANTENNAS.
`sor
`EDT
`
`226
`
`
`
`FINISH
`
`FIG. 9A
`
`EDT
`
`SELECT THEEDT YOUWOULDLIKETODOTO SETUP.
`
`228
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`O DELETE
`
`O REVIEW
`
`O INTIAL
`
`TOADDADEVICE TO ANUNUSED INPUT.
`TOCHANGETHENAME OR CONNECTION
`OFADEVICEALREADY CONNECTED,
`TO DELETEADEVOCE OR COMPLETELY
`DELETE SETUP.
`TOREVIEWALL THEDEVICESORTURN AN
`INPUT OFFORON.
`TORESTARTINITIAL SETUP.
`
`NEXT
`
`CANCEL
`
`
`
`FIG. 9B
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 16 of 19 US 2003/0075983 A1
`
`
`
`CONNECTIONFOR <DEVICETYPEX
`
`SELECT THE INPUTS ON THE TWANDAVRECEIVER CONNECTED TO THE
`CDEVICETYPEX. CHECKTHE AUDIO AND WIDEO CONNECTIONS TO THE TW
`AND AWR. CONNECTING ONLY AUDIOTO THEAVRSRECOMMENDED.
`THEAVRMAYNEED cory WTHDIGITALAUDIO. 238
`24O
`
`250
`
`TWINPUT
`256 AUDIO
`
`AVRINPUT
`242 AUDIO
`
`FIG. 9C
`
`
`
`RECORDICONNECT
`
`THECURRENT ANTENNAORDEVICE IS THE RECORDINGSOURCE TO RECORD NOW, SELECT
`RECORDINGDEVICE AND DURATION, THEN PRESSREC, TORECORDLATER, ALSO SELECT
`THE START TIME AND DAY, THENSELECT THE ADD BUTTON, FORANTENNAS, SELECT THE
`CHANNEL FOR RECORDING, TOSEEALIST OFFUTURERECORDING, SELECT THELISTBUTTON.
`TOFINISH, SELECT THE QUIT BUTTON TO CONNECT THE 1394 SOURCE ON THE TWTO
`ANOTHER 1394 DEVICE, SELECT DEVICE AND DURATION, THEN PRESSCONNECT.
`252
`254
`256
`258
`260
`
`250
`
`DEVICE
`
`DURATION
`
`STARTTIME
`
`SETDAY
`
`CHANNEL
`
`FIG. 1 O
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 17 of 19 US 2003/0075983 A1
`
`
`
`
`
`
`
`
`
`408
`
`
`
`TRANSMTTER
`
`410
`
`FIG. 1 1A
`
`402
`
`
`
`406
`
`408
`
`REMOTEA
`
`R
`DETECTOR
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TRANSMITTER
`
`
`
`
`
`REMOTEB
`
`R
`DETECTOR
`
`404
`
`405
`
`410
`
`FIG. 1 1B
`
`414
`
`SUPPORTEDR
`DRIVENDEVICE
`
`SUPPORTEDR
`DRIVENDEVICE
`
`NONSUPPORTEDIR
`DRIVENDEVICE
`
`SUPPORTEDR
`DRIVENDEVICE
`
`SUPPORTEDIR
`DRIVENDEVICE
`
`NONSUPPORTEDR
`DRIVENDEVICE
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 18 of 19 US 2003/0075983 A1
`
`
`
`se 103
`
`WDEBAND v AMP
`DETECTOR
`
`MEMORY
`
`TVMICRO
`
`DIGITAL MODULEBOARD
`
`RBLASTER
`CONTROLLER
`
`N
`
`s R
`
`BLASTER
`
`FIG. 12
`
`

`

`Patent Application Publication Apr. 24, 2003. Sheet 19 of 19 US 2003/0075983 A1
`
`SN
`401 N.
`v WIDEBAND
`IRDETECTOR
`
`105
`105
`D TVMICRODECODER
`R
`DETECTOR
`
`TÉ
`DEVICES
`
`
`
`
`
`Pc
`
`DIGITAMODULE
`O
`re-
`
`DEVICE
`weir CONANERLIST
`SYSTEM
`DMS
`(DMS)
`
`DEVICE
`INTERCONNECT
`
`116
`
`140
`
`CONTROL
`MODULE
`
`
`
`131
`
`132
`
`IRCONTROL
`MODULE
`IRLIBRARY
`E.
`
`
`
`1394
`CONTROL
`MODULE
`
`409
`CONTROL
`
`RBLASTER
`142
`410
`CONTROLLER
`H. GATE
`
`DIGITALTUNER
`MPEGDECODER
`AC-3DECODER
`146
`
`{
`
`INTERNAL
`DEVICES
`(NES)
`148
`
`135
`
`
`
`
`
`
`
`
`
`EXERNA
`
`DEVICES (IRC)
`
`124
`
`154
`
`126
`
`E.
`(1394)
`
`FIG. 13
`
`

`

`US 2003/0075983 A1
`
`Apr. 24, 2003
`
`CONTROL SYSTEMAND USER INTERFACE FOR
`NETWORK OF INPUT DEVICES
`
`CROSS-REFERENCE OF RELATED
`APPLICATIONS
`0001. This application is related to U.S. provisional
`application No. 60/288,317, filed May 3, 2001, which is
`incorporated by reference herein.
`
`FIELD OF THE INVENTION
`0002 The invention relates to the field of consumer
`electronics Systems and, more particularly, to apparatus,
`methods, and Systems for centrally controlling the operation
`of devices within a network of consumer electronics SyS
`temS.
`
`BACKGROUND OF THE INVENTION
`0003. The United States and other countries are quickly
`transitioning to digital television (DTV) to take advantage of
`high definition TV broadcasts. The US, in particular, is
`Slowly moving away from and will ultimately abandon the
`analog television System. According to current timelines, the
`US government is calling for the termination of analog TV
`broadcasts by the year 2006. The use of an analog TV will
`require the addition of Set-top-box down-converters to
`change the digital broadcasts to the lower-performance
`analog format Such TVs were designed to receive.
`0004. Accompanying the transition to DTV is the inte
`gration of the IEEE 1394 digital home-networking technol
`ogy. IEEE 1394 enables DTV and other digital devices of
`consumer electronics systems that incorporate IEEE 1394 to
`connect and communicate via single cables (FireWire(R) that
`carry digital Video, digital audio, and System control data. A
`home network System comprising Such integrated devices
`eliminates the myriad of cables and connectors and Separate
`remotes currently necessary to interconnect and control
`electronic devices for a home theater system. With IEEE
`1394 technology, the DTV or some other primary video
`display unit (PDCU) can be engineered to be the command
`center of a digital home network System.
`0005. However, IEEE 1394 by itself provides no way to
`control conventionally wired, IR signal controlled, analog
`audio-video (AV) devices (IRC devices), Such as analog
`VCRs, DVD players, cable and satellite boxes, and AV
`receivers, and does nothing to eliminate the myriad of
`cables, connectors and remotes necessary to connect and
`control a mixed analog and digital home theater network
`System. The interconnection and control of Such Systems can
`be quite complex and unwieldy. For example, simply
`Switching from a cable broadcast to playing a movie on a
`DVD player may involve numerous device specific remote
`controls and Several iterations through the different layers of
`control on Such remotes. Such a task may require the user to
`Switch between video inputs on the TV, Switch between
`layers on a TV remote control to power on and play the DVD
`player, and then, if the user has a AV receiver (AVR), Switch
`between layers on the TV remote and shut down the audio
`output from the TV and Switch to an AVR remote control to
`power up and output audio through the AVR or, if the AVR
`is the current audio output device, use the AVR remote
`control to switch between AVR inputs to output the DVD
`player's audio from the AVR. Completing such tasks is often
`
`fraught with frustration especially when the user is not
`immediately Successful in being able to watch and listen to
`a movie being played on the DVD player.
`0006 Thus, it is desirous to be able to centrally and
`Seamlessly control a variety of electronic devices over a
`variety of protocols from a single input device and provide
`an easy to use user interface (UI) wherein the complexities
`of the control of Such devices is transparent to the user.
`
`SUMMARY OF THE INVENTION
`0007 Accordingly, the present inventions comprise
`novel apparatus, methods, and Systems for centrally and
`uniformly controlling the operation of a variety of devices
`over a variety of protocols within a network System and,
`more particularly, a control System and uniform user inter
`face for centrally controlling these devices in a manner that
`appears SeamleSS and transparent to the user. For example,
`in an entertainment System or a home theater network
`system (HTNS) comprising a mix of analog IR controlled
`(IRC) and digital 1394 audio-video (AV) devices, control
`and operation of the IRC and 1394 versions of an AV device
`appears the Same to the user.
`0008. In a preferred embodiment, a HTNS in accordance
`with the present invention comprises a primary display and
`control unit (PDCU) and a mix of IRC and 1394 AV devices
`and other inputs. The PDCU may comprise an AV system
`Such as a television and, preferably, a digital television
`(DTV), having appropriate circuitry and programmable
`logic for operation of a control System in accordance with
`the present invention. Alternatively, the PDCU may com
`prise a primary display unit such as a TV or a “dumb”
`monitor or display, and a dedicated controller or computer
`housed in a separate chassis from the primary display unit
`and comprising appropriate programmable logic for opera
`tion of a control System in accordance with the present
`invention. Preferably, the PDCU includes several I/O ports
`to which external or peripheral devices, Such as the IRC and
`1394 AV devices, may be coupled.
`0009) Numerous possible configurations of a HTNS in
`accordance with the present invention are possible. For
`example, the HTNS may comprise numerous IRC and 1394
`devices and other System inputs interconnected in a variety
`of ways to one an other and to the PDCU. Preferably, the
`PDCU integrates IEEE 1394 and EIA-775 technology as
`well as the Home Audio Video Interoperability (HAV)
`networking Software technology and AV/C, which compli
`ment the IEEE 1394 technology. The 1394 devices are
`preferably connected in Series and/or in parallel to the
`PDCU across 1394 cable, while the IRC devices are con
`nected to the PDCU in parallel across conventional AV
`cables and controlled across IR blaster cables. The IR blaster
`cables enable messages or commands comprising device
`specific IR codes to be communicated to the IRC devices.
`0010. In one innovative aspect of the present invention,
`the PDCU includes a context sensitive control system that
`enables centralized and Seamless integrated control of both
`1394 and IRC-type devices, as well as internal TV-type
`inputs and other input devices and System hardware inter
`connected to the PDCU. AS Such, the PDCU is the command
`center or hub of the HTNS or other network systems that
`may comprise, in addition to entertainment AV type devices,
`home appliances and home lighting, heating, air condition
`
`

`

`US 2003/0075983 A1
`
`Apr. 24, 2003
`
`ing, Security-type Systems, and the like. The control System
`preferably includes a control module that is capable of
`interpreting an input command Such as an event Signal from
`a System remote, determining what action needs to take
`place, for example, navigate through menus on the Screen of
`the PDCU or operate an attached AV device, determining
`what devices to connect and how to connect them, and then
`preparing and Sending device appropriate messages or com
`mands to the input devices. Preferably, for Supported IRC
`devices, the control module includes a library of IR codes
`and is capable of translating a input command, Such as a
`digital input command, into a message comprising IR codes
`from the IR code library appropriate for the device, and then
`blasting the command message to the IRC device to drive
`the IRC device. The control system of the present invention
`may also be capable of learning and/or uploading IR code of
`a variety of IRC devices. All Such operations, however, are
`advantageously transparent to the consumer or user.
`0011. In another innovative aspect of the present inven
`tion, the control System includes a versatile icon based
`graphical user interface (UI) to provide a uniform, on-screen
`centralized control system for the network system. The UI
`enables the user to transparently control multiple input
`devices Such as internal TV-type devices, AV devices, and
`other input devices over different protocols while operating
`on a single layer of a System remote control, e.g., the TV
`layer of a universal TV remote. For example, operation of an
`IRC DVD player and a 1394 DVD player appears identical
`to the user. The UI also advantageously provides onscreen,
`real time Visual recognition of the State of the System, device
`availability, operation or connection options, active connec
`tions, navigation, and the like.
`0012. In operation, the user selects the “device' button on
`the remote, which causes the control System to display a
`device selection menu on the screen of the PDCU. The
`device Selection menu preferably comprises a device win
`dow, a Video window, an audio window, and, when a
`recording or other peer-to-peer connection is active, a con
`nection window. The user next navigates through the device
`Selection window and highlights a device icon, Such as a
`VCR icon, to play a movie on the VCR. The user may move
`or jump to an audio Selection window and highlight an AV
`receiver (AVR) icon for audio output from an AVR. Selec
`tion of the VCR and AVR from the device selection menu by
`pressing the “enter” or Some other appropriate key on the
`System remote control while the corresponding icons are
`highlighted (selected), causes the control System to perform
`all necessary Switching, make all necessary connections and
`display a transport menu on the screen of the PDCU. The
`transport menu is a device control menu preferably com
`prising device appropriate control function buttons Such as
`“play”, “FF", “RW, and the like. Alternatively, device
`Specific control menus, i.e., device Supplied, may be dis
`playable and operable through the control System of the
`present invention. Lastly, the user Selects the play button in
`the transport menu by pressing the “enter” or “play” buttons
`on the System remote control to play the movie. The Steps
`taken by a user would be the same whether the device is an
`IRC or a 1394 device. As noted above, the control system
`interprets and acts on the user's Selections, performing all
`necessary Switching and making all necessary connections,
`in a manner that is transparent to the user.
`
`0013 A further innovative aspect of the present invention
`includes the connection permutation Sensitivity of the con
`trol System. In particular, once a device Such as the VCR is
`Selected, the control System will automatically control it and
`the rest of HTNS based on stored device and device con
`nection configuration data. For instance, if the VCR is
`connected to both an AVR and the PDCU, wherein the audio
`from VCR is to be outputted by the AVR while the video is
`outputted by the PDCU, upon selection of the VCR and
`AVR, the control system will automatically turn off the
`audio output from the PDCU and turn on the AVR to output
`the audio from the VCR when the VCR or Switch inputs
`within the AVR if it is the current audio output or sink
`device. Thus, the control System handles all of the necessary
`Switching transparently to the user. This situation dependent,
`context sensitive method tends to be superior to the “macro”
`command capability of Some remotes because the control
`Sequences of the control System are not dependent on the
`network devices being in a particular State at the beginning
`of the Sequence. Further, this aspect of the control System
`enables Seamless peer-to-peer communication and operation
`such as recording between devices even when the PDCU is
`not physically involved in the connection.
`0014.
`In yet another innovative aspect of the present
`invention, the control System includes a configuration Setup
`Subsystem. It provides users with the capability to Setup the
`configuration or device interconnections of the network
`System in a first time out of the box initial Setup mode or the
`capability to change/modify/delete existing configurations
`in an edit mode. In the initial Setup mode, the user is
`provided with a pre-Set configuration of IRC device input
`connections on the PDCU and instructed to connect the IRC
`devices to the PDCU accordingly. The user then logs in each
`IRC device within the network system and the control
`System builds a device list and device connection database.
`If the network system includes IRC devices interconnected
`to the PDCU through other input connections, the user may
`enter the edit mode of the Subsystem to customize the input
`connections of Such devices as well as delete individual
`device or entire System configuration data. The navigation
`through the configuration Setup Subsystem is text and Screen
`driven. In an alternative, navigation through the configura
`tion Setup Subsystem may be by voice recognition or the
`configuration Setup Subsystem may be graphically driven.
`0015. In yet another innovative aspect, the control system
`preferably enables IR signal pass-through control of non
`supported IRC devices within the network system, while
`avoiding IR signal jamming. Avoidance of IR signal jam
`ming may be accomplished by appropriate Signal transmis
`Sion gapping control or through a gated control System.
`Preferably, the gated pass-through control System includes a
`gate mechanism that controls the pass-through of IR signals
`to the non-supported IRC devices. An IRC device controller,
`which is adapted to translate remote commands into mes
`Sages containing device appropriate IR code for Supported
`IRC devices, controls the operation of the gate. AS Such, the
`IRC controller preferably maintains the gate in a closed State
`as the IRC controller transmits device specific IR code
`messages to Supported devices. When Such transmissions
`are complete, the IRC controller may transition the gate to
`an open State to allow IR signals to freely pass to non
`Supported devices.
`
`

`

`US 2003/0075983 A1
`
`Apr. 24, 2003
`
`0016 Other aspects and features of the present invention
`will become apparent from consideration of the following
`description taken in conjunction with the accompanying
`drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0017 FIG. 1 is a diagram showing an example of a
`device interconnect configuration for a home theater net
`work System of the present invention.
`0.018
`FIG. 2A is a schematic showing an example of a
`home theater network System of the present invention com
`prising a television having a variety of IRC and 1394 AV
`devices connected to the television. A graphical user inter
`face of the control System of the present invention is shown
`on the display of the television providing visual recognition
`of the current System State, user navigation through device
`and audio menus, device connection options, and active
`device connections.
`0.019
`FIG. 2B is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control System shown on the display of the
`television provides Visual recognition of current System
`State, user navigation through device and audio menus,
`device connection options, and active device connections.
`0020 FIG. 2C is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control System shown on the display of the
`television provides visual recognition of current System
`State, user navigation through device and audio menus,
`device connection options, and active device connections.
`0021
`FIG. 2D is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control System shown on the display of the
`television provides a device appropriate control (transport)
`menu for operation of a Selected device.
`0022 FIG. 2E is a schematic showing the home theater
`network system provided in FIG. 2A. The graphical user
`interface of the control System shown on the display of the
`television provides PIP device connection options.
`0023 FIG.2F is a graphical representation of a preferred
`embodiment of the graphical user interface of the control
`System of the present invention.
`0024 FIG. 3A is a schematic of a remote control and a
`television in accordance with the present invention.
`0025 FIG. 3B is a schematic of the remote control and
`an alternative embodiment of the television shown in FIG.
`3a including IR pass-through circuitry.
`0.026
`FIG. 3C is a schematic of a remote control and a
`primary display and control unit in accordance with the
`present invention comprising a television and a Separate
`HTNS controller.
`0027 FIG. 3D is a schematic of a remote control and a
`primary display and control unit in accordance with the
`present invention comprising a monitor or display and a
`separate HTNS controller.
`0028 FIG. 4 is a plan view of a remote control for the
`home theater network System of the present invention.
`
`0029 FIG. 5 is a schematic of a control system for the
`home theater network System of the present invention.
`0030 FIG. 6 is a schematic of a user interface module of
`the control System of the present invention.
`0031
`FIG. 7A is a diagram showing a device log in
`menu for a Setup configuration Subsystem of the present
`invention.
`0032 FIG. 7B is a diagram showing a preferred embodi
`ment of the device log in menu.
`0033 FIG. 8 is a diagram showing a device connection
`review menu for the Setup configuration Subsystem.
`0034 FIG. 9A is a diagram showing a finish menu for the
`Setup configuration Subsystem.
`0035 FIG.9B is a diagram showing an edit menu for the
`Setup configuration Subsystem.
`0036 FIG. 9C is a diagram showing a device connection
`customization menu for the Setup configuration Subsystem.
`0037 FIG. 10 is a diagram showing a menu for initiating
`recording or peer-to-peer connections.
`0038 FIG. 11A is a schematic of an IR signal pass
`through and control System of the present invention.
`0039 FIG. 11B is a schematic of an alternate embodi
`ment of the IR signal pass-through and control System.
`0040 FIG. 12 is a schematic of a remote control and
`television for the home theater network System of the
`present invention with an IR pass-through and control
`System incorporated therein.
`0041
`FIG. 13 is a schematic of a control system for the
`home theater network System of the present invention with
`an IR pass through and control System incorporated therein.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`0042 Referring in detail to the figures, novel apparatus,
`methods, and Systems for centrally and uniformly control
`ling the operation of a variety of devices over a variety of
`protocols within a network System are described. In particu
`lar, a control System and user interface that provide uniform,
`SeamleSS and transparent centralized control of a network of
`devices over a variety protocols are described. It will be
`understood by those skilled in the art that numerous con
`figurations of a network System in accordance with the
`present invention are possible. For example, a network
`System may comprise a mix of communication devices,
`consumer electronic Systems, audio/video (A/V) devices,
`high and low speed devices, analog and digital devices,
`globally and locally controlled devices, and AV and non-AV
`devices, and the like, and may comprise both analog IR
`controlled and digital 1394 AV and other input-type devices.
`For exemplary purposes only, the apparatus, Systems and
`methods in accordance with the present inventions will be
`described primarily in the context of a Home Theater
`Network System (HTNS).
`0043. In a preferred embodiment, a HTNS in accordance
`with the present invention comprises a primary display and
`control unit (PDCU), which functions as the hub or com
`mand center of the HTNS, and a mix of IR controlled
`
`

`

`US 2003/0075983 A1
`
`Apr. 24, 2003
`
`(analog) and 1394 (digital) AV devices, and other inputs.
`The AV devices and other inputs may be interconnected in
`a variety of ways to each other and to the PDCU. The PDCU
`preferably includes an integrated control System with a
`graphical user interface (UI) for making connections
`between components of the HTNS and controlling their
`operation. The control System provides the user with cen
`tralized control of all of the supported devices in the HTNS
`and, in an alternative embodiment, enables pass-through
`control of non-Supported devices while avoiding Signal
`jamming.
`0044) Preferably, the PDCU comprises an AV system
`Such as a television and, more preferably, a digital television
`(DTV), comprising appropriate circuitry and programmable
`logic for operation of a control System in accordance with
`the present invention. Alternatively, the PDCU may com
`prise a primary display unit such as a TV or a “dumb”
`monitor or display, and a dedicated controller or a computer
`housed in a separate chassis from the primary display unit
`and comprising appropriate programmable logic for opera
`tion of a control System in accordance with the present
`invention. For exemplary purposes only, however, the
`description that follows primarily describes the present
`inventions with regard to a DTV.
`0.045
`Preferably, the control system of the present inven
`tion integrates IEEE 1394 and EIA-775 technology as well
`as the Home Audio Video Interoperability (HAVi) network
`ing software technology and AV/C, which compliment IEEE
`1394 technology. The control system also preferably incor
`porates a bi-directional 1394 bus interface, which is com
`pliant with IEEE 1394-1995 and IEC 61883-1, exchanges
`MPEG-2 video with other devices in accordance with IEC
`61883-4, at HD and SD resolutions as described in
`IEC61883-2, 3, 4, and exchanges digital audio as described
`in IEC 61883-6, which specifications are all incorporated
`herein by reference. The control system also preferably
`functions as a 1394 bus cycle master, as defined in IEEE
`1394-1995 8.3.1.4, a bus manager, as defined in IEEE
`1394-19958.3.1.6, and an isochronous resource manager, as
`defined in IEEE 1394-19958.3.1.5, provides higher-level
`1394 interfaces to open cable and other AV/C devices as
`defined in EIA-775A, and conforms to Profile B of 775A
`Subscriber devices, which specifications are all incorporated
`herein by reference. Although capable of being configured to
`do So, the control System will preferably not respond to any
`type of 1394 commands from other 1394 devices, in any
`protocol, and preferably does not conform to the HAVi
`Display Functional Module. The control system's Config
`ROM and SDD preferably identifies itself to other bus
`members that it does not Support those Sub-unit Standards. In
`addition, the PDCU is preferably a full A/V device (FAV) as
`described in the HAVii 1.0 Specification, wh