(12) United States Patent
`Maxon et al.
`
`USOO693073OB2
`US 6,930,730 B2
`Aug. 16, 2005
`
`(10) Patent No.:
`(45) Date of Patent:
`
`(54)
`
`(75)
`
`(73)
`
`(21)
`(22)
`(65)
`
`(60)
`
`(51)
`(52)
`
`(58)
`
`CONTROL SYSTEMAND USER INTERFACE
`FOR NETWORK OF INPUT DEVICES
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`Inventors: Brian Maxon, Riverside, CA (US);
`Polly Stecyk, Fountain Valley, CA
`(US); Brian Peterson, Cypress, CA
`(US); Pavel Houda, Laguna Hills, CA
`(US); George E. Palmer, Huntington
`Beach, CA (US); Shenta T. Pu, Irvine,
`CA (US); Martin Zanfino, Coto de
`Caza, CA (US); Robert A. Perry,
`Mission Viejo, CA (US); Sorin I.
`Teodorescu, Fountain Valley, CA (US);
`David M. Mann, Upland, CA (US)
`Assignee: Mitsubishi Digital Electronics
`America, Inc., Irvine, CA (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 504 days.
`
`Notice:
`
`Appl. No.: 10/138,451
`Filed:
`May 3, 2002
`Prior Publication Data
`
`US 2002/0171762 A1 Nov. 21, 2002
`Related U.S. Application Data
`Provisional application No. 60/288,317, filed on May 3,
`2001.
`Int. Cl................................................... H04N 5/44
`U.S. Cl. ....................... 348/734; 348/552; 715/717;
`715/718; 340/825.72
`Field of Search ..................... 726/37, 38; 715/714,
`71.5/716, 718, 719; 348/734, 706, 731,
`705, 460, 552, 553,554; 340/825.69, 825.22,
`825.24, 825.25, 825.72; 700/17
`SS
`4Gi N
`
`
`
`
`
`5/1995 Sato et al. .................. 348/706
`5,416,535 A
`5,455,636 A * 10/1995 Furrey et al. .....
`... 348/731
`5,596,372 A
`1/1997 Berman et al.
`5,602,664 A * 2/1997 Doyle ........................ 398/126
`(Continued)
`
`Primary Examiner Michael H. Lee
`(74) Attorney, Agent, or Firm-Orrick, Herrington &
`Sutcliffe LLP
`ABSTRACT
`(57)
`Apparatus, methods, and Systems for centrally and uni
`formly controlling the operation of a variety of devices, Such
`as communication, consumer electronic, audio-video,
`analog, digital, 1394, and the like, over a variety of protocols
`within a network System and, more particularly, a control
`System and uniform user interface for centrally controlling
`these devices in a manner that appearS SeamleSS and trans
`parent to the user. In a preferred embodiment, a command
`center or hub of a network System includes a context and
`connection permutation Sensitive control System that
`enables centralized and Seamless integrated control of all
`types of input devices. The control System preferably
`includes a versatile icon based graphical user interface that
`provides a uniform, on-Screen centralized control System for
`the network System. The user interface, which includes a
`Visual recognition System, enables the user to transparently
`control multiple input devices over a variety of protocols
`while operating on a Single control layer of an input com
`mand device. In an alternative embodiment, the control
`System also enables gated Signal pass-through control while
`avoiding Signal jamming.
`
`45 Claims, 19 Drawing Sheets
`
`t
`
`TRDECODER
`
`FC
`
`ar
`
`M
`
`AC
`
`i----
`
`112
`
`GRAPHICAL
`V
`(GUI
`
`WEBA
`REECTOR
`
`
`
`)
`it?
`
`OGALRODLE
`o
`
`fi4
`I
`"I act
`DECE
`wer CNANERLST
`ce Zoos
`SYSTEM
`(DAS)
`DEWE
`(1 INTEGECT
`18
`s
`
`Er
`RNTROE
`;3f
`MOELE
`10- cer. His
`&
`BRARY
`LASER
`132
`k
`BRER
`ang
`conIRO.
`410s
`
`Tw
`MOE
`
`1334
`
`t
`
`122-- 0s
`
`f42
`
`i24
`IRBA3ER
`CONTROLLERY
`34
`
`AE
`
`1884DRMBR
`
`f44
`
`IRA
`ECES
`
`DATER
`PEER
`A3DECODER
`
`I
`35 - RBLASER
`
`:28
`
`ERNA
`EWCES
`(39.
`
`ERA
`*Disc
`
`Roku EX1026
`U.S. Patent No. 7,589,642
`
`

`

`US 6,930,730 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,883,677
`5.990,883
`5,995,155
`6,003,041
`6,032,202
`6,038.614
`6,131,130
`6,169,879
`6,182,094
`6,182.287
`6.219,839
`
`3/1999
`11/1999
`11/1999
`12/1999
`2/2000
`3/2000
`10/2000
`1/2001
`1/2001
`1/2001
`4/2001
`
`Hofmann
`Byrne et al.
`Schindler et al.
`Wugofski
`Lea et al.
`Chan et al.
`Van Ryzin et al.
`Perlman
`Humpleman et al.
`Schneidewend et al.
`Sampsell
`
`5/2001
`6,239,794
`6,288,716
`9/2001
`6,314,326
`* 11/2001
`6,359,580
`3/2002
`6,359,636
`3/2002
`6,449,767
`9/2002
`6,469,633
`* 10/2002
`6,546,419
`4/2003
`6,556.219
`4/2003
`6,567,106
`5/2003
`6,801,957
`10/2004
`* cited by examiner
`
`Yuen et al.
`Humpleman et al.
`Fuchu ......................... 700/17
`Morrison
`Schindler et al.
`Krapf et al.
`Wachter ................ 340/825.69
`Humpleman et al.
`Wugofski
`Wugofski
`Sadanaka et al.
`
`

`

`US. Patent
`
`Aug. 16, 2005
`
`Sheet 1 0f 19
`
`US 6,930,730 B2
`
`N.UNK
`
`vv
`
`8532.3
`
`oma>3
`
`35%2,3
`
`53$:
`
`o.v
`
`mv
`
`
`
`.132loam“;
`
`a,EsanEgg\\
`
`33//.
`
`m.»
`
`mm.
`
`_
`
`_
`
`9:u=EmmwwmwRairwas
`Eu:mm_..0“
`000000
`NN
`_r11111111%........._llllllllllllLES
`
`2
`
`a
`
`052.”.>5
`'8pmRmm
`
`hm.NM.
`
`
`
`E3,3m»'95:“;F‘993.3023'95::
`gangsRR$592323llwofioi
`a“5.5033leE0329\Eosgs
`
`.63m»»n
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 2 of 19
`
`US 6,930,730 B2
`
`þý
`
`V? "5) IAI
`
`
`
`
`
`JEWOTWISIQ
`
`HIITE||WS80
`
`MEMB03}}
`
`99 ?
`
`80A 69–TT
`
`WNNELINY
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 3 of 19
`
`US 6,930,730 B2
`
`| #7
`
`80ASHA-0
`
`E?EJÆ
`
`
`
`WNNELIN, MEN?l1S80
`
`
`
`l l
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 4 of 19
`
`US 6,930,730 B2
`
`EITHIWS
`80 ET8WO-0
`
`0#
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 5 of 19
`
`US 6,930,730 B2
`
`
`
`80A SHA-0
`
`OSIC] WHO
`
`
`
`

`

`US 6,930,730 B2
`
`U.S. Patent
`
`Aug. 16, 2005
`
`! #
`
`
`
`80A SHA-0
`
`
`
`
`
`
`
`Sheet 6 of 19
`
`##HEINBOERJAW
`
`

`

`U.S. Patent
`US. Patent
`
`Aug. 16, 2005
`Aug. 16, 2005
`
`Sheet 7 of 19
`Sheet 7 0f 19
`
`US 6,930,730 B2
`US 6,930,730 B2
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 8 of 19
`
`US 6,930,730 B2
`
`20
`
`s
`
`
`
`12
`
`CONTROL(DIGITAL MODULE) CIRCUITBOARD
`
`TVMICRO
`
`IRBLASTER
`CONTROLLER
`
`MEMORY
`
`
`
`CONTROL(DIGITAL MODULE)CIRCUITBOARD
`
`TWMICRO
`
`IRBLASTER
`CONTROLLER
`
`FIG. 3B
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 9 of 19
`
`US 6,930,730 B2
`
`
`
`12'
`
`452
`
`-
`
`Renoit Rese
`
`N
`
`20
`
`450
`
`TVMICRO
`
`412
`
`FIG. 3C
`
`
`
`HTNS CONTROLLER
`
`454
`HTNS CONTROLLER
`
`
`
`DETECTOR
`
`S 104
`
`
`
`
`
`
`
`SCREENS
`
`
`
`FIG. 3D
`
`
`
`DECODER
`
`CONTROL (DIGITAL MODULE CIRCUITBOARD
`
`

`

`U.S. Patent
`US. Patent
`
`Aug. 16, 2005
`
`Sheet 10 0f 19
`
`US 6,930,730 B2
`US 6,930,730 B2
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 11 of 19
`
`US 6,930,730 B2
`
`REMOTE
`
`101
`- 20
`
`u-
`REVSIG
`
`D TV MICRODECODER
`- IR
`DETECTOR
`
`148
`INTERNAL
`DEVICES
`
`f05
`
`
`
`PC
`
`
`
`
`
`DIGITAMODULE
`110
`O
`
`TV
`CONTROL
`
`MANAGEMENT
`SYSTEM
`(DMS)
`
`IRCONTROL
`MODULE
`RLIBRARY
`
`BLASTER
`DRMER
`
`IRBLASTER
`CONTROLLER
`
`U
`(GUI)
`
`DEVICE
`CONTAINERLIST
`
`DEVICE
`INTERCONNECI
`
`
`
`E
`1394 DRIVER
`
`T
`
`EXTERNAL
`DEVICES
`1394
`(1394)
`
`at Ts
`
`DIGITALTUNER
`MPEGDECODER
`AC-3DECODER
`N146
`
`O
`
`INTERNAL
`DEVICES
`EXTERNAL
`NERS.
`(NES) 136-E
`148
`
`FIG. 5
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 12 of 19
`
`US 6,930,730 B2
`
`
`
`EVENT --
`-MENU
`- DIRECT ACTION
`
`AVCM
`(SYSTEM | (MENUACTION)
`STATE)
`
`GRAPHICAL
`U
`(GUI)
`
`(DIRECT
`ACTION)
`
`(MENU
`ACTION)
`
`DEVICE
`
`(DMS)
`(WHAT TOCONNECT)
`(HOW TO CONNECT)
`
`CONTAINERLIST
`DEVICE
`
`INTERNAL
`DEVICES
`(ANT;TUNER)
`148
`
`EXTERNAL
`DEVICES
`(IRC)
`136
`
`EXTERNAL
`DEVICES
`(1394)
`f26
`
`FIG. 6
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 13 of 19
`
`US 6,930,730 B2
`
`200
`
`DEVICETYPE
`
`SELECT THE MANUFACTURERAND MODEL OF THE & DEVICETYPE > FTHE
`MANUFACTURERORMODELIS NOT LISTED, SELECTOTHER. IF YOU DO NOT
`HAVEACDEVICETYPEX, SELECT NONE FOR THE MANUFACTURER.
`2O2
`204
`
`CMANUFACTURERSNAMEX
`
`CMODELNO, X
`
`CBACK
`
`MANUFACTURER
`
`MODELNO,
`
`NEXTX
`
`FIG. 7A
`
`CANCEL
`
`200
`
`
`
`DEVICETYPE
`
`SELECT THE MANUFACTURER KDEVICETYPEX. IF THE MANUFACTURERIS
`NOT LISTED, SELECTOTHER: IF YOU DO NOT HAVEACDEVICETYPEX,
`SELECT NONE FORTHE MANUFACTURER.
`206
`
`CMANUFACTURERSNAMEX
`
`MANUFACTURER
`SYSTEMSETTINGS OPTIMIZED FORMODEL CMFGMODEL
`NO.>, OTHERMODELSMAYSTILL BECOMPATIBLE,
`
`NEXTX
`
`FIG. 7B
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 14 of 19
`
`US 6,930,730 B2
`
`220
`
`
`
`REVIEW
`
`PLEASE REVIEWALL THE DEVICESTOENSURE PROPER CONNECTIONS, INPUS
`WITHOUT DEVICESHAVE BEENTURNEDOFF. TOTURN AN INPUTON, PRESS
`ENTER, TOMAKECHANGES, SELECTBACK SELECT NEXT TOFINISH.
`225
`225
`TV INPUT - AVR INPUT
`ANTA
`TW
`ANT-B
`TV
`
`TW
`WCR
`AUX
`WCR2
`
`ANT-DTW
`INPUT-
`INPUT-2
`INPUT-3
`INPUT-4
`INPUT-5
`COMP-1
`COMP-2
`INP-DTW
`VGA
`
`FIG. B
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 15 of 19
`
`US 6,930,730 B2
`
`226
`
`FINISH
`
`YOU HAVE COMPLETED SYSTEMSETUP TO CHANGETHE INPUTS OR
`DEVICENAMESSELECTEDIT, TOMAKECHANGESIN THE FUTURE GOTO
`SETUPIN THE TVMENU, AND SELECTEDIT.
`
`IF THERE ARE NOCHANGES NOW, SELECT FINISH. TOFINISH SETUP OF THE
`TW YOU MAYNEED TO GO TO THE TWMENUTOSET THE CLOCKOR
`MEMORIZECHANNELS FOR THEANTENNAS,
`
`EDT
`
`
`
`FINISH
`
`FIG. 9A
`
`
`
`EDT
`
`SELECT THE EDT YOU WOULDLIKE TODOTO SETUP.
`
`TOADDADEVICE TO ANUNUSED INPUT.
`TOCHANGETHENAME OR CONNECTION
`OFADEVICEALREADY CONNECTED,
`TODELETEADEVOCE OR COMPLETELY
`DELETESETUP.
`TOREVIEWALL THE DEVICESORTURN AN
`INPUT OFFORON.
`TORESTARTINITIAL SETUP.
`
`NEXTX
`
`CANCEL
`
`FIG. 9B
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 16 of 19
`
`US 6,930,730 B2
`
`CONNECTIONFORCDEVICETYPEX
`
`SELECT THE INPUTS ON THE TWANDAVRECEIVER CONNECTED TO THE
`KDEVICETYPEX, CHECK THE AUDIO AND WIDEO CONNECTIONS TO THE TV
`ANDAVR, CONNECTING ONLY AUDIOTO THEAVRS RECOMMENDED.
`240
`
`230
`
`
`
`RECORDICONNECT
`
`THECURRENT ANTENNAORDEVICE IS THE RECORDINGSOURCE, TORECORD NOW, SELECT
`RECORDING DEVICE AND DURATION, THEN PRESSREC, TORECORDLATER, ALSO SELECT
`THE START TIME AND DAY. THENSELECT THE ADD BUTTON, FORANTENNAS, SELECT THE
`CHANNEL FORRECORDENG. TOSEEALIST OFFUTURE RECORDING, SELECT THELISTBUTTON.
`TOFINISH, SELECT THE QUITBUTTON, TO CONNECT THE 1394 SOURCEON THE TWTO
`ANOTHER 1394 DEVICE, SELECT DEVICE AND DURATION, THEN PRESSCONNECT.
`252
`254
`256
`258
`260
`
`250
`
`DEVICE
`
`DURATION
`
`START TIME
`
`SETDAY
`
`CHANNEL
`
`FIG. 10
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 17 0f 19
`
`US 6,930,730 B2
`
`
`
`
`
`FIG. 1 1A
`
`402
`
`406
`
`405
`
`
`
`R
`DETECTOR
`
`404
`
`405
`
`
`
`
`
`
`
`
`
`
`
`410
`FIG. 11 B
`
`SUPPORTEDR
`DRIVENDEVICE
`
`SUPPORTEDIR
`DRIVENDEVICE
`
`NONSUPPORTEDIR
`DRIVENDEVICE
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 18 of 19
`
`US 6,930,730 B2
`
`
`
`seOR
`
`103
`WIDEBAND V AMP
`DETECTOR
`
`TVMICRO
`
`DIGITAMODULEBOARD
`
`134
`
`RBLASTER
`CONTROLLER
`
`MEMORY
`
`FIG. 12
`
`

`

`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 19 of 19
`
`US 6,930,730 B2
`
`SS
`401 N.
`M
`WIDEBAND
`
`
`
`105
`103
`> WMICRODECODER
`IR
`
`INTER 8
`DEVICES
`
`DIGITAL MODUL
`110
`m
`
`MANAGEMEN
`SYSTEM
`(DMS)
`
`f 18
`
`DEVICE
`CONTAINERLIST
`DCOs/DMOs
`DEVICE
`INTERCONNECT
`
`CONTROL
`MODULE
`
`IRCONTROL
`MODULE
`
`TRANSCODER
`
`RBLASTER
`CONTROLLER
`
`f35
`
`IRBLASTER
`
`EXTERNAL
`
`1394
`CONTROL
`MODULE
`
`ETERNA
`DEVICES
`(1394)
`
`Vl INTERNAL
`DEVICES
`NERS
`
`DIGITALTUNER
`MPEGDECODER
`AC-3DECODER
`...
`Nf46
`
`148
`
`FIG. 13
`
`

`

`US 6,930,730 B2
`
`1
`CONTROL SYSTEMAND USER INTERFACE
`FOR NETWORK OF INPUT DEVICES
`
`CROSS-REFERENCE OF RELATED
`APPLICATIONS
`This application is related to U.S. provisional application
`No. 60/288,317, filed May 3, 2001, which is incorporated by
`reference herein.
`
`2
`protocols from a single input device and provide an easy to
`use user interface (UI) wherein the complexities of the
`control of Such devices is transparent to the user.
`
`SUMMARY OF THE INVENTION
`Accordingly, the present inventions comprise novel
`apparatus, methods, and Systems for centrally and uniformly
`controlling the operation of a variety of devices over a
`variety of protocols within a network System and, more
`particularly, a control System and uniform user interface for
`centrally controlling these devices in a manner that appears
`SeamleSS and transparent to the user. For example, in an
`entertainment System or a home theater network System
`(HTNS) comprising a mix of analog IR controlled (IRC) and
`digital 1394 audio-video (AV) devices, control and opera
`tion of the IRC and 1394 versions of an AV device appears
`the same to the user.
`In a preferred embodiment, a HTNS in accordance with
`the present invention comprises a primary display and
`control unit (PDCU) and a mix of IRC and 1394 AV devices
`and other inputs. The PDCU may comprise an AV system
`Such as a television and, preferably, a digital television
`(DTV), having appropriate circuitry and programmable
`logic for operation of a control System in accordance with
`the present invention. Alternatively, the PDCU may com
`prise a primary display unit such as a TV or a “dumb”
`monitor or display, and a dedicated controller or computer
`housed in a separate chassis from the primary display unit
`and comprising appropriate programmable logic for opera
`tion of a control System in accordance with the present
`invention. Preferably, the PDCU includes several I/O ports
`to which external or peripheral devices, Such as the IRC and
`1394 AV devices, may be coupled.
`Numerous possible configurations of a HTNS in accor
`dance with the present invention are possible. For example,
`the HTNS may comprise numerous IRC and 1394 devices
`and other System inputs interconnected in a variety of ways
`to one another and to the PDCU. Preferably, the PDCU
`integrates IEEE 1394 and EIA-775 technology as well as the
`Home Audio Video Interoperability (HAVi) networking soft
`ware technology and AV/C, which compliment the IEEE
`1394 technology. The 1394 devices are preferably connected
`in series and/or in parallel to the PDCU across 1394 cable,
`while the IRC devices are connected to the PDCU in parallel
`acroSS conventional AV cables and controlled acroSS IR
`blaster cables. The IR blaster cables enable messages or
`commands comprising device Specific IR codes to be com
`municated to the IRC devices.
`In one innovative aspect of the present invention, the
`PDCU includes a context sensitive control system that
`enables centralized and Seamless integrated control of both
`1394 and IRC-type devices, as well as internal TV-type
`inputs and other input devices and System hardware inter
`connected to the PDCU. AS Such, the PDCU is the command
`center or hub of the HTNS or other network systems that
`may comprise, in addition to entertainment AV type devices,
`home appliances and home lighting, heating, air
`conditioning, Security-type Systems, and the like. The con
`trol System preferably includes a control module that is
`capable of interpreting an input command Such as an event
`Signal from a System remote, determining what action needs
`to take place, for example, navigate through menus on the
`screen of the PDCU or operate an attached AV device,
`determining what devices to connect and how to connect
`them, and then preparing and Sending device appropriate
`messages or commands to the input devices. Preferably, for
`
`15
`
`25
`
`FIELD OF THE INVENTION
`The invention relates to the field of consumer electronics
`Systems and, more particularly, to apparatus, methods, and
`Systems for centrally controlling the operation of devices
`within a network of consumer electronics Systems.
`BACKGROUND OF THE INVENTION
`The United States and other countries are quickly transi
`tioning to digital television (DTV) to take advantage of high
`definition TV broadcasts. The US, in particular, is slowly
`moving away from and will ultimately abandon the analog
`television System. According to current timelines, the US
`government is calling for the termination of analog TV
`broadcasts by the year 2006. The use of an analog TV will
`require the addition of Set-top-box down-converters to
`change the digital broadcasts to the lower-performance
`analog format Such TVs were designed to receive.
`Accompanying the transition to DTV is the integration of
`the IEEE 1394 digital home-networking technology. IEEE
`1394 enables DTV and other digital devices of consumer
`electronics systems that incorporate IEEE 1394 to connect
`and communicate via single cables (FireWire0) that carry
`digital Video, digital audio, and System control data. A home
`network System comprising Such integrated devices elimi
`nates the myriad of cables and connectors and Separate
`remotes currently necessary to interconnect and control
`electronic devices for a home theater system. With
`IEEE1394 technology, the DTV or some other primary
`video display unit (PDCU) can be engineered to be the
`command center of a digital home network System.
`However, IEEE 1394 by itself provides no way to control
`conventionally wired, IR signal controlled, analog audio
`video (AV) devices (IRC devices), such as analog VCRs,
`DVD players, cable and satellite boxes, and AV receivers,
`and does nothing to eliminate the myriad of cables, connec
`tors and remotes necessary to connect and control a mixed
`analog and digital home theater network System. The inter
`connection and control of Such Systems can be quite com
`pleX and unwieldy. For example, Simply Switching from a
`cable broadcast to playing a movie on a DVD player may
`involve numerous device Specific remote controls and Sev
`eral iterations through the different layers of control on Such
`remotes. Such a task may require the user to Switch between
`video inputs on the TV, Switch between layers on a TV
`remote control to power on and play the DVD player, and
`55
`then, If the user has an AV receiver (AVR), Switch between
`layers on the TV remote and shut down the audio output
`from the TV and switch to an AVR remote control to power
`up and output audio through the AVR or, if the AVR is the
`current audio output device, use the AVR remote control to
`Switch between AVR inputs to output the DVD player's
`audio from the AVR. Completing Such tasks is often fraught
`with frustration especially when the user is not immediately
`Successful in being able to watch and listen to a movie being
`played on the DVD player.
`Thus, it is desirous to be able to centrally and Seamlessly
`control a variety of electronic devices over a variety of
`
`35
`
`40
`
`45
`
`50
`
`60
`
`65
`
`

`

`US 6,930,730 B2
`
`1O
`
`15
`
`25
`
`35
`
`40
`
`3
`supported IRC devices, the control module includes a library
`of IR codes and is capable of translating a input command,
`Such as a digital input command, into a message comprising
`IR codes from the IR code library appropriate for the device,
`and then blasting the command message to the IRC device
`to drive the IRC device. The control system of the present
`invention may also be capable of learning and/or uploading
`IR code of a variety of IRC devices. All such operations,
`however, are advantageously transparent to the consumer or
`USC.
`In another innovative aspect of the present invention, the
`control System includes a versatile icon based graphical user
`interface (UI) to provide a uniform, on-screen centralized
`control system for the network system. The UI enables the
`user to transparently control multiple input devices Such as
`internal TV-type devices, AV devices, and other input
`devices over different protocols while operating on a single
`layer of a System remote control, e.g., the TV layer of a
`universal TV remote. For example, operation of an IRC
`DVD player and a 1394 DVD player appears identical to the
`user. The UI also advantageously provides on-Screen, real
`time Visual recognition of the State of the System, device
`availability, operation or connection options, active
`connections, navigation, and the like.
`In operation, the user selects the “device' button on the
`remote, which causes the control System to display a device
`Selection menu on the screen of the PDCU. The device
`Selection menu preferably comprises a device window, a
`Video window, an audio window, and, when a recording or
`other peer-to-peer connection is active, a connection win
`dow. The user next navigates through the device Selection
`window and highlights a device icon, Such as a VCR icon,
`to play a movie on the VCR. The user may move or jump to
`an audio Selection window and highlight an AV receiver
`(AVR) icon for audio output from an AVR. Selection of the
`VCR and AVR from the device selection menu by pressing
`the “enter” or Some other appropriate key on the System
`remote control while the corresponding icons are high
`lighted (Selected), causes the control System to perform all
`necessary Switching, make all necessary connections and
`display a transport menu on the screen of the PDCU. The
`transport menu is a device control menu preferably com
`prising device appropriate control function buttons Such as
`“play”, “FF", “RW, and the like. Alternatively, device
`Specific control menus, i.e., device Supplied, may be dis
`playable and operable through the control System of the
`present invention. Lastly, the user Selects the play button in
`the transport menu by pressing the “enter” or “play” buttons
`on the System remote control to play the movie. The Steps
`taken by a user would be the same whether the device is an
`IRC or a 1394 device. As noted above, the control system
`interprets and acts on the user's Selections, performing all
`necessary Switching and making all necessary connections,
`in a manner that is transparent to the user.
`A further innovative aspect of the present invention
`includes the connection permutation Sensitivity of the con
`trol System. In particular, once a device Such as the VCR is
`Selected, the control System will automatically control it and
`the rest of HTNS based on stored device and device con
`nection configuration data. For instance, if the VCR is
`connected to both an AVR and the PDCU, wherein the audio
`from VCR is to be outputted by the AVR while the video is
`outputted by the PDCU, upon selection of the VCR and
`AVR, the control system will automatically turn off the
`audio output from the PDCU and turn on the AVR to output
`the audio from the VCR when the VCR or Switch inputs
`within the AVR if it is the current audio output or sink
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`device. Thus, the control System handles all of the necessary
`Switching transparently to the user. This situation dependent,
`context sensitive method tends to be superior to the “macro”
`command capability of Some remotes because the control
`Sequences of the control System are not dependent on the
`network devices being in a particular State at the beginning
`of the Sequence. Further, this aspect of the control System
`enables Seamless peer-to-peer communication and operation
`such as recording between devices even when the PDCU is
`not physically involved in the connection.
`In yet another innovative aspect of the present invention,
`the control System includes a configuration Setup Subsystem.
`It provides users with the capability to Setup the configura
`tion or device interconnections of the network System in a
`first time out of the box initial setup mode or the capability
`to change/modify/delete existing configurations in an edit
`mode. In the initial Setup mode, the user is provided with a
`pre-Set configuration of IRC device input connections on the
`PDCU and instructed to connect the IRC devices to the
`PDCU accordingly. The user then logs in each IRC device
`within the network system and the control system builds a
`device list and device connection database. If the network
`system includes IRC devices interconnected to the PDCU
`through other input connections, the user may enter the edit
`mode of the Subsystem to customize the input connections of
`Such devices as well as delete individual device or entire
`System configuration data. The navigation through the con
`figuration Setup Subsystem is text and Screen driven. In an
`alternative, navigation through the configuration Setup Sub
`System may be by Voice recognition or the configuration
`Setup Subsystem may be graphically driven.
`In yet another innovative aspect, the control System
`preferably enables IR signal pass-through control of non
`supported IRC devices within the network system, while
`avoiding IR signal jamming. Avoidance of IR signal jam
`ming may be accomplished by appropriate Signal transmis
`Sion gapping control or through a gated control System.
`Preferably, the gated pass-through control System includes a
`gate mechanism that controls the pass-through of IR signals
`to the non-supported IRC devices. An IRC device controller,
`which is adapted to translate remote commands into mes
`Sages containing device appropriate IR code for Supported
`IRC devices, controls the operation of the gate. AS Such, the
`IRC controller preferably maintains the gate in a closed State
`as the IRC controller transmits device specific IR code
`messages to Supported devices. When Such transmissions
`are complete, the IRC controller may transition the gate to
`an open State to allow IR signals to freely pass to non
`Supported devices.
`Other aspects and features of the present invention will
`become apparent from consideration of the following
`description taken in conjunction with the accompanying
`drawings.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a diagram showing an example of a device
`interconnect configuration for a home theater network Sys
`tem of the present invention.
`FIG. 2A is a Schematic showing an example of a home
`theater network System of the present invention comprising
`a television having a variety of IRC and 1394 AV devices
`connected to the television. A graphical user interface of the
`control System of the present invention is shown on the
`display of the television providing Visual recognition of the
`current System State, user navigation through device and
`audio menus, device connection options, and active device
`connections.
`
`

`

`S
`FIG. 2B is a schematic showing the home theater network
`system provided in FIG. 2A. The graphical user interface of
`the control system shown on the display of the television
`provides visual recognition of current System State, user
`navigation through device and audio menus, device connec
`tion options, and active device connections.
`FIG. 2C is a schematic showing the home theater network
`system provided in FIG. 2A. The graphical user interface of
`the control system shown on the display of the television
`provides visual recognition of current System State, user
`navigation through device and audio menus, device connec
`tion options, and active device connections.
`FIG. 2D is a schematic showing the home theater network
`system provided in FIG. 2A. The graphical user interface of
`the control system shown on the display of the television
`provides a device appropriate control (transport) menu for
`operation of a Selected device.
`FIG. 2E is a schematic showing the home theater network
`system provided in FIG. 2A. The graphical user interface of
`the control system shown on the display of the television
`provides PIP device connection options.
`FIG. 2F is a graphical representation of a preferred
`embodiment of the graphical user interface of the control
`System of the present invention.
`FIG. 3A is a schematic of a remote control and a television
`in accordance with the present invention.
`FIG. 3B is a schematic of the remote control and an
`alternative embodiment of the television shown in FIG. 3a
`including IR pass-through circuitry.
`FIG. 3C is a schematic of a remote control and a primary
`display and control unit in accordance with the present
`invention comprising a television and a separate HTNS
`controller.
`FIG. 3D is a schematic of a remote control and a primary
`display and control unit in accordance with the present
`invention comprising a monitor or display and a separate
`HTNS controller.
`FIG. 4 is a plan view of a remote control for the home
`theater network System of the present invention.
`FIG. 5 is a schematic of a control system for the home
`theater network System of the present invention.
`FIG. 6 is a schematic of a user interface module of the
`control System of the present invention.
`FIG. 7A is a diagram showing a device log in menu for a
`Setup configuration Subsystem of the present invention.
`FIG. 7B is a diagram showing a preferred embodiment of
`the device log in menu.
`FIG. 8 is a diagram showing a device connection review
`menu for the Setup configuration Subsystem.
`FIG. 9A is a diagram showing a finish menu for the setup
`configuration Subsystem.
`FIG.9B is a diagram showing an edit menu for the setup
`configuration Subsystem.
`FIG. 9C is a diagram showing a device connection
`customization menu for the Setup configuration Subsystem.
`FIG. 10 is a diagram showing a menu for initiating
`recording or peer-to-peer connections.
`FIG. 11A is a Schematic of an IR signal pass-through and
`control System of the present invention.
`FIG. 11B is a schematic of an alternate embodiment of the
`IR signal pass-through and control System.
`FIG. 12 is a schematic of a remote control and television
`for the home theater network System of the present invention
`with an IR pass-through and control System incorporated
`therein.
`
`6
`FIG. 13 is a schematic of a control system for the home
`theater network system of the present invention with an IR
`pass through and control System incorporated therein.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`Referring in detail to the figures, novel apparatus,
`methods, and Systems for centrally and uniformly control
`ling the operation of a variety of devices over a variety of
`protocols within a network System are described. In
`particular, a control System and user interface that provide
`uniform, SeamleSS and transparent centralized control of a
`network of devices over a variety protocols are described. It
`will be understood by those skilled in the art that numerous
`configurations of a network System in accordance with the
`present invention are possible. For example, a network
`System may comprise a mix of communication devices,
`consumer electronic Systems, audio/video (A/N) devices,
`high and low speed devices, analog and digital devices,
`globally and locally controlled devices, and AV and non-AV
`devices, and the like, and may comprise both analog IR
`controlled and digital 1394 AV and other input-type devices.
`For exemplary purposes only, the apparatus, Systems and
`methods in accordance with the present inventions will be
`described primarily in the context of a Home Theater
`Network System (HTNS).
`In a preferred embodiment, a HTNS in accordance with
`the present invention comprises a primary display and
`control unit (PDCU), which functions as the hub or com
`mand center of the HTNS, and a mix of IR controlled
`(analog) and 1394 (digital) AV devices, and other inputs.
`The AV devices and other inputs may be interconnected in
`a variety of ways to each other and to the PDCU. The PDCU
`preferably includes an integrated control System with a
`graphical user interface (UI) for making connections
`between components of the HTNS and controlling their
`operation. The control System provides the user with cen
`tralized control of all of the Supported devices in the HTNS
`and, in an alternative embodiment, enables pass-through
`control of non-Supported devices while avoiding Signal
`jamming.
`Preferably, the PDCU comprises an AV system such as a
`television and, more preferably, a digital television (DTV),
`comprising appropriate circuitry and programmable logic
`for operation of a control System in accordance with the
`present invention. Alternatively, the PDCU may comprise a
`primary display unit such as a TV or a “dumb' monitor or
`display, and a dedicated controller or a computer housed in
`a separate chassis from the primary display unit and com
`prising appropriate programmable logic for operation of a
`control System in accordance with the present invention. For
`exemplary purposes only, however, the description that
`follows primarily describes the present inventions with
`regard to a DTV.
`Preferably, the control system of the present invention
`integrates IEEE 1394 and EIA-775 technology as well as the
`Home Audio Video Interoperability (HAVi) networking soft
`ware technology and AV/C, which compliment IEEE 1394
`technology. The control System also preferably incorporates
`a bi-directional 1394 bus interface, which is compliant with
`IEEE 1394-1995 and IEC 61883-1, exchanges MPEG-2
`video with other devices in accordance with IEC 61883-4, at
`HD and SD resolutions as described in IEC61883-2, 3, 4,
`and exchanges digital audio as described in IEC 61883-6,
`which specifications are all incorporated herein by refer
`ence. The control system also preferably functions as a 1394
`
`US 6,930,730 B2
`
`1O
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`US 6,930,730 B2
`
`15
`
`25
`
`7
`bus cycle master, as defined in IEEE 1394-19958.3.1.4, a
`bus manager, as defined in IEEE 1394-19958.3.1.6, and an
`isochronous resource manager, as defined in IEEE 1394
`19958.3.1.5, provides higher-level 1394 interfaces to open
`cable and other AV/C devices