USOO7200683B1
`
`(12) United States Patent
`Wang et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,200,683 B1
`Apr. 3, 2007
`
`(54)
`
`(75)
`
`(73)
`
`(*)
`
`(21)
`(22)
`
`(60)
`
`(51)
`
`(52)
`(58)
`
`(56)
`
`DEVICE COMMUNICATION AND CONTROL
`IN A HOME NETWORK CONNECTED TO
`AN EXTERNAL NETWORK
`
`Notice:
`
`Inventors: Dongyan Wang, Santa Clara, CA (US);
`Richard Humpleman, Fremont, CA
`(US)
`Assignee: Samsung Electronics, Co., Ltd.,
`Suwon (KR)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 861 days.
`Appl. No.: 09/63
`3.289
`Filed:
`Aug.
`4, 2000
`Related U.S. Application Data
`Provisional application No. 60/166,602, filed on Nov
`19, 1999, provisional application No. 60/149.515.
`filed on Aug. 17, 1999.
`Int. Cl
`we
`(2006.01)
`G06F 5/16
`U.S. Cl. ....................... 709/250; 715/734; 725/141
`Field of Classification Search ................ 709/218,
`709/200 203, 217, 219, 220 227, 250; 34.5/519–520;
`715/716,719, 733 738; 725/37, 141
`See application file for complete search history.
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,031,543 A
`
`1977 Holz
`6.
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`EP
`
`841 10755.0
`
`9, 1984
`
`OTHER PUBLICATIONS
`
`Y. Takabatake et al., "A Testbed for Home Network based on
`IEEE1394.” The Institute of Electronics, Information and Commu
`nications Engineers, Technical Report of IEICE IN98-43, Jul. 1998,
`vol. 98, No. 181.
`
`(Continued)
`Primary Examiner Moustafa M. Meky
`(74) Attorney, Agent, or Firm—Kenneth L. Sherman, Esq.;
`Michael Zarrabian, Esq.; Myers Dawes Andras & Sherman,
`LLP
`(57)
`
`ABSTRACT
`
`A method for providing user interfaces in a first network
`including first devices interconnected via a communication
`medium and an interface device connecting the first network
`to a second network having interconnected second devices
`providing services. The user interfaces are for controlling
`the devices that are currently connected to the first network
`and communication with devices that are currently con
`nected to the second network. The method includes: (a)
`obtaining information from first devices currently connected
`to the first network, the information including device infor
`mation; (b) obtaining information from second devices via
`the interface device, about the services of second devices
`connected to the second network; (c) generating a USC
`interface description in one or more of the first devices based
`on the obtained information. The user interface description
`in each first device includes: (1) a reference associated with
`the device information of each of the first devices, and (2)
`a reference associated with the service information of each
`of the second devices. A user interface is displayed based on
`each user interface description on a device connected to the
`first network capable of displaying a user interface, for user
`control of the first devices and communication with the
`second devices. Displaying each user interface is based on
`using each reference in the corresponding user interface
`description to access the associated information in each
`device; generating the user interface including device and
`service corresponding to each device using the accessed
`information in each device; and displaying the user inter
`face.
`
`(Continued)
`
`53 Claims, 17 Drawing Sheets
`
`22
`
`-
`
`HCP
`
`- 134 SERIA 8US
`HTTP/IP 114
`
`OTW S HUMAN
`102 - NTERFACE
`
`Tw
`3.
`
`2
`
`PRXY
`
`18
`
`s
`
`Owcr
`
`20
`
`HOME AUTOMATION
`Network
`18
`aroce
`ETHERNET
`
`17
`
`g
`
`15- Ely
`NETWORK
`
`Roku EX1019
`U.S. Patent No. 10,334,311
`
`

`

`US 7,200,683 B1
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`8, 1989 Barall
`4,860,006 A
`9/1993 Grandmougin
`5,249,043 A
`3/1994 Faulk, Jr. et al.
`5,293,635 A
`9, 1994 Moura et al.
`5,347,304 A
`2f1995 Look et al.
`5,387,927 A
`2/1995 Lepley et al.
`5,389,963 A
`2f1995 Oman et al.
`5,392,033. A
`9, 1995 Eisenhandler et al.
`5,452.291 A
`1/1996 Majeti et al.
`5.488.412 A
`8/1996 Fling et al.
`5,546,484 A
`5,561,709 A 10, 1996 Remillard
`5,572,643 A 11/1996 Judson
`5,579.308 A * 11/1996 Humpleman ................ 370,352
`5,612,730 A
`3, 1997 Lewis
`5,826,000 A 10, 1998 Hamilton
`5,886,732 A
`3/1999 Humpleman
`5,940,072 A
`8/1999 Jahanghir et al.
`5,940,387 A
`8/1999 Humpleman
`6,005,861. A 12/1999 Humpleman
`6,011,909 A *
`1/2000 Newlin et al. .............. 709,227
`6,020,924 A
`2/2000 Jahanghir
`6,032,202 A
`2/2000 Lea et al.
`6,037.933 A
`3, 2000 Blonstein et al.
`6,052,750 A
`4/2000 Lea
`6,078,783 A
`6/2000 Kawamura et al.
`6,085,236 A
`7, 2000 Lea
`6, 101499 A
`8, 2000 Ford et al.
`6,101,530 A * 8/2000 Rosenberg et al. ......... TO9,203
`6,175.362 B1
`1/2001 Harms et al.
`6,181,333 B1
`1/2001 Chaney et al.
`6,182,094 B1
`1/2001 Humpleman et al.
`6,188,397 B1
`2/2001 Humpleman
`6, 191,781 B1
`2/2001 Chaney et al.
`6,466,971 B1 * 10/2002 Humpleman et al. ....... TO9.220
`6,560,221 B1* 5/2003 Hara et al. .................. 370,352
`6,563.430 B1* 5/2003 Kemink et al. ... 340/825.49
`6,700,592 B1* 3/2004 Kou et al. .................. 715,771
`6,941,340 B2 * 9/2005 Kim et al. .................. 70020
`2001.0053274 A1* 12, 2001 Roelofs et al.
`38646
`2002/0046403 A1* 4/2002 Kim et al. .................... 7.2537
`FOREIGN PATENT DOCUMENTS
`
`
`
`EP
`EP
`
`903052132
`914O1245.5
`
`5, 1990
`5, 1991
`
`6, 1996
`96304709.3
`EP
`9, 1996
`96306507.3
`EP
`9, 1996
`963072004
`EP
`10, 1996
`961 16873.9
`EP
`1, 1997
`971.00356.1
`EP
`10, 1997
`97117812.4
`EP
`4f1998
`O 838 768
`EP
`10, 1997
`9-261355
`JP
`10, 1997
`9-282263
`JP
`12/1997
`O9-325925
`JP
`5, 1998
`10-145773
`JP
`6, 1998
`10-149270
`JP
`3, 1999
`11-884.06
`JP
`7, 1999
`11-194987
`JP
`11, 1999
`11-317756
`JP
`12/1999
`11-355.294
`JP
`12/1999
`11-355.357
`JP
`4/2002
`2002-5104.15
`JP
`1, 1995
`WO PCT/EP95/OO.191
`1, 1995
`WO PCT/US95.00354
`12/1995
`WO PCT/US95/17108
`11, 1996
`WO PCT/US96, 18798
`5, 1997
`WO PCT/US97/08490
`5, 1997
`WO
`WO97, 18636 A2
`12/1998
`WO
`WO9859282
`WO
`WO 98.59282 A2 12, 1998
`WO
`WO 99 57839
`11, 1999
`
`OTHER PUBLICATIONS
`
`T. Saito et al., "Homenetwork Architecture Considering Digital
`Home Appliances.” The Institute of Electronics, Information and
`Communications Engineers, Technical Report of IEICE, IN97-128,
`Nov. 1997, pp. 57-64, vol.97, No. 368.
`Y. Takabatake et al, A Proposal of an Inter-Networking for the
`Residential Network, The Institute of Electronics, Information and
`Communications Engineers, Technical Report of IEICE, SSE97-19.
`N97-19. Apr 1997, pp. 73-79, Vol.97. No. 4.
`K. Teramoto et al., “Design and Implementation of Home Gateway,
`Integrated Control of Digital ComSumer Appliances.”99-DPS-92,
`ISSN 0919-6072, Feb. 26, 1999, pp. 97-102, vol. 99, No. 18.
`P. Johansson, “IPv4 over IEEE 1394.” RFC2734, http://www.faqs.
`org/ftp/irfc/pdfrfc2734.txt.pdf.
`K. Fujisawa, “DHCP for IEEE 1394.” RFC2855, http://www.facs.
`org/ftp/irfc/pdfrfc2855.txt.pdf.
`* cited by examiner
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 1 of 17
`
`US 7,200,683 B1
`
`12
`
`18
`
`HUMAN
`
`
`
`
`
`/ CENT
`
`
`
`
`
`FIG. 1
`
`COMMANDS
`COMMUNICATION
`
`COMMANDS
`COMMUNICATION
`
`
`
`
`
`
`
`
`
`
`
`
`
`/
`
`SERVICE
`CONTROL
`PROGRAM
`SERVER
`
`SERVICE -14.
`CONTROL
`PROGRAM-2
`
`11
`
`SERVER
`
`14
`
`
`
`
`
`SERVICE
`CONTROL
`PROGRAM
`/ SERVER
`11
`
`
`
`2O
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 2 of 17
`
`US 7,200,683 B1
`
`FIG. 2
`
`122
`
`
`
`ACCESS
`NETWORK
`
`ACCESS
`NETWORK
`
`OBS ACCESS
`1 O9
`-
`CABLE/MODEM
`ACCESS 1 O7
`
`11
`1
`
`11
`Y
`
`N DVD
`1 O8.
`
`-14
`
`1 N PC
`1 O5
`
`1 394 SERAL BUS
`HTTP/IP 114
`
`12
`
`DTV N HUMAN
`1 O2 N INTERFACE
`
`12
`
`11
`DTV
`1 O3
`
`/
`11
`PROXY
`
`1 16
`
`11
`M
`DVCR
`
`12O
`
`11
`N DVCR
`11 O
`
`14
`
`/
`HOME AUTOMATION
`NETWORK (e.g. X10)
`118
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 3 of 17
`
`US 7,200,683 B1
`
`
`
`NOIIVINGSBèld
`
`79 I }} B)\\7Tl
`
`NOISSES
`
`
`
`èJE „?VTI
`
`83Ay?
`
`OG I NJENJËS
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 3, 2007
`Apr. 3, 2007
`
`Sheet 4 of 17
`Sheet 4 of 17
`
`US 7.200,683 B1
`US 7,200,683 B1
`
`II|I|lIII|j1||||||l{|\||||\\|||J|
`
`
`
`LINSWNS00IWLH
`
`
`
`NOOO}HLIM
`
`SOIHdVYD
`
`NOILVYSLIV
`
`IND
`
`
`
`‘ddy3OIANaS
`
`/QNYOOSYOIdN®NaAN3S
`GSMr6E1
`
`NOILOV
`
`
`
`80¢INIHOVN902
`
`‘ddyALG NOILOY
`
`
`
`OACIADIAdW
`
`
`
`JOYNOSWV3SYLS
`
`
`
`LYOdSNVULS3dW>
`
`
`
`WVIULSO3CIA
`
`OACIAD4dW
`
`QNV300930
`
`AW1dSIG
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ISNOdSAU>
`
`OW
`
`COLMYOMLM3N
`
`YdISNVYL
`
`In
`
`Vb‘OIA
`
`<NOILOV
`
`GIMVES|
`
`LNAN9
`
`YISMONG
`
`IND
`
`"WOW
`
`002
`
`CLC
`
`INIHOVIN
`
`YIISNVYL
`
`
`
`IN3WN9DC0IWLH
`
`
`
`NOOIHLIM
`
`SIIHdVeD
`
`NOILWASL1V
`
`IND
`
`NOILOV>
`
`D4AdW¥YAANSSG4AMvb6E|
`
`<ISNOdS3Y
`
`OJQIA
`
`SOIANSS
`
`Leee
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 5 of 17
`
`US 7,200,683 B1
`
`[|7||1||319NOD9°3a4i||31dHave||WLHNOO![||IaJ
`|{i314IWLH"3WYN
`11139NOLOI|53014ptLateSew)LHOSon
`,WLH’XSGNI,!a|inTOI
`Y3HLO|ONY
` ||J|itjJ1tt||t!NOLWY3LTVZ0Z!
`
`
`
`ty¥O4JQVINSLNITOMLNODitSHLS314
`“200
`!||‘ddyANSduy/O34y
`
`
`
`‘ddy39IANSSAVIdIy
`/QHOD3YD3dW#Y3IAN39
`
`GIMPEEL
`DeJ__L-—~-~~-~-ne
`SUIISNVULINDY¥3SMOYUG“ddvVALOAMSO3QIA|3inIN3MDYO3
`
`
`
`
`001HYOMLINALO
`
`
`
`
`
`wougauiannisJSNOdS34>SSNOSSBE]“SelALG,“aoIANaSA“SNOLLOVfe
`JOWIYSLNIIONLNOD|Ly}«=GIMPEEL
`
`
`
`
`39vdLInvs3aq|NOWov>YIANIOGIMPECL
`WV“ov
`+-gor|WLH'NODIJdDIHAWHD||t|Uaevoain1d|1|AYOLOZYIO1|S3LVvy3N393144I9NO319°3||1;|aavMLJOS
`
`
`
`|oa|ItW1H"3WVN
`beeendLSTEOneI314WHi11|AYOLOSMIO™NH
`,ALH'X3QNI,||~||NWWd|I4ID09019°3|tfeeTNyo
`BHLS374‘900NAHLO
`
`
`
`O30\AD3dW
`
`
`
`3OYNOSWV3YLS
`
`
`
`LYOdSNVYLIGdn>
`
`
`
`WVIULSO3QIA
`
`AWIdSIOONY300930
`
`
`
`O3QIAD3dnW
`
`
`
`8023NiHOWN
`
`NOILDY
`
`rc|
`
`HONNVILY
`
`SMOHS
`
`qr“OL
`
`ONV
`
`NOLLOV
`
`WNIHOYN«OLE
`
`Indfi.
`
`,
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 3, 2007
`Apr.3, 2007
`
`Sheet 6 of 17
`Sheet 6 of 17
`
`US 7,200,683 B1
`US 7,200,683 B1
`
`
`TL)Tet
`Li
`ik
`
`/name.htm /icon.Atm
`
`
`Cl
`
`
`
`
`
`o F
`
`IG.
`
`
`
`
`
`
`
`
`
`
`
` EXAMPLENETWORKTOP-LEVELDEVICESGUI
`
`©NN
`
`O
`CN
`CN
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 7 of 17
`
`US 7,200,683 B1
`
`lo
`
`LYIGOOWNVO
`
`9‘Olu
`
` INDSAOIAIO
`
`
`
`
`SOIAACVISJOIAIGDINOSWNVd}}JDIAIGVWIOYOLONJOIASOVIS
`
`
`
`
`DaveyTYBesTENpUYB;UCN12003prirarsouatiiysoutsnpul210410013
`
`
`WGA31—-dOlHYOMLSNJOJIdWVX3SAILVNYSLIW
`
`ANOS
`
`
`
`3DIAI0ANOS
`
`Oc?
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 8 of 17
`
`US 7.200,683 B1
`
`FIG 7
`
`122
`
`
`
`DVD
`1 O8.
`
`105.
`
`V DVCR
`1 1 O
`
`14
`
`1 394 SERAL BUS
`HTTP/IP 114
`
`DTV
`1 O2
`
`INTERFACE S
`
`HUMAN
`
`I-12
`
`DTV
`1 O3
`
`PROXY
`116
`
`DVCR
`12O
`
`HOME AUTOMATON
`NETWORK 118
`BUS
`BRIDGE | f | ETHERNET
`117
`1 19
`
`CABLE-TV
`115 KWOR
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 9 of 17
`
`US 7,200,683 B1
`
`
`
`v-JDIAIGv6CL
`
`V6CLN 8“O14
`
`‘dOHMS
`
`(y-Suavdi)
`
`JIANOQJOLAV
`
`VECL®VECLN
`
`SAIOIAIIA
`
`CcK<
`
`-dOHM4
`
`(¢-S3yavdl)
`
`dOHOLJOIAIO
`YSANSS
`
`
`
`
`
`ISM4VI1-LxX3
`
`
`
`MYOMLINVOELAYOMLANV6EL-NON
`
`tC~SuGvdiL—-SuaVdl
`
`
`
`
`
`INSWS9VNVYASSSYCOVYOSOINVNSDSHYOMLSANP6EL—-NONONV76EL
`
`
`
`
`
`
`
`/ININMOdOHO
`
`OIINODOLNY
`
`>>>
`
`
`
`S-3JOIAS0v6el
`
`‘dHOMSI
`
`S~SYQVdl
`
`
`/LN3IND
`
`dOHaZJOIAIGP6CUN
`
`QISINODOLNV
`
`DLL
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 10 of 17
`
`US 7,200,683 B1
`
`
`
`
`
`
`
`
`
`| N30\7' 0} + NOO CHÍ HLIW SBOHAEC
`
`
`
`(VOC) INBOW
`
`
`
`(VOC) INBOW
`
`V6 * 0IJI
`
`NAWO NI \/ IV/C]
`
`NNW O NI VIVO
`
`TTV NI VIVO
`
`
`SEO IAEO 769 ||
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`X!? JONALEN 769 ||
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 11 of 17
`
`US 7,200,683 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`06 * #0IJI
`
`NWO NI VIVO
`(WOB) 762 ||
`
`0 | +7
`
`
`
`(BWVN 'NOOI)
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 12 of 17
`
`US 7.200,683 B1
`
`FIG 10
`
`5OO
`
`1394 DDA-
`DEVICE DISCOVERY
`
`NO
`
`GO
`DORMANT
`
`51 O
`
`
`
`
`
`LIST OF P
`ADDRESSES
`WITH P-C REGS.
`
`504
`
`1394 DDA
`ENDED?
`YES 506
`
`READ EUI-64's
`FROM ALL
`DEVICES
`
`
`
`
`
`CHECK FOR SELF
`BEING HIGHEST BIT
`REVERSED EUI-64
`
`512
`
`READ IP-CONTROL
`REGISTER AND
`ACTIVE P. ADDRESS
`FROM ALL 1394 (DEVICES
`
`
`
`
`
`MAKE UIST OF
`ACTIVE IP-ADDRESSES
`WITH IP-CTL REGS.
`
`READ EXTENSION
`IP-ADDRESS FROM
`DEVICES ON BRIDGED/
`ROUTED NETWORKS
`
`516
`
`CHECK EACHIP
`ADDRESS FROM LIST
`AGAINST REST OF
`LST FOR COLLISION
`
`WRITE ASSIGNED
`P-ADDRESS TO
`DEVICE AND
`WRITE IP-CONTROL
`REG (ASSIGNED EP
`ADRS AND IR-ADRS
`
`SELECT NEW IP-ADDRESS
`WITH HELP FROM LIST DATA:
`P-ADRS AND P-CTL REG
`(1) LOCK BIT,
`(2) BUILT-IN OR ASSIGNED?
`(3) BRIDGED OR 1394
`
`528
`
`AT ENDN
`OF LIST?
`
`YES
`
`C END O
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 13 of 17
`
`US 7,200,683 B1
`
`FIG. 11
`
`
`
`
`
`
`
`
`
`
`
`
`
`READ CONTROL BITS
`DEFINED IN 1394
`ROM SPACE
`
`READ IP ADDRESS LIST
`
`6OO
`
`6O2
`
`
`
`
`
`GENERATE HN
`DIRECTORY PAGE
`
`SEND TO DISPLAY (FOR
`EXAMPLE, BROWER)
`
`
`
`608
`
`RETRIEVE ICON.HTM
`NAME.HTM, LOGO, HTM
`FROM EACH DEVICE
`CONNECTED IN THE HN
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 14 of 17
`
`US 7,200,683 B1
`
`
`
`
`
`
`
`NO|[d]&#9S3C] In SBOIAGO TENGT – GO1 XNOMIEN JO MBIA TVIHOLOICH ETBWwXE
`
`
`
`
`
`WO || Z.
`
`OGZ
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 15 of 17
`
`US 7.200,683 B1
`
`WOO-JOE8
`èJELSWW A|CH
`
`
`
`
`
`
`
`
`
`890/
`
`8/0/
`
`£I ‘5)IJI
`
`OZ
`
`ZZ / | Z/
`
`80 | /
`
`890/
`
`8 Z I A
`
`OZZ
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 16 of 17
`
`US 7,200,683 B1
`
`v-ADIAAOV6EL DIANOOSOLNV/LN3I19
`G-AOIAACP6ELSIINOOOLNV/LNANOdOHO
`
`
`
`dOHGéADIAACV6ELNTANASINI
`
`(p-SUavdl)S0IA30
`
`
`
`‘OHMy6EL8PEELN
`
`
`
`LASDIAACV6ELN
`
`
`
`VJIANOQVOLAV/HAAYASdOHO
`
`
`
`<<p6E|JO4
`
`<dOHMS
`
`(€-SHQVdl)
`
`SITAVAT-LXS
`
`‘dOHMS
`
`(S-SYavdl)
`
`-AVMALV9
`
`(ZSYavdl)
`
`
`
`P6ELUONJO4>>
`
`MYOMLANP6EL
`
`
`(Z-SHavdl)
`(L-SYavdl)
`
`MYOMLANV6EL-NON
`
`
`
`JUaWaGeUeWSSa!PPRJO}OBUB9DSWOMANPGEL-UONpuePEEL
`
`
`
`
`
`
`
`Vt“OIA
`
`

`

`U.S. Patent
`
`Apr. 3, 2007
`
`Sheet 17 of 17
`
`US 7,200,683 B1
`
`800
`
`
`
`802
`
`
`
`804
`
`
`
`806
`
`
`
`808
`
`
`
`
`
`
`
`
`
`
`
`810
`
`Retrieve files from
`home portal,
`logoiconX.htm,
`logonameX.htm.
`
`
`
`
`
`
`
`UDGA Process
`Start
`
`Read Control bits
`defined in 1394
`ROM space
`
`Read IP address list
`of devices in this
`Home NetWork
`
`Get Home POrta IP
`address
`
`Generate HN
`directory Page (top
`level GUI) including
`external links
`
`
`
`Send to Display (for
`example, browser)
`
`814
`
`FIG. 15
`
`812
`
`Retrieve icon.htm,
`name.htm, logo.htm
`from each device
`Connected in the HN
`
`

`

`US 7,200,683 B1
`
`1.
`DEVICE COMMUNICATION AND CONTROL
`IN A HOME NETWORK CONNECTED TO
`AN EXTERNAL NETWORK
`
`2
`manufacturers have developed control units for controlling
`and commanding their home devices from a single interface.
`One drawback associated with using the remote control
`unit to command and control home devices is that it provides
`static and command logic for controlling and commanding
`each home device. Therefore, a particular remote control
`unit can only control and command those home devices for
`which it includes the necessary control and command logic.
`For example, if a remote control unit comprises logic for
`controlling a television (TV), a video cassette recorder
`(VCR), and a digital video device (DVD), but not a compact
`disk (CD) unit, the remote control unit can not be used to
`command and control the CD unit. In addition, as new home
`devices are developed, the remote control unit will not be
`able to control and command the new home devices that
`require control and command logic that was not known at
`the time the remote control unit was developed.
`Further, typically a remote control unit can only be used
`to command and control those home devices that are within
`the signal range of the remote control unit. Therefore, a user
`cannot use the remote control unit from a single location in
`the house to control and command home devices that are
`interconnected, but located in separate areas of the home.
`For example, a VCR that is located upstairs in a bedroom
`may be connected to a TV that is downstairs in the family
`room. If a user wishes to play a tape contained in the VCR
`located upstairs in the bedroom, on the TV located down
`stairs in the family room, the user cannot control and
`command both the TV and the VCR from a single location.
`Another drawback associated with using remote control
`units is that known remote control units cannot control a
`plurality of diverse devices, and more particularly, cannot
`control a plurality of devices having different capabilities to
`communicate with each other in order to accomplish tasks or
`provide a service. Further, conventional network systems do
`not provide a mechanism for Software applications in dif
`ferent network devices to automatically communicate with
`one another in order to accomplish tasks without direct user
`command.
`To alleviate the above problems, some network models
`provide a central/singular user interface (UI) in one device
`including static device information for networked devices
`for user control of network devices. However, in such
`networks a change to device information (e.g., ICON) in a
`device requires a change to, and rebuilding of the top level
`page. Further, if the device displaying the central user
`interface becomes unavailable, user control of the network
`is curtailed. Another problem with the central/singular page
`is that every UI device must display the same page, and a
`Scope is not provided for each manufacturer to generate its
`own UI look and feel nor alter the technology used in the UI
`device. The content of an icon/information representing a
`device cannot be changed, and a UI device cannot display a
`more prominent look to a device icon Such as the icon for the
`UI device itself. Nor can a UI builder tool obtain e-business
`icons from an external Web Portal. Such a model cannot be
`standardized for industry use because a central/single UI
`device controls the UI.
`Further, existing networks only allow communication and
`control of devices connected to a network (e.g., 1394) using
`said central user interface, without the ability to provide user
`interface and control of devices and services connected to
`another different network (e.g., Internet).
`There is, therefore, a need for a method and a system
`which provides dynamic control and command devices in a
`home network. There is also a need for such a method and
`system to provide the ability for accessing devices con
`
`CROSS-REFERENCES TO RELATED
`APPLICATIONS
`
`Applicants claim the benefit of U.S. Provisional Applica
`tion No. 60/149,515 entitled “External Web Server Included
`in Home Network Top-Level User Interface Description.”
`filed on Aug. 17, 1999, and U.S. Provisional Application No.
`60/166,602 entitled “Regional Service Support for Home
`Network Top-Level Home Page and External Device Manu
`facturer's Portal Services, filed on Nov. 19, 1999 which
`applications are incorporated herein by reference.
`
`10
`
`15
`
`NOTICE OF INCLUSION OF COPYRIGHTED
`MATERIAL
`
`A portion of the disclosure of this patent document
`contains material which is subject to copyright protection.
`The copyright owner has no objection to the facsimile
`reproduction by anyone of the patent disclosure, as it
`appears in the Patent and Trademark Office patent files or
`records, but otherwise reserves all copyright rights whatso
`eVe.
`
`25
`
`FIELD OF THE INVENTION
`
`The present invention relates to the field of networks, and
`more particularly, to home networks having multi-media
`devices connected thereto.
`
`30
`
`BACKGROUND OF THE INVENTION
`
`35
`
`A network generally includes a communication link and
`various devices with communication capability connected to
`the communication link. The devices include computers,
`peripheral devices, routers, storage devices, and appliances
`with processors and communication interfaces. An example
`of a network is a home network for a household in which
`various devices are interconnected. A usual household can
`contain several devices including personal computers and
`home devices that are typically found in the home. As Such
`the term “device' typically includes logical devices or other
`units having functionality and an ability to exchange data,
`and can include not only all home devices but also general
`purpose computers. Home devices include Such electronic
`devices as security systems, theater equipment, TVS, VCRs,
`Stereo equipment, and direct broadcast satellite services or
`(DBSS), also known as digital satellite services (DSS),
`sprinkler systems, lighting systems, micro waves, dish
`washer, ovens/stoves, washers/dryers, and a processing sys
`tem in an automobile.
`In general, home devices are used to perform tasks that
`enhance a homeowner's life style and standard of living. For
`example, a dishwasher performs the task of washing dirty
`dishes and relieves the homeowner of having to wash the
`dishes by hand. A VCR can record a TV program to allow
`a homeowner to watch a particular program at a later time.
`Security systems protect the homeowner's valuables and can
`reduce the homeowner's fear of unwanted entry.
`Home devices, such as home theater equipment, are often
`controlled using a single common control unit, namely a
`remote control device. This single common control unit
`allows a homeowner to control and command several dif
`ferent home devices using a single interface. Thus, may
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`3
`nected to a first network and accessing devices and services
`connected to a second different network, and to indepen
`dently generate different user interface representations of the
`devices connected to the first and of devices and services
`connected to the second network for user control and
`communication.
`
`BRIEF SUMMARY OF THE INVENTION
`
`The present invention satisfies these needs. In one
`embodiment, the present invention provides a method and
`system for providing user interfaces in a first network
`including first devices interconnected via a communication
`medium and at least one interface device connecting said
`first network to at least a second network having intercon
`nected second devices providing services, the user interfaces
`for controlling the devices that are currently connected to the
`first network and devices that are currently connected to the
`second network. The method includes the steps of: (a)
`obtaining information from one or more of first devices
`currently connected to the first network, said information
`including device information; (b) obtaining information
`from one or more of the second devices via the interface
`device, about the services provided by such devices con
`nected to the second network; (c) generating a user interface
`description in one or more of said first devices based at least
`on the obtained information, the user interface description in
`each first device including: (1) at least one reference asso
`ciated with the device information of each of said first
`devices, and (2) at least one reference associated with the
`service information of one or more of said second devices.
`Further, a user interface is displayed based on each user
`interface description on a device connected to the first
`network capable of displaying a user interface, for user
`control of said first devices and communication with said
`second devices. Displaying each user interface is based on
`using each reference in the corresponding user interface
`description to access the associated information in each first
`device, and associated service information in each second
`device; generating the user interface including information
`corresponding to each device using the accessed information
`in each device; and displaying the user interface on said
`device capable of displaying a user interface.
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`45
`
`These and other features, aspects and advantages of the
`present invention will become better understood with regard
`to the following description, appended claims and accom
`panying drawings where:
`FIG. 1 shows an example block diagram of the architec
`ture of an embodiment of a network according to the present
`invention;
`FIG. 2 shows an example block diagram of the architec
`ture another embodiment of a network according to the
`present invention;
`FIG. 3 illustrates an example of a layered interface model
`that can be used for communicating between home devices
`in accordance with the present invention;
`FIG. 4a shows an example architecture diagram of a
`DVCR server device replaying video to a DTV client device
`capable of displaying a user interface, in a network accord
`ing to the present invention;
`FIG. 4b shows another example architecture diagram of a
`server device communicating with a client device capable of
`displaying a user interface, in a network according to the
`present invention;
`
`50
`
`55
`
`60
`
`65
`
`US 7,200,683 B1
`
`4
`FIGS. 5–6 illustrate example top-level GUIs representing
`the functions of networked devices to a user;
`FIG. 7 shows an example block diagram architecture of a
`home network constructed in accordance with another
`embodiment of the present invention;
`FIG. 8 shows an example process according to the present
`invention for communication between a 1394 network and a
`non-1394 network for IP address configuration;
`FIGS. 9a–c show example functional block diagrams of
`connections to data and control bits of an embodiment of a
`discovery system architecture in a network according to
`another aspect of the present invention;
`FIG. 10 shows an example flow diagram for discovery
`and configuration agents in the home network in connection
`with the functional block diagrams in FIGS. 9a–c.
`FIG. 11 shows an example flow diagram for user interface
`description generator agent in the home network in connec
`tion with the functional block diagrams in FIGS. 9a–c.
`FIG. 12 shows a pictorial outline of a top level network
`user interface description including links to external Ser
`vices, showing actual icon and name HTML file references
`and addresses, according to another aspect of the present
`invention;
`FIG. 13 shows example top-level GUI representing the
`functions of devices in a home network and services pro
`vided by an external network, based on the user interface
`description of FIG. 12;
`FIG. 14 shows another example process according to
`another aspect of the present invention for communication
`between a 1394 network and a non-1394 network for IP
`address configuration; and
`FIG. 15 shows an example flow diagram for user interface
`description generator agent in the home network for gener
`ating a top level network user interface description including
`links to external services, according to another aspect of the
`present invention.
`Appendices 1–4, illustrative examples for: (1) Top-Level
`Page description 250 (Appendix 1); (2) Background.htm
`(Appendix 2); (3) Icon.htm (Appendix 4); and (4) Name.htm
`(Appendix 4); and
`Appendices 5–12, illustrative examples for the following
`htm files for generating the top level home network user
`interface description and GUI in FIGS. 12–13, wherein:
`Appendix 5 Top-Level Page Example TLNUID (in
`dex.htm) Appendix 6—background.htm example Appendix
`7 icon.htm example AppendiX 8. Example name.htm
`Appendix 9—Example logoicon1.htm Appendix 10 EX
`ample
`logoname1.htm
`Appendix
`11—Example
`logoicon2.htm Appendix 12-Example logoname2.htm
`To facilitate understanding, identical reference numerals
`have been used, where possible, to designate identical
`elements that are common throughout the figures.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`Network Overview
`Referring to FIG. 1, in an embodiment of the present
`invention, a network 10 comprises multiple devices 11
`including at least one client device 12 and at least one server
`device 14 interconnected via a communication link 16. The
`communication link 16 can include a 1394 serial bus pro
`viding a physical layer (medium) for sending and receiving
`data between the various connected home devices. The 1394
`serial bus supports both time-multiplexed audio/video (A/V)
`streams and standard IP (Internet Protocol) communications
`
`

`

`US 7,200,683 B1
`
`5
`(e.g., IETF RFC 2734). In certain embodiments, a home
`network uses an IP network layer as the communication
`layer for the home network. However, other communication
`protocols could be used to provide communication for the
`home network. For example, the invention may be imple
`mented using Function Control Protocol (FCP) as defined by
`IEC 61883, or any other appropriate protocol. Thus, a
`network may generally include two or more devices inter
`connected by a physical layer exchange or transfer of data in
`accordance with a predefined communication protocol.
`Each client device 12 may communicate with one or more
`server devices 14 in the network 10. Further, each server
`device 14 may communicate with one or more other server
`devices 14, and one or more client devices 12, in the network
`10. Each client device 12 can include a user communication
`interface including input devices such as a mouse and
`keyboard for receiving user input, and a display for provid
`ing a control user interface for a user to interact with the
`networked devices. The user interface can include a graphi
`cal user interface (GUI) 18 for providing information to the
`user. Each server device 14 includes hardware as a resource
`in the network for providing services to the user, and can
`further include a server or service control program 20 for
`controlling the server hardware.
`Each server device 14 provides a service for the user,
`except control user interface, and each client device 12
`provides a service including control user interface for user
`interaction with the network 10. As such, only client devices
`12 interact directly with users, and server devices 14 interact
`only with client devices 12 and other server devices 14.
`Example services can include MPEG sourcing/sinking and
`display services.
`In an exemplary embodiment of the present invention, a
`browser based network (e.g., a home network) uses Internet
`technology to control and command devices including client
`devices and server devices that are connected to a network.
`Each device includes device information such as interface
`data (e.g. HTML, XML, JAVA, JAVASCRIPT, GIF, JPEG,
`graphics files, or any other format useful for the intended
`purpose) that provides an interface for commanding and
`controlling of the device over the network. In certain
`embodiments, each device includes device information Such
`as one or more Hypertext markup Language (HTML) pages
`that provide for the commanding and controlling of that
`device. Using the browser technology, the network employs
`Internet standards to render the HTML pages in order to
`provide users with a plurality of graphical user interface
`(GUIs) for commanding and controlling each device. In one
`example, the network is configured as an intranet.
`In one embodiment, a client device comprises a device
`providing control interface service to a human operator,
`including a graphical display hardware for down communi
`cation and a mouse or other point-and-click device for up (or
`return) communication. A server device comprises a module
`Supplying a service, which can be any service other than a
`control interface provided by a client device. As such, the
`server/client device relationship is a control relationship,
`wherein the server device provides a service but a client
`device can use the data, as a DTV displays video data, but
`need not manipulate or alter the data. It is thus consistent
`with this definition to observe that, frequently, a server may
`be a source of information and a client (a browser, for
`example) may be a consumer of information.
`Examples of specific functions which can be implemented
`by server devices include: return of information (data):
`performance of a function (e.g., mechanical function) and
`return of status; return of a data steam and status; reception
`
`40
`
`45
`
`6
`of a data stream and return of status; or saving of a state for
`Subsequent action. Examples of server devices include
`MPEG source, sink and display servers. While a server
`device typically includes a custom, built-in, control program
`to implement control of its own hardware, a client functions
`to interface with the server device. However, server device
`as used herein does not imply that a web server and a
`protocol stack must be used.
`FIG. 2 shows a block diagram of an embodiment of a
`network 100 according to an aspect of the present invention.
`A 1394 serial bus 114, described above, electronically
`connects multiple devices 11 including server devices 14
`(e.g., DVD 108, DVCR 110), client devices 12 (e.g., DTV
`102, 103), Bridge 116, DVCR 120, PC 105, cable/modem
`access 107, and DBS access 109, on the network 100. FIG.
`3 illustrates an example of a layered interface model that can
`be used for communicating between the devices 11 in
`accordance with the present invention. In this example, a
`device (server) 150 communicates with a client device 166
`using one or more of the network commun