United States Patent (19)
`Lewis
`
`III IIII
`USO05612730A
`11
`Patent Number:
`5,612,730
`45) Date of Patent:
`Mar 18, 1997
`
`9
`
`9
`
`54 INTERACTIVE SYSTEM FOR A CLOSED
`CABLE NETWORK
`
`(75) Inventor: Scott W. Lewis, Saratoga, Calif.
`73) Assignee: Multimedia Systems Corporation, San
`Jose, Calif.
`
`4,935,924 6/1990 Baxter ......................................... 348/8
`5,193,208
`3/1993 Yokota et al. ........................... 455/6.3
`5,247,347 9/1993 Litteral et al. ............................ 348/14
`5,318,450 6/1994 Carver ......................................... 348/8
`F
`GNP
`D
`TS
`OREIGN PATENT DOCUMEN
`0488289 6/1992 European Pat. Off. ......... HO4N 7/14
`Primary Examiner-John K. Peng
`Assistant Examiner-John W. Miller
`(21) Appl. No.: 400,245
`Attorney, Agent, or Firm-Benman Collins & Sawyer
`(22
`Filed:
`Mar. 3, 1995
`57 -
`ABSTRACT
`(51] Int. Cl." ........................... H04N 7/14; H04N 7/18:
`H04N 7/00
`A system is provided that enhances the interactivity of
`(52) U.S. Cl. ................................... 3488; 5. 3. multimedia information in a closed cable network such as a
`s
`a 9
`hotel system or the like. The system includes a multimedia
`58) Field of Search ............................... 348/6, 8, 12, 13,
`processing system, a telephone switching system, a video
`348/14, 15, 3, 5; 455/5.1, 6.1, 6.3; H04N 7/14,
`control system, a service operations platform, and a plurality
`7/15, 7/173, 7/16, 7/18
`of interactive devices. This system has the advantage of
`providing compression and/or transmission algorithms to
`maximize enhancement of the multimedia information. The
`system allows for enhanced interactivity within a closed
`cable system with minimum modification to the existing
`network.
`
`(56
`
`References Cited
`U.S. PATENT DOCUMENTS
`4,787,085 11/1988 Suto et al. .................................. 3486
`4,885,747 12/1989 Foglia .............
`4,920,432 4/1990 Eggers et al. ...
`4,926,256 5/1990 Nanba ......................................... 348/8
`
`14 Claims, 27 Drawing Sheets
`
`11 O'
`
`116
`
`TELEPHONE OUTSIDE
`CALLS (VOICE/FAX)
`TELEPHONY
`SWITCHING
`
`
`
`
`
`113
`
`TELEPHONE
`PORTS RNC
`INTERACTIVE
`122
`VIDEO PORT
`
`IMD
`CD
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ACCOUNT
`COMPUTER
`(BILLING/
`MANAGEMENT
`SYSTEM)
`
`
`
`112
`122
`102
`2 114
`MULTIMEDIA 3. oTHER
`PROCESSING RU
`SYSTEM (MPS) S 119
`N 12
`PC
`PC
`
`INTERNET
`VIDEO MENUI
`
`REMOTE 55.
`
`PORT
`
`VIDEO
`CONTROL
`SYSTEM
`
`107
`REMOTE SIGNAL FROM
`ANY TRANSPORT (CABLE,
`TELECO, VDS)
`
`123
`VCR INTERACTIVE
`
`YEAUDIO
`
`122
`
`CHANNES
`VIDEO SWITCHING
`NETWORKSYSTEM
`CABLE HEAD-END
`FEED (IN)
`
`CABLE
`HEAD
`END
`SEP
`(OUT)
`
`
`
`
`
`
`
`
`
`100
`
`Ex.1036
`APPLE INC. / Page 1 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 1 of 27
`
`5,612,730
`
`
`
`14
`
`Telephone
`
`12
`
`HOTEL PBX
`
`TO ROOm TV
`
`
`
`CONTROL SYSTEM
`
`
`
`PRIOR ART
`
`Remote Link
`
`FIGURE 1
`
`Ex.1036
`APPLE INC. / Page 2 of 39
`
`

`

`U.S. Patent
`
`Mar. 18, 1997
`
`Sheet 2 of 27
`
`5,612,730
`
`|Athp>)onissa00udLNNOOOV
`OLTOYNLNOOfY*:7Ol
`
`(LNO)SSHLO3eeiaaaPLLS|VIGaWILINW
`
`
`dNa.ZbL|a5ZZLAGvaH201
`OLLOLLZLFALLOWYSLNI
`
`C=|qo()C)|-|‘S1gVO)LYHOdSNVYLLANV
`s1avooz1|dd|
`
`SAALLOVYSLNISLOWSY|HOA|/NNAWO3CIA
`
`
`OIGNV/OSCIATOYLNOD
`
`BLLL_odfect!_~/ONITHM)|a||—~Si(SdW)WaLSASYALNdWOO
`
`betLNAWAOWNVN
`
`ONIHOLIMSOACIAWALSAS
`
`STANNVHOOACIA
`ecbLANYSLNI|A,S61(WALSAS
`
`3OuNOScelLuOd
`
`WALSASMYOMLAN
`|WI|140dOCIA
`
`GN3-GV3H3198v9ALOL
`
`
`
`(NI)aaaWOUsIVNOISSLOWSY
`
`ACIS.LNOS3NOHd313
`
`
`(SGAI‘OOS1351
`
`(xv4/S9ION)STIVO
`
`ANOHdsaTSL
`
`ONIHOLIMS
`
`Ex.1036
`APPLEINC./ Page 3 of 39
`
`Ex.1036
`APPLE INC. / Page 3 of 39
`
`
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 3 of 27
`
`5,612,730
`
`
`
`FIGURE 2A
`
`Ex.1036
`APPLE INC. / Page 4 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 4 of 27
`
`5,612,730
`
`IMD HeHTEL
`
`102
`
`195
`
`-
`
`500
`
`FIGURE 2B
`
`Ex.1036
`APPLE INC. / Page 5 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet S of 27
`
`5,612,730
`
`110
`
`135
`
`MM
`
`MUX
`
`PC
`
`VCR
`
`CD/ROM
`
`CD
`
`VC
`
`CD/
`
`OTHER
`
`FIGURE 2C
`
`Ex.1036
`APPLE INC. / Page 6 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 6 of 27
`
`5,612,730
`
`137
`
`GMM
`
`IMDo
`
`MDn
`
`MM
`
`MM
`
`FIGURE 2D
`
`Ex.1036
`APPLE INC. / Page 7 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 7 of 27
`
`5,612,730
`
`Program Port
`
`MM
`
`MPS
`
`109
`
`FIGURE 2E
`
`Ex.1036
`APPLE INC. / Page 8 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 8 of 27
`
`5,612,730
`
`MASTER
`NODE
`
`2OO
`
`206
`
`2O8
`
`SERVER
`NODE 2
`
`SERVER
`NODE 3
`
`
`
`SERVER
`NODE 1
`
`
`
`21 O
`
`218
`
`CLENT
`NODE 1
`
`220
`
`CLIENT
`NODE 2
`
`(CLIENT DC CLIENT
`KNODE 1 N D. K. NODE 1
`220
`
`212
`
`CLIENT
`XCNODE 2
`A. 22O
`
`
`
`is a CLIENT
`( NODE 2
`A. 220
`
`102
`
`FIGURE 3
`
`Ex.1036
`APPLE INC. / Page 9 of 39
`
`

`

`U.S. Patent
`
`Mar. 18, 1997
`
`Sheet 9 of 27
`
`5,612,730
`
`TANNVHO/ALJ3ALOHBOL
`
`OIGNVW/OAGIAVIGAWLLINW
`
`
`AALLOVYSLNIIGAWIL1
`
`ONIHOLIMSOFCIAWALSASOl
`
`eLL19SLOWSY
`OLLAT
`
`WALSASMHOMLAN
`Ol_OI|col
`
`s9unos(Sd)WALSAS
`
`VAYNSlIOMcoun
`rawr|iS6L
`xaos
`
`1YOdOAGIA
`zz1OCIAAVd
`
`OUNLNOOD
`
`NNAWO3GIA
`
`JOYLNOOD
`
`LuOd
`
`INOOYOL
`
`‘OLL
`
`AAILOVUSLNI
`
`ONISSSOONd
`
`
`
`SLYOdADIOA
`
`YAWOLSND
`
`901
`
`SNOILVYAdO
`
`WeOs4LV1d
`
`SSSIAYAS
`
`YAWOLSND
`
`SLYOdXV4
`
`Ex.1036
`APPLEINC./ Page 10 of 39
`
`Ex.1036
`APPLE INC. / Page 10 of 39
`
`
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 10 of 27
`
`5,612,730
`
`,0 || ||
`
`?CIO
`
`ENOHCHETE_L
`
`
`
`60||
`
`SOd VN
`
`10||
`
`cHOS
`
`Ex.1036
`APPLE INC. / Page 11 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 11 of 27
`
`5,612,730
`
`
`
`SSER}dVNO OBC]
`
`XIW X8
`
`EGIOONE
`
`809
`
`#709
`
`Z09
`
`EGIOONE
`
`AEX I XYJVWIAJd
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Ex.1036
`APPLE INC. / Page 12 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 12 of 27
`
`5,612,730
`
`
`
`NOISSE? He! WOWO
`
`
`
`SONICIO O WEX
`
`NOISSE?-|d|WOO
`
`
`
`SONICJOO XEX
`
`/ ERHT|5)|–|
`
`Ex.1036
`APPLE INC. / Page 13 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 13 of 27
`
`5,612,730
`
`
`
`907
`
`=#CJOONE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ÅRH\/CINO OES
`
`00
`
`Ex.1036
`APPLE INC. / Page 14 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 14 of 27
`
`5,612,730
`
`.......
`
`
`
`5O2
`
`FIGURE 9
`
`Ex.1036
`APPLE INC. / Page 15 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 15 of 27
`
`5,612,730
`
`HEADER
`20%
`
`
`
`HEADER
`10%
`
`IMAGE FILE
`
`MIDI FILE
`
`FIGURE 10
`
`Ex.1036
`APPLE INC. / Page 16 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 16 of 27
`
`5,612,730
`
`
`
`
`
`
`
`
`
`
`
`
`
`>
`s
`n
`OP
`O
`
`
`
`?7 (SSDTV NOISSERHCHWOOEO]
`
`OZG
`
`
`
`TV/NSDIS» HOMIEN
`
`
`
`
`
`OEC?IA ARHVOJNO OES
`
`Ex.1036
`APPLE INC. / Page 17 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 17 of 27
`
`5,612,730
`
`
`
`FIGURE 12
`
`Ex.1036
`APPLE INC. / Page 18 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 18 of 27
`
`5,612,730
`
`
`
`1248
`
`OBTAIN TELEPHONE
`NUMBER FROM SOURCE
`
`1250
`
`PRESS TELEPHONE KEY
`FOR SOURCE
`
`1252
`
`
`
`DETERMINE ROOM
`NUMBER
`
`1254-
`
`PLAYMESSAGE
`
`1256
`
`PRESS
`BUTTON 1
`
`PRESS
`BUTTON2
`
`PRESS
`BUTTON 3
`
`1262
`
`FIGURE 12A
`
`Ex.1036
`APPLE INC. / Page 19 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 19 of 27
`
`5,612,730
`
`
`
`
`
`REVIEW
`SELECTIONS
`
`1302
`
`MAKE A
`SELECTION
`
`1304
`
`S THERE
`AVAILABILITY
`
`1306
`
`CONTACT
`PBX SYSTEM
`
`1308
`
`
`
`
`
`
`
`MAKE ARESERVATION
`BASED UPON
`MULTIMEDIA
`INFORMATION
`
`1310
`
`FIGURE 13
`
`Ex.1036
`APPLE INC. / Page 20 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 20 of 27
`
`5,612,730
`
`START
`
`UPDATE
`INFORMATION
`
`1402
`
`SELECT FROMA NUMBER
`OF SHOPPING SOURCES
`
`1404
`
`BILL
`
`MPS GENERATES ORDER
`
`SEND ORDER TO
`SHOPPING SOURCE
`
`PRINT RECEIPT
`
`1406
`
`1408
`
`1410
`
`1412
`
`DELIVER RECEPT TO
`CLIENT
`
`1414
`
`FIGURE 14
`
`Ex.1036
`APPLE INC. / Page 21 of 39
`
`

`

`U.S. Patent
`
`Mar. 18, 1997
`
`Sheet 21 of 27
`
`5,612,730
`
`MPS CALLS CATALOG
`SOURCE NUMBER
`
`
`
`MPS CONNECTS TO
`CATALOG SOURCE
`
`
`
`
`
`1408-1
`
`1408-2
`
`MPS SENDS ORDER INFO
`TO SOURCE
`
`141 0-1
`
`
`
`
`
`
`
`SOURCE
`ACKNOWLEDGES ORDER
`
`1410-2
`
`FIGURE 14A
`
`Ex.1036
`APPLE INC. / Page 22 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 22 of 27
`
`5,612,730
`
`REVIEW MOVIE
`SELECTIONS
`
`1502
`
`1508
`
`
`
`SA MOVIE
`AVAILABLE FOR
`VIEWING
`
`N
`
`RESERVE MOVE
`FOR A PARTICULAR
`TIME
`
`1504
`
`Y
`
`1506
`
`SELECT
`MOVIE
`
`
`
`SELECT MOVIEAT
`- THE PARTICULAR
`TIME
`
`1510
`
`END
`
`FIGURE 15
`
`Ex.1036
`APPLE INC. / Page 23 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 23 of 27
`
`5,612,730
`
`
`
`
`
`
`
`
`
`DETERMINE WHICH MOVIES
`ARE BEING SHOWN AT A
`PARTICULARTIME BASED
`UPON OTHER CUSTOMERS
`
`1508-1
`
`S CUSTOMER
`INTERESTED ENVIEWING
`MOVIEATA PARTICULAR
`TIME
`
`
`
`1510-1
`
`SELECT A
`MOVIE
`
`FIGURE 15A
`
`Ex.1036
`APPLE INC. / Page 24 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 24 of 27
`
`5,612,730
`
`START
`
`UPDATE
`CLIENT INFORMATION
`
`1602
`
`SELECT FROMANUMBER
`OF TICKETING SOURCES
`
`1604
`
`BL
`
`MPS GENERATES ORDER
`
`SEND ORDER TO
`TICKETING SOURCE
`
`PRINT TICKET
`
`1606
`
`1608
`
`1610
`
`1612
`
`DELIVERTICKET TO
`CLENT
`
`1614
`
`END
`
`FIGURE 16
`
`Ex.1036
`APPLE INC. / Page 25 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 25 of 27
`
`5,612,730
`
`START
`
`UPDATE
`CLIENT INFORMATION
`
`1702
`
`SELECT FROMA NUMBER
`OF MAP SOURCES
`
`1704
`
`BLL
`
`MPS GENERATES ORDER
`
`SEND ORDER TO MAP
`SOURCE
`
`PRINT MAP
`
`DELIVER MAP TO CLIENT
`
`1706
`
`1708
`
`1710
`
`1712
`
`1714
`
`FIGURE 17
`
`Ex.1036
`APPLE INC. / Page 26 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 26 of 27
`
`5,612,730
`
`TELE-
`
`1802
`
`PHONE PERSONAL
`COMPUTER
`
`1806
`
`CRT
`
`1804
`
`KEYPAD
`
`MPS
`
`printer
`
`PRINTER
`
`1808
`
`1810
`
`OUTPUT
`
`R
`
`TO
`CUSTOMER
`
`FIGURE 18A
`
`Ex.1036
`APPLE INC. / Page 27 of 39
`
`

`

`U.S. Patent
`
`Mar 18, 1997
`
`Sheet 27 of 27
`
`5,612,730
`
`TELE-
`PHONE
`
`18O2"
`
`1806
`
`PERSONAL
`COMPUTER
`
`CRT
`
`1804."
`
`MPS
`
`KEYPAD
`
`1 808"
`
`1812'
`
`TRAY
`
`181O'
`8
`
`OUTPUT
`
`TO
`CUSTOMER
`
`FIGURE 18B
`
`Ex.1036
`APPLE INC. / Page 28 of 39
`
`

`

`5,612,730
`
`1
`NTERACTIVE SYSTEM FOR A CLOSED
`CABLE NETWORK
`
`FIELD OF THE INVENTION
`The present invention relates to a closed cable network
`and more particularly the present invention relates to the
`interactive transfer of multimedia information within such a
`network.
`
`2
`to provide a reservation system for pay per view movies,
`catalog shopping, ticketing or the like through the network.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a block diagram of a prior art closed cable
`network.
`FIG. 2 is a block diagram of a general embodiment of an
`interactive multimedia system for use in a closed cable
`network.
`FIG.2a is a block diagram of a personal computer and an
`IMD utilized in the system of FIG. 2.
`FIG.2b is a block diagram of a point to point system
`utilized in the system of FIG. 2.
`FIG.2c is a block diagram of a multimedia multiplexer
`coupled to an interactive multimedia decoder.
`FIG. 2d is a block diagram of a global multimedia
`decoder.
`FIG. 2e is a block diagram of a multimedia processing
`center (MPC) in accordance with the system of FIG. 2.
`FIG. 3 is a block representation of the multimedia pro
`cessing system (MPS) in accordance with the present inven
`tion.
`FIG. 4 is a first specific embodiment of an interactive
`multimedia system for use in a closed cable network.
`FIG. 5 is a second specific embodiment of an interactive
`multimedia system for use in a closed cable network.
`FIG. 6 is a flow chart of a first embodiment of the
`optimization method which is utilized in the closed cable
`network in accordance with the present invention.
`FIG.7 is a representation of the separation of primary and
`secondary multimedia information.
`FIG. 8 is a flow chart of a second embodiment of the
`optimization method showing the cooperation of a compres
`sion algorithm with a transmission algorithm in accordance
`with the present invention.
`FIG. 9 is a block that shows the cooperation of a com
`pression algorithm with a transmission algorithm in accor
`dance with the present invention.
`FIG. 10 is a block representation of digital information of
`an image file and a MIDI file.
`FIG. 11 is a block diagram of a general embodiment of an
`interactive multimedia device (IMD) in accordance with the
`present invention.
`FIG. 12 is a representation of a remote control utilized in
`conjunction with the system architecture of the present
`invention.
`FIG. 12a is a flow chart of an operation of a linked
`services system in accordance with the present invention.
`FIG. 13 is a flow chart of a reservation system that utilizes
`the interactive system in accordance with the present inven
`tion.
`FIG. 14 is a flow chart of a shopping system that utilizes
`the interactive system in accordance with the present inven
`tion.
`FIG. 14a is a flow chart of a portion of the shopping
`system of FIG. 14.
`FIG. 15 is a flow chart of a movie review and ordering
`system that utilizes the interactive system in accordance
`with the present invention.
`FIG. 15a is a flow chart of a portion of the movie review
`and ordering system of FIG. 15.
`
`BACKGROUND OF THE INVENTION
`There are many types of closed cable networks. What is
`meant by closed cable networks in the context of this
`application are networks which are self-contained and have
`a specified number of users. For example, a hotel or hospital
`would contain such networks. In such networks, there are a
`series of connections to each room or the like for presenta
`tion of various multimedia information. Oftentimes this
`information takes the form of video material that is provided
`to each of the customers or patients. The characteristic of
`these types of networks is that there is a feedbackpath that
`provides the owner of the network with knowledge of the
`activities of the particular user on the network. Hence, in the
`case of a hotel system, if a person orders a service there is
`a way for the owner of the network to know that the service
`has been ordered by that particular person. The major
`problem with existing closed cable networks are that they
`are not fully interactive. That is, there is no way to actively
`select multimedia information from outside of the network
`in real time. Accordingly, what is needed is a system for
`allowing a user of such a network to interactively access
`information outside of the network without requiring addi
`tional equipment within each user location. In addition, the
`system should be one that does not affect the normal
`operation of the existing closed cable system. The present
`invention addresses such a need.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`SUMMARY OF THE INVENTION
`A closed cable network for interactive multimedia trans
`mission comprises a services operation platform system for
`receiving program materials from customers and a multi
`media processing system responsive to the program mate
`rials for providing information. The network further
`includes means for transmitting and receiving telephone
`messages coupled to the multimedia processing system, a
`video control unit coupled to the processing system and a
`plurality of interactive multimedia devices (IMDs) for
`receiving and transmitting multimedia information to and
`from the multimedia processing system.
`In another aspect, an interactive system for a closed cable
`network comprises means for processing multimedia infor
`mation; means coupled to the multimedia processing means
`for receiving telephone messages from and transmitting
`telephone messages to the multimedia processing means;
`means coupled to the multimedia processing means for
`receiving account information from and transmitting
`account information to the multimedia processing means;
`means coupled to the multimedia processing means for
`receiving control information from and transmitting control
`information to the multimedia processing means; and a
`plurality of interactive devices coupled to the multimedia
`processing means.
`The interactive devices are utilized to vastly increase the
`amount of information that can be processed through a
`closed cable network. In one aspect, the network is utilized
`
`65
`
`Ex.1036
`APPLE INC. / Page 29 of 39
`
`

`

`5,612,730
`
`3
`FIG. 16 is a flow chart of a ticketing system that utilizes
`the interactive system in accordance with the present inven
`tion.
`FIG. 17 is a flow chart of a map generating system that
`utilizes the interactive system in accordance with the present
`invention.
`FIG. 18a is a block diagram of an electronic inventory
`control system utilized in the interactive system in accor
`dance with the present invention.
`FIG. 18b is a block diagram of a physical inventory
`control system utilized in the interactive system in accor
`dance with the present invention.
`
`10
`
`15
`
`4
`Typically, multimedia systems in whatever form provide
`this information over a single transmission line. In so doing,
`the amount and quality of the multimedia information is
`severely limited by the bandwidth of the transmission line.
`The present invention first differentiates between impor
`tant and less important multimedia information by separat
`ing the information into primary and secondary layers
`through the use of a program model to minimize the band
`width limitations. In such a system each layer will have its
`own set of parameters that are important psychographically,
`however, the secondary layer will not vary as much as the
`primary layer.
`What is meant by a program model refers to psycho
`graphic parameters within the multimedia system, that is
`parameters that relate to an individual's sensory perceptions
`when encountering multimedia information. These param
`eters comprise a set of unique and consistent elements for a
`particular class of multimedia information. In accordance
`with the present invention, its multimedia information is
`separated into different layers in accordance with the pro
`gram model. Therefore, by way of example, in the instance
`of video images, the foreground and background informa
`tion might be divided into different layers. Similarly, in the
`case of audio information, the news information, weather
`information, or the like may be one layer whereas the
`background music may be the dther layer.
`In the present invention, these layers will be divided into
`primary and secondary layers in accordance with the infor
`mation's importance relative to the program model. The
`most important information is identified and enhanced to
`provide the best quality information to the receiver of the
`multimedia information.
`In the preferred embodiment, the primary layers will be
`enhanced in such a way to provide a perceived improvement
`in quality of the multimedia information presented. In one
`embodiment the secondary layers are presented that may or
`may not be enhanced. Thereby the important information or
`the primary layers that are to be transmitted can be identified
`and selectively enhanced in accordance with the present
`invention.
`In addition, the primary layers generally can be enhanced
`through critical psychographic parameters take the form of
`spatial, color, audio, and temporal variables that occur in the
`primary or secondary layers.
`In a closed cable network such as a hotel system it is
`important that the multimedia information that is produced,
`transmitted and received is enhanced in some manner. This
`is necessary to ensure that high fidelity, high quality infor
`mation is presented to the viewer. Therefore, it will be
`possible to bring a superior product into the network. It is
`known, for example, it has been possible to provide video
`information over the telephone lines. However, it has been
`a problem sending high quality video information due to the
`bandwidth requirements that are needed to provide such
`high quality video information.
`The present invention is directed towards a method and
`apparatus for enhancing the interactive multimedia informa
`tion that is utilized within a closed cable network. To more
`fully explain such a method and apparatus, refer now to
`FIGS. 2-5 which shows a block diagram of a general
`embodiment and block diagrams of two specific embodi
`ments of the overall system architecture for an enhanced
`interactive multimedia system for a closed cable network.
`The overall architecture would be connected to the hotel
`PBX or the like so as to readily access the transmission lines
`located therein.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`The present invention relates to an interactive system for
`a closed cable network. The following description is pre
`sented to enable one of ordinary skill in the art to make and
`use the invention and is provided in the context of a patent
`application and its requirements. Various modifications to
`the preferred embodiment will be readily apparent to those
`skilled in the art and the generic principles and features
`described herein may be applied to other embodiments. Thus
`the present invention is not intended to be limited to the
`embodiment shown but is to be accorded the widest scope
`consistent with the principles and features described herein.
`Referring now to FIG. 1, what is shown in simple block
`diagram form is a prior art closed cable network. In the
`following discussion the present invention will be discussed
`in the context of a hotel system. It should be understood
`however that there are other types of closed cable networks
`such as hospitals, educational institutions and many con
`ventional cable head end networks or the like where the
`principles of the present invention would apply.
`The system 10 includes a hotel PBX system 12 for
`receiving and transmitting telephone calls, property man
`agement system 14 and a video control system 16 which
`40
`could be used to access the pay per view movies or the like.
`The video control system 16 includes an in-room remote
`link and is connected to the services operation platform 14.
`The property management system (PMS) 14 keeps track of
`the users that order the movies.
`The system 10 as above described is not fully interactive.
`In this type of system there are a number of video units or
`VCRs located within the system and they are switched in
`when the appropriate customer or client wants to use the
`video unit. Hence, these video units cannot be individualized
`to a particular user because there are simply not enough
`units. For example, there may be a bank of 64 VCRs which
`would service a 500 room hotel. Each of the VCRs would
`have a separate movie. Accordingly, in this case there is a
`possibility that a particular movie would not be available. In
`55
`addition, this type of arrangement severely limits the num
`ber of choices available.
`Before the present invention is described in detail certain
`background information should be discussed to clarify the
`utility of the present invention in terms of existing closed
`cable networks. In a multimedia system, various sensory
`information is provided to a receiver. In the case of video
`information, this information takes the form of foreground
`and background images that display a particular scene. In the
`case of audio information, the foreground and background
`signals are such that the foreground information is speech
`and the background information is music.
`
`60
`
`20
`
`25
`
`30
`
`35
`
`45
`
`50
`
`65
`
`Ex.1036
`APPLE INC. / Page 30 of 39
`
`

`

`5,612,730
`
`S
`Referring first to FIG. 2, the overall general architecture
`100 includes a multimedia processing system (MPS) 102.
`which is coupled to receive information from and transmit
`information to a video control system 104, an account
`computer 106, a service operations platform SOP 107, and
`a telephony switching system 108. The MPS 102 is also
`coupled to an interactive multimedia decoder (IMD) 110, a
`CD/I device 112, a laser disk 117, video camera 121,
`compact disk (CD) player 125, personal computer (PC) 119,
`video camera recorder (VCR) 123 and other devices 114. In
`this system each of these devices can be utilized to provide
`updatable multimedia information. For example, a compact
`disk player 125 can be utilized to jump to different places to
`provide multimedia information. It could be utilized in
`conjunction with an IMD to augment the fixed media with
`interactive material (updatable video source) material.
`A personal computer 119 can be utilized in conjunction
`with the IMD 110 as shown in FIG. 2a to mesh a composite
`signal (audio, video) utilizing a multimedia selection. Some
`examples for the use of such a system are on-line services,
`games or maps and the like.
`A VCR 123 or CD player 125 could be utilized in such a
`system, for example, movie preview, catalog shopping, and
`a music listening system. Through this system full interac
`tivity could be obtained.
`Video conferencing can be implemented for point to point
`or point to multiple point video conferencing. For example,
`referring now to FIG.2b, what is shown is a point to multiple
`point video conference system 500. In this type of system,
`a video conference room (VC) can be utilized to transmit to
`multiple sites. This system can be utilized with the IMD 110
`to provide updatable multimedia information.
`Similarly, a point to point system, in which there is a
`video camera in each guest's room, can be utilized. In this
`embodiment, a video multiplexer can be utilized to send
`updatable multimedia information from point to point (room
`to room) dependent on the type of information presented.
`An advantage of this system is to provide means for
`switching between alternate multimedia information at the
`head end. This allows for switching between analog and
`digital; data and graphics, music and video, etc. To more
`fully explain the advantage of this feature refer now to FIG.
`2c. FIG. 2c shows a multimedia multiplexer (MM) 135
`coupled to an IMD 110. In this embodiment the MM 135 can
`send information from a plurality multimedia sources to the
`MD 110.
`In a preferred embodiment to provide for maximum
`resource allocation refer now to FIG. 2d which shows a
`global multimedia multiplexer (GMM) 137. The GMM 137
`would typically include a plurality of multimedia lines
`(mm-mm) for receiving multimedia source material. The
`GMM 137 receives information from a plurality of multi
`media devices such as a PC, VCR, LD, CD-ROM, and CD/I
`devices. The output of the GMM 137 is provided to a
`55
`plurality of IMDs 110 (IMD-IMD). The GMM 137
`receives signals from a control channel 139 either from a
`MPS or the IMDs or other outside source. Through this
`device any multimedia source or combination of sources
`(mm mm) can be directed to any decoder or interactive
`channel (IMD-IMD). This GMM 137 can be implemented
`in a variety of ways, for example, it can be a digital
`crosspoint switch. Through such a device a combination of
`multimedia devices can be utilized to produce a composite
`signal.
`Referring back to FIG. 2, the cable feed line in turn is
`coupled to the video control system 104. The account
`
`65
`
`35
`
`40
`
`45
`
`50
`
`10
`
`15
`
`20
`
`25
`
`30
`
`6
`computer 106 and the SOP 107 are also directly coupled to
`the telephone switching system 108 via line 120. The
`telephone switching system 108 is capable of sending and
`receiving outside calls. The video control system 104 is
`capable of sending and receiving a remote signal from a
`cable system, telecommunication system or the like.
`Another portion of the invention is an interactive voice
`response system 111. This system includes a telephone 113
`which connects to the telephony switching 108 via telephone
`links. The telephone 113 also could include a credit card slot.
`There is also included within the system 111, a remote
`control 900 which will be described in detail later and a
`television 115 which is coupled to the cable 116.
`In this general embodiment, the multimedia processing
`system (MPS) 102 receives program source material from
`the SOP 107 and from the control system 104. The control
`system 104 can be a pay per view system such as a
`On-CommandTM Video or a different type of service, such as
`a shopping, buying movie or airline tickets, or the like. The
`MPS can also operate an interactive voice response program
`independently or integrated into other interactive multime
`dia programs.
`The SOP 107 is utilized for receiving facsimile and voice
`messages. The SOP 107 can also be utilized in conjunction
`with pagers and the like to relay messages. By linking the
`account computer 106 to MPS 102 messages can be dis
`played on a monitor within the guest room. In addition, faxes
`can be displayed on the television and could be forwarded to
`other locations.
`A master multimedia processing center (MPC) 109 is also
`coupled to the closed cable system 100 via connection to the
`MPS 102. The MPC 109 is coupled to a plurality of closed
`cable systems to provide enhanced interactivity thereto.
`Referring now to FIG.2e what is shown is a block diagram
`of the MPC 109. The MPC 109 comprises an interactive
`multimedia mastering system 111 which receives program
`source material from various outside sources and a MPS 102
`which receives source material from the IMM 111 and can
`also receive data information over a program port 113 and an
`auxiliary port 115.
`Referring back to FIG. 2, a critical portion of the system
`100 is the telephone switching system 108 interface.
`Through the use of this architecture the switching system
`108 can be controlled to provide the appropriate information
`to the user. Through the use of the interface devices (IMD
`110, CD/I 112 and the other device 114) and the MPS 102,
`the switching system 108 can be controlled in such a manner
`that the user doesn't have to remember a telephone number
`to obtain the desired information. This control can be
`accomplished through either a digital link that is directly
`interfaced to the telephone switching system 108 or through
`an analog link where only a normal phone connection to the
`system. Through either of the systems an emulation of the
`customer actions would be undertaken.
`In a typical example, a call is made by the user to order
`a service. The MPS 102 places call to the room through
`control of the system 108. The room telephone will ring and
`the MPS 102 will send a message to the switching system
`108 that the customer would like to access a service, in this
`case, a restaurant where the customer would like to make
`reservations. It should be understood in the alternative to the
`above that the restaurant could be called first via the system
`108 and then the MPS 102 would call the customer back.
`The switching system 108 will then call the restaurant,
`introduce the caller and then the restaurant will be linked to
`the room. All of these activities are done transparently to the
`
`Ex.1036
`APPLE INC. / Page 31 of 39
`
`

`

`5,612,730
`
`7
`user. Through the use of this system 100 it is also possible
`to print out faxes and or receipts directly at the front desk of
`a hotel or the like.
`The system 100 is capable of transaction processing via
`the multimedia in a variety of ways. For example, transac
`tions can be processed by posting billing information to a
`computer within the closed cable system, a facsimile order
`ing system within the system or through a voice order
`processing.
`The MPS 102 will provide and receive information relat
`ing to movies and other services from and to interface
`devices 110, 112, and 114. The interface devices 110, 112,
`and 114 are in the hotel facilities connected either to the
`hotel video cable system through use of the video/audio
`outputs or connected via digital links from interface devices
`110, 112 and 114 in each guest's room. The MPS 102 also
`includes an internet interface 195 for connections to data
`bases and other on-line information on the internet or
`equivalent on-line service. This internet gateway interface
`195 can be utilized in a variety of manners.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`8
`computing structure the entire network can be operated as a
`massive distributed computing environment.
`This environment shares all dimensions of computing,
`storage, transmission and peripheral resources (printing,
`product ordering, mailing functions, etc.). This type of
`computing architecture would include dynamic port alloca
`tion and would include incremental failure characteristics to
`allow for robustness of the MPS 102.
`In addition through the use of this interactive system 100
`of the present invention a multiplicity of different interactive
`devices can be utilized and no modification to the device
`need be made to allow for devices use within the system.
`Accordingly the link between the MPS 102 and the inter
`active devices can be a serial link, a CD/I link, a cable link
`such as ethernet or telephone connection via a simple
`infrared relay control link. Since the MPS 102 can transmit
`and receive data as well as control information it can operate
`utilizing a wide range and types of interact