`Mackintosh et al.
`
`USOO631 7784B1
`US 6,317,784 B1
`(10) Patent No.:
`Nov. 13, 2001
`(45) Date of Patent:
`
`(54) PRESENTING SUPPLEMENTAL
`INFORMATION FOR MATERIAL
`CURRENTLY AND PREVIOUSLY
`BROADCAST BY A RADIO STATION
`
`(75) Inventors: Gregory B. Mackintosh, Roselle; Mike
`H. Kim, Naperville; Edwin C. Price;
`Edward C. Stojakovic, both of
`Chicago, all of IL (US)
`(73) Assignee: RadioWave.com, Inc., S. Schaumburg
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/163,292
`(22) Filed:
`Sep. 29, 1998
`(51) Int. Cl." .................................................. G06F 15/16
`(52) U.S. Cl. ........................... 709/219; 709/217; 709/218
`(58) Field of Search ..................................... 709/230, 236,
`709/203, 216, 217, 219, 218; 707/517;
`345/339; 705/1
`
`(56)
`
`5,204,969
`5,557,724
`5,572,442
`5,699,089
`5,774,664
`5,822,537
`5,826,102
`5,918,213
`5,922,047
`5,928,330
`
`References Cited
`U.S. PATENT DOCUMENTS
`4/1993 Capps et al. ........................, 395/800
`9/1996 Sampat et al..
`11/1996 Schulhof et al. .................... 364/514
`12/1997 Murray ...........
`... 345/902
`6/1998 Hidary et al...
`... 395/200.48
`10/1998 Katseff et al. .
`... 395/200.61
`10/1998 Escobar et al. ...................... 395/806
`6/1999 Bernard et al. ........................ 705/26
`7/1999 Newlin et al. .
`... 709/217
`7/1999 Geotz et al. ......................... 709/231
`
`10/1999 Kaplan ................................... 705/26
`5,963,916
`1/2000 Lowell ................................. 709/218
`6,012,086
`6,151,634 * 11/2000 Glaser et al.
`709/236
`6,161,114 * 12/2000 King et al. ........................... 707/517
`6,161,142
`12/2000 Wolfe et al. ......................... 709/230
`6,166,735
`12/2000 Dom et al. ........................... 345/339
`6,226,618
`5/2000 Downs et al. ........................... 705/1
`FOREIGN PATENT DOCUMENTS
`O 847 156 A2
`6/1998 (EP).
`WO 98/21664
`5/1998 (WO).
`WO 97/42582
`11/1997 (WO) ............................. G06F/17/OO
`* cited by examiner
`Primary Examiner Le Hien Luu
`(74) Attorney, Agent, or Firm-Foley, Hoag & Eliot llp
`(57)
`ABSTRACT
`A media player for playing broadcast material and associ
`ated Supplemental information includes a receiver config
`ured to receive broadcast material from a broadcast Service
`provider. The broadcast material includes program Segments
`and program data related to one or more of Said program
`Segments. The player playS program Segments of Said
`received broadcast material on a user's terminal. An infor
`mation retrieval module forwards an item of program data
`related to a given one of the program Segments to a first
`Server enabling the Server to retrieve parameters identifying
`one or more items of Supplemental material for said given
`program Segment. The information retrieval module for
`wards the parameters to a Second Server to retrieve Supple
`mental materials from Said Second Server based on the
`parameters, and provideSteh Supplemental materials to the
`player for playback with a given program Segment of
`broadcast material.
`
`24 Claims, 13 Drawing Sheets
`
`
`
`38.
`
`---O-
`
`255
`
`"ise ...ay---
`
`5.
`
`self:
`48 he air 883risy
`a 8 i.
`
`S-88
`
`& 8
`
`x8-83 &
`
`88.3xx
`
`88: 888: 888. 38
`
`3.
`88ssia: g: 383.38: 8888.E.8s
`
`- 53.38
`
`SES
`
`---. S)
`
`Petitioner
`Ex. 1005 - Page 1
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 1 of 13
`
`US 6,317,784 B1
`
`BROADCAST
`PROVIDER
`108
`
`USER
`112
`
`
`
`MATERIAL
`SERVER
`120
`
`DATA
`122
`
`
`
`PROGRAM
`PROVIDER
`104
`
`DATA
`SERVER
`116
`
`C d
`DATA
`118
`
`A7 f.
`
`Petitioner
`Ex. 1005 - Page 2
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 2 of 13
`
`US 6,317,784 B1
`
`DELIVER PROGRAM TO USER
`
`| DELIVER PROGRAM DATA TODATASERVER
`
`132
`
`u?
`
`u? 134
`
`136
`
`-
`
`DATASERVER
`RETRIEVES
`SUPPLEMENTAL MATERIAL
`
`r 142
`.
`DATASERVER RETREIVES
`PARAMETERS AND SENDS
`TO USEREQUIPMENT
`
`138
`
`-
`y
`SUPPLEMENTAL MATERAL
`PROVIDED TO USER
`TERMINAL
`
`144
`(-
`USEREQUIPMENT USES
`PARAMETERS TO
`RETRIEVE SUPPLEMENTAL
`MATERIAL
`
`i? 140
`SUPPLEMENTAL MATERAL |
`PLAYED IN CONUUNCTION
`WITH PROGRAMMATERIAL
`
`i? 146
`SUPPLEMENTAL MATERIAL
`PLAYED IN CONJUNCTION
`WITH PROGRAMMATERIAL
`
`A72
`
`Petitioner
`Ex. 1005 - Page 3
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 3 of 13
`
`US 6,317,784 B1
`
`ENCODNG
`106
`
`BROADCAST
`PROVIDER
`108
`
`
`
`USER
`EOUIPMENT
`112
`
`MATERIAL
`SERVER
`120
`
`MATERIAL
`122
`
`PROGRAM
`PROVIDER
`104
`
`DATA
`SERVER
`116
`
`CD
`DATA
`118
`
`A13
`
`Petitioner
`Ex. 1005 - Page 4
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 4 of 13
`
`US 6,317,784 B1
`
`PROGRAMMATERIALDELIVERED TO i? 162
`USEREQUIPMENT
`
`USEREQUIPMENT DELIVERS PROGRAML?
`DATA TODATASERVER
`
`( 136
`
`DATASERVER
`RETRIEVES
`SUPPLEMENTAL MATERIAL
`
`142
`DATASERVER RETREIVES
`PARAMETERS AND SENDS
`TO USEREQUIPMENT
`
`138
`SUPPLEMENTAL MATERIAL
`PROVIDED TO USER
`TERMINAL
`
`( 144
`USEREQUIPMENT USES
`PARAMETERS TO
`RETRIEVE SUPPLEMENTAL
`MATERIAL
`
`1. 140
`SUPPLEMENTAL MATERIAL
`PLAYED IN CONJUNCTION
`WITH PROGRAMMATERIAL
`
`1. 146
`SUPPLEMENTAL MATERIAL
`PLAYED IN CONJUNCTION
`WITH PROGRAMMATERIAL
`
`A74
`
`Petitioner
`Ex. 1005 - Page 5
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 5 of 13
`
`US 6,317,784 B1
`
`--
`
`i s
`
`STATION
`204
`
`
`
`i s
`
`? 208
`
`Broadcast
`INTERNET
`SERVICE
`PROVIDER
`
`210
`
`
`
`
`
`216
`
`SUPPLEMENTAL SERVER
`
`USER TERMINAL
`
`A7Af
`
`Petitioner
`Ex. 1005 - Page 6
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 6 of 13
`
`US 6,317,784 B1
`
`DELIEVER PROGRAMMATERIAL TO A
`BROADCAST SERVICE PROVIDER
`
`????
`
`BROADCAST ENCODED PROGRAMMATERIAL ??
`TO USER
`
`PLAY PROGRAM MATERIAL
`
`PROVIDE PROGRAM DATA TO SERVER
`
`226
`
`i?
`
`u? 228
`
`SERVER PROVIDES SUPPLEMENTAL
`MATERIAL PARAMETERS
`
`? 23O
`
`USER TERMINAL RETREIVES SUPPLMENTAL ? 232
`MATERIALS
`
`USERTERMINAL PLAYS SUPPLMENTAL
`MATERIALS TO USER
`
`??
`
`A76
`
`Petitioner
`Ex. 1005 - Page 7
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 7 of 13
`
`US 6,317,784 B1
`
`
`
`TRACK IMAGE
`322
`
`TRACK INFO
`3.
`
`:
`
`ACNA
`Niki
`
`STAONS 38
`
`338
`
`Petitioner
`Ex. 1005 - Page 8
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 8 of 13
`
`US 6,317,784 B1
`
`RECEIVE MODULE
`404
`
`PLAY MODULE
`408
`
`- - - - - - -
`
`PERIPH.
`422
`!--------
`
`-------
`: DISPLAY
`410
`
`way was as
`
`| SPKR
`412
`--------
`
`GET DATA
`414
`
`GET MATERIALS
`418
`
`
`
`HISTORY
`420
`
`Afzal
`
`Petitioner
`Ex. 1005 - Page 9
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 9 of 13
`
`US 6,317,784 B1
`
`RECEIVE PROGRAMMATERIALS AND
`PROGRAM DATA
`
`442
`
`PLAY PROGRAMMATERIAL
`
`444
`
`STORE PROGRAM DATA
`
`U 446
`
`
`
`
`
`STORE IMAGE ASSOCATED WITH
`PROGRAM DATA AND DISPLAY SAME IN
`HISTORY WINDOW
`
`448
`
`RETRIEVE SUPPLEMENTAL MATERIAL L? 450
`FOR HISTORIC TRACK UPONUSER
`SELECTION
`
`AZ
`
`Petitioner
`Ex. 1005 - Page 10
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 10 Of 13
`
`US 6,317,784 B1
`
`
`
`Nipper
`
`509
`
`BROADCAST
`SERVER
`
`
`
`SUPPORT
`SERVER
`
`51O
`
`AZ 10
`
`FULFILLMENT
`
`PEr
`
`Petitioner
`Ex. 1005 - Page 11
`
`
`
`U.S. Patent
`
`US 6,317,784 B1
`
`
`
`@HT8IVL YHWHCIIA ORIGI@HT8IVJL ONOS
`
`
`
`
`
`
`
`LIS9 IS
`
`// //
`
`Petitioner
`Ex. 1005 - Page 12
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 12 of 13
`
`US 6,317,784 B1
`
`8.
`
`53;
`-xxxx.
`
`55
`
`six
`
`- - -
`55:
`
`iri:
`: Fasig.
`
`s
`
`xx
`
`xxxx8
`:::::
`
`a.
`
`St.
`
`:8:
`
`:::::
`"a jay'--
`
`S.
`
`-
`33r:
`48 is Sii &foray
`3i Eli
`
`3- YF4.
`
`88:
`&X. X. Xixxx
`
`&
`38:
`
`XXXXXX XXXXXXXXX XXXXXX-XXXXX XXXX XXX
`
`x
`
`*ae:Egg: his
`
`3 & 888.33:83. 888 388 (38 :::
`Best RAE. ON. N. BrokERs
`
`
`
`i
`
`-- SS
`
`--- Sir
`
`Petitioner
`Ex. 1005 - Page 13
`
`
`
`U.S. Patent
`
`Nov. 13, 2001
`
`Sheet 13 of 13
`
`US 6,317,784 B1
`
`BUS
`
`PROCESSOR
`704
`
`1N 7702
`
`MAIN MEMORY
`708
`
`SECONDARY MEMORY
`710
`
`REMOVABLE
`STORAGE DRIVE
`714
`
`REMOVABLE
`STORAGEMEDIA
`728
`
`REMOVEABLE
`STORAGE UNIT /F
`720
`
`REMOVALE
`STORAGE UNIT
`722
`
`
`
`COMMUNICATION
`INTERFACE
`724
`
`CHANNEL 728-O
`
`Fig. 13
`
`Petitioner
`Ex. 1005 - Page 14
`
`
`
`1
`PRESENTING SUPPLEMENTAL
`INFORMATION FOR MATERIAL
`CURRENTLY AND PREVIOUSLY
`BROADCAST BY A RADIO STATION
`
`The present application is related to copending U.S.
`patent applications No. 09/163,293, docket number 237/092,
`titled “System and Method for Coordinating Supplemental
`Materials With Broadcast Material,” now pending, No.
`09/163,297, titled “System and Method For Playing Supple
`mental Materials With Broadcast Material,” now pending,
`and No. 09/162,288, titled “System and Method For Coor
`dinating Communications Network Advertising Material.”
`now pending, each of which are of common assignee and are
`filed concurrently here with and each of which are incorpo
`rated herein by reference in their entirety.
`BACKGROUND OF THE INVENTION
`1. Field of the Invention
`The present invention relates generally to broadcast
`materials, and more particularly to a System and method for
`coordinating history information relating to broadcast mate
`rials.
`2. Related Art
`The proliferation of processors and processor-based SyS
`tems in recent years has led to a tremendous increase in the
`ability of businesses, industry and individuals to share
`information. Most computers and WorkStations in today's
`homes and offices are connected in Some manner to another
`computer or WorkStation, either locally or remotely. An early
`form of Such inter-connection of computing Systems is the
`local area network (LAN). Using LAN technology, several
`computers, workStations, peripherals, or other related
`devices can be connected to share data among one another
`and to share network resources.
`The Internet can be thought of as an extension of local
`area network technology. The Internet originally began as a
`communication network through which government
`researchers, Scientists and other perSonnel could exchange
`data or other information between offices and facilities
`throughout the World. Eventually, the Internet became acces
`sible to the public. Initially, the public was slow to embrace
`the Internet, and it seemed as if the Internet would remain
`nothing more than a way for a Select group of technologists
`to exchange e-mails and other data or information.
`Eventually, however, entrepreneurs who envisioned the
`growth of the consumer market for Internet Services were
`able to attract a large number of consumers into the fold. AS
`a result, a Sort of Snowball effect ensued in which more and
`more consumers become Internet users, and in turn, more
`and more businesses rushed to get web pages Set up on an
`Internet server. With more businesses offering information,
`products and Services on the Web, more consumers were
`attracted to the Internet. This cycle rapidly fed on itself
`Virtually creating an explosion on the Internet.
`However, the proliferation of the Internet did not stop
`with the provision of web pages to the Internet users, or web
`Surfers. In the true capitalistic Spirit, providers of popular
`web pages found that they were able to Sell advertising Space
`on their web pages. Thus, the Internet became not only a way
`for businesses to advertise their own businesses on their web
`pages, but also a way for advertisers to include their ads on
`others web pages.
`Seemingly overnight, the Internet had transformed into
`the new advertising medium of the decade. Virtually every
`busineSS and industry jumped on to the Internet bandwagon.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,317,784 B1
`
`2
`On top of that, hundreds, if not thousands, of new businesses
`were created to offer Internet-related Services. It seemed as
`if just about everyone was able to capitalize on this new
`medium.
`However, in spite of this proliferation, there were still a
`few business that were left out of the Internet craze. One
`example of Such a busineSS is the radio industry. Although
`stations could offer their own web sites on the Internet, Such
`Sites typically were not popular among the Web Surfers, and
`thus were not a good Source of advertising revenues. Thus,
`even though radio Stations could participate in the Internet,
`their only gains from doing So were PR-related.
`Eventually, enterprising web developerS decided that they
`could offer a mechanism by which one or more radio Stations
`or radio networks could offer their broadcast materials over
`the Internet. One popular Internet Site offering this Service is
`www.broadcast.com, although there are others. While many
`radio Stations have agreed to provide their programming
`acroSS the Internet by Such Service providers, most have
`found that this has not led to an increase their advertising
`revenues. Although these providers offer an excellent Ser
`Vice to radio Stations and their listeners, most advertisers are
`not willing to pay a premium for advertising slots simply
`because the broadcast material is additionally offered to
`listeners over the Internet. Thus, even though these Services
`allowed radio Stations to further participate in the Internet
`related industry, their ability to fully take advantage of
`Internet opportunities is still Somewhat limited.
`Additional background information on the use of com
`puter networks as a broadcast medium is available from
`“BROADCAST AND DISTRIBUTION SYSTEM AND
`METHOD,” U.S. patent application Ser. No. 08/961,314,
`filed Oct. 30, 1997, now pending, and “AUDIO CONTENT
`PLAYER METHODS AND ARTICLES OF
`MANUFACTURE,” U.S. patent application Ser. No.
`08/976,971, filed Nov. 25, 1997, now abandoned, both of
`which are fully incorporated by reference herein as though
`set forth in full.
`
`SUMMARY OF THE INVENTION
`The present invention is directed toward Systems and
`methods for providing enhanced features for the delivery of
`broadcast material to a listener, viewer or, more generally, a
`user. According to one aspect of the invention, Supplemental
`materials can be provided to a user in a coordinated fashion
`with the broadcast materials being delivered. The Supple
`mental materials can be provided in a coordinated fashion
`Such that they relate to the actual broadcast materials as they
`are being Streamed or otherwise delivered to the user. For
`example, according to one embodiment, the broadcast mate
`rial is delivered to the user in Segments Such as, for example,
`tracks of music, advertisements, and promotional materials
`in a radio broadcast. In this embodiment, the Supplemental
`materials can be coordinated with the individual Segments
`(e.g., tracks) Such that Supplemental materials relating to the
`Segments can be provided as the Segments are being pro
`vided to the user.
`Supplemental materials can include, for example, images,
`Video clips, audio clips, data, or other materials that may be
`provided to the user in conjunction with the broadcast
`materials. The Supplemental materials can also include
`advertising information that is provided to the user during
`particular Segments of the broadcast material. In one
`embodiment, this advertising information can be coordi
`nated with the particular Segments of the broadcast material
`Such that the value of the advertising is enhanced.
`
`Petitioner
`Ex. 1005 - Page 15
`
`
`
`3
`One example application of this aspect of the invention is
`found in the broadcast of radio broadcast materials over the
`Internet. According to this example application, the radio
`broadcast materials can include a plurality of tracks that can
`be streamed to a user via the Internet. The tracks can include,
`for example, music tracks, advertising tracks, DJ voice or
`introduction tracks, promotional tracks, and any other track
`that a Station my wish to broadcast as part of its broadcast
`material. In one embodiment, the tracks are provided along
`with program data that can indicate, for example, an iden
`tification of the track, the type of track, and other pertinent
`or relevant information regarding the particular track being
`broadcast at that time. This information can be provided to
`an Internet broadcast service provider that “broadcasts” the
`broadcast materials and the program data to the listener's
`Internet terminal.
`The listener receives the broadcast material and the pro
`gram data via the Internet connection and plays it on his or
`her computer, WorkStation or other Internet terminal. This
`can be a web page type player or a downloaded player that
`is resident on the user's terminal. When the user's terminal
`receives a track to be played, the user's terminal takes the
`program data associated with that track and uses that data to
`access one or more Servers to retrieve the Supplemental
`information.
`In one embodiment, the data can be used to access a first
`Server to directly retrieve the Supplemental information to be
`coordinated with the broadcast material. In another
`embodiment, the program data can be used to retrieve
`locational or other identification information from the first
`Server, and use this retrieved information to retrieve the
`Supplemental information from a Second Server. In yet
`another embodiment, Some or all of the Supplemental infor
`mation may be Stored at the listener's terminal. In this case,
`the program data is used to retrieve the Supplemental infor
`mation from local Storage.
`According to another aspect of the invention, a history bar
`can be provided in conjunction with the broadcast material.
`The history bar can be used to display a history of the
`Segments or tracks of the broadcast material that were
`broadcast to the listener or other listeners. The history bar
`can allow the listener or user to retrieve Supplemental
`information about or pertaining to a previous Segment that
`had been broadcast. Thus, if the user wishes to, for example,
`obtain information about a Song track that was played in the
`recent past, or obtain additional information about a product
`that was advertised in the recent past, the user can Select the
`particular item from the history bar, and retrieve this Supple
`mental information.
`In one embodiment, any information or Supplemental
`information that was retrieved during initial playing of the
`Subject track can be saved locally, for example in a circular
`type buffer or a FIFO or LIFO buffer. Thus, this information
`is available to the user without the need to retrieve the
`Supplemental information again from one or more Servers.
`Alternatively, only the program data needs to be stored and
`asSociated with each track. In this alternative, the user
`terminal uses the program data to retrieve the Supplemental
`information. An advantage of the history bar is that it can
`allow the user to in effect go back in time to obtain
`information about a Segment that was played in the past. In
`this manner, the information relating to the Segment is not
`lost to the user once the time for the Segment has past.
`A method and apparatus for facilitating the coordination
`of visual advertisements with audio broadcast material if
`provided in “SYSTEM AND METHOD FOR COORDI
`
`4
`NATING COMMUNICATIONS NETWORKADVERTIS
`ING MATERIALS,” Lyon & Lyon Docket No. 237/094,
`filed on even date herewith and which is owned by common
`assignee, and which is incorporated herein by reference as
`though set forth in full.
`Further features and advantages of the invention as well
`as the Structure and operation of various embodiments of the
`invention are described in detail below with reference to the
`accompanying drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The present invention is described with reference to the
`accompanying drawings. In the drawings, like reference
`numbers indicate identical or functionally Similar elements.
`FIG. 1 is a block diagram illustrating an example archi
`tecture for providing Supplemental materials in coordination
`with broadcast materials according to one embodiment of
`the invention.
`FIG. 2 is an operational flow diagram illustrating a
`process for coordinating Supplemental materials with the
`program provided to user equipment according to one
`embodiment of the invention.
`FIG. 3 is a block diagram illustrating an alternative
`embodiment to the architecture illustrated in FIG. 1.
`FIG. 4 is an operational flow diagram describing the
`coordination of Supplemental materials with the broadcast
`material according to the example embodiment illustrated in
`FIG. 3.
`FIG. 5 is a block diagram illustrating the example appli
`cation of the invention in which a radio Station provides its
`broadcast materials to a listener at a user terminal according
`to one embodiment of the invention.
`FIG. 6 is a operation flow diagram illustrating an example
`process by which Supplemental information can be coordi
`nated with the broadcast material in the example application
`illustrated in FIG. 5.
`FIG. 7 is a diagram illustrating an example user interface
`for an example player according to one embodiment of the
`invention.
`FIG. 8 is a diagram illustrating an example functional
`architecture for a player according to one embodiment of the
`invention.
`FIG. 9 is an operational flow diagram illustrating a
`process for implementing a history window according to one
`embodiment of the invention.
`FIG. 10 is a diagram illustrating an example implemen
`tation of an architecture for providing Supplemental mate
`rials with broadcast material.
`FIG. 11 is a diagram illustrating an example Song table
`and provider table according to one embodiment of the
`invention.
`FIG. 12 is a diagram illustrating an example player
`according to one embodiment of the invention.
`FIG. 13 is a diagram illustrating an example computer
`architecture according to one embodiment of the invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`The present invention is directed toward a System and
`method for coordinating Supplemental materials with broad
`cast materials delivered to a viewer, listener or other pro
`gram user. According to one Specific implementation of the
`invention, the invention is directed toward a System and
`method for coordinating Supplemental information Such as
`
`US 6,317,784 B1
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Petitioner
`Ex. 1005 - Page 16
`
`
`
`S
`advertising and promotional information with a radio Station
`broadcast over the Internet. However, as described below,
`alternative embodiments can include the coordination of
`Supplemental materials. Such as images, Video clips, audio
`clips, text, data or other materials with the delivery of
`broadcast material.
`FIG. 1 is a block diagram illustrating an example archi
`tecture for providing Supplemental materials in coordination
`with broadcast materials according to one embodiment of
`the invention. The example embodiment illustrated in FIG.
`1 includes a program provider 104 for providing broadcast
`materials to a user equipment 112. Program provider 104 can
`provide, for example, broadcast materials. Such as a radio
`program, a Video program, or other broadcast materials on
`another program medium. For example, in one embodiment,
`program provider 104 can be a radio Station broadcasting its
`radio program to a number of listeners.
`Program provider 104 can provide its broadcast materials
`directly to a user's user equipment 112 or alternatively, via
`a broadcast provider 108. Broadcast provider 108 may be
`included to allow the broadcast material to be forwarded to
`the user via an alternative medium. For example, in one
`embodiment, an example of a broadcast provider 108 can be
`a Service provider Such as, for example, www.broadcast.com
`that provides radio broadcast materials to user equipment
`112 via the Internet. In this document, the term “broadcast'
`is used to describe the delivery of broadcast materials to one
`or more than one user or other destination via a hard-wired
`or wireleSS communication channel.
`Depending on the broadcast or delivery medium, the user
`equipment can include, for example a processor-based
`System, Such as a personal computer (PC) or other
`processor-based System, having an appropriate communica
`tion interface. In the Internet embodiment described above,
`user equipment 112 can include, for example, an Internet
`terminal having an Internet communication interface.
`In the embodiment illustrated in FIG. 1, program provider
`104 provides information pertaining to the broadcast mate
`rials to a data Server 116. For example, program provider
`104 can provide to data server 116 an identification of the
`broadcast materials that are being broadcast or otherwise
`provided to user equipment 112. This data can be sent in real
`time as the broadcast materials are being broadcast or
`otherwise Sent to user equipment 112. Alternatively, the data
`can be sent in advance of the delivery of the broadcast
`materials. If Sent in advance, the data preferably also
`includes a Schedule for the programming materials. Such that
`Supplemental information associated with the broadcast
`materials can be coordinated with the broadcast materials, as
`discussed below.
`In operation, data Server 116 utilizes the data received
`from program provider 104 to retrieve Supplemental mate
`rials related to the broadcast materials and to provide those
`Supplemental materials to user equipment 112 in coordina
`tion with the broadcast materials. Thus, in one embodiment,
`Data server 116 uses the data from program provider 104 to
`retrieve the associated Supplemental materials from its one
`or more data Storage databases 118 and provide these
`materials to user equipment 112.
`In the context of the radio Station example, data from
`program provider 104 can include event codes identifying
`the item being broadcast to user equipment 112. Event codes
`can be codes indicating, for example, a current Song being
`played, an advertising Spot being played, or other material in
`the Stream of broadcast materials being broadcast by pro
`gram provider 104. Continuing in this example Scenario,
`
`5
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,317,784 B1
`
`6
`data Server 116 can retrieve Supplemental information per
`taining to the Specific item of programming being broadcast
`Such as, for example, images, Video clips, or textual data
`relating to the material being broadcast.
`In an alternative embodiment, the Supplemental materials
`are not necessarily Stored in databases 118 of data Server
`116. Instead, the Supplemental materials can be Stored in one
`or more external databases 122 associated with one or more
`external servers 120. Thus, also illustrated in FIG. 1 is a
`material server 120 and its associated database 122. In this
`embodiment, when data server 116 uses the data from
`program provider 104 to retrieve locational or other identi
`fication information about the Supplemental information to
`be coordinated with a broadcast. Data server 116 provides
`this locational or identification information to user equip
`ment 112. User equipment 112 then uses this locational or
`other identification information to access server 120 to
`retrieve the associated Supplemental materials from one or
`more material servers 120.
`FIG. 2 is an operational flow diagram illustrating a
`process for coordinating Supplemental materials with the
`program provided to user equipment 112 according to one
`embodiment of the invention. Referring now to FIG. 2, in a
`step 132, program provider 104 delivers its broadcast mate
`rials to user equipment 112. AS Stated above, the broadcast
`materials can be audio, video or other broadcast materials
`including, for example, a radio broadcast, a television
`broadcast, an educational broadcast or other delivery of
`broadcast materials to a user equipment 112. AS illustrated
`in FIG. 1, delivery of the broadcast materials can also be
`accomplished via an intermediary broadcast provider 108. In
`one example, the intermediary broadcast provider 108 can
`be, for example, an Internet provider 108, or other interme
`diary provider.
`In a step 134, program provider 104 delivers data per
`taining to the broadcast materials to data server 116. This
`data can include, for example in one embodiment, data
`identifying the broadcast material or the particular portion of
`broadcast material currently being broadcast to user equip
`ment 112. This data can be provided in real time as the
`broadcast material is being provided to user equipment 112,
`or, alternatively, in advance of delivery of the broadcast
`material.
`AS described above with reference to FIG. 1, there are at
`least two alternative embodiments by which the Supplemen
`tal materials can be provided to user equipment 112 in
`coordination with the broadcast materials. Each of these
`embodiments are described with reference to FIG. 2 and are
`illustrated as parallel flow paths in the diagram of FIG. 2. In
`a Step 136, data Server 116 uses the data from program
`provider 104 to retrieve the supplemental materials from
`data base 118. AS Stated, these Supplemental materials can
`include, for example, audio, Video, image, data, or other
`information.
`In a step 138, data server 116 provides the retrieved
`Supplemental materials to user equipment 112 Such that they
`can be played, displayed, or otherwise provided to the user
`in coordination with the broadcast materials. In one embodi
`ment the data is provided to data server 116 in real time as
`the broadcast material is provided to user equipment 112. In
`this embodiment, data server 116 can simply retrieve the
`Supplemental materials and provide them to user equipment
`112 as the Server receives the data from program provider
`104. Alternatively, where the data is provided by program
`provider 104 in advance of the broadcast material, data
`server 116 can build a schedule for retrieval of the Supple
`
`Petitioner
`Ex. 1005 - Page 17
`
`
`
`7
`mental materials and their delivery to user equipment 112. In
`these or other alternatives, the Supplemental materials are
`provided to user equipment 112 Such that they can be
`presented to user equipment 112 in coordination with the
`broadcast materials. In a step 140, the Supplemental mate
`rials can be played, displayed, or otherwise provided to the
`user in coordination with the broadcast materials.
`Referring now to the parallel path of FIG. 2, in a step 142,
`the data server 116 uses the data from program provider 104
`to retrieve Supplemental material parameters from database
`118. These parameters can include, for example, locational
`or other identification information pertaining to the Supple
`mental materials. In one embodiment, this information pro
`vides an identification of where user equipment 112 may
`locate Supplemental materials on another Server Such as, for
`example, Server 120. These retrieved parameters are pro
`Vided to user equipment 112.
`User equipment 112 then uses this information to retrieve
`the Supplemental materials from another location. In one
`embodiment, user equipment 112 access Server 120 to
`retrieve the Supplemental materials from database 122. This
`is illustrated by a step 144.
`This data is now available to user equipment 112 in
`coordination with the broadcast materials. Thus, in a step
`146, the Supplemental materials can be played, displayed, or
`otherwise provided to the user in coordination with the
`broadcast materials. AS with the previous embodiment, data
`from program provider 104 can be presented in real time or
`in advance of the broadcast materials.
`In one embodiment, user equipment 112 can include the
`processing ability to either receive the Supplemental mate
`rials from server 116 and provide them to the user in
`coordination with the broadcast materials or to retrieve the
`Supplemental materials from material Server 120 and pro
`vide them to the user in coordination with the broadcast
`materials. For example, in one embodiment, user equipment
`112 is a computer System capable of receiving information
`via communication links including, for example, the
`Internet, and also capable of retrieving information using
`Similar linkS. Where user equipment 112 is a computer
`System, a player may be provided to the user Such that the
`user equipment 112 can play the broadcast material and the
`Supplemental materials provided from program provider
`104.
`FIG. 3 is a block diagram illustrating an alternative
`embodiment to the architecture illustrated in FIG.1. Accord
`ing to the alternative illustrated in FIG. 3, program data
`relating to the broadcast material is not directly provided
`from program provider 104 to data server 116. Instead, in
`this embodiment, data pertaining to the broadcast materials
`is provided along with the broadcast materials to the user
`equipment 112. This can be done either directly, or via an
`interim provider Such as, for example, broadcast Internet
`service provider 108.
`FIG. 4 is an operational flow diagram describing the
`coordination of Supplemental materials with the broadcast
`material according to