Ulllted States Patent [19]
`Philyaw et al.
`
`US006098106A
`[11] Patent Number:
`[45] Date of Patent:
`
`6,098,106
`Aug. 1, 2000
`
`[54] METHOD FOR CONTROLLING A
`COMPUTER WITH AN AUDIO SIGNAL
`
`5,357,276 10/1994 Banker et a1. ............................ .. 348/7
`5,438,355
`8/1995 Palmer ...................................... .. 348/1
`
`_
`_
`[75] Inventors: Je?'ry Jovan Phllyaw, Dallas; David
`Kent Mathews, Carrollton; Brad
`MaXWell Smith, Irving; Paul S60v9“
`Adams, Dallas, all of TeX.
`
`[73] Assignee: DigitalC0nvergence.c0m inc., Dallas,
`Tex
`
`[21] Appl' NO‘: 09/151’530
`[22] Filed:
`Sep_ 11’ 1998
`
`Int. (:1-7 ........................... ..
`[52] US. Cl. ........................ .. 709/238; 709/218; 709/219;
`709/224; 709/239
`[58] Field of Search ................................... .. 709/238, 239,
`709/245> 218> 224> 719; 345/327
`_
`References Clted
`
`[56]
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`0 152 341
`8/1985 European Pat. on. .
`2 692 613 9/1994 France ,
`O 601 437 A1 6/1994 Germany .
`WO 91/03891
`3/1991 WIPO .
`WO 95/28044 10/1995 WIPO .
`OTHER PUBLICATIONS
`“Integrating Traditional Media with the Web”, web page
`located at wwwwebchoicetv.com/products, 4 pages, by Web
`Choice, Inc., Santa Monica, CA.
`Web page for Symbol, located at WWWSymbOLCOn/l, 5 pages_
`“Symbol CyberPen (previously know as InfoPen)”, web
`page located at WWW.symbol.com/products/consumer sys
`[ems/Consumer CyberPen, 2 pages
`Primary Examiner—Zarni Maung
`Assistant Examiner—Almari Romero
`Attorney, Agent, or Firm—Gregory M. Howison
`
`U.S. PATENT DOCUMENTS
`
`[57]
`
`ABSTRACT
`
`6/1972 Yamamoto et a1. .................... .. 348/17
`3,668,312
`8/1977 Pakenham et al. ..................... .. 179/90
`4,042,792
`4,621,259 11/1986 Schepers'et 8.1.
`..................... ..
`4,654,482
`3/1987 DeAngehs ~ ~ ~ ~ ~ ~ ~ ~
`- - - - ~~ 379/95
`4’816’9O4
`3/1989 MhcK‘zlnna et a1‘
`348/ 1;
`2511a;
`"" "
`Z6
`1/1990 Yer]: ...........
`................. .. 348/552
`4,894,789
`4 899 370 M1990 Kameo et aL
`379/1O4
`4Z9O5ZO94
`2/1990 Pocock et a1_
`386/106
`4,907,264
`3/1990 seiler et a1, ,,,, ,,
`__ 379/216
`4,937,853
`6/1990 Brule et a1.
`379/91
`4,947,028
`8/1990 60mg ------------- ~~
`235/380
`4J975J948 12/1990 Anfhesen et a1~
`379/355
`2984425 1/1991 Geler ethal' """ "
`" 36445401
`514232542‘
`£31150‘??? '
`""
`364/514
`5’189’630
`2/1993 Barstzw ct
`_____ __ 348/7
`572477347
`9/1993 Litteral et aL
`__ 348/461
`5,262,860 11/1993 Fitzpatrick et a1_
`_ _ _ _ __ 348/10
`5,285,278
`2/1994 Holman _ _ _ _ _ _ _ _ _ _ _ _ _
`348/473
`5,287,181
`2/1994 Holman
`...... .. 705/1
`5,305,195
`4/1994 Murphy .
`5,319,454
`6/1994 Schutte ................................... .. 348/5.5
`
`A method for controlling a computer by inputting an analog
`signal into the computer to control a web browser software
`application' The analog Signal Contains a trigger Signal
`which activates proprietary software, and a product identi
`?er. The proprietary software launches the web browser
`application on the computer, extracts the product identi?er,
`and Creates an appended data String by appending Server
`address (URL) routing information to the product identi?er
`information. The appended data string is automatically
`inserted into the web browser as keystroke data and routed
`to an advertiser reference server. The appended routing
`information directs communication to the advertiser refer
`ence server which contains a cross-referenced database of
`advertiser product identi?er information and associated
`advertiser server URLs. The advertiser server URL and a
`request for product information relevant to the product
`identi?er is returned to the computer web browser where it
`is automatically redirected to the advertiser server contain
`ing the advertiser product information. The advertiser prod
`uct information is then returned to the computer for display.
`
`18 Claims, 6 Drawing Sheets
`
`GLOBAL
`COMMUNlCATlON
`NETWORK
`
`|
`l
`| ADVERTISER |
`: DATABASE 1|
`
`Google Ex. 1014
`
`

`

`6,098,106
`Page 2
`
`US. PATENT DOCUMENTS
`
`5,905,251
`5,905,665
`5,905,865
`
`5/1999 Knowles .......................... .. 235/472.01
`5/1999 Rim ....................................... .. 364/746
`5/1999 116161616161. ................... .. 395/200.47
`
`5,907,793
`
`5/1999 Reams . . . . . . . . .
`
`. . . . .. 455/3.1
`
`g’gg’gzg $333
`
`etal' """"""""""""" " 32:53;
`
`I .................................. ..
`g
`,
`,
`7/1999 Broadwrn et a1. .................... .. 345/327
`5,929,850
`5,933,468 11/1998 Guy et a1. ............................. .. 434/350
`
`- 709/219
`9/1999 Meniman e191-
`5,948,061
`434/307 R
`9/1999 Redford et a1. .
`5,957,695
`9/1999 Hartman et a1. ........................ .. 705/26
`5,960,411
`5,961,603 10/1999 Kunkel et a1. ........................ .. 709/229
`5,970,471 10/1999 Hill ........... ..
`705/26
`5,970,472 10/1999 Allsop et a1. ..
`.... .. 705/26
`5,971,277 10/1999 Cragun et al.
`235/462.01
`
`27:22:38 3133; 51311215356‘ a1~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~453512Z
`5,491,508
`2/1996 Friedell et a1.
`.. 348/16
`5,570,295 10/1996 Isenberg 6161.
`379/9001
`
`"" "
`
`'
`
`’
`
`’
`
`5,572,643 11/1996 Judson ~~~~~ "
`575927551
`1/1997 Len et a1‘
`5594226 1/1997 Steger
`
`6/1997 Wellner .... ..
`5,640,193
`9/1997 Green et aL
`576647110
`5,675,721 10/1997 Freedman et a1_
`5,694,163 12/1997 Harrison __________ __
`5,708,780
`1/1998 Levergood et a1.
`5,715,314
`2/1998 Payne et a1. .... ..
`5,724,424
`3/1998 Gifford
`
`395/793
`380/20
`" 235/379
`
`348/7
`705/26
`__ 395/129
`348/13
`.. 709/229
`705/78
`705/79
`
`5,754,906
`
`5/1998 Yoshida
`
`.. 396/448
`
`5,974,443 10/1999 Jeske . . . . . . . . . . .
`
`. . . .. 709/202
`
`455/6.2
`6/1998 Wolzien ..
`5,761,606
`.. 709/231
`6/1998 Stumm ..... ..
`5,768,528
`.. 709/218
`6/1998 Hidary et a1.
`5,774,664
`. 705/14
`6/1998 Storey ...... ..
`5,774,870
`707/10
`7/1998 Wesinger, Jr. .
`5,778,367
`.. 709/218
`8/1998 Higley .......... ..
`5,790,793
`705/14
`8/1998 Goldhaber et a1.
`5,794,210
`305/200.54
`8/1998 Davis et a1. .... ..
`5,796,952
`. 709/224
`5,854,897 12/1998 RadZieWicZ et a1.
`5,864,823
`1/1999 Levitan ................................... .. 105/14
`
`.709/218
`5,974,451 10/1999 Simmons
`435/69.1
`5,976,833 11/1999 Furukawa e161.
`. 709/219
`5,978,773 11/1999 HudetZ et a1. ..
`705/26
`5,991,739 11/1999 Cupps et a1.
`. 345/327
`6,002,394 12/1999 Schein et a1.
`. 709/219
`6,003,073 12/1999 Solvason ..
`. 709/219
`6,006,257 12/1999 Slezak .... ..
`. 709/219
`6,009,410 12/1999 LeMOle et a1.
`. 709/219
`6,009,465 12/1999 Decker et a1. ..
`6,018,764
`1/2000 Field 6161. ............................ .. 709/217
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1, 2000
`
`Sheet10f6
`
`6,098,106
`
`ADVERTISER
`DATA INPUT
`
`x100
`
`'1/01
`
`“4
`
`109)[
`
`1
`
`H0 111
`
`DISPLAY
`
`RECEIVER
`
`AUDIO _
`
`\
`1 1
`
`PC
`
`AUDIO MODULATE
`
`Tv PROGRAM
`SOURCE
`/
`104
`
`_/-1 18
`14
`1
`/
`
`—> MODEM
`\A
`1 12
`
`PROGRAM
`1 16/ INFORMATION
`
`TO
`NETWORK
`
`DISPLAY
`
`118
`./
`
`FIG.
`
`1
`
`O
`
`109 IRE
`
`CEIVER
`
`F I G. 2
`
`NETWORK
`
`110
`
`CEIVER
`
`TR
`
`108
`
`SOUND /2O5
`CARD
`
`CPU
`
`> MODEM
`
`\208
`
`A61 I 1
`
`pC
`
`x302
`
`FIG. 3
`
`306
`
`II
`
`0 C
`
`Bmo
`ONW
`GWN
`ILUH
`Mum
`
`N m
`
`ADVERTISER
`SERVER
`
`S816
`
`\ _ IADTTERTTSERAT
`I
`SERVER
`I
`
`l- _ _ _ _ _ _ .J
`
`ADVERTISER
`DATABASE
`
`1 ADVERTISER |
`1 DATABASE '1
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1,2000
`
`Sheet 2 0f6
`
`6,098,106
`
`PATH A: SOURCE To ARS
`4OO\
`URL OF
`ARS
`
`PATH B: ARS TO SOURCE
`4O2\
`URL OF
`SOURCE
`
`ADVERTISER
`PRODUCT CODE
`FIG. 4a,
`
`URL OF
`SOURCE
`
`URL OF
`ADVERTISER
`FIG. 4 b
`
`URL OF
`ARS
`
`PATH C: SOURCE TO ADVERTISER
`404\
`URL OF
`REQUEST-FOR-
`ADVERTISER
`INFORMATION
`FIG. 40
`
`PATH D: ADVERTISER TO SOURCE
`406\
`URL 0F
`REQUESTED
`SOURCE
`INFORMATION
`FIG. 4d
`
`PATH E: ARS TO ADVERTISER (OPTIONAL)
`408\
`URL OF
`REQUEST FOR
`ADVERTISER
`INFORMATION
`FIG. 42
`
`URL OF
`SOURCE
`
`URL 0F
`ADVERTISER
`
`URL OF
`SOURCE
`
`I
`
`START I
`
`500
`
`RECEIVE
`
`MESSAGE? PACKET
`
`NO
`
`502/
`
`DECODE PACKET
`I
`604/ EXTRACT PRODUCT CODE
`
`I
`LOOK UP URL OF
`_
`ADVERTISER
`BASED ON CODE
`I
`ASSEMBLE PACKET
`I
`SEND To SOURCE
`(PATH B)
`
`f606
`
`r608
`
`x610
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1, 2000
`
`Sheet 3 0f 6
`
`6,098,106
`
`@
`
`RECEIVE ARS PACKET f 700
`I
`EXTRACT URL OF
`ADVERTISER PRODUCT
`INFORMATION
`I
`SEND MESSAGE TO
`ADVERTISER
`SERVER (PATTI c)
`I
`WAIT
`
`r702
`
`r706
`
`O4
`
`(
`
`START )
`
`500
`
`DECODE THE
`FOLLOWING DATA
`I
`BUFFER THE DATA
`
`522
`/
`GNAL FOR
`SI
`
`RET RANMISSION
`I
`DISCARD
`
`LAUNCH WEB BROWSER f508
`I
`INSERT URL DATA
`INTO WEB BROWSER
`I
`SEND URL TO
`GLOBAL NETWORK
`I
`ARS SERVER RESPONDS
`WITH URL OF
`ADVERTISER SERVER
`I
`PC TRANSMITS REQUEST
`FOR PRODUCT INFORMATION
`TO ADVERTISER SERVER
`I
`ADVERTISER SERVER
`SENDS PRODUCT
`INFORMATION TO PC
`
`(E
`
`FIG. 5
`
`[708
`
`"\
`
`710
`
`, ADVERTISER
`SERVER
`
`RECEIVE SOURCE
`PACKET
`I
`EXTRACT PRODUCT
`INFORMATION
`FILE LOCATION
`I
`TRANSMIT PRODUCT
`INFORMATION To
`souRcE (PATH D)
`
`Oi RETURN
`
`I
`PROCESS ADVERTISER
`INFORMATION
`
`@@
`
`FIG. 7
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1,2000
`
`Sheet 4 0f6
`
`6,098,106
`
`DISPLAY
`
`F
`
`W
`
`800
`\
`
`BROWSER PAGE
`
`804
`800
`\
`K
`http://URL[/?][ADVERTISER DATA]
`
`8&2
`
`k
`
`R
`
`|
`
`O O
`
`|
`
`J
`
`|
`
`808\
`
`URL/ADVERTISER DATA
`'[Ctrl—O][http://][URL][/?][vOriOb|e][.J ]‘
`FIG. 8
`OPEN PAGE‘—|
`
`USE HYPERTEXT PROTOCOL
`URL OF ARS
`ALLOW VARIABLE APPENDING
`APPENDED VARIABLE (e.g., UPC CODE)
`CARRIAGE RETURN — TRANSMIT DATA
`
`902
`
`904\(R0UT]NG
`INFORMATION)
`
`906
`\
`
`910
`/
`
`912
`/
`
`_
`
`_
`
`REMOTE
`
`' NET
`
`PC
`I
`USER \908
`
`INFORMATION
`
`FIG. 9
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1,2000
`
`Sheet 5 0f6
`
`6,098,106
`
`902
`
`1002
`\
`
`910
`/
`
`PC
`904 \ (ROUTING
`I
`INFORMATION)
`908/ USER
`
`F10 70
`
`NET
`|
`REMOTE
`INFORMATION
`k_,\
`912
`
`1004
`/
`
`~
`
`PC
`
`o
`1006
`DATABASE
`
`PRIMARY ROuTINO
`INFORMATION
`
`I
`PRIMARY ROUTING
`INFORMATION
`
`FIG. 7 7
`
`SECONDARY ROUTING
`INFORMATION
`
`VIDEO SOURCE
`
`OPTICAL REGION
`1204_/_
`
`[1202
`
`/
`902
`SENSED VIDEO
`FIG. 7 2
`
`906
`\
`
`PC
`
`910
`/
`
`NET
`|
`
`912
`/
`REMOTE
`INFORMATION
`
`908/- USER
`
`902
`
`1302
`
`ID
`
`[1304
`
`DATABASE
`
`904\(R0UIIN<;
`INFORMATION) 905T
`
`PC
`
`"
`/ USER
`908
`7 3
`
`312I
`
`F I G .
`
`310
`
`INTERMEDIATE
`DESTINATION
`TABLES
`
`910
`
`\ I
`
`NET
`A
`
`= SUBSCRIBER A312
`
`_
`
`REMOTE [91
`INFORMATION
`2
`
`‘
`
`©
`BILLING
`\1316
`
`TRANSACTION
`
`I 31 O
`
`Google Ex. 1014
`
`

`

`U.S. Patent
`
`Aug. 1,2000
`
`Sheet 6 0f6
`
`6,098,106
`
`@1 402
`
`PROMPT FOR PROFILE r1404
`
`1406
`
`14l0
`ENTER SPECIFIC
`INFORMATION, JOBS,
`INOOME, HISTORY,
`DEMOGRAPHICS, ETC.
`v<
`sTORE LOCALLY
`
`1414
`
`O0
`ON LINE TO
`HOST?
`
`I408
`/
`ENTER BASIC
`INFORMATION
`
`r1412
`
`1415
`/
`SET FOR LATER
`
`1506-\_
`
`RX PRIMARY ROUTING
`INFORMATION
`AND USER ID
`I
`LOOK UP MANUFACTURER'S
`1508/
`URL AND RETURN
`4'
`
`1510/
`
`UPDATE TRANsAcTION
`DATABASE FOR
`CURRENT TRANsAcTION
`
`sTART CONNECT PROCESS \1416
`
`‘V 1314
`
`‘
`SET FOR
`LATER
`DELIVERY
`
`FORWARD TO
`MANuFAcTuRER
`‘
`
`\1520
`
`UPDATE
`1515/ BILLING
`
`=0
`1518
`END
`FIG. 1 5
`
`FIG. 74
`
`SEND PROFILE
`INFORMATION wITFI ID \1428
`I
`TERMINATE
`AND AcTIvATE
`
`“1430
`
`@1432
`
`Google Ex. 1014
`
`

`

`1
`METHOD FOR CONTROLLING A
`COMPUTER WITH AN AUDIO SIGNAL
`
`This application is related to copending US. patent
`application Ser. No. 09/151,471, entitled, “METHOD FOR
`INTERFACING SCANNED PRODUCT INFORMATION
`WITH A SOURCE FOR THE PRODUCT OVER A GLO
`BAL NETWORK” ?led of even date hereWith.
`
`6,098,106
`
`2
`region having a de?ned location. Aprogram is broadcasted
`having embedded therein a routing signal having routing
`information contained therein. The routing signal is then
`extracted from the broadcast. Thereafter, a personal com
`puteris controlled to alloW a user to retrieve the information
`from a storage region at the de?ned location, Which de?ned
`location is located With the extracted routing information,
`providing it at the personal computer for use by the user.
`
`TECHNICAL FIELD OF THE INVENTION
`
`10
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`This invention is related to a method of computer control,
`and particularly for automatically directing a Web broWser
`application on the computer to retrieve and display infor
`mation in response to an analog signal.
`
`BACKGROUND OF THE INVENTION
`
`With the groWing numbers of computer users connecting
`to the “Internet,” many companies are seeking the substan
`tial commercial opportunities presented by such a large user
`base. For example, one technology Which exists alloWs a
`television (“TV”) signal to trigger a computer response in
`Which the consumer Will be guided to a personaliZed Web
`page. The source of the triggering signal may be a TV, video
`tape recorder, or radio. For example, if a vieWer is Watching
`a TV program in Which an advertiser offers vieWer voting,
`the advertiser may transmit a unique signal Within the
`television signal Which controls a program knoWn as a
`“broWser” on the vieWer’s computer to automatically dis
`play the advertiser’s Web page. The vieWer then simply
`makes a selection Which is then transmitted back to the
`advertiser.
`In order to provide the vieWer With the capability of
`responding to a Wide variety of companies using this
`technology, a database of company information and Uni
`form Resource Locator (“URL”) codes is necessarily main
`tained in the vieWer’s computer, requiring continuous
`updates. URLs are short strings of data that identify
`resources on the Internet: documents, images, doWnloadable
`?les, services, electronic mailboxes, and other resources.
`URLs make resources available under a variety of naming
`schemes and access methods such as HTTP, FTP, and
`Internet mail, addressable in the same simple Way. URLs
`reduce the tedium of “login to this server, then issue this
`magic command .
`.
`. ” doWn to a single click. The Internet
`uses URLs to specify the location of ?les on other servers.
`A URL includes the type of resource being accessed (e.g.,
`Web, gopher, FTP), the address of the server, and the
`location of the ?le. The URL can point to any ?le on any
`netWorked computer. Current technology requires the
`vieWer to perform periodic updates to obtain the most
`current URL database. This aspect of the current technology
`is cumbersome since the update process requires doWnload
`ing information to the vieWer’s computer. Moreover, the
`likelihood for error in performing the update, and the
`necessity of redoing the update in the event of a later
`computer crash, further complicates the process.
`Additionally, current technologies are limited in the number
`of companies Which may be stored in the database. This is
`a signi?cant limitation since WorldWide access presented by
`the Internet and the increasing number of companies con
`necting to perform on-line commerce necessitates a large
`database.
`
`SUMMARY OF THE INVENTION
`
`The present invention disclosed and claimed herein com
`prises a method for retrieving information from a storage
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`For a more complete understanding of the present inven
`tion and the advantages thereof, reference is noW made to
`the folloWing description taken in conjunction With the
`accompanying DraWings in Which:
`FIG. 1 illustrates a block diagram of the preferred
`embodiment;
`FIG. 2 illustrates the computer components employed in
`this embodiment;
`FIG. 3 illustrates system interactions over a global net
`Work;
`FIGS. 4a—4e illustrate the various message packets trans
`mitted betWeen the source PC and netWork servers used in
`the preferred embodiment; and
`FIG. 5 is a ?oWchart depicting operation of the system
`according to the preferred embodiment.
`FIG. 6 illustrates a ?oWchart of actions taken by the
`Advertiser Reference Server (“ARS”) server;
`FIG. 7 illustrates a ?oWchart of the interactive process
`betWeen the source computer and ARS;
`FIG. 8 illustrates a Web broWser page receiving the
`modi?ed URL/advertiser product data according to the
`preferred embodiment;
`FIG. 9 illustrates a simpli?ed block diagram of the
`disclosed embodiment;
`FIG. 10 illustrates a more detailed, simpli?ed block
`diagram of the embodiment of FIG. 9;
`FIG. 11 illustrates a diagrammatic vieW of a method for
`performing the routing operation;
`FIG. 12 illustrates a block diagram of an alternate
`embodiment utiliZing an optical region in the video image
`for generating the routing information;
`FIG. 13 illustrates a block diagram illustrating the gen
`eration of a pro?le With the disclosed embodiment;
`FIG. 14 illustrates a ?oWchart for generating the pro?le
`and storing at the ARS; and
`FIG. 15 illustrates a ?oWchart for processing the pro?le
`information When information is routed to a user.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`55
`
`60
`
`65
`
`Referring noW to FIG. 1, there is illustrated a block
`diagram of a system for controlling a personal computer
`(“PC”) 112 via an audio tone transmitted over a Wireless
`system utiliZing a TV. In the embodiment illustrated in FIG.
`1, there is provided a transmission station 101 and a receive
`station 117 that are connected via a communication link 108.
`The transmission station 101 is comprised of a television
`program source 104, Which is operable to generate a pro
`gram in the form of a broadcast signal comprised of video
`and audio. This is transmitted via conventional techniques
`along channels in the appropriate frequencies. The program
`source is input to a mixing device 106, Which mixing device
`is operable to mix in an audio signal. This audio signal is
`
`Google Ex. 1014
`
`

`

`3
`derived from an audio source 100 Which comprises a coded
`audio signal Which is then modulated onto a carrier Which is
`combined With the television program source 104. This
`signal combining can be done at the audio level, or it can
`even be done at the RF level in the from of a different carrier.
`HoWever, the preferred method is to merely sum the audio
`signal from the modulator 102 into the audio channel of the
`program that is generated by the television program source
`104. The output thereof is provided from the mixing device
`106 in the form of broadcast signal to an antenna 107, Which
`transmits the information over the communication link 108
`to an antenna 109 on the receive side.
`On the receive side of the system, a conventional receiver
`110, such as a television is provided. This television pro
`vides a speaker output Which provides the user With an
`audible signal. This is typically associated With the program.
`HoWever, the receiver 110 in the disclosed embodiment, also
`provides an audio output jack, this being the type RCA jack.
`This jack is utiliZed to provide an audio output signal on a
`line 113 Which is represented by an audio signal 111. This
`line 113 provides all of the audio that is received over the
`communication link 108 to the PC 112 in the audio input
`port on the PC 112. HoWever, it should be understood that,
`although a direct connection is illustrated from the receiver
`110 to the PC 112, there actually could be a microphone
`pickup at the PC 112 Which could pick the audio signal up.
`In the disclosed embodiment the audio signal generated by
`the advertiser data input device 100 is audible to the human
`ear and, therefore, can be heard by the user. Therefore, no
`special ?lters are needed to provide this audio to the PC 112.
`The PC 112 is operable to run programs thereon Which
`typically are stored in a program ?le area 116. These
`programs can be any type of programs such as Word pro
`cessing programs, application programs, etc. In the dis
`closed embodiment, the program that is utiliZed in the
`system is What is referred to as a “broWser.” The PC 112 runs
`a broWser program to facilitate the access of information on
`the netWork, for example, a global communication netWork
`knoWn as the “Internet” or the World-Wide-Web (“Web”).
`The broWser is a hypertext-linked application used for
`accessing information. Hypertext is a term used to describe
`a particular organiZation of information Within a data pro
`cessing system, and its presentation to a user. It exploits the
`computer’s ability to link together information from a Wide
`variety of sources to provide the user With the ability to
`explore a particular topic. The traditional style of presenta
`tion used in books employs an organiZation of the informa
`tion Which is imposed upon it by limitations of the medium,
`namely ?xed siZed, sequential paper pages. Hypertext
`systems, hoWever, use a large number of units of text or
`other types of data such as image information, graphical
`information, video information, or sound information, Which
`can vary in siZe. A collection of such units of information is
`termed a hypertext document, or Where the hypertext docu
`ments employ information other than text, hypermedia
`documents. Multimedia communications may use the
`Hypertext Transfer Protocol (“HTTP”), and ?les or format
`ted data may use the Hypertext Markup Language
`(“HTML”). This formatting language provides for a min
`gling of text, graphics, sound, video, and hypertext links by
`“tagging” a text document using HTML. Data encoded
`using HTML is often referred to as an “HTML document,”
`an “HTML page,” or a “home page.” These documents and
`other Internet resources may be accessed across the netWork
`by means of a netWork addressing scheme Which uses a
`locator referred to as a Uniform Resource Locator (“URL”),
`for example, “http://WWW.digital.com.”
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`6,098,106
`
`4
`The Internet is one of the most utiliZed netWorks for
`interconnecting distributed computer systems and alloWs
`users of these computer systems to exchange data all over
`the World. Connected to the Internet are many private
`netWorks, for example, corporate or commercial netWorks.
`Standard protocols, such as the Transport Control Protocol
`(“TCP”) and the Internet Protocol (“IP”) provide a conve
`nient method for communicating across these diverse net
`Works. These protocols dictate hoW data are formatted and
`communicated. As a characteristic of the Internet, the pro
`tocols are layered in an IP stack. At higher levels of the IP
`stack, such as the application layer (Where HTTP is
`employed), the user information is more readily visible,
`While at loWer levels, such as the netWork level (Where
`TCP/IP are used), the data can merely be observed as
`packets or a stream of rapidly moving digital signals.
`Superimposed on the Internet is a standard protocol interface
`for accessing Web resources, such servers, ?les, Web pages,
`mail messages, and the like. One Way that Web resources can
`be accessed is by broWsers made by Netscape® and
`Microsoft Internet Explorer®.
`Referring again noW to FIG. 1, the user can load this
`program With the appropriate keystrokes such that a broWser
`WindoW Will be displayed on a display 118. In one
`embodiment, the user can run the broWser program on the
`PC 112 such that the broWser WindoW is displayed on the
`display 118. While Watching a preferred program, the user
`can also vieW display 118. When an audio signal is received
`by the receiver 110 and the encoded information is contained
`therein that Was input thereto by the advertiser, the PC 112
`Will then perform a number of operations. The ?rst
`operation, according to the disclosed embodiment, is to
`extract the audio information Within the received audio
`signal in the form of digital data, and then transmit this
`digital data to a de?ned location on the global communica
`tion netWork via a modem connection 114. This connection
`Will be described hereinbeloW. This information Will be
`relayed to a proprietary location and the instructions sent
`back to the PC 112 as to the location of the advertiser
`associated With the code, and the PC 112 Will then effect a
`communication link to that location such that the user can
`vieW on the display 118 information that the advertiser, by
`the fact of putting the tone onto the broadcast channel,
`desires the vieWer to vieW. This information can be in the
`form of interactive programs, data ?les, etc. In one example,
`When an advertisement appears on the television, the tone
`can be generated and then additional data displayed on the
`display 118. Additionally, a streaming video program could
`be played on the PC received over the netWork, Which
`streaming video program is actually longer than the adver
`tising segment on the broadcast. Another example Would be
`a sports game that Would broadcast the tone in order to alloW
`a user access to information that is not available over the
`broadcast netWork, such as additional statistics associated
`With the sports program, etc.
`By utiliZing the system described herein With respect to
`the disclosed embodiment of FIG. 1, an advertiser is alloWed
`the ability to control a user’s PC 112 through the use of tones
`embedded Within a program audio signal. As Will descried
`hereinbeloW, the disclosed embodiment utiliZes particular
`routing information stored in the PC 112 Which alloWs the
`encoded information in the received audio signal to route
`this information to a desired location on the netWork and
`then alloW other routing information to be returned to the PC
`112 for control thereof to route the PC 112 to the appropriate
`location associated With that code.
`Referring noW to FIG. 2, there is illustrated a computer
`204, similar to computer 112, connected to display infor
`
`Google Ex. 1014
`
`

`

`15
`
`25
`
`35
`
`5
`mation on display 118. The computer 204 comprises an
`internal audio or “sound” card 206 for receiving the trans
`mitted audio signal through receive antenna 109 and
`receiver 110. The sound card 206 typically contains analog
`to-digital circuitry for converting the analog audio signal
`into a digital signal. The digital signal may then be more
`easily manipulated by softWare programs. The receiver 110
`separates the audio signal from the video signal. A special
`trigger signal located Within the transmitted advertiser audio
`signal triggers proprietary softWare running on the computer
`204 Which launches a communication application, in this
`particular embodiment, the Web broWser application located
`on the PC 204. Coded advertiser information contained
`Within the audio signal is then extracted and appended With
`the address of a proprietary server located on the commu
`nication netWork. The remote server address is in the form
`of a URL. This appended data, in addition to other control
`codes, is inserted directly into the Web broWser application
`for automatic routing to the communication netWork. The
`Web broWser running on PC 204, and communicating to the
`netWork With a through an internal modem 208, in this
`embodiment, transmits the advertiser information to the
`remote server. The remote server cross-references the adver
`tiser product information to the address of the advertiser
`server located on the netWork. The address of the advertiser
`server is routed back through the PC 204 Web broWser to the
`advertiser server. The advertiser product information is
`returned to PC 204 to be presented to the vieWer on display
`118. In this particular embodiment, the particular advertiser
`product information displayed is contained Within the adver
`tiser’s Web page 212. As mentioned above, the audio signal
`is audible to the human ear. Therefore the audio signal, as
`emitted from the TV speakers, may be input to the sound
`card 206 via a microphone. Furthermore, the audio signal
`need not be a real-time broadcast, but may be on video tapes,
`CDs, DVD, or other media Which may be displayed at a later
`date. With the imminent implementation of high de?nition
`digital television, the audio signal output from the TV may
`also be digital. Therefore, direct input into a sound card for
`A/D purposes may not be necessary, but alternative inter
`facing techniques to accommodate digital-to-digital signal
`formats Would apply.
`Referring noW to FIG. 3, there is illustrated a source PC
`302, similar to PCs 204 and 112, connected to a global
`communication netWork 306 through an interface 304. In
`this embodiment, the audio signal 111 is received by PC 302
`through its sound card 206. The audio signal 111 comprises
`a trigger signal Which triggers proprietary softWare into
`launching a Web broWser application residing on the PC 302.
`The audio signal 111 also comprises advertiser product
`information Which is extracted and appended With URL
`information of an Advertiser Reference Server (“ARS”) 308.
`The ARS 308 is a system disposed on the netWork that is
`de?ned as the location to Which data in the audio signal 111
`is to be routed. As such, data in the audio signal 111 Will
`alWays be routed to the ARS 308, since a URL is unique on
`the netWork system. Connected to the ARS 308 is a database
`310 of product codes and associated manufacturer URLs.
`The database 310 undergoes a continual update process
`Which is transparent to the user. As companies sign-on, e.g.,
`subscribe, to this technology, manufacturer and product
`information is added to the database 310 Without interrupt
`ing operation of the source PC 302 With frequent updates.
`When the advertiser server address URL is obtained from
`the ARS database 310, it and the request for the particular
`advertiser product information is automatically routed back
`through the Web broWser on PC 302, over to the respective
`
`45
`
`55
`
`65
`
`6,098,106
`
`6
`advertiser server for retrieval of the advertiser product
`information to the PC 302. It should be noted that although
`the disclosed invention discusses a global communication
`netWork, the system is also applicable to LANs, WANs, and
`peer-to-peer netWork con?gurations. It should be noted that
`the disclosed architecture is not limited to a single source PC
`302, but may comprise a plurality of source PCs, e.g., PC
`300 and PC 303. Moreover, a plurality of ARS 308 systems
`and advertiser servers 312 may be implemented, e.g., ARS
`314, and advertiser server A 316, respectively.
`The information transactions, in general, Which occur
`betWeen the netWorked systems of this embodiment, over
`the communication netWork, are the folloWing. The Web
`broWser running on source PC 302 transmits a message
`packet to the ARS 308 over Path “A.” The ARS 308 decodes
`the message packet and performs a cross-reference function
`With product information extracted from the received mes
`sage packet to obtain the address of an advertiser server 312.
`A neW message packet is assembled comprising the adver
`tiser server 312 address, and sent back to the source PC 302
`over Path “B.” A “handoff” operation is performed Whereby
`the source PC 302 broWser simply reroutes the information
`on to the advertiser server 312 over Path “C,” With the
`appropriate source and destination address appended. The
`advertiser server 312 receives and decodes the message
`packet. The request-for-advertiser-product-information is
`extracted and the advertiser 312 retrieves the requested
`information from its database for transmission back to the
`source PC 302 over Path “D.” The source PC 302 then
`processes the information, i.e., for display to the vieWer. The
`optional Path “E” is discussed hereinbeloW. It should be
`noted that the disclosed methods are not limited to only
`broWser communication applications, but may
`accommodate, With sufficient modi?cations by one skilled in
`the art, other communication applications used to transmit
`information over the Internet or communication netWork.
`Referring noW to FIG. 4a, the message packet 400 sent
`from the source PC 302 to ARS 308 via Path “A” comprises
`several ?elds. One ?eld comprises the URL of the ARS 308
`Which indicates Where the message packet is to be sent.
`Another ?eld comprises the advertiser product code or other
`information derived from the audio signal 111, and any
`additional overhead information required for a given trans
`action. The product code provides a link to the address of the
`advertiser server 312, located in the database 310. Yet
`another ?eld comprises the netWork address of the source
`PC 302. In general, netWork transmissions are effected in
`packets of information, each packet providing a destination
`address, a source address, and data. These packets vary
`depending upon the netWork transmission protocol utiliZed
`for communication. Although the protocols utiliZed in the
`disclosed embodiment are of a conventional protocol suite
`commonly knoWn as TCP/IP, it should be understood that
`any protocols providing the similar basic functions can be
`used, With the primary requirement that a broWser can
`forWard the routing information to the desired URL in
`response to keystrokes being input to a PC. HoWever, it
`should be understood that any protocol can be used, With the
`primary requi