US007013283B1
`
`(12) United States Patent
`Murdock et al.
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,013,283 B1
`Mar. 14, 2006
`
`(54)
`
`(75)
`
`SYSTEM AND METHOD FOR PROVIDING
`PROGRAMMING CONTENT IN RESPONSE
`TO AN AUDIO SIGNAL
`
`Inventors: Michael Chase Murdock, Smith?eld,
`UT (US)_ John Pearson Lawrencev?le
`_’
`_
`’
`’
`IIISSUS)’ Paul sa‘lda’ New York NY
`
`(73)
`
`Assignee: (Slagio?' Corporation, Princeton, NJ
`
`EP
`
`5,835,667 A * 11/1998 Wactlar et al. .............. .. 386/96
`5,907,793 A *
`5/1999 Reams ........... ..
`725/122
`5,983,190 A * 11/1999 Trower et al. .
`704/276
`6,192,340 B1 *
`2/2001 Abecassis ....... ..
`704/270
`6,226,794 B1: 5/2001 Anders“ 6‘ al- -
`725/131
`6,314,398 B1
`11/2001 Junqua et al.
`704/257
`6,324,512 B1 * 11/2001 Junqua et al. ...... ..
`704/275
`6,535,854 B1 *
`3/2003 Buchner a a1. .......... .. 704/275
`
`FOREIGN PATENT DOCUMENTS
`0 782 337 A2
`7/1997
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U_S_C_ 154(k)) by 401 days_
`
`Appl. N0.: 09/714,838
`
`Filed:
`
`Nov. 16, 2000
`
`* cited by examiner
`_
`_
`_
`P r 1'11” y Exammer—Da_V1d D' Knepper
`Assistant Examzner—Q1 Han
`(74) Attorney, Agent, or Firm—Lowenstein Sandler
`
`(57)
`
`ABSTRACT
`
`(21)
`(22)
`
`(60)
`
`(51)
`
`(52)
`
`(58)
`
`(56)
`
`A system and a concomitant method for providing program
`ming content in response to an audio signal. The program
`Related US- Application Data
`ming content and the audio signal are transmitted in a
`Provisional application NO‘ 60/166 010 ?led on NOV‘
`network having a forward channel and a back channel. In
`17 1999
`’
`’
`one embodiment, the system comprises a local processing
`’
`'
`unit and a remote server computer. A ?rst user provides a
`Int CL
`?rst audio signal containing a request for programming
`(200601)
`G 10L 21/00
`content from a service provider. The local processing unit
`704/275_ 704070, 704076,
`U S C]
`receives the ?rst audio signal and transmits the received ?rst
`704/27’7_ 704/27’8 386/96’
`'
`l
`l """""""""" "
`audio signal to a service provider via the back channel. The
`’
`’
`_
`.
`.
`.
`Fleld of Classl?catlon Search """ " 704/6’ remote server computer receives the ?rst audio signal from
`See a “Cation ?le for com 16 t6 Search histor
`the back channel, recognizes the ?rst user and the request for
`pp
`p
`y'
`programming content, retrieves the requested programming
`References Cited
`content from a program database and transmits the program
`ming content to the local processing unit via the forward
`channel.
`
`U.S. PATENT DOCUMENTS
`
`5,585,858 A * 12/1996 Harper et al. ............. .. 348/485
`5,815,108 A *
`9/1998 Terk ......................... .. 341/176
`
`23 Claims, 2 Drawing Sheets
`
`100
`
`_ r_ _ _ _ _ _ _ _ __ __ _ _
`
`(
`I
`BACK
`(OTHER HOME I
`ENTERTAINMENT —1—> CHANNEL
`PROCESSORS) I
`MULTIPLEXER
`
`110 _ _ _ _ __
`
`1 20 "'\
`
`CHANNEL MULTIPLEXORS)
`
`(
`REMOTE
`SERVER
`COMPUTER
`
`LOCAL
`> PROCESSING
`UNIT
`
`\_,_
`\~ — — — — _ 4
`125
`
`PROGRAM
`CONTROL DEVICE
`
`: /122
`[:11
`
`/124
`
`:)
`TELEVISION DISPLAY
`
`DVD/VCR
`
`Comcast - Exhibit 1010, page 1
`
`

`

`U.S. Patent
`
`Mar. 14, 2006
`
`Sheet 1 of2
`
`US 7,013,283 B1
`
`E _ _ _ _ _ _ _ _ _ _ _
`
`(OTHER BACKWARD
`P
`(136 CHANNELMuLTIPLExORs) I
`|
`BACK
`(OTHER HOME |
`ENTERTA|NMENT—|—> CHANNEL
`PROCEssORs) I
`MLILTIPLExER
`
`130
`(
`REMOTE
`sERvER
`COMPUTER
`
`‘I10
`
`_ _ _ 1
`
`120“
`LOCAL
`
`UNIT
`-
`
`I
`
`I
`
`132
`
`I
`
`I
`
`l
`
`156
`
`PROCRAM
`\: — — _ _ _ _J\/-125
`CONTROL DEVICE V
`III/122
`/124
`
`[:3
`
`DVD/VCR
`
`:
`TELEVISION DISPLAY
`
`FIG. 1
`
`(-202
`
`(206
`
`AUDIO
`
`sENsOR
`
`\ TRANSMITTER
`
`>AUD|O
`
`(152
`
`208%
`
`/*204
`PROCEssOR
`110-)
`
`FIG. 2
`
`Comcast - Exhibit 1010, page 2
`
`

`

`U.S. Patent
`
`Mar. 14, 2006
`
`Sheet 2 of2
`
`US 7,013,283 B1
`
`(-302
`
`SENSOR
`INTERFACE
`
`AUD'O
`
`(-308
`
`NOISE
`FILTER
`1\
`
`MEMORY
`
`(310
`
`AUDIO
`+
`
`' ENCODER
`i
`306 \
`NETWORK
`PROCESSOHH’ INTERFACE <_
`PROGRAM
`K312
`CONTENT
`/-304
`
`SOFTWARE MODULE \314
`
`‘V
`
`120) PROGRAM
`CONTENT
`
`FIG 3
`
`412
`
`AUD'O
`
`PROGRAM
`CONTENT
`‘L
`
`404 /. MEMORY
`
`SPEECH
`410/‘ REfggu'g'EoN
`
`L
`
`(402
`AUDIO
`SIGNAL
`INTERFAOE
`
`CPU
`
`<
`
`USER
`
`DATABASE
`uSER
`PROFILE
`\414
`
`A
`
`DATA
`SIGNAL 2
`INTERFAOE
`\408
`
`L
`406
`
`PROGRAM
`DATABASE
`
`130)
`
`FIG. 4
`
`Comcast - Exhibit 1010, page 3
`
`

`

`US 7,013,283 B1
`
`1
`SYSTEM AND METHOD FOR PROVIDING
`PROGRAMMING CONTENT IN RESPONSE
`TO AN AUDIO SIGNAL
`
`This application claims the bene?t of US. Provisional
`Application No. 60/166,010, ?led Nov. 17, 1999, Which is
`herein incorporated by reference.
`The invention relates generally to a system and a con
`comitant method for audio processing and, more particu
`larly, to a system and method for providing video content in
`response to an audio signal.
`
`BACKGROUND OF THE DISCLOSURE
`
`In current television systems, a user may order program
`ming content from a service provider. For example, if a user
`decides to select and order a pay-per-vieW cable program,
`sporting event or some other entertainment package, the user
`is required to vieW or select a particular program or package
`With a remote control. The user Would then need to call the
`service provider to con?rm or complete the selection of a
`program or package.
`As calling the service provider is often annoying and
`possibly time-consuming, e.g., the service provider is busy
`handling other requests, there is a need for better alternatives
`or solutions. One solution to this problem is to electronically
`process a spoken request or command from the user or
`consumer. Such electronic processing of the spoken com
`mand requires accurate and reliable speech recognition,
`Which, in turn, requires a very poWerful computer. HoWever,
`the local implementation of such a poWerful computer, e.g.,
`in a cable box, Would adversely increase the cost of the
`providing pay-per-vieW services With the television systems.
`Therefore, a need exists in the art for a system and a
`concomitant method for economically providing video con
`tent in response to a spoken command.
`
`SUMMARY OF THE INVENTION
`
`The present invention is a system and method for pro
`viding video content in response to an audio signal such as
`a spoken audio command. The programming content and the
`audio signal are transmitted in a netWork having a forWard
`channel and a back channel. In one embodiment, the system
`comprises a local processing unit and a remote server
`computer. A?rst user provides a ?rst audio signal containing
`a request for programming content from a service provider.
`The local processing unit receives the ?rst audio signal and
`transmits the received ?rst audio signal via the back channel.
`The remote server computer receives the ?rst audio signal
`from the back channel, recogniZes the ?rst user and the
`request for programming content, retrieves the requested
`programming content from a program database and trans
`mits the programming content to the local processing unit
`via the forWard channel.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The teachings of the present invention can be readily
`understood by considering the folloWing detailed descrip
`tion in conjunction With the accompanying draWings, in
`Which:
`FIG. 1 depicts a high-level block diagram of a voice
`control system of the present invention;
`FIG. 2 depicts a block diagram of a program control
`device of FIG. 1;
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`55
`
`60
`
`65
`
`2
`FIG. 3 depicts a block diagram of a local processing unit
`of FIG. 1; and
`FIG. 4 depicts a block diagram of a remote server
`computer of FIG. 1.
`To facilitate understanding, identical reference numerals
`have been used, Where possible, to designate identical
`elements that are common to the ?gures.
`
`DETAILED DESCRIPTION
`
`FIG. 1 depicts a block diagram of the voice activated
`control system 100 of the present invention. In one embodi
`ment, the voice activated control system 100 comprises a
`program control device 110, a local processing unit 120 and
`a remote server computer 130. The local processing unit 120
`is coupled to the program control device 110, and is option
`ally coupled to a video recorder 122 and a television display
`124. Additionally, the local processing unit 120 is coupled to
`the service provider 130 via a television signal delivery
`netWork 125 comprising a forWard channel 132, a back
`channel 134 and a back channel multiplexer 136.
`The program control device 110 captures the input verbal
`command signal from the user of the voice activated control
`system 100. The input command signal may comprise a
`verbal request of programming content from a service
`provider. The format of such an input command signal may
`comprise an audio signal or a video signal (the video
`imagery can be used for identi?cation of the user). Examples
`of the requested programming content include Web-based
`content, video-on-demand, cable television programming,
`and the like. Once the input command signal is received, the
`program control device 110 performs a transmission, e.g., a
`Wireless transmission, of the command signal to the local
`processing unit 120.
`In one embodiment, the program control device 110
`comprises a portable or hand-held controller. HoWever, the
`program control device 110 may also be physically con
`nected or integrated With the local processing unit 120. As
`such, the program control device 110 may comprise any
`device or combination of devices for capturing the input
`command signal and transmitting the captured signal to the
`local processing unit 120. The program control device 110 is
`further described beloW With respect to FIG. 2.
`The local processing unit 120 receives the input command
`from the program control device 110. Examples of the local
`processing unit 120 may include a set top terminal, a cable
`box, and the like. The received input command may com
`prise an audio signal containing a request by a user for
`programming content from the service provider. In one
`embodiment, the local processing unit 120 identi?es the user
`upon receipt of the audio signal. If the user is veri?ed, the
`local processing unit 120 transmits the audio signal to the
`back channel multiplexer 136.
`The local processing unit 120 may enhance the transmis
`sion of the audio signal by providing speech enhancement or
`?ltering background noise in an area proximate to the audio
`signal. Additionally, if the received input command com
`prises a video signal, the local processing unit 120 extracts
`visual information of the user from the video signal and
`identi?es the user from the extracted information, e.g., lip
`location of the user. The local processing unit 120 also
`receives the requested programming content from the ser
`vice provider via the forWard channel 132. Upon receipt of
`the requested programming content, the local processing
`unit 120 transmits the received content to the video player
`122 or the television recorder 124. The local processing unit
`120 is further described With respect to FIG. 3.
`
`Comcast - Exhibit 1010, page 4
`
`

`

`US 7,013,283 B1
`
`3
`The back channel multiplexer 136 multiplexes or com
`bines the audio signal transmitted from the local processing
`unit 120 With additional audio signals from the local pro
`cessing units of other users, i.e., other users of other voice
`activated home entertainment systems. The multiplexed
`audio signal is then transmitted via the back channel 134 to
`the service provider. The back channel 134 combines the
`multiplexed audio signal With additional multiplexed audio
`signals from other back channel multiplexers. As such, the
`back channel 134 transmits audio control signals from a
`plurality of local processing units 120 to the remote server
`computer 130 at the service provider.
`The remote server computer 130 performs the functions
`for the service provider Within the voice control system 100.
`Speci?cally, the remote server computer 130 receives the
`multiplexed signal from the back channel 134 and performs
`speech recognition on the received signal. HoWever, to
`accurately perform such speech recognition, the remote
`server computer 130 is generally a very poWerful and
`expensive computer. By centraliZing speech recognition of
`audio commands at the service provider 130, the voice
`control system 100 may provide accurate speech recognition
`Without the additional cost of providing poWerful and expen
`sive computers in each local processing system 120. As the
`speech recognition is provided at one centraliZed site, the
`overall cost of implementing the voice control system 100 is
`reduced.
`The remote server computer 130 performs the speech
`recognition by identifying or recogniZing the user that
`generated the audio signal and determining the requested
`programming content contained in the audio signal. Once
`the user is identi?ed and the requested programming content
`is determined, the server computer 130 retrieves the
`requested program content from a program database and
`transmits the retrieved program content via the forWard
`channel 132 to the local processing unit 120. The remote
`server computer 130 is further described With respect to FIG.
`4. HoWever, in another embodiment of the voice control
`system 100, separate computers may be used to implement
`the speech recognition and transmission of programming
`content functions at the service provider.
`FIG. 2 depicts a block diagram of the program control
`device 110 of FIG. 1. Speci?cally, the program control
`device 110 comprises a sensor 202, a processor 204, a
`transmitter 206 and an optional button 208. Auser or vieWer
`may use the program control device 110 to navigate through
`different programming content selections in a similar man
`ner to current television remote control devices. HoWever,
`the program control device 110 provides the user With the
`additional capability of selecting programming content
`using verbal commands, i.e., selections of programming
`content in response to an audio signal or audio command.
`For example, the user may speak the folloWing input com
`mand to the program control device 110: “ShoW me all the
`college football games on this Saturday.” The audio selec
`tion or input command is received by sensor 202 and
`coupled to the transmitter 206.
`The sensor 202 comprises a transducer such as a micro
`phone that converts the audio signal from the user into an
`electrical signal. In one embodiment, the sensor 202 may
`comprise multiple microphones to accurately focus and
`capture the input audio signal from the user. In another
`embodiment, the sensor 202 may comprise a video camera
`to capture and process a video signal in addition to the audio
`signal. This video signal can be used for user identi?cation.
`Once the input signal is captured at the sensor 202, the
`transmitter 206 transmits the audio signal and optional video
`
`10
`
`15
`
`25
`
`35
`
`40
`
`45
`
`55
`
`65
`
`4
`to the local processing unit 120. The transmitter 206 com
`prises a radio frequency (RF) transmitter to perform Wireless
`transmission of audio signal and video. In one embodiment,
`the receipt and transmission of the audio signal and video is
`controlled With the use of the push button 208. For example,
`the transmission of the audio signal occurs When a user
`depresses the push button 208. As such, the program control
`device 110 avoids performing any voice processing When
`commands are not intended to be processed. The transmitter
`206 may also comprise an analog-to-digital converter
`(ADC) for converting the microphone output into a digital
`signal.
`FIG. 3 depicts a block diagram of a local processing unit
`120 of FIG. 1. Examples of the local processing unit 120
`may include set top boxes, cable boxes, and the like. More
`speci?cally, the local processing unit 120 comprises a sensor
`interface 302, a memory 304, a processor 306, a noise ?lter
`308, an encoder 310 and a netWork interface 312. The sensor
`interface 302 receives the audio signal and (optional) video
`from the program control device 110. The memory 304
`stores programs, e.g., a softWare module 314, utiliZed to
`implement the operation of the local processing unit 120.
`The softWare module 314 represents softWare application
`programs that, When executed by the processor 306, imple
`ment the local processing unit 120 of the voice control
`system 100.
`Once the softWare module 314 is retrieved from memory
`304 and executed, the processor 306 may identify the user
`from the received audio signal. The processor 306 may also
`extract visual information of the user as contained in the
`received video. The extracted visual information, e.g., lip
`location of the user, enables the local processing unit 120 to
`perform more accurate speech processing and/or user iden
`ti?cation. Additionally, the processor 306 may coordinate
`the operation of the sensor interface 302, the noise ?lter 308,
`the encoder 310 and the netWork interface 312.
`The noise ?lter 308 ?lters the effects of background noise
`on the received audio signal. Background room noise is a
`primary source of speech recognition inaccuracies. Even a
`small amount of noise from other speakers or users may
`cause a large number of speech recognition errors. Addi
`tionally, noise in the audio signal may create problems in
`coding the audio signal for transmission, i.e., selecting an
`economical code for optimal transmission. To counter the
`possible effects of background noise, the noise ?lter 308
`performs local speech enhancement on the received audio
`signal. Speci?cally, the noise ?lter 308 implements a local
`signal separation routine to extract a “clean” audio signal
`from the received audio signal at the sensor interface 302.
`An exemplary noise ?lter 308 is disclosed in US. applica
`tion Ser. No. 09/191,217, ?led Nov. 12, 1998 and herein
`incorporated by reference.
`The encoder 310 codes the ?ltered audio signal for
`transmission to the service provider via the back channel
`134. The netWork interface 312 converts the encoded audio
`signal into a format suitable for transmission to the service
`provider. The netWork interface 312 also receives the
`requested programming content from the service provider
`via the forWard channel 132. More speci?cally, the netWork
`interface 312 may couple the audio signal from the encoder
`310 to the back channel multiplexer 136, and programming
`content from the forWard channel 132 to the processor 306.
`Examples of the netWork interface 312 include cable
`modems and netWork interface cards.
`FIG. 4 depicts a block diagram of one embodiment of the
`remote server computer 130 at the service provider. Spe
`ci?cally, the remote server computer 130 comprises a com
`
`Comcast - Exhibit 1010, page 5
`
`

`

`US 7,013,283 B1
`
`5
`mand signal interface 402, a memory 404, a central pro
`cessing unit (CPU) 406, and a data signal interface 408. The
`command signal interface 402 receives the multiplexed
`signal from the back channel 134. The memory 404 stores a
`speech recognition module 410 that, When retrieved and
`executed by the CPU 406, causes the remote server com
`puter 130 to operate as a speech recognition server. An
`example of the speech recognition module 404 is the Nuance
`7.0TM speech recognition softWare from Nuance Communi
`cations of Menlo Park, Calif.
`Once the CPU 406 executes the speech recognition mod
`ule 410, the remote server computer 130 recogniZes the user
`requesting the programming content and the request from
`the received signal. In one embodiment, the remote server
`computer 130 determines Whether the user for a particular
`request matches a user pro?le 414 in a user database 412.
`The user pro?le 414 represents a data structure used by the
`remote server computer 130 to determine Whether a user is
`entitled to order or request programming content from the
`service provider. The user pro?le 414 contains a statistical
`model of the preferences and audio command patterns of a
`particular user of the voice control system 100.
`Upon recogniZing the user and the request for program
`ming content, the CPU 406 determines Whether the time is
`appropriate for retrieving and transmitting the programming
`content to the local processing unit 120. For example, the
`CPU 406 Would decide to immediately retrieve and transmit
`video on demand, but Wait until a ?xed time to retrieve and
`transmit a pre-scheduled cable television program. The
`server computer 130 then retrieves the requested program
`ming content from the program database 416. The data
`interface 408 converts the retrieved programming content
`into a format suitable for transmission via the forWard
`channel 132 to the local processing unit 120.
`Although the server computer 130 is depicted to imple
`ment both speech processing and transmission of program
`ming content, the service provider may also use separate
`computers to implement these functions.
`Although various embodiments Which incorporate the
`teachings of the present invention have been shoWn and
`described in detail herein, those skilled in the art can readily
`devise many other varied embodiments that still incorporate
`these teachings.
`
`15
`
`3O
`
`What is claimed is:
`1. A system for providing programming content in
`response to an audio signal, Where said audio signal and
`programming content are transmitted using a television
`netWork having a forWard channel and a back channel, the
`system comprising:
`a local processing unit for receiving a ?rst audio signal
`from a ?rst user, Where said ?rst audio signal contains
`a request for said programming content from a service
`provider, transmitting said ?rst audio signal to the
`service provider via the back channel of said television
`netWork; and
`a remote server computer for receiving said ?rst audio
`signal from the back channel, recogniZing the ?rst user
`and said request for said programming content from
`said transmitted audio signal, retrieving the request
`programming content from a program database, and
`transmitting said programming content to said local
`processing unit via the forWard channel.
`2. The system of claim 1 further comprising:
`a back channel multiplexer for multiplexing said trans
`mitted ?rst audio signal from said local processing unit
`and a second audio signal from another audio source
`
`45
`
`55
`
`65
`
`6
`into a multiplexed signal, and transmitting said multi
`plexed signal to the back channel.
`3. The system of claim 1 Wherein said local processing
`unit identi?es the ?rst user prior to transmitting said ?rst
`audio signal to the service provider.
`4. The system of claim 1 Wherein said local processing
`unit comprises:
`a sensor interface for receiving the ?rst audio signal;
`a memory for storing softWare modules;
`a processor, upon retrieving and executing said softWare
`modules from said memory, for verifying Whether the
`?rst user is entitled to order programming content from
`the service provider; and
`a netWork interface for transmitting said ?rst audio signal
`via said back channel.
`5. The system of claim 4 Wherein said local processing
`unit further comprises:
`a ?lter for ?ltering background noise from said received
`?rst audio signal; and
`an encoder for encoding said ?ltered audio signal.
`6. The system of claim 4 Wherein said sensor interface
`receives a video signal, and said processor extracts visual
`information of the ?rst user contained in said received video
`and identi?es the ?rst user from said extracted information
`and said audio signal.
`7. The system of claim 1 further comprising:
`a program control device for capturing said ?rst audio
`signal from the ?rst user, and transmitting said captured
`?rst audio signal to said local processing unit.
`8. The system of claim 7 Wherein said program control
`device comprises a hand held control device.
`9. The system of claim 7 Wherein said program control
`device comprises at least one audio sensor.
`10. The system of claim 9 Wherein said program control
`device further comprises a video camera.
`11. The system of claim 1 Wherein said remote server
`computer matches the ?rst user from said received ?rst
`audio signal to a user pro?le stored in a user database, Where
`said user pro?le contains audio command patterns and
`preferences of the ?rst user.
`12. The system of claim 1 Wherein said remote server
`computer comprises:
`an audio interface for receiving said ?rst audio signal
`from said back channel;
`a memory for storing a speech recognition module;
`a processor, upon retrieving and executing said speech
`recognition module from said memory, for recogniZing
`the ?rst user and said request from said received ?rst
`audio signal, and retrieving said programming content
`from the program database; and
`a data interface for transmitting said retrieved program
`ming content to said local processing unit via the
`forWard channel.
`13. The system of claim 1 Wherein said programming
`content comprises at least one of Web content, video on
`demand and cable television programming.
`14. A method for providing programming content in
`response to an audio signal, Where said audio signal and
`programming content are transmitted using a television
`netWork having a forWard channel and a back channel, the
`method comprising:
`receiving a ?rst audio signal from a ?rst user, Where said
`?rst audio signal contains a request for said program
`ming content from a service provider;
`transmitting said ?rst audio signal to the service provider
`via a back channel of a television netWork;
`
`Comcast - Exhibit 1010, page 6
`
`

`

`US 7,013,283 B1
`
`7
`recognizing the ?rst user and said request for said pro
`gramming content from said transmitted audio signal;
`retrieving the requested programming content from a
`program database; and
`transmitting said retrieved programming content to the
`?rst user via a forWard channel of said television
`netWork.
`15. The method of claim 14 further comprising:
`multiplexing said ?rst audio signal With a second audio
`signal, Where said second audio signal is transmitted
`from a different audio source than said ?rst audio
`signal, into a multiplexed audio signal.
`16. The method of claim 14 further comprising:
`identifying the ?rst user prior to and transmitting said ?rst
`audio signal.
`17. The method of claim 14 further comprising:
`?ltering said received ?rst audio signal of background
`noise upon receipt of said ?rst audio signal from the
`?rst user; and
`encoding said ?ltered ?rst audio signal.
`18. The method of claim 14 further comprising:
`verifying Whether the ?rst user is entitled to order pro
`gramming content from the service provider; and
`transmitting said ?rst audio signal to the back channel if
`the ?rst user is entitled to order programming content.
`
`10
`
`15
`
`8
`19. The method of claim 18 Wherein said verifying
`comprises:
`identifying the ?rst user from a local list of valid users.
`20. The method of claim 14 Wherein said recogniZing
`comprises:
`matching the ?rst user from the transmitted ?rst audio
`signal With a user pro?le containing audio command
`patterns and preferences of the ?rst user.
`21. The method of claim 14 Wherein said programming
`content comprises at least one of Web content, video on
`demand and cable television programming.
`22. The method of claim 14 further comprising:
`receiving video of the ?rst audio signal from the ?rst user;
`extracting visual information of the ?rst user contained in
`said received video; and
`identifying the ?rst user from said extracted visual infor
`mation and said ?rst audio signal.
`23. The method of claim 14 Where a ?rst computer
`performs said recogniZing the ?rst user and said request, and
`a second computer performs said transmitting of said
`retrieved programming content.
`
`Comcast - Exhibit 1010, page 7
`
`