11111111111111111111111111f1!1
`
`0F
`
`IR11111111111111111111111111111
`
`[11] Patent Number:
`[45] Date of Patent:
`
`5,774,859
`Jun. 30, 1998
`
`FOREIGN PATENT DOCUMENTS
`
`4351094
`
`5/1991
`
`Japan
`
` G1OL 3/00
`
`OTHER PUBLICATIONS
`
`Lefkowitz, "Voice—Recognition Home TV Coming This
`Year; Service Merges Computer, Phone, and Cable Tech-
`nologies (BBN Hark Systems Corp, Time Warner Cable,
`Full Service Network)," Computer Shopper, v. 15, n2,
`p.68(1), Feb. 1995.
`"Voice Operated Controls and Switches Are Developed,"
`Veterans
`Administration
`Journal
`Announcement
`GRA18422, Abstract, Jul., 1984.
`Sugaya et al., "Voice Remote Controlled TV Set," COMP-
`CON 79 Proceedings using microprocessors extending our
`reach, 1979.
`Dawson, "Time Warner Pursues Voice as New Remote",
`Multichannel News, Jan. 9, 1995, pp. 31 and 34.
`
`Primary Examiner—David R. Hudspeth
`Assistant Examiner—Susan Wieland
`Attorney, Agent, or Firm—Kenneth M. Massaroni; Kelly A.
`Gardner
`
`[57]
`
`ABSTRACT
`
`A system for controlling a device such as a television and for
`controlling access to broadcast information such as video,
`audio, and/or text information is disclosed. The system
`includes a first receiver for receiving utterances of a speaker,
`a second receiver for receiving vocabulary data defining a
`vocabulary of utterances, and a processor for executing a
`speech recognition algorithm using the received vocabulary
`data to recognize the utterances of the speaker and for
`controlling the device and the access to the broadcast
`information in accordance with the recognized utterances of
`the speaker.
`
`10 Claims, 28 Drawing Sheets
`
`United States Patent [19]
`Houser et al.
`
`[54]
`
`INFORMATION SYSTEM HAVING A
`SPEECH INTERFACE
`
`[75]
`
`Inventors: Peter B. Houser, Poway, Calif.; Mark
`E. Schutte, Sugar Hill, Ga.; Gloria J.
`Majid, San Diego, Calif.
`
`[73] Assignee: Scientific-Atlanta, Inc., Norcross, Ga.
`
`[21] Appl. No.: 367,997
`
`[22] Filed:
`
`Jan. 3, 1995
`
`[51] Int. C1.6
`[52] U.S. Cl.
`[58] Field of Search
`
` HO4N 7/00; GlOL 9/00
` 704/275
` 395/2.79, 2.84;
`704/275, 270
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5/1985 Moriyama et al.
`4,516,207
`2/1987 Tunnell et al.
`4,641,292
`6/1987 Nakano et al.
`4,677,569
`4,706,121 11/1987 Young
`4,776,016 10/1988 Hansen
`4,977,455 12/1990 Young
`4,989,253
`1/1991 Liang et al.
`5,086,385
`2/1992 Launey et al.
`5,151,789
`9/1992 Young
`5,157,760 10/1992 Akagiri
`5,199,080
`3/1993 Kimura et al.
`5,230,023
`7/1993 Nakano
`5,267,323 11/1993 Kimura
`5,303,148
`4/1994 Mattson et al.
`5,335,276
`8/1994 Thompson et al.
`5,335,313
`8/1994 Douglas
`5,353,121 10/1994 Young et al.
`5,479,266 12/1995 Young et al.
`5,479,268 12/1995 Young et al.
`5,557,319
`9/1996 Gurusami et al.
`
` 364/424
` 367/198
` 364/513.5
` 358/142
` 381/42
` 358/142
` 381/110
` 364/188
` 358/194.1
` 395/2
` 381/110
` 381/110
` 381/110
` 364/413.01
` 380/21
` 395/2.84
` 348/563
` 358/335
` 358/335
` 348/11
`
`c 14-1
`
`INFO
`PROV
`
`14-n
`
`INFO
`PROV
`
`DEVICE
`
`INFORMATION
`DISTRIBUTION
`CENTER
`
`INFORMATION
`
`TERMINAL
`UNIT
`
`10J
`
`16j
`
`1
`
`SPEECH DATA
`
`Comcast - Exhibit 1023, page 1
`
`

`

`U.S. Patent
`Pined *S'fl
`
`Jun. 30, 1998
`
`Sheet 1 of 28
`8Z Jo 1 13311S
`
`5,774,859
`
`FIG. 1
`
`
`
`
`DEVICE
`
`B01AB0
`
`18---
`
`(-14-1
`
`INFO
`PROV
`
`(- 14-n
`
`INFO
`PROV
`
`INFORMATION
`DISTRIBUTION
`CENTER
`
`INFORMATION
`
`TERMINAL
`UNIT
`
`--12
`
`SPEECH DATA
`
`Comcast - Exhibit 1023, page 2
`
`

`

`U.S. Patent
`Pined *S'fl
`
`Jun. 30, 1998
`
`Sheet 2 of 28
`8Z Jo Z 13311S
`
`5,774,859
`
`FIG. 2A
`
`
`
`
`122-1
`
`122-2
`
`122-3
`
`No.OOONE
`
`| OHNI
`
`--_.114-2
`
`INFO
`L115
`
`TX
`1 8i
`
`-__.114-3
`
`ENCODER
`1 6--)
`
`No.OOONE,
`
`INFO
`L115
`
`| OHNI
`
`-114-n
`
`U-57 || ~
`
`118
`
`TX
`
`Comcast - Exhibit 1023, page 3
`
`

`

`waled °S11
`
`8661 `0£ 'LW
`
`8Z Jo £ lamIS
`
`122-1
`
`126-1
`
`r 1 28-1
`
` RECEIVER
`
`MODULATOR
`
`FIG. 2B
`
`/125
`
`124
`
`-130
`
`F-128-2
`
`RECEIVER
`
`SCRAMBLER
`
`MODULATOR
`
`COMBINER
`
`122-2 L126-2
`122-3
`(-142
`
`F132
`
`LOCAL
`SOURCE
`
`ISP
`
`HEC
`
`OTHER
`MODS
`
`OUT-OF-BAND
`TX
`
`L134
`
`138
`
`F140
`
`(-142
`
`TX
`
` RCR
`
`(--144
`
`----,136
`
`154
`
`DATABASE
`
`TO/FROM
`OTHER
`HEAD-END
`INSTALLATIONS
`
`146-)
`
`148
`
`150
`
`SYSTEM
`CONTROL
`COMPUTER
`
`BILLING
`COMPUTER
`
`INFO
`REQUEST
`PROCESSOR
`
`---,-/156
`
`(---152
`
`RF
`PROCESSOR
`
`COMMUNICATION
`NETWORK
`
`--,-.158
`
`Comcast - Exhibit 1023, page 4
`
`

`

`waled °S11
`U.S. Patent
`
`Jun. 30, 1998
`8661 `0£ 'LW
`
`8Z Jo 17 lamIS
`Sheet 4 of 28
`
`5,774,859
`
`138 )
`
`c---144
`
`FIG. 2C
`
`(---120-n
`
`
`
`
`(168
`
`(-166
`
`REMOTE
`CONTROL
`
`F160
`
`TERMINAL
`UNIT
`
`DEVICE
`
`B01AB0 || ~ ~ ~ || 301AB0
`B01AB0
`
`DEVICE
`
`DEVICE
`
`L162-1
`
`L162-2
`
`L162-n
`
`Comcast - Exhibit 1023, page 5
`
`

`

`U.S. Patent
`Pined *S11
`
`Jun. 30, 1998
`8661 `0£ Imf
`
`8Z Jo S 13311S
`Sheet 5 of 28
`
`5,774,859
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`r 1 7 0
`ANALOG
`TUNER
`
`r174
`
`SAW
`
`A
`
`r176
`DESCRAMBLER
`+
`DEMODULATOR
`r182
`
`DET
`
`FIG. 3
`r178
`
`FIL
`
`F-184
`B
`P
`
`(-180
`ON SCREEN
`DISPLAY
`CONTROL
`r19
`r188
`F
`VOL
`M
`CON
`
`186
`
`AM
`DET
`
`r172
`
`DATA
`RCR
`198---)
`
`ANALOG
`CONTROL
`CIRCUIT
`.---,.
`ROM
`
`I
`RAM
`
`210•-----
`
`LED
`
`r194
`
`MODULATOR
`
`RF OUT
`
`2201
`
`RAM
`
`ROM
`
`218-i
`
`r192
`MUTE
`
`c-200
`
`||WAS
`
`224i
`
`MAIN
`PROCESSOR
`
`SWITCHED
`OUTLET
`226-
`
`CJEHO
`
`x-229
`
`RF
`TX
`
`KEY
`1977212,-,
`214,_...---
`216._,---- VCR
`
`I/O
`
`IR
`RCR
`
`OUTPUTS
`
`208
`
`TO
`DIST.
`NETWORK
`138
`
`196i
`
`N00
`T08]
`
`r202
`DIGITAL
`TUNER/DEMOD
`
`ZOZ
`
`206,
`RAM
`
`F204
`DIGITAL
`CONTROL
`CIRCUIT
`_1_
`ROM
`
`Comcast - Exhibit 1023, page 6
`
`

`

`waled °S11
`U.S. Patent
`
`Jun. 30, 1998
`8661 `0£ 'LW
`
`8Z JO 9 lamIS
`Sheet 6 of 28
`
`5,774,859
`
`FIG. 4
`
`
`
`
`THRESHOLD
`
`--310
`
`-,-..-224
`
`(-200
`
`MAIN
`PROCESSOR
`
`NIV/W
`
`HOSSE|00}}d
`
`INTER-
`FACE
`----
`
`)4
`
`FRONT
`END
`
`CODEC
`
`L 303
`
`-7;2
`
`808Z09
`
`RCR
`
`L 301
`
`ROM
`
`RAM
`
`FLASH
`
`3757- 3065 307i
`
`909908
`
`160,-
`
`166
`
`_(-598
`
`WIRELESS
`MICROPHONE
`
`i-599
`
`TX
`
`Comcast - Exhibit 1023, page 7
`
`

`

`waled °S11
`U.S. Patent
`
`Jun. 30, 1998
`8661 `0£ 'LW
`
`8Z JO L PaqS
`Sheet 7 of 28
`
`5,774,859
`
`
`
`
`FIG. 5
`
`r200
`
`224
`
`F-330
`
`088
`
`INTER-
`FACE
`
`166-)
`
`(---320
`
`F322
`
`(---324
`
`(-326
`
`MIC
`
`RCR
`
`CODEC
`
`TX
`
`(-328
`
`RCR
`
`MAIN
`PROCESSOR
`
`NIV/W
`
`HOSSE|00}}d
`
`FLASH
`
`HSWTH
`
`RAM
`
`ROM
`
`73-7 337- 336-)
`
`160
`
`Comcast - Exhibit 1023, page 8
`
`

`

`waled °S11
`U.S. Patent
`
`8661 `0£ 'LW
`
`8Z Jo 8 lamIS
`
`5,774,859
`
`x320
`
`r 322
`
`r 324
`
`(--340
`
`326
`
`M IC
`
`RCR
`
`CODEC
`
`DSP
`
`TX
`
`FIG. 6
`
`
`
`
`328
`
`RCR
`
`F330
`
`INTER-
`FACE
`
`-224
`
`c 200
`
`MAIN
`PROCESSOR
`
`ROM
`
`RAM
`
`FLASH
`
`332i 334
`
`336-
`
`Comcast - Exhibit 1023, page 9
`
`

`

`jualud *S*11
`
`cc
`
`8Z Jo 6 lamIS
`
`ao
`uri
`
`F352
`
`M IC
`
`r 354
`
`FRONT
`END
`
`_F 356
`CODEC
`
`FIG. 7
`
`F358
`
`INTER-
`FACE
`
`-v 224
`
`200
`
`MAIN
`PROCESSOR
`
`ROM
`
`RAM
`
`FLASH
`
`75-77
`
`-3-5-97
`
`Comcast - Exhibit 1023, page 10
`
`

`

`U.S. Patent
`pined °S11
`
`Jun. 30, 1998
`8661 `0£ *unf
`
`8Z Jo OI lamIS
`Sheet 10 of 28
`
`5,774,859
`
`FIG. 8
`
`j---- 352
`
`MIC
`
`_F-354
`FRONT
`END
`
`r356
`
`F-362
`
`CODEC
`
`DSP
`
`r358
`
`INTER-
`FACE
`
`-224
`
`r 200
`
`MAIN
`PROCESSOR
`
`NIV/W
`
`HOSSB00}}d
`
`ROM
`
`RAM
`
`FLASH
`
`0
`
`9
`
`8
`
`6
`
`9
`
`8
`
`/
`
`9
`
`8
`
`
`
`757 797- 360j
`
`Comcast - Exhibit 1023, page 11
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 11 of 28
`Sheet 11 of 28
`
`5,774,859
`5,774,859
`
`FIG. 9
`FIG. 9
`
`POWER
`
`--,..___.770
`
`MENU
`
`INFO
`
`
`
`768
`
`766 _____--
`766
`GUIDE
`GUIDE
`
`769
`769
`
`767
`767
`SELECT
`SELECT
`
`764
`764
`
`
`MUTE
`MUTE
`
`762
`
`????? 762
`
`LAST
`
`763
`
`_765
`765?
`
`166
`
`)
`
`772
`772
`VOICE
`VOICE
`
`000
`® ® ®
`
`751,--
`
`- CD ® 0
`
`753
`753
`
`752./
`752
`
`
`
`EL ) 754 AY
`
`755
`755
`
`PAUSE
`
`STOP
`
`756
`756
`
`757J
`757
`
`REC
`
`758
`758
`
`Comcast - Exhibit 1023, page 12
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 12 of 28
`Sheet 12 of 28
`
`5,774,859
`5,774,859
`
`
`
`%
`
`FIG. 10
`FIG. 10
`
`%
`
`5
`
`FIG. 11
`FIG. 11
`
`64
`64
`7:00 PM | | 7:30PM '
`| 03/05 |
`f 7:30 PM
`7:00 PM
`03/05
`WXIA HOLLYWO G|LLIGANS
`HOLLYWO
`WXIA
`GILLIGANS
`ISLAND
`SQUARES
`14
`14
`ISLAND
`SQUARES
`H |
`HB0
`ERMNOR2
`HBO
`TERMINATOR 2
`62,m,__ 15
`62–– 15 : [R] [CC]
`[R] [CC]
`
`10
`+
`
`60
`60
`8:30 PM |
`8:00PM '
`8:30 PM
`8:00 PM
`BRADY | TOMAND
`TOM AND
`BRADY
`JERRY
`BUNCH
`JERRY
`BUNCH
`QEANE
`HOME ALONE
`PG| (CC)
`[PG]
`[CC]
`
`|
`
`66
`??????
`-------- 66
`
`|
`
`WRESTLING
`WRESTLING
`
`H---— |
`KABC
`TERMINA-
`KABC TERMINA.
`16
`TOR 2
`16
`: TOR 2
`????????????????????------------??{
`E???
`GOLF
`| WIMBLEDON
`GOLF
`ESPN
`WIMBLEDON
`17
`|
`;
`|
`i
`|
`H–—-
`| SHOW BAD NEWS BEARS
`CITIZEN
`SHOW
`BAD NEWS BEARS
`CITIZEN
`18
`[PG]
`KANE
`
`|
`|
`
`BOWLING
`BOWLING
`
`TMC | ONE GOOD COOP
`TMC
`ONE GOOD COOP
`19
`| [R]
`19
`[R]
`
`|NV|S|BLE
`INVISIBLE
`MAN
`MAN
`
`CURRENT TIME: 7:15 PM CURRENT DATE: 03/05
`CURRENT DATE: 03/05
`CURRENT TIME: 7:15 PM
`
`PRESS [INFO FOR DETAILS, ISELECT] TO TUNE.
`PRESS [INFO] FOR DETAILS, [SELECT] TO TUNE.
`LLLLL LLLLLS L LLLLS
`PRESS [MENU] TO EXIT.
`
`|
`
`|
`1
`
`|
`
`|
`
`|
`
`|
`
`|
`
`|
`
`;
`
`|
`
`|
`
`
`SS
`
`Comcast - Exhibit 1023, page 13
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 13 of 28
`Sheet 13 of 28
`
`5,774,859
`5,774,859
`
`
`
`
`
`FIG. 12A
`FIG. 12A
`
`MAIN MENU
`MAIN MENU
`
`1.
`PAY PER VIEW
`1. PAY PER VIEW
`2.
`WHAT'S ON CABLE
`2. WHAT'S ON CABLE
`3.
`MESSAGES/INFORMATION
`3. MESSAGES/INFORMATION
`4.
`FAVORITE CHANNELS
`4. FAVORITE CHANNELS
`; VCR PROGRAM TIMER
`5. VCR PROGRAM TIMER
`SLEEP TIMER
`6. SLEEP TIMER
`7
`PARENTAL CONTROL
`7. PARENTAL CONTROL
`CABLE TERMINAL SETUP
`8
`8. CABLE TERMINAL SETUP
`9
`9. EXIT
`????
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`FIG. 12B
`FIG. 12B
`
`WHAT'S ON CABLE
`WHAT'S ON CABLE
`
`1. VIEWING CHANNEL
`VIEWING CHANNEL
`2. FAVORITE CHANNEL
`FAVORITE CHANNEL
`CHANNEL LISTINGS
`3. CHANNEL LISTINGS
`4. CATEGORIES
`CATEGORIES
`5. EXIT
`????
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`Comcast - Exhibit 1023, page 14
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 14 of 28
`Sheet 14 of 28
`
`5,774,859
`5,774,859
`
`FIG. 12C
`FIG. 120
`
`
`
`VIEWING GUIDE
`VIEWING GUIDE
`
`1.
`TUNE TV TO PROGRAM
`1. TUNE TV TO PROGRAM
`2.
`RECORD PROGRAM
`2. RECORD PROGRAM
`3.
`PROVIDE INFORMATION
`3. PROVIDE INFORMATION
`ON PROGRAM
`ON PROGRAM
`????
`4.
`4. EXIT
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`FIG. 12D
`FIG. 12D
`
`
`
`YOU'VE CHOSEN:
`YOU'VE CHOSEN:
`ESPN CH 17
`ESPN CH 17
`SEE THE WORLD'S FINEST GOLFER'S
`SEE THE WORLD'S FINEST GOLFER'S
`|N FIRST ROUND ACTION AT THE
`IN FIRST ROUND ACTION AT THE
`U.S. OPEN.
`U.S. OPEN.
`STARTS: 7:00PM ENDS: 7:30PM
`STARTS: 7:00PM ENDS: 7:30PM
`
`RECORD:
`RECORD:
`1. ONE-TIME
`1. ONE-TIME
`2. DAILY
`2. DAILY
`3. WEEKLY
`3. WEEKLY
`4. ????
`4. EXIT
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`Comcast - Exhibit 1023, page 15
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Sheet 15 of 28
`Jun. 30, 1998
`Sheet 15 of 28
`FIG. 12E
`FIG. 12E
`
`5,774,859
`5,774,859
`
`VCR IS SCHEDULED TO RECORD:
`VCR IS SCHEDULED TO RECORD:
`
`1. 3/5/94 ?? 17 7:00 ?? ?? 7:30??
`1. 3/5/94 CH 17 7:00 PM TO 7:30PM
`
`FIG. 12F
`FIG. 12F
`
`
`
`FAVORITE CHANNEL GUIDE
`FAVORITE CHANNEL GUIDE
`7:00 PM | 7:30 PM | 8:00 PM | 8:30 PM
`7:00 PM
`7:30 PM 8:00 PM 8:30 PM
`KABC TERMIN
`KABC
`TERMIN-
`16
`ATOR 2
`ATOR 2
`
`16
`
`WRESTLING
`WRESTLING
`
`ESPN
`ESPN
`
`17
`17
`
`DIS
`DIS
`29
`29
`
`GOLF
`GOLF
`
`W|MBELDON
`WIMBELDON
`
`BOWLING
`BOWLING
`
`??????
`NATIONAL
`MICKEY
`NATIONAL
`JEOPARDY GË6:0 || MötjšË
`JEOPARDY
`GEOGRAPHIC
`MOUSE
`
`CURRENT TIME: 6:51 PM
`CURRENT TIME: 6:51 PM
`
`DATE: 3/5/94
`DATE: 3/5/94
`
`Comcast - Exhibit 1023, page 16
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 16 of 28
`Sheet 16 of 28
`
`5,774,859
`5,774,859
`
`FIG. 12G
`FIG. 126
`
`19 TM0
`19 TMC
`29 DIS
`29 DIS
`
`14 WXIA
`14 WXIA
`15 HBO
`15 HBO
`16 ????
`16 KABC
`17 ESPN
`17 ESPN
`18 SHOW
`18 SHOW
`
`1, VIEWING GUIDE
`1. VIEWING GUIDE
`2. MAIN MENU
`2. MAIN MENU
`3. ????
`3. EXIT
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`
`
`FIG. 1211
`FIG. 12H
`
`CATEGORIES
`CATEGORIES
`
`CHILDREN/EDUCATION/SCIENCE
`1. CHILDREN/EDUCATION/SCIENCE
`DRAMA/ROMANCE
`2. DRAMA/ROMANCE
`ENTERTAINMENT/VARIETY
`3. ENTERTAINMENTNARIETY
`4. MOVIES
`MOVIES
`NEWS/TALK/MAGAZINE
`5. NEWS/TALK/MAGAZINE
`SPECIALS/MINI-SERIES
`6. SPECIALS/MINI-SERIES
`PRE-RECORDED SPORTS
`7. PRE-RECORDED SPORTS
`8.
`LIVE SPORTS
`LIVE SPORTS
`ACTION/MYSTERY/HORROR
`9. ACTION/MYSTERY/HORROR
`COMEDY
`10. COMEDY
`M|SCELLANEOUS
`11. MISCELLANEOUS
`12. EXIT
`????
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`Comcast - Exhibit 1023, page 17
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 17 of 28
`Sheet 17 of 28
`
`5,774,859
`5,774,859
`
`
`
`
`
`FIG. 121
`FIG. 12I
`
`LIVE SPORTS
`LIVE SPORTS
`
`BASEBALL
`1. BASEBALL
`BASKETBALL
`2. BASKETBALL
`SOCCER
`3. SOCCER
`MORE LISTINGS
`4. MORE LISTINGS
`5. EXIT
`????
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`FIG. 12J
`FIG. 12J
`
`BASEBALL
`BASEBALL
`
`CH
`CH
`
`PROGRAM NAME
`PROGRAM NAME
`
`1. 02
`1. 02
`2. 07
`2. 07
`3. EXIT
`3. ????
`
`CUBS VS METS
`CUBS vs METS
`BRAVES VS REDS
`BRAVES vs REDS
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`Comcast - Exhibit 1023, page 18
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 18 of 28
`Sheet 18 of 28
`
`5,774,859
`5,774,859
`
`FIG. 12K
`FIG. 12K
`
`VCR PROGRAM TIMER
`VCR PROGRAM TIMER
`
`USE PLUS CODES
`1. USE PLUS CODES
`SET PROGRAM TIMER
`2.
`SET PROGRAM TIMER
`CHANGE PROGRAM TIMER
`3. CHANGE PROGRAM TIMER
`4. CLEAR PROGRAM TIMER
`CLEAR PROGRAM TIMER
`5. EXIT
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`FIG. 12L
`FIG. 12L
`
`
`
`PLUS CODES
`PLUS CODES
`
`STATE THE CODE ONE DIGIT
`STATE THE CODE ONE DIGIT
`AT A TIME
`ATA TIME
`
`STATE "OK"WHEN YOU ARE DONE.
`STATE "OK" WHEN YOU ARE DONE.
`STATE "EXIT" TO EXIT.
`STATE "EXIT" TO EXIT.
`
`Comcast - Exhibit 1023, page 19
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 19 of 28
`Sheet 19 of 28
`
`5,774,859
`5,774,859
`
`
`
`
`
`FIG. 12M
`FIG. 12M
`
`PROGRAM TIMER
`PROGRAM TIMER
`
`EPG PROGRAM VCR
`1.
`1. EPG PROGRAM VCR
`VOICE PROGRAM VCR
`2.
`2. VOICE PROGRAM VCR
`????
`3.
`3. EXIT
`
`PLEASE MAKE SELECTION.
`PLEASE MAKE SELECTION.
`
`FIG. 12N
`FIG. 12N
`
`1.
`2.
`3.
`4.
`5.
`
`SELECT PROGRAM NUMBER,
`SELECT PROGRAM NUMBER.
`
`Comcast - Exhibit 1023, page 20
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 20 of 28
`Sheet 20 of 28
`
`5,774,859
`5,774,859
`
`FIG. 120
`FIG. 120
`
`STATE
`STATE
`
`"DAY"
`"DAY"
`
`EXAMPLE: SATURDAY
`EXAMPLE: SATURDAY
`
`FIG. 12P
`FIG. 12P
`
`
`
`PROGRAM 1
`PROGRAM 1
`
`RECORD ON JUNE 11, 1994
`RECORD ON JUNE 11,1994
`STATE:
`STATE:
`
`"STARTHOUR, START MINUTE,
`"START HOUR, START MINUTE,
`AM ORPM"
`AM OR PM"
`
`EXAMPLE: "EIGHT ZERO ZERO PM"
`EXAMPLE: "EIGHT ZERO ZERO PM"
`
`Comcast - Exhibit 1023, page 21
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 21 of 28
`Sheet 21 of 28
`
`5,774,859
`5,774,859
`
`FIG. 120
`FIG. 120
`
`START TIME: 9:05 PM
`START TIME: 9:05 PM
`
`STATE:
`STATE:
`"STOP HOUR, STOP MINUTE, AMORPM"
`"STOP HOUR, STOP MINUTE, AM OR PM"
`
`FIG. 12R
`FIG. 12R
`
`
`
`STOP TIME: 10:35 PM
`STOP T|ME: 10:35 PM
`
`STATE: CHANNEL
`STATE: CHANNEL
`
`Comcast - Exhibit 1023, page 22
`
`

`

`U.S. Patent
`
`Jun. 30, 1998
`
`Sheet 22 of 28
`
`5,774,859
`
`FIG. 12S
`
`PROGRAM 1
`
`START TIME:
`9:05 PM
`STOP TIME:
`10:35 PM
`DATE: JUNE 11,1994
`CHANNEL: 07
`SPEED
`1. SP
`2. EP
`3. LP
`
`PLEASE MAKE SELECTION.
`
`FIG. 12T
`
`PROGRAM 1
`
`START TIME:
`9:05 PM
`STOP TIME:
`10:35 PM
`DATE: JUNE 11,1994
`CHANNEL: 07
`SPEED: SP
`
`STATE "OK" IF THIS
`INFORMATION IS CORRECT.
`
`Comcast - Exhibit 1023, page 23
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 23 of 28
`Sheet 23 of 28
`
`5,774,859
`5,774,859
`
`FIG. 12U
`FIG. 12U
`
`
`
`YOUR VCR WILL TAPE THE
`YOUR VCR WILL TAPE THE
`PROGRAMMING ON:
`PROGRAMMING ON:
`
`JUNE 11, 1994
`JUNE 11,1994
`FROM 9:05 TO 10:35 PM
`FROM 9:05 T0 10:35 PM
`ON CH 07
`ON CH 07
`AT SP SPEED
`AT SP SPEED
`
`Comcast - Exhibit 1023, page 24
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 24 of 28
`Sheet 24 of 28
`
`5,774,859
`5,774,859
`
`FIG. 13A
`FIG. 13A
`
`SEARCH...
`SEARCH...
`
`FIG. 13B
`FIG. 13B
`
`
`
`SEARCH...
`SEARCH...
`ONLY FOOTBALL
`ONLY FOOTBALL
`
`47 ITEMS HAVE BEEN FOUND.
`47 ITEMS HAVE BEEN FOUND.
`
`Comcast - Exhibit 1023, page 25
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 25 of 28
`Sheet 25 of 28
`
`5,774,859
`5,774,859
`
`FIG. 130
`FIG. 13C
`
`SEARCH...
`SEARCH...
`ONLY FOOTBALL
`ONLY FOOTBALL
`ONLY SPORTS
`ONLY SPORTS
`
`42 ITEMS HAVE BEEN FOUND.
`42 ITEMS HAVE BEEN FOUND.
`
`FIG. 13D
`FIG. 13D
`
`
`
`SEARCH...
`SEARCH...
`ONLY FOOTBALL
`ONLY FOOTBALL
`ONLY SPORTS
`ONLY SPORTS
`??L? ??D??
`ONLY TODAY
`
`23 ITEMS HAVE BEEN FOUND.
`23 ITEMS HAVE BEEN FOUND.
`
`Comcast - Exhibit 1023, page 26
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jun. 30, 1998
`Jun. 30, 1998
`
`Sheet 26 of 28
`Sheet 26 of 28
`
`5,774,859
`5,774,859
`
`FIG. 13E
`FIG. 13E
`
`SEARCH...
`SEARCH...
`
`ONLY FOOTBALL
`ONLY FOOTBALL
`ONLY SPORTS
`ONLY SPORTS
`ONLY TODAY
`ONLY TODAY
`ONLY AFTER ELEVEN AM
`ONLY AFTER ELEVEN AM
`
`19 ITEMS HAVE BEEN FOUND.
`19 ITEMS HAVE BEEN FOUND.
`
`FIG. 13F
`FIG. 13F
`
`
`
`SEARCH...
`SEARCH...
`
`ONLY FOOTBALL
`ONLY FOOTBALL
`ONLY SPORTS
`ONLY SPORTS
`ONLY TODAY
`ONLY TODAY
`ONLY AFTER ELEVEN AM
`ONLY AFTER ELEVEN AM
`ONLY BEFORE SIX PM
`ONLY BEFORE SIX PM
`
`12|TEMS HAVE BEEN FOUND.
`12 ITEMS HAVE BEEN FOUND.
`
`Comcast - Exhibit 1023, page 27
`
`

`

`U.S. Patent
`
`Jun. 30, 1998
`
`Sheet 27 of 28
`
`5,774,859
`
`FIG. 13G
`
`LIST
`
`1. PENN STATE - NOTRE DAME
`CHANNEL 10
`12:30 PM
`2. OHIO STATE - MICHIGAN
`CHANNEL 5
`1:00 PM
`
`3.
`4.
`5. MORE
`6. EXIT
`
`PLEASE MAKE SELECTION.
`
`FIG. 14
`
`PAY-PER-VIEW
`
`1. TERMINATOR 2
`2. FORREST GUMP
`3. THE LION KING
`4. PULP FICTION
`5. SPEED
`6. MORE
`7. EXIT
`
`PLEASE MAKE SELECTION.
`
`Comcast - Exhibit 1023, page 28
`
`

`

`juajud 'Ka
`U.S. Patent
`
`Jun. 30, 1998
`8661 `0£ Inif
`
`8Z Jo 8Z WIN
`Sheet 28 of 28
`
`5,774,859
`
`
`
`
`
`
`
`FIG. 15
`
`DEVICE
`
`B01AB0
`
`521/-
`
`TERMINAL
`UNIT
`
`519X-
`
`I
`SPEECH
`DATA
`
`515
`
`INFORMATION
`DISTRIBUTION
`CENTER
`
`517
`
`NODE
`
`Comcast - Exhibit 1023, page 29
`
`

`

`5,774,859
`
`2
`ing an On-Screen User Interface for a Subscription Televi-
`sion Terminal", incorporated herein by reference, can
`greatly enhance the ability of a user to access available
`features. The system described in that application signifi-
`5 cantly reduces the number of key presses and data entries
`required to utilize available features; moreover, a key pad is
`designed in such a way as to group keys together in a manner
`to facilitate their use. However, even with such an improved
`interface, certain tasks are simply not well-suited for execu-
`10 tion using a keypad on a subscriber terminal unit or an
`associated remote control. For example, while a subscriber
`might be very interested in using an EPG to determine the
`channel number and time for the next showing of a particular
`television show or to find all movies being shown in the next
`15 week starring a particular actress, such tasks are not easily
`implemented using menu screens and key presses.
`
`SUMMARY OF THE INVENTION
`
`1
`INFORMATION SYSTEM HAVING A
`SPEECH INTERFACE
`
`BACKGROUND OF THE INVENTION
`
`1. Technical Field
`The present invention generally relates to an information
`system having a speech interface and, more particularly, to
`a subscription information system including a subscriber
`terminal unit which provides for control of electronic
`devices and access to information services by spoken com-
`mands.
`2. Description of the Related Art
`The volume of information and number of features being
`made available to subscribers in information systems such as
`subscription television systems are continuously increasing.
`For example, the advent of optical fiber networks and links
`to telecommunication networks enables an almost limitless
`supply of information and features to be provided to sub-
`scribers. Already subscription television systems are being
`used for addressed message transmissions, pay-per-view
`programming, impulse pay-per-view programming, favorite
`channel features, and parental control. Cable television
`system operators may also provide text services such as
`news articles, sports scores, stock market quotations, and
`weather reports. Relatively new features such as video game
`delivery, wide area network access, home shopping, travel
`reservations service, home banking, energy management,
`video conferencing and other such services are also being
`provided.
`Recently, some companies have begun offering electronic
`television schedules for purchase by subscription television
`providers who, in turn, provide the schedules to their sub-
`scribers. The schedules contain a listing of television pro-
`grams by time and channel, and are typically displayed as a
`grid on the television screen. Such a system is shown in PCT
`Publication No. WO 92/04801, applied for by Insight
`Telecast, Inc. (hereinafter "the Insight system") and incor-
`porated herein by reference. That publication describes a
`display system for maneuvering a cursor through a televi-
`sion schedule. The system also describes that a subscriber
`can choose a program for recording by moving a cursor to
`the selected program; the system will automatically program
`the subscriber's video cassette recorder.
`Also recently, so-called near-video-on-demand services
`have been introduced. These services provide a simulation
`of the videotape rental experience. One such system is
`described in Walter, U.S. Pat. No. 5,168,353, incorporated
`herein by reference. Walker describes in column 4, lines
`18-27 that a converter may be enabled to descramble two
`channels carrying the same program at staggered intervals.
`This allows returning to the same portion of the video after
`a pause equal to the staggered time interval. The Walker
`patent gives as an example a subscriber ordering a program
`that begins at 8:00 p.m. The converter unscrambles the 8:00
`showing as well as the 8:15 showing so that the viewer may
`return to the same point in the program after a fifteen minute
`break.
`This increase in information and features has generally
`resulted in a corresponding increase in the complexity of the
`subscriber's interface with the system. Since the subscrib-
`er's "comfort level" with an interface for accessing infor-
`mation and features will often determine whether the sub-
`scriber will utilize the information and features, there is a
`need for user-friendly interfaces. An interface such as that
`described in commonly assigned copending application Ser.
`No. 07/800,836 entitled "Method and Apparatus for Provid-
`
`30
`
`40
`
`The present invention adds a speech recognition interface
`20 to a subscriber terminal unit in an information system for
`implementing spoken control of electronic devices at the
`subscriber location and of access to information transmitted
`to the subscriber terminal unit. The speech recognition
`interface enhances the interface of the subscriber with the
`25 information system by allowing control using language
`which is naturally spoken by the subscriber. Such natural
`language control affords ease of use as well as permitting the
`implementation of tasks which are not easily implemented
`using menu screens and key presses.
`In accordance with one aspect of the instant invention, a
`system for controlling a device includes a first receiver for
`receiving utterances of a speaker, a second receiver for
`receiving vocabulary data defining a vocabulary of
`utterances, and a processor for executing a speech recogni-
`35 tion algorithm using the received vocabulary data to recog-
`nize the utterances of the speaker and for controlling the
`device in accordance with the recognized utterances of the
`speaker.
`In accordance with another aspect of the invention, a
`method for controlling a device includes the steps of receiv-
`ing utterances of a speaker, receiving vocabulary data defin-
`ing a vocabulary of utterances, using the received vocabu-
`lary data to recognize the utterances of the speaker, and
`controlling the device in accordance with the recognized
`utterances of the speaker.
`In accordance with another aspect of the invention, a
`system for controlling access to broadcast information
`includes a first receiver for receiving utterances of a speaker,
`50 a second receiver for receiving vocabulary data defining a
`vocabulary of utterances, and a processor for executing a
`speech recognition algorithm using the received vocabulary
`data to recognize the utterances of the speaker and for
`controlling access to the broadcast information in accor-
`55 dance with the recognized utterances of the speaker.
`In accordance with another aspect of the invention, a
`method for controlling access to broadcast information
`includes the steps of receiving utterances of a speaker,
`receiving vocabulary data defining a vocabulary of
`60 utterances, using the received vocabulary data to recognize
`the utterances of the speaker, and controlling access to the
`broadcast information in accordance with the recognized
`utterances of the speaker.
`In accordance with yet another aspect of the invention, a
`65 system for controlling a device and for controlling access to
`broadcast information includes a first receiver for receiving
`utterances of a speaker, a second receiver for receiving
`
`
`
`5 4
`
`Comcast - Exhibit 1023, page 30
`
`

`

`5,774,859
`
`3
`vocabulary data defining a vocabulary of utterances, and a
`processor for executing a speech recognition algorithm
`using the received vocabulary data to recognize the utter-
`ances of the speaker and for controlling the device and the
`access to the broadcast information in accordance with the
`recognized utterances of the speaker.
`In accordance with yet another aspect of the invention, a
`method for controlling a device and for controlling access to
`broadcast information includes the steps of receiving utter-
`ances of a speaker, receiving vocabulary data defining a
`vocabulary of utterances, using the received vocabulary data
`to recognize the utterances of the speaker, and controlling
`the device and the access to the broadcast information in
`accordance with the recognized utterances of the speaker.
`In accordance with yet another aspect of the invention, a
`system for controlling a device includes a transmitter for
`transmitting vocabulary data for defining a vocabulary of
`utterances; and a terminal unit including a first receiver for
`receiving utterance data of a speaker, a second receiver for
`receiving the transmitted vocabulary data, and a processor
`for executing a speech recognition algorithm using the
`received vocabulary data to recognize utterances of the
`speaker and for controlling said device in accordance with
`the recognized utterances of the speaker.
`In accordance with yet another aspect of the invention, a
`method for controlling a device includes the steps of trans-
`mitting vocabulary data for defining a vocabulary of
`utterances, receiving utterance data of a speaker, receiving
`the transmitted vocabulary data, using the received vocabu-
`lary data to recognize utterances of the speaker, and con-
`trolling the device in accordance with the recognized utter-
`ances of the speaker.
`In accordance with still another aspect of the invention, a
`system for controlling access to broadcast information
`includes a transmitter for transmitting vocabulary data defin-
`ing a vocabulary of utterances and a terminal unit including
`a first receiver for receiving utterance data of a speaker, a
`second receiver for receiving the transmitted vocabulary
`data, and a processor for executing a speech recognition
`algorithm using the received vocabulary data to recognize
`utterances of the speaker and for controlling access to the
`broadcast information in accordance with the recognized
`utterances of the speaker.
`In accordance with still another aspect of the invention, a
`method for controlling access to broadcast information
`includes the steps of transmitting vocabulary data for defin-
`ing a vocabulary of utterances, receiving utterance data of a
`speaker, receiving the transmitted vocabulary data, using the
`received vocabulary data to recognize utterances of the
`speaker, and accessing the information in accordance with
`the recognized utterances of the speaker.
`In accordance with still another aspect of the invention, a
`system for controlling a device and for controlling access to
`broadcast information includes a transmitter for transmitting
`vocabulary data defining a vocabulary of utterances and a
`terminal unit including a first receiver for receiving utter-
`ance data of a speaker, a second receiver for receiving the
`transmitted vocabulary data, and a processor for executing a
`speech recognition algorithm using the received vocabulary
`data to recognize utterances of the speaker and for control-
`ling the device and the access to the broadcast information
`in accordance with the recognized utterances of the speaker.
`In accordance with still another aspect of the invention, a
`method for controlling a device and for controlling access to
`broadcast information includes the steps of transmitting
`vocabulary data for defining a vocabulary of utterances,
`
`2 5
`
`
`
`5
`
`4
`receiving utterance data of a speaker, receiving the trans-
`mitted vocabulary data, using the received vocabulary data
`to recognize utterances of the speaker, and controlling the
`device and the access to the information in accordance with
`the recognized utterances of the speaker.
`In accordance with still another aspect of the invention, a
`system for controlling a television receiver to allow user
`selection of broadcast programs from program schedule
`information includes a first receiver for receiving the pro-
`10 gram schedule information, a second receiver for receiving
`utterances of a user, and a processor for executing a speech
`recognition algorithm to recognize the utterances of the user
`and for selecting broadcast programs from the program
`schedule information in accordance with the recognized
`15 utterances of the user.
`In accordance with another aspect of the invention, a
`remote control for transmitting utterance data to a receiver
`includes a microphone for receiving utterances of a speaker,
`an analog-to-digital converter for converting utterance sig-
`20 nals from the microphone to digital utterance signals, a
`digital signal processor for extracting time-variant spectral
`characteristics of the digital utterance signals, and a trans-
`mitter for transmitting the time-variant spectral characteris-
`tics to the receiver.
`In accordance with still another aspect of the invention, a
`subscription television system includes a head-end installa-
`tion for transmitting vocabulary data for defining a vocabu-
`lary of spoken commands and a subscriber terminal unit
`0 connected to a television. The subscriber terminal unit 3
`includes a first receiver for receiving spoken command data,
`a second receiver for receiving the vocabulary data trans-
`mitted from the head-end installation, and a processor for
`executing a speech recognition algorithm using the vocabu-
`35 lary data to recognize spoken commands and for controlling
`the television in accordance with the recognized spoken
`commands.
`In accordance with another aspect of the invention, an
`information broadcasting center for broadcasting informa-
`40 tion to at least one terminal unit includes a first transmitter
`for transmitting text information and a second transmitter for
`transmitting phonemic data corresponding to at least a
`portion of the text information.
`In accordance with another aspect of the invention, a
`45 subscriber terminal unit includes a tuner for tuning channels
`of a television signal, each channel carrying a respective
`program identified by a program title, a memory for storing
`a speech recognition algorithm for recognizing spoken pro-
`gram titles, and a processor for executing the speech rec-
`50 ognition algorithm to recognize a program title spoken by a
`subscriber and for generating a tuner control signal for
`controlling the tuner to tune to the channel carrying the
`program corresponding to the recognized program title.
`These and other features and advantages of the present
`55 invention will be better understood from a reading of the
`following detailed description in conjunction with the
`accompanying drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`60
`
`FIG. 1 is a generalized block diagram of an information
`system in accordance with the instant invention.
`FIGS. 2A, 2B, and 2C are a block diagram of a subscrip-
`tion television system in which the instant invention is
`65 implemented.
`FIG. 3 is a detailed block diagram of subscriber terminal
`unit 160 shown in FIG. 2C.
`
`Comcast - Exhibit 1023, pa