(12) United States Patent
`Asmussen
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7.565,680 B1
`Jul. 21, 2009
`
`US00756568OB1
`
`(54) ADVANCED SET TOP TERMINAL HAVINGA
`VIDEO CALL FEATURE
`
`(75) Inventor: Michael L. Asmussen, Oak Hill, VA
`(US)
`
`5.990,927 A * 1 1/1999 Hendricks et al. ........... 725/135
`5.999.207 A * 12/1999 Rodriguez et al. ....... 348/1403
`2001/00 13021 A1* 8/2001 Saito ........................... 705/51
`2005/0262542 A1* 11/2005 DeWeese et al. ............ T25, 106
`
`(73) Assignee: site telling I, LLC,
`
`WO
`
`FOREIGN PATENT DOCUMENTS
`WO94f13107
`6, 1994
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1172 days.
`(21) Appl. No.: 09/609,316
`
`y x- - -
`
`9
`
`* cited by examiner
`Primary Examiner Christopher Kelley
`Assistant Examiner Timothy R Newlin
`(74) Attorney, Agent, or Firm Banner & Witcoff, Ltd
`
`(22) Filed:
`
`Jun. 30, 2000
`
`(57)
`
`ABSTRACT
`
`(51) Int. Cl.
`H04N 7/6
`(52) U.S. Cl.
`
`(2006.01)
`725/135: 725/121. 725/106:
`s 725 /126. 715 758
`
`- - - - - - - - - - - - - - - - - - - - - - -
`
`72 5/132
`(58) Field of Classification Search
`725/140, 152, 106 121,135.126. 7575s
`See application file for complete search history
`References Cited
`U.S. PATENT DOCUMENTS
`
`(56)
`
`3,993,955
`4,896,354
`5,062,136
`5,083,205
`5,208,660
`5.448,313
`5,550,863
`5,838,368
`5,867,223
`5,953,485
`
`11, 1976
`1, 1990
`* 10, 1991
`1, 1992
`5, 1993
`9, 1995
`8, 1996
`11, 1998
`2, 1999
`9, 1999
`
`*
`
`Belcher et al.
`Inagaki et al.
`Gattis et al. .............. 379,9321
`Arai
`Yoshida
`Kim et al.
`Yurt et al.
`Masunaga et al.
`Schindler et al. ............ 348,552
`Abecassis
`
`A set top terminal equipped with a camera and microphone
`includes the capability to send and receive video calls through
`a cable television delivery system or other communications
`networks. In response to detection of the occurrence of a
`
`Video call event or triggering event, a video program is auto
`matically paused. In response to an incoming video phone
`call, message, web page, or other video communications
`information, the system pauses the video program and dis
`plays an indication of the occurrence of the communications
`event. The system also buffers the video program while
`paused, permitting a user to replay missed portions of it.
`Alternatively, the system waits for a triggering event, which
`includes the user's access to the communications event, in
`order to pause the video program. The set top terminal also
`includes features for caller identification of video calls and
`dual display of video programs and video calls. Such as pic
`ture in picture. A hardware upgrade for adding video call
`functionality to a set top terminal is also disclosed.
`
`16 Claims, 42 Drawing Sheets
`
`OPERAONS
`CENTER
`PROGRAM
`PACKAGNG
`MENU
`MANAGEMENT
`Oewery
`CONRO
`
`
`
`
`
`MASER CONTRO
`PLNKSE
`
`
`
`
`
`
`
`
`
`
`
`
`
`ANAOG
`sfGMAS
`GTA COMPRESSEC
`SGNALS
`W.
`
`W W
`Y
`ReMOECSOER
`MERFACE
`
`SOC
`
`26-1
`
`UP-STREAM/
`NTERACWY
`
`IPR2020-00200
`Apple Inc. EX1004 Page 1
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 1 of 42
`
`US 7,565,680 B1
`
`xmoakmz
`
`mmAAOmpzoo
`
`whosmm
`
`hum
`
`moh
`
`w4<z_2mmk
`
`omh<zmp<ozoo
`
`w4m<o
`
`smhm>m
`
`ozmo<mz
`
`m4m<o
`
`
`
`xz:4smhwmmmmh
`
`wzc_h<mm¢o
`
`mmHZmo
`
`8m
`
`2“
`
`wow
`
`N.5
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 2
`
`IPR2020-00200
`Apple Inc. EX1004 Page 2
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 2 of 42
`
`US 7,565,680 B1
`
`imoommoI
`
`k
`
`
`
`2m...m>m25.96
`
`
`
`
`
`mmoSmmmmil:
`
`
`
`FszzEEmEm-.1
`_Igu__
`-l....[||ll.lll.illi_é
`
`
`
`
`
`thodIoU
`
`:3..._05
`
`QmmmmmmEOo
`
`00._<z<
`
`mufi<0
`
`mmEMS
`
`.
`
`4<ZO_F<me._.Z_
`
`m3m2mmo
`
`wEuTmEC.
`
`xom
`
`0mmx_<ZOC.<Z
`
`mdzz<5
`
`
`
`.Oz_,sz_._.<O_ZD_>=>_OU
`
`CHE—omam.
`
`>~._m>OOm_O
`
`m._._.._0_m
`
`mhmomm
`
`mmwQJOI
`
`
`
`202.05-202mimz>KEZMEDUOQ
`
`
`
`mmeJOImFIOE
`
`mmeAOI
`
`
`
`mhIoEmzmmoilu
`
`
`
`\\\5sz
`
`
`
`mmawum_\Ezmozmamoimgmzomz\mmm
`
`Na
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 3
`
`00.32,“_-z<4<20E0<mhIDmmmmeEOUmqmfinu_-mthmmqm’uu00.3,HmMDommFmOlmm45,55
`
`
`
`BI
`
`D3I
`
`thm©04<Z<
`
`
`
`N‘AWN.“.s.9.6ZOEmmKQEOU/|IIII.III
`
`IPR2020-00200
`Apple Inc. EX1004 Page 3
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 3 of 42
`
`US 7.565,680 B1
`
`Fig. 3
`
`202 N.
`OPERATIONS
`CENTER
`PROGRAM
`PAgSING
`MANAGEMENT
`OEL VERY
`CONTROL
`
`22O
`
`(1d
`
`
`
`222
`
`V
`
`CABLE HOUSEHOLD
`W t
`v
`REMOTE/CUSTOMER
`NTERFACE
`
`90
`O
`
`KX
`az
`
`(S
`f
`ESA
`MASTER CONTROL
`UPLNKSITE
`
`204-1
`
`^)
`
`208-
`
`SIGNAL
`PROCESSOR
`
`NETWORK
`CONTROLLER
`
`2O9
`
`24
`
`ANALOG
`SIGNALS
`DIGITAL COMPRESSED
`SIGNALS (YCTV)
`
`OTHER DIGITAL
`OR ANAOG
`
`UP-STREAM/
`26-11NNERACWY
`
`IPR2020-00200
`Apple Inc. EX1004 Page 4
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 4 of 42
`
`US 7,565,680 B1
`
`E.I582.5283
`
`
`
`
`
`:58x23E22m:0525%.
`
`ac
`
`Anllllll8m.30
`5&8052E8m8,.
`
`>20
`
`09.2
`
`89>
`
`.50
`
`20m
`
`
`
`89>2%
`
`memmwoommogsE
`
`E05,.
`
`89>I28%
`
`$2528$28338%6528
`
`
`
`V.ME\amamamas
`
`mum8a
`
`528%
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 5
`
`IPR2020-00200
`Apple Inc. EX1004 Page 5
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 5 of 42
`
`US 7.565,680 B1
`
`220
`
`635
`
`22O
`
`9 Mic AUDIO
`UPGRADEPORT
`VIDEO
`OUTPUT
`OUTPUT INPUT
`PHONE RS422
`
`ol,
`
`
`
`650
`
`652
`
`660
`
`662
`
`665
`
`
`
`
`
`
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 6
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 6 of 42
`
`US 7,565,680 B1
`
`m9.Em
`
`mmEm>zoo
`
`RN
`
`
`
`
`
`an
`
`5.25
`
`
`
`Sm;m._m<o
`
`
`
`m2:mzozm
`
`EM
`
`om
`
`.50“E
`
`8mmmoH..-
`
`omhz03ng
`
`SN
`
`E25200
`
`50
`
`am
`
`mom
`
`82>
`
`<c>
`
`office
`
`mmjoEzoo
`
`NM
`
`n=Ioom
`
`20
`
`I
`
`:88E
`
`.2885
`
`255mg“
`
`\8,
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 7
`
`IPR2020-00200
`Apple Inc. EX1004 Page 7
`
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`9
`
`f07m
`
`US 7.565,680 B1
`1B0006,
`
`7
`
`m.02eE:W2:85
`
`fi.022E5252¢on5.
`
`_^)*
`.02eE:2285
`.02e:35.252¢on
`
`
`
`
`E
`
`mhaEam@252“.z+BaE$52EaVEa¢35w1,522:;2.
`.MNman.k
`
`
`\&3:v.83$822:85E912mm298$52538«$223:
`
`«8N803amama.«a
`
`%a8amam
`
`aEa2$5m&N.mwk
`
`
`
`
`
`§\\43:292218;Eweme9298mE2833$3323: 2.5mm._m<_m<>$532.5vmtmvmtmw
`
`
`
`
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 8
`
`IPR2020-00200
`Apple Inc. EX1004 Page 8
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 8 of 42
`
`US 7.565,680 B1
`
`
`
`-OHJENI
`
`?R?OJOTICI
`
`[YNEIVAN
`
`
`
`
`
`
`
`HO JESIT
`-NO
`
`STINGIWE
`
`YHOEICINO
`80 NOIL
`
`-WWNIGINOO
`
`IPR2020-00200
`Apple Inc. EX1004 Page 9
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 9 of 42
`
`US 7.565,680 B1
`
`30
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SIMPLE
`DECOMPRESSION BOX
`
`
`
`
`
`
`
`
`
`
`
`UPGRADE
`MODULE
`
`f. DIGITALDATA
`2. MICROPROCESSOR
`COMMUNICATIONS
`3, DECOMPRESSED
`VIDEO
`4. VIDEO, GRAPHICS
`&TEST
`
`IPR2020-00200
`Apple Inc. EX1004 Page 10
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 10 of 42
`
`US 7.565,680 B1
`
`SIMPLE
`DECOMPRESSION BOX
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1. DIGITALDATA
`2. MICROPROCESSOR
`COMMUNICATIONS
`3, DECOMPRESSED
`VIDEO
`4. VIDEO, GRAPHICS
`&TEST
`
`IPR2020-00200
`Apple Inc. EX1004 Page 11
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 11 of 42
`
`US 7.565,680 B1
`
`900
`
`REMOTE
`CONTROL
`
`
`
`REMOTE
`CONTROL
`INTERFACE
`626
`
`32
`O
`EXPANSON
`CARD
`
`322
`PHONE
`
`EXPANSION
`CARD
`INTERFACE
`
`N
`
`606
`
`
`
`CATW
`627 NPUT
`DIGITA
`603
`TELEPHONE
`TUNERF DEYA
`MODEM
`DATA
`ERROR
`'N coRRECTION
`
`CAMERA
`
`2easo
`Mie?zepiele
`2002-
`
`Amr A
`VF
`22
`td. (F
`322
`
`RoM
`
`
`
`
`
`MCRO
`PROCESS OR
`
`609 DEMULTIPLEXER
`
`602
`
`COMPRESSED
`VIDEO DATA
`
`600
`
`DECRYPT
`
`
`
`TEXT
`
`ENERATOR
`
`615
`
`
`
`1
`
`
`
`PICTURE RELATED
`DATA
`
`-a as a
`
`- a
`
`- - -
`
`WDEO
`DECOM.
`
`Passics
`
`WD/GRAPHC Sf
`TEXT
`
`| DEMULTIPLEXOR
`
`34
`
`TEXT IGRAPHICS
`WIDEO PLANE
`COMBINER
`
`36
`
`ENGT
`-L
`H
`giNS
`DECOMPRESSOF
`
`1318
`
`-
`
`
`
`RUN-LENGTH
`- - - - - - - - COMPRESSED
`GRAPHICS
`RAM OR
`EPROM
`
`
`
`
`
`
`
`
`
`
`
`AUDO
`DATA
`
`
`
`
`
`
`
`
`
`00
`
`ANT-
`TAPNG
`NTSC
`ENCODER ENCODING
`625
`
`69
`
`RGB
`
`o
`
`Fig. 10
`
`605
`
`
`
`
`
`RF
`MODULATOR
`
`AUDO
`DECOMPRESS OR
`612
`
`RF
`CH 34
`OUTPUT
`
`
`
`AUDO
`BASEBAND
`OUTPUT
`
`EGEND
`- WDEOIAUDIO
`ul MCROPROCESS OR
`CONTROL
`
`IPR2020-00200
`Apple Inc. EX1004 Page 12
`
`

`

`U.S. Patent
`
`US 7.565,680 B1
`
`
`
`
`
`
`
`
`
`
`
`HEILIWSN WHI WIW0
`
`IPR2020-00200
`Apple Inc. EX1004 Page 13
`
`

`

`U.S. Patent
`U.S. Patent
`
`21,
`
`9_W_N:
`
`
`
`2.22:36“53:8mazam8m.£25232.
`
`
`
`
`
`
`
`
`
`
`mm>fiomm
`
`wHZmZOmzoo
`
`Now_
`
`US 7.565,680 B1
`1B000
`5,7SU
`
`6,m5I6SNNE
`
`
`
`p?I (814
`
`_>mo=m2
`
`3238830528.:
`
`memmeOmmomo_:
`
`S
`
`h_
`
`ee
`
`B
`
`t_«E
`
`III_.IIIM£253.58“.EM__LFI.
`/ow:_$395$5353E:
`
`2:
`
`A<z_2mmhmOHhum
`
`\\
`
`
`
`£52228223:..sz
`
`:32:52:_
`
`z<wmhwm3
`
`<h<oum
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 14
`
`IPR2020-00200
`Apple Inc. EX1004 Page 14
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 14 0f 42
`
`US 7,565,680 B1
`
`
`
`gm~.mw~g.
`
`._<._._o_om;
`
`02:2
`
`.3930
`
`memmmooEOmog
`
`:Ommmoommgog
`
`22.2mm:mobEm
`
`Now
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 15
`
`IPR2020-00200
`Apple Inc. EX1004 Page 15
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 15 of 42
`
`US 7.565,680 B1
`
`Fig. 13a
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 16
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 16 of 42
`
`US 7.565,680 B1
`
`Fig. 13b
`
`
`
`368
`
`376
`
`IPR2020-00200
`Apple Inc. EX1004 Page 17
`
`

`

`U.S. Patent
`
`0
`
`a
`
`M
`
`(0Rd
`
`Rd
`
`1Bnu
`
`m:58_89>08
`
`
`
`1hmmnoozm.mmzoomo>mosw2.-l022CE
`
`Hm\mo_Im<moxszmomeh
`
`tommo‘mo_:&<mo\0mo;
`
`mpm
`
`n7emo_>
`
`
`
`H30_owesmmz_m2oo.
`
`0mm;masoown
`
`
`
`mu.mmm.mmzoomaSsou82>«a89>
`
`11omkz\mo_:g<ma
`
`“msmooo.mmsoomo
`
`
`
`v,h=mhaoNome>omkzzmmep>mozm:
`
`oo.6,35
`
`"InPampasNo_n=<S:58N89>EU.ES:Eno:u:mazoomo
`
`mom
`
`arm
`
`o_a3<
`
`\woxm<ma‘0mo;
`
`
`
`.mmzoomaFxmh
`
`Ma
`
`mewmeOmmow—QE
`
`mom
`
`5&882>_“a.Ico:m.museumn
`
`
`
`o_a=<Hm>momoxszma.
`
`own:>J4«Q
`
`
`
`hzmhaoFoa=<«Fmcommoo
`
`mom
`
`new
`
`$23.
`
`:152.3
`
`mummhozmm
`
`AOEkzoo
`
`wo<mmw~z_
`
`mm”mo<LmWHz_
`
`zo_mz<mxu
`
`om<o
`
`
`
`“wehmom
`
`ma<mc¢=
`
`.moo
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 18
`
`IPR2020-00200
`Apple Inc. EX1004 Page 18
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 18 of 42
`
`US 7.565,680 B1
`
`
`
`O2
`
`PRESS GOON ANY TEM FOR SHOWSCHEDULES
`
`NETWORK SCHEDULES
`
`NEXT 7 DAYS
`
`NOTE PRESS GUIDE RECORD BUTTON ON ANY SHOW
`LSTED AND WE WILL AUTOMATICALLY SET YOUR WCR
`TO TAPE IT
`OU HAVENTSUBSCRIBED TO TV GUIDEXPRESS YET
`YOUR CHOICE
`PRESS GOHERE TO ORDER FOR JUST 2.95/MO.
`PRESSGO) HERE TO RETURN TO CABLE TV.
`
`IPR2020-00200
`Apple Inc. EX1004 Page 19
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 19 of 42
`
`US 7.565,680 B1
`
`
`
`O
`
`CURRENT TIME:
`9:45 PM
`
`BROADCAST TV
`MENU
`
`WELCOME
`
`CATEGORIES OF
`PROGRAM MEN US
`
`PRESS GO FOR ANY CATEGORY
`
`FAVORITE CHANNELS
`POPULAR SHOWS
`MURDERMMYSTERY PROGRAMS
`NEWS AND INFORMATION
`
`OF TEN WATCHED CHANNELS
`CHILDREN'S PROGRAMS
`DOCUMENTARES
`OTHER
`
`PRESS GO HERE TO RETURN TO HOME MENU
`
`OOOOOOOO OO OOOO F
`Yilia
`
`IPR2020-00200
`Apple Inc. EX1004 Page 20
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 20 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`
`
`4
`
`16
`
`8
`
`MOOD QUESTON MENUS
`
`LENGTH OF PROGRAM DESIRED
`
`30 minutes Or leSS
`
`MEDIUM
`
`30 to 60 minutes
`
`Fig. 16b
`
`60 minutes or more
`
`TYPE OF PROGRAM DESIRED
`
`Fig. 16c
`
`DOYOU WISHAN ACTIVE OR
`PASSIVE PROGRAM?
`
`Fig. 16d
`
`ACTIVE
`
`PASSIVE
`
`IPR2020-00200
`Apple Inc. EX1004 Page 21
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 21 of 42
`
`US 7.565,680 B1
`
`229
`
`
`
`80 SS3||HdW 0030
`
`
`
`
`
`W
`
`Å80 WE W
`
`DZI 814
`
`IPR2020-00200
`Apple Inc. EX1004 Page 22
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 22 of 42
`
`US 7.565,680 B1
`
`HOSSE 8 d. W003||0
`
`09
`
`
`
`QZI ?
`
`IPR2020-00200
`Apple Inc. EX1004 Page 23
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 23 of 42
`
`US 7.565,680 B1
`
`Fig. 18
`
`
`
`THURSDAY, OCTOBER 26, 1994
`NTERACTIVE SERVICES
`(4)
`LEVEB
`THIS LEVEL OF INTERACTIVITY ALLOWS
`YOU TO ACCESS AWDE RANGE OF SERVICES
`NCLUDING:
`
`ENCYCLOPEDIA
`PRODGY
`ATLAS
`AMERICAON LINE
`SHOPPNG CENTER
`X PRESS
`ARINE RESERVATIONS ASSOCATED PRESS
`HOTEL RESERVATIONS
`U.S. YELLOWPAGES
`
`TO TAKE ADVANTAGE OF THESE SERVICES AN INTER
`ACTIVE MODEM IS REQUIRED. THIS IS AVAILABLE
`FROM YOUR CABLE SYSTEM. FOR INSTALLATION AND
`SS, INFORMATION, CONTACT YOUR CABLE SYSTEM
`
`YOUR CHOICE
`
`PRESS GO HERE FOR MORE INFORMATION
`PRESSGODHERE TO RETURN TO CABLE TV
`
`So
`
`IPR2020-00200
`Apple Inc. EX1004 Page 24
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 24 of 42
`
`US 7.565,680 B1
`
`Fig. 19a
`
`
`
`HERE FOR THE INTERACTIVTY WITH THIS SHOW
`PRESS
`PRESS GOHERE TO RESUME SHOW WITHOUT INTERACTIVITY
`YOUR CHOICE
`v7 PRESS GOHERE FOR INTERACTIVE MENU
`
`Iso-1
`
`IPR2020-00200
`Apple Inc. EX1004 Page 25
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 25 of 42
`
`US 7.565,680 B1
`
`Fig. 19b
`
`
`
`NTERACTIVE PROGRAMMING VENTURESTM
`
`S\al
`PRESS GO ON ANY INTERACTIVE MENU C.
`
`w
`
`34
`
`33
`
`36
`
`PRESSGOON YOUR ANSWER
`QUESTION OF 48
`WHAT IS THE MINIMUM WIND SPEED
`MORE THAN 40 MPH
`REQUIRED FOR A STORM TO BE
`MORE THAN 65 MPH
`CLASSIFIED ASA HURRICANEp
`MORE THAN 74 MPH
`MORE THAN 85 MPH
`YOUR CHOICE PRESS GOHERE TO RESUME SHOW WITHOUT
`INTERACTIVITY
`PRESS GOHERE TO RETURN TO CABLE TV
`
`Nils
`
`IPR2020-00200
`Apple Inc. EX1004 Page 26
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 26 of 42
`
`US 7.565,680 B1
`
`Fig. 20a
`
`
`
`42
`
`THURSDAY OCTOBER 26 1994
`
`INTERACTIVE SERVICES
`PRESS GOON ANYTITLE FOR MORE INFORMATION
`PRODGY
`SHOPPING CENTER
`AMERICA ON LINE
`GAMES
`X PRESS
`ATLAS
`AIRLINE RESERVATIONS
`ASSOCATED PRESS
`HOTEL RESERVATIONS
`U.S. YELLOW PAGES
`ENCYCLOPEDIA
`CABLE FAXMA
`YOUR CHOICE
`V/ PRESS GOHERE TO RETURN TO CABLE TV
`
`Iso
`
`IPR2020-00200
`Apple Inc. EX1004 Page 27
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 27 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`
`
`
`
`
`
`
`in N
`
`N
`
`
`(pºnu??u00)SNOIIVAH™ISSTH CINV
`
`
`
`KIOIJIVWTHO HNI SHNITHIV
`
`
`
`|ZZZZZZZZZZZZZZZZOZZZZZZZZZZZZZ?ýNo.Wyº/ZW??ZW 703372
`
`IPR2020-00200
`Apple Inc. EX1004 Page 28
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 28 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`(pºnu??u00)SNOILVAHOEISOETH CINV
`
`
`
`NOIJIVWTHORINI SHNITHIV
`
`
`
`N is
`s
`ass
`is as
`Samaa
`
`• © #ffi?i % Ø Ø Ø Ø D Ø Ø Ø Ø
`
`IPR2020-00200
`Apple Inc. EX1004 Page 29
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 29 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`KNOI IWWRIO INI CHNITHIV
`
`
`
`(pºnu??u00)SKIOILVANIEISOETH CINV
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 30
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 30 of 42
`
`US 7.565,680 B1
`
`
`
`*============) -----&=================::
`
`XWG 10 pu O 0, 019 H @@©|
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 31
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 31 of 42
`
`US 7.565,680 B1
`
`Fig. 22
`
`
`
`THURSDAY, OCTOBER 26, 1994
`G
`Eos GUIDE RECORD HAS BEEN ACTIVATED FOR
`9:OOPM, GREAT FIGHTS OF THE 1980'S
`ON: THURSDAY, OCTOBER 26, 1994
`FROM: 9:OOPMET TO: 93O PM ET
`CHANNEL: 29 NETWORK HBO
`
`MAKE SURE YOUR VCR IS TURNED
`ON AND ATAPE IS LOADED
`WELL HANDLE THE REST
`
`PRESS GOHERE FOR GUIDE RECORD MENUS
`PRESSGOHERE TO RETURNTO SCHEDULE
`PRESSGO)HERE TO RETURNTO CABLE TV
`
`IPR2020-00200
`Apple Inc. EX1004 Page 32
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 32 of 42
`
`US 7.565,680 B1
`
`Fig. 23
`
`
`
`72
`
`WEDNESDAY, JANUARY 7, 1996
`His HDTV
`HIGH DEFINITION TELEVISION
`SRSE A CURRENT SUBSCRIBERTO ALL HDTV SERVICES.
`
`PRESS GOON THE HDTVCHANNELYOU WANT TOVIEW
`DSCOVERY'S WINDOW ON THE WORLD WOW
`HBO N HIGH DEFINITION
`SHOWTIME IN HIGH DEFINITION
`HIT MOVIES FROM YOUR CHOICE TVTM
`OTHER HDTV SELECTIONS
`YOUR CHOICE
`v/ PRESS GOHERE TO RETURN TO CABLE TV
`
`IPR2020-00200
`Apple Inc. EX1004 Page 33
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 33 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`
`
`
`
`
`
`1402
`
`
`
`
`
`
`
`404
`
`
`
`1405
`
`1401
`CALL FROM
`202-555-1234
`GRANDMA o
`-S2
`
`1400
`
`Fig. 24a
`
`14O1
`E-MAIL FROM
`
`400
`
`140
`MESSAGE FROM
`PROGRAM CONTROL
`
`Fig. 24b
`
`1400
`
`Fig. 24c
`
`1400
`
`Fig. 24d
`
`IPR2020-00200
`Apple Inc. EX1004 Page 34
`
`

`

`U.S. Patent
`
`HJ
`
`whS
`
`nM
`
`7S
`
`1B0
`
`>m_am_o0...
`
`ONE.
`
`m.%mmmEm.«E:
`mmvwmmww MOEDOm
`
`«NE.
`
`NNVw
`
`
`
`_>_<r_00mn_Omn=>
`
`m.MawmE5,.E3
`Uamigoo._.
`
`EvF 20:09.5
`I\mm:
`
`RE
`
`mm:
`
`3mm
`
`8:095”E
`
`m83
`
`5:
`
`NNE.
`
`--§S\\
`
`
`
`2<m00mmOwn=>
`
`MON—30w
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 35
`
`IPR2020-00200
`Apple Inc. EX1004 Page 35
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 35 of 42
`
`US 7.565,680 B1
`
`
`
`
`
`
`
`1431
`
`
`
`
`
`
`
`
`
`
`
`
`
`BEGIN
`(Program Caller ID)
`
`1430
`
`User Requests To
`Program Caller ID
`
`Receive Phone Number
`
`
`
`1432
`
`Receive Text Message
`
`1433
`
`Receive Optional
`Selection Of A Graphic
`
`ASSociate Phone Number
`With Text Message And
`Graphic, And Store
`
`1434
`
`1435
`
`Program
`More?
`
`Fig. 27
`
`IPR2020-00200
`Apple Inc. EX1004 Page 36
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 36 of 42
`
`US 7.565,680 B1
`
`1440
`
`Y.
`
`1443
`
`BEGIN
`Event Monitoring
`
`441
`
`Monitor On-Line Connection
`
`1442
`
`
`
`Detect
`Occurrence
`Of Communication
`Event?
`
`YES
`Automatically Pause Program in Response To Detection Of
`Communications Event And Transmit To Buffer For Storage (Optional)
`
`1445
`
`1444
`
`Retrieve
`Stored information
`
`YES
`
`information
`Stored Corresponding
`To Communication
`
`1446
`
`1447
`
`1451
`
`
`
`Display Number
`Or Other indication Of
`Call, Along With
`Retrieved information
`if Present
`
`
`
`1452
`
`45
`3
`
`454
`
`1458
`
`
`
`1464
`
`1465
`
`Detect
`User
`Command2.
`
`Execute User Command
`
`indication
`Of Web Page
`
`Display
`indication
`Of Message
`
`Display
`indication
`Of Other Event
`
`Wait For User input
`or User inp
`
`1455
`
`Receive User input
`
`1457
`
`1456
`
`NO
`
`Detect
`Triggering
`
`1459
`
`YES
`
`1460
`
`Program
`Already
`aused2
`NO
`Pause Program in Response To Triggering Event
`And Transmit To Buffer For Storage
`
`461
`
`
`
`
`
`Particular
`re
`Elapsed?
`
`Remove indication Of Communications Event
`
`Fig. 28
`
`IPR2020-00200
`Apple Inc. EX1004 Page 37
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 37 of 42
`
`US 7.565,680 B1
`
`1470
`
`
`
`
`
`BEGIN
`(Video Program Control)
`
`
`
`Fig. 29
`
`Receive User
`Command
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Receive And Display Video Program
`And Simultaneously Buffer Program;
`Remove indication Of Event, if present
`
`rogram
`Already
`Paused?
`
`
`
`Play Program
`f E.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FastForward
`
`Program Transmitted
`At Current Point Of
`Transmission2
`
`Transmit Program in
`FastForward Direction
`From Buffer
`
`rogram Transmitted
`At Current Point Of
`Transmission2
`
`Jump To Start Of Buffer
`And Play Program
`
`Transmit Program From
`Buffer At Reduced Rate
`
`Program
`Paused?
`
`Transmit Program Frame
`By-Frame in Forward
`Direction From Buffer
`
`Program YES
`Paused?
`
`Transmit Program Frame
`By-Frame in Reverse
`Direction From Buffe
`
`1494
`
`Slow Motion
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 38
`
`

`

`U.S. Patent
`
`HJ
`
`0
`
`S
`
`a
`
`659
`
`1B0
`
`w.P
`
`lo:\\.
`
`2O.fl><
`
`
`
`W»alga—Lufirmam
`
`.vfimuflrfi2.:A
`
`wfi>3(a:.emit...
`“—
`
`153..mMum.“\.
`mow:1»003
`Ba;<umi<o
`
`
`
`
`
`
`
`
`
`1.,yrmoimnefuqaaé.\amyxflmfi
`m:WEDTA‘OQJIZ
`
`
`
`ewe|q:2{why:_A
`
`a”finioTSer,
`
`pm,1SangJugs“wNQJ
`8SFQB;\rfinmfi
`
`
`
`9i
`
`WT?Q.QJ<
`
`
`
`,nMGQQQQ.HUICQ1W.NGQN
`
`
`
`EhWin.(.55
`
`\mdu38¢
`
` 7iUAJ‘ZELMNL.‘;\vQy
`
`
`mauvlrfirm¢MudflmwufiudibmyiA‘1MN“.”1M.0~y
`
`
`
`
`
`
`
`
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1004 Page 39
`
`IPR2020-00200
`Apple Inc. EX1004 Page 39
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 39 of 42
`
`US 7.565,680 B1
`
`
`
`A
`
`-
`
`(carv, Ps7 aj, eazlue Ale,
`Iwter/E) OR Po n)
`dees
`
`/
`
`
`
`st
`
`22d
`
`IPR2020-00200
`Apple Inc. EX1004 Page 40
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 40 of 42
`
`US 7.565,680 B1
`
`
`
`f
`
`/O/O
`
`IPR2020-00200
`Apple Inc. EX1004 Page 41
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 41 of 42
`
`US 7.565,680 B1
`
`
`
`its O
`
`- /
`
`IPR2020-00200
`Apple Inc. EX1004 Page 42
`
`

`

`U.S. Patent
`
`Jul. 21, 2009
`
`Sheet 42 of 42
`
`US 7.565,680 B1
`
`
`
`IPR2020-00200
`Apple Inc. EX1004 Page 43
`
`

`

`US 7,565,680 B1
`
`1.
`ADVANCED SET TOP TERMINAL HAVINGA
`VIDEO CALL FEATURE
`
`RELATED APPLICATIONS
`
`15
`
`10
`
`The following applications and patents are incorporated
`herein by reference: U.S. application Ser. No. 09/528,614,
`filed Mar. 9, 2000, entitled, ADVANCED SET TOP TERMI
`NAL HAVING A PROGRAM PAUSE FEATURE; U.S.
`application Ser. No. 08/868,967, filed Jun. 5, 1997, entitled
`CALLER IDENTIFICATION SYSTEM FOR TELEVI
`SION: U.S. Pat. No. 5,990,927, dated Nov. 23, 1999, entitled
`ADVANCED SET TOP FOR CABLE TELEVISION
`DELIVERY SYSTEM: U.S. application Ser. No. 08/928,
`630, filed Sep. 12, 1997, entitled SET TOPTERMINAL FOR
`CABLE TELEVISION DELIVERY SYSTEMS; U.S. appli
`cation Ser. No. 09/404,707, filed Sep.15, 1999, entitled PRO
`GRAM DELIVERY SYSTEM FOR NVOD; U.S. Pat. No.
`5,798,785, dated Aug. 25, 1998, entitled TERMINAL FOR
`SUGGESTING PROGRAMS OFFERED ON A TELEVI
`SION PROGRAM DELIVERY SYSTEM: U.S. Pat. No.
`5,600,364, dated Feb. 4, 1997, entitled NETWORK CON
`TROLLER FOR CABLE TELEVISION DELIVERY SYS
`TEMS; U.S. Pat. No. 5,659,350, dated Aug. 19, 1997. entitled
`AN OPERATIONS CENTER FOR A TELEVISION PRO
`25
`GRAM PACKAGING AND DELIVERY SYSTEM: U.S.
`Pat. No. 5,834,853, dated Mar. 31, 1998, entitled SET TOP
`TERMINAL FOR CABLE TELEVISION DELIVERY
`SYSTEMS; U.S. Pat. No. 5,682,195, dated Oct. 28, 1997,
`entitled DIGITAL CABLE HEADEND FORCABLETELE
`30
`VISION DELIVERY SYSTEM; and U.S. application Ser.
`No. 09/391461, filed Sep. 9, 1999, entitled VIDEO CON
`FERENCING USING ANELECTRONICBOOKVIEWER.
`
`TECHNICAL FIELD
`
`The invention relates to television entertainment systems
`for providing television programming to consumer homes.
`More particularly, the invention relates to an apparatus and
`method for pausing of a video program based upon automatic
`detection of occurrence of a communications event.
`
`35
`
`40
`
`BACKGROUND
`
`2
`service, the television entertainment industry will also expe
`rience a Switch from new technology driving the market to
`consumer useability driving the market.
`Consumers want products incorporating new technology
`that are useful, and will no longer purchase new technology
`for the sake of novelty or status. Technological advances in
`Sophisticated hardware are beginning to Surpass the capabil
`ity of the average consumer to use the new technology. Care
`ful engineering must be done to make entertainment products
`incorporating new technology useful and desired by consum
`CS.
`In order for new television entertainment products to be
`Successful, the products must satisfy consumer demands. TV
`consumers wish to go from limited viewing choices to a
`variety of choices, from no control of programming to com
`plete control. Consumers wish to advance from cumbersome
`and inconvenient television to easy and convenient television
`and keep costs down. Consumers do not wish to pay for one
`hundred channels when due to lack of programming informa
`tion, they seldom, if ever, watch programming on many of
`these channels.
`The concepts of interactive television, high definition tele
`vision and 300 channel cable systems in consumer homes will
`not sell if they are not packaged, delivered and presented in a
`useable fashion to consumers. The problem is that TV pro
`gramming is not being delivered and presented to consumers
`in a user friendly manner.
`Consumers are already being bombarded with program
`ming options, numerous “free” cable channels, Subscription
`cable channels and pay-per-view choices. Any further
`increase in TV entertainment choices, without a user friendly
`presentation and approach, will likely bewilder viewers with
`a mind-numbing array of choices.
`The TV industry has traditionally marketed and sold its
`programs to consumers in bulk, Such as continuous feed
`broadcast and long-term Subscriptions to movie channels.
`The TV industry is unable to sell its programming in large
`quantities on a unit per unit basis, such as the ordering of one
`program. Consumers prefer a unit sales approach because it
`keeps costs down and allows the consumer to be more selec
`tive in their viewing.
`In addition, viewership fragmentation, which has already
`begun, will increase. Programming not presented in a user
`friendly manner will suffer with a decrease in viewership and
`revenue. As programming presentation becomes more user
`friendly, users seek additional features and functional capa
`bilities.
`What is needed is a system which can deliver and present
`television programming through a user friendly interface
`which allows the consumer to easily select from among the
`many program choices.
`What is needed is a set top converter that provides a user
`friendly interface for subscribers to access television pro
`grams.
`What is needed is a set top converter with enhanced func
`tionality.
`What is needed is a set top converter that provides users
`with advanced features and capabilities.
`What is needed is a method that allows efficient access to
`hundreds of television programming options.
`What is needed is technology that upgrades the function
`ality of existing set top converters.
`What is needed is hardware that provides an upgrade capa
`bility allowing the use of existing set top converter technol
`ogy in advanced program delivery systems.
`
`Advances in television entertainment have been primarily
`45
`driven by breakthroughs in technology. In 1939, advances on
`Vladimir Zworykin's picture tube provided the stimulus for
`NBC to begin its first regular broadcasts. In 1975, advances in
`satellite technology provided consumers with increased pro
`gramming to homes.
`Many of these technology breakthroughs have produced
`inconvenient systems for consumers. One example is the
`ubiquitous three remote control home, having a separate and
`unique remote control for the TV, cable box and VCR. More
`recently, technology has provided cable users in certain parts
`of the country with 100 channels of programming. This
`increased program capacity is beyond the ability of many
`consumers to use effectively. No method of managing the
`program choices has been provided to consumers.
`Consumers are demanding that future advances in televi
`sion entertainment, particularly programs and program
`choices, be presented to the consumer in a user friendly
`manner. Consumer preferences, instead of technological
`breakthroughs, will drive the television entertainment market
`for at least the next 20 years. As computer vendors have
`experienced a Switch from marketing new technology incom
`puter hardware to marketing better useability, interfaces and
`
`50
`
`55
`
`60
`
`65
`
`IPR2020-00200
`Apple Inc. EX1004 Page 44
`
`

`

`3
`What is needed is a set top converter that provides an
`upstream communications capability between the set top con
`verter and cable headend.
`What is needed is a set top converter that provides a capa
`bility of generating menus for display.
`What is needed is a set top converter that provides a simple
`way to select a program from a menu.
`What is needed is a set top converter that allows users to
`Subscribe on-screen to specialty channels.
`What is needed is a set top converter that monitors sub
`scriber viewing choices for statistical purposes.
`What is needed is a set top converter that provides sophis
`ticated on-screen television menus which can incorporate still
`Video and moving video.
`What is needed is a set top converter that provides a capa
`bility of Scaling and redirecting video for menus.
`The present invention is addressed to fulfill these needs.
`
`10
`
`15
`
`SUMMARY
`
`The present invention is a set top converter box or terminal
`for a television program delivery system. More specifically,
`the present invention is an advanced set top converterbox that
`acts as a terminal in the viewer's home. The set top terminal
`is a key component of a digital cable television delivery
`system. The set top terminal is an upgradeable system that
`provides for the decompression of digital program signals.
`The preferred set top terminal provides both a menu genera
`tion capability as well as a number of advanced features and
`functional capabilities.
`The set top terminal of the present invention may be
`achieved through a set of hardware upgrades to any of the
`following embodiments: (1) an existing set top converter
`upgraded with a circuit card (which has a microprocessor
`electronically connected to the set top converter); (2) an
`industry standard decompression converter upgradeable by
`either an upgrade module or a menu generation card; and (3)
`a set top converter box capable of both decompression and
`menu generation. The hardware upgrades provide additional
`advanced features and functional capabilities to any of these
`embodiments.
`A number of advanced features and functional capabilities
`are supported by the preferred set top terminal. This set top
`terminal provides Subscribers with a picture-on-picture capa
`bility without requiring a special television to Support the
`capability. The set top terminal also supports a TV guide
`service, which provides subscribers with information on all
`programming available at its particular Subscriber location.
`The set top terminal further includes the capability of query
`ing viewers to establish, among other things, favorite channel
`lists, personal profile data and mood information. The set top
`terminal allows the subscriber to view promotional menus on
`future programming events.
`The set top terminal Supports additional capabilities using
`its hardware upgrades that allow subscribers to use other
`interactive services, for example, to engage in on-line ques
`tion and answer sessions, to order and confirm airline tickets,
`and to access a variety of other data services. The set top
`terminal makes use of a digital tuneras a hardware upgrade to
`provide subscribers with a digital audio capability.
`The preferred set top terminal may be used to control video
`tape machines, thereby simplifying the recording of pro
`grams. The set top terminal can, in conjunction with the
`program delivery system, easily Support high definition tele
`vision (HDTV). For subscribers living in remote locations,
`the set top terminal accommodates backyard satellite sys
`tems. In addition to all the features that the set top terminal
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 7,565,680 B1
`
`4
`Supports with its current internal programming and upgrade
`ability, additional features may be added or existing features
`increased through remote reprogramming of the set top ter
`minal 220 or other programming.
`Such features include the capability to send and receive
`Video calls through the set top terminal equipped with a
`camera and microphone. The video call can be communicated
`through the cable television delivery system or other commu
`nications networks.
`Other such features include a system for automatically
`pausing a video program in response to detection of the occur
`rence of a video call event or triggering event. In response to
`an incoming video phone call, message, web page, or other
`Video information, the system pauses the video program and
`displays an indication of the occurrence of the video call
`event. Alternatively, the system pauses the video program in
`response to a triggering event, which includes a user's access
`to a video call event. The system also buffers the video pro
`gram while paused, permitting a user to replay missed por
`tions of it. As used herein, “video programs” include live or
`prerecorded programs from any source Such as, for example,
`a broadcast television signal transmission, a cable television
`signal transmission, satellite television, video streaming over
`the Internet or other network, a VCR, a computer memory
`such as a hard disk, CD-ROM, or digital versatile disk (DVD).
`Still other such features include caller identification of
`Video calls and dual display of video programs and video
`calls. Such as picture in picture. The video call functionality
`can be built into a set top terminal or provided as a hardware
`upgrade to a set top terminal.
`It is an object of the invention to provide a user friendly
`interface for subscribers to access television programs.
`It is an object of the invention to allow users to easily
`navigate through hundreds of programming choices using
`O-SC
`U.S.
`It is an object of this invention to efficiently access hun
`dreds of television programming options.
`It is an object of this invention to upgrade the functionality
`of existing set top converters.
`It is an object of this invention to provide an upgrade
`capability allowing the use of existing set top converter tech
`nology in an advanced program delivery system.
`It is an object of this invention to provide an upstream
`communications capability between the set top converter and
`cable headend.
`It is an object of this invention to provide a set top terminal
`capable of generating menus for display.
`It is an object of this invention to allow users to subscribe
`on-screen to specialty channels.
`It is an object of this invention to monitor subscriber view
`ing choices for statistical purposes.
`It is an object of this invention to provide sophisticated
`on-screen television menu