(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2002/0088010 A1
`(43) Pub. Date: Jul. 4, 2002
`
`Dudkiewicz et al.
`
`US 20020088010A1
`
`INTERACTIVE SYSTEM AND METHOD FOR
`GENERATING METADATA FOR
`PROGRAMMING EVENTS
`
`(51)
`
`Publication Classification
`
`(54)
`
`(76)
`
`Inventors: Gil Gavriel Dudkiewicz, San
`Francisco, CA (US); Dale Kittrick
`Hitt, San Jose, CA (US)
`
`Correspondence Address:
`David A. Blumenthal
`FOLEY & LARDNER
`2029 Century Park East - Suite 3500
`Los Angeles, CA 90067-3021 (US)
`
`(21) Appl. No.:
`
`09/991,741
`
`(22)
`
`Filed:
`
`Nov. 16, 2001
`
`Related US. Application Data
`
`application No.
`(63) Non-provisional of provisional
`60/249,179, filed on Nov. 16, 2000. Continuation-in-
`part of application No. 09/793,294, filed on Feb. 26,
`2001. Continuation-in-part of application No. 09/793,
`322, filed on Feb. 26, 2001. Continuation-in-part of
`application No. 09/793,357, filed on Feb. 26, 2001.
`Continuation-in-part of application No. 09/793,479,
`filed on Feb. 26, 2001.
`
`Int. Cl.7 .............................. H04N 7/16; G06F 3/00;
`H04N 5/445; G06F 13/00
`.............................................. 725/138; 725/38
`
`(52) us. Cl.
`
`(57)
`
`ABSTRACT
`
`Metadata for a programming event may be generated
`through an interactive process. A system may receive data
`corresponding to a programming event. The data may
`include descriptive information and timing information. The
`system may then generate preliminary metadata for the
`programming event from the received data. The system may
`provide the preliminary metadata to a system user, and then
`receive user specified metadata responsive to the prelimi-
`nary metadata. The preliminary metadata may include one or
`more of categories of a classification hierarchy, goodness of
`fit scores associated with the categories, keywords, goodness
`of fit scores associated with the keywords, and a title.
`Related embodiments may pertain to a system implementing
`such methods. Further related embodiments may pertain to
`methods and systems in which a system user is enabled to
`approve preliminary metadata provided by the system.
`
`PPD data 14
`
`Metadata
`Metadata
`
`
`PPD provider
`
`
`20
`
`
`fl
`—>
`
`Metadata
`20
`
`
`
`Metadata
`
`
`
`distributor
`
`
`
`generator
`
`
`_2_2_
`
`
`
`Production
`
`fl
`
`
`facility agent
`
`
`
`Production
` Programming
`_1_;
`
`
`
`data 16
`event provider
`
`
`%
`
`Programming
`events 28
`
`BBiTV EX2023
`
`Dish Network v. Broadband iTV
`
`IPR2020-01280
`
`BBiTV EX2023
`Dish Network v. Broadband iTV
`IPR2020-01280
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 1 of 18
`
`US 2002/0088010 A1
`
`PPD provider
`m
`
`
`
`PPD data 14
`Metadata
`Metadata
`
`
`20
`20
`
`
`Metadata
`“9
`
`
`Metadata
`distributor
`
`
`generator
`22
`
`
`
`
`
`
`Production
`fl
`Client
`"‘
`
`
`
`.
`.
`‘
`d
`.
`facrhty agent
`Productlon
`ev1ce
`.
`
`
`
`
`2_6
`Programming
`1.2
`
`
`
`
`data 16
`.
`
`event prov1der
`
`
` 2:4.
`Programming
`events 28
`
`,
`Figure 1
`
`
`
` @ Receive production data for a
`
`program
`
`
`
`3; Determine time data for
`
`
`
`programming events within the
`
`
`program
`
`
`Figure 2
`
` 1; Determine descriptive data for
`
`
`programming events within the
`program
`
`
`
`
`
`
`
`
`fl Store metadata for each
`programming event comprising
`
`
`time data and description data
`
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 2 0f 18
`
`US 2002/0088010 A1
`
`<A name = 1 25TERROR> </A> <TABLE width = "100%" bgCoIor=#fffff0 borderCoIorLight=#eOeOeO
`border=1> <TBODY> <TR> <TD vAIign =top width= "30%" > < IMG aIt="script icon" hspace= 5
`src= “NOON, Tuesday, ‘IO—24-OO_fiIes/script.gif" align =Ieft> < FONT size: +O> <B> INTRO
`TERROR </B> <lFONT> <BR> <FONT size=~2> </A> <lFONT> </TD> <TD> <FONT size=-1>|N
`WASHINGTON, THE PENTAGON HAS ISSUED A "THREAT CONDITION DELTA.“ <BR>THAT IS AN ORDER TO
`U-S TROOPS TO BE ON THE HIGHEST ALERT, BECAUSE AN ATTACK—- IN THIS CASE A TERRORIST ATTACK--
`COULD BE |MM|NENT.<BR>THE ORDER AFFECTS TROOPS STATIONED IN TURKEY AND IN THE PERSIAN
`GULF STATES OF BAHRAIN, AND QATAR <BR> THE ORDER COMES IN THE WAKE 0F THREATS THE
`PENTAGON SAYS U-S INTELLIGENCE RECEIVED AFTER THE ATTACK ON THE U—S-S COLE IN YEMEN.
`<BR> </FONT> </TD> </TR> </TBODY> <ITABLE>
`<A name=134WORKING_MOMS> </A> <TABLE width= "100%" bgColor=#fffffO
`borderCoIorLight= #eOeOeO border=1 > <TBODY> <TR> <TD vAIign=—top width= "30%" > <IMG aIt= "script
`icon" hspace= 5 src= "NOON, Tuesday, 10—24-00files/script. gif" align= Ieft> <FONT
`size: +0> <B>WORKING MOMS<IB> </FONT> <BR> <FONT size=—2> <lFONT> </TD> <TD> <FONT
`size=-1>IN OTHER NEWS, A NEW STUDY SHOWS THAT NEW MOTHERS ARE GOING BACK TO WORK MORE
`QUICKLY THAN EVER. <BR>THE CENSUS BUREAU REPORTS THAT 59 PERCENT OF WOMEN WHO HAD
`BABIES WERE BACK ON THE JOB WITHIN A YEAR, USUALLY ON A FULL-TIME BASIS.<BR>THAT'S UP
`EIGHT PERCENT FROM TEN YEARS AGO.<BR> AND THE NUMBER OF CHILDREN AMERICAN WOMEN ARE
`HAVING CONTINUES TO DECLINE:<BR>THE CENSUS FOUND EACH WOMAN ON AVERAGE NOW HAS ONE-
`POINT-EIGHT CHILDREN.<BR>IN 19-76, AMERICAN WOMEN ON AVERAGE HAD THREE KIDS EACH.
`<BR> </FONT> </TD> </TR> </TBODY> <lTABLE>
`<A name=35$HUTTLE_> </A> <TABLE width = "100%" bgCoIor=#fffffO borderColorLight= #eOeOeO
`border=1> <TBODY> <TR> <TD vAIign=top width ="30%" > <IMG aIt= "script icon" hspace= 5
`src = "NOON, Tuesday, 1024-00_files/script.gif" align = |eft> < FONT size = +O> < B> SHUTTLE
`</B> <lFONT> <BR> <FONT size=~2> </FONT> </TD> <TD> <FONT size=~1>AND THE SHUTTLE
`DISCOVERY ASTRONAUTS ARE STILL STUCK IN SPACE WAITING FOR AN OPPORTUNITY TO RETURN TO
`EARTH.< BR>FOR THE THIRD STRAIGHT DAY, THEY WILL DON THEIR RE-ENTRY SUITS AND TRY TO BRING
`THE SHUTTLE HOME. <BR> HIGH WINDS AND RAIN ARE ONCE AGAIN PREVENTING A FLORIDA LANDING.
`BUT THE PLAN IS TO BRING DISCOVERY TO CALIFORNIA FOR A DESERT TOUCHDOWN AT EDWARDS AIR
`FORCE BASE AT 1:59PM OUR TIME. <BR> <lFONT> </TD> </TR> </TBODY> </TABLE>
`
`Figure 3
`
`O :
`
`IBaCk Time
`ITotalI Out cue
`Ivideo
`ITM ITN Ishot
`ITalentISLUG
`// PG
`///////////////////////////////////////////////////////////////////////////////////////////////
`lZSTERROR
`I
`IINTRO TERROR
`I
`I2- shot
`I0n Set
`I2. 23
`58: 45 I 15)I o: 02- 26aI
`134WORKING_MOMS
`IS/D
`IWORKING MOMS
`I
`I
`I2--shot
`Ice Set
`Io:25 I 58:45
`( 15)I 0:02 54aI
`3SSHUTTLE
`I
`ISHUTTLE
`I
`I
`I2—shot
`IOn Set
`|0:26 I 58:45
`(:15)| 0:03:33aI
`22WEATHER
`I
`IWEATHER
`I
`I
`IZ—Shot
`IOn Set
`I2:41 I 58:45
`(:15)I 0:06:27aI
`lGlHOMETOWN_HERO |
`IHOMETOWN HERO
`|
`|
`I2—shot
`IOn Set
`I0 51 I 53:45
`( 15)I 0:07:21aI
`164SURPLUS
`I
`ISURPLUS
`I
`I
`I2-shot
`I0n Set
`I0 17 I 55:45
`I 15II 0:07:41aI
`lsoCRANEs
`I
`ICRANES
`I
`I
`Iz-shot
`IOn Set
`|o:22 I 58:45
`( 15)I 0:08:06aI
`l328CflLIVE‘WAGE
`IS/D
`Isc LIVE WAGE
`I
`|
`|2—shot
`IOn Set
`I0 23 I 58:45
`(:15)I 0:08:32aI
`l3SLOTTO~WINNERS I
`ILOTTO WINNERS
`|
`I
`I2—shot
`IOn Set
`Io:53 I 53:45
`( 15)I 0:09:26aI
`
`Figure 4
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 3 0f 18
`
`US 2002/0088010 A1
`
`Figure 5
`
`PPD provider
`1 0
`
` PPD data 14
`
`
`
`
`
`\LMetadata
`20
`
`
`Distribution
`
`
`Metadata
`
`
`agent 35
`
`
`
`generator 18
`
`—>
`
`Metadata 20
`
`
`
`Metadata
`TransmsSpinninmuu...
`
`20
`system 3 8
`
`
`
`
`
`
`
`Production
`Production
`Client device
`
`
`26
`
`
`facility agent
`
`
`12
`
`
`
`
`
`Programming
`events 28 and
`metadata 20
`
`Production
`
`
`
`equipment
`36
`
` 49 Provide production data for a program
`
`to a metadata generator
`
`
`
`
`
`4; Receive metadata for programming
`events within the program
`
`
`fl Provide the metadata for transmission
`through a programming event broadcasting
`
`system
`
`
`Figure 6
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 4 0f 18
`
`US 2002/0088010 A1
`
`METADATA
`
`
`
`Field
`I—
`Data
`EP07071 974-LAHOYASINGS
`
`Program‘ID
`
`Program_Name
`
`Channel 2 Nightly News at 11:00
`
`ProgramQDescription
`
`Local NFL Team Report; Buffalo Bills training
`camp opens; interview with coach; interviews
`
`with players
`
`Program_Reduced_Description
`Buffalo Bills training camp
`
`
`
`W— J 25 July 2000
`
`
`
`
`
` Message_Status
`
`
`W 23:12:30 (HI-I:MM:SS)
`W— L00:02:10 (HHcMMtSS)
`
`
`ChanneLlD
`
`
`2
`
`
`
`FProgram_Type 1 Program segmen—t—w—J
`
`Program_TV_Rating
`
`Program_l\/LPAA_Rating
`
`Category_List
`
`Keyword_List
`
`_____L________._._._______
`
`Retransmission of evening news segment
`
`News/Looal/Spoxts/Football/NFL,100;
`Sports/Football/NFL/AFC/Bills,100;
`Sports/F0otball/NFL/Training_Camp, 8 5 ;
`Sports/Football/NFL/News_C0mmentary,35
`Football, 100; Buffalo, 75; Bills, 75;
`Training_Camp, 100
`
`Figure 7
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 5 0f 18
`
`US 2002/0088010 A1
`
`Categories
`
`Cate 0 Levels
`
`Football
`
`Baseball
`
`Basketball
`
`. . . Level 2
`
`C C .
`
`Level 4
`
`Buffalo
`
`Bills
`
`NY Jets
`
`Miami
`
`Level 5
`
`Dolphins
`
`‘ ' '
`
`Figure 8
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 6 of 18
`
`US 2002/0088010 A1
`
`fl Receive PPD data and / or
`production data for a programming
`event
`
`5; Assign a “goodness of fit” score
`to each category of the
`classification hierarchy based on
`analysis of the received data
`
`and their goodness of fit scores
`
`it Determine categories within the
`hierarchy that are representative of
`the programming event
`
`so Store metadata including the
`representative category identifiers
`
`Figure 9
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 7 of 18
`
`US 2002/0088010 A1
`
`
`
`Determine candidate keywords from
`descriptive data associated with the
`
`programming event _2_ZQ
`
`
`
`
`
`
`Provide candidate keywords to a
`classification tool configured to
`generate category goodness of fit
`scores 22;
`
`
`Select keyword from the candidate
`
`keywords based on category goodness
`
`of fit scores 22A
`
`
`
`
`
`
`
`
`Store the selected keywords as a
`component of programming event
`
`metadata _2_2§
`
`Figure 10
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 8 of 18
`
`US 2002/0088010 A1
`
`Generate preliminary
`metadata for the
`
`programming event gas
`
`Provide preliminary
`metadata to system user
`_2_3_Q
`
`2.3.2.
`
`Receive specified
`metadata responsive to
`the preliminary metadata
`
`Figure 1 1
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 9 0f 18
`
`US 2002/0088010 A1
`
`Programming
`events 62
`
`Client Device
`
`Video Receiver
`.69
`
`Data processor
`fl
`
`Data storage
`
`
`
`Metadata
`Receiver
`fl
`
`Display interface
`E
`
`Bulk data storage
`12
`
`Metadata 66
`
`Audio and
`
`Vldeo Slgnals 78
`
`Figure 12
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 10 0f 18
`
`US 2002/0088010 A1
`
`VIEWER PROFILE
`
`Profile_Name
`
`Profile__Description
`
`l I
`Profile_Alert_Minutes In Advance
`
`Football Fan
`
`Ident1fies programs about my favorite team.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Profile_Activation_Time
`
`C
`
`12:00:00 — 23:00:00
`
` ategory_Scores
`
`News/Local/Sports/Football/NFL,6;
`Sports/Football/NFL/AFC/Bills,1 O;
`
`Sports/Football/NFL/Training_Camp, 1 O;
`Sports/Football/NFL/Commentary,4;
`
`Bills, Sports/Football/NFL, 10;
`
`Figure 13
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 11 0f 18
`
`US 2002/0088010 A1
`
`_1_OQ Receive metadata for
`upcoming programming events
`
`
`
`fl Process metadata to determine
`desirability scores for each
`programming event
`
`
`
`
`
`
`
`
`
`
`19A Process programing event
`scores, times and durations to
`determine a preferred programming
`event schedule
`
`M Receive additional metadata
`for additional upcoming
`
`programming events
`
`
`
`
`
`1% Process additional metadata to
`determine desirability scores for
`each additional programming event
`
`
`
`
` 1m Process additional
`programming event scores, times
`
`and durations to determine updates
`to preferred programming event
`schedule
`
`
`
`
`
`
`m Store any updates in preferred
`programming event schedule
`
`
`Figure 14
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 12 of 18
`
`US 2002/0088010 A1
`
` Q
`
`Is there a real time
`
`
`viewer?
`
`1% Notify viewer of preferred
`programming event
`
`Q41 Record preferred
`programming event
`
` _1._29_ Check schedule and determine
`
`
`the next upcoming preferred
`programming event
`
`
`
`
`
`
`
`Did viewer select
`preferred programming
`event for viewing?
`
`
`
` m Display preferred
`
`programming event
`
`
`
`Figure 15
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 13 of 18
`
`US 2002/0088010 A1
`
`lit; Determine each matched category
`of the metadata
`
`fl Determine a score for each
`matched category as a function of the
`goodness of fit score and the
`preference score in the viewer profile
`
`ljj Sum the weighted preference
`scores and multiply by the goodness of
`fit score
`
`each category in the branch of the
`matched category by a factor based on
`the level of the category
`
`
`
`
`
` L4_6_ Weight the preference score of
`
`
`
`
`
`
`
`
`
`
`
`
`
`154 Adopt the highest score and the
`category that produced it as the
`desirability score and category of the
`
`
`programming event
`
`
`_1_SQ Weight the sum in accordance With
`the duration of the programming event
`
`Figure 16
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 14 0f 18
`
`US 2002/0088010 A1
`
`@ For each profile having a
`preference score for the matched
`category, weight the preference score of
`each category in the branch of the
`matched category by a factor based on
`the level of the category
`
`
`
`@ Determine each matched category
`of the metadata
`
`fl Determine a score for each
`matched category as a function of the
`goodness of fit score, the preference
`score in each viewer profile, and the
`priority of each viewer profile
`
`1% Adopt the highest score and the
`category that produced it as the
`desirability score and category of the
`programming event
`
`
`
`
`
`
`
`
`
`
`
`fl Sum the weighted preference
`scores of each branch for each profile
`and multiply the sum by the goodness
`of fit score
`
`
`
`HQ Weight the product for each profile
`in accordance with the priority of the
`
`
`profile
`
` fl Sum the priority-weighted products
`
`and multiply by the number of profiles
`
`having a preference score for the
`matched category
`
`
` fl Weight the sum in accordance with
`
` the duration of the programming event
`
`
`
`Figure 17
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 15 0f 18
`
`US 2002/0088010 A1
`
`Receive metadata for
`
`Receive metadata for
`
`programming events including
`category goodness of fit scores
`and keywords a
`
`programming events including
`category goodness of fit scores
`and keywords 2_3§
`
`scores and keywords £6
`
`Rank the programming events
`according to viewer profiles
`including category preference
`
`Rank the programming events
`according to viewer profiles
`including category preference
`scores and keywords and
`qualified keywords git)
`
`Figure 18
`
`Figure 19
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 16 0f 18
`
`US 2002/0088010 A1
`
`. . . PE 1 Text Data
`
`PE 2 Timing Data
`
`PE 2 Text Data . . .
`
`Figure 20
`
`Teleprompter
`system
`&
`
`
`
`
`
`Text for
`Trigger
`display
`\l/
`.
`5 6
`fl
`s1gna1 2—
`
`Closed caption text
` Closed
`
`
`caption data
`and timing
`
`
`
`.
`source
`data 24—8
`
`
`
`
`
`
`
`246 % Storage dev1ce
`or
`
`
`
`transmission
`.
`.
`medium
`
`
`
`Vldeo Slgnal
`250
`
`
`source
`
`
`253.
`
`Determine a programming
`event to be recorded fl
`
`.
`.
`.
`Identify tuning data for
`the programming event in
`closed caption data
`E
`
`.
`.
`.
`.
`In1t1ate recording in
`accordance With the
`timing data
`2Q
`
`Figure 21
`
`Figure 22
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 17 0f 18
`
`US 2002/0088010 A1
`
`
`
`Metadata
` 1 82
`
`
`Metadata
`
`
`Programming
`
`event provider
`provider 180
`
`
`
`
`a
`1 84
`
`
`
`
` Preferred
`programming
`event 186
`
`Figure 23
`
`fl Receive viewer profiles
`
`fl Receive metadata for
`
`programming events
`
`programming events to viewers
`
`fl Process metadata and viewer
`profiles to determine preferred
`programming events
`
`m Transmit preferred
`
`Figure 24
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 18 0f 18
`
`US 2002/0088010 A1
`
`Metadata
`
`
`
`Viewer
`Programming
`202
`
`
`communication
`alert 206
`
`
`
`Metadata
`
`
`—>
`
`
`
`
`&
`
`
`M
`
`
`
`
`distributor
`
`device
`
`Figure 25
`
` 2_1__ Receive Viewer profile
`
`m Receive metadata for
`
`programming events
`
`
`
`M Process metadata and viewer
`
`profile to determine preferred
`programming events
`
`
`
`
`
`2_1_§ Provide programming alert to
`viewer’s communication device
`
`Figure 26
`
`

`

`US 2002/0088010 A1
`
`Jul. 4, 2002
`
`INTERACTIVE SYSTEM AND METHOD FOR
`GENERATING METADATA FOR PROGRAMMING
`EVENTS
`
`CONTINUING DATA
`
`[0001] This application claims priority under 35 USC
`§119(e) from US. Provisional Application Ser. No. 60/249,
`179, filed Nov. 16, 2000, the entirety of which is incorpo-
`rated herein by reference. This application is a continuation
`in part of, and claims priority under 35 USC §120 from, US.
`applications Ser. Nos. 09/793,294, 09/793,322, 09/793,357,
`and 09/793,479, each filed Feb. 26, 2001, the entirety of
`each of which is incorporated herein by reference.
`
`[0002] This application is related to the following appli-
`cations: System and Method for Generating Metadata for
`
`Programming Events, Ser. No.
`, filed concurrently
`herewith; System and Method for Determining the Desir-
`ability of Video Programming Events Using Keyword
`
`Matching, Ser. No.
`, filed concurrently herewith; Sys-
`tem and Method for Providing Timing Data for Program-
`
`ming Events, Ser. No.
`, filed concurrently herewith;
`System and Method for Using Programming Event Timing
`
`Data in a Recording Device, Ser. No.
`, filed concur-
`rently herewith; System and Method for Creating and Edit-
`ing a Viewer Profile Used in Determining the Desirability of
`
`Video Programming Events, Ser. No.
`, filed concur-
`rently herewith; and System and Methods for Determining
`the Desirability of Video Programming Events, Ser. No.
`PCT/US/
`, filed concurrently herewith, each of which
`is incorporated herein by reference.
`
`FIELD OF THE INVENTION
`
`[0003] Embodiments of the invention relate to technolo-
`gies that enable the identification of programming events of
`interest to a viewer.
`
`BACKGROUND TECHNOLOGY
`
`[0004] Television viewers are presently able to access
`hundreds of channels providing a multitude of programs,
`only a small fraction of which will be of interest to a given
`viewer. To assist the viewer in determining programs of
`interest, current commercially available reception devices
`such as televisions, analog cable receivers, and digital cable
`and satellite receivers typically provide a program guide
`function that allows the viewer to access a grid showing
`programs that will be available on various channels in
`upcoming time slots. Brief descriptions of programs may
`also be accessible. Such receivers may also allow the user to
`search for programs in basic categories such as news, sports,
`movies, etc.
`
`[0005] Current commercially available television record-
`ing technology also provides similar tools. The present
`generation of digital video recording machines, which typi-
`cally store video on a bulk storage device such as a hard disk
`drive, allow users to select programs for recording using an
`on screen program guide that provides keyword searching of
`program titles, a program time grid, and basic program
`categorization.
`
`[0006] Although these devices provide tools that improve
`over devices of earlier generations, most conventional tools
`still require viewers to examine all upcoming programs to
`
`identify programs of interest. Thus, developers of the next
`generation of devices are focused on providing intelligence
`in receiving and recording devices for identifying programs
`of interest on behalf of the user. A number of US. patents
`describe different approaches to this problem.
`
`[0007] US. Pat. No. 5,223,924 describes a device that
`downloads program descriptions. The program descriptions
`are viewed individually by a user, who indicates whether he
`is interested in each program. Based on the user’s input, the
`device builds a database of keywords associated with the
`user’s positive and negative preferences. This database is
`then used to identify upcoming programs that may be of
`interest to the user.
`
`[0008] US. Pat. No. 5,410,344 describes a device that
`stores a viewer preference file that reflects the viewer’s
`positive and negative preferences concerning various pro-
`gram attributes. The device uses the preference file to
`analyze content codes that describe attributes of available
`programs, and presents a program to the user based on the
`analysis. Programs are ranked using a neural network thresh-
`olding method.
`
`[0009] US. Pat. No. 5,434,678 and its related patents
`describe a video retrieval system in which individual por-
`tions of scenes within a video are rated in accordance with
`
`a rating system and a version of the video is presented by
`selecting the segments that are acceptable based on a user’s
`content preferences. Similar technology is described in US.
`Pat. No. 5,717,814 and its related patents.
`
`[0010] US. Pat. No. 5,444,999 describes a device that
`tracks the viewing habits of a user and builds a weekly
`viewing trend. The device notifies the viewer when the
`television is tuned to different channel in conflict with the
`
`viewing trend.
`
`[0011] US. Pat. No. 5,534,911 describes a system in
`which a viewer builds a personal profile that is then used to
`analyze data describing available programs. Programs are
`selected based on the analysis and are made available on a
`personalized virtual channel. The viewer is also enabled to
`select from among programs that are ranked in accordance
`with the profile. The specific manner in which program
`analysis is performed is not described.
`
`[0012] US. Pat. No. 5,585,865 describes a system that
`searches for a genre code in broadcast signals in accordance
`with a specified program genre. If more than one signal
`contains the desired genre code,
`the system displays the
`channel with the greatest display history.
`
`[0013] US. Pat. No. 5,619,247 describes a video record-
`ing device that selects programs for storage based on pre-
`defined user preferences, and allows a user to view the
`stored programs on a pay-per-view basis.
`
`[0014] US. Pat. No. 5,767,893 describes a system that
`uses content based filtering for identifying video programs
`to be stored. The specific manner in which content is filtered
`is not described.
`
`[0015] US. Pat. No. 5,878,222 describes a system that
`monitors channel data describing contents of available chan-
`nels and arbitrates access to display or storage resources
`based on a user profile.
`
`[0016] US. Pat. No. 5,945,988 describes a system that
`monitors the programs viewed by a current viewer and
`
`

`

`US 2002/0088010 A1
`
`Jul. 4, 2002
`
`determines the identity of the current viewer using stored
`viewer profiles. The system may then use the viewer profile
`to analyze metadata describing upcoming programs to iden-
`tify programs for viewing or recording. The specific manner
`in which the metadata analysis is performed is not described.
`
`[0017] US. Pat. No. 6,088,722 describes a system in
`which a user profile is compared to program content profiles
`to generate an agreement matrix for each program. The
`agreement matrixes are used to select a program for presen-
`tation to the viewer. Agreement matrixes may also be
`generated at a server end using profiles for multiple viewers
`to select programs to be made available from the server.
`
`SUMMARY OF THE INVENTION
`
`[0018] One shortcoming of the conventional technology
`as described above is that programs must be evaluated on a
`whole-program basis. However, many programs address
`diverse subjects, some of which will be of interest to a
`particular viewer and some of which will not. Embodiments
`of the invention address this problem through devices and
`processes for generating metadata for individual program
`segments, thus allowing program segments to be treated as
`individual programming events that can be individually
`evaluated by the user or by user equipment. Related embodi-
`ments of the invention are applicable to programs such as
`news broadcasts that are multi-segmented and are typically
`not described in detail in conventionally available informa-
`tion sources because their contents are typically not known
`until shortly before broadcast. In accordance with embodi-
`ments of the invention, the production data used to produce
`such programs may be processed to generate metadata for
`the individual segments of the program and to distribute that
`metadata to consumers in advance of the airing of the
`program.
`
`[0019] Afurther shortcoming of the conventional technol-
`ogy is that program classification is limited to broadly
`defined subject categories that are typically not easily com-
`pared to an individual viewers’ personal tastes. For example,
`conventional
`technology may be capable of classifying
`programs as being within the category of “sports.” However,
`for the viewer who is only interested in a particular sport, or
`a particular team, such classification is not effective in
`identifying programs of particular interest. Embodiments of
`the invention address this problem through the use of a
`content classification hierarchy for classifying the content of
`programming events and for defining viewer’s particular
`interests. The classification hierarchy is comprised of trees
`of subject categories of increasing specificity. This allows
`programming events to be classified with a previously
`unattainable degree of specificity, and allows viewer pref-
`erences to be expressed with equal specificity, both to
`emphasize particular categories of interest and to exclude
`categories not of interest. For example, rather than simply
`being enabled to specify interest in “sports”, a viewer may
`specify that he is interested in football and tennis but not
`basketball or baseball, and may further express interest in
`particular football teams. Thus, devices may evaluate pro-
`gramming events that are rated according to the classifica-
`tion hierarchy, using viewer profiles defined according to the
`same classification system, and the resulting evaluations
`reflect actual user preferences much more accurately than if
`conventional general categories were used. Further, among
`multiple programs that are evaluated as being of interest to
`
`a viewer, the degree of specificity of the matches provides a
`manner of ranking those programs based on viewer prefer-
`ences.
`
`[0020] The use of hierarchical classification as described
`above enables intelligent
`identification of programming
`events that will be of particular interest to a given viewer.
`This intelligence may be implemented to automatically
`record programming events of interest, to alert a viewer of
`upcoming programming events of interest, to automatically
`display programming events of interest as they become
`available, or to selectively provide programs to the viewer.
`When this intelligence is coupled with metadata describing
`individual program segments as described above, it becomes
`possible to provide the viewer with a truly personalized
`viewing experience, from which all uninteresting subject
`matter has been eliminated through deep content specific
`filtering at the program segment level.
`
`[0021] Further embodiments of the invention may com-
`bine the use of a content classification hierarchy with
`keywords for further characterizing programming events.
`Keywords may be given scores to characterize the degree to
`which they are descriptive of the programming event. In
`some embodiments, a keyword may be associated with a
`category of a classification hierarchy in a device that ana-
`lyzes programming events to more precisely indicate the
`manner in which the keyword characterizes the subject
`matter of interest to the viewer. Related embodiments of the
`
`invention may therefore evaluate programming events using
`a combination of keyword matching and category matching.
`
`[0022] Further embodiments of the invention may utilize
`interactive processes whereby personnel involved in the
`production of a programming event are enabled to partici-
`pate in the generation of metadata for the programming
`event through an interactive process, whereby preliminary
`metadata produced by a system is either approved or edited
`to reflect the judgment of the production personnel as to
`various aspects such as the categories used to described the
`programming event, scores associated with the categories,
`keywords and their scores and category associations, and a
`title for the programming event.
`
`[0023] Further embodiments of the invention may utilize
`timing data that is inserted in a closed caption data stream to
`mark at least the beginnings of programming events with
`precision so that a recording device is enable to determine
`the beginning of the programming event. The timing data
`may be created at the time that the rest of the closed caption
`data is created for the programming event, and closed
`caption data including such timing data may be synchro-
`nized to the programming event through triggering by a
`teleprompter system. A recording device may use the timing
`data to initiate, pause, un-pause and terminate recording.
`Related embodiments may incorporate such timing data in
`the video signal itself.
`
`In accordance with one embodiment of the inven-
`[0024]
`tion, metadata for a programming event may be generated
`through an interactive process. A system may receive data
`corresponding to a programming event. The data may
`include descriptive information and timing information. The
`system may then generate preliminary metadata for the
`programming event from the received data. The system may
`provide the preliminary metadata to a system user, and then
`receive user specified metadata responsive to the prelimi-
`
`

`

`US 2002/0088010 A1
`
`Jul. 4, 2002
`
`nary metadata. The preliminary metadata may include one or
`more of categories of a classification hierarchy, goodness of
`fit scores associated with the categories, keywords, goodness
`of fit scores associated with the keywords, and a title.
`Related embodiments may pertain to a system implementing
`such methods. Further related embodiments may pertain to
`methods and systems in which a system user is enabled to
`approve preliminary metadata provided by the system.
`
`[0025] The following description of various embodiments
`discloses a variety of additional features that may be imple-
`mented in conjunction with the various embodiments sum-
`marized above and in further combinations that will be
`
`apparent to those having ordinary skill in the art.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0026] The invention may be better understood with ref-
`erence to the following figures. The components in the
`figures are not necessarily to scale, emphasis instead being
`placed upon illustrating the principles of the embodiments of
`invention described in conjunction therewith.
`
`[0027] FIG. 1 illustrates a system for providing metadata
`and programming events to a client device in accordance
`with an embodiment of the invention;
`
`[0028] FIG. 2 illustrates a process in a system such as the
`system shown in FIG. 1;
`
`[0029] FIG. 3 illustrates an example of production data
`comprising HTML script data produced by a conventional
`production application;
`
`[0030] FIG. 4 illustrates an example of production data
`comprising rundown data produced by a conventional pro-
`duction application;
`
`[0031] FIG. 5 illustrates a system for providing metadata
`and programming events to a client device in accordance
`with an embodiment of the invention;
`
`[0032] FIG. 6 illustrates a process in a system such as the
`system shown in FIG. 5;
`
`[0033] FIG. 7 illustrates metadata in accordance with an
`embodiment of the invention;
`
`[0034] FIG. 8 illustrates a portion of a classification
`hierarchy in accordance with an embodiment of the inven-
`tion;
`
`[0035] FIG. 9 illustrates a process for generating metadata
`in accordance with an embodiment of the invention;
`
`[0036] FIG. 10 illustrates a process for generating key-
`word metadata in accordance with an embodiment of the
`invention;
`
`[0037] FIG. 11 illustrates an interactive process for gen-
`erating metadata in accordance with an embodiment of the
`invention;
`
`[0038] FIG. 12 illustrates a client device in accordance
`with an embodiment of the invention;
`
`[0039] FIG. 13 illustrates a viewer profile in accordance
`with an embodiment of the invention;
`
`[0040] FIG. 14 illustrates a process for producing a pre-
`ferred programming event schedule in accordance with an
`embodiment of the invention;
`
`[0041] FIG. 15 illustrates a process for selectively noti-
`fying a viewer of a programming event and recording a
`programming event in accordance with an embodiment of
`the invention;
`
`[0042] FIG. 16 illustrates a process for assigning a desir-
`ability score to a programming event based on category
`matching using a viewer profile in accordance with a pre-
`ferred embodiment of the invention;
`
`[0043] FIG. 17 illustrates a process for assigning a desir-
`ability score to a programming event based on category
`matching using multiple viewer profiles in accordance with
`a preferred embodiment of the invention;
`
`[0044] FIG. 18 shows a process for ranking programming
`events based on category matching and keyword matching
`in accordance with a preferred embodiment of the invention;
`
`[0045] FIG. 19 shows a process for ranking programming
`events based on categor