Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 1 of 15
`Case 3:l6—cv—O2433 Document 1-4 Filed 05/04/16 Page 1 of 15
`
`  
`
`EXHIBIT D 
`
`EXHIBIT D
`
` 
`
` 
`
`

`
`case we-cv-o24ss Document IIIIIIIIIIIIIIIIIIIIIIIIIIHIIIIIIIIIIIIIIIIIIIIIIIIIIII||||||||||||
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 2 of 15
`US005907322A
`
`Ulllted States Patent
`
`[19]
`
`[11] Patent Number:
`
`5,907,322
`
`Kelly et al.
`
`[45] Date of Patent:
`
`May 25, 1999
`
`[54] TELEVISION EVENT MARKING SYSTEM
`
`Kenneth Y_
`Inventors: Gregory H_
`Goldberg’ both of San Francisco; John
`S. Gee, Auburn; Philip D. Levinson,
`Los Altos Hills; Scott Fullam,
`Mountain View’ all of Calif.
`
`[73] Assignee: Catch TV Acquisition Corp.,
`.
`.
`Burlingame, Calif.
`
`[21] Appl. No.: 08/731,525
`
`[22]
`
`Filed:
`
`Oct 16, 1996
`
`Int. Cl.6 ..................................................... .. H04N 7/16
`[51]
`[52] U.S. Cl.
`.......................... .. 345/327; 348/10; 348/734;
`455/6.2
`
`[58] Field of Search .................................. .. 348/906, 1, 6,
`348/10, 11, 12, 13, 7, 734; 345/327; 455/4,
`2, 5.1, 6.1, 6.2, 6.3; H04N 7/173
`
`[56]
`
`References Cited
`
`Us‘ PATENT DOCUMENTS
`11/1987 Young .
`8/1995 Palmer ...................................... .. 348/1
`8/1995 Saitoh ................................... .. 348/734
`
`4,706,121
`5,438,355
`5,444,499
`
`5,570,295
`5,692,214
`
`5,778,182
`
`10/1996 Isenberg et al.
`.................. .. 364/514 R
`11/1997 Levine .................................. .. 348/906
`
`HEIIIISOH ..... ..
`............................ .. 348/1
`7/1998 Cathey et al.
`OTHER PUBLICATIONS
`5,
`.
`.
`.
`.
`.
`Joining Television and the Internet Using Java , Internet
`Week, pp. 1-2, Apr. 1, 1996.
`
`“
`
`Primary Examiner—Chris Grant
`Attorney, Agent, or Firm—Dennis & Irene Fernandez LLP
`
`[571
`
`ABSTRACT
`
`A system for bookmarking viewer selected TV broadcast
`events and displaying a set of associated internet locations or
`website hotlinks, comprising the selection of a set of broad-
`cast events using a remote control, and storing a set of
`event-identifier data associated with the set of selected
`
`broadcast events in an activity table, and then generating a
`set of associated internet locations or Website hotlinks by
`comparing the set of event identifiers with a database of TV
`schedules, events and company information. The generated
`set of associated internet locations or Website hotlinks can
`then be used by viewer for access to and display of the
`selected internet locations associated with the set of selected
`br0adCaSI CVCHIS
`
`10 Claims, 9 Drawing Sheets
`
`
`
`
`
`------------------------------ »-
`
`202
`
`INTERNET OR
`CUSTOM COMMAND
`QTHER
`.............................. ..
`GENERAL PURPOSE
`1
`NETWORK
`
`MEMORY FOR CPU
`
`
`REMOE
`CONTR L
`(RC)
`
`I
`I
`
` ROM
`CPU PROGRAM
`INSTRUCTIONS
`
`60
`
`IR COMMAND
`
`CHANNEL REGISTER
`
`I/0
`
`
`
`
`36
`
`
`VCR
`INTERFACE
`DVD-ROM,
`5
`DVD'E
`
`
`
`
`
`I
`I
`
`REAL TIME
`CLOCK
`
`NETWORK
`INTERFACE
`
`

`
`342n_VVp_.6
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 3 of 15
`03e9aD.
`41
`6
`l
`
`aaCP5
`itgm%t
`
`02DYa3M
`
`U9C5
`
`ewm1
`
`M9
`
`EhHS
`
`.O%
`
`510t
`
`00
`
`4f
`
`M9
`
`f5
`223,7059,
`
`m_.:
`
`mmv_mo>>m_zE158m_oEzmEz_
`
`
`
`mm_>>E_._.mm_>o<mwmm>._.>>OIm>.r
`
`mm<m<._.<n_
`
`
`
` mmEmmm_>>Im_Em_Em_>o<E85mesomzfimm
`mflsomzom
`
`
`
`8%mm;n_m_._.<._m_m
`
`>.r
`
`:,m_s_m_mE.._m_>o<
`
`mmSom__._om
`
`wm_m._.m<on_<Om_m>._.
`
`
`
`v_m_O>>._.mzm_._m<o
`
`m_.:._._m_._.<m
`
`mmEm<oo<omm
`
`Fmm_D.O_..._
`
`265/._oEzoo
`
`Eosmm
`
`
`
`
`
`
`
`
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 4 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 4 of 15
`
`Mw
`
`9M2whS
`
`5,907,322
`
`U.S. Patent
`
`5.,8W
`v_mo>Ez
`
`mom_zmEz_
`
`E15
`
`Now
`
`am
`
`SN
`
`mom
`
`SN
`
`NE
`
`im
`
`
`
`n_z<_>__>_Oo205:0
`
`
`
`mmommi._<m_m_zm__®
`
`Eomom>mos_m_s_
`
`20¢
`
`s_<mwoE3%
`
`mzO_._.o:m_._.wz_
`
`oz<s_s_oom_
`
`em
`
`20
`
`
`
`$5.8m._mzz<_._o
`
`m_o<u_m_m:.z_
`
`
`
`v_m_O>>._.m_zgood
`
`
`
`.u.__>=._.._<m_m
`
`mmm._m_m_>>
`
`m_o<u_m_m._.z_
`
`Z.‘u::uvu:-
`...uunun.an
`
`Eosmm
`
`657.8
`
`as
`
`mo>
`
`__>_om-n_>n_
`
`m_-o>n_
`
`Nm_m:0_u_
`
`
`
`
`
`

`
`U
`
`22
`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 5 of 15
`
`.......................................................................-.._CP\ScomEm
`m5WI5o<&@_W.99pmmm_Sm_._mE40>#5MMn_z<_>__>_Oom__9®®00..............................-.
`mzmwwmmjwzmO@OBh_>_<Hs.28AWQ©H@@@m93%mo;
`Eo_>_m_>_
`-%.m.$_.g._...,@..z..m..m.V..M@@no02_Dym®9EW1m4mo_._.2Hmt 3nm_oEmEz_NeCWxM.
`a-a/WEomaomMo§>m_v_om5m,.........................................................................AM.........................................--
`
`
`

`
`.m9
`
`U
`
` mv_mo>Emz595DMmE5<on_<ommEmM35mm;om._.<._mmMm_E_mmm_>>MawIm.Em_Em>o<E8mymmEmmm;
`m_Em_Em>o<Em_m<mE<oaoxmEetNov_¢o>EmzE158mummoEzmm_Ez_8mm&afl
`
`Bcjmm$5818mMmE_mmm>>
`
`
`mmmm:2m__._ommmwm.,%_%«m¢mm.5,Ezm_2mm\.,_EEm_>2
`
`
`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 6 of 15
`4
`6
`
`M9mM54oadeP._h__HS
`
`1x
`
`22
`
`w,_.mm:w_"_
`
`
`5W,maW5gm......................................\em...........
`-.4.Qm._.E.._,._.Qo..........-.mEosmm
`
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 7 of 15
`6
`
`U
`
`nun“uu:::un:u:nu:I::uuIuu:::un:::u::u:::::.:u:::uI:.:n:nnu.“CP\SmS.gmM3
`MmmMQEEEmmwmmw5#__>>maanuuuuuuu..:u:uuu
`
` W22<,$%:oWW@@awmwMWm5.,SN3%mo;>mosm__2WM®QU9DMum_mo.E:n:<$_zmo©63n_3__m8Noz<s__>_oo
`205822wSN39:t_>_5<__
`
`
`dzzséMW5sN:NWmwWWO@OmnEmH._Hsoz<_>_s_oom_mmGUGGUMmzo:o:Emz_
`6Eu4o>45mMMSNE5_om_m
`
`
`22
`
`f5mmoEE:,__Wm_V5%HN3mmamms__Z<m_m9.mm2\-:\Ee..__mma2WM9GU
`o<&@_om5m,_................................................E...........1......................................................................
`onEE205.W,:8m_oommmm_:0_u_
`
`
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 8 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 8 of 15
`
`U.S. Patent
`
`May 25,1999
`
`Sheet 6 of 9
`
`5,907,322
`
`300
`
`VIEWER ACCESSES DATABASE
`
`THROUGH ON-LINE SERVICE TO
`VIEW SCHEDULE OF UPCOMING
`BROADCAST EVENTS.
`
`VIEWER SELECTS A SET OF
`BROADCAST EVENTS TO
`BE VIEWED.
`
`CUSTOM SCHEDULE IS
`GENERATED BY
`DATABASE.
`
`CUSTOM SCHEDULE IS
`DOWNLOADED TO CUSTOM
`
`COMMAND TABLE IN MEMORY
`
`OF NETWORK ACCESS DEVICE.
`
`TIME-BASED COMMANDS ARE
`EXECUTED BY CPU IN
`NETWORK ACCESS DEVICE TO
`CAUSE TV TUNER TO CHANGE
`CHANNELS AT THE
`PREDETERMINED TIMES.
`
`FIG. 6
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 9 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 9 of 15
`
`U.S. Patent
`
`May 25,1999
`
`Sheet 7 of 9
`
`5,907,322
`
`330
`
`VIEWER ACCESSES DATABASE
`THROUGH ON-LINE SERVICE TO
`VIEW SCHEDULE OF UPCOMING
`BROADCAST EVENTS.
`
`VIEWER SELECTS A SET OF
`BROADCAST EVENTS TO
`
`BE VIEWED.
`
`CUSTOM SCHEDULE IS
`
`GENERATED BY
`DATABASE.
`
`CUSTOM SCHEDULE IS
`DOWNLOADED TO CUSTOM
`COMMAND TABLE IN MEMORY
`OF REMOTE CONTROL.
`
`TIME-BASED COMMANDS ARE
`EXECUTED BY CPU IN
`REMOTE CONTROL TO CAUSE
`TV TUNER TO CHANGE
`CHANNELS AT THE
`PREDETERMINED TIMES.
`
`FIG. 7
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 10 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 10 of 15
`
`U.S. Patent
`
`May 25,1999
`
`Sheet 8 of 9
`
`5,907,322
`
`400
`
`VIEWER ACCESSES DATABASE
`THROUGH ON-LINE SERVICE TO
`VIEW SCHEDULE OF UPCOMING
`BROADCAST EVENTS.
`
`VIEWER SELECTS A SET OF
`BROADCAST EVENTS TO
`BE VIEWED.
`
`CUSTOM SCHEDULE IS
`GENERATED BY
`DATABASE.
`
`CUSTOM SCHEDULE IS
`DOWNLOADED TO CUSTOM
`COMMAND TABLE IN MEMORY
`OF NETWORK ACCESS DEVICE.
`
`TIME-BASED COMMANDS ARE
`EXECUTED BY CPU IN
`NETWORK ACCESS DEVICE TO
`CAUSE THE VCR TO RECORD
`BROADCAST EVENTS AT THE
`PREDETERMINED TIMES.
`
`FIG. 8
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 11 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 11 of 15
`
`U.S. Patent
`
`May 25,1999
`
`Sheet 9 of 9
`
`5,907,322
`
`430
`
`VIEWER ACCESSES DATABASE
`THROUGH ON-LINE SERVICE TO
`VIEW SCHEDULE OF UPCOMING
`BROADCAST EVENTS.
`
`VIEWER SELECTS A SET OF
`BROADCAST EVENTS TO
`
`BE VIEWED.
`
`CUSTOM SCHEDULE IS
`
`GENERATED BY
`DATABASE.
`
`CUSTOM SCHEDULE IS
`DOWNLOADED TO CUSTOM
`COMMAND TABLE IN MEMORY
`OF REMOTE CONTROL.
`
`TIME-BASED COMMANDS ARE
`
`EXECUTED BY CPU IN
`REMOTE CONTROL TO CAUSE
`THE VCR TO RECORD
`BROADCAST EVENTS AT THE
`PREDETERMINED TIMES.
`
`FIG. 9
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 12 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 12 of 15
`
`5,907,322
`
`1
`TELEVISION EVENT MARKING SYSTEM
`
`FIELD OF THE INVENTION
`
`This invention relates to systems for navigating, marking
`and displaying viewer-selected television broadcast events
`and the on-line information and content associated with the
`selected broadcast events.
`
`BACKGROUND OF THE INVENTION
`
`As television (TV) viewers become more familiar with
`on-line services, such as the internet and the World Wide
`Web, they are demanding access to on-line information and
`content related to the TV content and TV-advertised com-
`
`panies and products. This information is becoming more
`readily available to the internet user. An increasing number
`of TV broadcasters, advertisers, and organizations have
`created their own internet
`locations (i.e., websites), and
`many have begun to display their web site address, (i.e., their
`Universal Resource Locator (URL) on TV ads and programs
`(broadcast events) to encourage viewers to access their
`website for more information. However, viewers typically
`cannot easily recall or identify an associated URL for a
`particular broadcast event because the broadcast URLs are
`typically displayed on TV for only a brief time and, in many
`cases, the relevant URL is not broadcast at all. A tool is
`needed to allow the viewer to easily access URLs,
`to
`immediately navigate to the desired URL, i.e., switch to the
`displayed website as if it were a TV channel, or to “book-
`mark” the broadcast event, i.e., to mark one or more broad-
`cast TV events so the viewer can later recall these events and
`access all the websites associated with these events.
`
`Familiar to most people, traditional bookmarks are those
`used to mark a page in a book to which the reader wants to
`later return. In the personal computer and World Wide Web
`environment, an analogous feature allows a typical net
`browser application running on the computer to “bookmark”
`web pages, i.e., select a button from a pull-down menu on
`the browser tool, allowing the user to store a URL associated
`with a website for rapid, one-step return access, without
`requiring the user to recall or re-enter the URL of that
`particular website. However, because there is no similar
`“bookmarking” tool that exists for viewers to use with their
`TVs, there is a resulting need for a user-friendly, automated
`system to “bookmark” TV broadcast events and the URLs
`associated with these events for subsequent viewer use.
`Additionally, once the events are bookmarked,
`it is also
`desirable to provide a system for viewers to easily retrieve
`and display the websites and website “hotlinks” (i.e., buttons
`programmed in hypertext markup language displayed on the
`internet that connect directly to specific websites) associated
`with these bookmarked events.
`
`SUMMARY OF THE INVENTION
`
`This invention describes a system for marking viewer-
`selected TV broadcast events by selecting a one or more
`broadcast events using a remote control, and storing a set of
`data associated with each selected broadcast events as an
`
`The activity
`in an activity table
`activity record
`table with the set of event identifiers is transmitted to an
`
`on-line database having information relating to TV program
`schedules, TV and Web advertisements information and
`related website hotlinks to thereby generate a set of associ-
`ated network locations, such as websites and website hot-
`links. The generated set of associated internet locations or
`website hotlinks can be used by the viewer for access to and
`display of the generated set of internet locations or websites
`associated with viewer selected broadcast events.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`It is also envisioned that this invention also provides a
`system to allow viewer to customize in advance event
`viewing schedule and to automate TV display of, or record-
`ing to a VCR of, viewer selected events.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 illustrates a TV event marking system for marking
`viewer selected television events and displaying the associ-
`ated internet hotlinks and locations corresponding with the
`selected events in accordance with the principles of this
`invention.
`
`FIG. 2 illustrates a more detailed block diagram of the
`network access device shown in FIG. 1.
`
`FIG. 3 illustrates a more detailed block diagram of the
`new remote control shown in FIG. 1.
`FIG. 4 illustrates an alternative embodiment of the TV
`
`event marking system of FIG. 1.
`FIG. 5 illustrates a more detailed block diagram of the
`new remote control in the TV event marking system of FIG.
`4.
`
`FIG. 6 illustrates an automated custom program schedul-
`ing and display method using TV event marking system of
`FIG. 1.
`FIG. 7 illustrates an alternative embodiment of the auto-
`
`mated custom program scheduling and display method using
`TV marking system of FIG. 4.
`FIG. 8 illustrates an automated VCR programming
`method of viewer marked events using TV event marking
`system of FIG. 1.
`FIG. 9 illustrates an alternative embodiment of the auto-
`
`mated VCR programming method of viewer marked events
`using TV event marking system of FIG. 4.
`DETAILED DESCRIPTION OF THE
`INVENTION
`FIG. 1 illustrates an embodiment of a low cost TV event
`
`marking system 100 for marking viewer selected TV broad-
`cast events so that associated information such as websites
`can be retrieved from an on-line service 60, such as the
`Internet, an intranet or other networks. In effect, this pro-
`vides means to “bookmark” a televised event, marking that
`event for later recall, loosely analogous to placing a book-
`mark in a book to facilitate later recall. TV event marking
`system 100 allows a viewer to “bookmark” a set of selected
`TV events as they are broadcast, such as, but not limited to,
`a TV advertisement, a TV news broadcast, a TV educational
`or entertainment program, or a TV job training show. TV
`event marking system 100 stores the set of selected events
`into computer memory so that on-line data associated with
`these events can be retrieved from a central database. In
`
`system 100, the viewer can mark the specified broadcast
`event by activating a select button 15 on a remote control 12.
`In this example, select button 15 is labeled “B” on remote
`control 12 to denote “Bookmark”. Each time the viewer
`
`activates select button 15 to bookmark a particular broadcast
`event, an activity record
`entry comprises data describ-
`ing the date, time and channel is stored into an electronic
`memory 202. It is envisioned that TV event marking system
`100 can also store an AR entry for each additional data
`relating to viewer preferences, such as for example, each
`time the channel is changed via remote control 12, and other
`remote control operations indicating viewing preferences.
`We refer to a list of AR entries as an activity table (AT) 204
`that is stored in electronic memory 202.
`Once the viewer has completed marking a selection of
`broadcast events, AT 204 is stored into a network access
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 13 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 13 of 15
`
`5,907,322
`
`3
`device 21, whether in the resident memory inside network
`access device 21 coupled to a TV tuner 34, or in an
`alternative embodiment, in the resident memory of a per-
`sonal computing device 20 (as in FIG. 4). When the viewer
`is ready to browse the websites associated with the selected
`broadcast events, either network access device 21, or per-
`sonal computing device 20 of FIG. 4, transmits activity table
`204 comprising the AR entries and also viewer identifying
`data, such as a particular demographic data, for example, the
`postal code of the viewer’s location, via on-line service 60
`to a central database 40. Database 40 comprises information
`compiled from various sources, such as TV advertisements
`schedules 50 associated with various TV shows, TV show
`schedules 52, TV advertisers’ websites 62 and other web-
`sites topically related to broadcast content 64. AT 204 is then
`used to determine which data in the database 40 should be
`
`retrieved and presented to the viewer. For example, one of
`the AR entries in the AT might be (Sep. 1, 1996-19:30:32-
`CH7), indicating the date, time, and channel selected. This
`data, along with the viewer’s regional information, is then
`compared to the TV advertisement schedule 50 in database
`40 to determine the TV advertisements broadcast at the time
`
`of activating select button 15. Database 40 then generates a
`custom list of data for the user which indicates bookmarks
`
`associated with the broadcast event. For example, this list of
`data could take the form of, but not limited to, a World Wide
`Web
`page on the Internet. The viewer could then
`view these with a generic www browser.
`FIG. 2 shows a more detailed block diagram of network
`access device 21 such as a set-top box comprising a com-
`puter system coupled to a conventional TV tuner 34, or a
`specialized TV having computer processing capability (i.e.,
`a PCTV), both having conventional network connection
`capabilities or other means for on-line access to the Internet
`or other networks 60. CPU 216 controls among other
`functions, a wireless interface 230, a custom command table
`206, communications with external devices via an I/O
`interface 232. In the preferred embodiment, AT 204 is stored
`in electronic memory 202 inside network access device 21.
`When Bookmark button 15 is pressed, remote control 12
`sends a wireless signal comprising a command to CPU 216
`to store an AR entry into AT 204 inside network access
`device 21, thereby “bookmarking” the broadcast event for
`later lookup. It is also an objective of this invention that TV
`event marking system 100 can be programmed to automate
`custom display of, or to program a VCR to record viewer
`selected broadcasts according to viewer selected TV sched-
`ules and events of database 40, as is later described with
`FIGS. 6-9. It is further envisioned that the principles of this
`invention can also be used to mark radio broadcast.
`
`FIG. 3 illustrates a more detailed block diagram of remote
`control 12. In the preferred embodiment, remote control 12
`comprises a network access button 16 that interrupts a TV
`broadcast displayed on TV 34 and immediately display
`instead a selected associated website on TV 34. In this
`
`example, network button 16 is labeled “Go” to denote “Go
`to selected site”. Each time the viewer activates network
`
`button 16, a request to view a particular website is initiated.
`Aside from the new features described herein, remote con-
`trol 12 further comprises similar basic components and
`functions as in conventional remote controls, and thus it also
`provides the traditional operations of other conventional
`remote controls along with the event marking function
`buttons, such as provided by event selection button 15,
`(labeled here, for example, as “B” for “Bookmarking”),
`network access button 16 (labeled “Go”), and in an alter-
`native embodiment shown in FIG. 5, further described
`
`4
`
`below, download button 17 (labeled “D”) and upload button
`(labeled “U”). It
`is understood that
`the labels provided
`herein for the function buttons on remote control 12 are
`merely examples in describing their respective embodiments
`and for ease of reference. It should be obvious that other
`labeling of function buttons 15-16 are envisioned as within
`the scope of this invention.
`In operation, whenever the viewer activates event selec-
`tion button 15 “B” on keypad 14 (FIG. 3), this activation
`contemporaneously triggers CPU 216 (FIG. 2) in network
`access device 21 to concurrently query real time clock 220
`for the current date and time, and IR command table 212 for
`the current channel, in order to generate an AR to which it
`adds a flag indicating a “bookmark”. The resulting activity
`record having a “bookmark” flag is then stored into AT 204
`and, as an example, comprising information representative
`of:
`Date-Time-Channel-Bookmark:
`
`Sep. 1, 1996-19:30:32-7-B
`It is also envisioned that TV event marking system 100
`can also be used to provide data of user’s viewing patterns,
`interests and preferences by generating an AR entry for each
`time the viewer changes channels via remote control 12.
`Whenever the viewer activates the change of channel button
`on remote control 12, the remote control sends to the TV, the
`VCR, etc., an infrared signal to change the channel, and also
`signals CPU 216 in network access device 21 to query real
`time clock circuit 220 for the current date and time, and also
`current channel register 214 for the current channel infor-
`mation. The resulting AR entry might comprise the follow-
`ing representative information:
`Date-Time-Channel Change:
`Sep. 1, 1996-19:30:32-CH7
`Each change of channel by the viewer thereby produces a
`corresponding stored AR entry in AT 204, the collective data
`of various AT 204 from each viewer can be used to evaluate
`
`viewer preferences and viewing patterns.
`The number of AR entries stored in AT 204 is limited only
`by the available memory space in memory storage 202 or
`attached storage device. AT 204 is organized in a first-in,
`first-out (FIFO) sequence. When the available memory is
`fill, the oldest ARs are deleted to accommodate the newest
`ARs. When the viewer wants to access the various websites
`associated with the selected broadcast events, the viewer
`activates network access button 16 (“G0”) which causes
`peripheral device 21 to send the selected AT 204 to database
`40, whereupon database 40 will return to network access
`device 21 the network address of the selected websites.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`then processes the
`Network access device 21 (FIG. 2)
`network address for the selected website and retrieve it for
`the viewer. Thus the viewer can access selected websites
`
`55
`
`60
`
`65
`
`with a single button.
`FIG. 4 shows an alternative embodiment of network
`access device 20, wherein the network access device need
`not be a set-top box, a PCTV, or a computer coupled to the
`TV for network access. In this embodiment, AT 204 is first
`stored in a remote control device 10 and later downloaded
`
`from remote control 10 to a personal computing device 20,
`such as a standard personal computer that can communicate
`with remote control 10 via a wireless interface 230 and/or a
`standard I/O interface 232. In this embodiment, personal
`computer 20 has a network connection or other means for
`on-line access to the Internet and other such networks 60. As
`
`shown in FIG. 4, network interface 250 for controlling the
`access to network 60 resides in PC 20, thereby eliminating
`the need for a TV to be coupled to a settop box or a personal
`computer.
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 14 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 14 of 15
`
`5,907,322
`
`5
`In the alternative embodiment of TV event marking
`system 101 of FIG. 4, the viewer periodically transfers AT
`204 from remote control 10 to peripheral device 20 via
`standard wireless interface 231 or standard I/O interface 233
`on remote 10 when viewer download button 17 is activated
`by the viewer. In this example, download button 17 is
`labeled “D” on remote control 10 to denote “Download
`Activity Table to PC”. Each time the viewer activates
`download button 17 to transfer AT 204 to remote control 10,
`AT 204 on personal computer 20 is thereby updated.
`FIG. 5 illustrates a more detailed block diagram of remote
`control 10, described in accordance with the principles of
`this invention. Aside from the additional features described
`
`herein, remote control 10 further comprises similar basic
`components as in conventional remote controls and thus also
`provide the traditional operations of other conventional
`remote controls together with event marking function
`buttons, such as provided by, event selection button 15,
`(labeled here, for example, as “B” for “Bookmarking”),
`network access button 16 (labeled “Go”), download button
`17 (labeled “D”) and upload button (labeled “U”).
`Additionally, remote control 10 comprises a serial I/O
`interface 233 which is envisioned as an alternative means of
`
`interfacing remote control 10 to personal computing device
`20. It is envisioned that remote control 10 may be manu-
`factured with or without I/O interface 232.
`In operation, whenever the viewer changes channels via
`remote control 10 by pressing the conventional channel
`change buttons, in addition to performing the function of
`sending to the TV set, VCR, etc. an infrared signal to change
`the channel, this action contemporaneously activates CPU
`218 embedded in personal computing device 20 to concur-
`rently query real time clock 220 for the current date and
`time, and current channel register 214 for
`the current
`channel, in order to generate an AR entry which is stored
`into AT 204. The resulting AR comprises:
`Date-Time-Channel:
`
`Sep. 1, 1996-19:30:32-CH7
`Whenever the viewer activates the event selection button
`
`15 on keypad 14, “bookmarking” a particular event, this
`activation contemporaneously triggers CPU 218 to concur-
`rently query real time clock 220 for the current date and
`time, and an IR command table 212 for the current channel,
`in order to generate an AR to which it adds a flag indicating
`the “bookmark”. IR command table 212 comprises stored
`infrared data that remote control 10 received via wireless
`
`interface circuit 231, such as from the TV tuner or personal
`computing device 20. The resulting AR entry is then stored
`into AT. The resulting AR entry with “bookmark” flag
`comprises the following information:
`Date-Time-Channel-Bookmark Example:
`Sep. 1, 1996-19:30:32-7-B
`As described above in the preferred embodiment, AT 204 is
`organized in a FIFO sequence. Thus, when the available
`memory is full, the oldest ARs are deleted to accommodate
`the newest ARs. When the viewer wants to access the
`various websites associated with the selected broadcast
`events,
`the viewer then activates download button 17 to
`transfer stored AT 204 to personal computing device 20 via
`the wireless interface 231 or the I/O interface 233. When
`viewer activates network access button 16 (“Go”), personal
`computing device 20 transmits AT 204 to database 40,
`whereupon in response, database 40 transmits to personal
`computing device 20 the network address of the associated
`website correlating to viewer’s selection. Personal comput-
`ing device 20 will then process the network address to
`generate the selected website or website hotlinks for access
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`by the viewer. Thus the viewer can access desired websites
`activating a single button, “GO”.
`FIG. 6 illustrates an automated custom program schedul-
`ing method using TV event marking system 100 of FIG. 1.
`Automated custom program schedule method 300 accesses
`on-line broadcast event listings in database 40 to allow
`viewer to bookmark in advance selected scheduled broad-
`
`cast events or websites for automated TV viewing. Auto-
`mated custom scheduling method 300 comprises a first step
`302 of accessing database 40 via network accessing device
`20 to view scheduled broadcast events. Then, in step 304,
`viewer selects the set of broadcast events to be viewed. Once
`
`selection is completed, a corresponding custom schedule
`identifying selected the date, time and channel of all selected
`events is generated in step 306,. Then,
`in step 308,
`the
`custom schedule is downloaded to custom command table
`
`206 (see also FIGS. 1) in memory 202 of network access
`device 21. The custom command table 206 comprising a
`time-based command sequence is then executed by CPU 216
`in network access device 21 in step 310 to instruct TV tuner
`34 to automatically change channels in a time sequence
`provided in custom command table 206. It is envisioned that
`remote controls 10 and 12 (FIG. 3 and 5) comprises
`bi-directional
`I/O port and thus can be remotely pro-
`grammed by personal computer system 20 or network access
`device 21.
`FIG. 7 shows an alternative embodiment of an automated
`
`custom program scheduling method using TV event marking
`system of FIG. 4. Thus, automated scheduling method 330
`comprises a first step 312 of accessing on-line broadcast
`event listings in database 40 to allow viewer to bookmark in
`advance selected scheduled broadcast events or websites for
`
`automated TV viewing. Then, in step 314, viewer identifies
`the set of broadcast events to be viewed. Once selection is
`
`completed, a corresponding custom schedule identifying
`selected the date, time and channel of all selected events is
`generated in step 306. Then, in step 308, the custom sched-
`ule is downloaded to custom command table 206 in memory
`of remote control 10 (see FIG. 5). Custom command table
`206 comprising a time-based command sequence is then
`executed by CPU 218 remote control 10 in step 310 to
`instruct TV tuner 34 to automatically change channels in a
`time sequence provided in custom command table 206.
`In yet another embodiment, FIG. 8 illustrates an auto-
`mated VCR programming method 400 using TV event
`marking system of FIG. 1 to access an on-line broadcast
`event listing in database 40 to allow viewer to bookmark
`scheduled broadcast events or websites for automated VCR
`
`recording. Automated programming method 400 comprises
`a first step 402 of accessing database 40 through on-line
`service 60 to view scheduled broadcast events. Then, in step
`404, viewer identifies the set of broadcast events to be
`recorded. Once selection is complete, database 40 then
`generates in step 406, a corresponding custom schedule
`identifying selected the date, time and channel of all selected
`broadcast events to be recorded. Then,
`in step 408,
`the
`custom schedule is downloaded to custom command table
`
`206 in memory storage 202 of network access device 21.
`The custom schedule is then executed by CPU 216 in
`network access device 21 in a time-based sequence in step
`410 to instruct the VCR to automatically record a particular
`channel at a pre-determined time.
`Shown in FIG. 9 is an alternative embodiment of auto-
`
`mated VCR programming method 430 using TV event
`marking system of FIG. 4 comprising a first step 412 of
`accessing database 40 to view scheduled broadcast events.
`Then, in step 414, viewer selects the set of broadcast events
`
`

`
`Case 3:16-cv-02433 Document 1-4 Filed 05/04/16 Page 15 of 15
`Case 3:16—cv—O2433 Document 1-4 Filed 05/04/16 Page 15 of 15
`
`5,907,322
`
`7
`to be recorded and viewed. Once the selection is complete,
`a corresponding custom schedule identifying selected the
`date, time and channel of all selected broadcast events is
`thereby generated in step 406. Then, in step 409, the custom
`schedule is downloaded to custom command table 206 in
`
`remote control 10 (see FIG. 5) via personal computer device
`20. The custom schedule is then executed in step 420 by
`CPU 218 of remote control 10 in a time-based sequence so
`to instruct the VCR to automatically record a particular
`channel at a pre-determined time.
`It is also envisioned as within the principles and scope of
`this invention to provide a method and means to develop
`viewer data patterns by uploading a plurality of AT 204 from
`multiple viewers. As described above, since it is envisioned
`that viewer channel selection can be stored as an AR entry
`in AT 204 each time the viewer makes a channel selection,
`activity table 204 can be uploaded from each viewer to
`identify patterns of TV viewing, such as, but not limited to,
`frequency of viewing of particular channels, broadcast
`events, volume patterns and other events and patterns.
`Examples of the method and means to record and display
`viewer selected events and associated internet locations or
`website hotlinks are described herein in accordance with the
`
`principles of this invention. However, variations in embodi-
`ments of the principles of this invention are contemplated as
`within the scope of this invention and are thus also consid-
`ered as taught by this invention.
`We claim:
`
`1. A method for marking and recording viewer-selected
`TV broadcast events comprising the steps of:
`
`selecting a set of broadcast events using a remote control,
`wherein the step of selecting a set of broadcast events
`comprises;
`activating by a viewer an event select button on the
`remote control; and
`detecting in response to the viewer activating the event
`select button an associated date and time data from
`a real time clock circuit and an associated channel
`
`data from a channel register corresponding to the
`selected event; and
`storing a set of event-identifiers associated with the set of
`selected broadcast events, comprising storing the
`detected date and time data and the detected channel
`
`data as an activity record in an activity table.
`2. The method of recording viewer selected broadcast
`events of claim 1 further comprising a viewer activating a
`direct network access button on the remote control for
`