`
`1.
`
`I have been retained by Sony Corporation in connection with its petition for
`
`inter partes review of U.S. Patent No. 9,521,466 (“the ’466 patent”).
`
`2.
`
`I am a tenured professor in the Department of Computer Science at the
`
`University of North Carolina at Chapel Hill (UNC) where I currently hold the
`
`position of Gillian T. Cell Distinguished Professor of Computer Science. I also
`
`currently serve as the Chairman of the Department.
`
`3.
`
`I have a Ph.D. in computer science from the University of Washington, a
`
`M.Sc. degree in computer science from the University of Toronto, and a B.S.
`
`degree with Highest Distinction in mathematics from the University of Illinois at
`
`Urbana-Champaign.
`
`4.
`
`I have been involved in the research and development of computing systems
`
`for over 30 years. I have been a faculty member at the University of North
`
`Carolina (UNC) since 1989 where I perform research and I teach in the areas of
`
`computer networks, multimedia networking, real-time systems, operating systems,
`
`and network performance evaluation, among others. A major theme of my research
`
`has been the development of technology to improve the performance of data
`
`transfers on the Internet. My research has examined problems ranging from
`
`network support for real-time multimedia applications such as audio and video
`
`streaming, voice-over-Internet protocol (VoIP) and Internet videoconferencing, to
`
`SONY - Ex.-1003
`Sony Corporation - Petitioner
`
`1
`
`
`
`
`
`measurements and analysis of network traffic to passively assess the performance
`
`of servers on the Internet. In addition, I have also explored problems in the design
`
`and implementation of operating systems.
`
`5.
`
`Much of my research has been performed jointly with industry. For example,
`
`in the early 1990s, my research considered problems of real-time transmission of
`
`audio and video streams over packet-switched networks such as the Internet. Much
`
`of this work was performed jointly with Intel and IBM and led to demonstrations
`
`of some of the first videoconferencing systems for the Internet. I also collaborated
`
`with researchers from AT&T Bell Laboratories and later with Lucent Technologies
`
`Bell Laboratories on problems related to delivering video services over both the
`
`public telephone network as well as the Internet. Several papers written by my
`
`research group at UNC describing the results of these projects received awards for
`
`their research contributions at major international conferences and symposia.
`
`6.
`
`In the late 1990s and 2000s, my research evolved to consider router-based
`
`mechanisms for controlling the performance of network traffic. This work involved
`
`algorithms and mechanisms for quality-of-service (QoS) queuing and scheduling in
`
`network routers. In much of this research, my students and I built and instrumented
`
`network routers and performed large scale experiments with this equipment. Based
`
`on these experiments, in 2003, my group at UNC won the most prestigious
`
`research award for original research in computer networking.
`
`2
`
`2
`
`
`
`
`
`7.
`
`I have authored or co-authored over 100 articles in peer-reviewed journals,
`
`conference proceedings, texts, and monographs in the aforementioned areas of
`
`computer science and others. I have previously served as the Associate Editor for
`
`the journal Real-Time Systems and have served as the Editor-in-Chief for the
`
`journal Multimedia Systems. In addition, I have edited and co-edited numerous
`
`published proceedings of technical conferences and have edited a book of readings
`
`in multimedia computing and networking (with Hong-Jiang Zhang) published by
`
`Morgan Kaufman. I am a co-author (with Long Le and F. Donelson Smith) of a
`
`monograph related to computer network protocols, and a co-author (with Jay Aikat
`
`and F. Donelson Smith) of a second monograph related to experimental computer
`
`networking.
`
`8.
`
`I have served on numerous proposal review panels for the National Science
`
`Foundation and other international funding agencies in the aforementioned areas of
`
`computer science. I have served as a program chair or member of the technical
`
`program committee for over 100 professional, international, and technical
`
`conferences, workshops, and symposia.
`
`9.
`
`I am a named inventor on three U.S. Patents and have applications for two
`
`additional patents pending. These patents are generally related to computer
`
`networking and the delivery of services over networks.
`
`3
`
`3
`
`
`
`
`
`10.
`
`I have served as an expert witness and technical consultant in litigation
`
`matters concerning computer networks, content delivery networks, video-on-
`
`demand systems, multimedia networking, internet protocol television (IPTV),
`
`cellular and wireline telephony, mobile computing, and operating systems, and
`
`among others. I have testified in several trials, arbitrations, and claim construction
`
`hearings as an expert witness.
`
`11.
`
`I attach as Exhibit A my curriculum vitae, which includes a more detailed
`
`list of my qualifications, as well as a list of my publications and recent testimony.
`
`12.
`
`I have reviewed the ’466 patent, PCT Publication No. WO03/025726
`
`("Sparrell”), U.S. Patent Publication No. 2003/0067872 (“Harrell”), an PCT
`
`Publication No. WO02/05557 (“Rautila”).
`
`The ’466 Patent
`
`13.
`
`The ’466 patent describes communication systems and methods for
`
`providing and receiving “programs” that, generally speaking, are media streams.
`
`’466 patent, 2:17, 5:14, Fig. 3.
`
`14.
`
`The ’466 patent describes a user device that includes a transceiver unit
`
`connected to a controller that is adapted to: (i) receive a “program multiplex;” (ii)
`
`receive an indication that at least one program is to be removed from the multiplex;
`
`and (iii) selectively transmit a program removal response. ’466 patent, 1:66-2:4.
`
`Also disclosed is a device to provide a program multiplex. The device includes,
`
`4
`
`4
`
`
`
`
`
`e.g., a management unit adapted to consider a removal of at least one program
`
`from the multiplex in response to program viewing parameters, and determine the
`
`removal in response to at least one received user program removal response. ’466
`
`patent, 2:5-12. The ’466 patent further describes a corresponding method for
`
`receiving programs that includes (i) receiving a “program multiplex,” and a
`
`program removal indication; and (ii) selectively transmitting a program removal
`
`response. ’466 patent, 2:13-16. Also disclosed is a method for providing programs,
`
`which includes (i) providing a program multiplex to multiple user devices; (ii)
`
`considering removal of at least one program from the multiplex in response to
`
`program viewing parameters; (iii) allowing at least one user to respond to a
`
`possible removal of the at least one program; and (iv) determining whether to
`
`remove the at least one program in response to received user removal responses.
`
`’466 patent, 2:17-24.
`
`15.
`
`The claims of the ’466 patent are directed to methods and apparatuses for
`
`conserving “resources” associated with a packet television service comprising,
`
`determining if a resource conserving process should be activated and initiating an
`
`action to conserve resources comprising sending instructions to the content
`
`provider to halt the delivery of a video portion of the television content. ’466
`
`patent, 11:30-55, 12:39-65.
`
`
`
`5
`
`5
`
`
`
`
`
`Sparrell and Harrell
`
`16.
`
`Sparrell describes methods and systems for allocating and managing
`
`resources of digital entertainment devices. Sparrell, 2:26-3:5. The network
`
`resources include disk bandwidth, disk capacity, network bandwidth, etc. Sparrell,
`
`12:3-5, 12:17-19. A plurality of devices, e.g., televisions, video recording devices,
`
`etc., are provided “in a network having sufficient bandwidth to distribute media
`
`content (e.g., movies, audio/stereo).” Sparrell, 2:26-3:5. A centralized resource
`
`manager is provided, in which the “centralized resource manager … assign[s]
`
`network resources in the most efficient manner.” Sparrell, 4:13-17. According to
`
`Sparrell, the “centralized resource manager identifies, assigns, and reserves
`
`available resources in response to user requests for processing media content so
`
`that the functionality of the distributed network is centralized,” and “[m]anaged
`
`resources can include … network bandwidth, … TV tuners, MPEG encoders and
`
`decoders.” Sparrell, 4:19-25.
`
`17. Regarding television content, “[w]hen a request is received from a user …
`
`for viewing … television programming material, … the centralized resource
`
`manager implements a reservation protocol … to define a pipeline or session, using
`
`the available network resources embodied in the media server and client devices, to
`
`fulfill the user’s request.” Sparrell, 5:3-9. If devices are removed from the network,
`
`the centralized resource manager can reallocate network resources. In this regard,
`
`6
`
`6
`
`
`
`
`
`the centralized resource manager can include sensing systems for determining
`
`when devices are added or removed from the network. Sparrell, 6:8-10. Such a
`
`sensing system “may include a current, infrared (IR), or electro-magnetic field
`
`(EMF) sensing systems for detecting when video devices are turned off so that the
`
`network resources associated with that video device may be reallocated.” Sparrell,
`
`6:10-12.
`
`18.
`
`For example, a power switching system may be included in the centralized
`
`resource manager that “allow[s] the centralized resource manager to determine the
`
`powering on and off of the devices such that network resources associated with
`
`these devices may be automatically reallocated when the devices are determined to
`
`be in an OFF state.” Sparrell, 6:19-23. For example, an electrical current sensing
`
`system 308 may be provided in a set-top box (STB) 300 that is connected to a
`
`television. Sparrell, 22:29-23:1. The current sensing system 308 can detect the ON
`
`and OFF states of the television to which the STB 300 is connected. Sparrell,
`
`22:29-23:1.
`
`19.
`
`Similarly, an IR sensing system can “detect and process signals from a
`
`typical IR remote control device, and thereby determine the on/off state of the
`
`corresponding video device, so that resources associated with that device can be
`
`automatically reallocated.” Sparrell, 6:13-16. For example, “if a viewer of one
`
`television is requesting a tuner, and if all tuners are in use, and if more than one
`
`7
`
`7
`
`
`
`
`
`tuner is in use in a media pipeline to a television set,” according to Sparrell, “the
`
`ideal solution is to reallocate a tuner 404 that is used by a television 104 that is
`
`actually turned off.” Sparrell, 24:28-25:1. Sparrell’s centralized resource manager
`
`can “guess which television is most likely turned off and issue an alert to that
`
`screen.” Sparrell, 25:1-3. Sparrell’s centralized resource manager issues an alert as
`
`a graphical pop-up window 46, shown in Figure 11, reproduced below, which
`
`signals: “The tuner you are using is being requested by another viewer. Press enter
`
`to reject this request.” Sparrell, 25:4-6.
`
`
`
`20.
`
`The alert above is issued allowing a user a certain amount of time, e.g., one
`
`minute, to reject the request; if there is no response within the allotted time, “the
`
`centralized resource manager 12 will reallocate that tuner 104.” Sparrell, 25:4-9.
`
`8
`
`8
`
`
`
`
`
`21.
`
`Sparrell discloses that media pipelines between the media server 108 and
`
`client devices 112, 114, which are connected to respective televisions 104, 106, are
`
`established when requested and “torn down” after particular requests have been
`
`fulfilled. For example, when a user wants to watch a television program on a
`
`television that is located in the kitchen, a media pipeline is established with that
`
`television. Sparrell, 14:27-30. If a user wants to watch a television program on
`
`another television, e.g., a television located in the living room, when there are no
`
`more tuners available in the network, the user can request “to ‘steal’ a tuner from
`
`one of the other media pipelines, i.e., utilizing a network resource (tuner) that had
`
`previously been reserved by the centralized resource manager 12.” Sparrell, 15:29-
`
`16:2. Thus, for example, the centralized resource manager 12 can “tear down” the
`
`media pipeline to a television that has been turned off and re-allocate that network
`
`resource to another media request. Sparrell, 16:10-13.
`
`22. While Sparrell does not specifically disclose that the “tear down” of a media
`
`pipeline can include halting delivery of a video portion of the television program, it
`
`was well known, at least as early as the publication date of Harrell (April 10,
`
`2003), to halt delivery of the video portion of streaming video, while continuing to
`
`deliver the audio portion. For example, Harrell describes methods and apparatuses
`
`for client-side detection of network congestion in packet networks. Harrell,
`
`Abstract, ¶[0003]. According to Harrell, there are difficulties associated with
`
`9
`
`9
`
`
`
`
`
`“delivering streaming media over broadband packet networks.” Harrell, ¶[0005].
`
`For example, network congestion can “result[] in the loss or corruption of
`
`packets,” can “interfere[] with the quality level of real-time data,” and can “cause
`
`interruptions or delays in streaming media, resulting in a quality of service that is
`
`inferior to broadcast standards.” Harrell, ¶[0006]. Against this background, Harrell
`
`describes methods and apparatuses “for ensuring the delivery of quality streaming
`
`media to clients over packet networks” and for “avoiding error[s] in a media
`
`stream across a congested network” and “addresses the problem of managing
`
`network congestion when streaming media data consumes a significant share of
`
`network bandwidth.” Harrell, ¶[0014].
`
`23. Harrell describes that a client receives a media stream into a media buffer,
`
`and that the media buffer can detect a plurality of levels of network congestion by
`
`monitoring the buffer level. Harrell, ¶[0016]. The client can request a plurality of
`
`service adjustments from the media server in response to the congestion level in
`
`order to avoid errors in playback of the media stream. Harrell, ¶[0016]. Harrell,
`
`describes a number of different adjustments that can be requested by the client,
`
`including a request, sent by the client to the media server, for the service
`
`adjustment “maintaining audio while dropping video.” Harrell ¶[0016]. A person
`
`of ordinary skill in the art would understand this disclosure to correspond to the
`
`’466 patent claim limitations, “wherein initiating the action to conserve resources
`
`10
`
`10
`
`
`
`
`
`comprises sending instructions to the content provider to halt delivery of a video
`
`portion of the television content” and “wherein the television content delivered
`
`after sending the instructions does not comprise the video portion.”
`
`24. Utilizing Harrell’s service adjustments, including “maintaining audio while
`
`dropping video,” in Sparrell’s resource manager would, for example, achieve
`
`“gracefully decreased quality” of the media stream (Harrell, ¶[0016]).
`
`25.
`
`Sparrell and Harrell describe methods and apparatuses “for conserving
`
`resources associated with packet television services.” Sparrell, for example,
`
`describes that a “centralized resource manager … for distributed networks
`
`manages resources available on the network, such as network bandwidth, CPU
`
`allocation, TV tuners …, MPEG encoders …, disk bandwidth, and input output
`
`devices.” Sparrell, Abstract. Sparrell specifically describes “televisions and video
`
`recording devices” as devices connected to the network and describes “movies”
`
`among the media content that is distributed on the network. Sparrell, 2:26-3:3.
`
`Similarly, Harrell describes “delivery of quality streaming media to clients over
`
`packet networks,” Harrell, ¶[0014]. The packet network distributes “broadcast
`
`quality streaming media from a server to at least one client,” Harrell, ¶[0015], and
`
`the client takes “the form of … a set top box attached to a television,” Harrell,
`
`¶[0088].
`
`11
`
`11
`
`
`
`
`
`26.
`
`Sparrell and Harrell describe “receiving television content from a content
`
`provider over a packet network” and “a first interface adapted to receive television
`
`content from a content provider over a packet network.” For example, Sparrell
`
`describes that “linking multiple digital entertainment devices in a home network
`
`infrastructure has become widely accepted” and that “televisions and video
`
`recording devices,” for example, are interconnected “in a network having sufficient
`
`bandwidth
`
`to distribute media content,”
`
`including, for example, movies,
`
`“throughout a home.” Sparrell, 2:26-3:3. According to Sparrell, a media server 108
`
`accepts “CATV (both analog and digital) as well as broadband (cable modem,
`
`xDSL, etc.) WAN connectivity,” Sparrell, 17:16-18, and includes a “broadband
`
`interface for receiving digital content such as TCP/IP or UDP/IP packets,” Sparrell,
`
`18:12-13. Harrell, describes “providing uninterrupted streaming media over IP
`
`[Internet Protocol] networks,” Harrell, ¶[0029], which Harrell recognizes to be, as
`
`is well-known, “a packet network,” Harrell, ¶[0007].
`
`27.
`
`Sparrell and Harrell describe “providing the television content to a television
`
`monitor for display to a viewer” and “a second interface adapted to provide the
`
`television content to a television monitor for display to a viewer.” For example,
`
`Sparrell describes network resources that include “distributing audio and/or video
`
`content for real-time presentation to a user (e.g., … viewing and listening via a
`
`television set).” Sparrell, 8:17-23. Sparrell also describes that “client devices
`
`12
`
`12
`
`
`
`
`
`include set-top boxes (STBs) 44, 46, 48 for video clients” (Sparrell, 10:16-18), and
`
`that client devices “receive video content via the distributed network” and
`
`“output[] it to a television” (Sparrell, 19:12-20). Harrell describes that “data and
`
`video traffic is directed to the one or more clients 212 and client media buffers
`
`210” and that “[t]he client receptacle might … take the form of … a set top box
`
`attached to a television.” Harrell, ¶[0088].
`
`28.
`
`Sparrell describes “determining if a resource conserving process should be
`
`activated,” in which “the resource conserving process determines if an action to
`
`conserve resources associated with transporting the television content over the
`
`packet network should be performed,” and also describes “a control system
`
`associated with the first and second interfaces and adapted to: determine if a
`
`resource conserving process should be activated,” in which “the resource
`
`conserving process determines if an action to conserve resources associated with
`
`transporting the television content over the packet network should be performed.”
`
`For example, Sparrell discloses a “centralized resource manager … linked with a
`
`media server and each client device in the distributed network.” Sparrell, 4:18-19.
`
`Sparrell further describes that the centralized resource manager makes an
`
`“educated guess as to whether a particular television or other resource is in use.”
`
`Sparrell, 24:24-27. If the centralized resource manager determines “that the
`
`television 104 is in the OFF state,” an alert will “be issued … to the screen of the
`
`13
`
`13
`
`
`
`
`
`television 104, a response waited for (for a predetermined period of time) …,
`
`followed by reallocation … of the resources 404 associated with the television 104
`
`if no response is received.” Sparrell, 25:27-26:2.
`
`29.
`
`Sparrell describes, “if the resource conserving process should be activated:
`
`determining [and determine] whether the viewer is watching the television
`
`monitor.” For example, Sparrell describes that “[t]he centralized resource manager
`
`12 can make a considered determination as to the likelihood a screen of a
`
`television 103 is being watched by monitoring the IR channel 402 … of the
`
`associated client device.” Sparrell, 25:16-20. According to Sparrell, “[i]f there has
`
`been recent IR activity in the vicinity of the TV 104, there is a high probability that
`
`a user is watching and interacting with the TV 104,” whereas “if there has been no
`
`IR activity for several hours, there is a high probability that nobody is watching the
`
`television 104.” Sparrell, 25:20-25.
`
`30.
`
`Sparrell describes “initiating [and initiate] the action to conserve resources
`
`associated with transporting the television content over the packet network upon
`
`determining that the viewer is not watching the television monitor.” For example,
`
`Sparrell describes that “[o]nly when a determination has been made … that the
`
`television 104 is in the OFF state will an alert be issued … to the screen of the
`
`television 104, a response waited for (for a predetermined period of time) …,
`
`14
`
`14
`
`
`
`
`
`followed by reallocation … of the resources 404 associated with the television 104
`
`if no response is received.” Sparrell, 25:27-26:2.
`
`31.
`
`Sparrell and Harrell describe “initiating the action to conserve resources
`
`comprises sending instructions to the content provider to halt delivery of a video
`
`portion of the television content, wherein the television content delivered after
`
`sending the instructions does not comprise the video portion.” For example,
`
`Sparrell describes that “media pipelines … can be torn down when they are no
`
`longer needed, e.g., when particular requests have been fulfilled.” Sparrell, 16:17-
`
`8. Harrell describes that a client, which receives a media stream from a media
`
`server, “is able to request a plurality of service adjustments from the media server”
`
`and that “[s]uch adjustments may include … maintaining audio while dropping
`
`video.” Harrell, ¶[0016]. In Harrell’s methods and apparatuses, the client, e.g., “a
`
`set top box attached to a television,” “request[s] server adjustments.” Harrell,
`
`¶[0098]. See also, Harrell, claim 33 (“A method for client-initiated flow control for
`
`media streaming over best-effort packet networks, wherein, upon client detection
`
`of network congestion, a client sends requests to a server to adjust the media
`
`stream and thereby to improve the congestion situation.”).
`
`32.
`
`The media server 108 and a broadband service provider described by
`
`Sparrell (e.g., Sparrell, 21: 14-28) correspond to the content provider described in
`
`claim 1. Since “the media server 108 accepts CATV (both analog and digital) as
`
`15
`
`15
`
`
`
`
`
`well as broadband (cable modem, xDSL, etc.) WAN connectivity (Sparrell, 17:16-
`
`18) and “a service provider … use the centralized resource manager,” the media
`
`server 108 can send the instruction to the broadband service provider (Sparrell, 21:
`
`14-28). In addition, since Sparrell explains that “the resource manager 12 can exist
`
`on any client device of the distributed network” (Sparrell, 19:3-11), the client
`
`described by Sparrell could send the instruction to Sparrell’s media server.
`
`33.
`
`Sparrell describes “if the resource conserving process should not be
`
`activated: continue providing [or allow for continued providing of] the television
`
`content.” For example, Sparrell describes that the “centralized resource manager
`
`12 will guess which television is most likely turned off and issue an alert to that
`
`screen.” Sparrell, 25:1-3. According to Sparrell, if the screen to which an alert is
`
`issued “is in use, the centralized resource manager 12 will then try to reallocate the
`
`resources associated with the next-most likely powered down screen.” Sparrell,
`
`25:13-15.
`
`34.
`
`Sparrell describes “monitoring viewing indicia bearing on the television
`
`monitor being watched and applying the viewing indicia to resource saving criteria
`
`to determine whether the viewer is watching the television monitor.” For example,
`
`Sparrell describes that the centralized resource manager 12 issues an alert to the
`
`television 104 as a graphical pop-up window. If the user is watching this television,
`
`the viewer is given a certain amount of time to reject the request; if there is no
`
`16
`
`16
`
`
`
`
`
`response within the given time period, the centralized resource manager 12 will
`
`reallocate that tuner. Sparrell, 25:4-9.
`
`35.
`
`Sparrell describes “receiving viewer input and wherein the viewing indicia
`
`comprise viewer input.” For example, as mentioned above, Sparrell describes that
`
`the centralized resource manager 12 issues an alert to the television 104 as a
`
`graphical pop-up window. If the user is watching this television, the viewer is
`
`given a certain amount of time to reject the request; if there is no response within
`
`the given time period, the centralized resource manager 12 will reallocate that
`
`tuner. Sparrell, 25:4-9.
`
`36.
`
`Sparrell describes “monitoring the viewer input over time; determining
`
`viewer behavior based on the viewer input over time; and generating the resource
`
`saving criteria based on the viewer behavior, wherein the viewer input over time is
`
`used to learn the viewer behavior from which the resource saving criteria is
`
`generated.” For example, Sparrell describes that the centralized resource manager
`
`12 “can make a considered determination as to the likelihood a screen of television
`
`104 is being watched by monitoring the IR channel 402 of the associated client
`
`device 112.” Sparrell, 25:16-20. According to Sparrell, the “IR channel 402 is
`
`monitored,” and the “time between received IR signals is measured.” Sparrell,
`
`25:20-21. If there has been recent IR activity in the vicinity of the TV 104, there is
`
`a high probability that a user is watching and interacting with the TV 104, whereas
`
`17
`
`17
`
`
`
`
`
`if there has been no IR activity for several hours, there is a high probability that
`
`nobody is watching the television 104. Sparrell, 25:21-25. Sparrell describes that
`
`an “algorithm based on time-between-signals will determine whether the screen of
`
`the television 103 is most likely powered off.” Sparrell, 25:25-27.
`
`37.
`
`Sparrell describes that “the viewing indicia bears on a status of a user
`
`device,” and Sparrell describes that “determining whether the viewer is watching
`
`the television monitor comprises determining a status of a user device, and
`
`initiating the action to conserve resources after detecting that the status of the user
`
`device is idle.” For example, Sparrell describes that “[t]he IR sensing system is
`
`operative to detect and process signals from a typical IR remote control device, and
`
`thereby determine the on/off state of the corresponding video device, so that
`
`resources associated with that device can be automatically reallocated.” Sparrell,
`
`6:13-16.
`
`38.
`
`Sparrell describes “providing an alert for display on the television monitor in
`
`association with initiating the action to conserve resources.” Referring, for
`
`example, to Figure 11, reproduced below, Sparrell describes that “[o]ne possible
`
`alert is a graphical pop-up window 40…, which can signal as follows: ‘The tuner
`
`you are using is being requested by another viewer. Press enter to reject this
`
`request.’” Sparrell, 25:4-6. According to Sparrell, “[i]f a user is watching this
`
`television 104 (a viewing session), he/she can be given a certain amount of time to
`
`18
`
`18
`
`
`
`
`
`reject the request,” and “[i]f after, say, one minute, there is no response, the
`
`centralized resource manager 12 will reallocate that tuner 404.” Sparrell, 25:6-9.
`
`
`
`39. Additionally, referring to Figure 14, reproduced below, Sparrell
`
`describes monitoring key inputs for an IR remote control. Sparrell, 26:29-30.
`
`According to Sparrell, “the power down key and other key inputs are
`
`monitored to determine which television screen is most likely powered off at
`
`step 430,” and “[a] screen alert is then issued at step 432, a response waited
`
`for in step 434, followed by reallocation of the resource 404 in a step 436 if no
`
`response to the screen alert is received.” Sparrell, 27:2-6
`
`19
`
`19
`
`
`
`
`
`
`
`40.
`
`Sparrell describes that “initiating the action to conserve resources comprises
`
`sending instructions to the content provider to stop delivery of the television
`
`content, wherein delivery of the television content is stopped.” For example,
`
`Sparrell describes that “media pipelines can be torn down when they are no longer
`
`needed, e.g., when particular requests have been fulfilled.” Sparrell, 16:17-18.
`
`20
`
`20
`
`
`
`
`
`According to Sparrell, a “network resource for fulfilling a recording request … can
`
`be freed up when the scheduled recording … is completed.” Sparrell, 16:18-21.
`
`41.
`
`Sparrell describes that “initiating the action to conserve resources further
`
`comprises providing local content to the television monitor for display to the
`
`viewer.” For example, Sparrell describes providing local content in the form of a
`
`“graphical pop-up window” as an alert to the viewer. Figure 11, reproduced below,
`
`illustrates the local content displayed to the viewer on the television 104.
`
`
`
`42. Additionally, Sparrell explains that a viewer can select “watching one of the
`
`streams in progress” or “watching a previously recorded show” on the television
`
`monitor (Sparrell, 15:20-21), both of which constitute local content provided to the
`
`television monitor for display to the viewer.
`
`21
`
`21
`
`
`
`
`
`43.
`
`Sparrell describes that “determining if the resource conserving process
`
`should be activated is based on a programming type for a program delivered via
`
`the television content.” For example, Sparrell distinguishes between streaming
`
`media and previously recorded programs. According to Sparrell, when a request
`
`for a network resource is made to the centralized resource manager and there are
`
`no more tuners available in the network, the centralized resource manager alerts
`
`the user, who then has the options of “watching one of the streams in progress” or
`
`“watching a previously recorded show.” Sparrell, 15:15-24.
`
`44.
`
`Sparrell describes that “determining if the resource conserving process
`
`should be activated is based on at least one of a time, date, and length of a program
`
`delivered via the television content.” For example, Sparrell distinguishes between
`
`programs requested at various times, specifically mentioning 7:45, 7:50, 8:00, and
`
`8:05, and distinguishes between streams in progress, e.g., a hockey game currently
`
`being recorded, and previously-recorded shows, e.g., a James Bond movie.
`
`Sparrell, 14:6-15:24.
`
`45.
`
`Sparrell describes that “determining if the resource conserving process
`
`should be activated is based on a program being delivered via the television
`
`content.” For example, Sparrell distinguishes between streams in progress, e.g., a
`
`hockey game currently being recorded, and previously-recorded shows, e.g., a
`
`James Bond movie. Sparrell, 14:27-15:24.
`
`22
`
`22
`
`
`
`
`
`46.
`
`Sparrell describes “a user interface associated with the control system, which
`
`is adapted to determine whether the viewer is watching the television monitor
`
`based on viewer activity detected at the user interface.” For example, Sparrell
`
`describes that the centralized resource manager includes an IR sensing system for
`
`detecting when video devices are turned off. Sparrell, 6:8-12. According to
`
`Sparrell, “[t]he IR sensing system is operative to detect and process signals from a
`
`typical IR remote control device, and thereby determine the on/off state of the
`
`corresponding video device, so that resources associated with that device can be
`
`automatically reallocated.” Sparrell, 6:13-16.
`
`47.
`
`Sparrell also describes that the centralized resource monitor issues an alert
`
`on the television to present the viewer with the alert: “The tuner you are using is
`
`being requested by another viewer. Press enter to reject this request.” Sparrell, 4:4-
`
`6. If there is no response from the viewer, the centralized resource manager will
`
`reallocate that tuner. Sparrell, 4:6-9.
`
`48.
`
`Sparrell describes that “to determine whether the viewer is watching the
`
`television monitor, the control system is further adapted to determine a status of
`
`user devices, and initiate the action to conserve resources after detecting the status
`
`of the user devices.” For example, Sparrell describes that “[t]he IR sensing system
`
`is operative to detect and process signals from a typical IR remote control device,
`
`and thereby determine the on/off state of the corresponding video device, so that
`
`23
`
`23
`
`
`
`
`
`resources associated with that device can be automatically reallocated.” Sparrell,
`
`6:13-16.
`
`49. Both Sparrell and Harrell address problems rel