UNITED STATES PATENT AND TRADEMARK OFFICE
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`SONY CORPORATION,
`Petitioner
`
`
`
`
`Case No. IPR2017-01963
`
`Patent No. 7,752,564
`
`Issue Date: July 6, 2010
`
`Title: System and Method for Focused
`Navigation Using Option Type Filters
`
`
`
`DECLARATION OF BRAD A. MYERS
`
`
`
`
`
`
`
`
`
`
`
`
`P. 1
`
`SONY - Ex.-1002
`Sony Corporation - Petitioner
`
`

`

`
`
`TABLE OF CONTENTS
`
`The ’564 Patent .......................................................................................................... 2
`Bernhardson ............................................................................................................... 5
`Robarts ....................................................................................................................... 6
`Schein ......................................................................................................................... 8
`Youman ...................................................................................................................... 9
`Tornqvist ..................................................................................................................10
`The Combination of Bernhardson and Robarts .......................................................12
`Claim 1 ...........................................................................................................12
`Claim 12 .........................................................................................................24
`Claims 3 and 13 .............................................................................................36
`Claims 4 and 14 .............................................................................................37
`Claims 5 and 15 .............................................................................................38
`Claims 6 and 16 .............................................................................................39
`Claims 7 and 17 .............................................................................................40
`Claims 8 and 18 .............................................................................................41
`Claims 9 and 19 .............................................................................................41
`Claims 11 and 21 ...........................................................................................42
`Combining Bernhardson and Robarts ...........................................................43
`Claim 2 ...........................................................................................................44
`Combining Bernhardson, Robarts, and Schein..............................................45
`Claims 10 and 20 ...........................................................................................46
`Combining Bernhardson, Robarts, and Youman ...........................................47
`
`- i -
`
`
`
`P. 2
`
`

`

`
`
`The Combination of Tornqvist and Robarts ............................................................48
`Claim 1 ...........................................................................................................48
`Claim 12 .........................................................................................................60
`Claims 3 and 13 .............................................................................................75
`Claims 4 and 14 .............................................................................................76
`Claims 5 and 15 .............................................................................................77
`Claims 6 and 16 .............................................................................................78
`Claims 7 and 17 .............................................................................................79
`Claims 8 and 18 .............................................................................................80
`Claims 9 and 19 .............................................................................................80
`Claims 11 and 21 ...........................................................................................81
`Combining Tornqvist and Robarts ................................................................82
`Claim 2 ...........................................................................................................83
`Combining Tornqvist, Robarts, and Schein ..................................................84
`Claims 10 and 20 ...........................................................................................85
`Combining Tornqvist, Robarts, and Youman................................................86
`
`- ii -
`
`
`
`P. 3
`
`

`

`
`
`I, Brad A. Myers, declare as follows:
`1.
`
`I am currently a Professor at Carnegie Mellon University (CMU), and I have
`
`been on the faculty at CMU since 1987. I received a Bachelor of Science in
`
`Computer Science and Engineering and Master of Science in Computer Science
`
`from the Massachusetts Institute of Technology in 1980. I received my Doctorate in
`
`Computer Science from the University of Toronto in 1987.
`
`2. My research activities have covered User Interface Software, Programming
`
`Environments, End-User Software Engineering, API Usability, Smartphone User
`
`Interfaces, Demonstrational Interfaces, User Interface Design, Window Managers,
`
`and Visual Programming.
`
`3.
`
`Additional details about my employment history, fields of expertise, and
`
`publications are included in my curriculum vitae, attached as Ex. A.
`
`4.
`
`I have been retained by Sony Corporation in connection with its petition for
`
`inter partes review of U.S. Patent No. 7,752,564 (“the ’564 patent”). I have over 30
`
`years of experience in fields relevant to the ’564 patent.
`
`5.
`
`I have reviewed the ’564 patent as well as its prosecution history. I have also
`
`reviewed U.S. Patent No. 6,976,228 (“Bernhardson”), U.K. Patent Application
`
`Publication No. 2,325,537 (“Robarts”), U.S. Patent No. 6,412,110 (“Schein”), U.S.
`
`Patent No. 5,629,733 (“Youman”), PCT International Patent Application
`
`- 1 -
`
`
`
`P. 4
`
`

`

`
`
`Publication No. WO 00/65429 (“Tornqvist”), and U.S. Patent No. 5,396,588
`
`(“Froessl”).
`
`THE ’564 PATENT
`
`6.
`
`The ’564 patent describes systems and methods for navigating through
`
`selectable options using a graphical user interface. (’564 patent, 1:31-34, 3:38-4:7,
`
`5:53-54, 6:15-21, 6:39-50, 11:25-12:22, 14:19-52). The “selectable options” include
`
`“channels, programs, applications, digital media files, etc.” (’564 patent, 3:38-40;
`
`see also 8:40-47). Each selectable option may be associated with a “card 200,” which
`
`is described as “an object or other suitable data structure that provides information
`
`about and/or access to an available option” and as “a container of all of the attributes,
`
`actions, and/or states needed to facilitate interaction with the option represented
`
`thereby.” (’564 patent, 3:52-57; see also 11:9-13, 11:17-24, 14:25-30).
`
`’564 patent, Fig. 12 (excerpt)
`
`
`
`- 2 -
`
`
`
`P. 5
`
`

`

`
`
`7.
`
`Each card 200 may include one or more tags 1200, indicating, e.g., “a genre,
`
`type, function, priority, or other characteristic of a card 200 or a represented option.”
`
`(’564 patent, 11:17-20). Filter(s) 1202 may be provided for filtering cards based on
`
`the tags, and certain cards 200 may be used to represent the filters 1202. (’564 patent,
`
`11:25-12:11, 14:31-33, 15:5-8). The filter “may be embodied as an object, a module
`
`of code, a data structure, a circuit, or other suitable mechanism for performing or
`
`assisting with the filtering function.” (’564 patent, 11:26-29).
`
`8.
`
`The interface displays a sequence of filter cards along a first axis that
`
`intersects a “focus area.” (’564 patent, 12:1-19, 14:33-37, Fig. 13). The user can use
`
`an input device to scroll the filter cards along the first axis, and select the filter card
`
`displayed in the focus area. (’564 patent, 12:12-19, 14:33-39, 15:5-10, Fig. 13).
`
`Selecting a filter card filters the options so that a second set of cards that corresponds
`
`to the selected filter is displayed along a second, perpendicular axis, which intersects
`
`the first axis at the focus area. (’564 patent, 8:48-51, 12:12-26, 14:33-35, 14:40-49,
`
`15:5-10, Fig. 13). The user can scroll the second set of cards along the second axis,
`
`and select the card displayed in the focus area. (’564 patent, 12:20-22, 14:48-52).
`
`- 3 -
`
`
`
`P. 6
`
`

`

`
`
`’564 patent, Fig. 13
`
`
`
`9.
`
`User interfaces that allow a user to navigate through options displayed along
`
`two perpendicular axes that intersect at a selectable focus area—in which the options
`
`displayed on one axis represent results of the option displayed in the focus area of
`
`the other axis—were well known by August of 2001. Moreover, using filter
`
`techniques, such as comparing filtering criteria to attributes of options, to limit the
`
`number of options displayed in an electronic program guide was also well known by
`
`then. Therefore, as explained below, the claims of the ’564 patent describe a
`
`- 4 -
`
`
`
`P. 7
`
`

`

`
`
`predictable combination of conventional and well-known techniques, according to
`
`their known functionalities, as would have been understood in 2001.
`
`BERNHARDSON
`
`10. Bernhardson discloses a graphical user interface including a horizontal scroll
`
`bar H and a vertical scroll bar V. (Bernhardson, 3:51-55). “The scroll bars intersect
`
`in a focus region 16 in the lower left corner” of the user interface. (Bernhardson,
`
`3:55-57). Each scroll bar includes a plurality of scroll bar elements (“elements”)
`
`“that can be scrolled successively through the focus region.” (Bernhardson, 2:11-
`
`12). In Fig. 3, Bernhardson discloses elements V0-V6, which can be scrolled
`
`vertically into the focus region 16 using the “up” or “down” scroll buttons of a
`
`remote control. (Bernhardson, 3:63-67). Similarly, Bernhardson discloses elements
`
`H0-H6, which can be horizontally scrolled into the focus region 16 using the “left”
`
`or “right” scroll buttons. (Bernhardson, 4:6-10).
`
`
`
`- 5 -
`
`
`
`P. 8
`
`

`

`
`
`11.
`
`“[W]hen elements of the [horizontal] scroll bar are scrolled individually into
`
`the focus region [16],” the elements “of the [vertical] scroll bar signify content
`
`sources which are” grouped into the horizontal element. (Bernhardson, 2:6-24).
`
`Bernhardson also provides that the user can scroll the vertical elements into the focus
`
`region 16 so that the user can make the user’s ultimate selection. (Bernhardson, 4:47-
`
`51).
`
`12.
`
`In Bernhardson, the option included in each horizontal element H may be
`
`“programmed content data,”
`
`(Bernhardson, 6:36-37), such as cartoons
`
`(Bernhardson, Fig. 4C (H1)), but can also be different option types, such as games
`
`and the Internet (Bernhardson, Fig. 4C (H2, H3)).
`
`ROBARTS
`
`
`
`13. Robarts discloses software “which enables creation of queries to facilitate
`
`simple and complex searches” on an electronic program guide. (Robarts, 19:11-12).
`
`The software can be implemented in an interactive television or a set-top box.
`
`(Robarts, 14:2-4, 24:20-23). For example, the interactive television is connected to
`
`- 6 -
`
`
`
`P. 9
`
`

`

`
`
`an EPG database 72, which stores program information received from a content
`
`provider. (Robarts, 27:7-9, 34:3-5, Fig. 5). This program information is stored as a
`
`data structure encompassing various items, each of which includes several data fields
`
`90. (Robarts, 26:1-3, Fig. 4).
`
`14. The software provides the viewer with a user interface 170, which has a
`
`scrollable grid displaying the program information obtained from the EPG database
`
`72. (Robarts, 22:6-7, 31:18-21, Fig. 6). The user interface allows the user to scroll
`
`through the program information, and select a desired program to watch. (Robarts,
`
`33:12-15). In addition, the user interface discloses several “predefined query
`
`buttons.” (Robarts, 36:3). “The queries function as a filter which sifts through the
`
`programming information and returns only those items which satisfy the
`
`parameters.” (Robarts, 40:22-24). For example, “[a]ctivation of these query buttons
`
`trigger a query of the EPG database 72 to identify programs satisfying the predefined
`
`query parameters.” (Robarts, 36:4-5). For example, by activating the “comedies”
`
`query button 206 shown in Fig. 6, “a query of the EPG database 72 for all comedy
`
`programs” is initiated. (Robarts, 36:16-18).
`
`- 7 -
`
`
`
`P. 10
`
`

`

`
`
`
`
`15. The viewer can create various viewer-defined queries. (Robarts, 38:9-10). For
`
`example, the viewer can select various search parameters, such as a program genre,
`
`and “based on these parameters, the [software] constructs a query and searches the
`
`EPG database 72 to locate programs satisfying the query.” (Robarts, 38:16-17).
`
`Also, the software monitors a viewer’s viewing habits, and “automatically develops
`
`queries for identifying programs that the viewer would likely watch.” (Robarts,
`
`19:23-24).
`
`SCHEIN
`
`16. Schein discloses a system for displaying a program guide on a television
`
`screen. (Schein, 1:12-15). The program guide shows program schedule information
`
`in a grid, which “lists the channels in a vertical column … and the [show] times in a
`
`horizontal row.” (Schein, 4:17, 4:25-27, Fig. 1).
`
`- 8 -
`
`
`
`P. 11
`
`

`

`
`
`
`
`17. The viewer can scroll through the grid using a remote control device. (Schein,
`
`3:59-63, 4:17-24). For example, each click on a scroll button on the program guide
`
`scrolls the program guide one half-hour to the left or right to display earlier or later
`
`programs. (Schein, 11:54-58). “A click-and-hold scrolls a half-hour every half-
`
`second, accelerating over time as the user continues to hold, coming to a stop upon
`
`letting up.” (Schein, 11:58-60).
`
`YOUMAN
`
`18. Youman discloses an electronic program schedule system which receives
`
`schedule information for television programs. (Youman, 4:64-67). The system has a
`
`user interface which allows the user to filter the program schedule information by
`
`category of the programs. (Youman, 17:5-9, 17:11-15). For example, the user
`
`- 9 -
`
`
`
`P. 12
`
`

`

`
`
`interface has “a ‘Category Listing’ mode in which program schedule information is
`
`displayed and categorized by program content.” (Youman, 17:5-9). Youman also
`
`discloses that a “revised or replacement” version of the “application software which
`
`controls the program schedule system” can “be downloaded directly from the
`
`software developer to the user site through the cable or other transmission system.”
`
`(Youman, 8:32-40).
`
`TORNQVIST
`
`19. Tornqvist discloses a method and arrangements for “scrollable cross point
`
`navigation in a user interface” used to select an option. (Tornqvist, 3:4-6). The “cross
`
`point navigation” system allows a user of appliances such as “digital TV set-top
`
`boxes” to navigate and select different types of services in “an easy way without
`
`disturbing the actual viewing experience of the user.” (Tornqvist, 5:26-30).
`
`20. User-selectable options in the interface are organized into “one or more
`
`levels,” in a “tree-like manner with any branch of the tree constituting a further
`
`level.” (Tornqvist, 9:5-6, 9:22-23). The user-selectable options at “a first level are
`
`very general” categories. (Tornqvist, 9:8).
`
`21. At least two “bars”—e.g., a vertical bar and a horizontal bar—are provided
`
`for scrollable cross point navigation. (Tornqvist, 7:25-29). One of the bars displays
`
`user-selectable options at one level and the other bar displays user-selectable options
`
`at a higher or lower level. (Tornqvist, 12:7-9, Figs. 2a and 2b). A user may scroll
`
`- 10 -
`
`
`
`P. 13
`
`

`

`
`
`through the options of all the levels (e.g., the first level, second level, third level,
`
`etc.) by navigating back and forth between the vertical and horizontal bars.
`
`(Tornqvist, 9:27-10:5).
`
`22.
`
`“Scrolling is accomplished by feeding or ‘zapping’ up and down or left or
`
`right” to move objects—representing user-selectable options at each level—to a
`
`fixed “focus” area. (Tornqvist, 4:14-15; Figs. 2a, 2b). Objects on each bar are
`
`“displayed in sequence” through “scroll action” by actuating function commands
`
`such as “left, right, up, down, and OK or like confirmation.” (Tornqvist, 4:22-26).
`
`
`
`23. When a user scrolls the vertical bar up or down to place one of the objects
`
`from the vertical bar (e.g., one of objects A-G) into the fixed “focus area,” the
`
`horizontal bar displays objects (e.g. objects F0-F5) corresponding to the object from
`
`the vertical bar in the fixed focus area (e.g. object F). (Tornqvist, 7:24-27, 7:32-36).
`
`- 11 -
`
`
`
`P. 14
`
`

`

`
`
`When the user scrolls the horizontal bar left or right to place one of the objects from
`
`the horizontal bar (e.g., one of objects F0-F5) into the fixed “focus area,” the vertical
`
`bar displays objects (e.g. objects F2:0-F2:5) corresponding to the object from the
`
`horizontal bar (e.g. object F2). (Tornqvist, 7:24-27, 7:32-36).
`
`
`
`
`
`THE COMBINATION OF BERNHARDSON AND ROBARTS
`
`Claim 1
`24. Claim 1 of the ’564 patent describes a “method for navigating options
`
`within a user interface.” Bernhardson, for example, discloses a method for
`
`navigating “a graphical user interface which may be used to select content sources.”
`
`(Bernhardson, 2:3-5). The “content sources” are displayed as elements and they refer
`
`to options. (Bernhardson, 4:12-21).
`
`- 12 -
`
`
`
`P. 15
`
`

`

`
`
`25. Claim 1 of the ’564 patent describes “providing a first set of cards, each
`
`card graphically representing a single available option from one of a plurality
`
`of option types.”
`
`26. For example, Bernhardson discloses a set of cards as graphical user interface
`
`elements, each of which includes “individual object fields in which information
`
`concerning sources of program content can be displayed.” (Bernhardson, 3:59-62).
`
`In Bernhardson’s user interface, the vertical elements are displayed as “two-
`
`dimensional rectangular displays,” and the horizontal elements are displayed as
`
`“three-dimensional rectangular blocks.” (Bernhardson, 3:59-62, 4:3-6). Each of
`
`these elements facilitates interaction with a television option. For example, selection
`
`of a horizontal element results in the display of a set of vertical elements that
`
`correspond to the selected horizontal element, and selection of a vertical element
`
`results in the display of the corresponding option, such as a television channel (e.g.
`
`a news channel, a cartoon channel), as well as other types of options, e.g., a game,
`
`an Internet website. (Bernhardson, 4:12-19, 4:47-51, Figs. 3, 4A, 4B, 4C). The ‘564
`
`patent states that a card “may be a container of all of the attributes, actions, and/or
`
`states needed to facilitate interaction with the option represented thereby.” (’564
`
`patent, 3:51-59). Therefore, because Bernhardson’s elements graphically represent
`
`information about the source of programs (or other types of options) and facilitate
`
`interaction with the programs (or options), they disclose a plurality of options.
`
`- 13 -
`
`
`
`P. 16
`
`

`

`
`
`27. Moreover, these elements describe different option types. Bernhardson
`
`provides that its user interface can be used in a variety of applications such as a home
`
`computer, a gaming device, or a vending machine. (Bernhardson, 6:30-34). For
`
`example, in Fig. 4C, Bernhardson discloses elements for displaying cartoon
`
`channels, games, and Internet websites. (Bernhardson, Fig. 4C). More specifically,
`
`Bernhardson discloses that “it is desirable to provide a system which can bookmark
`
`individual web sites and pages that are of interest to the user,” (Bernhardson, 1:23-
`
`25), and thus, Bernhardson’ disclosure of an element pertaining to “an Internet news
`
`site” describes a website. (Bernhardson, 4:39-47, 1:23-25). Therefore, because
`
`Bernhardson discloses elements pertaining to various types of options, e.g., cartoon
`
`channels, games, and Internet websites, Bernhardson discloses elements that
`
`represent options from among a plurality of option types.
`
`28. Robarts also discloses cards that represent a plurality of options. Robarts
`
`discloses software in connection with an EPG database 72, which stores program
`
`information received from a content provider. (Robarts, 27:7-9, 34:3-5). The
`
`software provides the viewer with a user interface 170, which has a scrollable grid
`
`displaying the program information obtained from the EPG database 72. (Robarts,
`
`22:6-7, 31:18-21). This program information is stored as a data structure
`
`encompassing various items, each item including several data fields 90. (Robarts,
`
`26:1-2, Fig. 4). According to the ’564 patent, a card can be a data structure. (’564
`
`- 14 -
`
`
`
`P. 17
`
`

`

`
`
`patent, 3:51-59). Therefore, by disclosing the program information as a data
`
`structure, Robarts discloses a first set of cards each representing an option.
`
`29. Robarts also discloses different option types for the cards. In Fig. 14, Robarts
`
`displays a query from the EPG database 72 for retrieval of television program
`
`information and a query from the web cache for retrieval of web sites. (Robarts,
`
`45:22-46:2). Robarts further discloses that its filtering techniques can be used for
`
`different option types: movies, games, financial records, communications records,
`
`software, and document files. (Robarts, 52:8-11). Therefore, by disclosing various
`
`types of options for which the user can filter and display in the user interface, such
`
`as television programs and websites, Robarts also discloses a plurality of option
`
`types.
`
`30. Claim 1 of the ’564 patent further describes “providing a user interface
`
`including a focus area intersected by a first axis.” Bernhardson, for example,
`
`discloses a graphical user interface which displays a horizontal bar H and a vertical
`
`bar V, and the focus region 16 at the point where these two bars intersect.
`
`(Bernhardson, 3:50-57, Fig. 3). The horizontal bar H corresponds to the claimed first
`
`axis, and the focus region 16 corresponds to the claimed focus area.
`
`31. Claim 1 of the ’564 patent further describes “displaying a set of cards
`
`representing filters along the first axis, each filter corresponding to a respective
`
`one of the plurality of option types.” Bernhardson discloses horizontal elements
`
`- 15 -
`
`
`
`P. 18
`
`

`

`
`
`H0-H5 along the horizontal scroll bar H, and these elements represent filters that
`
`correspond to different option types. (Bernhardson, 3:67-4:3). The horizontal
`
`elements correspond to vertical elements. (Bernhardson, 4:12-19). Once triggered,
`
`each horizontal element can filter various television programs as well as other type
`
`of options, and display the filtered options on the vertical scroll bar. (Bernhardson,
`
`4:39-47, 6:34-37). For example, Fig. 3 discloses a filter H3 for Internet websites and
`
`a filter H2 for sports channels. (Bernhardson, Fig. 3). Similarly, Fig. 4C discloses a
`
`filter H1 for cartoon channels, a filter H2 for games, and a filter H3 for Internet
`
`websites. (Bernhardson, Fig. 4C).
`
`32. Similarly, as discussed below in ¶¶ 36-38, Robarts discloses various filters,
`
`and these filters pertain to different option types, e.g., in Fig. 14, Robarts discloses
`
`a filter 282 for television programs, and a filter 292 for Internet web sites. (Robarts,
`
`45:16-18, 45:22-46:2).
`
`33. Claim 1 of the ’564 patent further describes “receiving a selection of a filter
`
`in response to a user scrolling the set of filter cards along the first axis to align
`
`a corresponding filter card with the focus area.” Bernhardson discloses that the
`
`user can scroll the horizontal and vertical elements through the focus region 16 using
`
`scroll buttons 17, 18, 21, and 22 provided on the infrared controller 4. (Bernhardson,
`
`3:27-29, 3:64-67, 4:6-10). For example, as illustrated in Fig. 3, the user can scroll
`
`the horizontal element H1 (which includes news) into the focus region 16.
`
`- 16 -
`
`
`
`P. 19
`
`

`

`
`
`(Bernhardson, 4:3-10, 4:27-30). When a horizontal element is scrolled into the focus
`
`region, the vertical elements associated with the horizontal element populate the
`
`vertical bar. (Bernhardson, 2:12-18, 1:49-52, 6:50-58). For example, Bernhardson
`
`discloses in Fig. 4C that if the horizontal element H1 “Son-cartoons” is in the focus
`
`region, various elements representing cartoon channels will be displayed on the
`
`vertical axis. (Bernhardson, Fig. 4C).
`
`34. Claim 1 of the ’564 patent further describes “filtering the first set of cards
`
`according to the selected filter to produce a second set of cards, the second set
`
`of cards only including cards representing the type of option corresponding to
`
`the selected filter.” Bernhardson discloses that in response to scrolling a horizontal
`
`element into the focus region, elements that correspond to the horizontal element
`
`will be displayed on the vertical bar. (Bernhardson, 2:12-18, 1:49-52, 6:50-58).
`
`Bernhardson also discloses that the displayed vertical elements are “associated with”
`
`the horizontal bar element. (Bernhardson, 4:30-35). Therefore, by displaying only
`
`the associated vertical elements, Bernhardson discloses filtering the displayed
`
`vertical elements based on the selection of the corresponding horizontal element.
`
`35. Bernhardson also discloses that the options displayed on the vertical axis are
`
`all of the same type of option corresponding to the selected filter on the horizontal
`
`axis. For example, in Figure 4C, when the horizontal element H1 “Son-cartoons” is
`
`in the focus area, the interface displays only vertical elements that represent cartoon
`
`- 17 -
`
`
`
`P. 20
`
`

`

`
`
`channels on the vertical axis, as opposed to other option types, such as games or
`
`Internet websites. (Bernhardson, Fig. 4C).
`
`36. Additionally, Robarts discloses filtering cards according to option type.
`
`Robarts discloses software in an interactive television system for filtering
`
`information. (Robarts, 14:5-7). An interactive television is provided with an EPG
`
`database 72, which stores program information as a data structure encompassing
`
`various items, each item including several data fields 90. (Robarts, 27:7-9, 34:3-5,
`
`26:1-3). These data fields 90 can contain information such as titles, actor names, the
`
`scheduled time of the program, the network name, and the like. (Robarts, 26:3-5,
`
`Fig. 4).
`
`37. The software provides a user interface 170, which has a scrollable grid
`
`displaying the program information obtained from the EPG database 72. (Robarts,
`
`32:14, 22:6-7, 31:18-21). The user interface includes several “predefined query
`
`buttons.” (Robarts, 36:3). “Activation of these query buttons trigger a query of the
`
`EPG database 72 to identify programs satisfying the predefined query parameters.”
`
`(Robarts, 36:4-5). For example, activating the “comedies” query button 206
`
`“initiates a query of the EPG database 72 for all comedy programs”. (Robarts, 36:16-
`
`17). Additionally, the user can create various user-defined queries. (Robarts, 38:9-
`
`10). These queries are not limited to television programs, and they can pertain to
`
`- 18 -
`
`
`
`P. 21
`
`

`

`
`
`various types of options, e.g., games, educational materials, communications
`
`records, software, etc. (Robarts, 52:8-11).
`
`38. Figure 9 displays “a diagrammatic illustration of how a query filters the
`
`program database … to identify programs satisfying the parameters of the query.”
`
`(Robarts, 22:10-11). The viewer has defined “a science fiction (Sci-Fi) query”
`
`including a science fiction parameter. (Robarts, 41:3-4). Once the query is triggered,
`
`the software filters the programs provided in the database to “a short list of Sci-Fi
`
`programs” including only the programs with a science fiction genre, and displays
`
`the short list in the user interface. (Robarts, 41:5-9). Because the queries of Robarts
`
`cause display of options only related to each specific query parameter, Robarts
`
`discloses filtering cards representing the type of option corresponding to the selected
`
`filter.
`
`
`
`- 19 -
`
`
`
`P. 22
`
`

`

`
`
`39. Claim 1 of the ’564 patent further describes “displaying at least a subset of
`
`the second set of cards along a second axis that is perpendicular to the first axis,
`
`one card being displayable within the focus area.” Bernhardson discloses
`
`displaying on the vertical scroll bar those vertical elements that correspond to the
`
`selected horizontal element. (Bernhardson, 4:12-19). For example, as disclosed in
`
`Fig. 3, the user can scroll the horizontal element H1 (which includes news content)
`
`into the focus region 16. (Bernhardson, 4:3-10, 4:27-30). When the horizontal
`
`element H1 is scrolled into the focus region 16, “the vertical … elements are
`
`populated with details concerning content sources that the father has selected to form
`
`a group associated with ‘news’ for the horizontal element H1.” (Bernhardson, 4:31-
`
`35). Similarly, in Fig. 4C, when the horizontal element H1 “Son-cartoons” is in the
`
`focus area, the interface displays only vertical elements that represent cartoon
`
`channels on the vertical axis. (Bernhardson, Fig. 4C). Once the selected vertical
`
`elements are displayed, “the user can then operate the vertical scrolling keys 17, 18
`
`on the controller 4 to scroll the vertical scroll bar V so as to move one of the vertical
`
`scroll bar elements V into the focus region 16.” (Bernhardson, 4:36-39). Therefore,
`
`Bernhardson discloses displaying the vertical elements along the vertical axis
`
`perpendicular to the horizontal axis, with one vertical element displayable within the
`
`focus region.
`
`- 20 -
`
`
`
`P. 23
`
`

`

`
`
`40. Claim 1 of the ’564 patent further describes “receiving a selection of a
`
`second filter in response to a user scrolling the set of filter cards along the first
`
`axis to align a second corresponding filter card with the focus area.”
`
`Bernhardson discloses receiving a selection of a second horizontal element after
`
`selection of a first horizontal element. Specifically, the user can scroll a second
`
`horizontal element into the focus region, which results in the corresponding set of
`
`vertical elements being displayed along the vertical axis. (Bernhardson, 2:12-18,
`
`1:49-52, 6:50-58).
`
`41. For example, in Fig. 4B, the element H1 (“Mother-shopping”) is displayed in
`
`the focus region 16, which results in various shopping channels being displayed on
`
`the vertical axis. (Bernhardson, 5:15-21, Fig. 4B). When the user scrolls a second
`
`horizontal element H3 (“Mother-fashion”) into the focus region 16, various program
`
`information related to fashion are displayed along the vertical axis. (Bernhardson,
`
`4:19-22, 5:21-26). Further, the second filter can be of a different option type than
`
`the first selected filter. For example, “Son-games” or “Son-Internet” can be selected
`
`as the second filter (Bernhardson, Fig. 4C).
`
`42. Claim 1 of the ’564 patent further describes “filtering the first set of cards
`
`to produce a third set of cards wherein each of the cards in the third set differs
`
`in type from each of the cards in the second set.” Bernhardson discloses that in
`
`response to selection of a horizontal element, the elements that correspond to that
`
`- 21 -
`
`
`
`P. 24
`
`

`

`
`
`horizontal element will be displayed on the vertical bar. (Bernhardson, 2:12-18,
`
`1:49-52, 6:50-58). Bernhardson also discloses that the displayed vertical bar
`
`elements are “associated with” the horizontal bar element. (Bernhardson, 4:30-35).
`
`Therefore, by displaying only the associated vertical elements, Bernhardson filters
`
`the displayed vertical elements based on the horizontal element in the focus region.
`
`43. Bernhardson also discloses that the elements displayed along the vertical axis
`
`in response to the selection of one horizontal element can be of a different option
`
`type than the elements displayed along the vertical axis in response to the selection
`
`of another horizontal element. For example, Bernhardson discloses horizontal
`
`elements pertaining to television programs, e.g., “Son-cartoons.” (Bernhardson, Fig.
`
`4C). When the user selects this element, various cartoon channels are displayed
`
`along the vertical axis. (Bernhardson, Fig. 4C). Bernhardson also discloses other
`
`horizontal elements pertaining to other option types, e.g., “Son-games” and “Son-
`
`Internet.” (Bernhardson, Fig. 4C). Just as Bernhardson explains with reference to
`
`selection of different horizontal elements in Fig. 4B (Bernhardson, 5:15-26), if the
`
`user selects one of these other horizontal elements in Fig. 4C, such as “Son-games,”
`
`various options corresponding to that