`U.S. Patent No. 8,688,028
`
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`HYUNDAI MOTOR AMERICA
`Petitioner
`
`v.
`
`STRATOSAUDIO, INC.,
`Patent Owner
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`
`
`DECLARATION OF DR. JOHN C. HART, Ph.D.
`
`
`
`1
`
`
`
`
`
`
`
`
`
`
`
`StratosAudio Exhibit 2020
`Hyundai v. StratosAudio
`IPR2021-01303
`Page 1 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`TABLE OF CONTENTS
`
`A.
`
`Background and Qualifications ............................................................. 6
`
`Claim construction .............................................................................. 11
`Obviousness ......................................................................................... 12
`
`Specification ........................................................................................ 13
`Claim 11 .............................................................................................. 22
`Claim 16 .............................................................................................. 24
`
`A.
`B.
`
`A.
`B.
`C.
`
`A.
`B.
`C.
`
`“broadcast segment” ............................................................................ 26
`“media content” ................................................................................... 28
`Additional terms identified by the Board ............................................ 28
`“receiving a broadcast stream comprising the at least one
`broadcast segment and associated media content” ................... 29
`“associating/associated” ............................................................ 30
`“corollary” ................................................................................. 31
`
`
`
`
`
`
`
`A.
`
`Curtin (EX1010) .................................................................................. 31
`
`
`
`2
`
`Page 2 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`Crosby (EX1006) ................................................................................ 35
`B.
`Alwadish (EX1011) ............................................................................. 37
`C.
`D. Koerber (EX1012) ............................................................................... 41
`
`
`
`A.
`
`B.
`C.
`
`
`
`
`
`
`
`Curtin alone does not render Claim 11 obvious .................................. 42
`Element 11[pre]: A method for correlating media content
`identifying data with at least one broadcast segment
`received by a communication device ........................................ 42
`Element 11[a]: receiving a broadcast stream comprising
`the at least one broadcast segment and associated media
`content ....................................................................................... 46
`Element 11[e]: providing for presentation of at least a
`portion of the data elements stored in the electronic
`memory of the communication device, whereby the
`providing provides selective outputting, using an
`interface, of at least one of the following: the media
`content identifying data, the media content, the corollary
`broadcast segment, a temporal position of the corollary
`broadcast segment of the broadcast stream ............................... 47
`Curtin alone does not render Claims 13-20 obvious ........................... 52
`Curtin alone does not render Claim 16 obvious .................................. 52
`
`A. A POSITA would not have been motivated to combine the teachings of
`Curtin and Crosby, and would not have had a reasonable expectation of
`success in doing so .............................................................................. 53
`
`
`
`3
`
`Page 3 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`B.
`
`C.
`D.
`
`A POSITA would not have been motivated to consider Dr. Almeroth’s
`proposed combination of the teachings of Curtin and Crosby, and
`would not have had a reasonable expectation of success in doing so . 56
`Curtin in view of Crosby does not render Claim 11 obvious ............. 58
`Curtin in view of Crosby does not render Claims 13-20 obvious ....... 62
`
`
`
`
`
`
`
`A. Alwadish alone does not render Claim 11 obvious ............................. 62
`Element 11[pre]: A method for correlating media content
`identifying data with at least one broadcast segment
`received by a communication device,
`the system
`comprising ................................................................................. 62
`Element 11[d]: storing in an electronic memory of the
`communication device, at a minimum, media content
`identifying data elements into identifying data aggregates,
`each identifying data aggregate associated with at least
`one of the plurality of media content and the at least one
`broadcast segment, wherein the at least one broadcast
`segment is corollary to the at least one of the plurality of
`media content ............................................................................ 65
`Alwadish alone does not render Claims 14, 15 and 18
`obvious ...................................................................................... 67
`
`
`
`A. Alwadish alone does not render Claim 12 obvious ............................. 67
`B.
`Alwadish alone does not render Claim 16 obvious ............................. 68
`
`A. Alwadish in view of Koerber does not render Claim 12 obvious ....... 69
`
`
`4
`
`Page 4 of 94
`
`
`
`B.
`
`Alwadish in view of Koerber does not render Claims 16 obvious ..... 71
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`
`
`
`
`5
`
`Page 5 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`INTRODUCTION
`1.
`I, John C. Hart, Ph.D., have been retained by Patent Owner
`
`
`
`StratosAudio, Inc. (“Patent Owner”) as an independent expert witness in the above
`
`referenced inter partes review (“IPR”) of United States Patent No. 8,688,028 (“the
`
`’028 patent”) (EX1001). I understand that Hyundai Motor America (“Petitioner”)
`
`has petitioned for inter partes review of the ’028 patent and requests that the United
`
`States Patent and Trademark Office (“PTO”) cancel as unpatentable certain claims
`
`of the ’028 patent.
`
`2.
`
`This declaration sets forth my analyses and opinions based on the
`
`materials I have considered thus far and the bases for my opinions. I understand that
`
`this declaration will be used in the above mentioned IPR2021-01303.
`
`A. Background and Qualifications
`3. My qualifications are set forth in my curriculum vitae, a copy of which
`
`is attached as Appendix A hereto. As set forth in my curriculum vitae, I have a B.S.
`
`degree in Computer Science, as well as both an M.S. and Ph.D. degree in Electrical
`
`Engineering and Computer Sciences. I am a tenured Professor of Computer Science
`
`in the Department of Computer Science at the University of Illinois at Urbana-
`
`Champaign, one of the top five CS departments in the nation according to US News
`
`and World Report. As an educator for the past three decades, I have taught courses
`
`
`
`6
`
`Page 6 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`in interactive computing to thousands of students, and served as its area chair from
`
`2004 to 2011. I also strive to provide opportunities for the general public to learn
`
`more about interactive computing. For example, in 1999 I oversaw the production
`
`of the documentary “The Story of Computer Graphics.” I also teach an open course
`
`on data visualization on Coursera that has reached over 360,000 learners worldwide
`
`since 2016.
`
`4.
`
`The subject of the IPR is a patent titled “Broadcast Response System”
`
`(emphasis added). As summarized in its abstract, it describes an interactive system
`
`that allows a user to respond to a data stream. The invention is demonstrated by
`
`embodiments based on a broadcast multimedia audio system. I have experience with
`
`multimedia systems and have co-authored several peer-reviewed publications
`
`regarding this subject matter:
`
` P-C Wang, A.I. Ellis, J.C. Hart, C-H Hsu. Optimizing next-generation cloud
`
`gaming platforms with planar map streaming and distributed rendering. Proc.
`
`NetGames (15th Annual Workshop on Network and Systems Support for
`
`Games), 2017.
`
` P.R. Khorrami, V.V. Le, J.C. Hart, T.S. Huang. A System for Monitoring the
`
`Engagement of Remote Online Students using Eye Gaze Estimation. Proc.
`
`
`
`7
`
`Page 7 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`IEEE ICME Workshop on Emerging Multimedia Systems and Applications,
`
`
`
`July 2014.
`
` C. Dietrich, J. Hart, D. Raila, U. Ravaioli, N. Sobh, O. Sobh, C. Taylor.
`
`InvertNet: a new paradigm for digital access to invertebrate collections.
`
`ZooKeys 209, July 2012, pp. 165-181.
`
` S. Shi, M. Kamali, K. Nahrstedt, J.C. Hart, R. Campbell. High-Quality Zero-
`
`Delay Remote Rendering System for 3D Video. Proc. Multimedia, Oct. 2010.
`
`5.
`
`In addition to the above examples, I have been researching interactive
`
`computing since 1987, with over a hundred papers, videos, patents and other
`
`contributions to computer graphics, visualization, multimedia systems and human-
`
`computer interaction. This work has been funded by Adobe, Intel, Microsoft, Nokia
`
`and Nvidia as well as the National Science Foundation (NSF) and the Defense
`
`Advanced Research Projects Agency (DARPA).
`
`6.
`
`I am also an internationally recognized leader in the area of interactive
`
`computing. From 2002-08, I was the Editor-in-Chief of the top journal in computer
`
`graphics, the Association for Computing Machinery (ACM) Transactions on
`
`Computer Graphics. From 1994-1999, I served on the executive committee of the
`
`main organization of computer graphics practitioners, the ACM Special Interest
`
`Group on Computer Graphics and Interactive Techniques (SIGGRAPH). I continue
`
`
`
`8
`
`Page 8 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`to oversee the peer review of major papers in the field through service as chair and
`
`member of various paper review committees. I am also a founding member of the
`
`editorial board of ACM Books, where I oversaw the publication of “The VR Book”
`
`by Jason Jerald.
`
`7.
`
`I am being compensated for my time spent in connection with this
`
`matter at my usual rate of $650 per hour. My compensation is not contingent on the
`
`outcome of this case.
`
`
`
`SUMMARY OF OPINIONS
`8.
`I have reviewed the Declaration of Kevin Almeroth, Ph.D. (EX1002)
`
`(the “Almeroth Declaration”), the Petition, the prior art references cited therein, the
`
`specification, claims, and prosecution history of the ’028 patent, and the PTAB’s
`
`Institution Decision. I considered all these materials and additional exhibits cited
`
`herein. I also relied on my education, training, and experience as a skilled artisan in
`
`the field.
`
`9.
`
`The opinions that I express in this declaration are based on the
`
`information and evidence currently available to me. It is my opinion that the
`
`challenged claims of the ’028 patent are not obvious in light of the combinations of
`
`references set forth in the Petition.
`
`
`
`9
`
`Page 9 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`10.
`
`It is my opinion that claims 11 and 13-20 of the ’028 patent are not
`
`
`
`rendered obvious by Curtin (EX1010), alone (Ground 1), or by Curtin in view of
`
`Crosby (EX1006) (Ground 2).
`
`11.
`
`It is my opinion the claims 11, 14-15, and 18 of the ’028 patent are not
`
`rendered obvious by Alwadish alone (EX1011) (Ground 3).
`
`12.
`
`It is my opinion the claims 12 and 16 are not rendered obvious by
`
`Alwadish (EX1011) alone or in view of Koerber (EX1012) (Grounds 4 and 5).
`
` LEGAL STANDARDS
`13.
`I am not an attorney, and therefore, my understanding of patent law and
`
`the legal standards set forth in this report are based on explanations provided by
`
`counsel.
`
`14.
`
`I have been informed by counsel and I understand that the ’028 Patent
`
`was filed on May 7, 2013, but that it claims priority to U.S. Provisional Application
`
`No. 60/232,333 filed on September 13, 2000. Therefore, I have been instructed by
`
`counsel that the invention date of the ’028 Patent is September 13, 2000, for the
`
`purposes of this Petition. I take no position on whether an earlier invention date
`
`should be afforded the ’028 Patent.
`
`
`
`10
`
`Page 10 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`A. Claim construction
`15.
`I understand that the United States Patent and Trademark Office
`
`
`
`interprets claim terms in an inter partes review proceeding under the same claim
`
`construction standard that is used in a United States federal court. I understand that,
`
`under this standard, the meaning of claim terms is considered from the viewpoint of
`
`a person having ordinary skill in the art (“POSITA”) at the time of the alleged
`
`invention.
`
`16.
`
`I understand that claim terms are generally given their plain and
`
`ordinary meaning as understood by a POSITA, in light of the specification and the
`
`prosecution history pertaining to the patent. I have been further informed and
`
`understand that claim terms are generally not to be imported from the embodiments
`
`described in the specification unless the patentee has demonstrated a clear intention
`
`to limit the claim scope.
`
`17.
`
`I understand that, in addition to the claims, specification, and
`
`prosecution history, other evidence may be considered to ascertain the meaning of
`
`claim terms, including textbooks, encyclopedias, articles, and dictionaries. I have
`
`been informed and understand that this other evidence is often less significant and
`
`less reliable than the claims, specification, and prosecution history.
`
`
`
`11
`
`Page 11 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`B. Obviousness
`18.
`I understand that even if an alleged claimed invention is not identically
`
`
`
`disclosed or described in a single piece of prior art, the patent claim may still be
`
`unpatentable if the differences between the claimed invention and the prior art (alone
`
`or in combination) are such that the claimed invention as a whole would have been
`
`obvious to a person having ordinary skill in the art at the time the invention was
`
`made. I understand that the level of ordinary skill in the pertinent art is evaluated as
`
`of the time of the invention, here the effective filing date of the ’028 patent.
`
`19.
`
`I also understand that, in addressing obviousness, the following factors
`
`must be considered from the perspective of a hypothetical person of ordinary skill
`
`in the relevant art: (1) the scope and content of the prior art; (2) the differences
`
`between the claimed invention and the prior art; (3) the level of ordinary skill in the
`
`art; and (4) any other indications (“objective indicia”) of non-obviousness, such as
`
`commercial success, long-felt but unsolved needs, failure of others, industry
`
`acclaim, and unexpected results.
`
`20.
`
`I understand that prior art references may be combined to render a claim
`
`obvious if a person of ordinary skill in the art would have been motivated to combine
`
`those teachings to derive the claimed subject matter with a reasonable expectation
`
`
`
`12
`
`Page 12 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`of success. I also understand that the use of hindsight to select or combine prior art
`
`references is improper for purposes of an obviousness analysis.
`
`21.
`
`I understand that in considering obviousness, it is relevant to consider
`
`whether the art includes references that “teach away” from the claimed invention. I
`
`have been informed that a reference teaches away from the claimed invention if a
`
`person of ordinary skill, reading the reference, would be discouraged from following
`
`the path of the claimed invention or would be led in a divergent direction.
`
` THE ’028 PATENT
`A.
`Specification
`22. The ’028 patent is titled “Broadcast Response System,” and discloses a
`
`novel system and method for allowing a user to respond to broadcast media by
`
`correlating media content identifying data with a broadcast segment. EX1001, 2:53-
`
`55, Claim 11. The ’028 Patent lists several applications of the invention, including
`
`providing “a radio broadcast listener with the ability to obtain media content such as
`
`music or speech while listening to the radio,” and allowing a user to “respond to
`
`items in the radio broadcast such as advertisements, fund raising drives or interactive
`
`listener polls during the broadcast.” EX1001, Abstract.
`
`23. The ’028 Patent summarizes the state of the art, explaining that the
`
`concept and application of including “ancillary signals” with FM broadcasts was
`
`
`
`13
`
`Page 13 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`well known, and implemented as standards, including RBDS and RDS, as far back
`
`as the “early 1990’s.” EX1001, 1:20-2:49. These ancillary metadata signals
`
`accompanying the broadcast media would commonly include a “4-digit Program
`
`Identification code (PI) which is derived from the transmitting station’s call letters,”
`
`“traffic information,” “a 5-bit Program Type (PTY) code which describes the current
`
`program or format being broadcast by the station (Rock, Oldies, Talk, News, etc.),”
`
`and display-only “RadioText (RT)” which “appears on RBDS-enabled radios as a
`
`scrolling message which some stations use to identify the song or program being
`
`broadcasted” or “to identify alternate frequencies where the same programming can
`
`be available, in-house station text messages, or Emergency Alert System (EAS)
`
`communication messages.” EX1001, 1:65-2:20.
`
`24. The ’028 Patent is not about identifying songs; instead it gives users the
`
`ability to interact with and respond to data associated with the broadcasts. EX1001,
`
`2:53-55. The patent states that the RBDS and RDS systems allow broadcasters to
`
`“distribute information to a large number of users” but do not “allow individual users
`
`to respond to the broadcast information.” EX1001, 2:26-29. The ’028 Patent
`
`enumerates such desired responses, including purchasing a song, pledging to a fund
`
`drive, or participating in a listener survey. EX1001, 2:30-49.
`
`
`
`14
`
`Page 14 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`25. The ’028 Patent describes a number of embodiments, many of which
`
`
`
`relate to use of “an Automatic Purchase System (APS) [that] provides a radio
`
`broadcast listener with the ability to conveniently purchase media content such as
`
`music or speech while listening to the radio.” EX1001, 2:53-3:57.
`
`26. One embodiment describes each broadcaster as having a RBDS/RDS
`
`enabled server onsite to “generate RBDS/RDS or equivalent code for inclusion in
`
`the broadcast” and also receive listener responses to “validate and route purchase
`
`information to the user’s wireless carrier for billing, monitor online sales
`
`transactions for data mining, or route validated purchases to licensed creative content
`
`providers.” EX1001, 3:7-14.
`
`27.
`
`In a related embodiment, the ’028 patent refers to a system where
`
`“purchases are made by saving requests for selected items for purchase on a flash
`
`card or storage technology and transferring that data to a personal computer for
`
`purchase through the Internet at a later time.” EX1001, 3:34-38.
`
`28. The ’028 patent includes a four-page Figure 1. I present below a single-
`
`page version of this figure:
`
`
`
`15
`
`Page 15 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`
`
`29. As shown in Fig. 1, a radio station 140 includes a radio automation
`
`system 142, an audio database/encoding server 144 (denoted “Proprietary”), an FM
`
`transmission system 146, as well as a RBDS encoder 148. EX1001, 5:41-44. The
`
`radio automation system 142 extracts information about songs or a radio program
`
`from the station playlist and provides the extracted information to the audio
`
`database/encoding server 144. EX1001, 5:44-48. The information can include song
`
`title, artist, cut or other information. EX1001, 5:48-49.
`
`
`
`16
`
`Page 16 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`30. The audio database/encoding server 144 matches this information with
`
`
`
`information in the database to determine whether an audio file corresponding to
`
`media content (e.g., song or radio program) is available for download. EX1001,
`
`5:48-52. If a match is found, the audio database/encoding server (proprietary) 144
`
`encodes download information for that media content and sends the encoded
`
`download information to the RBDS encoder 148. EX1001, 5:52-56.
`
`31. The RBDS encoder 148 transmits the encoded download information
`
`using the RBDS subcarrier 170 to the FM transmission system 146. EX1001, 5:57-
`
`59. The RBDS encoder 148 also formats into the subcarrier signal 170 “non-APS
`
`elements of the data stream (such as station identification (Call Letters), date and
`
`time etc.)” for the specific broadcast segment that is transmitted. EX1001, 10:46-
`
`51.
`
`32.
`
`“As shown in FIG. 1, a radio station 140, using either a standard radio
`
`automation system for tracking of music content which is being broadcast, or a data-
`
`enabled audio player, broadcasts audio material and synchronously sends
`
`RBDS/RDS or similar data to an APS server 144 that assigns a unique identifier to
`
`each specific broadcast segment or song.” EX1001, 5:64-6:2. Accordingly, the
`
`subcarrier signal 170, in addition to information identifying a media content (e.g.,
`
`name of a song), also contains data that enables a unique identification of each
`
`
`
`17
`
`Page 17 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`specific broadcast segment. EX1001, 5:64-6:2. For example, assuming that a
`
`particular song is broadcast by a radio station at multiple different times on a certain
`
`day, each instance of broadcast of that song by that radio station would have
`
`associated data that enables a unique identification for identifying that specific
`
`broadcast segment.
`
`33. The FM transmission system 146 modulates (or mixes) the subcarrier
`
`170 with the FM baseband program 172 (that contains the audio corresponding to
`
`the station playlist) and generates an FM RF signal 162 for transmission to a radio
`
`receiver 100. EX1001, 5:57-63.
`
`34. Although the receiver 100 has not been labeled in FIG. 1, a POSITA
`
`would readily understand, from the context of the description of Fig. 1, that the
`
`“receiver 100” corresponds to the following boxed-in portion of Fig. 1 (annotated to
`
`remove connecting lines and labeled with 100). EX1001, 4:30. In fact, this boxed-
`
`in portion of Fig. 1 is labeled “RADIO RECEIVER,” which a POSITA would
`
`understand indicates it corresponds to the specification’s “receiver 100.” EX1001,
`
`4:30.
`
`
`
`18
`
`Page 18 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`
`
`35. The embodiments disclosed in the specification of the ’028 patent
`
`further support a POSITA’s understanding that the “receiver 100” corresponds to
`
`this boxed-in portion of Fig. 1. EX1001, 4:30-35. For example, the specification of
`
`the ’028 patent indicates that “[i]n one embodiment, the radio receiver 100
`
`comprises a Radio Frequency (RF) Demodulator Section 102, a RBDS/RDS
`
`Decoder 106, a RBDS/RDS function control interpreter 104, an audio demodulator
`
`amplifier section 108, a scrolling display 110, an Internet Download Director 112, a
`
`local memory device 114 and the control interface 116.” EX1001, 4:30-35
`
`(emphasis added). FIG. 1 depicts such components 102, 104, 106, 108, 110, 112,
`
`114 and 116 all within the boxed-in portion.
`
`36. Receiver 100 receives the transmitted FM RF signal 162, splits the
`
`signal into an audio signal and a data signal, with the data signal provided to the
`
`
`
`19
`
`Page 19 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`RBDS/RDS decoder 106 and the audio signal provided to the audio demodulator
`
`amplifier section 108. EX1001, 4:39-43.
`
`37. The ’028 patent describes embodiments of the invention on the
`
`“technology enabled radio” (TER) shown in Fig. 2, reproduced below:
`
`
`
`38. As shown in FIG. 2, the “technology enabled radio” (TER) 200 includes
`
`a display 210 for displaying the extracted media content identifying data (e.g., name
`
`of a song) and an interactive button 212 for receiving a response from the user.
`
`EX1001, 6:52-7:9. The interactive button 212 can allow a user to select or “tag” a
`
`song for future purchase. EX1001, 6:52-65, 7:10-14. If a song is tagged for
`
`
`
`20
`
`Page 20 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`purchase, the APS module stores a unique identifier data 204 assigned to the specific
`
`broadcast segment. EX1001, 6:52-58. The tagged song is added to a playlist 208
`
`that is stored in the memory 220 of the receiver. EX1001, 6:62-65. The user can
`
`later access this list of tagged items and choose one or more items from this playlist
`
`208 for future download. EX1001, 6:65-7:7.
`
`39. The ’028 patent further explains that the radio can “use a wireless
`
`interface 218 to send a purchase request . . . . to an APS server 260 for processing,
`
`billing approval, and delivery of the content.” EX1001, 7:27-38. A second option
`
`is available if the “user does not have a wireless phone, or does not have a good
`
`connection with a wireless phone connected to the radio.” EX1001, 7:39-46. For
`
`this second option, “[t]he user can select . . . broadcast content for purchase” and
`
`these “content selections can be stored on the flash card or storage technology 220
`
`for later use.” EX1001, 7:39-46 (emphasis added). This second option discloses
`
`that the user selects content specific to a broadcast, and stores data identifying that
`
`content in the memory. EX1001, 7:39-46.
`
`40. The ’028 patent further discloses how this second-option embodiment
`
`handles the purchase when a wireless connection to the APS server cannot be
`
`obtained by the TER. EX1001, 7:49-61. “In cases where the user cannot obtain a
`
`good connection or the user does not have a wireless account, the flash card or
`
`
`
`21
`
`Page 21 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`storage technology 220 can later be removed by the user and inserted in a personal
`
`computer 240.” EX1001, 7:49-53. In this case, “[t]he routing information for each
`
`selection stored on the flash card or storage technology 220 is passed to the APS
`
`download software running on the user’s personal computer” which “allows the user
`
`to purchase the selected content and download it to a personal computer 240 as long
`
`as the content was tagged with the proper security codes obtained from the APS
`
`module 202 in the radio 200.” EX1001, 7:53-61. The ’028 patent states that “[t]he
`
`data collected through ‘data mining’ of sales transactions can be sold to companies
`
`interested in tracking demographic information and music sales such as record
`
`companies and trade publications.” EX1004, 8:41-44; see also EX1004, 9:34-37.
`
`B. Claim 11
`41. Claim 11, according to its preamble, discloses “[a] method for
`
`correlating media content identifying data with at least one broadcast segment
`
`received by a communication device.” EX1001, Claim 11. A POSITA would
`
`understand this correlation would be important, for example, for data mining. “In
`
`one embodiment, activity of each sale using the above system is tracked for the
`
`purposes of aggregating data or ‘Data Mining’ for sale to interested parties such as
`
`trade publications and record companies.” EX1001, 9:34-36. A POSITA would
`
`understand that such activity data important for mining would include not only what
`
`
`
`22
`
`Page 22 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`
`
`song was purchased, but which broadcast of that song triggered the purchase,
`
`answering, for example, which repeat broadcasts of any particular song generated
`
`the most user responses or which broadcast segments generated interest but no
`
`follow-through for purchase or vote generation. A POSITA would understand that
`
`answering such questions would require a system for correlating the media content
`
`identifying data with the broadcast segment uniquely resolvable using both
`
`proprietary sourced and “non-APS” or non-proprietary data. EX1001, 10:45-51.
`
`42. This understanding of a POSITA that such a system for correlating
`
`media content identifying data with a broadcast segment would be used for data
`
`mining is further emphasized by the fact that both Claim 11’s and the ’028 patent
`
`specification’s descriptions of data mining rely on the concept of data aggregation.
`
`Claim 11 requires storing in electronic memory “media content identifying data
`
`elements into identifying data aggregates” (emphasis added) with each aggregate
`
`associated with at least one media content item and its correlated broadcast segment.
`
`When the specification states “activity of each sale using the above system is tracked
`
`for the purposes of aggregating data or ‘Data Mining’” (EX1001, 9:34-36 (emphasis
`
`added)), it becomes clear to a POSITA that the “aggregates” of Claim 11 are
`
`referring to the inclusion of the additional data regarding the purchase that would be
`
`useful for the specification’s data mining.
`
`
`
`23
`
`Page 23 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`43. Because Claim 11 requires the “identifying data aggregates” be
`
`
`
`associated with both the purchased media content and the purchase triggering
`
`broadcast segment, the aggregation of the media content information (e.g., song
`
`title) with the broadcast segment identifying information (e.g., information particular
`
`to a discretely identifiable portion of the programming as broadcasted, such as the
`
`unique identifier generated by proprietary server 144) would need to be stored on
`
`the memory device so that when the purchase was later completed using an Internet
`
`connection, the details important for data mining (e.g., song was purchased because
`
`of a specific broadcast segment) could also be transmitted from the memory to the
`
`APS server.
`
`C. Claim 16
`44. Claim 16 provides “[t]he method of claim 11, wherein the data stream
`
`further comprises data that enables a unique identification of the at least one
`
`broadcast segment.” EX1001, 16:25-27. The data stream in claim 11 already
`
`includes “at a minimum, the media content identifying data.” EX1001, 15:27-28.
`
`Accordingly, claim 16 requires that the data stream now include both non-APS
`
`“media content identifying data” and “data that enables a unique identification of the
`
`at least one broadcast segment.” EX1001, Claim 16.
`
`
`
`24
`
`Page 24 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
` LEVEL OF ORDINARY SKILL IN THE ART
`45.
`I understand that the Board adopted the definition of the level of
`
`
`
`ordinary skill in the art from its institution decision in IPR2021-00716 (“the
`
`Volkswagen IPR”), which required “a B.S. in computer science or electrical
`
`engineering (or a related field), and approximately three years of experience working
`
`in the communications- or Internet-related industries, or alternatively, an advanced
`
`degree (such as a master’s degree) in computer science or electrical engineering (or
`
`a related field).” Paper 9 (citing Volkswagen IPR Institution Decision (EX2019,
`
`18).
`
`46. For the purpose of these proceedings, I do not disagree with the level
`
`of skill adopted by the Board. I am qualified to testify as to this level of skill for the
`
`reasons set forth above in “Background and Qualifications.” See supra Section I.A
`
`above.
`
` CLAIM CONSTRUCTION
`47. Dr. Almeroth at ¶33 states that he does “not believe any term requires
`
`explicit construction” in order “[t]o resolve the particular grounds presented in [the]
`
`Petition.” EX1002, ¶33. I disagree.
`
`
`
`25
`
`Page 25 of 94
`
`
`
`IPR2021-01303
`U.S. Patent No. 8,688,028
`
`A.
`“broadcast segment”
`48. While Dr. Almeroth provided no construction for the term “broadcast
`
`
`
`segment,” the Board’s Institution Decision adopted the finding in the Volkswagen
`
`IPR that the term means “a distinguishable piece or portion of broadcast stream, such
`
`as an individual song, speech or video.” Paper 9 at 20 (citing Volkswagen IPR
`
`Institution Decision (EX2019) at 19-23). I disagree.
`
`49.
`
`In my opinion, the term “broadcast segment” in the context of the ’028
`
`patent means “a discretely identifiable portion of programming as broadcasted.”
`
`Broadcasts are sent from a transmitter (e.g., an FM radio transmitter) to a receiver
`
`(e.g., a radio receiver). Broadcast programming may comprise multiple “broadcast
`
`segments,” with each “broadcast segment” discretely identifiable relative to all other
`
`“broadcast segments” transmitted. In other words, a “broadcast segment” is an
`
`identifiably unique occurrence – it encompasses a