`
`
`
`
`
`
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`____________
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
` ____________
`UBISOFT ENTERTAINMENT, S.A.
`Petitioner
`v.
`PRINCETON DIGITAL IMAGE CORP.,
`Patent Owner
`____________
`
`Case No. IPR2014-00635
`Patent 5,513,129
` ____________
`
`
`
`
`DECLARATION OF DR. VIJAY K. MADISETTI
`
`
`
`
`
`
`
`
`
`1
`
`
`
`PETITIONERS EX. 1013 Page 1
`
`
`
`
`
`I, Vijay K. Madisetti, hereby declare the following:
`I. BACKGROUND AND EDUCATION
`1. My name is Vijay Madisetti, and I am a Professor of Electrical and
`
`Computer Engineering at Georgia Institute of Technology (“Georgia Tech”) in
`
`Atlanta, GA.
`
`2.
`
`I received a Bachelor of Technology in electronics and Electrical
`
`Communications Engineering from the Indian Institute of Technology (IIT) in
`
`1984. I received my Ph.D. in Electrical Engineering and Computer Sciences
`
`(EECS) from the University of California, Berkeley in 1989. I am currently a
`
`tenured full Professor at Georgia Institute of Technology, and I have been on the
`
`faculty of Georgia Institute of Technology since 1989. I have authored or co-
`
`authored over 100 reference articles in the area of electrical engineering. I have
`
`also authored, co-authored, or edited several books in the areas of electrical
`
`engineering, signal processing, image and video processing, computer engineering,
`
`and embedded systems, including Modeling, Analysis, Simulation of Computer and
`
`Telecommunications Systems (1994), VLSI Digital Signal Processors (1995) and
`
`The Digital Signal Processing Handbook (First & Second Editions) (1998, 2012),
`
`and VHDL: Electronics Systems Design Methodologies (2000). Although I discuss
`
`my expert qualifications in more detail below, I also attach as [Appendix A] a
`
`
`
`2
`
`PETITIONERS EX. 1013 Page 2
`
`
`
`recent and complete curriculum vitae, which details my educational and
`
`professional background and includes a listing of most of my publications.
`
`3.
`
`I have been involved in research and technology in the area of signal
`
`processing, event-driven programming, and embedded systems since the late
`
`1980s, and my work in this area has focused on design and application of digital
`
`signal processors, optimization of signal processing systems, hardware and
`
`software of embedded systems, and event-driven programming in distributed
`
`systems.
`
`4.
`
`In 1987, at UC Berkeley, I worked on implementing a globally
`
`distributed file system, called GAFFES, to facilitate information sharing in a global
`
`network of workstations. GAFFES provided four services to handle naming,
`
`replication and caching, security and authentication, and file access primitives.
`
`GAFFES outlined features of access in terms of users and their roles, and in terms
`
`of beliefs and policies. Every file in GAFFES has at least one role, and the owner
`
`of a role determines the roles that may use that role to operations on software files.
`
`5.
`
`I have authored, co-authored, or edited several books in the past
`
`twenty years, including:
`
`• VLSI Digital Signal Processors
`Madisetti, V.K.
`• Quick-Turnaround ASIC Design in VHDL
`Romdhane, M., Madisetti, V.K., Hines, J.
`• The Digital Signal Processing Handbook (First Edition)
`
`
`
`3
`
`PETITIONERS EX. 1013 Page 3
`
`
`
`Madisetti, V. K., Williams, D. (Editors)
`• VHDL: Electronics Systems Design Methodologies.
`Madisetti, V. K. (Editor)
`• Platform-Centric Approach to System-on-Chip (SoC)
`Design.
`Madisetti, V. K., Arpnikanondt, A.
`• The Digital Signal Processing Handbook – Second Edition.
`Madisetti, V. K. (2009/2010)
`• Cloud Computing: A Hands-On Approach
`A Bahga, V. Madisetti (2013)
`In the past twenty years I have also authored several peer-reviewed
`
`6.
`
`papers in the areas of signal processing, embedded digital signal processing
`
`systems, event driven programming, and computer and software design, and these
`
`include:
`
`• V. Madisetti, et al, “Synchronization mechanisms for distributed
`event-driven computation”, ACM Transactions on Modeling and
`Computer Simulation, Vol 2, No. 1, January 1992
`• V. Madisetti, et al, “The Georgia tech Digital Signal Multiprocessor”,
`IEEE Transactions on Signal Processing, Vol 41, No. 7, July 1993
`• V. Madisetti et al, “Rapid Prototyping on the Georgia Tech Digital
`Signal Multiprocessor”, IEEE Transactions on Signal Processing, Vol
`42, March 1994.
`• V. Madisetti et al, “Computer Simulation of Application-Specific
`Signal Processing Systems”, International Journal in Computer
`Simulariton, Vol. 4, No. 4, Nov 1994
`• V. Madisetti, “Reengineering legacy embedded systems”, IEEE
`Design & Test of Computers, Vol 16, Vol 2, 1999
`• V. Madisetti et al, “Virtual Prototyping of Embedded Microcontroller-
`based DSP Systems”, IEEE Micro, Vol 15, Issue 5, 1995
`• V. Madisetti, et al, “Incorporating Cost Modeling in Embedded-
`System Design”, IEEE Design & Test of Computers, Vol 14, Issue 3,
`1997
`
`
`
`4
`
`PETITIONERS EX. 1013 Page 4
`
`
`
`• V. Madisetti, et al, “Conceptual Prototyping of Scalable Embedded
`DSP Systems”, IEEE Design & Test of Computers, Vol 13, Issue 3,
`1996.
`• V. Madisetti, Electronic System, Platform & Package Codesign,”
`IEEE Design & Test of Computers, Vol 23, Issue 3, June 2006.
`• V. Madisetti, et al, “A Dynamic Resource Management and
`Scheduling Environment for Embedded Multimedia and
`Communications Platforms”, IEEE Embedded Systems Letters, Vol 3,
`Issue 1, 2011.
`
`I have over 100 peer-reviewed publications issued from the early
`
`7.
`
`1980s to the present on topics related to computer engineering, signal processing,
`
`event-driven programming, and digital system design.
`
`8.
`
`I am a Fellow of the Institute of Electrical and Electronics
`
`Engineering (“IEEE”), which signifies the highest professional standing in my
`
`research and educational community.
`
`9.
`
`I have already been qualified as an expert in over a dozen trials, and
`
`two recent cases: Harkabi v. SanDisk Corp., No. 08-cv-8203 (S.D.N.Y.) and
`
`Yangaroo Inc. v. Destiny Media Techs. Inc., No. 09-cv-462 (E.D. Wisc.) the
`
`technology at issue was specific to the area of digital rights management of
`
`software products. I testified in both of these cases at trial (Harkabi v. SanDisk)
`
`and by deposition (Yangaroo v. Destiny).
`
`10.
`
`In sum, I have over 25 years of experience in research and
`
`development in the areas of signal processing, event-driven programming,
`
`
`
`5
`
`PETITIONERS EX. 1013 Page 5
`
`
`
`computer engineering and electrical engineering as a professor, researcher and
`
`consultant.
`
`11.
`
`I have been retained by Ubisoft Entertainment, S.A. and am
`
`submitting this declaration to offer my independent expert opinion concerning
`
`certain issues raised in the Patent Owner’s Response (“PO Response”) to the
`
`Petition for inter partes Review (“Petition”). My compensation is not based on the
`
`substance of the opinions rendered here. As part of my work in connection with
`
`this matter, I have studied U.S. Patent No. 5,513,129 (“the ‘129 patent”), including
`
`the respective written descriptions, figures and claims. I have also reviewed the
`
`Petition for Inter Partes Review of the ‘129 patent, the Board’s Institution
`
`Decision, and Patent Owner’s Response.
`
`OPINION
`LEVEL OF A PERSON HAVING ORDINARY SKILL IN THE ART
`
`I.
`
`12.
`
`It is my understanding that Petitioner contends that a person of
`
`ordinary skill in the field of audio-controlled virtual objects in 1993 would have a
`
`B.S. in electrical engineering, computer engineering, computer science or related
`
`engineering discipline and at least two years experience in practical or post-
`
`graduate work in the area of computer-generated animations and/or graphics or
`
`equivalent experience or education. It is also my understanding that Petitioner
`
`contends that the person would also have some knowledge of media processing
`
`and digital audio programming.
`
`
`
`6
`
`PETITIONERS EX. 1013 Page 6
`
`
`
`13.
`
`It is my understanding that Patent Owner’s expert is contending that a
`
`person of ordinary skill in the art would have “at least a bachelor of science degree
`
`in computer science or computer engineering, with at least two years of practical
`
`experience with graphical interfaces.” Ex. 2002 at ¶9.
`
`14.
`
` Based on my education, training, and professional experience in the
`
`field of the claimed invention, I qualify as a person having at least ordinary skill in
`
`the art as of the filing date of the ‘129 Patent under, at least, the Patent Owner’s
`
`definition of the level of one of ordinary skill in the art.
`
`II. CLAIM CONSTRUCTION
`15.
`I have been informed that the ‘129 Patent is expired and that, in such a
`
`case, the words of a claim are given their ordinary and customer meaning as would
`
`have been understood by a person of ordinary skill in the art at the time of the
`
`invention, in other words July 1993.
`
`16.
`
`I have also been informed that claim limitations that use certain
`
`language, such as “means” or “means for,” may invoke 35 U.S.C. §112, 6th
`
`paragraph, or what is now 35 U.S.C. §112(f). When a claim limitation falls under
`
`this provision (and is thus considered a “means plus function” claim limitation), I
`
`have been informed that the claim term is construed to only cover the
`
`corresponding structure, material, or acts described in the specification and
`
`equivalents thereof that were known at the time of the invention. Therefore, in
`
`
`
`7
`
`PETITIONERS EX. 1013 Page 7
`
`
`
`order for a prior art reference to teach such a claim term, it must disclose the same
`
`function required by the claim and the same corresponding structure as that
`
`disclosed in the patent for performing the function or an equivalent to the
`
`corresponding structure. It is also my understanding that the corresponding
`
`structure only includes the structure necessary to perform the function and that it is
`
`inappropriate to incorporate structure from the specification beyond that necessary
`
`to perform the recited function.
`
`A. means for supplying a first signal selected from a group consisting
`of … (Claim 12)
`
`It is my understanding that the Board has not construed this claim
`
`17.
`
`limitation. I understand that the parties agree that the function is “supplying a first
`
`signal selected from a group consisting of a control signal having music and/or
`
`control information generated in response to a music signal, a prerecorded control
`
`track having music and/or control information corresponding to the music signal,
`
`and a control signal having music and/or control information generated in response
`
`to the prerecorded control track.” PO Response at 11; see also Petition at 5-6. I
`
`understand that Patent Owner contends that the structure necessary for performing
`
`this function is “a media player having signal outputs, a sound processor connected
`
`to one or more of the media player outputs, an audio amplifier connected to the
`
`sound processor, one or more tape IF converters connected to one or more of the
`
`media player outputs, an audio source such as a microphone, a multichannel audio
`
`
`
`8
`
`PETITIONERS EX. 1013 Page 8
`
`
`
`digital with serial output connected to one or more outputs of the media player and
`
`to an audio source, a microprocessor having inputs connected to the tape IF
`
`converters and programmed to generate control signals.” PO Response at 11-12. I
`
`was asked to consider whether all of the structures identified by Patent Owner are
`
`necessary for performing the claimed function.
`
`18. First, I note that Patent Owner relies solely on Figure 6 of the ‘129
`
`Patent and appears to completely disregard Figures 1, 2, and 4. As described in the
`
`‘129 Patent, Figure 6 is a “block diagram of a system for creating an audio tape
`
`produced by the FIG. 5 system.” Ex. 1001, ‘129 patent at 7:33-34. The ‘129 Patent
`
`also describes Figures 5 and 6 as one implementation that is specific to a
`
`prerecorded multi-track audio tape for use with a head-coupled display system that
`
`provides “head position and orientation.” Ex. 1001, ‘129 Patent at 12:38-42, 14:23-
`
`26, 17:13-22. However, the ‘129 patent expressly discloses that a multi-track
`
`audio tape and head-mounted display are not necessary components of the system,
`
`and these components are not depicted in the “preferred embodiment of the
`
`inventive system” that is depicted in Figure 1. Ex. 1001, ‘129 Patent at 7:65-67,
`
`7:11-13, 20:10-15, 20:26-28, 8:7-17.
`
`19. The ‘129 patent expressly discloses that the multichannel audio
`
`digitizer 245, sound processor 205, audio source such as microphone 248, and
`
`audio amplifier 210 are all optional components for the system depicted in Figure
`
`
`
`9
`
`PETITIONERS EX. 1013 Page 9
`
`
`
`6. Ex. 1001, ‘129 patent at 19:20-22 (“Sound processing equipment (such as
`
`sound processor 205 shown in FIG. 6) can optionally be connected between audio
`
`source 200 and amplifier 210.”); 19:15-19 (“VR system 250 of FIG. 6 can play
`
`digitized music (e.g., generate original music), rather than merely routing digitized
`
`music from an external source (e.g., digitizer 245 of FIG. 6).”); 17:13-22 (“The VR
`
`system receives three signals: … digitized audio signals 246 that digitally represent
`
`the original audio (which is typically music), and/or any other audio source
`
`desired, such as a live microphone 248.”); 10:51-65 (disclosing that where “the VR
`
`computer has digital-to-analog audio capabilities,” an audio amplifier
`
`is
`
`unnecessary). As described by the ‘129 patent, a system that does not include
`
`these optional components, such as those depicted in Figures 1, 2, and 4, is still
`
`capable of supplying a first signal. Accordingly, it is my opinion that these
`
`optional components are not necessary for performing the claimed function.
`
`20. The ‘129 patent also discloses that the system of Figure 6, which is “a
`
`principally analog device, [] can easily be implemented digitally, in alternative
`
`embodiments of the invention.” Id. at 20:32-34; see also id. at 10:59-61 (“a digital
`
`VR computer itself (e.g., VR system 250 of FIG. 6)”); 15:34-42 (“there are many
`
`forms of signal processing which can be used to derive this control signal … A
`
`variety of digital signal processing techniques and analog signal processing
`
`techniques may be used”); 19:14-18 (“VR system 250 of FIG. 6 can play digitized
`
`
`
`10
`
`PETITIONERS EX. 1013 Page 10
`
`
`
`music … rather than merely routing digitized music from an external source (e.g.,
`
`digitizer 245 of FIG. 6).”). A skilled artisan would understand that where a
`
`prerecorded control track or control signal is stored or initially provided in digital
`
`form, converters and digitizers are not necessary. As such, it is my opinion that the
`
`tape IF converters and digitizer are not necessary structures for performing the
`
`specifically claimed function.
`
`21.
`
`It is my opinion that the only structure necessary for performing the
`
`function of “supplying a first signal” is a music source and a general purpose
`
`processor. See e.g., id. at 8:33-51 (“The control signals output from analyzer 5 are
`
`supplied through interface 6 to VR processor 7. … One or more of the control
`
`tracks (or both the music signal and one or more control tracks, or the music signal
`
`alone) can be supplied directly to VR processor”); Fig. 1.
`
`B. means for receiving the first signal and influencing action within a
`virtual environment (Claim 12)
`
`It is my understanding that the Board has not construed this claim
`
`22.
`
`limitation. I understand that the parties agree that the function is “receiving the
`
`first signal and influencing action within a virtual environment in response to said
`
`first signal.” PO Response at 14; Petition at 7. I understand that Patent Owner
`
`contends that the structure necessary for performing this function is “a virtual
`
`reality system connected to the microprocessor and outputting video signals and a
`
`virtual reality display connected to the virtual reality system.” PO Response at 14.
`
`
`
`11
`
`PETITIONERS EX. 1013 Page 11
`
`
`
`I was asked to consider whether all of the structures identified by Patent Owner are
`
`necessary for performing the claimed function and, if not, what structure is
`
`necessary to perform this specific function.
`
`23. As depicted in Figure 6, the VR system 250 is the only structure that
`
`receives the “first signals.” See e.g., Ex. 1001, ‘129 Patent at 17:13-22 (“The VR
`
`system receives … a control and data tape signal 241 that is related to the control
`
`tracks prerecorded on four-track tape 180T; and digitized audio signals 246 that
`
`digitally represent the original audio (which is typically music), and/or any other
`
`audio source desired, such as a live microphone 248.”); 17:42-49 (“The system …
`
`reads the ‘control track’ control signal 241 and audio control signal 246 (steps 440
`
`and 450). In response to this information, any number of programs can be
`
`implemented (step 460) to control and create and manipulate the virtual
`
`environment in a manner choreographed with the original music signal.”); see also
`
`id. at 8:33-51 (“The control signals output from analyzer 5 are supplied through
`
`interface 6 to VR processor 7. … One or more of the control tracks (or both the
`
`music signal and one or more control tracks, or the music signal alone) can be
`
`supplied directly to VR processor”).
`
`24.
`
`It is my opinion that a display is not a necessary structure for
`
`receiving a first signal or for influencing action within a virtual environment. As
`
`disclosed in the ‘129 patent, the display device merely displays image data
`
`
`
`12
`
`PETITIONERS EX. 1013 Page 12
`
`
`
`representing a virtual environment that was received from the VR processor. Ex.
`
`1001, ‘129 Patent at 8:2-4, 10:6-13 (“…VR processor 7 would draw a
`
`corresponding visual event (e.g., lightning) so that user would see the visual event
`
`a fraction of a second later.”), 14:11-13 (“VR system 250 outputs two video signals
`
`250L and 250R representing the left and right eye viewpoints of a virtual
`
`environment.”). As the claimed functions are not directed toward visualization of
`
`a virtual environment, a display is not necessary for performing the function of
`
`“receiving the first signal and influencing action within a virtual environment in
`
`response to said first signal.”.
`
`25.
`
`It is my opinion that the only structure necessary for performing the
`
`function of “receiving the first signal and influencing action within a virtual
`
`environment in response to said first signal” is a general-purpose computer. See
`
`e.g., Ex. 1001, ‘129 Patent at 8:33-51 (“The control signals … are supplied … to
`
`VR processor 7, for use within processor 7 for controlling generation of the virtual
`
`environment. One or more of the control tracks (or both the music signal and one
`
`or more control tracks, or the music signal alone) can be supplied directly to VR
`
`processor 7, to enable processor 7 … to control generation of the virtual
`
`environment in response to the control tracks or music”).
`
`C.
`
`analysis apparatus having means for receiving said music signal in
`digital or analog form, and processing said music signal to produce
`control information for modification of objects in the virtual
`environment (Claim 13)
`
`
`
`13
`
`PETITIONERS EX. 1013 Page 13
`
`
`
`
`26.
`
`It is my understanding that the Board has not construed this claim
`
`limitation. I understand that the parties agree that the function is “receiving said
`
`music signal in digital or analog form, and processing said music signal to produce
`
`control information for modification of objects in the virtual environment.” PO
`
`Response at 15-16; Petition at 8. I understand that Patent Owner contends that the
`
`structure necessary for performing this function is “a sound processor, an audio
`
`amplifier connected to the sound processor, one or more tape IF converters, a
`
`multichannel audio digitizer with serial output, a microprocessor having inputs
`
`connected to the tape IF converters and programmed to generate control signals.”
`
`PO Response at 16. I was asked to consider whether all of the structures identified
`
`by Patent Owner are necessary for performing the claimed function and, if not,
`
`identify what structures are necessary to perform this function.
`
`27. The ‘129 patent expressly discloses that the multichannel audio
`
`digitizer 245, sound processor 205, audio source such as microphone 248, and
`
`audio amplifier 210 are all optional components for the system depicted in Figure
`
`6. Ex. 1001, ‘129 patent at 19:20-22 (“Sound processing equipment (such as
`
`sound processor 205 shown in FIG. 6) can optionally be connected between audio
`
`source 200 and amplifier 210.”); 19:15-19 (“VR system 250 of FIG. 6 can play
`
`digitized music (e.g., generate original music), rather than merely routing digitized
`
`music from an external source (e.g., digitizer 245 of FIG. 6).”); 17:13-22 (“The VR
`
`
`
`14
`
`PETITIONERS EX. 1013 Page 14
`
`
`
`system receives three signals: … digitized audio signals 246 that digitally represent
`
`the original audio (which is typically music), and/or any other audio source
`
`desired, such as a live microphone 248.”); 10:51-65 (disclosing that where “the VR
`
`computer has digital-to-analog audio capabilities,” an audio amplifier
`
`is
`
`unnecessary). As described by the ‘129 patent, a system that does not include
`
`these optional components, such as those depicted in Figures 1, 2, and 4, is still
`
`capable of receiving a music signal in digital or analog form, and processing the
`
`music signal. Accordingly, it is my opinion that these optional components are not
`
`necessary for performing the claimed function.
`
`28. With respect to the one or more tape IF converters, it is my opinion
`
`that the need for a converter and the type of converter needed is dependent on the
`
`music source. The ‘129 Patent discloses several specific types of converters in
`
`addition to tape IF converters and discloses that a converter is only necessary to the
`
`extent that a music signal is received in analog form. Ex. 1001, ‘129 Patent at
`
`16:56-61, 20:26-35. As described in the ‘129 patent and depicted in Figures 1, 2,
`
`and 4, the disclosed structure for receiving a music signal in analog form is an A-
`
`to-D converter. An A-to-D converter merely digitizes analog signals before further
`
`processing. Id. at 9:61-65. The added step of digitizing a signal is unnecessary for
`
`digital signals, and as depicted in Figure 4, digital signals bypass the A-to-D
`
`converter to be instead supplied directly to the processor. Id. at 9:61-66; Fig. 4.
`
`
`
`15
`
`PETITIONERS EX. 1013 Page 15
`
`
`
`One of skill in the art would understand that a tape IF converter is simply one kind
`
`of A-to-D converter, and that the ‘129 patent discloses many other kinds of A-to-D
`
`converters. It is my opinion that the disclosed structure for receiving a music
`
`signal in analog form is not limited to any specific type of A-to-D converter.
`
`29.
`
`It is my opinion that the only structure necessary for performing the
`
`function of “receiving said music signal in … analog form” is an A-to-D converter.
`
`It is also my opinion that the only structure necessary for performing the function
`
`of “receiving said music signal in digital … form” and “processing said music
`
`signal to produce control information for modification of objects in the virtual
`
`environment” is a general purpose computer. See, e.g., Ex. 1001, ‘129 Patent at
`
`Abstract (“In preferred embodiments, a computer creating a virtual world interprets
`
`the music, the control track, or both, and uses the resulting information to modify,
`
`create, and or control objects in the virtual environment.”); 1:48-51 (“A VR system
`
`which embodies the invention can … create, animate, or otherwise control …
`
`virtual environments and virtual objects in response to music”); see also 5:1-10,
`
`11:28-43, 9:19-26.
`
`D. means for prerecording a control track having music and/or control
`information corresponding to a music signal (claim 16)
`
`means for prerecording a control track having audio and/or control
`information corresponding to an audio signal (Claim 22)
`
`
`
`
`16
`
`PETITIONERS EX. 1013 Page 16
`
`
`
`30.
`
`It is my understanding that the Board has not construed these claim
`
`limitations. I understand that the parties agree that the function is “prerecording a
`
`control track having music/audio and/or control information corresponding to an
`
`music/audio signal.” Petition at 9; see also PO Response at 16-17. I understand
`
`that Patent Owner contends that for the limitation in claim 22 the structure
`
`necessary for performing this function is “a first media player unit, one or more
`
`input devices, one or more microprocessors programmed with software to generate
`
`a control track from audio data and other input data and connected to the input
`
`devices, one or more interface converters connected to the one or more
`
`microprocessors, a second media player unit, a synchronizer connected to the first
`
`and second media player units, and a media recorder connected to the one or more
`
`interface converters and the second media player unit,” and for the similar
`
`limitation in claim 16, the corresponding structure “is the same except that the term
`
`‘audio’ is replaced with ‘music,’ a particular type of audio.” PO Response at 17. I
`
`was asked to consider whether all of the structures identified by Patent Owner are
`
`necessary for performing the claimed function.
`
`31. Both parties agree that the disclosed structure for performing the
`
`function of this limitation is illustrated in Figure 5. However, Figure 5
`
`encompasses structures for multiple disclosed embodiments, and
`
`includes
`
`structures not necessary for the claimed function. See e.g., Ex. 1001, ‘129 Patent
`
`
`
`17
`
`PETITIONERS EX. 1013 Page 17
`
`
`
`at 15:17-24. For example, in one embodiment the ‘129 Patent discloses
`
`prerecording control tracks by automatically deriving control signals from an
`
`original recording. See e.g., id. at 15:17-62. In another embodiment the ‘129
`
`Patent discloses a human operator prerecording a control track by creating control
`
`signals via input switches and/or a computer data storage device. See e.g., id. at
`
`15:17-24; 16:8-41.
`
`32. With respect to the one or more interface converters, it is my opinion
`
`that the need for a converter and the type of converter needed is dependent on the
`
`music source. The ‘129 Patent discloses several specific types of converters in
`
`addition to interface converters and discloses that a converter is only necessary to
`
`the extent that a music signal is received in analog form. Id. at 15:63-16:1; 16:56-
`
`61. A skilled artisan would understand that where a prerecorded control track is
`
`stored or initially provided in digital form, converters are not necessary. As such, it
`
`is my opinion that the interface converter is not necessary structure for performing
`
`the claimed function.
`
`33.
`
`In the embodiment depicted in Figure 5, where the control track is
`
`prerecorded automatically, the ‘129 Patent discloses the “original multitrack and
`
`two-track tape machines … can be replaced by any form of an audio source.” Id.
`
`at 20:26-35. Likewise, in the embodiment wherein the control track is prerecorded
`
`manually, the ‘129 Patent discloses that the input can be via “digital switches 150
`
`
`
`18
`
`PETITIONERS EX. 1013 Page 18
`
`
`
`or analog controls 160” or “via a disk drive 165 or other type of electronic data
`
`storage and retrieval mechanism or directly by a computer system.” Id. at 16:16-
`
`25. In the later case, “[s]uch information may be created in a multiple of ways
`
`including paint programs, 3D modeling programs, digitizing scanners and so on.”
`
`Id. at 16:22-27.
`
`34.
`
`It is my opinion that the only structure necessary for performing the
`
`function of “prerecording a control track having music/audio and/or control
`
`information corresponding to an music/audio signal” is an input, a general purpose
`
`computer, and a data storage device.
`
`E. means for producing the virtual environment in response to said
`prerecorded control track (claim 16)
`
`It is my understanding that the Board has not construed this claim
`
`35.
`
`limitation. I understand that the parties agree that the function is “producing the
`
`virtual environment in response to said prerecorded control track.” PO Response
`
`at 20; Petition at 10. I understand that Patent Owner contends that the structure
`
`necessary for performing this function is “a media player having signal outputs, a
`
`sound processor connected to one or more of the media player outputs, an audio
`
`amplifier connected to the sound processor, one or more tape IF converters
`
`connected to one or more of the media player outputs, a multichannel audio digital
`
`with serial output connected to one or more outputs of the media player, a
`
`microprocessor having inputs connected to the tape IF converters and programmed
`
`
`
`19
`
`PETITIONERS EX. 1013 Page 19
`
`
`
`to generate control signals.” PO Response at 20. I was asked to consider whether
`
`all of the structures identified by Patent Owner are necessary for performing the
`
`claimed function and, if not, what structure are necessary to perform this function.
`
`36. The ‘129 patent expressly discloses that the multichannel audio
`
`digitizer 245, sound processor 205, and audio amplifier 210 are all optional
`
`components for the system depicted in Figure 6. Ex. 1001, ‘129 patent at 19:20-22
`
`(“Sound processing equipment (such as sound processor 205 shown in FIG. 6) can
`
`optionally be connected between audio source 200 and amplifier 210.”); 19:15-19
`
`(“VR system 250 of FIG. 6 can play digitized music (e.g., generate original music),
`
`rather than merely routing digitized music from an external source (e.g., digitizer
`
`245 of FIG. 6).”); 17:13-22 (“The VR system receives three signals: … digitized
`
`audio signals 246 that digitally represent the original audio (which is typically
`
`music), and/or any other audio source desired, such as a live microphone 248.”);
`
`10:51-65 (disclosing that where “the VR computer has digital-to-analog audio
`
`capabilities,” an audio amplifier is unnecessary). As described by the ‘129 patent,
`
`a system that does not include these optional components, such as those depicted in
`
`Figures 1, 2, and 4, is still capable of producing the virtual environment in
`
`response to the prerecorded control track. Accordingly, it is my opinion that these
`
`components are not necessary for performing the claimed function.
`
`
`
`20
`
`PETITIONERS EX. 1013 Page 20
`
`
`
`37. The ‘129 patent also discloses that the system of Figure 6, which is “a
`
`principally analog device, [] can easily be implemented digitally, in alternative
`
`embodiments of the invention.” Id. at 20:32-34; see also id. at 10:59-61 (“a digital
`
`VR computer itself (e.g., VR system 250 of FIG. 6)”); 15:34-42 (“there are many
`
`forms of signal processing which can be used to derive this control signal … A
`
`variety of digital signal processing techniques and analog signal processing
`
`techniques may be used”); 19:14-18 (“VR system 250 of FIG. 6 can play digitized
`
`music … rather than merely routing digitized music from an external source (e.g.,
`
`digitizer 245 of FIG. 6).”). A skilled artisan would understand that where a
`
`prerecorded control track or control signal is stored or initially provided in digital
`
`form, converters and digitizers are not necessary. As such, it is my opinion that the
`
`tape IF converters and digitizer are not necessary structures for performing the
`
`claimed function.
`
`38. Likewise, a media player does not perform the function of this
`
`limitation. As illustrated in Figure 6, the four-track audio tape player 200 does not
`
`“produce the virtual environment,” rather it outputs “left and right audio signals
`
`200R and 200L, and control track signals 200X and 200Y consisting of data
`
`encoded as audio signals.” Ex. 1001, ‘129 Patent at 13:63-65.
`
`39.
`
`It is my opinion that the only structure necessary for performing the
`
`function of “producing the virtual environment in response to said prerecorded
`
`
`
`21
`
`PETITIONERS EX. 1013 Page 21
`
`
`
`control track” is a general purpose computer. Ex. 1001, ‘129 Patent at 1:48-51 (“A
`
`VR system which embodies the invention can … create, animate, or otherwise
`
`control … virtual environments and virtual objects … in response to prerecorded
`
`‘control tracks’ which correspond to audio signals (such as music).”); 8:41-44
`
`(“The control signals output from the analyze 5 are supplied through interface 6 to
`
`VR processor 7 for controlling generation