`
`
`
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`
`
`
`
`
`
`
`
`VOLKSWAGEN GROUP OF AMERICA, INC.,
`Petitioner
`
`v.
`
`ADVANCED SILICON TECHNOLOGIES, LLC,
`Patent Owner
`
`
`
`Case IPR2016-TBA
`Patent 8,933,945 B2
`
`
`
`
`DECLARATION OF DR. DONALD S. FUSSELL
`
`
`
`
`Mail Stop “PATENT BOARD”
`Patent Trial and Appeal Board
`U.S. Patent & Trademark Office
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Volkswagen 1003
`
`0001
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`I.
`
`TABLE OF CONTENTS
`QUALIFICATIONS ........................................................................................ 4
`A. Education ......................................................................................................... 5
`B. Professional Experience .................................................................................. 6
`II. MY UNDERSTANDING OF CLAIM CONSTRUCTION ......................... 11
`III. MY UNDERSTANDING OF OBVIOUSNESS ........................................... 11
`IV. LEVEL OF ORDINARY SKILL IN THE ART ........................................... 13
`V. OVERVIEW OF THE ’945 PATENT .......................................................... 14
`A. The ’945 patent alleges that conventional strip-based, screen partitioning
`resulted in poor load balance ......................................................................... 14
`B. The ’945 patent purports to have invented tile-based, screen partitioning ... 16
`VI. BACKGROUND OF THE TECHNOLOGIES DESCRIBED IN THE
`’945 PATENT ................................................................................................ 18
`A. Computer Graphics ........................................................................................ 19
`B. Miniaturization and Integration of Electronics .............................................. 25
`C. Screen Partitioning ......................................................................................... 27
`1. Furtner ...................................................................................................... 30
`2. Crockett .................................................................................................... 31
`3. Foley ......................................................................................................... 33
`4. Kelleher .................................................................................................... 34
`5. Perego ....................................................................................................... 37
`VII. CLAIM CONSTRUCTION .......................................................................... 39
`A. “memory controller” ...................................................................................... 39
`B. “scan converter” ............................................................................................ 42
`C. “graphics pipeline” ........................................................................................ 44
`VIII. THE COMBINATION OF NARAYANASWAMI AND GOVE ................ 49
`A. Overview of Narayanaswami ........................................................................ 49
`B. Overview of Gove .......................................................................................... 53
`C. Reasons that a POSITA would have combined Narayanaswami and Gove . 55
`D. Claim 1 ........................................................................................................... 59
`- i -
`
`
`
`0002
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`1. Both Narayanaswami and Gove disclose the preamble [1.P]. ................. 60
`2. The combination of Narayanaswami and Gove teaches the “at least
`two graphics pipelines” limitation [1.1]. ............................................. 60
`3. The combination of Narayanaswami and Gove teaches the “memory
`controller” limitation [1.2]. ................................................................. 71
`4. Narayanaswami discloses the “horizontally and vertically repeating
`pattern” limitation [1.3]. ..................................................................... 76
`E. Claim 21 ......................................................................................................... 79
`1. Both Narayanaswami and Gove disclose the preamble [21.P]. ............... 80
`2. The combination of Narayanaswami and Gove teaches “at least two
`graphics pipelines” limitation [21.1]. ................................................. 81
`3. Narayanaswami discloses the “horizontally and vertically repeating
`pattern” limitation [21.2] .................................................................... 81
`4. Narayanaswami discloses the “NxM” limitation [21.3]. .......................... 82
`5. The combination of Narayanaswami and Gove teaches the “memory
`controller” limitation [21.3]. ............................................................... 83
`F. Claim 9 ........................................................................................................... 84
`G. Claim 10 ......................................................................................................... 84
`IX. THE COMBINATION OF NARAYANASWAMI, GOVE, AND
`FOLEY........................................................................................................... 86
`A. Claim 2 ........................................................................................................... 86
`B. Claim 3 ........................................................................................................... 88
`C. Claim 4 ........................................................................................................... 88
`D. Claim 6 ........................................................................................................... 91
`E. Claim 7 ........................................................................................................... 93
`THE COMBINATION OF NARAYANASWAMI, GOVE, FOLEY,
`AND KELLEHER ......................................................................................... 94
`A. Claim 5 ........................................................................................................... 94
`B. Claim 8 ........................................................................................................... 99
`C. Claim 11 .......................................................................................................102
`XI. CONCLUSION ............................................................................................104
`
`X.
`
`
`
`- ii -
`
`0003
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`I, Dr. Donald S. Fussell, declare as follows:
`
`
`1.
`
`I have been retained as an expert witness by Sterne, Kessler,
`
`Goldstein & Fox PLLC to provide testimony on behalf of Volkswagen Group of
`
`America, Inc., for the above-captioned inter partes review proceeding. I
`
`understand that this proceeding involves U.S. Patent No. 8,933,945 (“’945
`
`patent”), entitled “Dividing Work Among Multiple Graphics Pipelines Using a
`
`Super-tiling Technique” by Mark M. Leather and Eric Demers. I understand that
`
`the ’945 patent is currently assigned to Advanced Silicon Technologies, LLC
`
`(“AST”).
`
`2.
`
`I understand that the ’945 patent was filed on June 12, 2003, and
`
`issued on January 13, 2015. I also understand that the ’945 patent claims priority to
`
`a provisional application (60/429,641) that was filed on November 27, 2002. For
`
`the purposes of this inter partes review, I assume that the November 27, 2002
`
`filing date of the provisional application is the earliest possible priority date of the
`
`’945 patent.
`
`3.
`
`I have reviewed and am familiar with the specification of the ’945
`
`patent. I understand that the ’945 patent has been provided as Exhibit 1001. I will
`
`cite to the specification using the following format (’945 patent, 1:1-10). This
`
`example citation points to the ’945 patent specification at column 1, lines 1-10.
`
`- 1 -
`
`0004
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`4.
`
`I have reviewed and am familiar with the file history of the ’945
`
`patent. I understand that the file history has been provided as Exhibit 1002.
`
`5.
`
`I have also reviewed and am familiar with the following prior art
`
`documents:
`
` U.S. Patent No. 6,778,177 to Furtner. I understand that Furtner has
`
`been provided as Exhibit 1004.
`
` U.S. Patent No. 5,794,016 to Kelleher. I understand that Kelleher has
`
`been provided as Exhibit 1005.
`
` U.S. Patent No. 6,864,896 to Perego. I understand that Perego has been
`
`provided as Exhibit 1006.
`
` U.S. Patent No. 5,408,606 to Eckart. I understand that Eckart has been
`
`provided as Exhibit 1007.
`
` U.S. Patent No. 5,757,385 to Narayanaswami et al.
`
`(“Narayanaswami”). I understand that Narayanaswami has been
`
`provided as Exhibit 1008.
`
` U.S. Patent No. 6,070,003 to Gove et al. (“Gove”). I understand that
`
`Narayanaswami has been provided as Exhibit 1009.
`
`- 2 -
`
`0005
`
`
`
`U.S. Patent No. 8,933,945 B2
`
` “Computer Graphics Principles and Practice,” Second Edition in C, by
`
`Foley et al. (“Foley”).1 I understand that Foley has been provided as
`
`Exhibit 1010.
`
` “3D Computer Graphics,” by Alan Watt (“Watt”).2 I understand that
`
`Watt has been provided as Exhibit 1011.
`
` “Multiprocessor Methods for Computer Graphics Rendering,” by Scott
`
`Whitman (“Whitman”). I understand that Whitman has been provided
`
`as Exhibit 1012.
`
` “Cramming more components onto integrated circuits,” by Gordon
`
`Moore (“Moore”). I understand that Moore has been provided as
`
`Exhibit 1013.
`
` “Miniaturization of electronics and its limits,” by R. W. Keyes
`
`(“Keyes”). I understand that Keyes has been provided as Exhibit 1014.
`
`
`1 I am very familiar with Foley. I use it as a supplemental text in the
`
`graduate-level computer graphics course that I teach.
`
`2 I am very also familiar with Watt. I use it as the main text in the graduate-
`
`level computer graphics course that I teach.
`
`- 3 -
`
`0006
`
`
`
`U.S. Patent No. 8,933,945 B2
`
` TMS320C80 Datasheet (“TMS320C80”). I understand that the
`
`TMS320C80 has been provided as Exhibit 1015.
`
`6.
`
`The ’945 patent “relates to graphics processing circuitry and, more
`
`particularly, to dividing graphics processing operations among multiple pipelines.”
`
`(’945 patent, 1:21-23.) I am familiar with the technology described in the ’945
`
`patent as of its earliest possible priority date (i.e., November 27, 2002).
`
`7.
`
`I have been asked to provide my technical review, analysis, insights
`
`and opinions regarding the ’945 patent and the above-noted references that form
`
`the basis for the grounds of unpatentability set forth in the Petition for inter partes
`
`Review that this Declaration supports.
`
`8.
`
`In forming the opinions expressed in this Declaration, I have relied
`
`upon my education and experience and the materials listed above, and I have
`
`considered and applied the viewpoint of a person of ordinary skill in the art
`
`(“POSITA”), as of November 27, 2002.
`
`I.
`
`QUALIFICATIONS
`9.
`
`I have over 38 years of experience in field of computer graphics.
`
`Since 1995, I have been the Trammell Crow Regents’ Professor in the Department
`
`of Computer Sciences at The University of Texas at Austin (“UT Austin”), where I
`
`am also a member of the Department of Electrical and Computer Engineering. I am
`
`- 4 -
`
`0007
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`currently the Director of the Laboratory for Real-time Graphics and Parallel
`
`Systems at UT Austin.
`
`10. As I will describe in more detail below, I have extensive experience in
`
`both academia and industry in computer graphics, computer hardware architecture,
`
`and computer software development. I am very familiar with the original assignee
`
`of the ’945 patent—ATI Technologies, ULC, as well as other companies that focus
`
`on computer graphics, such as NVIDIA Corporation. Indeed, many of the Ph.D.
`
`candidates that I have advised are working in the graphics industry.
`
`11.
`
`Before describing my professional experience, I will briefly discuss
`
`my formal education.
`
`A. Education
`
`12.
`
`In 1973, I received a BA in Mathematics and Social Science from
`
`Dartmouth College.
`
`13.
`
`In 1977, I received an MS degree in Computer Science (Mathematical
`
`Science) from the University of Texas at Dallas (“UT Dallas”).
`
`14.
`
`In 1980, I received a Ph.D. in Computer Science (Mathematical
`
`Science) from the University of Texas at Dallas.
`
`15.
`
`In my studies at UT Dallas, I took courses on Digital Logic Design
`
`and on Microprocessor-based Systems, and as a Research Assistant, I designed and
`
`- 5 -
`
`0008
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`built both the hardware and software for one of the world’s earliest experimental
`
`artificial reality systems. As a result of this early experience, I have always viewed
`
`computer systems design from the point of view of the interaction of hardware and
`
`software rather than concentrating only on one or the other.
`
`16. My formal education in mathematics and computer science provides a
`
`technical foundation for work in field of computer graphics. In describing my
`
`professional experience below, I focus on the activities and technologies that are
`
`most closely related to this proceeding. My Curriculum Vitae, which is attached as
`
`Appendix A, contains further details on my education, experience, publications,
`
`and other qualifications to render this opinion as an expert.
`
`B. Professional Experience
`
`17.
`
`I have been a professor at UT Austin since 1980. From 1980-1986, I
`
`was an Assistant Professor in the Department of Computer Sciences. From 1986-
`
`1994, I was an Associate Professor in the Department of Computer Sciences. And
`
`since 1995, I have been the Trammell Crow Regents’ Professor in the Department
`
`of Computer Sciences. I am also a member of the Department of Electrical and
`
`Computer Engineering at UT Austin. And, I am currently the Director of the
`
`Laboratory for Real-time Graphics and Parallel Systems at UT Austin.
`
`18. At UT Austin, I have taught and continue to teach graduate and
`
`undergraduate courses in computer graphics, computer game technology, computer
`
`- 6 -
`
`0009
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`organization and architecture, computer systems architecture, and computer
`
`organization and programming.
`
`19.
`
`For example, I taught CS354 – Computer Graphics in the Fall 2015
`
`semester. This undergraduate-level course is an introductory course on the major
`
`topics in the areas of image synthesis, interactive techniques, geometric modeling,
`
`and computer-based animation. It covers numerous topics in computer graphics,
`
`including OpenGL programming, the principles of operation of raster graphics
`
`systems, graphics processing operations (e.g., sampling and antialiasing,
`
`coordinate transformation techniques, hidden surface removal, shading techniques,
`
`etc.), basic animation, as well as other topics.
`
`20. As another example, I am teaching CS384G – Computer Graphics in
`
`the Spring 2016 semester. This is a graduate-level course that covers numerous
`
`topics in computer graphics, including (but not limited to): displays and frame
`
`buffers; sampling theory and antialiasing; image processing; shading; ray tracing;
`
`texture mapping; OpenGL and the OpenGL graphics pipeline; and graphics
`
`hardware. As I mentioned above, I use Watt as the main text in this course, and
`
`Foley as a supplemental text.
`
`21. As a Professor, I also perform research. My research is focused on
`
`computer graphics, computer architecture, computer systems, and computer game
`
`- 7 -
`
`0010
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`technology. My research often leads to publications. My Curriculum Vitae, which
`
`is attached as Appendix A, lists over 100 published papers that I have authored or
`
`co-authored.
`
`22.
`
`Shortly after my arrival at UT Austin in 1980, I started the first
`
`research and teaching program on very large scale integration (“VLSI”) system
`
`design at the university. I developed a popular course on VLSI design that was
`
`taken by many students in both the CS and ECE departments. I supervised a
`
`number of Masters and Ph.D. students in the area, both in ECE and CS, and was
`
`given an appointment in the ECE department to facilitate these efforts. We
`
`designed and fabricated a number of chips as part of the teaching effort, and
`
`published a number of papers on the design and analysis of VLSI systems in the
`
`research effort (Vita: Conference papers 5-22 (except 7), 24, 25, 27, 30, 33-38
`
`Journals: 3, 6, 7, 9, 12-14, 16-18, 20, 21). Conference paper 6 (“A VLSI-oriented
`
`Architecture for Real-time Raster Display of Shaded Polygons”), in particular, was
`
`an early proposal for a parallel graphics architecture. I also led the first
`
`microprocessor design research effort at the university, which culminated in an
`
`early general-purpose multithreaded processor, described in Vita conference paper
`
`34. Multithreading is now a key feature of modern GPUs. More recently, I have
`
`been involved in research aimed at improving memory systems in GPUs (Vita
`
`conference papers 89, 90).
`
`- 8 -
`
`0011
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`23.
`
`In addition to my academic and research experience, I served as a
`
`technical consultant for many different companies, including: Austin Ventures,
`
`Inc.; Motorola, Inc.; Cirrus Logic, Inc.; IBM Corporation; Ross Technology, Inc.;
`
`AT&T Bell Laboratories; McGinnis, Lockridge and Kilgore; Bausch and Lomb;
`
`and V-R Information Systems. I have also worked in research and development for
`
`two startup companies, including founding Infovision, Inc., a startup company
`
`directed toward developing turnkey interactive CAD systems, and working as
`
`Chief Science Officer for Matrix.Net, Inc., an Internet infrastructure startup
`
`company.
`
`24.
`
`In these positions, I have worked extensively with the design,
`
`development, and evaluation of computer graphics software and systems. For
`
`example, I have evaluated industrial designs for high-performance graphics display
`
`subsystems and early display architectures for commodity computers. Below, I list
`
`a few examples of the industry experiences that I gained in computer graphics in
`
`the late 1980s and 1990s—the time period leading up to the filing of the ’945
`
`patent.
`
`25.
`
`In 1994 I was contracted by Cirrus Logic to evaluate one of the first
`
`commodity 3-D graphics accelerators for PCs. This chip had been designed by an
`
`Austin-based startup (Ausgraph) and a prototype had been demonstrated at the
`
`Consumer Electronics Show. At the time, Cirrus was the largest volume supplier of
`
`- 9 -
`
`0012
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`2D graphics accelerators for PCs and was contemplating the purchase of Ausgraph
`
`to jump start a move into the then-nonexistent 3D PC accelerator market. Based in
`
`part on my evaluation, the purchase was made and Ausgraph became Cirrus Logic
`
`3D division. After much evolution, this group was sold to 3DFX and then to
`
`NVIDIA, and is the distant ancestor of the NVIDIA Austin office.
`
`26. As a visiting researcher at Bell Laboratories, I worked with several
`
`members of technical staff on the architecture of a high-performance parallel
`
`machine for real-time interactive display of solid models. Such models differ from
`
`the more common surface models used in computer graphics in that the objects are
`
`modeled as solid objects. As a result, they can be modified in ways more similar to
`
`real world objects, for example by having holes drilled through them. Our machine
`
`was designed to allow these objects to be moved and to interact with each other
`
`and the viewer in real time and thus did not simply involve real time display.
`
`27. My Curriculum Vitae (attached as Appendix A) contains further
`
`details on my education, experience, publications, and other qualifications to
`
`render this opinion as an expert. My work on this case is being billed at a rate of
`
`$500.00 per hour, with reimbursement for actual expenses. My compensation is
`
`not contingent upon the outcome of this inter partes review.
`
`- 10 -
`
`0013
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`II. MY UNDERSTANDING OF CLAIM CONSTRUCTION
`
`28.
`
`I understand that, during an inter partes review, claims are to be given
`
`their broadest reasonable construction in light of the specification as would be read
`
`by a person of ordinary skill in the relevant art.
`
`III. MY UNDERSTANDING OF OBVIOUSNESS
`29.
`I am not a lawyer and will not provide any legal opinions. Although I
`
`am not a lawyer, I have been advised certain legal standards are to be applied by
`
`technical experts in forming opinions regarding meaning and validity of patent
`
`claims.
`
`30.
`
`I understand that a patent claim is invalid if the claimed invention
`
`would have been obvious to a person of ordinary skill in the field at the time of the
`
`purported invention, which is often considered the time the application was filed.
`
`This means that even if all of the requirements of the claim cannot be found in a
`
`single prior art reference that would anticipate the claim, the claim can still be
`
`invalid.
`
`31. As part of this inquiry, I have been asked to consider the level of
`
`ordinary skill in the field that someone would have had at the time the claimed
`
`invention was made. In deciding the level of ordinary skill, I considered the
`
`following:
`
`- 11 -
`
`0014
`
`
`
` the levels of education and experience of persons working in the field;
`
`U.S. Patent No. 8,933,945 B2
`
` the types of problems encountered in the field; and
`
` the sophistication of the technology.
`
`32.
`
`To obtain a patent, a claimed invention must have, as of the priority
`
`date, been nonobvious in view of the prior art in the field. I understand that an
`
`invention is obvious when the differences between the subject matter sought to be
`
`patented and the prior art are such that the subject matter as a whole would have
`
`been obvious at the time of the invention to a person having ordinary skill in the
`
`art.
`
`33.
`
`I understand that to prove that prior art or a combination of prior art
`
`renders a patent obvious, it is necessary to (1) identify the particular references
`
`that, singly or in combination, make the patent obvious; (2) specifically identify
`
`which elements of the patent claim appear in each of the asserted references; and
`
`(3) explain how the prior art references could have been combined in order to
`
`create the inventions claimed in the asserted claim.
`
`34.
`
`I understand that certain objective indicia can be important evidence
`
`regarding whether a patent is obvious or nonobvious. Such indicia include:
`
`commercial success of products covered by the patent claims; a long-felt need for
`
`the invention; failed attempts by others to make the invention; copying of the
`
`- 12 -
`
`0015
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`invention by others in the field; unexpected results achieved by the invention as
`
`compared to the closest prior art; praise of the invention by the infringer or others
`
`in the field; the taking of licenses under the patent by others; expressions of
`
`surprise by experts and those skilled in the art at the making of the invention; and
`
`the patentee proceeded contrary to the accepted wisdom of the prior art.
`
`IV. LEVEL OF ORDINARY SKILL IN THE ART
`
`35. A person of ordinary skill in the art (“POSITA”) at the time of the
`
`earliest possible priority date of the ’945 patent (i.e., November 27, 2002) would
`
`have at least the equivalent of a Bachelor of Science (“B.S.”) degree in Electrical
`
`or Computer Engineering, at least four years of experience in the field of computer
`
`hardware architecture research or development, and a familiarity with computer
`
`graphics. Experience could take the place of some formal training, as domain
`
`knowledge may be learned on the job. This description is approximate, and a
`
`higher level of education or skill might make up for less experience and vice versa.
`
`36.
`
`I am well qualified to determine the level of ordinary skill in the art.
`
`First, I am personally very familiar with the technology of the ’945 patent in the
`
`November 2002 timeframe. By 2002, I had completed my formal education and
`
`had been working in academia and as an industry consultant for more than 20
`
`years. As a Professor, I have supervised, advised, and taught individuals at all
`
`- 13 -
`
`0016
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`levels of training in the relevant field. And as a technical consultant, I have worked
`
`with individuals in industry at all levels of training in the relevant field.
`
`V. OVERVIEW OF THE ’945 PATENT
`
`A. The ’945 patent alleges that conventional strip-based, screen
`partitioning resulted in poor load balance
`
`37.
`
`The ’945 patent “relates to graphics processing circuitry and, more
`
`particularly, to dividing graphics processing operations among multiple pipelines.”
`
`(’945 patent, 1:21-23.) It concedes that conventional “graphics processing systems
`
`typically include a host processor, graphics (including video) processing circuitry,
`
`memory (e.g. frame buffer), and one or more display devices.” (Id. at 1:26-30.)
`
`The graphics processing circuitry generates pixel data, which is presented as an
`
`object or a scene on the display screen. (Id. at 1:26-43.) This “pixel data is
`
`typically stored in the frame buffer in a manner that corresponds to the pixels
`
`location on the display device.” (Id. at 1:41-43.)
`
`38.
`
`The ’945 patent concedes that prior art graphics processing systems
`
`typically divided the processing workload among several graphics processing
`
`circuits to decrease processing time. (Id. at 1:44-60, 2:5-14.) One conventional
`
`technique partitioned the display screen into horizontal or vertical strips (“strip-
`
`based, screen partitioning”), and assigned different graphics processing circuits to
`
`generate the pixels in different strips. (Id.) But the ’945 patent asserts that strip-
`
`- 14 -
`
`0017
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`based, screen partitioning suffered from load balance problems. (Id. at 2:15-26.)
`
`That is, the processing workload was not always evenly distributed among the
`
`circuits. (Id.)
`
`39.
`
`FIG. 1 of the ’945 patent (reproduced below) illustrates a
`
`conventional strip-based, screen partitioning technique. Here, the display screen is
`
`partitioned into a series of vertical strips. (’945 patent, 1:44-51.) Different graphics
`
`processing circuits are responsible for processing different strips. (Id. at 2:5-14.)
`
`“[F]or example, one graphics processing circuit is responsible for one vertical strip
`
`(e.g. 13) of the frame while another graphics processing circuit is responsible for
`
`another vertical strip (e.g. 14) of the frame.” (Id.)
`
`
`
`- 15 -
`
`0018
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`40.
`
`The ’945 patent alleges that this screen partitioning technique resulted
`
`in a poor load balance “when all of the primitives 20-23 of a particular object or
`
`scene are located in one strip (e.g. strip 13 [of FIG. 1]).” (Id. at 2:15-16.) “When
`
`this occurs, only the graphics processing circuit responsible [for] strip 13 is
`
`actively processing primitives; the remaining graphics processing circuits are idle.”
`
`(Id. at 2:19-26.) According to the ’945 patent, “[t]his results in a significant waste
`
`of processing resources as at most only half of the graphics processing circuits are
`
`operating. Consequently, graphics processing system performance is decreased as
`
`the system is only operating at a maximum of fifty percent capacity.” (Id.) The
`
`’945 patent thus sought to overcome this load balancing problem that it associates
`
`with strip-based, screen partitioning.
`
`B. The ’945 patent purports to have invented tile-based, screen
`partitioning
`
`41.
`
`The ’945 patent purports to have invented tile-based, screen
`
`partitioning, which allegedly achieves better load balance than the prior art strip-
`
`based, screen partitioning. (’945 patent, 3:21-31.) As shown in FIGS. 2 and 3 of
`
`the ’945 patent, the specification describes a graphics processing circuit (labeled
`
`“34”) that includes at least two graphics pipelines (labeled “101” and “102”) and a
`
`memory controller (labeled “46”) that couples the pipelines to a graphics memory
`
`or frame buffer (labeled “48”). (Id. at 3:21-31; 4:5-12, 5:37-65, FIG. 2.) FIG. 2 is
`
`- 16 -
`
`0019
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`reproduced in-part and annotated below. FIG. 3 is reproduced and annotated
`
`below.
`
`FIG. 2 (in-part, annotated)
`
`FIG. 3 (annotated)
`
`42.
`
`FIG. 3 of the ’945 patent depicts the frame buffer. (Id. at 5:45-65.) It
`
`is partitioned into regions or tiles, which correspond to regions of the display
`
`screen. (Id.) The graphics pipelines are assigned to process the graphics data in
`
`certain tiles—the pipeline labeled “101” processes the graphics data in the “A”
`
`tiles (shown in red); the pipeline labeled “102” processes the data in the “B” tiles
`
`(shown in blue). (Id.) As shown by the color coding above, this assignment of
`
`pipelines to tiles forms a repeating tile pattern. (Id.) According to the ’945 patent,
`
`- 17 -
`
`0020
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`this tiling technique allegedly achieves better load balance than prior art
`
`techniques, such as the strip-based, screen partitioning. (Id. at 1:44-2:26, 3:21-31.)
`
`VI. BACKGROUND OF THE TECHNOLOGIES DESCRIBED IN THE
`’945 PATENT
`43.
`
`The inventors of the ’945 patent did not invent tile-based, screen
`
`partitioning. Nor did they invent the concept of load balancing among graphics
`
`pipelines. Instead, the graphics processing circuitry and techniques described in the
`
`’945 patent rely on elements and methods that were well known long before
`
`November 2002.
`
`44.
`
`To begin with, the ’945 patent concedes that conventional “graphics
`
`processing systems typically include a host processor, graphics (including video)
`
`processing circuitry, memory (e.g. frame buffer), and one or more display
`
`devices.” (’945 patent, 1:26-30.) It also admits that strip-based, screen partitioning
`
`was known. (1:44-60, 2:5-26.) As I discuss in more detail below, at the time of the
`
`alleged invention, tile-based, screen partitioning was a well-known and obvious
`
`alternative to of strip-based, screen partitioning. Indeed, I note that several
`
`references cited during the prosecution of the ’945 patent teach tile-based, screen
`
`partitioning in a graphics processing system.
`
`45.
`
`Thus, the ’945 patent relies on a variety of known graphics processing
`
`techniques, structures, and/or methods. Below, I provide a general overview of
`
`- 18 -
`
`0021
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`computer graphics and the graphics pipeline at or before the time of the alleged
`
`invention, and then discuss screen partitioning and load balancing at or before the
`
`time of the alleged invention (including several references that were cited or
`
`applied during the ’945 patent’s prosecution).
`
`A. Computer Graphics
`
`46.
`
`In general, computer graphics is concerned with displaying
`
`information from an application in graphical form on a computer or display. In the
`
`text “Computer Graphics Principles and Practice,” Foley et al. (which I’ll just
`
`refer to as “Foley”) explained that “[c]omputer graphics concerns the pictorial
`
`synthesis of real or imaginary objects from their computer-based models . . . .”
`
`(Foley, 0026; see also id. at 0027-32 (describing advantages and representative
`
`uses of computer graphics).) Similarly Watt, in his text “3D Computer Graphics,”
`
`described computer graphics as “the process involved in converting a mathematical
`
`or geometric description of an object – a computer graphics model – into a
`
`visualization – a two-dimensional projection – that simulates the appearance of a
`
`real object.” (Watt, 0016.)
`
`47.
`
`Fig. 1.5 of Foley, which I reproduced below, illustrates a conceptual
`
`frame work for interactive graphics. (Foley, 0041; see also Watt, 0017 (depicting a
`
`similar graphics system).) The application model includes information that can be
`
`displayed graphically. (Foley, 0041.) The application program, which in my
`
`- 19 -
`
`0022
`
`
`
`U.S. Patent No. 8,933,945 B2
`
`experience is typically executing on a central processing unit (CPU), reads
`
`information from the application model and provides directives to the graphics
`
`system, which processes the information and updates the display. (Id.) The purpose
`
`of the graphics system is to offload graphical operations from the application
`
`program. (Id.)
`
`
`
`(Foley at 0041.)
`
`48.
`
`T