PTO/SB/122 (11-08)
`Approvedfor use through 11/30/2011. OMB 0651-0035
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respondto a collection of information unlessit displays a valid OMB control number.
`
`
`
`
`CHANGE OF
`
`
`
`CORRESPONDENCE ADDRESS
`
`
`
`
`
`
`Addressto:
`Art Unit
`Commissioner for Patents
`
`
`
`P.O. Box 1450
`
`
`
`Alexandria, VA 22313-1450
`
`
`
`
`
`Examiner Name
`
`Please change the Correspondence Address for the above-identified patent application to:
`The address associated with
`Customer Number:
`
`29153
`
`OR
`
`Firm or
`Individual Name
`
`Address
`
`
`
`Country
`
`
`
`Telephone
`
`This form cannot be used to change the data associated with a Customer Number. To change the
`data associated with an existing Customer Number use “Request for Customer Number Data Change” (PTO/SB/124).
`lam the:
`
`
`
`Applicant/Inventor
`
`Assignee of record of the entire interest.
`Statement under 37 CFR 3.73(b) is enclosed. (Form PTO/SB/96).
`
`Attorney or agent of record. Registration Number 34.414
`
`Registered practitioner namedin the application transmittal letter in an application without an
`executed oath or declaration. See 37 CFR 1.33(a)(1). Registration Number.
`
`/Christopher J. Reckamp/
`Signature
`Typed or Printed
`.
`Name
`Ghristopher J. Reckamp
`
`Date May 17,2011 Telephone. 15609-7599
`NOTE: Signaturesofall the inventors or assigneesof record of the entire interestor their representative(s) are required. Submit multiple
`forms if more than one signatureis required, see below".
`
`*Total of 4
`
`forms are submitted.
`
`This collection of information is required by 37 CFR 1.33. The information is required to obtain or retain a benefit by the public whichistofile (and by the USPTO
`to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 3 minutes to complete,
`including gathering, preparing, and submitting the completed application form to the USPTO.Timewill vary depending upon the individual case. Any comments on
`the amountof time you require to complete this form and/or suggestionsfor reducing this burden, should be sentto the Chief Information Officer, U.S. Patent and
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS
`ADDRESS. SEND TO: Commissionorfor Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`ifyou need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`LG Ex. 1002
`LG v. ATI
`IPR2017-01225
`
`LG Ex. 1002, pg 1
`
`LG Ex. 1002, pg 1
`
`LG Ex. 1002
`LG v. ATI
`IPR2017-01225
`
`

`

`PTO/SB/14 (11-08)
`Approved for use through 09/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`cat
`Application Data Sheet 37 CFR 1.76
`Application Number
`
`Title of Invention|GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`The application data sheetis part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arrangedin a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paper filed application.
`
`Secrecy Order 37 CFR 5.2
`
`[_]
`Portionsorall of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuantto
`
`37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may notbefiled electronically.)
`
`
`
`Applicant Information:
`
`Applicant 1
`Applicant Authority @/nventor|()Legal Representative under 35 U.S.C. 117 CParty ofInterest under 35 U.S.C. 118
`
`Prefix} Given Name Family Name Middle Name
`
`
`
`Stephen
`L.
`Morein
`
`
`(©) Active USner Service
`(@) US Residency ~ Non US Residency
`Residence Information (Select One)
`Cambridge
`State/Province
`Country of Residence i
`SicersipnrTERIA[UE
`Mailing Address of Applicant.
`
`
`Address 1
`10 Magazine
`
`Address 2
`
`Apt. 801
`
`Applicant2
`
`
`Applicant Authority (@)Inventor|()Legal Representative under 35 U.S.C. 117 C)Party ofInterest under 35 U.S.C. 118
`
`
`
`Laurent Lefebvre
`
`
`Residence Information (Select One) ©) US Residency
`(@) NonUS Residency
`(©) Active US Military Service
`Lachgnaie
`Country Of Residencei
`
`
`
`Citizenship under 37 CFR 1.41{b}i
`
`Mailing Address of Applicant:
`Address 1
`124 Parenchere
`
`Postal Code
`JeW 6A5
`Countryi
`
`
`Applicant 3
`
`Applicant Authority @!/nventor|(Legal Representative under 35 U.S.C. 117 ©)Partyof Interest under 35 U.S.C. 118
`
`Prefix} Given Name
`Middle Name
`Family Name
`Andrew
`E.
`Gruber
`
`Residence Information (Select One)
`(@) US Residency
`©) NonUSResidency
`() Active US Military Service
`
`
`
`City|Arlington State/Province|MA Country of Residencei|US
`
`EFS Web 2.2.2
`
`LG Ex. 1002, pg 2
`
`LG Ex. 1002, pg 2
`
`

`

`PTO/SB/14 (11-08)
`Approved for use through 09/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number|00100.36.0001
`Application Data Sheet 37 CFR 1.76
`—
`Application Number
`
`Title of Invention|GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`Mailing Address of Applicant:
`Address 1
`215 Pleasant Street
`
`
`Address 2
`
`
`Arlington
`
`State/Province
`
`
`
`Applicant4
`
`
`Applicant Authority (Inventor|()Legal Representative under 35 U.S.C. 117 Partyof Interest under 35 U.S.C. 118
`
`Skende
`Andi
`
`
`ResidenceInformation (Select One)
`Shrewsbury
`
`(@) US Residency
`State/Province
`
`(©) Active US Military Service
`©) NonUS Residency
`Country of Residence i
`
`Citizenship under 37 CFR 1.41{b}i
`Mailing Address of Applicant:
`
`Us
`
`Address 1
`
`49 Sheridan Drive, #11
`
`
`City
`Shrewsbury
`State/Province
`
`Postal Code | 01545 Countryi | Us
`
`
`
`
`All
`Inventors Must Be Listed - Additional
`Inventor Information blocks may be
`
`generated within this form by selecting the Add button. A“
`
`Correspondence Information:
`
`Enter either Customer Number or complete the CorrespondenceInformation section below.
`
`For further information see 37 CFR 1.33(a). [_] An Addressis being provided for the correspondenceInformation of this application.
`
`Email Address
`creckamp@vedderprice.com
`|
`Add Email
`
`Customer Number
`
`29153
`
`Application Information:
`
`GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`Title of the Invention
`
`
`Suggested Figure for Publication (if any}
`
`
`
`Attorney Docket Number| 00100.36.0001 Small Entity Status Claimed [|
`
`
`
`
`
`Application Type
`
`Nonprovisional
`
`Subject Matter
`
`Utility
`
`Suggested Class (if any)
`
`Suggested Technology Center (if any)
`
`Total Number of Drawing Sheets {if any)
`
`EFS Web 2.2.2
`
`LG Ex. 1002, pg 3
`
`LG Ex. 1002, pg 3
`
`

`

`PTO/SB/14 (11-08)
`Approved for use through 09/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Attorney Docket Number|00100.36.0001
`Application Data Sheet 37 CFR 1.76
`Application Number
`
`Title of Invention|GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`eighteen monthsafterfiling.
`
`Publication Information:
`
`
`[_] Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Request Not to Publish. | hereby requestthat the attached application not be published under 35 U.S.
`C. 122(b} and certify that the invention disclosed in the attached application has not and will not be the subject of
`an application filed in another country, or under a multilateral international agreement, that requires publication at
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a powerof attorney in the application (see 37 CFR 1.32).
`
`
`
`
`
`
`Enter Representative Name_sectioneither Customer Number or complete the below. If both sections
`
`
`are completed the Customer Numberwill be used for the Representative Information during processing.
`
`
`
`
`Please Select One: (e) Customer Number | ©) US PatentPractitioner ©) Limited Recognition (37 CFR 11.9)
`
`
`
`
`Customer Number 29153
`
`
`
`Domestic Benefit/National Stage Information:
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, or 365(c) or indicate National Stage
`entry from a PCTapplication. Providing this information in the application data sheet constitutes the specific reference required by
`35 U.S.C. 119{e) or 120, and 37 CFR 1.78{a)(2) or CFR 1.78(a}(4), and need not otherwise be made part of the specification.
`
`
`
`Prior Application Status|Pending
`
`Application Number
`
`Continuity Type
`Continuation of
`
`Prior Application Number
`12791597
`
`Filing Date (YYYY-MM-DD}
`2010-06-01
`
`Additional Domestic Benefit/National Stage Data may be generated within this form
`
`by selecting the Add button. Aa
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim benefit of foreign priority and to identify any prior foreign application for which priority is
`not claimed. Providing this information in the application data sheet constitutes the claim for priority as required by 35 U.S.C. 119{b)
`
`and 37 CFR 1.55{a).
`
`Application Number
`Country i
`ParentFiling Date (YYYY-MM-DD}
`Priority Claimed
`
`© Yes © No
`Add
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`
`
`
`
`Assignee Information:
`
`Providing this information in the application data sheet does not substitute for compliance with any requirementof part 3 of Title 37
`of the CFR to have an assignmentrecordedin the Office.
`
`Assignee 1
`
`EFS Web 2.2.2
`
`LG Ex. 1002, pg 4
`
`LG Ex. 1002, pg 4
`
`

`

`PTO/SB/14 (11-08)
`Approved for use through 09/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Attorney Docket Number|00100.36.0001
`Application Data Sheet 37 CFR 1.76
`Application Number
`
`Title of Invention|GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`If the Assignee is an Organization check here.
`
`Organization Name
`
`ATI Technologies ULC
`
`Mailing Address Information:
`
`Address 1
`
`1 Commerce Valley Drive East
`
`Address 2
`
`
`fciy«idthom——SSC«dSterovinceNCS
`
`
`
`
`
`
`
`[PhoneNumber—__[eosamzaewosfFaxNumbor|
`
`Additional Assignee Data may be generated within this form by selecting the Add
`button.
`
`Signature:
`
`A signature of the applicant or representative is required in accordance with 37 CFR 1.33 and 10.18. Please see 37
`
`CFR 1.4(d) for the form of the signature.
`
`
`Signature=|/Christopher J. Reckamp/ Date (YYYY-MM-DD)| 2011-05-17
`
`
`
`
`
`
`
`First Name|Christopher Last Name|Reckamp Registration Number|34414
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amountof time you require to
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`EFS Web 2.2.2
`
`LG Ex. 1002, pg 5
`
`LG Ex. 1002, pg 5
`
`

`

`Privacy Act Statement
`
`
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to
`a patent application or patent. Accordingly, pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the collection
`of this information is 35 U.S.C. 2(b)(2}; (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is
`used by the U.S. Patent and Trademark Office is to process and/or examine your submission related to a patent application or patent.
`If you do not
`furnish the requested information, the U.S. Patent and Trademark Office may not be able to process and/or examine your submission, which may
`result in termination of proceedings or abandonmentof the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1.
`
`2.
`
`3.
`
`4.
`
`5.
`
`6.
`
`7.
`
`8.
`
`9.
`
`The information on this form will be treated confidentially to the extent allowed under the Freedom ofInformation Act (5 U.S.C. 552)
`and the Privacy Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Departmentof Justice to determine
`whether the Freedom of Information Act requires disclosure of these records.
`
`A record from this system of records may be disclosed, as a routine use, in the course of presenting evidence te a court, magistrate, or
`administrative tribunal, including disclosures to opposing counsel in the course of settlement negctiations.
`
`A recordin this system of records may be disclosed, as a routine use, to a Memberof Congress submitting a request involving an
`individual, to whom the record pertains, whenthe individual has requested assistance from the Memberwith respect to the subject matter of
`the record.
`
`A recordin this system of records may be disclosed, as a routine use, to a contractor of the Agency having need for the information in
`order to perform a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`
`A record related to an International Application filed under the Patent Cooperation Treaty in this system of records maybe disclosed,
`as a routine use, to the International Bureau of the World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`
`A recordin this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security
`review (35 U.S.C. 181) and for review pursuant to the Atomic Energy Act (42 U.S.C. 218(c)).
`
`A record from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or his/her designee,
`during an inspection of records conducted by GSA aspart of that agency's responsibility to recommend improvementsin records
`managementpractices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the
`GSA regulations governing inspection of records for this purpose, and any otherrelevant (i.e., GSA or Commerce)directive. Such
`disclosure shall not be used to make determinations aboutindividuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public after either publication of the application pursuan
`to 35 U.S.C. 122(b) or issuance of a patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record wasfiled in an application which became abandoned or in which the proceedings were
`terminated and which application is referenced by either a published application, an application open to public inspections or an issued
`patent.
`
`A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local law enforcement agency,if the
`USPTO becomes aware of a violation or potential violation of law or regulation.
`
`
`EFS Web 2.2.2
`
`LG Ex. 1002, pg 6
`
`LG Ex. 1002, pg 6
`
`

`

`
`
`Electronic Patent Application Fee Transmittal
`
`Title of Invention:
`
`GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`First Named Inventor/Applicant Name: Stephen L. Morein
`
`Filer:
`
`Christopher J. Reckamp/Christine Wright
`
`Filed as Large Entity
`
`Utility under 35 USC 111(a)Filing Fees
`
`Description
`
`Fee Code
`
`Sub-Total in
`USD($)
`
`
`
`Quantity
`
`Claims:
`
`Independent Claimsin excess of
`
`el
`
`Miscellaneous-Filing:
`
`LG Ex. 1002, pg 7
`
`LG Ex. 1002, pg 7
`
`

`

`
`
`
`
`Sub-Total in
`Fee Code Quantity AmountDescription USD(S)
`
`1970
`
`
`
`
`
`Patent-Appeals-and-Interference:
`
`Post-Allowance-and-Post-Issuance:
`
`Extension-of-Time:
`
`Miscellaneous:
`
`
`Total in USD ($)
`
`LG Ex. 1002, pg 8
`
`LG Ex. 1002, pg 8
`
`

`

`Electronic Acknowledgement Receipt
`
`10111290
`
`Confirmation Number:
`
`
`
`
`Title of Invention:
`
`GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`
`
`First Named Inventor/Applicant Name:
`
`Stephen L. Morein
`
`Customer Number:
`
`29153
`
`re Christopher Reckemp/ChristineNeigh
`
`
`
`Filer Authorized By: Christopher J, Reckamp
`
`Attorney Docket Number:
`
`00100,36.0001
`
`17:29:16
`Time Stamp:
`
`
`
`
`Application Type: Utility under 35 USC 111(a)
`
`Paymentinformation:
`
`Submitted with Payment
`Payment Type Deposit Account
`
`
`
`Payment was successfully received in RAM
`
`$1970
`
`Charge any Additional Fees required under 37 C.F.R. Section 1.17 (Patent application and reexamination processing fees)
`
`Deposit Account
`
`220259
`
`The Director of the USPTO is hereby authorized to charge indicated fees and credit any overpayment as follows:
`Charge any Additional Fees required under 37 C.F.R. Section 1.16 (National application filing, search, and examination fees)
`
`LG Ex. 1002, pg 9
`
`LG Ex. 1002, pg 9
`
`

`

`Charge any Additional Fees required under 37 C.F.R. Section 1.19 (Document supply fees)
`
`Charge any Additional Fees required under 37 C.F.R. Section 1.20 (Post Issuance fees)
`
`Charge any Additional Fees required under 37 C.F.R. Section 1.21 (Miscellaneous fees and charges)
`
`
`
`File Size(Bytes)/
`
`Multi
`
`Pages
`
`
`
`Warnings:
`
`DocumentDescription|Flee Message Digest|Part/.zip| (ifappl.)
`
`Document
`Number
`
`ar
`
`360001_Application.pdf
`5a2195ef350dfe96b37393d43d086ca74d1
`5a3al
`
`Multipart Description/PDF files in .zip description
`
`DocumentDescription
`
`Specification
`
`
`76/96
`
`Claims
`
`Abstract
`
`
`Warnings:
`
`Information:
`
`Information:
`
`Drawings-only black and white line
`drawings
`
`360001_Drawings.pdf
`
`Oath or Declaration filed
`
`360001_Declaration.pdf
`
`100418
`
`Jebabc9ced844U9aeed203093 16318as/b/d
`231f2
`
`1711262
`
`160347 19fh41ea9046049572663017]
`96b4e
`
`Change of Address
`
`360001_Change.pdf
`
`acc3Ual0S 193121879d529dab536dbed6:
`aesde
`
`Information:
`
`
`Application Data Sheet
`
`360001_ADS.pdf
`
`1032318
`
`0457161¢63792567d97d461 3dade7a99db}
`6d9934
`
`
`Warnings:
`Information:
`
`Fee Worksheet (PTO-875)
`fee-info.pdf
`9542301 783d22714df47076295ef00<937.
`37ec
`
`36605
`
`LG Ex. 1002, pg 10
`
`LG Ex. 1002, pg 10
`
`

`

`Information:
`
`
`
`Total Files Size (in bytes) 3009427
`
`This AcknowledgementReceipt evidences receipt on the noted date by the USPTO ofthe indicated documents,
`characterized by the applicant, and including page counts, where applicable. It serves as evidence of receipt similar toa
`Post Card, as described in MPEP 503.
`
`the application.
`
`New International Application Filed with the USPTO as a Receiving Office
`If a new international application is being filed and the international application includes the necessary componentsfor
`an international filing date (see PCT Article 11 and MPEP 1810), a Notification of the International Application Number
`and of the International Filing Date (Form PCT/RO/105)will be issued in due course, subject to prescriptions concerning
`national security, and the date shown on this Acknowledgement Receiptwill establish the international filing date of
`
`New Applications Under 35 U.S.C. 111
`If a new application is being filed and the application includes the necessary componentsfor a filing date (see 37 CFR
`1.53(b)-(d) and MPEP 506), a Filing Receipt (37 CFR 1.54) will be issued in due course and the date shownon this
`Acknowledgement Receiptwill establish thefiling date of the application.
`
`National Stage of an International Application under 35 U.S.C. 371
`If a timely submission to enter the national stage of an international application is compliant with the conditions of 35
`U.S.C. 371 and other applicable requirements a Form PCT/DO/EO/903indicating acceptanceof the application as a
`national stage submission under 35 U.S.C. 371 will be issued in addition to the Filing Receipt, in due course.
`
`LG Ex. 1002, pg 11
`
`LG Ex. 1002, pg 11
`
`

`

`GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER
`
`RELATED APPLICATIONS
`
`[0001]
`
`This application is a continuation of co-pending U.S. Application Serial No.
`
`12/791,597,
`
`filed June 1, 2010, entitled “GRAPHICS PROCESSING ARCHITECTURE
`
`EMPLOYING A UNIFIED SHADER”, having as inventors Steven Morein et al., owned by
`
`instant assignee and is incorporated herein by reference, which is a continuation of co-pending
`
`U.S. Application Serial No. 11/842,256,
`
`filed August 21, 2007, entitled “GRAPHICS
`
`PROCESSING ARCHITECTURE EMPLOYING A UNIFIED SHADER”, having as inventors
`
`Steven Morein et al., owned by instant assignee and is incorporated herein by reference, whichis
`
`a continuation of U.S. Application Serial No. 11/117,863, filed April 29, 2005, which has issued.
`
`into U.S. Patent No. 7,327,369, entitled “GRAPHICS PROCESSING ARCHITECTURE
`
`EMPLOYING A UNIFIED SHADER”, having as inventors Steven Morein et al., and owned by
`
`instant assignee and is incorporated herein by reference which is a continuation of U.S.
`
`Application Serial No. 10/718,318, filed on November 20, 2003, which has issued into U.S.
`
`Patent No. 6,897,871, entitled “GRAPHICS PROCESSING ARCHITECTURE EMPLOYING A
`
`UNIFIED SHADER’, having as inventors Steven Morein et al., and owned by instant assignee
`
`and is incorporated herein by reference.
`
`FIELD OF THE INVENTION
`
`[0002]
`
`The present
`
`invention generally relates
`
`to graphics processors and, more
`
`particularly, to a graphics processor architecture employing a single shader.
`
`BACKGROUND OF THE INVENTION
`
`[0003]
`
`In computer graphics applications, complex shapes and structures are formed
`
`through the sampling, interconnection and rendering of more simple objects, referred to as
`
`CHICAGO/#2201074.1
`
`LG Ex. 1002, pg 12
`
`LG Ex. 1002, pg 12
`
`

`

`primitives. An example of such a primitive is a triangle, or other suitable polygon. These
`
`primitives, in turn, are formed by the interconnection of individual pixels. Color and texture are
`
`then applied to the individual pixels that comprise the shape based on their location within the
`
`primitive and the primitives orientation with respect to the generated shape; thereby generating
`
`the object that is rendered to a corresponding display for subsequent viewing.
`
`[0004]
`
`The interconnection of primitives and the application of color and textures to
`
`generated shapes are generally performed by a graphics processor. Conventional graphics
`
`processors include a series of shaders that specify how and with what correspondingattributes, a
`
`final
`
`image is drawn on a screen, or suitable display device. As illustrated in FIG. 1, a
`
`conventional shader 10 can be represented as a processing block 12 that accepts a plurality of
`
`bits of input data, such as, for example, object shape data (14) in object space (x,y,z); material
`
`properties of the object, such as color (16); texture information (18); luminance information (20);
`
`and viewing angle information (22) and provides output data (28) representing the object with
`
`texture and other appearance properties applied thereto (x’, y”, z’).
`
`[0005]
`
`In exemplary fashion,as illustrated in FIGS. 2A-2B, the shader accepts the vertex
`
`coordinate data representing cube 30 (FIG. 2A) as inputs and provides data representing, for
`
`example, a perspectively corrected view of the cube 30° (FIG. 2B) as an output. The corrected
`
`view may be provided, for example, by applying an appropriate transformation matrix to the data
`
`representing the initial cube 30. More specifically, the representation illustrated in FIG. 2B is
`
`provided by a vertex shader that accepts as inputs the data representing, for example, vertices
`
`Vx. Vy and Vz, among others of cube 30 and providing angularly oriented vertices Vx,,Vy: and
`
`V7z,, including any appearanceattributes of corresponding cube 30”.
`
`CHICAGO/#2201074.1
`
`LG Ex. 1002, pg 13
`
`LG Ex. 1002, pg 13
`
`

`

`[0006]
`
`In addition to the vertex shader discussed above, a shader processing block that
`
`operates on the pixel level, referred to as a pixel shaderis also used when generating an object
`
`for display. Generally, the pixel shader provides the color value associated with each pixel of a
`
`rendered object.
`
`Conventionally, both the vertex shader and pixel shader are separate
`
`components that are configured to perform only a single transformation or operation. Thus, in
`
`order to perform a position and a texture transformation of an input, at least two shading
`
`operations and hence, at
`
`least
`
`two shaders, need to be employed. Conventional graphics
`
`processors require the use of both a vertex shader and a pixel shader in order to generate an
`
`object. Because both types of shaders are required, known graphics processors are relatively
`
`large in size, with most of the real estate being taken up by the vertex and pixel shaders.
`
`[0007]
`
`In addition to the real estate penalty associated with conventional graphics
`
`processors,
`
`there is also a corresponding performance penalty associated therewith.
`
`In
`
`conventional graphics processors, the vertex shader and the pixel shader are juxtaposed in a
`
`sequential, pipelined fashion, with the vertex shader being positioned before and operating on
`
`vertex data before the pixel shader can operate on individual pixel data.
`
`[0008]
`
`Thus, there is a need for an improved graphics processor employing a shaderthat
`
`is both space efficient and computationally effective.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0009]
`
`The present invention and the associated advantages and features thereof, will
`
`become better understood and appreciated upon review of the following detailed description of
`
`the invention, taken in conjunction with the following drawings, where like numerals represent
`
`like elements, in which:
`
`[0010]
`
`FIG. | is a schematic block diagram of a conventional shader;
`
`CHICAGO/#2201074.1
`
`LG Ex. 1002, pg 14
`
`LG Ex. 1002, pg 14
`
`

`

`[0011]
`
`FIGS. 2A-2B are graphical representations of the operations performed by the
`
`shaderillustrated in FIG. 1;
`
`[0012]
`
`FIG. 3 is a schematic block diagram of a conventional graphics processor
`
`architecture;
`
`[0013]
`
`FIG. 4A is a schematic block diagram of a graphics processor architecture
`
`according to the present invention;
`
`[0014]
`
`FIG. 4B is a schematic block diagram of an optional input componentto the
`
`graphics processor according to an alternate embodimentofthe present invention; and
`
`[0015]
`
`FIG. 5 is an exploded schematic block diagram of the unified shader employed in
`
`the graphics processorillustrated in FIG. 4A.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`[0016]
`
`Briefly stated,
`
`the present invention is directed to a graphics processor that
`
`employs a unified shader that is capable of performing both the vertex operations and the pixel
`
`operations
`
`in a space saving and computationally efficient manner.
`
`In an exemplary
`
`embodiment, a graphics processor according to the present invention includes an arbiter circuit
`
`for selecting one of a plurality of inputs for processing in response to a control signal; and a
`
`shader, coupled to the arbiter, operative to process the selected one of the plurality of inputs, the
`
`shader including means for performing vertex operations and pixel operations, and wherein the
`
`shader performs one ofthe vertex operations or pixel operations based on the selected one ofthe
`
`plurality of inputs.
`
`[0017]
`
`The shader includes a general purpose register block for storing at least the
`
`plurality of selected inputs, a sequencer for storing logical and arithmetic instructions that are
`
`used to perform vertex and pixel manipulation operations and a processor capable of executing
`
`CHICAGO/#2201074.1
`
`LG Ex. 1002, pg 15
`
`LG Ex. 1002, pg 15
`
`

`

`both floating point arithmetic and logical operations on the selected inputs according to the
`
`instructions maintained in the sequencer. The shader of the present invention is referred to as a
`
`“unified” shader because it is configured to perform both vertex and pixel operations. By
`
`employing the unified shader of the present invention, the associated graphics processor is more
`
`space efficient than conventional graphics processors because the unified shader takes up less
`
`real estate than the conventional multi-shader processor architecture.
`
`[0018]
`
`In addition, according to the present
`
`invention,
`
`the unified shader is more
`
`computationally efficient because it allows the shader to be flexibly allocated to pixels or
`
`vertices based on workload.
`
`[0019]
`
`Referring now to FIG.3, illustrated therein is a graphics processor incorporating a
`
`conventional pipeline architecture. As shown, the graphics processor 40 includes a vertex fetch
`
`block 42 which receives vertex information relating to a primitive to be rendered from an off-
`
`chip memory 55 on line 41. The fetched vertex data is then transmitted to a vertex cache 44 for
`
`storage on line 43. Upon request,
`
`the vertex data maintained in the vertex cache 44 is
`
`transmitted to a vertex shader 46 on line 45. As discussed above, an example of the information
`
`that is requested by and transmitted to the vertex shader 46 includes the object shape, material
`
`properties (e.g. color), texture information, and viewing angle. Generally, the vertex shader 46 is
`
`a programmable mechanism which applies a transformation position matrix to the input position
`
`information (obtained from the vertex cache 44),
`
`thereby providing data representing a
`
`perspectively corrected image of the object to be rendered, along with any texture or color
`
`coordinates thereof.
`
`[0020]
`
`After performing the transformation operation,
`
`the data representing the
`
`transformed vertices are then provided to a vertex store 48 on line 47. The vertex store 48 then
`
`CHICAGO/#2201074.1
`
`LG Ex. 1002, pg 16
`
`LG Ex. 1002, pg 16
`
`

`

`transmits the modified vertex information contained therein to a primitive assembly block 50 on
`
`line 49. The primitive assembly block 50 assembles, or converts, the input vertex information
`
`into a plurality of primitives to be subsequently processed. Suitable methods of assembling the
`
`input vertex information into primitives is known in the art and will not be discussed in greater
`
`detail here. The assembled primitives are then transmitted to a rasterization engine 52, which
`
`converts the previously assembled primitives into pixel data through a process referred to as
`
`walking. The resulting pixel data is then transmitted to a pixel shader 54 online 53.
`
`[0021]
`
`The pixel shader 54 generates the color and additional appearanceattributes that
`
`are to be applied to a given pixel, and applies the appearance attributes to the respective pixels.
`
`In addition, the pixel shader 54 is capable of fetching texture data from a texture map 57 as
`
`indexed by the pixel data from the rasterization engine 52 by transmitting such information on
`
`line 55 to the texture map. The requested texture data is then transmitted back from the texture
`
`map 57 on line 57° and stored in a texture cache 56 before being routed to the pixel shader on
`
`line 58. Once the texture data has been received, the pixel shader 54 then performsspecified
`
`logical or arithmetic operations on the received texture data to generate the pixel color or other
`
`appearance attribute of interest. The generated pixel appearance attribute is then combined with
`
`a base color, as provided by the rasterization engine on line 53, to thereby provide a pixel color
`
`to the pixel corresponding at the position of interest. The pixel appearanceattribute present on
`
`line 59 is then transmitted to post raster processing blocks (not shown).
`
`[0022]
`
`As described above, the conventional graphics proce