—
`
`This POA copy is intended for the attached
`continuation application being submitted on December
`13, 2007; attorney docket no. 850063.553C3.
`
`IN THE UNITE in STATES PATENT AND TRADEMAL ,. OFFICE
`2
`Jefferson E. Owen et al.
`:
`03/702,910
`:
`August 26, 1996
`
`Applicants
`Application No.
`Filed
`
`"
`
`-
`
`I
`
`‘-
`
`For
`
`i
`
`:
`
`DECOMPRESSION AND/OR
`VIDEO AND/OR
`COMPRESSION DEVICE THAT SHARES A MEMORY
`
`Examiner
`
`Art Unit
`
`Docket No.
`
`Date
`
`:
`
`:
`
`:
`
`:
`
`Glenn Gossage
`
`2751
`
`96-S-I2 (850063.553)
`
`April 12, 1999
`
`Assistant Commissioner for Patents
`
`Washington, DC 20231
`
`APPOINTMENT OF ASSOCIATE POWER OF ATTOQEX
`
`Sir:
`
`1, Lisa K. Jorgenson, attorney of record in the above-identified application,
`-
`appoint as associate attorneys David V. Carlson, Reg. No. 31,153; Michael J. Donohue,
`Registration No. 35,859, Kevin S. Ross, Reg. No. 42,116; Dale C. Barr, Reg. No. 40,498;
`Kevin S. Costanza-, Reg. No. 37,801, Brian L. Johnson, Reg. No. 40,033, Paul F. Rusyn, Reg.
`* No. 42,118, Dennis M. de Guzman, Reg. No. 41,702; E. Russell Tarleton, Reg. No.- 31,800,_
`John M, Wechkin-, Reg. No. 42,216; Robert D." 1V_I_cCutcheon, Reg. No. 38,717; and ‘
`Theodore E. Galanthay, Reg; No. 24,122.
`
`.
`
`_
`Jorgenson at:
`'
`
`It
`
`is requested that correspondencelicontinue to be addressed to Lisa K.
`'
`I
`
`Lisa K. Jorgenson, Esq.
`STMicro.electronics, Inc.
`1310 Electronics Drive
`
`Carrollton, Texas 75006-6039
`
`Respectfitlly submitted,
`
`STMicroelectronics, Inc;
`
`_
`’
`LK.I:BLJ:jabl
`
`1310 Electronics Drive
`
`. Carrollton, Texas 75006-5039
`
`(972) 466-7414
`
`Fax: (972) 466-7044-5039
`
`u:\lloat\j:ib l\8 50063.5 53-Assocpoa
`
` Lisa K. Jorge-nsoti
`
`Registration No. 34,845
`
`Apple Exhibit 1002
`Page 1 of 333
`
`Apple Exhibit 1002
`Page 1 of 333
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`_
`_
`Application Data Sheet 37 CFR 1.76
`
`Attorney Docket Number
`
`96—S—O12C3(850063.553C3)
`
`Application Number
`
`Title of Invention
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND ARBITER TO
`SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`The application data sheet is part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paper filed application.
`
`Secrecy Order 37 CFR 5.2
`
`|:| Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`Applicant Information:
`Applicant 1
`Applicant Authority @|nventor | OLegal Representative under 35 U.S.C. 117
`|OParty of Interest under 35 U.S.C. 118
`Prefix Given Name
`Middle Name
`Family Name
`Suffix
`Jefferson
`
`Residence Information (Select One) @ US Residency Q Non US Residency O Active US Military Service
`
`City
`
`Freemont
`
`
`
`StateIProvince US CA Country of Residence i
`
`
`
`
`
`Citizenship under 37 CFR 1.41(b) i
`
`US
`
`Mailing Address of Applicant:
`Address 1
`
`Address 2
`
`44177 Bowers Court
`
`Applicant 2
`Applicant Authority @|nventor OLegal Representative under 35 U.S.C. 117
`Prefix Middle Name
`
`C)Party of Interest under 35 U.S.C. 118
`Family Name
`suffix
`
`Residence Information (Select One) @ US Residency O Non US Residency O Active US Military Service
`Palo Alto
`StateIProvince
`Country of Residence i
`Citizenship under 37 CFR 1.41(b) i
`
`Mailing Address of Applicant:
`750 Montrose Avenue
`Address 1
`
`
`S
`
`Address 2
`
`
`
`Palo Alto
`
`Postal Code
`
`State! Province
`
`US
`
`A Iicant 3
`
`
`
`OParty of Interest under 35 U.S.C. 118
`Applicant Authority @|nventor OLegal Representative under 35 U.S.C. 117
`Family Name
`Suffix
`Prefix Middle Name
`—
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`City
`StateIProvince
`Countryof Residencei
`US
`Apple Exhibit 1002
`Page 2 Of 333
`
`EFS Web 2.2.1
`
`Apple Exhibit 1002
`Page 2 of 333
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`
` Attorney Docket Number
`96-8-O12C3(850063.553C3)
`Application Number
`
`Application Data Sheet 37 CFR 1.76
`
`Title of Invention
`
`
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND ARBITER TO
`SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`Citizenship under 37 CFR 1.41(b) i
`
`FR
`
`Mailing Address of Applicant:
`
`Address 1
`
`Address 2
`
`2820 Livsey Court
`
`US
`30084
`Postal Code
`Inventor Information blocks may be
`All
`Inventors Must Be Listed - Additional
`generated within this form by selecting the Add button.
`
`Add
`
`Correspondence Information:
`
`Enter either Customer Number or complete the Correspondence Information section below.
`For further information see 37 CFR 1.33(a).
`
`|:| An Address is being provided for the correspondence Information of this application.
`
`Customer Number
`
`Email Address
`
`
`
`
`
`
`davec.docketing@seedip.com
`
`Amman
`
`Application Information:
`.
`.
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND ARBITER TO
`T't'° °f the '""°"t'°"
`SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`Attorney Docket Number
`
`96—S—012C3 (850063.553C3)
`
`Small Entity Status Claimed
`
`|:|
`
`Application Type
`
`Nonprovisional
`
`Subject Matter
`
`Utility
`
`Suggested Class (if any)
`
`Sub Class (if any)
`
`Suggested Technology Center (if any)
`
`Total Number of Drawing Sheets (if any) 3 Suggested Figure for Publication (if any)
`Publication Information:
`
`|:| Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Request Not to Publish. I hereby request that the attached application not be published under 35 U.S.
`D C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the subject of
`an application filed in another country, or under a multilateral international agreement, that requires publication at
`eighteen months after filing.
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Enter
`either Customer Number
`or
`complete
`the
`Representative Name
`section
`below.
`If
`both
`are completed the Customer Number will be used for the Representative Information during processing.
`
`sections
`
`
`
`Please Select One:
`
`@ Customer Number
`
`0 US Patent Practitioner 0 Limited Recognition (37 CFR 11.9)
`
`EFS Web 2.2.1
`
`Page 3 Of 333
`
`Apple Exhibit 1002
`Page 3 of 333
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`.
`.
`Application Data Sheet 37 CFR 1.76
`
`Aeemev eeeke Number
`_
`_
`
`Aeeleeeee Nemeer T Title of Invention
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND ARBITER TO
`SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`Customer Number
`
`30423
`
`Domestic BenefitINational Stage Information:
`
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, or 365(0) or indicate National Stage
`entry from a PCT application. Providing this information in the application data sheet constitutes the specific reference required by
`35 U.S.C. 119(e) or 120, and 37 CFR 1.78(a)(2) or CFR 1.78(a)(4), and need not otherwise be made part of the specification.
`
`Prior Application Status
`Application Number
`
`Prior Application Status
`Application
`Number
`Continuity Type
`
`.
`
`.
`
`Prior Application
`
`Filing Date
`
`(YYYY_MM_DD)
`
`10174918
`
`Continuation of
`
`09539729
`
`2000-03-30
`
`Filing Date (YYYY-MM-DD)
`2002-06-19
`
`Patent Number
`
`6427194
`
`ISSUE Date
`
`(YYYY_MM_DD)
`
`2002-07-30
`
`Prior Application Status
`Patented
`Application
`.
`Number
`Continuity Type
`
`.
`
`Prior Application
`
`Filing Date
`
`(YYYY_MM_DD)
`
`09539729
`
`Continuation of
`
`08702910
`
`1996-08-26
`
`Patent Number
`
`6058459
`
`|SSUe Date
`
`(YYYY_MM_DD)
`
`2000-05-02
`
`Additional Domestic Benefit/National Stage Data may be generated within this form
`by selecting the Add button.
`
`M
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim benefit of foreign priority and to identify any prior foreign application for which priority is
`not claimed. Providing this information in the application data sheet constitutes the claim for priority as required by 35 U.S.C. 119(b)
`and 37 CFR 1_55(a)_
`
`I
`
`'
`
`Application Number
`
`Country i
`Parent Filing Date (YYYY-MM-DD)
`
`
`Priority Claimed
`
`0 Yes
`
`(Q No
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`Add
`
`Assignee Information:
`Providing this information in the application data sheet does not substitute for compliance with any requirement of part 3 of Title 37
`of the CFR to have an assignment recorded in the Office.
`
`Assignee 1
`If the Assignee is an Organization check here.
`
`Organization Name
`
`STMicroelectr0nics, Inc.
`
`EFS Web 2.2.1
`
`Apple Exhibit 1002
`Page 4 Of 333
`
`Apple Exhibit 1002
`Page 4 of 333
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`
`96-8-01203 (850063.553C3)
`
`Attorney Docket Number
`
`Application Number
`
` Application Data Sheet 37 CFR 1.76
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND ARBITER TO
` Title of Invention
`SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`
`
`Mailing Address Information:
`
`Address 1
`
`Address 2
`
`1310 Electronics Drive
`
`Email Address
`
`Additional Assignee Data may be generated within this form by selecting the Add
`button.
`
`Add
`
`Signature:
`
`A signature of the applicant or representative is required in accordance with 37 CFR 1.33 and 10.18. Please see 37
`CFR 1.4(d) for the form of the signature.
`
`/David V. Carlsonl
`
`Signature First Name
`
`Date (YYYY-MM-DD)
`
`Re9is*ra*i°nNumber
`
`2007-12-13
`
`31153
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.0. Box 1450, Alexandria, VA 22313-1450.
`
`EFS Web 2.2.1
`
`Apple Exhibit 1002
`Page 5 Of 333
`
`Apple Exhibit 1002
`Page 5 of 333
`
`

`
`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to
`a patent application or patent. Accordingly, pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the collection
`of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is
`used by the U.S. Patent and Trademark Office is to process and/or examine your submission related to a patent application or patent.
`If you do not
`furnish the requested information, the U.S. Patent and Trademark Office may not be able to process and/or examine your submission, which may
`result in termination of proceedings or abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1.
`
`The information on this form will be treated confidentially to the extent allowed under the Freedom of Information Act (5 U.S.C. 552)
`and the Privacy Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Department of Justice to determine
`whether the Freedom of Information Act requires disclosure of these records.
`
`A record from this system of records may be disclosed, as a routine use, in the course of presenting evidence to a court, magistrate, or
`administrative tribunal, including disclosures to opposing counsel in the course of settlement negotiations.
`
`A record in this system of records may be disclosed, as a routine use, to a Member of Congress submitting a request involving an
`individual, to whom the record pertains, when the individual has requested assistance from the Member with respect to the subject matter of
`the record.
`
`A record in this system of records may be disclosed, as a routine use, to a contractor of the Agency having need for the information in
`order to perform a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`
`A record related to an International Application filed under the Patent Cooperation Treaty in this system of records may be disclosed,
`as a routine use, to the International Bureau of the World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`
`A record in this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security
`review (35 U.S.C. 181) and for review pursuant to the Atomic Energy Act (42 U.S.C. 218(c)).
`
`A record from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or his/her designee,
`during an inspection of records conducted by GSA as part of that agency's responsibility to recommend improvements in records
`management practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the
`GSA regulations governing inspection of records for this purpose, and any other relevant (i.e., GSA or Commerce) directive. Such
`disclosure shall not be used to make determinations about individuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public after either publication of the application pursuant
`to 35 U.S.C. 122(b) or issuance ofa patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record was filed in an application which became abandoned or in which the proceedings were
`terminated and which application is referenced by either a published application, an application open to public inspections or an issued
`patent.
`
`A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local law enforcement agency, if the
`USPTO becomes aware of a violation or potential violation of law or regulation.
`
`EFS Web 2.2.1
`
`AppLe_Extu'mu11u2_
`Page 6 of 333
`
`Apple Exhibit 1002
`Page 6 of 333
`
`

`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`PATENT
`
`Applicants
`
`For
`
`:
`
`:
`
`Jefferson Eugene Owen et al.
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING
`
`A DECODER AND ARBITER TO SELECTIVELY ALLOW
`
`ACCESS TO A SHARED MEMORY
`
`Docket No.
`
`Date
`
`:
`
`:
`
`96-S-0l2C3 (850063.553C3)
`
`December 13, 2007
`
`Commissioner for Patents
`
`P.O. Box 1450
`
`Alexandria, VA 22313-1450
`
`FEE DEFICIENCY AUTHORIZATION FORM
`
`Commissioner for Patents:
`
`Applicants hereby authorize the Director to charge any deficiencies in fees due by
`
`way of the enclosed papers only under 37 CFR 1.16 and 1.17 to Deposit Account No. 19-1090.
`
`Respectfully submitted,
`
`SEED Intellectual Property Law Group PLLC
`
`/David V. Carlson/
`
`David V. Carlson
`
`Registration No. 31,153
`
`701 Fifth Avenue, Suite 5400
`
`Seattle, Washington 98104
`Phone: (206) 622-4900
`Fax: (206) 682-6031
`
`l077869_l.DOC
`
`Apple Exhibit 1002
`Page 7 of 333
`
`Apple Exhibit 1002
`Page 7 of 333
`
`

`
`Electronic Patent Application Fee Transmittal
`—
`
`Title Of Invention:
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A
`DECODER AND ARBITER TO SELECTIVELY ALLOW ACCESS TO A
`SHARED MEMORY
`
`First Named Inventor/Applicant Name:
`
`Jefferson Eugene Owen
`
`Attorney Docket Number:
`
`96-S-O12C3 (850063.553C3)
`
`Utility
`
`Filing Fees
`
`Description
`
`Fee Code
`
`Quantity
`
`Sub-Total in
`
`USD($)
`
`Miscellaneous-Filing:
`
`Apple Exhibit 1002
`Page 8 of 333
`
`Apple Exhibit 1002
`Page 8 of 333
`
`

`
`Post-AlIowance-and-Post-Issuance:
`
`Extension-of-Time:
`
`Patent-Appeals-and-Interference:
`
`1450
`
`Total in USD ($)
`
`Apple Exhibit 1002
`Page 9 of 333
`
`Apple Exhibit 1002
`Page 9 of 333
`
`

`
`Electronic Acknowledgement Receipt
`
`Application Number:
`
`International Application Number:
`
`Confirmation Number:
`
`Title of Invention:
`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A
`DECODER AND ARBITER TO SELECTIVELY ALLOW ACCESS TO A
`SHARED MEMORY
`
`First Named Inventor/Applicant Name:
`
`Customer Number:
`
`Filer Authorized By:
`
`Attorney Docket Number:
`
`Receipt Date:
`
`Filing Date:
`
`Time Stamp:
`
`Application Type:
`
`Payment information:
`
`—
`
`Submitted with Payment
`
`Payment Type
`
`Payment was successfully received in RAM
`
`RAM confirmation Number
`
`Deposit Account
`$1450
`
`3294
`
`191090
`
`
`
`Deposit Account
`
`Authorized User
`
`File Listing:
`
`Document
`Number
`
`Document Description
`
`Pages
`Multi
`File Size(Bytes)
`.10
`A00‘
`/Message Digest P t/z"fappl.)
`Page 10 of 333
`
`Apple Exhibit 1002
`Page 10 of 333
`
`

`
`850063_553C3_APP.pdf
`
`d2993ace667d770861ad0c643099b54e
`88119ea6
`
`167001
`
`Multipart Description/PDF files in .zip description
`
`Document Description
`
`Specification
`
`Warnings:
`
`Information:
`
`Warnings:
`
`Information:
`
`Warnings:
`
`Information:
`
`Warnings:
`
`Information:
`
`Warnings:
`
`Information:
`
`Warnings:
`
`Information:
`
`Drawings—only black and white line
`drawings
`
`850063_553C3_Drawings.P
`DF
`
`3985251
`
`e0869325b2a8cb63930308b3dfle0i886
`5069891
`
`Oath or Declaration filed
`
`_
`850063_553C3_Declaration.
`PDF
`
`108011
`
`1491 bb35be19de91bb1e612879401a8761
`99851 e
`
`Power of Attorney
`
`850063_553C3_POA. PDF
`
`d58ea03065144d455b81c92da9962i97
`6d8299cb
`
`Application Data Sheet
`
`850063_553C3_ADS.PDF
`
`1093949
`
`97534eeb01bae03b4e192390d6c69ca1
`8b17a722
`
`Miscellaneous Incoming Letter
`
`850063_553C3_FDA.pdf
`
`d887dCaB07063a,3a06e0494ba491e39b
`1 5140091
`
`Fee Worksheet (PTO—06)
`
`6e17bcc1 3e0c431c2caa0703112ae3eb8
`3120165
`
`Page11 of333
`
`Apple Exhibit 1002
`Page 11 of 333
`
`

`
`This Acknowledgement Receipt evidences receipt on the noted date by the USPTO of the indicated documents,
`characterized by the applicant, and including page counts, where applicable.
`It serves as evidence of receipt
`similar to a Post Card, as described in MPEP 503.
`
`New Applications Under 35 U.S.C. 111
`If a new application is being filed and the application includes the necessary components for a filing date (see
`37 CFR 1.53(b)-(d) and MPEP 506), a Filing Receipt (37 CFR 1.54) will be issued in due course and the date
`shown on this Acknowledgement Receipt will establish the filing date of the application.
`
`National Stage of an International Application under 35 U.S.C. 371
`If a timely submission to enter the national stage of an international application is compliant with the conditions
`of 35 U.S.C. 371 and other applicable requirements a Form PCT/DO/EO/903 indicating acceptance of the
`application as a national stage submission under 35 U.S.C. 371 will be issued in addition to the Filing Receipt,
`in due course.
`
`New International Application Filed with the USPTO as a Receiving Office
`If a new international application is being filed and the international application includes the necessary
`components for an international filing date (see PCT Article 11 and MPEP 1810), a Notification of the
`International Application Number and of the International Filing Date (Form PCT/RO/105) will be issued in due
`course, subject to prescriptions concerning national security, and the date shown on this Acknowledgement
`Receipt will establish the international filing date of the application.
`
`Apple Exhibit 1002
`Page 12 of 333
`
`Apple Exhibit 1002
`Page 12 of 333
`
`

`
`ELECTRONIC SYSTEM AND METHOD FOR DISPLAY USING A DECODER AND
`
`ARBITER TO SELECTIVELY ALLOW ACCESS TO A SHARED MEMORY
`
`Cross-reference to Related Applications
`
`This application is
`
`a continuation of U.S. Patent Application No.
`
`10/174,918, filed June 19, 2002, and allowed November 29, 2007; which is a continuation
`
`of U.S. Patent No. 6,427,194, issued July 30, 2002; which is a continuation of U.S. Patent
`
`No. 6,058,459,
`
`issued May 2, 2000. All of the U.S. patents, U.S. patent application
`
`publications, U.S. patent applications, foreign patents, foreign patent applications and non-
`
`patent publications referred to in this specification and/or listed in the Application Data
`
`10
`
`Sheet, are incorporated herein by reference, in their entirety.
`
`Cross-reference to Other Related Applications
`
`The present application contains some text and drawings in common with
`
`U.S. Patent Application No. 08/702,911, filed August 26, 1996, and issued September 22,
`
`1998
`
`as U.S.
`
`Patent
`
`No.
`
`5,812,789,
`
`entitled:
`
`"VIDEO AND/OR AUDIO
`
`DECOMPRESSION AND/OR COMPRESSION DEVICE THAT SHARES A MEMORY
`
`INTERFACE" by Raul Z. Diaz and Jefferson E. Owen, which had the same effective filing
`
`date and ownership as the present application, and to that extent is related to the present
`
`application, which is incorporated herein by reference.
`
`Background
`
`20
`
`25
`
`The present invention relates to the field of electronic systems having a
`
`video and/or audio decompression and/or compression device, and is more specifically
`
`directed to sharing a memory interface between a video and/or audio decompression and/or
`
`compression device and another device contained in the electronic system.
`
`The size of a digital representation of uncompressed video images is
`
`dependent on the resolution and color depth of the image. A movie composed of a
`
`sequence of such images, and the audio signals that go along with them, quickly become
`
`Apple Exhibit 1002
`Page 13 of 333
`
`Apple Exhibit 1002
`Page 13 of 333
`
`

`
`large enough so that, uncompressed, such a movie typically cannot fit entirely onto a
`
`conventional recording medium such as a Compact Disc (CD).
`
`It is now also typically
`
`prohibitively expensive to transmit such a movie uncompressed.
`
`It is therefore advantageous to compress video and audio sequences before
`
`they are transmitted or stored. A great deal of effort is being expended to develop systems
`
`to compress these sequences. Several coding standards currently in use are based on the
`
`discrete cosine transfer algorithm including MPEG-1, MPEG-2, H.261, and H.263. (MPEG
`
`stands for "Motion Picture Expert Group", a committee of the International Organization
`
`for Standardization, also known as the International Standards Organization, or ISO.) The
`
`MPEG-1, MPEG-2, H.261, and H.263 standards are decompression protocols that describe
`
`how an encoded bitstream is to be decoded. The encoding can be done in any manner, as
`
`long as the resulting bitstream complies with the standard.
`
`Video and/or audio compression devices (hereinafter "encoders") are used
`
`to encode the video and/or audio sequence before it is transmitted or stored. The resulting
`
`bitstream is decoded by a video and/or audio decompression device (hereinafter "decoder")
`
`before the video and/or audio sequence is displayed. However, a bitstream can only be
`
`decoded by a decoder if it complies with the standard used by the decoder. To be able to
`
`decode the bitstream on a large number of systems, it is advantageous to encode the video
`
`and/or audio sequences in compliance with a well accepted decompression standard. The
`
`MPEG standards are currently well accepted standards for one-way communication.
`
`H-26l, and H.263 are currently well accepted standards for video telephony.
`
`Once decoded,
`
`the images can be displayed on an electronic system
`
`dedicated to displaying video and audio, such as television or a Digital Video Disk (DVD)
`
`player, or on electronic systems where image display is just one feature of the system, such
`
`as a computer. A decoder needs to be added to these systems to allow them to display
`
`compressed sequences, such as received images and associated audio, or ones taken from a
`
`storage device. An encoder needs to be added to allow the system to compress video
`
`and/or audio sequences, to be transmitted or stored. Both need to be added for two-way
`
`communication such as video telephony.
`
`l0
`
`l5
`
`20
`
`25
`
`Apple Exhibit 1002
`Page 14 of 333
`
`Apple Exhibit 1002
`Page 14 of 333
`
`

`
`A typical decoder, such as an MPEG decoder 10 shown in Figure la,
`
`contains video decoding circuit 12, audio decoding circuit 14, a microcontroller l6, and a
`
`memory interface 18. The decoder can also contain other circuitry depending on the
`
`electronic system in which the decoder is designed to operate. For example, when the
`
`decoder is designed to operate in a typical television, it will also contain an on-screen
`
`display (OSD) circuit.
`
`l0
`
`l5
`
`20
`
`Figure lb shows a better decoder architecture, used in the STi3520 and
`
`STi3520A MPEG Audio/MPEG-2 Video Integrated Decoder manufactured by ST
`
`Microelectronics, Inc., Carrollton, Texas. The decoder has a register interface 20 instead
`
`of a microcontroller. The register interface 20 is coupled to an external microcontroller 24.
`
`The use of a register interface 20 makes it possible to tailor the decoder l0 to the specific
`
`hardware with which the decoder l0 interfaces, or to change its operation without having
`
`to replace the decoder by just reprogramming the register interface.
`
`It also allows the user
`
`to replace the microcontroller 24, to upgrade or tailor the microcontroller 24 to a specific
`
`use, by just replacing the microcontroller and reprogramming the register interface 20,
`
`without having to replace the decoder 10.
`
`The memory interface 18 is coupled to a memory 22. A typical MPEG
`
`decoder 10 requires 16 Mbits of memory to operate in the Main Profile at Main Level
`
`mode (MP at ML). This typically means that the decoder requires a 2Mbyte memory.
`
`Memory 22 is dedicated to the MPEG decoder 10 and increases the price of adding a
`
`decoder 10 to the electronic system.
`
`In current technology, the cost of this additional
`
`dedicated memory 22 can be a significant percentage of the cost of the decoder.
`
`An encoder also requires a memory interface 18 and dedicated memory.
`
`Adding the encoder to an electronic system again increases the price of the system by both
`
`25
`
`the price of the encoder and its dedicated memory.
`
`Figure lc shows a conventional decoder inserted in a computer architecture.
`
`A conventional computer generally includes a peripheral bus 170 to connect several
`
`necessary or optional components, such as a hard disk, a screen, etc. These peripherals are
`
`Apple Exhibit 1002
`Page 15 of 333
`
`Apple Exhibit 1002
`Page 15 of 333
`
`

`
`connected to bus 170 via interfaces (e.g., a display adapter 120 for the screen) which are
`
`provided directly on the computer's motherboard or on removable boards.
`
`A Central Processing Unit (CPU) 152 communicates with bus 170 through
`
`an interface circuit 146 enabling a main memory 168 of the computer to be shared between
`
`CPU 152 and peripherals of bus 170 which might require it.
`
`The decoder 10 is connected as a master peripheral to bus 170, that is, it
`
`generates data transfers on this bus without involving CPU 152. The decoder receives
`
`coded or compressed data CD from a source peripheral 122, such as a hard disk or a
`
`compact disk read only memory (CD-ROM), and supplies decoded images to display
`
`10
`
`adapter 120. Recent display adapters make it possible to directly process the "YUV"
`
`(luminance and chrominance) image data normally supplied by a decoder, while a display
`
`adapter is normally designed to process "RGB" (red, green, blue) image information
`
`supplied by CPU 152.
`
`Display adapter 120 uses memory 12-1 for storing the image under display,
`
`15
`
`which comes from the CPU 152 or from the decoder 10. A conventional decoder 10 also
`
`uses dedicated memory 22. This memory is typically divided into three image areas or
`
`buffers M1 to M3 and a buffer CDB where the compressed data are stored before they are
`
`processed. The three image buffers respectively contain an image under decoding and two
`
`previously decoded images.
`
`20
`
`25
`
`Figure 1d illustrates the use of buffers M1 to M3 in the decoding of a
`
`sequence of images 10, P1, B2, B3, P4, B5, B6, P7.
`
`1 stands for a so-called "intra" image,
`
`whose compressed data directly corresponds to the image.
`
`P stands for a so-called
`
`"predicted" image, the reconstruction of which uses pixel blocks (or macroblocks) of a
`
`previously decoded image. Finally, B stands for a so-called "bidirectional" image, the
`
`reconstruction of which uses macroblocks of two previously decoded images. The intra
`
`and predicted images are likely to be used to reconstruct subsequent predicted and
`
`bidirectional images, while the bidirectional images are not used again.
`
`Images 10 and P1 are respectively stored in buffers M1 and M2 during their
`
`decoding. The filling and the emptying of a buffer in Fig. 1d are indicated by oblique
`
`Apple Exhibit 1002
`Page 16 of 333
`
`Apple Exhibit 1002
`Page 16 of 333
`
`

`
`lines. The decoding of image Pl uses macroblocks of image I0. Image I0, stored in buffer
`
`Ml, is displayed during the decoding of image B2, this image B2 being stored in buffer
`
`M3. The decoding of image B2 uses macroblocks of images I0 and P1.
`
`Image B2 is
`
`displayed immediately after image I0. As the locations of buffer M3 become empty, they
`
`are filled by decoded information of image B3. The decoding of image B3 also uses
`
`macroblocks of images I0 and P1. Once image B3 is decoded, it is displayed immediately,
`
`while image P4 is decoded by using macroblocks of image Pl.
`
`Image P4 is written over
`
`image I0 in buffer M1 since image I0 will no longer be used to decode subsequent images.
`
`After image B3, image P1 is displayed while buffer M3 receives image B5 under decoding.
`
`The decoding of image B5 uses macroblocks of images P1 and P4.
`
`Image P1 is kept in
`
`buffer M2 until the decoding of image B6, which also uses macroblocks of images P1 and
`
`P4, and so on.
`
`Referring again to Figure 1c, when any component needs access to the main
`
`memory 168 either to read from or write to the main memory 168, it generates a request
`
`which is placed on the bus 170. When the request is a write, the data to be written is also
`
`placed on the bus 170. The request is processed and the data is then either written to or
`
`read from the main memory 168. When data is read from the main memory 168, the data is
`
`now placed on the bus and goes to the component that requested the read.
`
`There are typically many components in the computer systems that may
`
`require access to the main memory 168, and they are typically all coupled to the same bus
`
`170, or possibly to several buses if there are not enough connectors on one bus to
`
`accommodate all of the peripherals. However, the addition of each bus is very expensive.
`
`Each request is typically processed according to a priority system. The priority system is
`
`typically based on the priority given to the device and the order in which the requests are
`
`received. Typically, the priority system is set up so no device monopolizes the bus,
`
`starving all of the other devices. Good practice suggest that no device on the bus require
`
`more than approximately 50% of the bus's bandwidth.
`
`The minimum bandwidth required for the decoder 10 can be calculated
`
`based on the characteristics and desired operation of the decoder. These characteristics
`
`l0
`
`15
`
`20
`
`25
`
`Apple Exhibit 1002
`Page 17 of 333
`
`Apple Exhibit 1002
`Page 17 of 333
`
`

`
`include the standard with which the bitstream is encoded to comply, whether the decoder is
`
`to operate in real time, to what extent frames are dropped, and how the images are stored.
`
`Additionally, the latency of the bus that couples the decoder to the memory should be
`
`considered.
`
`If the decoder does not operate in real time, the decoded movie would stop
`
`period