11111111111111111111111111111111111111111111111111111111111111111111111 111
`US007777753B2
`
`(12) United States Patent
`Owen et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,777,753 B2
`*Aug.l7, 2010
`
`(54) ELECTRONIC SYSTEM AND METHOD FOR
`SELECTIVELY ALLOWING ACCESS TO A
`S HARED MEMORY
`
`(75)
`
`Inventors: J effenon Eugene Owen, Freemon!, CA
`(US); Raul Zeger s Diaz, Palo Alto, CA
`(US); Os,•aldo Co Iavin , Tucker, GA
`(US)
`
`(73)
`
`( * ) Notice:
`
`Assignee: STMicroelectronics, Inc., Carrollton,
`TX (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C.I54(b)by0days.
`This patent is subject to a terminal dis(cid:173)
`claimer.
`(2I) Appl. No.: 12/424,389
`(22) Filed:
`Apr. 15, 2009
`Prior Publication Data
`(65)
`
`US 2009/0201305 AI
`
`Aug. 13, 2009
`
`Related U.S. Application Data
`
`(63)
`
`(51)
`
`Continuation of application No. 11/956,165, filed on
`Dec. 13, 2007, now Pat. No. 7,542,045, which is a
`continuation of application No. 10/174,918, filed on
`Jun. 19, 2002, now Pat. No. 7,321,368, which is a
`continuation of application No. 09/539,729, filed on
`Ma.-. 30, 2000, now Pat. No . 6,427,194, which is a
`continuation of application No. 081702,910, filed on
`Aug. 26, 1996, now Pat. No. 6,058,459.
`Int.Cl.
`G06F 151167
`G09G 5136
`G09G 5/39
`(52) U.S. Cl.
`
`(2006.01)
`(2006.01)
`(2006.0 1)
`... ... 345/541; 345/542; 345/531;
`345/547
`(58) Field of C lassification Search ....... ......... 3451541 ,
`345/531,542,547, 555, 501,519, 545
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4 ,257,095 A
`
`3/ 1981 Nadir ......................... 7101119
`(Continued)
`
`FOREIGN PATENT DOCUlviENTS
`
`CA
`
`1/ 1995
`2100700
`(Continued)
`
`OrHER PUBLICATIONS
`U.S. District Cou1t, Eastern District of Texas Live (Shelman), Civil
`Docket for Case #: 4 :03.cv.00276-LED, STMicroelectmnics, Inc.,
`Plaintiffv. Mororola. lnc., andFreescaleSemiconducrOI; Inc., Defen(cid:173)
`dants, Counterclaim Plaintifts v. STMicroelectronics N. V, and
`STI\licroelecrronics, Inc., Counterclaim Defendants, date filed Jul.
`18, 2003, 47 pages.
`
`(Continued)
`
`Primary Examiner Hau H Nguyen
`(74) Attonzey, Agent, or Firm- Lisa K. Jorgenson; David V.
`Carlson
`(57)
`
`ABSTRACT
`
`An electronic system, an integrated circuit and a method for
`display are disclosed. l11e electronic system contains a first
`device, a memory and a video/audio compression/decom(cid:173)
`pression device such as a decoder/encoder. The electronic
`system is configured to allow the first device and the video/
`audio compression/decompression device to share the
`memory. The clcctrotuc system may be included in a com(cid:173)
`puter in which case the memory is a main memory. Memory
`access is accomplished by one or more memory interfaces,
`direct coupling of the memory to a bus, or direct coupling of
`the first device and decoder/encoder to a bus. An arbiter
`selectively provides access for the first device and/or the
`decoder/encoder to the memory based on priority. The arbiter
`may be monolithically integrated into a memory interface .
`The decoder may be a video decoder configured to comply
`with the MPEG-2 standard. The memory may store predicted
`images obtained from a preceding image.
`
`17 Claims, 6 Drawing Sheets
`
`l VIDEO r
`~ ~oco J
`I~TERfACE 1 AU~O I I pij~O r-=: IMlffifACE
`
`FIRS! O£VIC(
`.!Z
`
`60
`
`!lilA ENCll£ I
`I
`
`!J
`
`!IEOOR\' INlEllfN:E
`56
`~
`
`I Y[IMJRY C~TROli.Ell I
`
`()
`
`II
`
`FASt BUS
`
`,J
`40
`
`I*:CISTIR
`
`.2.Q
`
`OECODit.r.
`CIRCUli
`
`ocroJit.r.
`CIRCUli
`
`ENCOOINC
`CIRCUIT
`
`ENCOOINC
`CIRCUIT
`
`RECISTCA
`
`.2.Q
`
`ilECOOt:R
`
`ENClJC£11
`
`4~
`
`82
`
`56
`
`J
`
`j
`
`I !lilA ENGII£ ~r 52
`_r==:'_
`~ WOIORY INTERFACE
`R£FR£Sif lOGIC
`ARaiTER
`..1
`..1
`NO<ORf ()ONil;()tl[R
`
`J
`
`~
`
`sa
`
`f-'"76
`
`.00
`
`II
`
`U'-70
`
`NEJIOR\'
`.5.0
`
`J
`
`Page 1 of 21
`
`ZTE EXHIBIT 1001
`
`

`
`US 7,777,753 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`4,774 ,660 A
`4,894 ,565 A
`5,027,400 A
`5,212,742 A
`5,250,940 A
`5,363,500 A
`5,371,893 A
`5,450,542 A
`5,459,519 A
`5,461 ,679 A
`5,522,080 A
`5,557,538 A
`5,576,765 A
`5,579,052 A
`5,590,252 A
`5,598,525 A
`5,621,893 A
`5,623,672 A
`5,682,484 A
`5,748,203 A
`5,774,206 A
`5,774,676 A
`5,778,096 A
`5,793,384 A
`5,797,028 A
`5,809,245 A
`5,809,538 A
`5,812,789 A
`5,815 ,167 A
`5,835,082 A
`5,912,676 A
`5,923,665 A
`5,936,616 A
`5,960,464 A
`6,058,459 A
`6,297,832 B1
`6,330,644 B1
`
`911988 C<>nforti ..................... 364/200
`111990 Marquardt .................. 307/518
`..................... 380/20
`6/ 1991 Baji etal.
`511993 Normile et al .............. 382/ 166
`10/ 1993 Valentaten et al. .......... 345/189
`1111994 Takeda ....................... 395/425
`1211994 Price el a!. .................. 395/725
`911995 Le hman et at.
`............. 395/ 162
`1011995 Scalise el al .
`............ 348/431.1
`10/ 1995 Normile et al .............. 283/304
`511996 Harney ....................... 3951727
`911996 Retter et at.
`............ 364/514 A
`11/ 1996 Cheney et at.
`.............. 348/407
`1 111996 Artieri ........................ 348/416
`12/1996 Silverbrook ................ 395/133
`111997 Nally et at. ................. 395/520
`411997 Joh ....................... 395/200.02
`4/ 1997 Popat ......................... 395/728
`10/ 1997 Lambrecht .................. 710/128
`511998 Tang et at. .................. 345/521
`611998 Wasserman et al. .... 395/200.77
`6/ 1998 Stearns et al ................ 709/247
`7/ 1998 Stearns ....................... 382/233
`811998 Okitsu ........................ 345/535
`8/1998 G ulick et al. .......... 395/800.32
`9/ 1998 Zenda ........................ 345/204
`911998 Pollmannetal. ............ 711/ 151
`9/ 1998 D·iaz et al. .................. 709/247
`9/ 1998 Muthal ....................... 345/541
`1.111998 Perego ....................... 345/202
`6/ 1999 Malladi et a!. .............. 345/521
`711999 Sun et :LI. .................... 370/477
`8/1999 Torborg, Jr. et al .......... 345/202
`9/J 999 Lam ........................... 711/202
`5/2000 Owen etal. ................. 711/151
`10/2001 Mizuyabu et at. ........... 345/540
`1212001 Yamashitaetal. .......... 711/147
`
`FOREIGN PATENT DOCUMENTS
`
`DE
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`FR
`JP
`JP
`JP
`JP
`JP
`JP
`wo
`
`69631364
`0 639 032
`0673 171
`0 495 574
`0827348
`0827110
`0 7 10 029
`0772159
`2740583
`06-030442
`06-1 78274
`06-348238
`08-018953
`10-108117
`10- 145739
`96/20567
`
`11/2004
`7/ 1994
`911995
`3/ 1997
`3/ 1998
`911998
`3/2002
`112004
`4/ 1997
`2/ 1994
`6/ 1994
`1211994
`1/ 1996
`411998
`5/ 1998
`7/ 1996
`
`OTHER PUBLICATIONS
`
`BIJ'an Ackland, "The Role ofVLSI in Multimedia;• IEEE Jmtmal of
`Solid-State Circuits, Apr. 1994, vol. 29, No.4, pp. 381-388.
`Joel F. Adam and David L. Tennenhouse, "The Vidboard: A Video
`C•.phll'e and Processing Peripheral for a Oistrihuterl Mulrime<lia Sys(cid:173)
`tem," ACM Multimedia, Aug. 1-6, 1993, vol. 5, No.2, pp. I 13-120.
`Matthew Adiletta, et al., "Architecture of a Flexible Real-Time Video
`Encoder/Decoder: T he DECchip 2 1230," Multimedia Hardware
`Architectures 1997, Feb. 12-13, 1997, vol. 302 1, pp. 136-148.
`T. Araki, el: al., "Video DSP Architectm e for MPEG2 CODEC,"
`ICASSP-94 S2 AUVN, Speech Processing 2, Audio, Underwater
`Acoustics, VLSI & Neural Networks, Apr. 19-22, 1994, vol. 2, pp.
`417-420.
`Page 2 of 21
`
`Doug Bailey, et. aJ., "Programmabl·e Vision Processor/Conr.roller lur
`Flexible Implementation of Current and Futme Image Compression
`Standards," IEEE Micro, Oct. 1992, pp. 33-39.
`Yin Baoand A<L'Lrshpal S. Sethi, "OCP _ A: An Efficient QoS Control
`Scheme for Real Time Multimedia Communications," IEEE Global
`Telecommunications Conference, Conference Record, Nov. 3-8,
`1997, vol. 2 of 3, pp. 741-745.
`Mark Baugher, '1'he OS/2 Resotuce Reservation System," Multime(cid:173)
`dia Computing and Networking I995, Feb. 1995, vol. 2417, pp.
`167- 176.
`Allen J. Bawn et al., "A Multimedia Chipset for Consumer Audio(cid:173)
`Visual Applications," IEEE Transactions on Consumer Electronics,
`Aug. 1997, vol. 43, o. 3, pp. 646-648.
`Vasudev Bhaskaran eta I., "Multimedia Architectures: From Desktop
`Systems to Portable Appliances," Multimedia Hardware Architec(cid:173)
`tures 1997, Feb. 12-13, 1997, vol. 3021, pp. 14-25.
`Philip Bonannon et. at., "The Architecture of the Dati Main-Memory
`Storage Manager," Multimedia Tools and Applications, 1997, vol. 4,
`pp. 115-151.
`C. Bouville et al., "DVFLEX: A Flexible MPEG Real Time Video
`CODEC," International Confere, ce on Image Processing , Sep.
`16-19, 1996, vol. II of III, pp. 829-832.
`V. Michael 13ove, Jr., ''The Impact of New Multimedia Representa(cid:173)
`tions on Hardware and Software Systems," Multimedia Hardware
`Architectures I997, Feb. 12-13, 1997, vol. 3021, pp. 34-39.
`Apurva Brahmbatt, '"A VLSI Architecture lor Real Time Code Book
`Generator and Encoder of a Vector Quantizer," International Confer(cid:173)
`ence on Image Processing, IEEE S ignal Processing Society, vol. 2,
`Sep. 16-19, 1996, pp. 99 1-994.
`Dave Bursky, "Codec Compresses Images in Real Time: Real-Time
`Motion Video or Still Images Can be Compressed with Single-Ch ip
`Multistand ard C<>re," Electronic Design, Oct. 3, 1993.
`Dave Bursky, "Performing Over 8 BOPS, A Two Chip Set Can
`Compress or Expand Video in Real Time Image Processing Ch ip Set
`Handles Full Motion Video," Electronic Design, May 3, 1993.
`Navin Chaddha et al., "A Real-Time Scalable Color Quantizer
`Trainer/Encoder," The Twenty-Eigh th Asilomar Conference on Sig(cid:173)
`nals, Systems & Computers, Oct. 30-Nov. 2, 1994, pp. 203-207.
`Shih-Fu Chang et at., "Columbia's VoD and Multimedia Research
`Testbed with Heterogeneous Network Support," Multimedia Tools
`and Applications, 1997, vol. 5, pp. 171-184.
`Shailender ChaudhlJ'andAiok Cho udhary, "A Framework fo r Analy(cid:173)
`sis of Guaranteed QOS Systems," Video Techniques and Sojiwarefor
`Full-Service Networks, Nov. 21, 1996, vol. 2915, pp. 25-38.
`Geng-Lin Chen et al., '"Video Encoder Architecture for MPEG2 Real
`Time Encoding," IEEE Ti·ansactions Consumer Electronics, Aug.
`1996, vol. 42, No.3, pp. 290-299.
`Raymond M.K. Cheng and Donald W. Gillies, "Disk Management
`for a Hard Real-Time File System," Multimedia Systems, vol. 4, No.
`2, 1996, pp. 255-260
`Leonardo Chiariglione, "MPEG: A Technological Basis for Multi(cid:173)
`media Applications," Multimedia, Spring 1995, vol. 2, No. I.
`Winston Sijin Choe et al., "ATM-Based Multi-Party Conferencing
`System," ! EEE Global Telecommunications Conference, Nov. 1995,
`vol. 1 of3, pp. 592-596
`Francoise Colaitis, ··opening Up Multimedia Object Exchange with
`MHEG," lvfultimedia, Summer 1994, vol. 2, o. 2.
`Geoff Coulson et al., '"The Design <>fa QoS-Cont:rolled ATM-Based
`Conummications System in Chocus," IEEE Journal on Selected
`Areas in Communications, May 1995, vol. 13, No.4, pp. 686-699.
`Rabin Deka, "A Comprehensive Study of Digital Signal Processing
`Devices," }vficroprocessors and Aficro:.ystems. May 1995. vol. 19,
`No.4, pp. 209-221.
`Erwan Demairy et al., '"On the Correctness of Multimedia Applica(cid:173)
`tions," The II'" Euromicro Conference on Reai-1Jme Systems, IEEE
`Computer Society, Jun. 9-11, 1999, pp. 226-233.
`C. H. VanDusen et al., "From Concept to an bnplementat:ion,"Imer(cid:173)
`national Broadcasting Convention, Sep. 12-16, 1996.
`Santanu Dutta et al., "VLSI Issues in Memory-System Design tor
`Video Signal Processors," IEEE 1995, pp. 498-503.
`
`

`
`US 7,777,753 B2
`Page3
`
`Saied Hosseini Kbayat and Adreas D. Bovopoulos, "A Proposed Bus
`Fandrianto, Jan and Tim Williams, "A Progranunable Solution fo r
`AI'bitration Scheme for Multimedia Workstations," lmemational
`Standard Video Comptession," in IEEE Compwer Society Press,
`Co1!{erence on Multimedia Computing and Systems, May 14-19,
`Thiity-Seventh IEEE Computer Society Interniltion:ol Conference,
`San Francisco, CA, Feb. 24-28, 1992, pp. 47-50.
`1994, pp. 415-423.
`D. Kim et al., "A Real-Time MPEG Encoder Using a Programmable
`Borko Furht, "Multimedia Systems: An Overview," Multimedia,
`Processor;• 1£££, 1994, pp. 161-!70.
`Sprio I994, vol. l,No.l,pp.47-59·.
`.- - -
`Toshiro Kinugasa et al., "A Video Pre/Post-processing LSI for Video
`Borko Furht, "Processor Architectures for Multimedi2Jilr1Silr'i:t• '
`Multimedia Modeling, Nov. 17-20, 1997, pp. 89-109!1' ~
`Capttlfe," 1996 Digest ofTechnical Papers, Jun. 5-7, 1996, pp. 396-
`Subramanian Ganesan, "A Duai-DSP Microproces~~'l'e~
`397.
`Kiyoshi Kohiyruna et al., "Architecture ofMPEG-2 Digital Set-Top(cid:173)
`Real-Time Digitto.l Correlation," Microprocessors aJ1~·1Jsy~
`.....1
`vol. 15, No.7, Sep. 1991, pp. 379-384.
`Box for CATV Vod System," IEEE, 1996, pp. 667-672.
`Takeo Koinuma and Noriharu Miyaho, "ATM in B-ISD Commu(cid:173)
`Wanda Gass, "Architecture Trends o f MPEG Decoders for Set-Top
`nication Systems and VLSI Realiza,tion; • IEEE Joumal ofSolid-State
`Box," Multimedia Hardwm·e Architectures 1997, Feb. 12-13, 1997,
`Circuits, Apr. 1995, vol. 30, No. 4, pp. 341 -347.
`vol. 302 1, pp. 162-169.
`Tosbio Kondo et a!., "Two-Chip MPEG-2 Video Encoder," IEEE
`J. Goodenough et al ., "A General Putpose, Single Chip Video Signal
`Micro, Apr . .1996, vol. .16, No.2, pp. 51-58.
`Processing (VSP) Architecture for Image Processing, Coding and
`S.W. Lau and John C.S. Lui, "A Novel Video·On-Deman d Storage
`Computer Vision," IEEE 1994, pp. 1-4.
`AI·chitecttue for Supporting Constant Frame Rate with Vruriable Bit
`John Goodenough et al., "A Single Chip Video Signal Processing
`Rate Retrieval," Network and Operllting Systems S upport for Digiral
`Architect11re for Image Processing, Coding and Computer Vision,"
`Audio and Video, Apr . .19-21, 1995, pp. 294-305.
`IEEE Transllction on Circuits m1d Systemsfor Video Technology, Oct.
`Woobin Lee et al., "MediaStation 5000: Integrating Video and
`1995, vol. 5, ·o. 5, pp. 436-445.
`Audio," M ultimedia, Sununer 1994 , vol. I, No. 2, pp. 50-61.
`Robert J. Gove et al., "Image Compttf ing Requirements for the 1990s:
`Woo bin Lee et al., "Real-Time MPEG Video Compression Using the
`From Multimedia to Medicine," The international Sociery for Opri(cid:173)
`MVP," Data Compression Conference '94, Mar. 29-31, 1994 .
`cal Engineering, Medica/imaging V.·Image Capture, Formatlingand
`Chia-Hsing Lin et al., "Low Power Design for MPEG-2 Video
`Display, Feb. 1991, vol. 1444, pp. 3 18-333.
`Decoder," i EEE 1/'imsacrious on Consumer Electronics, Aug. 1996,
`Robett J. Gove, "The MVP: A Highly-Integrated Video Compression
`vol. 42, No.3, pp. 513-52.1 .
`Chip," DCC '94, Data Compressio11 Conference, Mar. 29-3 1, 1994,
`Cha-Hsing Lin and Chein-WeiJen , "On the Bus Arbitration for
`pp. 215-224.
`MPEG2 Video Decocler," VLS! Tech. Systems and Appl. 1995 Sym(cid:173)
`James L. Green, "Capn1ring Digital Video Using DVI, Multimedia
`posium, pp. 201-205.
`ancl the i7.)Q vi cleo processor," [)1: [)nllh'.Lkmmal, Jul. 1992, vol. 17,
`J. Lin et al., "DMA-based Communications bet\veen PC and DSP,"
`Issue 7.
`Microprocessors and Microsystems, Apr. 1991, vol. 15, No.3, pp.
`Klaus Gmg·er et al., "MPEG-1 Low-Cost Encoder Solution," Europe
`137-142.
`Series, Advanced image and Video Communications and Storage
`Ferran Lisa et al., "A Reconfigurable Coprocessor for a PCI-basecl
`Teclmologies, Mar. 20-23, I995, vol . 2451, pp. 4I-51.
`Real Time Computer Vision System," Field-Programmable Logic
`Fouad Guediri and Pavani Chilamakuri, "An Af1ordable Solution to
`and Applications, 7'• International Workshop, FPL 1997, London,
`Real-Time Video Compression," Technical Conference, Session 10
`UK, Sep. 1-3, 1997, pp. 392-399.
`lmaging&HDTV, Mar. 8, 1995, pp. 261-265.
`M. Norley Liu, "MPEG Decocler Architecture for Embedded Appli(cid:173)
`Karl Guttag et al., "A Single-Chip Multiprocessor for Multimedia:
`cations," TEE£ Ti·ansactions on Consumer Electronics, Nov. 1996,
`The MVP," IEEE Computer Graphics and Applications, Nov. 1992,
`vol. 42, No. 4, pp. 102.1-1028.
`pp. 53-64.
`Kamal N. Majeed, "Dual Processor Automotive Controller," IEEE,
`Y. Hoffner and M.F. Smith, "Communication bet\veen two micropro(cid:173)
`1988, pp. 39-44.
`cessors
`through conunon metnory," Microprocessors and
`Masatoshi Matsuo et al., "A Programmable Video Codec System for
`Microsystems, Jul./Aug. 1982, vol. 6, No.6, pp. 303-308.
`Low-Rit-Rate Communicarion," IF,F:r: Tran.mr.tinns on r:onsumer
`T. Russell Hsing, "The Challenge o f VLSI Technology to Low-Bit
`Eleclronics, Aug. 1997, vol. 43, No.3, pp. 903-910.
`Rate Video," pp. 164-168, May 17-19, I989.
`Kiyoshi Miura et al., "A 600 mW Single Chip MPEG2 Video
`J. Huang and P.J. Wan, ··on Supporting Mission-Critical Multimedia
`Decoder," !ElCE Ti·ans. Electrono, Dec. 1995, vol. E78-C, No. 12,
`Applications," llllernational Conference on Multimedia Computing
`pp. 1691-1696.
`and Systems, Jun. 17-23, 1996, pp. 46-53.
`Steven G. Morton, "A236 Parallel DSP Chip Provides Real-Time
`Jianclong Huangancl Ding-Zhu Du, "Resource Management for Con(cid:173)
`Video Processing Economically and Efficiently," Electro '96 Profes(cid:173)
`tinuous Multimedia Database Applications," Real-Time Systems
`sional Program Proceedings, Apr. 30-May 2, 1996, pp. 261-268.
`Symposium, Dec. 7-9, 1994, pp. 46-54.
`Raymond T. Ng and Jinhai Yang, "An analysis of buffer sharing and
`Khoa D. Huynh and Taghi M. Khoshgofla;u, ''Performance Analysis
`prefetching techniques for multimedia systems," Multimedia Sys(cid:173)
`of Advanced 110 A.rchitecnues for PC-based Video Servers," Multi(cid:173)
`tems, vol. 4 , No.2, 1996, pp. 55-69.
`media Systems, vol. 2, No. l, 1994, pp. 36-50.
`Agnes Ngai et al., "A Scalable Chip Set for MPEG2 Real-Time
`M. Irv in et al., "A New Generation of MPEG-2 Video Encoder ASIC
`Encoding," CompCon, 1996, pp. 193-198.
`& ITS Application to New Technology Markets," lmemational
`Lek Heng Ngoh eta!., "On Storage Server Issues for Multimedia-on(cid:173)
`8roadcasti~1g Convention, Sep. 12-16, 1996, Pub. No. 428.
`Demand System," Multimedia Modeling, Nov. 1995, pp. 393-409 .
`Rajeev Jain et al., "An Integrated Circuit Design for Pruned Tree
`Huw Oliver et al., ' 'DistribLJted Connection Management for Real(cid:173)
`Search Vector Quantization Encoding wiLb an Otl'-Cbip Controller,"
`Time Multi media Services," 1-/vm Mitllimedia Services 10 Ne1work
`IEEE 'fl'ansllctions on Circuit and Systems for Video Technology, Jun.
`Services, Dec. 1997, pp. 59-74.
`1992, vol. 2, No.2, pp. 147-158.
`T.H. Ooi et al., "A PC-Based MPEG Compressed Data Decoder,"
`A.A. Kassirn et al., "A DSP-Based Video Compression Test-Bed,"
`IEEE Ti·ansactions 011 Consumer Electronics, Nov. 1995, vol. 41, No.
`Microprocessors and Microsyslems, vol. 20, 1997, pp. 541-551.
`4, pp. 1I69-1 173.
`Yasusbi Ooi et aL, ''An MPEG-2 Encoder .-'\rch.it.ecture Based on a
`OiJnitris N . Kanellopoulos et al., "The Comprehensive Approach of
`QOS M.d the Evolution of ACSE Protocols in Multimedia Co~n~nu­
`Single Chip Dedicatecl LSI with a Control MPU," IEEE, 1997, pp .
`. nic2t.ons," Proceedings of the 171ird IEEE lntem ational Conference
`599-602.
`Banu Ozden et al., "On the Design of a Low-Cost Video-on-Demand
`on ElectrOJ;it:.s, Circuits. and Systems, Oct. 13- 16, 1996, vol. I, pp.
`Storage System," IEEE Journal of Solid State Circuits, Apr. 1994,
`323-326.
`vol. 29, No.4, pp. 40-54.
`Kevin A. Kettler and Jay K. Strosnid er, "Scheduling Analysis of the
`Pallavi Shah, "Multimedia on the Internet," 111e Tivemieth Annual
`Micro Chan nel A.rchitechJre for Multimedia Applications," llllema(cid:173)
`international Computer Software & Applications Conference, Aug.
`tional Conference on Multimedia Computing and Systems, May
`21-23, 1996, p. 150.
`14-19, 1994, pp. 403-414.
`Page 3 of 21
`
`

`
`US 7,777,753 B2
`Page4
`
`Pramod Pancha and Magda El z~uki, "Bandwidth-Allocation
`Schemes for Variable-Bit-Rate MPEG Sources in ATM Networks,"
`IEEE Ti-tmsactions Oil Circuits Gild Systems for Video Te.chllology,
`Jun. 1993, vol. 3, No.3, pp. 190- 198.
`R. Radhakrishna Pillai, "Multimed]a Over the Internet," The Twen(cid:173)
`tieth A111111al lntemationa/ Compwer Software & Applicatiolls Con (cid:173)
`ference,Aug. 2 1,23, 1996, p. 149.
`Peter Pirsch et al., "Architectural Approaches for Multimedia Pro(cid:173)
`cessors," Mullimedia Hardware Archiwcwres i997, Feb. 12-13,
`1997, vol. 3021, pp. 2-13.
`Peter Pirscn et al., "VLSI Architectures for Video Compression- A
`Survey," Proceedings of the IEEE, Feb. 1995, vol. 83, No. 2, pp.
`220-246.
`Peter Pirsch and Winfried Gehrke, "VLSI Architectures for Video
`Signal Processing," Image Processing Gild its ApplicatiOilS, Jul. 4-6,
`.1995, Conference Publication No. 410, pp. 6-10.
`HerbeJt Plansky, "Variable Block-Size Vector Quantization in the
`Transform Domain," Signal Processing VI Theories and Applica(cid:173)
`tiolls, vol. III, 1992, pp. 1243-1 246.
`P. Venkat. Rangan et al., "Designing an On-Demand Mullimedia
`Service," IEEE Communications Magazine, Jul. 1992, vol. 30, No.7,
`pp. 56-64.
`S.F. Reddaway, "Fractal Graphics and Image Compression on a
`DAP," The Design and Application of Parallel Digital Processors,
`Apr. 11 -15, .1988, p. 201.
`William D. Richard et al., "The Washington University Broadband
`Terminal," JEEEJoumal Oil Selected Areas in Communications, Feb.
`1993, vol. ll, No.2, pp. 276-282.
`William D. Richard et al., "The Washington University Mullimedia
`System," Multimedia Systems, vol. 1, No.3, 1993, pp. 120-131.
`Reza Rooho lamini and VladimirCherkassky, "ATM-Based Multime(cid:173)
`dia SeJvers," Multimedia, Spring 1995, vol. 2, o. I, pp. 39-52.
`Amr Sabaa et al., "Design and Modelling of a Nonblocking Input
`Buffer ATM Switch," Call. J E lecr & Comp. Eng , vol. 22, Nov. 3,
`1997, pp. 87-93.
`N.L. Seed et al., "An Enhanced Transputer Modu.le lu r Real-Time
`Image Processing," Third fmemational Conference Oil Image Pro(cid:173)
`cessing, 1989, pp. 131-135.
`Pallavi Shah, "Multimedia on the Internet," The Twentieth Ammal
`fntemational Compwer Software & Applicariolls Conferences,
`COMPSAC '96, Aug. 2.1-23, 1996, p. ISO.
`Doug Shepherd el al., ''Quality -of-Service Support for Multimedia
`Applications," Multimedia, Fall 1996, vol. 3, No. 3, pp. 78-82.
`' . Sriskanthan et al., "A Real-Time PC:-Rasec\ Vicleo Phone System
`on ISDN/L.-"ln," IEEE TransactiOilS on Consumer Electronics, May
`1995, vol. 41, No.2, pp. 332-342.
`Pau.l A. Stirpe and Dinesh C. Ver:ma, "Application Migration to
`Reserved Bandwidth etworks," Multimedia Computing and Net(cid:173)
`working i995, Feb. 1995, vol. 24 17 , pp. 428-434.
`lchiro Tami tani et :tl., ''An Encoder/Decoder Chip Set for the MPEG
`Video Standard," IEEE lntem ational Conference on Acoustics,
`Speech and Signal Processing, Mar·. 23-26, 1992, pp. 661-664.
`Prasoon Tiwari and Eric Viscit.o, "A Parallel MPEG-2 Video Encoder
`with Look-.-1\head R..1te Control," The i 996 IEEE lntem ational Con(cid:173)
`ference on Acoustics. Speech, and signal Processing Co1![erence,
`May 7-10, il996, pp. 1994-1997.
`Fouad A. Tobagi et al., "Streaming RAID-A Disk Array Manage(cid:173)
`ment System for Video Files," ACM Multimedia 93, Aug. 1-6, 1993,
`pp. 393-400.
`Kevin Tsang and Belle W.Y. Wei, "A VLSl ArchitectLLre for a Real(cid:173)
`Time Code Book Generator and Encoder of a Vector Quantizer,"
`IEEE 1i·ansactions on a Joilll Publication of iEEE Circuits and
`Systems Society, the IEEE Compuler Society, the IEEE Solid-State
`Circuits Council , Sep. 1994, vol. 2, No. J , pp. 360-364.
`Shin-ichi Uramoto et at, "An MPEG2 Video Decoder LSI with
`Hierarchical Control Mechanism," IEEE 1997 Custom Integrated
`Circuits COJ!ference, Apr. 26, 1995, pp. 1697-1708.
`Olivier Verscheure and Jean-Pierre Hubam<, "Perceptual Video Qual(cid:173)
`ity and Activity Metrics: Optimization of Video SeJvice Based on
`MPEG-2 Encoding," Multimedia Telecommunications and Applica(cid:173)
`tions, Nov. 1996, pp. 249-265.
`Andreas Vogel et al., "Distributed Multimedia and QOS: A Survey,"
`Multimedia, Sturuner 1995, vol. 2, No.2, pp. 10-19.
`Page 4 of 21
`
`Marco Win zker et al., "Architecture and Memory Requireme nts lur
`Stand-Alone and Hierarchical MPEG2 HDTV-Decoders with Syn(cid:173)
`chronous DRAJ\IIs," IEEE bttPJ'Ilational Symposium on Cir.:-uits and
`Systems, Apr. 30-May 3, .1995, pp. 609-612.
`Andrew Wolfe et al., "Design Methodology for Progrrunmable Video
`Signal Processors," Multimedia Hardware Architectures 1997, Feb.
`12-13, 1997, vol. 3021, pp. 26-31.
`Lars C. Wolfe and RalfSteirunetz, ''Concepts for Resource Reserva(cid:173)
`tion in Advance," Multimedia Tools and Applications, 1997, pp.
`255-278.
`Jeffrey J. Wong et al., "The li-Bus: A Media Acquisition Bus Opti(cid:173)
`mized for Multiple Streams," Multimedia Hardware Architectures
`i997, Feb. 12-13, 1997, vol. 3021, pp.40-SO.
`Dallas E. W rege and .Jorg Liebeherr, "Video Traffic Characterization
`for Multimedia Networks with a Deterministic Service," IEEE
`lnforcom '96, Mar. 1996, vol. 2, pp. 537-544.
`Chen-Mie Wu et al., "A Ftmction-P ipelined Architecture and VLSI
`Chip for MPEG Video Image Coding," i EEE Transaclions on Con(cid:173)
`sumer Eleclronics, Nov. 1995, vol. 41, No.4, pp. 1127-1137.
`A. Yamac\a et al., "Real-time MPEG2 Encoding and Decoding with a
`Dual-Issue RISC Processor," Proceedings of the IEEE 1997 Custom
`fntegrated Circuits Conference, May 5-8, .1997, pp. 225-228.
`Katsuyuki Yrunazaki et al., "ATM Networking and Video-Coding
`Techniques for QOS Control in B-ISON," IEEE Transactions on
`Circuits and Systems for Video 1eclmology, Jun. 1993, vol. 3, No.3,
`pp. 175-181
`Masahiko Yoshimoto eta!., "ULSI Realization of MPEG2 Realtime
`Video Encoder and Decoder- An Overview," IEICE 7i·ans. Electron,
`May 23, 1995, vol. E78-C, No. 12, pp. 1668-168 1.
`Frank Fran-Ko Yu et al., "Resotuc-e Management Issues of a Video
`Server;• Multimedia Storage and Archiving Systems, Nov. 18-19,
`1996, vol. 2916, pp. 290-300.
`SaifS. Zahir and Hussein Alnuweiri, "VBRMPEG-2 Encoded Video
`Over Broadband Network," Proceedings of SP.JE, Nov. 3-5, 1997,
`vol. 3231, pp. 372-381.
`Hui Zhang and Edward W. Kightly, "Red-VBR: A New Approach ro
`Support Delay-Sensitive VBR Video in Packet-Switched Networks,"
`Network and Operating System Support for Digital Audio and Video,
`Apr. 19-2.1 , 1995, pp. 258-272.
`Subramaniam Ganesan, "A Dual-DSP Microprocessor System for
`Real-Time Digital Correlat ion," Microprocessors and Microsystems,
`Sep. 1991, vol. 15, No.7, pp. 29-37.
`The Motorola MCD212 Video Decoder and System Controller
`("MCD212")(as described in the Advance Information man ual, pub(cid:173)
`lished in the U.S. Aug. 1995, at MOT-S 723,l.S3·723240).,.
`Apple Macintosh Quadra 840AV 'ifPe~ exMrtiJi~ ~~
`"Fusionrecorder 1.0" application as d' si:ri'bc!l'lll t11G.I993 ~cl. 1
`Note entitled Macintosh Quadra 840AV and .Maci.niosh Cci!tri8
`i
`L
`~~eo~~-
`C-CubeCL450 MPEG Video Decoder ("CL4.:i0") a~ribed in tl;
`''CL450 MPEG Decoder User's Manu~-Cubc ::MicrosysteoJil,
`Milpitas, C A .1992 (MOT-S 72 1789 -72 18'/4).
`•
`S. Undyet al., "A low-cost graphics and multimedia workstation chip
`set," IEEE Micro, vol. 14, No.2, Apr. 1994, pp . .10-22.
`S hed, H. and P. Srinivasan, "A High-Performance Cross-Platform
`MPEG Decoder," Digital Video Compression on Personal Comput(cid:173)
`ers: Algorithms and Technologies, SPTE Proceedings, Feb. 7 -8, 1994,
`vol. 2187, pp. 241-248.
`Bursky D., "Highly Integrated Controller Eases MPEG-2 Adoption,"
`Electronic Design, vol. 43, No. 17, pp. 141-142, Aug. 21, 1995.
`Butler, B. and T. Mace, "The Great Leap Forward," PC Magazine, pp.
`241-244, 246,248,250,253-254,256,260-261,264,266-268,273-
`275, 278, Oct. I I, 1994.
`Doquilo, J. "Symmetric Multiprocessing Servers: Scaling the Perfor(cid:173)
`mance Wall," lnfoworld, pp. 82-85, 88-92, Mar. 27, 1995.
`Galbi, D. et al., "An MPEG-1 AudioN ideo Decoder with Run(cid:173)
`Length Compressed An tialiased Video Overlays," .IEEE Imerna(cid:173)
`tional Solid State Circuits Conference, pp. 286-287, 381, 1995.
`Giorgis, T., "SMP Network Operating Systems," Computer Dealer
`News, vol. 12, No. 16, Aug. 8, 1996.
`
`

`
`US 7,777,753 B2
`Page 5
`
`King, A., Inside Windows 95, M icrosoll Press, Redmond Washing(cid:173)
`ton, pp. 85-'90, 1994.
`Maturi, G., "Single Chip MPEG Audio Deooder,"JE££ Trtmsartions
`011 C011S11mer Electronics, vol. 38, No. 3, pp. 348-356, Aug. 1992.
`"MPEG Video Overview;' SGS-111omson Microelecll'()llics Tee/mi(cid:173)
`ca/ Note, pp. 1-4, 1992.
`
`Video Electronics Standards Association, "VESA Unitied Memory
`Architecttue Hardware Specifications Proposal," Version: 1.0p, pp.
`1-38, Oct. 31, 1995.
`Video Eleclronics Standards Association, VESA Unified Memory
`Architecture VESA BIOS Extensions (VUMA-SBE Proposal), Ver(cid:173)
`sion J.Op, pp. 1-26, Nov. J, 1995.
`
`Page 5 of 21
`
`

`
`U.S. Patent
`
`Aug. 17, 2010
`
`Sheet 1 of6
`
`US 7,777,753 B2
`
`.,,.=
`
`.........
`
`.
`
`.............................. ......
`
`1 -
`
`MICRO-
`CONTROllER
`
`VI0£0 DECODING
`CIRCUIT
`Jl
`
`1-----
`
`MEMORY
`INTERfACE
`
`· .1§
`
`f+---
`
`AUDIO DECODING
`CIRCUIT
`14
`
`1--
`
`.1.B
`
`j ~
`
`\)
`
`MEMORY
`22
`
`Fig. la
`{Prior Art)
`
`MICRO-
`CONTROLLER
`
`.....
`
`, 11"
`
`REGISTER
`INTERF"AC£
`
`VIDEO DECODING
`~ CIRCUIT
`12
`
`.,...._
`
`MEMORY
`INTERfACE
`
`2.4
`
`20
`
`!+-+
`
`.16
`
`1---
`
`AUOIO DECODING
`CIRCUIT
`1.1
`•
`
`\.!r
`
`MEMORY
`22
`
`Fig. 1 b
`{Prior Art)
`
`10 j"
`
`Page 6 of 21
`
`

`
`U.S. Patent
`
`Aug. 17, 2010
`
`Sheet 2 of6
`
`US 7,777,753 B2
`
`152, CPU
`
`1~
`1+-- 1/f
`
`168 "' MAIN
`
`UEU
`
`170
`\
`
`22, coo U1 M2 W3
`122
`\
`SOURCE
`
`l~ v26
`
`..... _ ....
`
`' CD }
`
`120
`/
`VlotO
`DECODER
`CTLR
`...... _ .....
`\ YUV l·
`
`/"121
`
`UEU
`
`R
`G
`B
`
`P4
`
`86
`
`85
`
`P7
`
`86
`
`P4
`
`I
`l
`)
`~
`P7
`
`....
`
`Fig. lc
`(Prior Art)
`
`U(COOlNG I 10
`
`DISPlAY
`
`f Pl I 82
`[ ~~
`
`83
`
`..
`82
`
`Ml~ 10
`
`M2 ~
`
`B3
`
`B5
`
`Pl
`
`.. I
`P4
`I
`~
`Pt
`
`Fig. ld
`(Prior Art)
`
`Page 7 of 21
`
`

`
`""U
`Ill co
`CD
`Q)
`9,
`1\J
`.......
`
`FIRST DEVICE
`
`j2
`
`60
`
`DMA ENGINE I
`
`72
`/
`
`MEMORY INTERFACE
`5~
`I MEMORY CONTROLLER I
`~ >
`
`12 ,
`
`REGISTER
`INTERFACE 14\.
`2.Q
`
`DECODER
`
`4~
`
`VIDEO
`DECODING
`CIRCUIT
`
`AUDIO
`DECODING
`CIRCUIT
`
`VIDEO
`ENCODING
`CIRCUIT
`
`AUDIO
`ENCODING
`CIRCUIT
`
`t
`t
`I ow. ENGINE
`t
`
`52
`
`v62
`
`/64
`
`ENCODER
`
`REGISTER
`INTERFACE
`.2D
`
`~6
`
`~
`r:J).
`•
`~
`~
`~
`
`~ = ~
`
`> = ~
`
`""""
`~-...1
`N
`~
`"""" Q
`
`MEMORY INTE:RF'ACE
`ARBITER 1
`J
`
`1 REFRESH LOGIC
`t
`
`MEMORY CONTROLLER
`
`82:f
`L
`
`56
`
`58
`
`~76
`
`I
`
`80
`
`rJ) =(cid:173)
`
`('!)
`
`('I) -(M
`
`0 .....
`
`0\
`
`BUS
`
`~70
`MEMORY
`~
`
`-------------
`
`--------.-
`
`(
`I
`
`Fig. 2
`
`(j
`00
`-...1
`-:...:.
`-...1
`-...1
`-:...:.
`VI
`~
`t;C
`N
`
`

`
`U.S. Patent
`
`Aug. 17, 2010
`
`Sheet 4 of6
`
`US 7,777,753 B2
`
`17
`4
`
`INTERFACE
`
`182
`/
`DISPLAY
`
`184
`I
`FRAME
`SUFfER
`r185
`
`178
`I
`
`176
`/
`
`NAP I oM
`
`17
`2\
`
`LAN
`CONTROLLER
`
`200,
`
`GRAPHICS
`AUOIO
`ACCELERATOR ~ COOEC
`(WITH VIDEO SCALER AND
`COLOR SPACE CONVERTER)
`
`v-t
`80
`
`PC! BUS
`
`156"
`
`PC!
`
`v-160
`
`AGP
`
`170 "
`
`152
`'-..,
`CPU
`
`PCI
`PROCESSOR
`..................... INTERfACE CORE LQCIC
`EIOE····
`t
`DEVICE
`154 ~ m
`MEMORY INTERFACE
`
`./190
`
`164
`/
`HARD DISK
`DRIVE
`
`t
`
`ow
`CD ROM ~'--1 66
`
`l2
`162./ CACHE
`
`J
`
`12
`
`Fig. 3
`
`4:
`
`52
`
`DECODER
`
`t
`
`OMA ENGIN£
`
`ENCOOER
`~6
`76
`I
`REFRESH LOGIC I
`: ARBITER
`\
`8~ t
`I MEMORY CONTROllER
`58
`56
`
`"--ao
`
`MEMORY iNTERFACE
`
`{r.
`I ~'--167
`,
`
`MAIN
`168 _/ MEMORY
`
`Page 9 of 21
`
`

`
`U.S. Patent
`
`Aug. 17, 2010
`
`Sheet 5 of6
`
`US 7,777,753 B2
`
`152,
`
`CPU
`
`UEJ.f v12l
`
`168
`\
`MAIN M£M
`
`22'
`
`1~
`-
`Ncool•niM2 ...__
`1/F
`'\ '\ ---·--co _ ....... ,. ..
`·--
`'' ,, ........ ....
`
`\ .........
`
`PCI
`
`....
`
`I no
`
`122
`\
`SOURCE
`
`80
`I
`DECOO£R/
`VlllEO
`£NCOD£R
`CTLR
`~, B ... ~~
`/
`/
`
`.... _ ./
`
`/
`
`/
`
`./
`
`/
`
`/
`
`/
`
`-
`._._..
`R c
`._._..
`B
`~0
`
`''' DECODING I lO u I P1 ''' I B2
`
`DISPlAY
`
`10
`
`82
`
`Bl
`
`P7 l u
`'BJ I' P4 nut •• 85 u l 86
`.. I :Pl :: I u 85 I 86 I P4 I
`r==:::::
`U1~ I(}
`r-:::::
`~
`~-------------------~
`Fig. 5
`
`P1
`
`P4
`
`t
`~
`
`P7
`
`RUN
`VARIABLE
`LENGTH
`LENGTH
`DECODER DECODER
`
`o-1
`
`ocr-1 ·
`
`41
`
`34
`
`FILTER
`FIFO
`
`35
`
`37
`
`30
`
`PC! 1/f
`
`70
`
`Pel
`Fig. 6
`
`Page 10 of 21
`
`

`
`U.S. Patent
`
`Aug. 17, 2010
`
`Sheet 6 of6
`
`US 7,777,753 B2
`
`80"\.
`
`185,
`
`~~
`
`52
`
`I DECODER I tNCOOER J
`4:
`is
`t -
`OMA fNCI N£ I
`t
`~6
`REFRESH LOGIC I
`-: ARBITER
`t ~8
`8~
`I MEMORY CONTROllER J
`5/6 MEMORY INTERFACE
`
`-
`
`OJ SPlAY
`
`INTERfACE
`
`200
`i
`DAC !MEMORY INTERFACE v-?2 --
`172
`202../
`r----~
`...--\__._____,...._~ 204_.~ 20 ACCELERATOR AC-J !4--"'
`AUDIO v180
`CO DEC
`ZOS ../ 30 ACCELERATOR
`tAN
`. / PCI/AGP BUS INTERFACE \208
`COOROU.ER
`2to-~....-_______ __,
`
`AMP
`
`176
`
`~a
`
`170
`\
`
`PCJ BUS
`
`167
`...-----, \
`VAIN
`WEMORY
`1~
`
`l2
`CACHE
`
`.--------L-------.
`PCI
`..--~
`CHIPSET
`~0
`
`DAAI 1 ;J9
`
`MODE:M
`
`l
`
`CPU
`
`£fOE
`
`......_+f
`
`HARD DISK
`DRIVE
`
`"'-164
`
`DVO
`CO ROM
`
`'-166
`
`Fig. 7
`
`Page 11 of 21
`
`

`
`US 7,777,753 B2
`
`1
`