`DECLARATION OF JUNE ANN MUNFORD
`
`1
`
`SAMSUNG-1029
`
`1
`
`SAMSUNG-1029
`
`
`
`1. My name is June Ann Munford. I am over the age of 18, have personal
`
`knowledge of the facts set forth herein, and am competent to testify to the
`
`same.
`
`2. I earned a Master of Library and Information Science (MLIS) from the
`
`University of Wisconsin-Milwaukee in 2009. I have over ten years of
`
`experience in the library/information science field. Beginning in 2004, I
`
`have served in various positions in the public library sector including
`
`Assistant Librarian, Youth Services Librarian and Library Director. I have
`
`attached my Curriculum Vitae as Appendix CV.
`
`3. During my career in the library profession, I have been responsible for
`
`materials acquisition for multiple libraries. In that position, I have cataloged,
`
`purchased and processed incoming library works. That includes purchasing
`
`materials directly from vendors, recording publishing data from the material
`
`in question, creating detailed material records for library catalogs and
`
`physically preparing that material for circulation. In addition to my
`
`experience in acquisitions, I was also responsible for analyzing large
`
`collections of library materials, tailoring library records for optimal catalog
`
`
`
`
`
`
`
`
`
`2
`
`
`
`search performance and creating lending agreements between libraries
`
`during my time as a Library Director.
`
`
`4. I am fully familiar with the catalog record creation process in the library
`
`sector. In preparing a material for public availability, a library catalog record
`
`describing that material would be created. These records are typically
`
`written in Machine Readable Catalog (herein referred to as “MARC”) code
`
`and contain information such as a physical description of the material,
`
`metadata from the material’s publisher, and date of library acquisition. In
`
`particular, the 008 field of the MARC record is reserved for denoting the
`
`date of creation of the library record itself. As this typically occurs during
`
`the process of preparing materials for public access, it is my experience that
`
`an item’s MARC record indicates the date of an item’s public availability.
`
`
`5. Typically, in creating a MARC record, a librarian would gather various bits
`
`of metadata such as book title, publisher and subject headings among others
`
`and assign each value to a relevant numerical field. For example, a book’s
`
`physical description is tracked in field 300 while title/attribution is tracked in
`
`field 245. The 008 field of the MARC record is reserved for denoting the
`
`creation of the library record itself. As this is the only date reflecting the
`
`inclusion of said materials within the library’s collection, it is my experience
`
`
`
`
`
`3
`
`
`
`that an item’s 008 field accurately indicates the date of an item’s public
`
`availability.
`
`
`6. I have reviewed Exhibit SAMSUNG-1007, “A Unified Approach to
`
`Restoration, Deinterlacing and Resolution Enhancement in Decoding
`
`MPEG-2 Video” by Bo Martins and Soren Forchhammer as published in
`
`IEEE Transactions on Circuits and Systems for Video Technology,
`
`September 2002.
`
`
`7. Attached hereto as Appendix MARTINS01 is a true and correct copy of the
`
`MARC record for IEEE Transactions on Circuits and Systems for Video
`
`Technology as held by the Carnegie Library of Pittsburgh. I secured this
`
`record myself from the library’s public catalog. The MARC record
`
`contained within Appendix MARTINS01 accurately describes the title,
`
`author, publisher, and ISSN number of IEEE Transactions on Circuits and
`
`Systems for Video Technology. The ‘Lib Has’ field of this record visible on
`
`page 2 indicates this collection includes the September 2002 edition of IEEE
`
`Transactions on Circuits and Systems for Video Technology containing “A
`
`Unified Approach to Restoration, Deinterlacing and Resolution
`
`Enhancement in Decoding MPEG-2 Video”.
`
`
`
`
`
`
`
`4
`
`
`
`8. Attached hereto as Appendix MARTINS02 is a true and correct copy of “A
`
`Unified Approach to Restoration, Deinterlacing and Resolution
`
`Enhancement in Decoding MPEG-2 Video” as published in IEEE
`
`Transactions on Circuits and Systems for Video Technology as held by the
`
`Carnegie Library of Pittsburgh. I secured these scans myself from the
`
`library’s collection. In comparing Exhibit SAMSUNG-1007 to Appendix
`
`MARTINS02, it is my determination that Exhibit SAMSUNG-1007 is a true
`
`and correct copy of “A Unified Approach to Restoration, Deinterlacing and
`
`Resolution Enhancement in Decoding MPEG-2 Video” by Bo Martins and
`
`Soren Forchhammer as published in IEEE Transactions on Circuits and
`
`Systems for Video Technology September 2002.
`
`
`9. The 008 field of the MARC record in Appendix MARTINS01 indicates the
`
`date of record creation. The 008 field of Appendix MARTINS01 indicates
`
`the Carnegie Library of Pittsburgh first acquired this journal as of July 24,
`
`1990 and held the journal in perpetuity until 2009. Considering this
`
`information, it is my determination that IEEE Transactions on Circuits and
`
`Systems for Video Technology September 2002 and therefore “A Unified
`
`Approach to Restoration, Deinterlacing and Resolution Enhancement in
`
`Decoding MPEG-2 Video” was made available to the public shortly after its
`
`initial release in September 2002.
`
`
`
`
`
`5
`
`
`
`
`10. I have reviewed Exhibit SAMSUNG-1010 “Overview of the Scalable Video
`
`Coding Extension of the H.264/AVC Standard” by Heiko Schwarz, Detlev
`
`Marpe and Thomas Wiegand as published in IEEE Transactions on Circuits
`
`and Systems for Video Technology, September 2007.
`
`
`11. Attached hereto as Appendix SCHWARZ01 is a true and correct copy of the
`
`MARC record for IEEE Transactions on Circuits and Systems for Video
`
`Technology as held by the Carnegie Library of Pittsburgh. I secured this
`
`record myself from the library’s public catalog. The MARC record
`
`contained within Appendix SCHWARZ01 accurately describes the title,
`
`author, publisher, and ISSN number of IEEE Transactions on Circuits and
`
`Systems for Video Technology. The ‘Lib Has’ field of this record visible on
`
`page 2 indicates this collection includes the September 2007 edition of IEEE
`
`Transactions on Circuits and Systems for Video Technology containing
`
`“Overview of the Scalable Video Coding Extension of the H.264/AVC
`
`Standard”.
`
`
`12. Attached hereto as Appendix SCHWARZ02 is a true and correct copy of
`
`“Overview of the Scalable Video Coding Extension of the H.264/AVC
`
`Standard” as published in IEEE Transactions on Circuits and Systems for
`
`
`
`
`
`6
`
`
`
`Video Technology as held by the Carnegie Library of Pittsburgh. I secured
`
`these scans myself from the library’s collection. In comparing Exhibit
`
`SAMSUNG-1010 to Appendix SCHWARZ02, it is my determination that
`
`Exhibit SAMSUNG-1010 is a true and correct copy of “Overview of the
`
`Scalable Video Coding Extension of the H.264/AVC Standard” by Heiko
`
`Schwarz, Detlev Marpe and Thomas Wiegand as published in IEEE
`
`Transactions on Circuits and Systems for Video Technology September
`
`2007.
`
`
`13. The 008 field of the MARC record in Appendix SCHWARZ01 indicates the
`
`date of record creation. The 008 field of Appendix SCHWARZ01 indicates
`
`the Carnegie Library of Pittsburgh first acquired this journal as of July 24,
`
`1990 and held the journal in perpetuity until 2009. Considering this
`
`information, it is my determination that IEEE Transactions on Circuits and
`
`Systems for Video Technology September 2007 and therefore “Overview of
`
`the Scalable Video Coding Extension of the H.264/AVC Standard” was
`
`made available to the public shortly after its initial release in September
`
`2007.
`
`
`14. I have reviewed Exhibit SAMSUNG-1006 “Spatial Scalability Within the
`
`H.264/AVC Scalable Video Coding Extension” by C. Andrew Segall and
`
`
`
`
`
`7
`
`
`
`Gary J. Sullivan as published in IEEE Transactions on Circuits and Systems
`
`for Video Technology, September 2007.
`
`
`15. Attached hereto as Appendix SEGALL01 is a true and correct copy of the
`
`MARC record for IEEE Transactions on Circuits and Systems for Video
`
`Technology as held by the Carnegie Library of Pittsburgh. I secured this
`
`record myself from the library’s public catalog. The MARC record
`
`contained within Appendix SEGALL01 accurately describes the title,
`
`author, publisher, and ISSN number of IEEE Transactions on Circuits and
`
`Systems for Video Technology. The ‘Lib Has’ field of this record visible on
`
`page 2 indicates this collection includes the September 2007 edition of IEEE
`
`Transactions on Circuits and Systems for Video Technology containing
`
`“Spatial Scalability Within the H.264/AVC Scalable Video Coding
`
`Extension”.
`
`
`16. Attached hereto as Appendix SEGALL02 is a true and correct copy of
`
`“Spatial Scalability Within the H.264/AVC Scalable Video Coding
`
`Extension” as published in IEEE Transactions on Circuits and Systems for
`
`Video Technology as held by the Carnegie Library of Pittsburgh. I secured
`
`these scans myself from the library’s collection. In comparing Exhibit
`
`SAMSUNG-1006 to Appendix SEGALL02, it is my determination that
`
`
`
`
`
`8
`
`
`
`Exhibit SAMSUNG-1006 is a true and correct copy of “Spatial Scalability
`
`Within the H.264/AVC Scalable Video Coding Extension” by C. Andrew
`
`Segall and Gary J. Sullivan as published in IEEE Transactions on Circuits
`
`and Systems for Video Technology September 2007.
`
`
`17. The 008 field of the MARC record in Appendix SEGALL01 indicates the
`
`date of record creation. The 008 field of Appendix SEGALL01 indicates the
`
`Carnegie Library of Pittsburgh first acquired this journal as of July 24, 1990
`
`and held the journal in perpetuity until 2009. Considering this information, it
`
`is my determination that IEEE Transactions on Circuits and Systems for
`
`Video Technology September 2007 and therefore “Spatial Scalability Within
`
`the H.264/AVC Scalable Video Coding Extension” was made available to
`
`the public shortly after its initial release in September 2007.
`
`
`18. I have been retained on behalf of the Petitioner to provide assistance in the
`
`above-illustrated matter in establishing the authenticity and public
`
`availability of the documents discussed in this declaration. I am being
`
`compensated for my services in this matter at the rate of $200.00 per hour
`
`plus reasonable expenses. My statements are objective, and my
`
`compensation does not depend on the outcome of this matter.
`
`
`
`
`
`
`
`9
`
`
`
`19. I declare under penalty of perjury that the foregoing is true and correct. I
`
`hereby declare that all statements made herein of my own knowledge are
`
`true and that all statements made on information and belief are believed to
`
`be true; and further that these statements were made the knowledge that
`
`willful false statements and the like so made are punishable by fine or
`
`imprisonment, or both, under Section 1001 of Title 18 of the United States
`
`Code.
`
`
`
`Dated: 1/7/2024
`
`
`
`June Ann Munford
`
`
`
`
`
`10
`
`
`
`APPENDIX CV
`APPENDIX CV
`
`11
`
`
`
`June A. Munford
`Curriculum Vitae
`
`Education
`
`University of Wisconsin-Milwaukee - MS, Library & Information Science, 2009
`Milwaukee, WI
`
`
`● Coursework included cataloging, metadata, data analysis, library systems,
`management strategies and collection development.
`● Specialized in library advocacy, cataloging and public administration.
`
`
`Grand Valley State University - BA, English Language & Literature, 2008
`Allendale, MI
`
` ●
`
` Coursework included linguistics, documentation and literary analysis.
`● Minor in political science with a focus in local-level economics and
`government.
`
`
`
`Professional Experience
`
`Researcher / Expert Witness, October 2017 – present
`Freelance ● Pittsburgh, Pennsylvania & Grand Rapids, Michigan
`
`
`● Material authentication and public accessibility determination.
`Declarations of authenticity and/or public accessibility provided upon
`research completion. Experienced with appeals and deposition process.
`
` ●
`
` Research provided on topics of public library operations, material
`publication history, digital database services and legacy web resources.
`
` ●
`
` Past clients include Alston & Bird, Arnold & Porter, Baker Botts, Fish &
`Richardson, Erise IP, Irell & Manella, O'Melveny & Myers, Perkins-Coie,
`Pillsbury Winthrop Shaw Pittman and Slayden Grubert Beard.
`
`Library Director, February 2013 - March 2015
`Dowagiac District Library ● Dowagiac, Michigan
`
`
`● Executive administrator of the Dowagiac District Library. Located in
`
`12
`
`
`
`Southwest Michigan, this library has a service area of 13,000, an annual
`operating budget of over $400,000 and total assets of approximately
`$1,300,000.
`
`● Developed careful budgeting guidelines to produce a 15% surplus during
`the 2013-2014 & 2014-2015 fiscal years while being audited.
`
`
`
` ●
`
` Using this budget surplus, oversaw significant library investments
`including the purchase of property for a future building site, demolition of
`existing buildings and building renovation projects on the current facility.
`
` Led the organization and digitization of the library's archival records.
`
` ●
`
` ●
`
` Served as the public representative for the library, developing business
`relationships with local school, museum and tribal government entities.
`
` ●
`
` Developed an objective-based analysis system for measuring library
`services - including a full collection analysis of the library's 50,000+
`circulating items and their records.
`
`November 2010 - January 2013
`Librarian & Branch Manager, Anchorage Public Library ● Anchorage, Alaska
`
`
`● Headed the 2013 Anchorage Reads community reading campaign
`including event planning, staging public performances and creating
`marketing materials for mass distribution.
`
` ●
`
` Co-led the social media department of the library's marketing team,
`drafting social media guidelines, creating original content and instituting
`long-term planning via content calendars.
`
` ●
`
` Developed business relationships with The Boys & Girls Club, Anchorage
`School District and the US Army to establish summer reading programs for
`children.
`
`
`June 2004 - September 2005, September 2006 - October 2013
`Library Assistant, Hart Area Public Library
`Hart, MI
`
`
`● Responsible for verifying imported MARC records and original MARC
`
`13
`
`
`
`
`
`cataloging for the local-level collection as well as the Michigan Electronic
`Library.
`
`● Handled OCLC Worldcat interlibrary loan requests & fulfillment via
`ongoing communication with lending libraries.
`
`
`
`Professional Involvement
`
`Alaska Library Association - Anchorage Chapter
`● Treasurer, 2012
`
`
`Library Of Michigan
`● Level VII Certification, 2008
`● Level II Certification, 2013
`
`
`Michigan Library Association Annual Conference 2014
`● New Directors Conference Panel Member
`
`
`Southwest Michigan Library Cooperative
`● Represented the Dowagiac District Library, 2013-2015
`
`
`
`Professional Development
`
`Library Of Michigan Beginning Workshop, May 2008
`Petoskey, MI
`● Received training in cataloging, local history, collection management,
`children’s literacy and reference service.
`
`
`Public Library Association Intensive Library Management Training, October 2011
`Nashville, TN
`● Attended a five-day workshop focused on strategic planning, staff
`management, statistical analysis, collections and cataloging theory.
`
`
`Alaska Library Association Annual Conference 2012 - Fairbanks, February 2012
`Fairbanks, AK
`● Attended seminars on EBSCO advanced search methods, budgeting,
`cataloging, database usage and marketing.
`
`14
`
`
`
`Depositions
`
`2019 ● Fish & Richardson
`Apple v. Qualcomm (IPR2018-001281, 39521-00421IP, IPR2018-01282
`and 39521-00421IP2)
`2019 ● Erise IP
`
`Implicit, LLC v. Netscout Systems, Inc (Civil Action No. 2:18-cv-53-JRG)
`
`2019 ● Perkins-Coie
`
`Adobe Inc. v. RAH Color Technologies LLC (Cases IPR2019-00627,
`
`IPR2019-00628, IPR2019-00629 and IPR2019-00646)
`
`2020 ● O’Melveny & Myers
`
`Maxell, Ltd. v. Apple Inc. (Case No. 5:19-cv-00036-RWS)
`
`2021 ● Pillsbury Winthrop Shaw Pittman LLP
`
`Intel v. SRC (IPR2020-1449)
`2022 ● Perkins-Coie
`
`Realtek v. Future Link (IPR2021-01182)
`2023 ● Fish & Richardson
`
`Neuroderm Ltd. v. Abbvie, Inc (Case No. PGR2022-00040)
`2023 ● Fish & Richardson
`
`Nearmap US Inc. v. Pictometry International Corp. (IPR2022-00735)
`
`
`
`
`
`
`
`15
`
`
`
`Limited Case History & Potential Conflicts
`
`Alston & Bird
`● Ericsson
`
`v. Collision Communications (IPR2022-01233)
`
`
`
`
`
`● Nokia
` v. Neptune Subsea, Xtera (Case No. 1:17-cv-01876)
`
`
`Arnold & Porter
`● Ivantis
` v. Glaukos (Case No. 8:18-cv-00620)
`● Samsung
` v. Jawbone (Case No. 2:21-cv-00186)
`
`
`Benesch Friedlander Coplan & Aronoff
`● Voyis
`
`v. Cathx (Case No. 5:21-cv-00077-RWS)
`Erise I.P.
`
`● Apple
`
`
`v. Ericsson Inc. (IPR2022-00715)
`v. Future Link Systems (IPRs 6317804, 6622108, 6807505, and
`
`7917680)
`v. INVT (Case No. 20-1881)
`v. Navblazer LLC (IPR2020-01253)
`v. Qualcomm (IPR2018-001281, 39521-00421IP, IPR2018-01282,
`39521-00421IP2)
`v. Quest Nettech Corp (Case No. 2:19-cv-00118-JRG)
`v. Telefonaktiebolaget LM Ericsson (IPR2022-00275)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`16
`
`
`
`
`
`● Fanduel
` v. CGT (Case No. 19-1393)
`● Garmin
` v. Phillips North America LLC (Case No. 2:19-cv-6301-AB-KS)
`● Netscout
`
`v. Longhorn HD LLC (Case No. 2:20-cv-00349)
`
`v. Implicit, LLC (Civil Action No. 2:18-cv-53-JRG)
`● Sony Interactive Entertainment LLC
`
`v. Bot M8 LLC (IPR2020-01288)
`
`v. Infernal Technology LLC (Case No. 2:19-CV-00248-JRG)
`● Unified Patents
`
`v. GE Video Compression (Civil Action No. 2:19-cv-248)
`
`
`
`
`Fish & Richardson
`
`● Apple
`
`
`v. AliveCor (3:21-cv-03958)
`v. LBS Innovations (Case No. 2:19-cv-00119-JRG-RSP)
`v. Koss Corporation (IPR2021-00305)
`
`v. Masimo (IPR 50095-0012IP1, 50095-0012IP2, 50095-0013IP1,
`
`50095-0013IP2, 50095-0006IP1)
`
`v. Neonode (Case No. 21-cv-08872-EMC)
`
`v. Qualcomm (IPR2018-001281, 39521-00421IP, IPR2018-01282,
`
`39521-00421IP2)
`
`● Dell
`
`v. Neo Wireless (IPR2022-00616)
`
`
`
`
`
`
`
`
`
`
`
`17
`
`
`
`
`
`
`
`
`
`● Dish Network
`
`v. Realtime Adaptive Streaming (Case No. 1:17-CV-02097-RBJ)
`v. TQ Delta LLC (Case No. 18-1798)
`● Evapco Dry Cooling
`
`v. SPG Dry Cooling (IPR2021-00688)
`● Genetec
`
`v. Sensormatic Electronics (Case No. 1:20-CV-00760)
`● Huawei
` v. Bell Northern Research LLC (IPR2019-01174)
`● Kianxis
` v. Blue Yonder (Case No. 3:20-cv-03636)
`● LG Electronics
` v. Bell Northern Research LLC (Case No. 3:18-cv-2864-CAB-BLM)
`● Metaswitch
` v. Sonus Networks (IPR2018-01719)
`● Microsoft
`
`v. Throughputer Inc (IPR2022-00757)
`● MLC Intellectual Property
` v. MicronTech (Case No. 3:14-cv-03657-SI)
`● Nearmap Inc
`v. EagleView Technologies (IPR2022-01009)
`● Neuroderm Ltd.
`
`v. Abbvie, Inc (Case No. PGR2022-00040)
`● Realtek Semiconductor
` v. Future Link (IPR2021-01182)
`
`18
`
`
`
`● Quectel
` v. Koninklijke Philips (Case No. 1:20-cv-01710)
`● Samsung
`v. Aire Technology (IPR2022-00877)
`v. Bell Northern Research (Case No. 2:19-cv-00286-JRG)
`v. Communication Technologies Inc (IPR2022-01221)
`v. Jawbone Innovations (IPR2022-00865)
`v. MemoryWeb LLC (IPR2022-00885)
`v. Telefonaktiebolaget LM Ericsson (IPR2021-00615)
`● Texas Instruments
`
`v. Vantage Micro LLC (IPR2020-01261)
`● Xilinx
`
`v. Sentient Sensors LCC (Case No. 1:22-cv-00173)
`
`
`Irell & Manella
`
`● Curium
`
`O’Melveny & Myers
`
`● Apple
`
`v. Maxell (Case No. 5:19-cv-00036-RWS)
`
`Perkins-Coie
`
`● Heru Industries
`
`
`v. The UAB Research Foundation (IPR2022-01148)
`● Realtek Semiconductor
` v. Future Link (IPR2021-01182)
`
`19
`
`
`
`● Twitter Inc
`
`v. VOIP-Pal.com (Case No. 3:20-cv-02397-JD)
`● TCL Industries
`
`v. Koninklijke Philips NV (IPR2021-00495, IPR2021-00496
`
` and IPR2021-00497)
`
`Pillsbury Winthrop Shaw Pittman
`
`
`
`
`
`
`
`
`
`
`
`● Gravel Rating Systems
`
`v. Costco (Case No. 4:21-cv-149)
`
`v. Lowe’s Home Centers (Case No. 4:21-cv-150)
`
`v. T-Mobile USA (Case No. 4:21-cv-152)
`
`v. Kohl’s Inc. (Case No. 4:21-cv-258)
`
`v. Under Armor (Case No. 4:21-cv-356)
`
`● Intel
`
`v. FG SRC LLC (Case No. 6:20-cv-00315)
`
`20
`
`
`
`APPENDIX MARTINS01
`APPENDIX MARTINSOI
`
`21
`
`
`
`1/4/24, 7:00 PM
`
`nimbus screenshot app print
`
`screenshot-iiisy1.einetwork.net-2024.01.04-18_59_55
`https://iiisy1.einetwork.net/search~S1?/tIEEE+Transactions+on+Circuits+and+Systems+for+Video+Technology+/tieee+transactions+on+circuits+and+systems+for+video+technology/1%2C1%2C1%2CB/marc&FF=tieee+transactions+on+circuits+and+systems+for+video+technology&1%2C1%2C/indexsort=-
`04.01.2024
`
`chrome-extension://bpconcjcammlapcogcnnelfmaeghhagj/edit.html
`
`1/1
`
`22
`
`
`
`1/4/24, 7:00 PM
`
`nimbus screenshot app print
`
`screenshot-iiisy1.einetwork.net-2024.01.04-18_59_55
`https://iiisy1.einetwork.net/search~S1?/tIEEE+Transactions+on+Circuits+and+Systems+for+Video+Technology+/tieee+transactions+on+circuits+and+systems+for+video+technology/1%2C1%2C1%2CB/marc&FF=tieee+transactions+on+circuits+and+systems+for+video+technology&1%2C1%2C/indexsort=-
`04.01.2024
`
`chrome-extension://bpconcjcammlapcogcnnelfmaeghhagj/edit.html
`
`1/1
`
`23
`
`
`
`APPENDIX MARTINS02
`APPENDIX MARTINSO2
`
`24
`
`
`
`IEEE
`
`|
`
`HTK LAY
`
`ALY
`
`SNES
`
`at
`
`VIDEO
`
`OUSTaS)
`
`TECHNOLOGY
`
`25
`
`
`
`Carnegie
`Libraryof
`Pittsburgh
`
`Science and
`Technology
`Department
`
`26
`
`26
`
`
`
`
`
`— TRANSACTIONS ON
`
`CUITS AND SYSTEMS FOR
`IEO TECHNOLOGY
`IC. TION OF THE IEEE CIRCUITS AND SYSTEMS SOCIETY
`
`5.ORG
`
`R 2002
`
`VOLUME 12
`
`NUMBER9
`
`ITCTEM
`
`(ISSN 1051-8215)
`
`
`
`
`
`
`PAPERS
`ture Design of MPEG-4 Shape Coding. ..... +--+. erseerersrrrtrere sess e eters tases ss
`741
`BPN, ois Frei
`toneiewialavalel Wale araevalaras H.-C. Chang,Y.-C. Chang,Y.-C. Wang, W.-M. Chao, andL.-G.Chen
`jogonal Transforms Designed for Error-Resilient Image Coding .......---+++ D.-M. Chung and Y.Wang=752
`vised Video-Shot Segmentation and Model-Free Anchorperson Detection for News Video Story Parsing. .....
`re a ren ira aun ie
`a
`.sileld @
`into mare me mln a erm serene mp inet ee MNS aX.GaoandX.Tang
`765
`Image and Video Applications in a Multihop Radio EnvironmentUsing Path Diversity and Multiple Description
`BN ny siiiteiedy sl olaow canine milouesriesin tsN. Gogate, D.-M. Chung, S. S. Panwar, and ¥. Wang
`777
`ques for Multi-Resolution Motion Estimation, .......-+++++5 J. Zan, M. O. Ahmad, and M.N.S.Swamy—793
`
`
`JACTIONS LETTERS
`ie d Approach to Restoration, Deinterlacing and Resolution Enhancement in Decoding MPEG-2 Video ........
`no aria a art Sa ad serena Nicos res ¢ EER SeTIN eet OCsB. Martins and S. Forchhammer—803
`
`
`ory-Constrained 3-D Wavelet Transform for Video Coding Without Boundary Effects ......-+-++seteeeeees
`BN as cestn npn GARTH ca. guetta EGR NIMIGNOTS: Sem Dlnica/w Si'elay Suni-orie aiatiece'erace: ai pice J. Xu, Z. Xiong, S. Li,and ¥.-Q.Zhang
`812
`
`gical Representation of DCT Coefficients for Image Compression ........ D. Zhao, W.Gao,and Y.K.Chan
`819
`
`© FOR PAPERS
`Issue on Authentication, Copyright Protection and Information HidINGsoca os cee eens oveee eeles
`
`Issue on Audio and Video Analysis for Multimedia Interactive Services... -
`+ +++ +s ++recrereccrseeeeees
`ue esse mega rieio A Bie iaDK A ain ag (ein wire mW metre Set eRe Sa wm SERN A we rari
`BR hice care wie a dere oh a miteoeselaeosccnatinod ere mis erm Meee Dee sim React /y
`HRS
`ems ess
`
`
`
`
`824
`825
`826827
`
`IEE
`
`
`
`27
`
`27
`
`
`
`5ONCIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 12, NO.9, SEPTEMBER 2002
`
`803
`
`
`
`Bo Martins and Sgren Forchhammer
`
`
`
`
`actions Letters
`
`‘fied Approachto Restoration, Deinterlacing and Resolution Enhancement
`in Decoding MPEG-2 Video
`
`
`
`
`
`¢—The quality and spatial resolution of video can be
`‘combining multiple pictures to form a single super-
`e. We address the special problems associated
`of variable but somehow
`quality
`2G-decoded video. Our algorithm provides a unified
`
`d high-definition TV (HDTV)in 4: 2:0; and 5) progres-
`4:2:0. These conversions also provide features as
`
`ding mosquito noise are effectively suppressed. The
`n pictures obtained by the algorithm are of much
`quality and have lower MSE than superresolution
`ained by simple spatial interpolation.
`Deinterlacing, enhanced decoding, motion-com-
`essing, MPEG-2, SDTV to HDTV conversion, video
`
`At these bit rates, a sequence decoded from an MPEG-2 bit-
`stream is of lower quality than the original digital sequence in
`terms of sharpness and color resolution butstill acceptable (ex-
`cept for very demanding material). This overall reduction of
`quality is less annoying to a human observerthan the artifacts
`typically found in compressed video, The most annoying ar-
`tifacts are ringing artifacts! and in particular mosquito noise,
`which occurs whenthe appearance ofthe ringing changes from
`picture to picture.
`The primary goal of this paper is to improve MPEG-2 de-
`coding, or rather to postprocess the decoded sequencere-using
`information in the MPEG-2 bitstream to obtain a sequence of
`higher fidelity, especially with regard to the artifacts. The re-
`sulting output is a sequence in the same formatas the directly
`decoded one, which in our case is interlaced standard TV in
`4:2:0. In addition, we demonstrate how the approach can be
`used to obtain progressive (deinterlaced) or high-definition TV
`(HDTV) from the same bitstream. This also facilitates features
`such as frame freeze and zoom.
`Previous work on postprocessing includes projections onto
`convex sets (POCS)[3] and regularization [4]. For low-bit-rate
`(high compression)
`JPEG-compressed still
`images
`and
`MPEG-1-coded moving pictures, the main artifact is blocking,
`ie., visible discontinuities at coding block boundaries. This
`artifact can be dealt with efficiently using the POCS frame-
`work [5], as well as by other methods [6]. By regularization,
`POCSconstraints can be combined with “soft” assumptions
`about the sequence. Thus, Choi et al. [4] restored very-low
`bit-rate video encoded by H.261 and H.263 according to the
`following desired (soft) properties: 1) smoothness across block
`boundaries; 2) small distance between the directly decoded
`sequence and the reconstructed sequence; and 3) smoothness
`along motion trajectories. Elad and Feuer [7] presented a
`unified methodology for superresolution restoration requiring
`explicit knowledge of parameters as warping and blurring. As
`this knowledgeis not available in our case, we do not take the
`risk of processing based on estimating such parameters. Patti ef
`al. [8] also addressed the superresolution problem in a general
`setting modeling the system components. They applied POCS
`performing projections for each pixel of each reference image
`in each iteration. Recently [9] this approach was modified to
`obtain superresolution from images of an MPEG-1 sequence
`captured by a specific video camera. Projections were carried
`'Ringingartifacts are caused by the quantization error ofhigh-frequency con-
`tent, ¢.g., at edges. They appear as ringing adjacent to the edge.
`
`
`
`
`
`-2 [1] is currently the most popular method for com-
`ssing digital video. It is used for storing video on
`
`versatile disks (DVDs) and it is used in the contribu-
`
`distribution of video for TV. We base this paper on the
`reference software encoder [2] for which a bit rate of
`s yields a quality which is equivalentto (analog)distri-
`se alternating line (PAL) TV quality. Lowerbit rates
`
`used in TV distribution to save bandwidth and because
`al encoders may provide better quality than the refer-
`ware,
`
`
`
`
`
`received December1, 1999; revised May 2, 2002. This work was
`by The Danish National Centre for IT Research. This paper
`ed by Associate Editor A. Tabatabai.
`was with the Department of Telecommunication, Technical
`of Denmark, DK-2800 Lyngby, Denmark. He is now with
`Atlanta Denmark A/S, DK-2860 Seborg, Denmark (e-mail: bo.mar-
`tl.com).
`is with Research Center COM,371, Technical University of
`immer
`K-2800 Lyngby, Denmark (e-mail: sf@com.dtu.dk).
`er Item Identifier 10.11 09/TCSVT.2002.803227.
`
`1.
`
`INTRODUCTION
`
`1
`
`script
`
`)
`
`ity
`
`
`
`1051-821 5/02$17.00 © 2002 IEEE
`
`28
`
`Fe
`
`28
`
`
`
`techniques (which could be combined with POCS).
`Thestarting point of our work is the sequence decoded by
`an ordinary MPEG-2 decoder[2]. The material to be processed
`in this paper is of higher quality than MPEG-1 material or the
`low-bit-rate material of [4]. Consequently,there is a higherrisk
`ofdegrading the material. Enforcing assumptions ofsmoothness
`of the material will almostsurely lead to a decrease of sharpness.
`The basic idea of our restoration scheme is to apply a conser-
`vative form offiltering along motion trajectories utilizing the
`assumed quality of the pixels on eachtrajectory. The assumed
`quality of each pixel in the decoded sequenceis given by the
`MPEGpicture structure(i.e., what type of motion compensation
`is applied) and the quantization step size for the corresponding
`macroblock.
`Thealgorithm has two steps. In thefirst step, a superreso-
`lution version (default is quadruple resolution) of each directly
`decoded picture? is constructed. In the second Step, the super-
`resolution picture is decimatedto the desired format, Depending
`on the degree of decimation of the chrominance and luminance
`in the secondstep, the problem addressed is one ofrestoration,
`chrominance upsampling, deinterlacing,or resolution enhance-
`ment, e.g., conversion to HDTV.The aim in restorationis to en-
`hance the decoding quality. Forthe other applications,the reso-
`lution is also enhanced.
`:
`In thefirst part of the upsampling,directly decoded pixels are
`placed very accurately in a superresolution picture before fur-
`ther processing. This approachis motivated by the fact that the
`individual pictures of the original sequence are undersampled
`[9], [10]. We do not wantto trade resolution for improved peak
`signal-to-noise ratio (PSNR)by spatial filtering at this stage so
`the noise reducingfiltering is deferred to the decimation step.
`The paperis organized as follows. In Section Il, a quality
`value is assigned to each pixel in the decoded sequence. Part
`one (upsampling) of our enhancementalgorithm is described in
`Section III. The second part (decimation) is described in Sec-
`tion IV, Results on a numberoftest sequences are presented in
`Section V.
`
` out in the transform domain. Our goal is to develop simpler
`for all n, m within the DCT block having coefficients C(/. J):
`
`This expression may underestimate the erroras it neglects the
`influenceofthe dead zone, andit may overestimate the erroras
`the distribution of C(7, ) is usually quite peaked around zero,
`especially for the highfrequencies.
`The DCT transform is unitary (when appropriate scaling is”
`applied). Thus, the sum of squares over a block is the same in
`the DCT and spatial domains. Applyingthis to the quantization
`errors and introducing the expected values gives the following
`relationship for each DCT block:
`m=7,n=7
`
`m=0,n=0
`
`a E{(x(m n) — X(m, m)}
`= Yef j)- Oli, d)}
`
`
`
`A. Quality Measurefor Pixels in an MPEG Sequence
`From the MPEG code stream, the type (I, P. or By.
`quantization step size are extracted for each macroblock, Baca.
`on this information, we shall estimate a quality Parameterut
`each pixel which is used in a motion-compensated MC) fi.
`tering. MPEG specifies the code-stream syntax but not the en.
`coder itself. Our work is based on the reference MPEG-2 son
`ware encoder [2], for which the quantizers may be ch
`a
`ized as follows. The nonintraquantizer used for DCT coefficieng.
`O(?, j) is (very close to) a uniform quantizer with quantizatio,
`step q, and a deadzone of 2q, aroundzero. Theintra quantizer
`used for DCT coefficient C(i, j) has a deadzone of$/ (i, j)
`around zero. For larger values, it is a uniform quantizer with
`quantization step q,(7, j), and the dequantizer reconstruction
`point has a bias of 1/8 g,(i, 7) toward zero.In [2], as is usually
`the case, all DCT coefficients in all blocks are being quantized
`independently as scalars.
`The mean-squared error (MSE) caused by the quantization
`depends onthe distribution of C(i, j). This distribution varies
`with the image content and is hard to estimate accurately. We
`may approximate the expected error by the expressionfora uni-
`form distribution oferrors, within each quantization interval, re
`sulting from a uniform quantizer with quantization step q, ap-
`plied to C'(i, j)
`
`E{(cW.9 ne (i. i))} = at
`
`(1)
`
`Tl. PROCESSING BASED ON MPEG-QUALITY
`MPEG-2 [1] partitionsa picture into 16x 16 blocks of picture
`material (macroblocks). A macroblockis usually predicted from
`one or more reference pictures. The different types of pictures
`are referred to as I, P, and B pictures.I pictures are intracoded,
`i.e., n
Accessing this document will incur an additional charge of $.
After purchase, you can access this document again without charge.
Accept $ ChargeStill Working On It
This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.
Give it another minute or two to complete, and then try the refresh button.
A few More Minutes ... Still Working
It can take up to 5 minutes for us to download a document if the court servers are running slowly.
Thank you for your continued patience.
This document could not be displayed.
We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.
Your account does not support viewing this document.
You need a Paid Account to view this document. Click here to change your account type.
Your account does not support viewing this document.
Set your membership
status to view this document.
With a Docket Alarm membership, you'll
get a whole lot more, including:
- Up-to-date information for this case.
- Email alerts whenever there is an update.
- Full text search for other cases.
- Get email alerts whenever a new case matches your search.
One Moment Please
The filing “” is large (MB) and is being downloaded.
Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.
Your document is on its way!
If you do not receive the document in five minutes, contact support at support@docketalarm.com.
Sealed Document
We are unable to display this document, it may be under a court ordered seal.
If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.
Access Government Site