Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`
`
`Nikon Corporation, Panasonic Entertainment & Communication Co., Ltd.,
`Olympus Corporation, OM Digital Solutions Corporation, FUJIFILM North
`America Corporation, FUJIFILM Corporation,
`Petitioners,
`v.
`Optimum Imaging Technologies LLC,
`Patent Owner.
`
`____________________________
`
`Case IPR2024-01372
`
`Patent No. 8,451,339
`
`____________________________
`
`PETITION FOR INTER PARTES REVIEW
`OF U.S. PATENT NO. 8,451,339
`
`
`
`
`
`
`
`
`
`
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`TABLE OF CONTENTS
`
`I.
`II.
`
`
`
`
`
`
`
`Page
`
`
`Introduction ..................................................................................................... 1
`Requirements for IPR ..................................................................................... 3
`Standing ................................................................................................ 3
`
`Challenge and Relief Requested .......................................................... 3
`
`III. Overview Of The ’339 Patent ......................................................................... 4
`Summary .............................................................................................. 4
`
`Relevant Prosecution History ............................................................... 5
`Priority Date ......................................................................................... 6
`Level of Ordinary Skill in the Art ........................................................ 7
`Claim Construction .............................................................................. 7
`
`IV. Prior Art Overview ......................................................................................... 7
` Niikawa................................................................................................. 7
` Matsutani ............................................................................................ 13
`Enomoto ............................................................................................. 15
`
`Ito ........................................................................................................ 16
`Shiomi................................................................................................. 16
`Enomoto II .......................................................................................... 17
`
`The Challenged Claims Are Unpatentable ................................................... 18
` Grounds 1(a) and 1(b) ........................................................................ 18
`1.
`Independent Claim 1 ................................................................ 18
`2.
`Claim 2 ..................................................................................... 43
`3.
`Claim 3 ..................................................................................... 43
`4.
`Claim 5 ..................................................................................... 46
`5.
`Independent Claim 14 .............................................................. 49
`6.
`Claim 15 ................................................................................... 54
`7.
`Claim 17 ................................................................................... 55
`
`
`
`
`
`V.
`
`-i-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`
`
`
`
`
`
`
`
`TABLE OF CONTENTS
`Page
`
`8.
`Claim 18 ................................................................................... 55
`Grounds 2(a) and 2(b) ........................................................................ 56
`1.
`Claim 4 ..................................................................................... 56
`2.
`Claim 16 ................................................................................... 58
`Ground 3 ............................................................................................. 59
`1.
`Independent Claim 1 ................................................................ 59
`2.
`Claim 2 ..................................................................................... 72
`3.
`Independent Claim 14 .............................................................. 73
`4.
`Claim 15 ................................................................................... 77
`5.
`Claim 17 ................................................................................... 78
` Ground 4. ............................................................................................ 78
`1.
`Claim 3 ..................................................................................... 78
`2.
`Claim 5 ..................................................................................... 81
`3.
`Claim 18 ................................................................................... 83
`Ground 5 ............................................................................................. 83
`1.
`Claim 4 ..................................................................................... 83
`2.
`Claim 16 ................................................................................... 84
`Secondary Considerations of Non-Obviousness ................................ 84
`
`VI. Discretionary Denial is Unwarranted ........................................................... 85
` General Plastic Favors Institution ..................................................... 85
`Sotera Stipulations Moot Fintiv ......................................................... 87
`
`35 U.S.C. § 325(d).............................................................................. 87
`
`VII. Payment of Fees ............................................................................................ 87
`VIII. Mandatory Notices ........................................................................................ 88
`Real Party-in-Interest ......................................................................... 88
`
`Related Matters ................................................................................... 88
`
`
`
`
`
`-ii-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`
`
`TABLE OF CONTENTS
`Page
`
`1.
`U.S. District Court for the Eastern District of Texas. .............. 88
`U.S. District Court for the Western District of Texas ............. 88
`2.
`U.S. District Court for the Northern District of California...... 89
`3.
`Notice of Counsel and Service Information ....................................... 89
`
`IX. Conclusion .................................................................................................... 90
`
`
`
`-iii-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`TABLE OF EXHIBITS
`
`Exhibit
`Ex-1001
`Ex-1002
`Ex-1003
`Ex-1004
`Ex-1005
`Ex-1006
`
`Ex-1007
`Ex-1008
`Ex-1009
`
`Ex-1010
`Ex-1011
`
`Ex-1012
`Ex-1013
`Ex-1014
`Ex-1015
`Ex-1016
`Ex-1017
`Ex-1018
`Ex-1019
`Ex-1020
`Ex-1021
`
`Ex-1022
`Ex-1023
`Ex-1024
`Ex-1025
`
`Ex-1026
`
`Description
`U.S. Pat. No. 8,451,339 (“’339 Patent”)
`Prosecution History of the ’339 Patent Sans NPL
`Declaration of Expert Witness, Dr. Robert L. Stevenson
`Curriculum Vitae of Expert Witness, Dr. Robert L. Stevenson
`U.S. Pat. App. Pub. No. 2002/0135688 (“Niikawa”)
`Certified Translation of Japanese Pat. App. Pub. No. 2004-
`266768 (“Matsutani”)
`Japanese Pat. App. Pub. No. 2004-266768 (“Matsutani-JP”)
`U.S. Pat. No. 6,323,934 (“Enomoto”)
`Certified Translation of Japanese Pat. App. Pub. No. H6-113309
`(“Ito”)
`Japanese Pat. App. Pub. No. H6-113309 (“Ito-JP”)
`Certified Translation of Japanese Pat. App. Pub. No. H5-3568
`(“Shiomi”)
`Japanese Pat. App. Pub. No. H5-3568 (“Shiomi-JP”)
`U.S. Pat. No. 7,245,319 (“Enomoto II”)
`U.S. Patent No. 9,063,982 (“Bestgen”)
`U.S. Patent No. 6,920,443 (“Cesare”)
`U.S. Pat. No. 7,612,805 (“’805 Patent”)
`U.S. Pat. No. 5,276,519 (“Richards”)
`U.S. Pat. No. 6,862,373 (“Enomoto III”)
`Prosecution History of the ’805 Patent
`U.S. Pat. No. 5,477,264 (“Sarbadhikari”)
`Certified Translation of Japanese Pat. App. Pub. No. H11-
`205652 (“Ichiyama”)
`Japanese Pat. App. Pub. No. H11-205652 (“Ichiyama-JP”)
`U.S. Patent No. 7,683,950 (“Kelly”)
`Sotera Stipulation for Petitioners
`Certified Translation of Ricoh Technical Report No. 31, RICOH
`(Apr.
`20,
`2006),
`https://web.archive.org/web/20060420051054/http:/www.ricoh.
`co.jp/about/business_overview/report/31/ (“Ricoh”)
`Ricoh Technical Report No. 31, RICOH (Apr. 20, 2006),
`https://web.archive.org/web/20060420051054/http:/www.ricoh.
`co.jp/about/business_overview/report/31/ (“Ricoh-JP”)
`
`-iv-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`Limitation
`[1pre]
`
`[1A-1]
`[1A-2]
`[1A-3]
`[1A-4]
`[1A-5]
`[1A-6]
`[1A-7]
`[1A-8]
`[1B]
`[1C]
`
`[1D]
`
`[1E]
`
`[1F]
`
`[1G]
`
`[2]
`
`[3pre]
`[3A]
`[3B]
`
`image
`
`LIST OF CHALLENGED CLAIMS
`Claim Language
`A digital
`imaging system for correcting optical
`aberrations comprising:
`a digital camera mechanism,
`an optical lens mechanism,
`a digital sensor,
`a microprocessor,
`a digital signal processor,
`system software,
`a database management system and
`a memory storage sub-system;
`wherein the optical lens mechanism is a fixed focal length lens;
`wherein a microprocessor uses system software to identify at
`least one optical aberration by accessing the database;
`wherein the microprocessor uses the database to identify at least
`one algorithm to use to correct the at least one optical aberration;
`wherein when the image file is captured by the digital sensor the
`digital file is forwarded to the digital signal processor;
`wherein the image file with the at least one optical aberration is
`corrected by applying digital filtration by using at least one
`algorithm in the digital signal processor; and
`wherein the modified digital file consisting of the digital data
`optimized from the at least one optical aberration that are
`corrected from the original optical image is stored in memory.
`The system of claim 1: wherein the optical aberrations include
`at least one of spherical, comatic, lens distortion, astigmatism,
`curvature of field, pin cushion, barrel distortion, chromatic
`aberrations, scattered light, red eye, dust and/or flare types of
`optical aberrations.
`The system of claim 1:
`wherein the optical aberration is vignetting;
`wherein the digital signal processor applies neutral density
`filtration from one third of a stop to three stops in the center of
`the image and/or wherein the digital signal processor applies an
`algorithm to lighten the corners of the image or the digital signal
`processor applies both neutral density filtration in the image
`
`-v-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`[3C]
`
`[4]
`
`[5pre]
`[5A]
`[5B]
`
`[5C]
`
`[5D]
`
`[5E]
`
`[14pre]
`
`[14A-1]
`[14A-2]
`[14A-3]
`[14A-4]
`[14A-5]
`[14A-6]
`[14A-7]
`[14A-8]
`[14B]
`[14C]
`[14D]
`
`[14E]
`
`[14F]
`
`center and/or an algorithm to lighten the corners of the image;
`and
`wherein the image exposure is optimized to correct the
`vignetting.
`The system of claim 1: wherein the digital signal processor
`applies at least one fast Fourier transform (FFT) algorithm to
`correct the at least one optical aberration.
`The system of claim 1:
`wherein each lens type is registered in the camera database;
`wherein the multiple optical aberrations of each lens is listed in
`the database;
`wherein the filtration solutions to the lens optical aberrations are
`listed in the database;
`wherein the filtration of each lens optical aberration is applied
`by the digital signal processor; and
`wherein after the digital signal processor applies the filtration to
`correct the optical aberrations the corrected digital file is
`forwarded to storage in memory.
`A digital imaging system for correcting image aberrations
`comprising:
`a digital camera mechanism,
`an optical lens mechanism,
`a digital sensor,
`a microprocessor,
`a digital signal processor,
`system software,
`a database management system and
`a memory storage sub-system;
`wherein the optical lens mechanism is a zoom lens;
`wherein the zoom lens changes focal length positions;
`wherein when the image file is captured by the digital sensor the
`file is forwarded to the digital signal processor and to memory;
`wherein the microprocessor uses system software to access the
`database to identify at least one optical aberration in the image
`file at any focal length of a zoom lens configuration;
`wherein the microprocessor accesses the database to obtain at
`least one filtration correction algorithm to the optical aberrations
`
`-vi-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`and forwards the at least one filtration algorithms to the digital
`signal processor;
`wherein the image file is forwarded to the digital signal
`processor which applies at least one filtration algorithm to
`optimize the image and corrects the at least one optical
`aberration at the specific focal length in the zoom lens
`configuration; and
`wherein the modified image file consisting of the digital data
`optimized from the at least one optical aberration of a specific
`focal length of the zoom lens that are corrected from the original
`optical image is stored in memory.
`The system of claim 14: wherein the optical aberrations include
`vignetting, spherical, comatic,
`lens distortion, chromatic
`aberrations, curvature of field, pin cushion, barrel distortion,
`scattered light, red eye, dust and/or flare types of optical
`aberrations.
`The system of claim 14: wherein the digital signal processor
`applies a fast Fourier transform (FFT) algorithm to correct
`optical and/or digital aberrations.
`The system of claim 14: wherein each focal length of a zoom
`lens is analyzed for a different set of optical aberrations.
`The system of claim 14:
`wherein the optical aberration is vignetting;
`wherein the digital signal processor applies neutral density
`filtration from one third of a stop to three stops in the center of
`the image and/or wherein the digital signal processor applies an
`algorithm to lighten the corners of the image or the digital signal
`processor applies both neutral density filtration in the image
`center and/or an algorithm to lighten the corners of the image;
`and
`wherein the image exposure is optimized to correct the
`vignetting.
`
`[14G]
`
`[14H]
`
`[15]
`
`[16]
`
`[17]
`
`[18pre]
`[18A]
`[18B]
`
`[18C]
`
`
`
`
`-vii-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`I.
`
`Introduction
`Digital cameras capture images by an image sensor receiving light that passes
`
`through a lens, processing the data from the image sensor, and storing the image in
`
`memory. The image quality of the stored image may be adversely affected by
`
`distortions and artifacts caused by lenses. These adverses effects are known as
`
`“aberrations.” Such aberrations include “vignetting,” where less light is received at
`
`the edge of the image, causing the edges to be shaded.
`
`Techniques for correcting aberrations were well known. Acknowledging that
`
`correcting aberrations post-production (e.g., using Photoshop on a computer) was
`
`well known (Ex-1001, 6:31-36), the ’339 Patent describes and claims using well-
`
`known aberration correcting techniques in the camera itself utilizing the components
`
`of a camera, including (i) a lens (purple), (ii) a digital sensor (orange), (iii) a digital
`
`signal processor (yellow), (iv) a microprocessor (red), (v) software, (vi) a database
`
`management system (green), and (vii) a memory (grey).
`
`-1-
`
`
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`But correcting aberrations in-camera had been known for years. For example,
`
`Niikawa discloses a digital camera that corrects vignetting using the components of
`
`the camera. Like the ’339 Patent, Niikawa discloses correcting aberrations in a
`
`camera using a (i) lens (purple), (ii) CCD image sensor (orange), (iii) shading
`
`corrector processor (yellow), (iv) general controller (red), (v) programs stored in the
`
`general controller’s memory (brown), (vi) correction tables stored in the general
`
`controller’s shading ROM (green), and (vii) memory (grey).
`
`
`
`As detailed herein, correcting aberrations in camera was not novel as taught
`
`by Niikawa, Matsutani, and many other references. And implementing well-known
`
`aberration techniques in camera was certainly obvious. Thus, trial should be
`
`instituted and claims 1-5 and 14-18 (“Challenged Claims”) should be cancelled.
`
`-2-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`II. Requirements for IPR
`
`Standing
`Petitioners certify that the ’339 Patent is available for IPR, and that Petitioners
`
`are not barred or estopped from requesting this review.
`
` Challenge and Relief Requested
`Petitioners rely on the following references that qualify as prior art under 35
`
`U.S.C. §102(b):
`
`• Niikawa (Ex-1005) published on September 26, 2002.
`
`• Matsutani (Ex-1006) published on September 24, 2004.
`
`• Enomoto (Ex-1008) issued on November 27, 2001.
`
`• Ito (Ex-1009) published on April 22, 1994.
`
`• Shiomi (Ex-1011) published on January 8, 1993.
`
`Petitioners rely on Enomoto II (Ex-1013), which was filed on June 11, 1999
`
`and issued on July 17, 2007, and thus qualifies as prior art under 35 U.S.C. § 102(e).
`
`Petitioners request that the Challenged Claims be determined unpatentable
`
`and cancelled on the following grounds:
`
`Ground 1(a): Claims 1, 3, and 5 are obvious over Niikawa.
`
`Ground 1(b): Claims 1-3, 5, 14-15, and 17-18 are obvious over Niikawa in
`
`view of Enomoto.
`
`Ground 2(a): Claim 4 is obvious over Niikawa in view of Ito.
`
`-3-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`Ground 2(b): Claims 4 and 16 are obvious over Niikawa in view of Enomoto
`
`and Ito.
`
`Ground 3: Claims 1-2, 14-15 and 17 are obvious over Matsutani in view of
`
`Shiomi.
`
`Ground 4: Claims 3, 5 and 18 are obvious over Matsutani in view of Shiomi
`
`and Enomoto II.
`
`Ground 5: Claims 4 and 16 are obvious over Matsutani in view of Shiomi
`
`and Ito.
`
`This Petition is supported by the Declaration of Dr. Robert L. Stevenson (Ex-
`
`1003).
`
`III. Overview Of The ’339 Patent
`
`Summary
`The ’339 Patent discloses in-camera digital corrections to aberrations. Ex-
`
`1001, 8:3-4. The ’339 Patent admits that existing optical technologies reliably
`
`corrected for imaging aberrations, asserting that those technologies lacked “in-
`
`camera modification capabilit[ies] for each specific image problem.” Id., 6:54-58;
`
`see also 1:37-45, 2:38-56, 3:25-26, 3:40-53, 4:25-38, 5:6-35, 6:18-30.
`
`The patent describes a digital camera capable of identifying and correcting for
`
`optical image aberrations. Id., claim 1. The camera includes (i) an optical lens
`
`mechanism (e.g., lens 110, purple), (ii) a digital sensor (e.g., digital sensor 175 or
`
`-4-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`180, orange), (iii) a digital signal processor (e.g., DSP 195, yellow), (iv) a
`
`microprocessor (e.g., microprocessor 193, red), (v) a database management system
`
`(e.g., DBMS 190, green), and (vi) a memory storage sub-system (e.g., storage 197,
`
`grey). See id., claim 1; Ex-1003, ¶¶71-72.
`
`Ex-1001, Fig. 1.
`
`
`
`
`Relevant Prosecution History
`During prosecution, the Examiner took official notice that many claimed
`
`elements were “old and well known in the art,” including: “a system wherein the
`
`digital signal processor applies at least one FFT algorithm to correct the at least one
`
`optical aberration,” “the digital signal processor applies color filtration to the image
`
`file,” “the optical lens mechanism is a zoom lens,” “the zoom lens changes focal
`
`length positions on a continuous scale,” and “each focal length of a zoom lens is
`
`analyzed for a different set of optical aberrations.” Ex-1002, 136-139, 143.
`
`-5-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`In response, the applicant acknowledged that a “microprocessor is a CPU that
`
`controls the computing functions [in a digital] camera,” that “[t]he CPU may use
`
`memory circuits (DRAM, EPROM, EEPROM, Flash memory) in order to store and
`
`access data to perform a set of control functions,” that “a digital signal processor
`
`(DSP) … is used to process a digital image file,” and that “[a] DSP may be used to
`
`process these digital filter components in order to eliminate digital or color artifacts
`
`related to specific image sensor pixels.” Id., 120-121. The applicant also
`
`acknowledged that “the applicant does not claim to invent” “the FFT algorithm,”
`
`and in reference to the FFT algorithm, that “[t]here is no reason not to include a
`
`powerful class of algorithm to the toolbox in order to solve the aberrations.” Id.,
`
`123.
`
`A notice of allowance issued after the applicant’s response. Id., 82. The ’339
`
`Patent issued on May 28, 2013.
`
`Niikawa, Enomoto, Ito, Matsutani, Shiomi, and Enomoto II were not cited
`
`during prosecution of the ’339 Patent.
`
`
`Priority Date
`For purposes of this proceeding only, Petitioners assume that the provisional
`
`application’s filing date, July 11, 2006, is the priority date (“Priority Date”). This is
`
`before March 16, 2013, so the pre-AIA statute applies.
`
`-6-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
` Level of Ordinary Skill in the Art
`A person having ordinary skill in the art (“POSA”) would have had a
`
`bachelor’s degree in electrical engineering, physics, or a related field, with at least
`
`two years of industry experience and/or research, both concerning digital camera
`
`system design and image processing. Ex-1003, ¶¶50-52.
`
` Claim Construction
`Petitioners believe that the plain and ordinary meanings suffice and no further
`
`constructions are needed to resolve the issues presented in this Petition. Ex-1003,
`
`¶53.
`
`IV. Prior Art Overview
` Niikawa
`Niikawa discloses an image processing apparatus, e.g., a digital camera, having
`
`a lens 3 and CCD sensor 303, that performs shading correction on images, which is
`
`a form of image aberration correction. See, e.g., Ex-1005, Abstract, [0067]. “When
`
`an image is captured via a lens in a digital camera or the like, so-called ‘shading’
`
`[occurs meaning] that the level of image data decreases with distance from the center
`
`of the image to the periphery.” Id., [0012], see also id., [0056].
`
`Figure 1 depicts an example of how shading can influence an image captured
`
`using a digital camera with lenses at different focal lengths and “f-numbers.” Id.,
`
`-7-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`[0057]-[0060]. As shown in Figure 1, focal length (represented in mm) and f-
`
`number influence shading. Id., [0060].
`
`Ex-1005, Fig. 1.
`
`
`
`Niikawa teaches a signal processor 120 with a shading corrector that corrects
`
`shading due to optical conditions. Ex-1005, [0082], Claims 1, 2, 4, 5. The shading
`
`corrector works with general controller 150 (red) and shading ROM 153 (green) to
`
`correct the shading aberration in each image. Niikawa discloses that the shading
`
`corrector may be implemented as a hardware circuit, as in shading correction circuit
`
`123 (of original Figure 5), or the shading corrector may be implemented using a
`
`processor (shown in yellow in amended Figure 5 below). Id., [0030], [0078]-[0079],
`
`[0082], [0108], [0110], [0122], Figs. 5-6, Claims 1, 2, 4, 5.
`
`-8-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`
`
`Ex-1005, Fig. 5 (with shading corrector processor).
`
`Specifically, claim 1 of Niikawa recites a “shading corrector.” Ex-1005,
`
`Claim 1. Claim 2 of Niikawa, which is dependent on claim 1, recites that the
`
`“shading corrector” can be implemented as a “coefficient processing hardware
`
`circuit.” Id., Claim 2. Alternatively, claim 5 of Niikawa, which is dependent on
`
`claim 4, which depends from claim 1, recites that the “shading corrector” can be
`
`implemented as a “processor.” Id., Claim 4, 5. Thus Niikawa discloses that the
`
`shading corrector can be implemented as either a hardware circuit or a processor.
`
`Ex-1003, ¶81.
`
`-9-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`
`Although the implementation depicted in Figure 5 of Niikawa discloses the
`
`hardware circuit implementation, a POSA reading Niikawa would have understood
`
`that the embodiment of Figure 5 could equally be implemented using the disclosed
`
`processor implementation. Ex-1003, ¶82. At a minimum, it would have been
`
`obvious to a POSA to use a processor to perform the shading correction
`
`functionality. Id. Such motivation is provided by Niikawa’s claims themselves. Id.
`
`Additional motivations are explained further below.
`
`The general controller 150 includes programs for controlling camera functions
`
`and the components of the digital camera 1. Ex-1005, [0096]. Based on the optical
`
`conditions of the lens, such as focal length and f-number, the general controller 150
`
`selects a “correction table” with inverse correction coefficients from shading ROM
`
`153 to send to the shading corrector. Id., [0082], [0084], [0108].
`
`Figure 7 shows an example correction table used for shading correction. Id.,
`
`[0031], [0083]. “As shown in [Figure 7], the correction table has 1,920,000
`
`correction coefficients
`
`(actually,
`
`inverses of correction coefficients)
`
`for
`
`corresponding to the respective 1,920,000 pixels of 1,600 pixels×1,200 pixels of the
`
`[image pickup device] CCD 303.” Id., [0056], [0083]. “Each correction coefficient
`
`corresponds to the rate of decrease in level of each pixel data shown in FIG. 1, and
`
`the inverse of the correction coefficient is held in the correction table in advance.”
`
`Id. “When each pixel shown in the curve of FIG. 1 is multiplied by the inverse of
`
`-10-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`the correction coefficient, the curve is converted to a straight line in which the levels
`
`of image data are constantly 1. That is, by subjecting every pixel data to the
`
`multiplication by the inverse of the correction coefficient (coefficient process), the
`
`shading can be corrected.” Id.
`
`Ex-1005, Fig. 7.
`
`
`
`After signal processor 120 finishes processing the image, the signal processor
`
`forwards the image data to image memory 126 (orange) for temporary storage. Ex-
`
`1005, [0087], [0092]. The image data is stored in image memory 126 (orange) and/or
`
`memory card 8 (purple). Id., [0093], [0100]; see also id., Fig. 8 (depicting a recording
`
`method of image files onto the memory card 8), Fig. 15 (depicting a configuration
`
`-11-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`example of an image file stored in memory card 8), [0032], [0040], [0095] (disclosing
`
`that general controller 150 is connected to memory card 8 via card interface 103),
`
`[0101] (describing Fig. 8), [0149] (describing Fig. 15).
`
`
`
`Ex-1005, Fig. 5 (with shading corrector processor).
`
`Niikawa is analogous art at least because it is in the same field of endeavor as
`
`the ’339 Patent, i.e., digital signal processing techniques, such as aberration
`
`correction, for imaging systems like digital and video cameras. Compare Ex-1001,
`
`1:16-33 with Ex-1005, Abstract, [0003], [0065]. Niikawa also is reasonably pertinent
`
`-12-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`to the problem to be solved: correcting image aberrations in-camera. Id. Niikawa
`
`and the ’339 Patent both list the H04N subclass under the International
`
`Classification. Ex-1003, ¶¶78-86.
`
` Matsutani
`Matsutani describes a digital camera that “reads out the correction data from
`
`a memory…and transfers it to the image processing unit” that “performs a
`
`convolution operation” and “enables correction of various aberrations in the image
`
`data that are caused by the optical mechanism.” Ex-1006, Abstract, [0008], [0029]-
`
`[0030]. The camera includes a CPU and real-time processing circuit (RPU). Id.,
`
`[0026]-[0030], Figs. 1, 2.
`
`Figure 1 discloses a digital camera 1 with optical mechanism (lens) 10
`
`(yellow), an image sensor 11 (blue), working with analog signal processing circuit
`
`12 that includes an A/D converter (blue), for producing a digital image signal, a
`
`control unit 22 having a CPU (gray), a real-time processing circuit (RPU) 21 (purple)
`
`for performing image processing to correct aberrations, a software program stored
`
`in a ROM 15, a direct memory access controller (DMAC) 23 that operates with the
`
`control unit 22, a memory interface 27, a RAM 14 and the ROM 15 to access a
`
`database of aberration correction coefficients and transfer certain coefficients to the
`
`RPU 21, a system (orange) for accessing said database, and a RAM 14 (green) and
`
`-13-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`card memory (not shown but connectable through card interface 25) (green). Id.,
`
`[0023]-[0032].
`
`
`
`
`
`
`
`Ex-1006, Fig. 1.
`Matsutani is analogous art at least because it is in the same field of endeavor
`
`as the ’339 Patent, i.e., digital signal processing techniques, such as aberration
`
`correction, for imaging systems like digital and video cameras. Compare Ex-1001,
`
`1:16-33 with Ex-1006, Abstract, [0008], [0029]-[0030]. Matsutani also is
`
`reasonably pertinent to the problem to be solved: correcting image aberrations in-
`
`-14-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`camera. Id. Matsutani and the ’339 Patent both list H04N under the International
`
`Classification. Ex-1003, ¶¶87-89.
`
` Enomoto
`Enomoto discloses an image processing apparatus with a storage section for
`
`storing lens characteristics associated with the type of lens and a correcting section
`
`which receives the corresponding lens characteristics from the storage section and
`
`corrects at least one aberration selected from among lateral chromatic aberration,
`
`distortion, decrease in brightness of the edge of image field, and image blurring. Ex-
`
`1008, Abstract, 1:5-19. Enomoto also discloses that the image processing apparatus
`
`14, “which obtains input image data from an image recorded optically with a taking
`
`lens,” can comprise the image reading apparatus 12, e.g., a digital camera. Id.,
`
`11:35-52, Figs. 1, 2, 5, 8, 10, 12, Claims 11, 31, 34. The storage section can include
`
`a database, and the lens information stored in the database may be either correction
`
`functions/equations and/or coefficients for correcting lateral chromatic aberration and
`
`distortion. Id., 14:4-49.
`
`Enomoto is analogous art at least because it is in the same field of endeavor
`
`as the ’339 Patent, i.e., digital signal processing techniques, such as aberration
`
`correction, for imaging systems like digital and video cameras. Compare Ex-1001,
`
`1:16-33 with Ex-1008, Abstract, 1:5-19. Enomoto also is reasonably pertinent to the
`
`problem to be solved: correcting image aberrations in-camera. Specifically,
`
`-15-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`Enomoto corrects various aberrations for specific lens characteristics used with
`
`digital cameras. Ex-1008, Abstract, 1:5-19, 11:35-52. Enomoto and the ’339 Patent
`
`both list H04N under the International Classification. Ex-1003, ¶¶90-91.
`
`
`Ito
`Claims 4 and 16 of the ’339 Patent disclose “wherein the digital signal
`
`processor applies at least one fast Fourier transform (FFT) algorithm to correct the
`
`at least one optical aberration.” Ito discloses using a fast Fourier transform (“FFT”)
`
`as the chromatic aberration correction that is applied by digital signal processing.
`
`Ex-1009, ¶17.
`
`Ito is analogous art at least because it is in the same field of endeavor as the
`
`’339 Patent, i.e., digital signal processing techniques, such as aberration correction,
`
`for imaging systems like digital and video cameras. Compare Ex-1001, 1:16-33 with
`
`Ex-1009, [0006]. Ito also is reasonably pertinent to the problem to be solved:
`
`correcting image aberrations in-camera. Id. Ito and the ’339 Patent both list H04N
`
`under the International Classification. Ex-1003, ¶¶92-93.
`
`
`Shiomi
`Shiomi describes a video camera device that corrects chromatic aberration
`
`resulting from the use of a zoom lens. Ex-1011, Abstract. Shiomi discloses tables
`
`that store tables of “aberration correction coefficients” indexed to “focal length
`
`-16-
`
`

`

`Petition for Inter Partes Review of
`U.S. Patent No. 8,451,339
`
`inform