a2) United States Patent
`US 6,323,934 B1
`(10) Patent No.:
`
` Enomoto (45) Date of Patent: *Nov. 27, 2001
`
`
`US006323934B1
`
`(54)
`
`IMAGE PROCESSING METHOD AND
`APPARATUS
`
`(75)
`
`Inventor:
`
`Jun Enomoto, Kanagawa (JP)
`
`6/1999 Nakamuraccc 355/40
`5,917,578 *
`5,990,947 * 11/1999 Okino et al. eee eee 348/240
`6,005,987 * 12/1999 Nakamura et al... 382/294
`
`(73) Assignee: Fuji Photo Film Co., Ltd., Kanagawa
`(JP)
`
`* cited by examiner
`
`(*) Notice:
`
`This patent issucd on a continued pros-
`ecution application filed under 37 CFR
`1.53(d), and is subject to the twenty year
`patent
`term provisions of 35 U.S.C.
`154(a)(2).
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`Primary Examiner—Russell Adams
`Assistant Examiner—khaled Brown
`
`(57)
`
`ABSTRACT
`
`An image processing method in which at least one aberra-
`tion of an optically recorded image selected from among
`lateral chromatic aberration, distortion, decrease in the
`brightness of the edge of image field and imageblurring is
`corrected based on lens characteristics of a taking lens and
`position information of the image. Additionally, an image
`processing apparatus comprises an acquiring section for
`acquiring information identifying a taking lens; a storage
`section for storing lens characteristics associated with the
`(TP)
`Dec. 4, 1997
`cneeecceeesscesscseneseecreecesceescsensteeenee 9-333943
`
`type of the taking lens; and a correcting section which
`
`Dec. 9, 1997 (IP) oe eeeeecceeeecsescceesescseeceeceeseneneneeenee 9-338511
`receives the corresponding lens characteristics of the taking
`... 10-040177
`Feb. 23, 1998
`(JP)....
`
`lens from the storage section and corrects at
`least one
`(IP) ceeeecccccccsseeeeeneecseesseeeseneeeneees 10-059454
`Mat. 11, 1998
`aberration selected from amonglateral chromatic aberration,
`distortion, decrease in the brightness of the edge of image
`field and image blurring. High-quality imagesthat are free
`from color mismatch,distortion, uneven brightness,blurring
`and any other defects, or both vignetting and distortion can
`be outputted consistently. These high-quality images can be
`also displayed on an image display device, thus allowing the
`operator to perform verification and achicve consistent out-
`putting of image-carrying prints.
`
`(21) Appl. No.: 09/205,292
`
`(22)
`
`Filed:
`
`Dec. 4, 1998
`
`(30)
`
`Foreign Application Priority Data
`
`(51)
`
`Int. C1. eee eee G03B 27/52; G03B 27/32;
`G03B 27/68; HO4N 1/04; GO6K 9/32
`(52) US. C1. cceccsessseeseneseseneeneee 355/40; 355/32; 355/38;
`355/52; 358/487; 358/506; 382/298; 382/299;
`382/300
`(58) Field of Search 0... 355/32, 38, 40,
`355/52; 358/487, 506; 382/298, 299, 300
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`5,604,825 *
`
`2/1997 Hirota ct al. oo. eeee 358/451
`
`40 Claims, 13 Drawing Sheets
`
`
`
`
`
`
`
`
`
`
`
`IMAGE
`PROCESSING
`APPARATUS
`
`DISPLAY
`DEVICE
`
`20
`
`16 PRINTER
`
`PETITIONERS EX1008
`Page 1
`
`PETITIONERS EX1008
`Page 1
`
`

`

`U.S. Patent
`
`Nov. 27, 2001
`
`Sheet 1 of 13
`
`US 6,323,934 B1
`
`
`
`14
`
`16 PRINTER
`
`IMAGE
`
`APPARATUS
`PROCESSING
` DISPLAY
`
`DEVICE
`
`20
`
`1
`
`|]te
`
`!
`
`:
`
`18 18a
`13
`
`PETITIONERS EX1008
`Page 2
`
`PETITIONERS EX1008
`Page 2
`
`

`

`Sheet 2 of 13
`
`US 6,323,934 B1
`
`U.S. Patent
`
`
`
`Nov. 27, 2001
`
`
`
`
`
`PETITIONERS EX1008
`Page 3
`
`PETITIONERS EX1008
`Page 3
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 3 of 13
`
`US 6,323,934 BI
`
`(SLV10duSLN)
`
`
`
`N/4I:-SSayNdav
`
`WHOASNVYL €“Old
`
`LOVYLNOD/39YVINA
`
`SALVNIGYOOD
`
`d+iV+41=,]
`
`(ALV10duSIND
`
`LOWYLNOD/JDYWINA
`
`N/6}:ssauaav
`
`
`SALVNIGHOODWHOASNVYL
`
`g+bi=6|
`
`
`(SLV10dusaIND
`LOVYLNOD/S9YVWINA
`
`N/QI:<SSayddv
`
`
`SALVYNIGHOODWYHOASNVYL
`
`atqVv+qI=q|
`
`g9S9SV9S
`
`PETITIONERS EX1008
`Page 4
`
`PETITIONERS EX1008
`Page 4
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Nov. 27, 2001
`
`Sheet 4 of 13
`
`US 6,323,934 B1
`
`FIG.4c
`
`
`
`
`
`
`
`FIG.4d
` posef
`LLLPEOTTID
`CLTEEDED
`LETMLeats
`ELUTE
`
`||iRXWW"°>EF
`EFTTELELE
`
`FIG.4b
`
`FIG.4a
`
`PETITIONERS EX1008
`Page 5
`
`PETITIONERS EX1008
`Page 5
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 5 of 13
`
`US 6,323,934 B1
`
`fe
`
`<<
`Tr
`Ly
`
`14a
`
`A!
`
`
`
`o
`
`oO
`Ww
`
`<
`6uy
`
`“LO
`
`e ©i
`
`Py
`
`—
`
`“I
`
`om
`
`co}
`
`
`
`PETITIONERS EX1008
`Page 6
`
`PETITIONERS EX1008
`Page 6
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 6 of 13
`
`US 6,323,934 BI
`
`WYHOSSNVYL
`
`LOVYLNOD/39NVINA
`
`SSLVNIGHYOOD
`
`(S.LV10dY3LNI)
`
`
`
`N/4I‘SSaydav
`
`tiv+=
`
`g9S‘dls9°LS
`
`VOS'VLS
`
`(3LV10d4YS.LNI)
`
`N/61:ssaycav
`
`g+6l=
`
`by
`
`LOVYLNOD/ADYVINA
`
`
`SSLVNIGUOODWHOASNVYL
`
`(31LV10d4Y4LNI)
`
`
`
`N/QI:SSayqav
`
`a+dVv+q!=q|
`
`LOWYLNOD/3DYVINA
`
`
`SALVNIGHOODWYHOASNVEYLL
`
`VePS‘VOS
`
`PETITIONERS EX1008
`Page 7
`
`PETITIONERS EX1008
`Page 7
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 7 of 13
`
`US 6,323,934 B1
`
`20a(20b,20c)
`
`FIG./a
`
`FIG.7b
`
`FIG./c
`
`FIG./7d
`
`
`
`20b
`
`20c
`
`20a
`
`20b(20c)
`
`20a
`
`PETITIONERS EX1008
`Page 8
`
`PETITIONERS EX1008
`Page 8
`
`

`

`U.S. Patent
`
`FIG.8
`
`Nov. 27, 2001
`
`Sheet 8 of 13
`
`US 6,323,934 B1
`
`
`
`
`
`
`
`PETITIONERS EX1008
`Page 9
`
`PETITIONERS EX1008
`Page 9
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 9 of 13
`
`US 6,323,934 BI
`
`NOAV1dSIG
`
`YOLINOW
`
`YO
`
`YO_LINOW
`
`NOAV1dSId
`
`SNOILYOdAAOWSY
`YOA9VNWI40
`AZISSONCAY
`
`JILVWOYHSDWeslV7
`CNVNOILWddsav
`
`
`JOVWIGSNNV9SSNId
`
`INISSADOYdADV!
`
`dNlasGNV
`JILVWOXHDWeal]
`ONVNOILVadsav
`
`JOVWIGSNNVOSANI
`
`NOILYOLSIG
`
`(NOILM10S3YHOIH)
`
`LOAYYOD
`
`NOILYOLSIO
`
`(NOLLNIOS3YHOIH)
`
`LOAYYOD
`
`6
`
`JI
`
`LOAYYOD
`
`JILVWOUYHDWesalV7)
`
`ONVNOILVadsgdV
`
`JOVWIGSNNV2S3ud
`
`NOILYOLSIG
`(NOILNIOSSYMO7)
`
`
`
`
`
`YANNVOS
`
`PETITIONERS EX1008
`Page 10
`
`PETITIONERS EX1008
`Page 10
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Nov. 27, 2001
`
`US 6,323,934 B1
`
`Sheet 10 of 13
`
`
`
`
`
`FIG.10
`
`PETITIONERS EX1008
`Page 11
`
`PETITIONERS EX1008
`Page 11
`
`

`

`U.S. Patent
`
`Nov. 27, 2001
`
`Sheet 11 of 13
`
`US 6,323,934 B1
`
`oO
`oD
`~
`
`Oo
`Oo
`Mm
`
`2
`©
`hf.
`
`oO
`4
`
`e
`0
`Ke
`fry
`
`Oo
`-
`rt
`
`0)
`KH
`
`
`fry
`
`>
`=
`2
`2
`_
`Ss
`
`PETITIONERS EX1008
`Page 12
`
`Q
`_
`-
`e
`C)
`KH
`fy
`
`5M
`
`™
`
`© oO
`4”
`4
`
`0
`KH
`fry
`
`PETITIONERS EX1008
`Page 12
`
`

`

`U.S. Patent
`
`Nov. 27, 2001
`
`Sheet 12 of 13
`
`US 6,323,934 B1
`
`S|
`Cl
`
`3
`un
`_
`
`co
`
`
`
`
`
`L
`
`O
`w)
`
`qJ
`
`N r
`
`od
`
`hy
`
`e OB
`
`:
`“
`
`2
`
`©
`i
`1
`
`A
`:
`
`2
`
`dow
`
`: Q
`
`|
`
`~
`
`00
`
`
`y|>
`
`ca
`
`PETITIONERS EX1008
`Page 13
`
`PETITIONERS EX1008
`Page 13
`
`

`

`U.S. Patent
`
`Nov.27, 2001
`
`Sheet 13 of 13
`
`US 6,323,934 BI
`
`NOAV1dSIC
`
`SNOILYOdAAOWSY
`
`NOAVTIdSI0
`
`YOLINOW
`
`YO
`
`
`
`JOVIGSNNVOS3Yd
`
`(NOLLM10S3YMOT)
`
`eT°oOld
`
`YOLINOW
`
`
`ONISSIOOUdSOVINI
`dasONW
`
`
`JOVWIGANNV2SSNI4
`
`
`
`(NOILN10S3¥YHOIH)
`
`
`AZISSONY
`
`(NOILLM10S3¥H9OIH)
`
`YOADVWIAO
`
`
`JOVWIGANNVDSSNI4
`
`YANNVOS
`
`PETITIONERS EX1008
`Page 14
`
`PETITIONERS EX1008
`Page 14
`
`
`
`
`
`
`

`

`US 6,323,934 Bl
`
`1
`IMAGE PROCESSING METHOD AND
`APPARATUS
`
`BACKGROUND OF THE INVENTION
`
`This invention relates to the technical field of an image
`processing method for usc in digital photoprinters and the
`like which obtain digital
`image data from an optically
`recorded image by, for example, photoelectrically reading
`the image recorded on a film, or whichdirectly obtain digital
`image data by recording the image of a subject and which
`obtain an image reproducingprint (for photo) onthe basis of
`the digital image data. The process is particularly intended
`to correct various defects such as lateral chromatic
`
`2
`apparatus) that performs scan exposure ona light-sensitive
`material
`in accordance with the image data and which
`performs development and other necessary steps to produce
`a print.
`In the scanner, reading light issuing from a light source is
`allowedto be incident on the film to produce projected light
`carrying the image recorded on the film and the projected
`light is focused on an image sensor such as a CCDsensor,
`whereby photoelectric conversion is effected to read the
`image from the film; after optionally being subjected to
`various image processing steps, image data from the film
`(image data signal) is sent to the image processing appara-
`tus.
`
`10
`
`The image processing apparatus sets the conditions for
`aberration, distortion, decrease in the brightness of the edge
`image processing on the basis of the image data that has
`of image field and a defocused image that develop in the
`been read with the scanner;
`the apparatus then performs
`image recorded with a film with lens, an inexpensive com-
`image processing on the image data in accordance with the
`pact camera or a digital camera and so forth. The invention
`thus set conditions and supplies the printer with output
`also relates to the technical field of an image processing
`image data (exposure conditions) for image recording.
`apparatus that makes use of this image processing method.
`In the printer, if it is of a type that relies upon exposure
`by scanning with light beams, the latter are modulated in
`Currently, the image recorded on a photographicfilm such
`as a negative film or a reversal film (which are hereinafter
`accordance with the image data sent from the image pro-
`collectively referred to as “film”’)
`is printed to a light-
`cessing apparatus and the light-sensitive material is exposed
`sensitive material (photographic paper) by “direct exposure”
`by two-dimensional scanning to form a latent image, which
`(or analog exposure),
`in which the image on a film is
`in turn is subjected to development and other specified
`processing steps, thereby producing a print (photograph)
`projected onto the light-sensitive material to perform areal
`exposure.
`reproducing the image recorded on the film.
`Whenthe image recorded onafilm or taken with a digital
`A printer that relies upon digital exposure has recently
`been commercialized. Called a “digital photoprinter’,
`the
`camera or a compact camera is reproduced on a print,
`30
`various factors come into play to deteriorate the image
`apparatus operates as follows The image recorded onafilm
`quality and theyare aberrations that are caused by the poor
`is read photoclectrically; the image is then converted to a
`performance of the lens fitted on the camera used to record
`digital signal and subjected to various image processing
`or take the image, such as lateral chromatic aberration,
`steps to produce recording image data; a light-sensitive
`distortion, decrease in the brightness of the edge of image
`material is exposed by scanning with recording light modu-
`field and defocusing of the image.
`lated in accordance with the image data, whereby an image
`(latent image) is recorded; and the necessary processing is
`A color image is formed of three primarycolors, red (R),
`done to produce a (finished) print.
`green (G) and bluc (B) and duc to the slight wavelength-
`dependentdifferences in the refractive index ofthe lens, the
`In the digital photoprinter, the image recorded on a film is
`imaging magnification of the three light components, R, G
`converted to digital image data, which is then processed to
`and B, varies to cause “lateral chromatic aberration”. As a
`determine the conditions for exposure to be performed in
`result,
`the image recorded on a film will have a color
`printing; hence, the correction of drop-outs or blocked-ups
`mismatch upon reproduction.
`in image due to photography with rear light or an electronic
`flash, sharpening, the correction of color or density failure,
`In order to record an appropriate or satisfactory image, a
`the correction of under-exposure or over-exposure or the
`plane of a scene of interest normal to the optical axis must
`correction of insufficiency of the brightness of the edge of
`be imaged on an identical plane or imaging plane that is
`imagefield can be effectively performed to produceprints of
`normalto the optical axis. In fact, however, ordinary lenses
`very high quality that have heretofore been unattainable by
`have an aberration called “distortion”, or displacementof the
`conventional direct exposure. What is more, by image data
`imaging plane with respect
`to the optical axis, and the
`processing, a plurality of images can be assembled into one
`resulting distortion of the image on the imaging plane causes
`50
`
`composite image or a single image can be divided into more a problem in that the image recorded onafilm is distorted
`than one image and even characters can be assembled;thus,
`upon reproduction.
`prints can be outputted after editing/processing is done in
`Other causes of image deterioration that depend on the
`accordance with a specific use.
`performance of the lens used are the decrease in the bright-
`nessof the edge of imagefield, or the image from either edge
`A further advantage of the digital photoprinter is that
`of the lens being darker than that from the central arca, and
`prints can also be prepared from the image (image data)
`defocusing, or the production of a blurred image dueto the
`taken with an imaging device such as a digital camera. The
`varying focus position across the plane of the film.
`desired image can not only be outputted as a print (photo);
`the image data can also be supplied to a computer or stored
`If comparatively high cost can be spent to manufacture
`in a recording medium suchasafloppy disk; thus, the image
`cameras as in the case of a single reflex lens camera,
`60
`data can be utilized in various applications other than
`high-precision lenses may be employed and optionally a
`photography.
`plurality of lens elements may be combined to record an
`appropriate image on the film by correcting various lens
`Having these capabilities, the digital photoprinter is basi-
`aberrations including lateral chromatic aberration,
`cally composed of a scanner (image reading apparatus) for
`distortion, decrease in the brightness of the edge of image
`photoelectric reading of the image recorded on a film, an
`field and defocusing of image.
`image processing apparatus that performs image processing
`on the thus read image to produce recording image data
`On the other hand, a film with lens and an inexpensive
`(conditions for exposure) and a printer (image recording
`compact camera do notjustify high cost and lens aberrations
`
`15
`
`40
`
`45
`
`55
`
`65
`
`PETITIONERS EX1008
`Page 15
`
`PETITIONERS EX1008
`Page 15
`
`

`

`US 6,323,934 Bl
`
`3
`suchas lateral chromatic aberration and distortion will occur
`in the image recorded on the film. As the result, the image
`reproducedin a print will have various defects such as color
`mismatch, distortion, unevennessin brightness and blurring.
`FIG. 13 showshow the image ona film is processed with
`a conventional digital photoprinter and outputted as a fin-
`ished print. As shown, the image on a film is scanned with
`a scanner to read high-resolution, fine scanned image data,
`which is subsequently subjected to predetermined image
`processing and setup steps in an image processing apparatus;
`this is not followed by imagedisplaying but the processed
`image data is immediately fed into a printer which outputs
`a finished print. If the image on a film that
`involves
`aberrations such as lateral chromatic aberration and distor-
`tion is processed by the stated procedure, the aberrationsare
`not effectively corrected and the reproduced image onthe
`print will have a color mismatch and distortion.
`As also shown in FIG. 13, print outputting from the
`conventional photoprinter is preceded by prescanning ofthe
`imageon a film with the scanner to produce low-resolution,
`prescanned image data, which is displayed as such on a
`monitor (i.c., an image display device); alternatively, fine
`scanning is directly performed in place of prescanning so as
`to produce high-resolution, fine-scanned image data, which
`is displayed on the monitor after removing portionsof it or
`effecting size reduction. Whicheveris the case, aberrations
`such as lateral chromatic aberration and distortion in the
`
`4
`brightness of the edge of image field and defocusing. Thus
`a high-quality image that
`is free from color mismatch,
`distortion, uneven brightness of the edge of image field,
`blurring and any other defects is output.
`Another object of the present invention is to provide an
`image processing apparatus that makes use of this image
`processing, method.
`A further object of the present invention is to provide an
`image processing method by which even the image recorded
`on a film with lens or taken with an inexpensive compact
`camera or a digital camera can be effectively processed to
`correct distortion, lateral chromatic aberration and other lens
`aberralions. Thus an image is producedthatis [ree from any
`distortion, color mismatch and other defects, and is dis-
`played on a monitor device together with a print area, or only
`the aberration-corrected area in agreement with the print
`area. Further, the range of vignetting due to the aberrational
`correction is clearly delineated on the monitor device to
`reproduce a print image that has been corrected for lateral
`chromatic aberration, distortion and other lens aberrations to
`achieve agreement with the image displayed within the
`displayed print area or with the displayed image solely
`consisting of the print area.
`Astill further object of the present inventionis to provide
`an image processing apparatus that makes use of this image
`processing, method.
`Another object of the present invention is to provide an
`image processing method wherein even if aberration char-
`image data are not corrected and the image displayed on the
`monitor also has a color mismatch and distortion.
`acteristics for the image recorded onafilm with lensor taken
`30
`with an inexpensive compact cameraor a digital camera are
`To deal with this problem, the user may verify the color
`not obtained from the information about the lenses or film
`mismatch and distortion in the displayed image and manu-
`used to take the picture, the aberration characteristics of
`ally correct the lateral chromatic distortion and distortion.
`interest can be detected on the basis of the data for the
`Ilowever, positively verifying these aberrations from the
`displayed image and manually applying the appropriate
`correction to the image data are extremely difficult even for
`a skilled uscr; even if aberrations are successfully corrected,
`a phenomenoncalled vignetting to be described later will
`occurin the corrected image, andit is extremely difficult to
`achieve correct verification of the range of vignetting that
`results from the correction of aberrations. What is more, in
`order to produce a print that is properly corrected for the
`aberrations and which has an appropriate print area repro-
`duced thereon, print outputting must be repeated with small
`variations in the amountof correction; however,this is quite
`cumbersomeand,in addition, the printing cost is increased.
`If the information about the lenses used to take a picture
`of a subject or their characteristics are known in the con-
`ventional image processing apparatus, it would be possible
`to correct lateral chromatic aberration, distortion and other
`kinds of aberrations in accordance with the characteristics of
`
`10
`
`15
`
`40
`
`45
`
`50
`
`the image displayed on a
`recorded image. For example,
`monitor device using such image data, with the detected
`aberration characteristics being utilized in subsequent image
`processing to correct lateral chromatic aberration, distortion
`and other lens aberrations, ensures that a high-quality image
`optimally, corrected for aberrations to becomefree of color
`mismatch, distortion and other defects, is reproduced as a
`print image.
`Yet another object of the present inventionis to provide an
`image processing apparatus that makes use of this image
`processing method.
`In order to attain the above objects, the invention provides
`an image processing method comprising the steps of obtain-
`ing input image data from an imagerecorded optically with
`a taking lens and applying specified image processing to the
`obtained input image data to produce output image data that
`can be reproduced as a visible image, in whichat least one
`aberration of said optically recorded image selected from
`among lateral chromatic aberration, distortion, decrease in
`the brightness of the edge of imagefield and image blurring
`is corrected based on lens characteristics of said taking lens
`and position information of said image.
`Preferably, the position information of said imageis pixel
`position information of said recorded image.
`Preferably,
`the position information of said image is
`referenced to an optical axis of said taking lens used in
`recording of said image.
`Preferably, the lens characteristics of said taking lens is
`obtained from separately acquired information about the
`taking lens used to record said image.
`Preferably, correction of said distortion of said image is
`accompanied by electronic scaling at a higher-than-steady
`ratio.
`
`PETITIONERS EX1008
`Page 16
`
`the taking lenses. In fact, however, there is no established
`methodof correcting aberrations and if one wants to perform
`the actual correction, many trials and errors are necessary
`before the appropriate result is attaincd and this has been a
`quite cumbersome job. If the information about the taking
`lensesor their characteristics are not known,it is even more
`difficult to correct the aberrations and producing the most
`effectively corrected image has been extremely difficult.
`SUMMARYOF THE INVENTION
`
`The present invention accounts for these circumstances
`and provides an image processing method by which eventhe
`image recorded on a film with lens, or taken with an
`inexpensive compact camera or a digital camera can be
`effectively processed to correct
`lens aberrations such as
`lateral chromatic aberration, distortion, decrease in the
`
`55
`
`60
`
`65
`
`PETITIONERS EX1008
`Page 16
`
`

`

`US 6,323,934 Bl
`
`5
`Preferably, said higher-than-steady ratio is sufficient to
`cancel image dropout resulting from the correction of said
`distortion.
`
`Preferably, said visible image is both a printed image and
`a displayed image andat least said output image data is both
`image data for outputting said printed image from a printer
`and image data for display on an image display device, both
`of said image data being subjected to the correction of said
`at least one aberration selected from among lateral chro-
`matic aberration, distortion, decrease in the brightnessof the
`edge of image field and image blurring.
`The invention also provides an image processing method
`comprising the steps of obtaining input image data from an
`image recorded optically with a taking lens and applying
`specified image processing to the obtained input image data
`to produce output image data, in which at least one aberra-
`tion characteristic selected from lateral chromatic aberration
`
`characteristic and distortion characteristic of said taking lens
`is detected based on said input image data and at lcast onc
`aberration selected from said lateral chromatic aberration
`and said distortion is corrected based on the detected aber-
`
`10
`
`15
`
`ration characteristic and position information of said image.
`Preferably, said aberration characteristic is detected by the
`steps of displaying said image on an image display device
`based on said input image data, obtainingat least two points
`of the position information that specify a subject
`to be
`corrected for said at least one aberration that is selected from
`
`6
`Preferably, said correcting means is such that based on
`offsets on the image, from a reference color for three
`primaries, of the other colors due to said lateral chromatic
`aberration, image positions as corrected for the lateral chro-
`matic aberration of the three primaries are calculated to
`correct the lateral chromatic aberration of the image, or such
`that based on an offset on the image due to said distortion,
`the image positions as corrected for the distortion of the
`three primaries are calculated to correct the distortion of the
`image, or such that based on the offsets on the image, from
`a reference color for three primaries, of the other colors due
`to said lateral chromatic aberration, as well as an offset of the
`image of said reference color due to said distortion, the
`image positions as corrected for the lateral chromatic aber-
`ration and distortion of the three primaries are calculated to
`correct the lateral chromatic aberration and distortion of the
`image.
`Preferably, said correcting means, using the image posi-
`tions as corrected for the lateral chromatic aberration ofsaid
`three primaries, or the image positions as corrected for the
`distortion of said three primaries, or the image positions as
`corrected for the lateral chromatic aberration and distortion
`
`of said three primaries, performselectronic scaling, whereby
`arithmetic operations for interpolation to perform correction
`of lateral chromatic aberration and electronic scaling, or
`correction of distortion and electronic scaling or correction
`of both lateral chromatic aberration and distortion and
`
`electronic scaling are performed simultaneously.
`the image displayed on said imagedisplay device, extracting
`Preferably, the identifying information to be acquired by
`said subject between said at least two points based on said
`said acquiring means is information about said taking Icns
`input image data, acquiring the position information of said
`that is recorded either optically or magnetically on a film for
`subject before said at least one aberration is corrected, also
`optically recording said image or onafilm cartridge.
`acquiring the corrected position information of said subject
`Preferably, the image processing apparatus is connected
`as predictable between said at least two points and calcu-
`to an apparatus for outputting a print reproducing said output
`lating an aberration equation based on said position infor-
`image data as said visible image.
`mation before said at least one aberration is corrected and
`Preferably, said correcting means, based on the identify-
`said corrected position information, and said at least one
`ing information acquired by said acquiring means, deter-
`aberration is corrected throughout said image based on said
`mines whetherit is necessary to correct the distortion of said
`posilion information in accordance with said aberration
`image and if the correction of distortion is
`found
`equation.
`unnecessary, performs image processing under specified
`Preferably, the position information of said subject before
`conditions and if the correction of distortion is found
`said at least one aberration is corrected and the corrected
`necessary, receives the lens characteristics of the associated
`taking lens fromsaid storage means, corrects the distortion
`of the image based onthe position information of said image
`and said lens characteristics and performs image processing
`under different conditions than when said correction of
`distortion is unnecessary.
`Preferably, said image processing is the electronic scaling
`which, if said correction of distortion is not effected, is
`performed at a specified ratio associated with the output
`image but if said correction of distortion is effected, said
`electronic scaling is performedat a higher scaling ratio than
`whensaid correction of distortion is not effected.
`
`position information thereof, both being extracted from said
`input image data, are the position information for an edge of
`said subject.
`The invention further provides an image processing appa-
`ratus that applies specified image processing to input image
`data obtained from an image recorded optically with a taking
`lens so as to produce output image data that can be repro-
`duced as a visible image, comprising:
`an acquiring means for acquiring information that iden-
`tifies said taking lens;
`a storage meansfor storing lens characteristics associated
`with type of said taking lens; and
`a correcting means which, in response to the identifying
`information acquired by said acquiring means,receives
`the corresponding lens characteristics of said taking
`lens from said storage means and which corrects at
`least one aberration of said optically recorded image
`selected from among lateral chromatic aberration,
`distortion, decrease in the brightness of the edge of
`image field and image blurring based on said lens
`characteristics and position information of said image.
`Preferably, said correcting means hascorrection equations
`associated with a plurality of types of the taking lens and
`said storage means stores correction coefficients for said
`correction equations as said lens characteristics in accor-
`dance with the type of said taking lens.
`
`30
`
`35
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Preferably, said scaling ratio higher than when said cor-
`rection of distortion is not effected is sufficient to cancel
`
`image dropout resulting from said correction of distortion.
`Preferably,
`the electronic scaling ratio is adjusted in
`accordance with the type of said taking lens when said
`correction of distortion is effected.
`Preferably, the electronic scaling is performed at a speci-
`fied ratio irrespective of the type of said taking lens when
`said correction of distortion is effected.
`
`Preferably, said correcting means corrects the distortion
`by calculating appropriate positions of the respective three
`primaries based onthe offsets of the image positions due to
`said distortion.
`Preferably, said correcting means calculates the appropri-
`ate positions of the respective three primaries based on the
`
`PETITIONERS EX1008
`Page 17
`
`PETITIONERS EX1008
`Page 17
`
`

`

`US 6,323,934 Bl
`
`8
`position information of said subject as predictable between
`said at least two points and calculates an aberration equation
`based on said position information which is yet
`to be
`corrected for aberrations and said corrected position infor-
`mation.
`Preferably, the position information of said subject to be
`corrected for aberrations is the position information for an
`edge of said subject.
`The invention yet further provides an image processing
`apparatus that obtains input
`image data from an image
`recorded optically with a taking lens and that applies speci-
`fied image processing to the obtained input image data to
`produce output image data, comprising:
`an image display device for displaying said image based
`on said input image data;
`an acquiring means for acquiring at least one aberration
`characteristic selected from between the lateral chro-
`matic aberration characteristic and the distortion char-
`acteristic of said taking lens;
`a correcting meansfor correcting at least one ofthe lateral
`chromatic aberration and the distortion of said recorded
`
`10
`
`15
`
`we0
`
`Vvnm
`
`30
`
`35
`
`7
`offsets of the image positions due to the distortion and
`performselectronic scaling of the image using the informa-
`tion about said appropriate positions.
`Preferably, said correcting means,prior to calculating the
`appropriate positions of said respective three primaries,
`calculates the offsets, from a reference color for
`three
`primaries, of the image positions of the other colors due to
`lateral chromatic aberration and, using the offsets due to said
`lateral chromatic aberration and the offset of the image
`position of said reference color dueto distortion, calculates
`the appropriate positions of the respective three primaries as
`corrected for both distortion and lateral chromatic aberra-
`tion.
`the ratio of said electronic scaling differs
`Preferably,
`between vertical and horizontal directions of the image.
`Preferably,
`the image processing apparatus further
`includes an image display device that displays said optically
`recorded image as a verification image based on the input
`image data as obtained from said recorded image, said
`visible image being a printed image, said output image data
`being image data for outputting said printed image from the
`printer, said correcting means being such that not only the
`image based on both said at least one aberration char-
`imagedata for outputting said printed image from the printer
`acteristic acquired by said acquiring means and the
`but also the image data used for display on said image
`position information of said image; and
`display device is corrected for at least one aberration of said
`an adjusting means for adjusting correction intensity or
`optically recorded image selected from among lateral chro-
`aberration pattern of said at least one aberration char-
`matic aberration, distortion, decrease in the brightnessof the
`acteristic used by said correcting means, wherein said
`edge of image field and image blurring, and prior to out-
`image display device displays an image that is cor-
`putting said output image data for producing said printed
`rected for said at least one aberration by said correcting
`image as corrected by said correcting means, a corrected
`means, said adjusting means adjusts different levels of
`imagefor producing said printed image is displayed on said
`said correction intensity or aberration pattern, the best
`image display device based on display image data as cor-
`state of correction is determined from amongaplurality
`rected by said correcting means.
`of displayed images that have been corrected by said
`Preferably, said corrected display image data is based on
`correcting means in accordance with said adjusted
`either low-resolution, prescanned image data or image data
`correction intensity or aberration pattern and the image
`obtained by removing portions of high-resolution,
`fin