`
`
`
`JP 2007-259108 A 2007.10.4
`
`(19) Japan Patent Office (JP)
`
`(12) Unexamined Patent Application Publication (A)
`(11) Patent Application Publication No.
`
`FI
`
`JP 2007-259108
`(P2007-259108A)
`(43) Publication Date: Oct. 4, Heisei 19 (2007.10.4)
`Theme Code (Reference)
`
`5/225
`5/232
`
`(2006.01)
`(2006.01)
`
`H04N
`H04N
`
`5/225 F
`5/232 Z
`
`5C122
`
`(51) Int. Cl.
`H04N
`H04N
`
`
`
`(13 Pages Total)
`
`OL
`
`No. of Claims: 7
`306037311
`Fujifilm Corp.
`2-26-30 Nishi Azabu, Minato-ku, Tokyo
`100094330
`Masaki Yamada, Patent Attorney
`100079175
`Yoshio Kosugi, Patent Attorney
`100109689
`Musubu Mikami, Patent Attorney
`Takashi Soga
`c/o Fuji Photo Film Co. Ltd.
`3-11-46 Senzui, Asaka-shi, Saitama-ken
`5C122
`DA04 EA61 FD14 FH19 FH22
`FK12 GG16 GG28 HB05
`
`
`
`(21) Filing No.
`(22) Filing Date
`
`Examination Request: Not Made
`JP 2006-81229 (P2006-81229)
`(71) Applicant
`Mar. 23, Heisei 18 (2006.3.23)
`
`(74) Agent
`
`(74) Agent
`
`(74) Agent
`
`(72) Inventor
`
`F Terms (Ref.)
`
`
`
`(54) [Title] Photographic Device
`
`(57) [Abstract]
`
`[Problem] To provide a photographic device that, while being a
`photographic device equipped with an imaging element of a small
`area, can obtain an image having similar bokeh to an image
`photographed by a silver halide camera.
`[Solution] First, in a first round of photography, a first image is
`obtained that is focused on a principal subject. In a second round
`of photography, a second image is obtained that is focused at a
`shorter distance than the principal subject, is more wide-angle
`than the first image, and has the principal subject and a
`background blurred. Compositing is performed by cutting out the
`principal subject in the first image and replacing a region of the
`second image identical to the principal subject cut out from the
`first image with this principal subject cut out from the first image.
`This generates an image having similar bokeh to an image
`photographed by a silver halide camera.
`[Selected FIG.] FIG. 4
`
`
`
`APPL-1006 / Page 1 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(2)
`
`JP 2007-259108 A 2007.10.4
`
`[Claims]
`[Claim 1]
`A photographic device that forms an image of a subject on an imaging element by a photographic
`optical system and generates an image representing the subject, comprising:
`an image generation means for generating a first image, which is focused on a principal subject, and a
`second image, which has the principal subject and a background blurred and is more wide-angle than the first
`image, the first image and the second image being of the same subject; and
`an image compositing means for generating a composite image by cutting out the principal subject in
`the first image and replacing a region of the second image identical to the principal subject cut out from the
`first image with the principal subject cut out from the first image.
`[Claim 2]
`The photographic device of claim 1, wherein the photographic optical system is a photographic
`optical system having a focal-length adjustment function and a focus adjustment function, and
`the image generation means obtains, by photographing the same subject, a first photographic image,
`which is focused on the principal subject, and a second photographic image, which is more on a wide-angle
`side than the first photographic image and is focused at a shorter distance than a distance to the principal
`subject, and defines the first photographic image as the first image and the second photographic image as the
`second image.
`[Claim 3]
`The photographic device of claim 1, wherein the photographic optical system has a focal-length
`adjustment function and a focus adjustment function, and
`the image generation means obtains, by photographing the same subject, a first photographic image,
`which is focused on the principal subject, and a second photographic image, which is focused on the principal
`subject but is more on a wide-angle side than the first photographic image, and defines the first photographic
`image as the first image and, upon generating a blurred image by subjecting the second photographic image
`to a blurring process, the blurred image as the second image.
`[Claim 4]
`The photographic device of claim 2 or 3, further comprising: an emission means for emitting a
`photography auxiliary light; and an emission control means for emitting the photography auxiliary light in
`photographing the first photographic image and not emitting the photography auxiliary light in
`photographing the second photographic image.
`[Claim 5]
`The photographic device of claim 1, wherein the photographic optical system has a focus adjustment
`function, and
`the image generation means obtains, by photography, a first photographic image focused on the
`principal subject; subjects the first photographic image to an enlarging process corresponding to a
`photographic image more on a telephoto side than the first photographic image to obtain an enlarged image;
`and defines the enlarged image as the first image and, upon subjecting the photographic image prior to the
`enlarging process to a blurring process to generate a blurred image, the blurred image as the second image.
`[Claim 6]
`The photographic device of claim 1, further comprising: a through-the-lens–image display means for
`displaying a moving image of the subject prior to a photography instruction; wherein the through-the-lens–
`image display means displays a frame guide for a head and shoulder shot of the principal subject together
`with the moving image of the subject.
`[Claim 7]
`The photographic device of claim 1, further comprising: a blurring-level setting means for setting an
`extent of blurring in the second image; wherein
`the image generation means generates a second image having blurring of a level set by the blurring-
`level setting means.
`[Description]
`[Field]
`[0001]
`
`The present invention relates to a photographic device that forms an image of a subject on an
`imaging element by a photographic optical system and generates image data representing the subject.
`[Background]
`
`10
`
`20
`
`30
`
`40
`
`50
`
`
`
`APPL-1006 / Page 2 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`[0002]
`
`(3)
`
`JP 2007-259108 A 2007.10.4
`
`Conventional art is proposed for obtaining an aesthetic image (“bokeh” hereinbelow) on film that is
`intentionally blurred by performing multiple exposure while moving a focus lens in silver halide camera
`photography (for example, see patent literature 1).
`[0003]
`
`Furthermore, recent art also includes art that, by taking advantage of digital cameras being equipped
`with an image signal processing circuit, performs continuous photography (continuous shooting) while
`shifting a focal position and composites images obtained by the continuous shooting by this image signal
`processing unit in an attempt to obtain a bokeh image (for example, see patent literature 2).
`[0004]
`
`Furthermore, recent art also includes art that, by making use of labs being equipped with a printing
`device that performs digital exposure, subjects an image to a blurring process or the like by this printing
`device when printing an image from a negative on photographic paper in an attempt to obtain a bokeh image
`(for example, see patent literature 3).
`[0005]
`
`Now, a size of a photosensitive surface of an imaging element is considerably smaller than a size of a
`photosensitive surface of film (for example, 24 mm × 36 mm in 35 mm film). Because of this, when a subject is
`photographed by a silver halide camera using a lens with a bright f value, an image with a bokeh background
`is obtained, but when the same subject is photographed by a digital camera, in contrast to the conventional
`photographic image from the silver halide camera, an image is obtained that, due to the difference in the size
`of the photosensitive surface, has the background and a principal subject all in focus, without a blurred
`background.
`[0006]
`
`Using an imaging element having a photosensitive surface of the same size as the photosensitive
`surface of the above film in the digital camera prevents the above situation, but this makes the digital camera
`large in size.
`[Patent Literature 1] JP H5-313060 A
`[Patent Literature 2] JP 2003-209727 A
`[Patent Literature 3] JP H10-233919 A
`[Summary]
`[Technical Problem]
`[0007]
`
`In view of these circumstances, the present invention has as an object to provide a photographic
`device that, while being a photographic device equipped with an imaging element of a small area, can obtain
`an image having similar bokeh to an image photographed by a silver halide camera.
`[Solution to Problem]
`[0008]
`
`A photographic device of the present invention that achieves the above object is a photographic
`device that forms an image of a subject on an imaging element by a photographic optical system and
`generates image data representing this subject, provided with:
`an image generation means of generating a first image, which is focused on a principal subject, and a
`second image, which has the principal subject and a background blurred and is more wide-angle than the first
`image, the first image and the second image being of the same subject; and
`an image compositing means of generating a composite image by cutting out the principal subject in
`the first image and replacing a region of the second image identical to the principal subject cut out from the
`first image with this principal subject cut out from the first image.
`[0009]
`
`According to the photographic device of the present invention, the image generation means
`generates the first image and the second image, and the image compositing means cuts out the principal
`subject in the first image and replaces the region of the second image identical to the principal subject cut out
`from the first image with the principal subject cut out from the first image.
`[0010]
`
`Here, by making the second image an image that is more wide-angle than the first image, a size of the
`principal subject in the second image is made smaller than the principal subject in the first image. Then, the
`background of the principal subject in the second image is blurred, and the region of this second image with
`
`10
`
`20
`
`30
`
`40
`
`50
`
`
`
`APPL-1006 / Page 3 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(4)
`
`JP 2007-259108 A 2007.10.4
`
`the blurred background identical to the principal subject cut out from the first image is replaced with the
`principal subject cut out from the first image.
`[0011]
`
`That is, when the background of the principal subject in the second image is blurred, a contour
`periphery of the principal subject also undergoes bokeh, widening the contour periphery. As such, the
`principal subject in the second image is made smaller and replaced with the first principal subject, and
`afterward, the bokeh of the contour periphery of the principal subject in the second image is made to not
`appear in a periphery of the principal subject so the bokeh effect only appears in a portion other than the
`principal subject. By doing so, the bokeh effect only appears in the portion other than the principal subject,
`which is at a focal position, such that a bokeh image substantially similar to an image photographed by a silver
`halide camera is obtained.
`[0012]
`
`As described above, this realizes a photographic device that, while being a photographic device
`equipped with an imaging element of a small area, can obtain an image having similar bokeh to an image
`photographed by a silver halide camera.
`[0013]
`
`Here, the photographic optical system may be a photographic optical system having a focal-length
`adjustment function and a focus adjustment function, and
`the image generation means may obtain, by photography, a first photographic image, which is
`focused on the principal subject, and define this as the first image and define a second photographic image,
`which is more on a wide-angle side than this first photographic image and is focused at a shorter distance
`than a distance to the principal subject, as the second image.
`Alternatively, the photographic optical system may have a focal-length adjustment function and a
`focus adjustment function, and
`the image generation means may obtain, by photographing the same subject, a first photographic
`image, which is focused on the principal subject, and a second photographic image, which is focused on this
`principal subject but is more on a wide-angle side than this first photographic image, and define this first
`photographic image as the first image and, upon generating a blurred image by subjecting the second
`photographic image to a blurring process, this blurred image as the second image.
`[0014]
`
`Here, preferably, further provided are: an emission means of emitting a photography auxiliary light;
`and an emission control means of emitting the photography auxiliary light in photographing the first
`photographic image and not emitting the photography auxiliary light in photographing the second
`photographic image.
`[0015]
`
`This emphasizes the contour of the principal subject in the first photographic image and facilitates
`the image compositing means cutting out the principal subject.
`[0016]
`
`Alternatively, the photographic optical system may have a focus adjustment function, and
`the image generation means may obtain, by photography, a first photographic image focused on the
`principal subject; subject this first photographic image to an enlarging process corresponding to a
`photographic image more on a telephoto side than this first photographic image to obtain an enlarged image;
`and define this enlarged image as the first image and, upon subjecting the photographic image prior to the
`enlarging process to a blurring process to generate a blurred image, this blurred image as the second image.
`[0017]
`
`Furthermore, preferably, further provided is: a through-the-lens–image display means of displaying a
`moving image of the subject prior to a photography instruction; wherein the through-the-lens–image display
`means displays a frame guide for a head and shoulder shot of the principal subject together with the moving
`image of the subject.
`[0018]
`
`When the subject is a person, a full shot often causes the person and the background to not match,
`producing an image where the person seems to be floating. Therefore, during photography, it is favorable to
`display the frame guide to a photographer to instruct the photographer to shoot a head and shoulder shot to
`prevent failed photography in advance.
`[0019]
`
`10
`
`20
`
`30
`
`40
`
`50
`
`
`
`APPL-1006 / Page 4 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(5)
`
`JP 2007-259108 A 2007.10.4
`
`10
`
`20
`
`30
`
`Furthermore, more preferably, further provided is: a blurring-level setting means of setting an extent
`of blurring in the second image; wherein
`the image generation means generates a second image having blurring of a level set by the blurring-
`level setting means.
`[0020]
`
`This enables the photographer to photograph upon setting the extent of blurring by the blurring-
`level setting means so a bokeh image of the photographer’s preference is obtained.
`[Advantageous Effects of Invention]
`[0021]
`
`As described above, this realizes a photographic device that, while being a photographic device
`equipped with an imaging element of a small area, can obtain an image having similar bokeh to an image
`photographed by a silver halide camera.
`[Description of Embodiments]
`[0022]
`
`A digital camera that is one embodiment of a photographic device of the present invention is
`described below.
`[0023]
`
`FIG. 1 is an external perspective view of a digital camera 10 that is one embodiment of the
`photographic device of the present invention as viewed from the front and diagonally above. (a) in FIG. 1
`illustrates a view of a front surface of the digital camera 10 as viewed from diagonally above, and (b) in FIG. 1
`illustrates a view of a back surface of the digital camera 10 as viewed from diagonally above.
`[0024]
`
`This digital camera 10 illustrated in (a) and (b) in FIG. 1 is a photographic device that forms a subject
`image on an imaging element by a photographic optical system and generates an image signal for recording in
`response to a release button being pressed.
`[0025]
`
`A zoom lens barrel 10_1 internally provided with a photographic lens 10_1a that is an optical zoom
`lens is provided in a central portion of the front surface of the digital camera 10 illustrated in (a) in FIG. 1.
`Provided above this zoom lens barrel is a flash emission window 10_2 for irradiating a flash light to a subject
`when a field brightness is low and a flash dimming sensor 10_3 for adjusting a light amount of the flash light
`emitted toward the subject through the flash emission window 10_2.
`[0026]
`
`This flash dimming sensor 10_3 receives a flash light that, when the flash light is irradiated toward
`the subject through the flash emission window 10_2, strikes the subject, is reflected by the subject, and
`returns. A control unit inside the digital camera controls automatically stopping irradiation of the flash light
`when the light amount received by this flash dimming sensor 10_3 increases over time and reaches a
`predetermined value. Moreover, an optical-finder objective window 10_4 paired with an optical-finder
`eyepiece window (described below) on a back-surface side is provided next to this dimming sensor 10_3.
`[0027]
`
`40
`
`[0028]
`
`Furthermore, a release button 10_11 is disposed on an upper surface of the digital camera.
`
`Furthermore, as illustrated in (b) in FIG. 1, an optical-finder eyepiece window 10_12; a finder lamp
`10_13 that turns on when, for example, photography preparation is completed and blinks during
`photography; a mode switch 10_14 that switches between a photography mode and a playback mode; a zoom
`button 10_15 that zooms up toward a wide-angle side (wide side) by being pressed or zooms up toward a
`telephoto side (tele side) by being pressed; and the like are disposed in a back-surface upper portion of the
`digital camera 10.
`[0029]
`
`Furthermore, a menu/OK button 10_16, a DISP button 10_17, and a BACK button 10_18 are provided
`below the zoom button 10_15. This menu/OK button 10_16 is a button for displaying various menus during
`photography or playback and determining a selected menu. When this menu/OK button 10_16 is pressed and
`the photography mode is selected when a plurality of selection items including the photography mode is
`displayed on a liquid-crystal panel 10_30a, a mode referred to as a background blurring mode, indicating a
`type of the photography mode, is displayed as one of the selection items.
`[0030]
`
`50
`
`
`
`APPL-1006 / Page 5 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(6)
`
`JP 2007-259108 A 2007.10.4
`
`This background blurring mode is for solving the problem above; photographing in this mode
`enables an image having the bokeh of silver halide–camera photography to be obtained.
`[0031]
`
`Details are described below, but when this background blurring mode is selected, the digital camera
`of the present embodiment performs continuous photography in two rounds. First, the first round of
`photography acquires a first photographic image that is focused on a principal subject, and the second round
`of photography acquires a second photographic image that is more on a wide-angle side than this first
`photographic image and is focused at a shorter distance than a distance to the principal subject. Afterward, an
`image signal processing circuit that is described below composites the first photographic image and the
`second photographic image, thereby processing these images into an image having identical bokeh to an
`image photographed by a silver halide camera. This first photographic image corresponds to “first image” as
`referred to in the present invention, and this second photographic image corresponds to “second image” as
`referred to in the present invention.
`[0032]
`
`Furthermore, the DISP button 10_17 is a button for switching a state of a screen displayed on the
`liquid-crystal monitor 10_30a, which is to the side of this button. For example, it turns display of the liquid-
`crystal monitor 10_30a on and off during photography and turns character display on and off during
`playback. Moreover, the BACK button 10_18 serves as a button for returning an operation state effected by
`the MENU/OK button 10_16 or the like to an operation state one before or cancelling an operation state.
`[0033]
`
`FIG. 2 is a block diagram illustrating a circuit configuration of the digital camera 10 illustrated in FIG.
`
`1.
`[0034]
`
`The circuit configuration is described along a flow of the image signal. FIG. 2 illustrates as an example
`a digital camera 10 that, when the mode switch 10_14 is switched to a photography-mode side when power is
`turned on, displays a through-the-lens image on the liquid-crystal monitor 10_30a and performs photography
`by the release button 10_11 being pressed at a photo opportunity.
`[0035]
`
`First, a circuit configuration involved in the flow of the image signal as pertaining to display of the
`through-the-lens image is described.
`[0036]
`
`FIG. 2 illustrates a zoom lens 10_1a1 and a focus lens 10_1a2 in the photographic lens. The
`photographic lens 10_1a that includes these lenses forms an image of subject light on the imaging element
`(because a CCD solid-state imaging element is used here, this is referred to as a “CCD” hereinbelow) at a
`subsequent stage, and this CCD 10_41 generates the image signal, which represents the subject light.
`[0037]
`
`Described below is how the CCD 10_41 generates the image signal and how the generated image
`signal is transmitted to subsequent circuits.
`[0038]
`
`First, the flow of the image signal, which represents the through-the-lens image displayed on the
`liquid-crystal panel when power is turned on and the mode switch is on the photography-mode side, is
`described.
`[0039]
`
`In the CCD 10_41 generating the image signal for the through-the-lens image, as controlled by a CPU
`10_47 that is described below, a timing generator that is not illustrated repeatedly supplies an exposure start
`signal and an exposure end signal to the CCD 10_41 in a predetermined period so the CCD 10_41 generates
`the image signal representing the through-the-lens image every predetermined period. After exposure at the
`CCD 10_41 is ended according to the exposure end signal from this timing generator (not illustrated), the
`image signal representing the through-the-lens image (“RGB signal” hereinbelow) for which exposure is
`ended is output from the CCD 10_41 substantially at the same time.
`[0040]
`
`When the RGB signal for the through-the-lens image is output to an A/D conversion circuit 10_42 in
`this manner, the A/D conversion circuit 10_42 converts the analog RGB signal into a digital RGB signal, and an
`image input controller 10_43 at a subsequent stage guides the digital RGB signal to a bus line 10_100.
`[0041]
`
`10
`
`20
`
`30
`
`40
`
`50
`
`
`
`APPL-1006 / Page 6 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(7)
`
`JP 2007-259108 A 2007.10.4
`
`This digital RGB signal for the through-the-lens image guided to the bus line 10_100 by the image
`input controller 10_43 is supplied to an image signal processing circuit 10_44, and this image signal
`processing circuit 10_44 converts the digital RGB signal into a digital YC signal. This YC signal converted by
`the image signal processing circuit 10_44 is supplied to an LCD control unit 10_46, and the LCD control unit
`10_46 displays an image based on the YC signal on the liquid-crystal monitor 10_30a, which is provided by an
`LCD 10_30. Because the CCD 10_41 generates this YC signal every predetermined period, the image based on
`the YC signal is displayed on the liquid-crystal monitor 10_30a by being switched every predetermined
`period. This causes a subject in a direction where the photographic lens 10_1a faces to be displayed on the
`liquid-crystal monitor 10_30a as-is as a through-the-lens image.
`[0042]
`
`That is, photography can be performed by pressing the release button 10_11 at a photo opportunity
`while viewing the liquid-crystal monitor 10_30a instead of and without looking through the optical finder.
`[0043]
`
`Next, the flow of the image signal as pertaining to photographic processing in response to an
`operation of pressing the release button 10_11 is described.
`[0044]
`
`The release button 10_11 provided by the digital camera of the present embodiment has two
`operation aspects, a half-press operation and a full-press operation, and two contacts 10_11A, 10_11B
`respectively corresponding to these operation aspects. Each of these contacts is connected to an input port of
`the CPU 10_47. When operation of this release button 10_11 starts, the CPU 10_47 senses a half-pressed state
`due to one of the switches, the switch 10_11B, separating, and the CPU 10_47 senses a full press due to the
`other switch, the switch 10_11A, connecting.
`[0045]
`
`In the digital camera 10 of this embodiment, upon sensing the first contact 10_11B entering an open
`state when the pressing operation of the release button 10_11 starts, the CPU 10_47 instructs an AE detection
`circuit 10_50 to perform exposure adjustment and instructs an AF detection circuit 10_51 to perform focus
`adjustment. This is so exposure setting and focus setting are performed quickly in preparation for a full press.
`[0046]
`
`The AE detection circuit 10_50 detects a brightness necessary for exposure setting. According to a
`detection result of this AE detection circuit 10_50, a flash emission device 10_60 emits the flash light, and an
`opening diameter of an aperture that is not illustrated is adjusted. Moreover, the AF detection circuit 10_51
`performs a process of detecting a subject contrast at each of a plurality of positions when, as controlled by the
`CPU 10_47, a motor driver 10_49 is being instructed to move the focus lens 10_1a2 from a closest point to a
`farthest point in order to define as a focal point a peak of the subject contrasts detected at each position.
`[0047]
`
`After exposure setting and focus adjustment end upon the half-press of the release button 10_11 in
`this manner, when the release button 10_11 is fully pressed, an image of the subject light is formed on the
`CCD 10_41 at the exposure and focus from the half-press, and an exposure start signal and an exposure end
`signal according to a shutter speed are sequentially supplied from the timing generator that is not illustrated.
`After the CCD 10_41 outputs the RGB signal to the A/D conversion circuit 10_42 in response to this exposure
`end signal, the image input controller 10_43 guides the RGB signal converted into a digital signal by this A/D
`conversion circuit 10_42 to the bus line 10_100.
`[0048]
`
`An entirety of this RGB signal guided to the bus line 10_100 is temporarily stored in a memory
`(SDRAM) 10_52 and afterward read from the memory 10_52 and supplied to the image signal processing
`circuit 10_44. The RGB signal is converted into the YC signal by this image signal processing circuit 10_44, and
`the converted YC signal is then supplied to a compression processing circuit 10_45 and subjected to JPEG
`compression by the compression processing circuit 10_45. This JPEG-compressed YC signal is recorded in a
`recording medium 10_54 via a media controller 10_53.
`[0049]
`
`In the digital camera of the present embodiment, image data obtained by photography is recorded in
`a recording medium in this manner.
`[0050]
`
`Here, photographic processing when the background blurring mode is selected is described.
`
`10
`
`20
`
`30
`
`40
`
`50
`
`[0051]
`
`
`
`APPL-1006 / Page 7 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(8)
`
`JP 2007-259108 A 2007.10.4
`
`When the background blurring mode is selected, the CPU 10_47 disposes the focus lens 10_1a2 in the
`focal position and instructs a clock generator (not illustrated) to supply the exposure start signal to the CCD
`10_41. Afterward, when a predetermined shutter time is elapsed, the exposure end signal is supplied to the
`CCD 10_41 so the image signal is output. This image signal output from the CCD 10_41 is converted into a
`digital signal by the A/D conversion circuit 10_42. The image signal input controller 10_43 in a subsequent
`stage guides the image signal converted into a digital signal to the bus 10_100, and the image signal guided to
`the bus 10_100 is temporarily stored in the memory 10_52. The photographic image represented by this
`image signal obtained by disposing the focus lens 10_1a2 in the focal position is the “first image” as referred
`to in the present invention.
`[0052]
`
`When the image signal representing this first image is entirely stored in the memory 10_52, next, the
`CPU 10_47 reads this image signal and supplies this image signal representing the first image to the image
`signal processing circuit 10_44 via the bus 10_100.
`[0053]
`
`At this time, the CPU 10_47 instructs the motor driver 10_49 to move the focus lens 10_1a2 to a
`macro position (closest end) and instructs a motor driver 10_48 to move the zoom lens 10_1a1 to the wide-
`angle side. Afterward, the clock generator (not illustrated) supplies the exposure start signal so the CCD
`10_41 starts a second round of exposure.
`[0054]
`
`Meanwhile, the image signal processing circuit 10_44 performs edge detection of the first image read
`from the memory 10_52 and cuts out the principal subject. This cutout principal subject is temporarily stored
`in a storage unit (not illustrated) in the image signal processing circuit 10_44.
`[0055]
`
`Here, upon confirming that a predetermined shutter time is elapsed from the clock generator (not
`illustrated) supplying to the CCD 10_47 the exposure start signal for starting exposure in the second round of
`photography, the CPU 10_47 next causes the exposure end signal for ending the second round of exposure to
`be supplied to the CCD 10_41 so the image signal is output to the A/D conversion circuit 10_42. The image
`input controller 10_43 in a subsequent stage guides the image signal converted into a digital signal by the A/D
`conversion circuit 10_42 to the bus 10_100 so this signal is stored in the memory 10_52. This photographic
`image obtained by the second round of photography is the “second image” as referred to in the present
`invention. Moreover, the CPU 10_47, the motor driver 10_48, the motor driver 10_49, the clock generator (not
`illustrated), and the CCD 10_41 correspond to “image generation means” as referred to in the present
`invention.
`[0056]
`
`Furthermore, the CPU 10_47 reads the image signal representing the second image in the memory
`10_52 and supplies this to the image signal processing circuit 10_44. In this image signal processing circuit
`10_44, a region of the second image identical to a region of the principal subject is replaced by the principal
`subject cut out earlier from the first image. After the region of the second image identical to the principal
`subject is replaced by the principal subject cut out from the first image in this manner, the replaced image
`signal is recorded in the recording medium. This image signal processing circuit 10_44 corresponds to “image
`compositing means” as referred to in the present invention.
`[0057]
`
`FIG. 3 is a diagram for describing a relationship between the “first image” as referred to in the
`present invention and the “second image” as referred to in the present invention.
`[0058]
`
`(a) in FIG. 3 illustrates an example where a cylinder that is a principal subject is photographed.
`
`[0059]
`
`Furthermore, (b) to (d) in FIG. 3 illustrate as waveforms detection states of detecting a high-
`frequency component along each position on a horizontal line a–a′, in order from an a side, in the
`photographic image illustrated in (a) in FIG. 3. In (b) to (d) in FIG. 3, the horizontal axis is horizontal position.
`[0060]
`
`(b) in FIG. 3 illustrates a waveform of when an edge of an image from when the focus lens is disposed
`in the focal position and the first round of photography is performed (the “first image” as referred to in the
`present invention) is detected in order from the a side along the horizontal line. Moreover, like (b) in FIG. 3,
`(c) in FIG. 3 illustrates a waveform of when an edge of an image from when the focus lens is moved to a macro
`
`10
`
`20
`
`30
`
`40
`
`50
`
`
`
`APPL-1006 / Page 8 of 30
`APPLE INC. v. COREPHOTONICS LTD.
`
`

`

`
`
`(9)
`
`JP 2007-259108 A 2007.10.4
`
`side and photography is performed is detected. Moreover, like (b) in FIG. 3, (d) in FIG. 3 illustrates a
`waveform of when an edge of an image from when the focus lens is moved to the macro side, the z