(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2007/0018069 A1
`Higashino
`(43) Pub. Date:
`Jan. 25, 2007
`
`US 200700 18069A1
`
`(54) IMAGE PICKUP APPARATUS, CONTROL
`METHOD, AND PROGRAM
`(75) Inventor: Fuminobu Higashino, Kanagawa (JP)
`Correspondence Address:
`LERNER, DAVID, LITTENBERG,
`KRUMHOLZ. & MENTLIK
`6OO SOUTHAVENUE WEST
`WESTFIELD, NJ 07090 (US)
`(73) Assignee: Sony Corporation, Tokyo (JP)
`(21) Appl. No.:
`11/481,479
`(22) Filed:
`Jul. 6, 2006
`
`(30)
`
`Foreign Application Priority Data
`
`Jul. 6, 2005 (JP).................................... P2005-197086
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`CI2O I/68
`(52) U.S. Cl. .............................................................. 250/2OO
`
`ABSTRACT
`(57)
`An image pickup apparatus, a control method and a program
`are provided. The image pickup apparatus includes an
`imaging module which takes an image; a display module
`which displays the image taken by the imaging module; a
`touch R Širit is R the E. module
`and manipulatable by a user; a focus frame control module
`which controls a focus frame in accordance with a manipu
`lation of the touch panel by the user, the focus frame being
`set at a given position on the image displayed on the display
`module and being used for focus control; and a focus control
`module which controls focus based on an image inside the
`focus frame on the image displayed on the display module.
`
`
`
`ONE TOUCH
`
`10
`
`AFFRAME
`
`'s as esses a e s - a r s - e o os
`FRAME IS MOVED
`
`Qualcomm, Exh. 2010, p. 1
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 1 of 8
`
`US 2007/0018069 A1
`
`FIG. 1
`
`
`
`5
`
`LENS SIDE
`
`Qualcomm, Exh. 2010, p. 2
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 2 of 8
`
`US 2007/0018069 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`T\/N?IS TWLISOICIO//TVNOIS ?OTWNY/
`
`€)NICHOOEH
`
`BOIAEO
`
`096282/3
`
`HO?OW
`
`HEAIHO
`
`Z8
`
`Qualcomm, Exh. 2010, p. 3
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 3 of 8
`
`US 2007/0018069 A1
`
`| 18Wd
`
`TOHINOO HW
`
`
`
`
`
`
`
`
`
`
`
`Qualcomm, Exh. 2010, p. 4
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 4 of 8
`
`US 2007/0018069 A1
`
`
`
`CEAOW SI EWVH-]
`
`HO[IOLENO
`
`Qualcomm, Exh. 2010, p. 5
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 5 of 8
`
`US 2007/0018069 A1
`
`
`
`©EOVHL
`
`<!OBNOW SI BWVH+
`
`Qualcomm, Exh. 2010, p. 6
`Apple v. Qualcomm, 2018-01278
`
`

`

`Qualcomm, Exh. 2010, p. 7
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 7 of 8
`
`US 2007/0018069 A1
`
`FIG. 7
`
`AFFRAME
`CONTROL PROCESS
`
`BEING TOUCHED?
`YES
`STATUS-1
`HistoRyo y YES
`ISTOUCHE
`e.
`
`S11
`
`
`
`
`
`
`
`DPLACE
`SAME AS PREV
`IOUS TIME?
`YES
`COUNTER DEFINED
`TIME PERIOD?
`YES
`UPDATE
`FRAME SIZE
`
`
`
`
`
`
`
`S12
`
`STATUS-0
`
`
`
`
`
`S13
`
`CLEAR
`COUNTER
`
`
`
`
`
`
`
`
`
`
`
`
`
`S16
`S18
`UPDATE CENTER
`POSITION OF FRAME
`
`INCREMENT
`COUNTER
`
`
`
`CLEAR
`COUNTER
`
`HISTORY-STATUS
`
`Qualcomm, Exh. 2010, p. 8
`Apple v. Qualcomm, 2018-01278
`
`

`

`Patent Application Publication Jan. 25, 2007 Sheet 8 of 8
`
`US 2007/0018069 A1
`
`FIG. 8
`
`AFCONTROL
`PROCESS
`
`
`
`EXTRACT ANIMAGE
`INSIDEAF FRAME
`
`S1
`
`
`
`CALCULATE CONTRAST
`NFORMATIONABOUTAF FRAME IMAGE
`
`S2
`
`
`
`CONTROLFOCUS BASED
`ON CONTRAST INFORMATION
`
`
`
`S3
`
`Qualcomm, Exh. 2010, p. 9
`Apple v. Qualcomm, 2018-01278
`
`

`

`US 2007/0018069 A1
`
`Jan. 25, 2007
`
`IMAGE PICKUP APPARATUS, CONTROL
`METHOD, AND PROGRAM
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`0001. The present application claims priority from Japa
`nese Patent Application No.JP 2005-197086 filed on Jul. 6,
`2005, the disclosure of which is hereby incorporated by
`reference herein.
`
`BACKGROUND OF THE INVENTION
`
`0002)
`1. Field of the Invention
`0003. The present invention relates to an image pickup
`apparatus, a control method, and a program, particularly to
`an image pickup apparatus, a control method, and a pro
`gram, which can improve usability.
`0004 2. Description of the Related Art
`0005 For example, cameras such as a digital (still) cam
`era and a digital video camera generally have a so-called
`autofocus function.
`0006.
`In the autofocus function, for example, at the center
`of an image taken by a picture element such as a CCD
`(Charge Coupled Device) and a CMOS (Complementary
`Metal Oxide Semiconductor) imager, a focus frame is dis
`posed which is used for focus control, and the focus is
`controlled in such a way that a high frequency component of
`the image inside the focus frame is the maximum, that is, the
`contrast inside the focus frame is the greatest (focus is
`adjusted).
`0007. In the autofocus function before, the focus frame is
`fixed at the center position of the image taken by the picture
`element. Therefore, in the cases in which a subject (the
`image of a Subject) to be focused is not inside the focus
`frame, and the size of a subject inside the focus frame is too
`small as compared with the size of the focus frame even
`though it is inside the focus frame, the subject to be focused
`might not achieve the focus.
`0008. Then, for example, the following methods are
`proposed. The method in which an image taken by a picture
`element is split into small blocks of a 10 by 10 matrix of
`pixels, one or more Small blocks are specified for a focus
`frame, and the focus frame in desired size is set at a desired
`position in a desired shape, and the method in which focus
`frames are defined in a plurality of patterns, a pattern
`selection button is operated to select a focus frame used for
`focus control among the focus frames in the plurality of the
`patterns, and a scaling button and a cross key (a button for
`up, down, right and left directions) is operated to further
`change the position, shape and size of the selected focus
`frame, as necessary (for example, see JP-A-6-113187).
`0009. However, in the method to specify one or more
`small blocks to be the focus frame and to set the focus frame,
`it is necessary to specify a small block one by one or
`multiple blocks by multiple blocks in order to configure a
`desired focus frame, which hardly has excellent usability. In
`addition, since the minimum unit of configuring the focus
`frame is a small block of a 10 by 10 matrix of pixels, the
`position and size of the focus frame are limited by that small
`block. For example, it is difficult to set the focus frame at the
`position at which the border of the focus frame is not
`
`matched with the border of the small block. Furthermore, the
`focus frame can be moved only in a unit often pixels which
`is the matrix size of the small block.
`0010. In addition, in the method in which the focus frame
`used for focus control is selected by operating the pattern
`selection button, and the position, shape and size of the
`selected focus frame are changed by manipulating the scal
`ing button and the cross key, as necessary, various manipu
`lations have to be done for setting the focus frame at a
`desired position, for example, which hardly has excellent
`usability.
`
`SUMMARY OF THE INVENTION
`0011. The invention has been made in view of the cir
`cumstances. It is desirable to improve usability, particularly,
`operational ease of setting a focus frame.
`0012. An image pickup apparatus according to an
`embodiment of the invention includes an imaging module
`which takes an image; a display module which displays the
`image taken by the imaging module; a touch panel config
`ured integrally with the display module and manipulatable
`by a user, a focus frame control module which controls a
`focus frame in accordance with a manipulation of the touch
`panel by the user, the focus frame being set at a given
`position on the image displayed on the display module and
`being used for focus control; and a focus control module
`which controls focus based on an image inside the focus
`frame on the image displayed on the display module.
`0013 A control method according to an embodiment of
`the invention is a control method of an image pickup
`apparatus having an imaging module which takes an image:
`a display module which displays the image taken by the
`imaging module; and a touch panel configured integrally
`with the display module and manipulatable by a user, the
`method including controlling a focus frame in accordance
`with a manipulation of the touch panel by the user, the focus
`frame being set at a given position on the image displayed
`on the display module and being used for focus control; and
`controlling focus based on an image inside the focus frame
`on the image displayed on the display module.
`0014) A program according to an embodiment of the
`invention is a program which runs a process by a computer
`that controls an image pickup apparatus having an imaging
`module which takes an image; a display module which
`displays the image taken by the imaging module; and a touch
`panel configured integrally with the display module and
`manipulatable by a user, the process including controlling a
`focus frame in accordance with a manipulation of the touch
`panel by the user, the focus frame being set at a given
`position on the image displayed on the display module and
`being used for focus control; and controlling focus based on
`an image inside the focus frame on the image displayed on
`the display module.
`0015. In an image pickup apparatus, a control method, or
`a program according to an embodiment of the invention, a
`focus frame is set at a given position on the image displayed
`on the display module, and is used for focus control. The
`focus frame is controlled in accordance with a manipulation
`of the touch panel by a user, and the focus is controlled based
`on an image inside the focus frame on the image displayed
`on the display module.
`
`Qualcomm, Exh. 2010, p. 10
`Apple v. Qualcomm, 2018-01278
`
`

`

`US 2007/0018069 A1
`
`Jan. 25, 2007
`
`0016. According to an embodiment of the invention,
`operational ease of setting the focus frame can be improved.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0017. The teachings of the invention can be readily
`understood by considering the following detailed descrip
`tion in conjunction with the accompanying drawings, in
`which:
`0018 FIG. 1 shows a perspective view depicting an
`exemplary configuration of the appearance of an embodi
`ment of a digital camera to which an embodiment of the
`invention is applied;
`0.019
`FIG. 2 shows a block diagram depicting an exem
`plary internal configuration of an embodiment of the digital
`camera to which an embodiment of the invention is applied;
`0020 FIG. 3 shows a block diagram depicting an exem
`plary functional configuration of an AF processing part 50:
`0021
`FIG. 4 shows a diagram depicting a manner of
`moving an AF frame;
`0022 FIG. 5 shows a diagram depicting a manner of
`moving an AF frame;
`0023 FIG. 6 shows a diagram depicting a manner of
`changing the size of the AF frame;
`0024 FIG. 7 shows a flow chart illustrative of an AF
`frame control process; and
`0025 FIG. 8 shows a flow chart illustrative of an AF
`control process.
`
`DETAILED DESCRIPTION
`Hereinafter, embodiments of the invention will be
`0026.
`described. The following is examples of the correspondence
`between configuration requirements for the invention and
`the embodiments of the detailed description of the invention.
`This is described for confirming that the embodiments
`Supporting the invention are described in the detailed
`description of the invention. Therefore, even though there is
`an embodiment that is described in the detailed description
`of the invention but is not described herein as an embodi
`ment corresponding to configuration requirements for the
`invention, it does not mean that the embodiment does not
`correspond to those configuration requirements. Contrary to
`this, even though an embodiment is described herein as an
`embodiment corresponding to configuration requirements, it
`does not mean that the embodiment does not correspond to
`configuration requirements other than those configuration
`requirements.
`0027 First, an image pickup apparatus according to an
`embodiment of the invention is an image pickup apparatus
`(for example, a digital camera shown in FIG. 2) including:
`an imaging module which takes an image (for example, a
`CCD 21 shown in FIG. 2); a display module which displays
`the image taken by the imaging module (for example, a
`liquid crystal panel 11 shown in FIG. 2); and a touch panel
`which is configured integrally with the display module and
`which is manipulated by a user (for example, a touch panel
`12 shown in FIG. 2), the image pickup apparatus further
`includes: a focus frame control module which controls a
`focus frame in accordance with a manipulation of the touch
`panel by the user, the focus frame which is set at a given
`
`position on the image displayed on the display module and
`which is used for focus control (for example, an AF frame
`control part 52 shown in FIG.3); and a focus control module
`which controls focus based on an image inside the focus
`frame in the image displayed on the display module (for
`example, an AF control part 53 shown in FIG. 3).
`0028. A control method or a program according to an
`embodiment of the invention is a control method of an image
`pickup apparatus (for example, the digital camera shown in
`FIG. 2) including an imaging module which takes an image
`(for example, the CCD 21 shown in FIG. 2) a display
`module which displays the image taken by the imaging
`module (for example, the liquid crystal panel 11 shown in
`FIG. 2); and a touch panel which is configured integrally
`with the display module and which is manipulated by a user
`(for example, the touch panel 12 shown in FIG. 2), or a
`program which runs a process by a computer that controls
`the image pickup apparatus, the method and the process of
`the program including the steps of controlling a focus frame
`in accordance with a manipulation of the touch panel by the
`user, the focus frame which is set at a given position on the
`image displayed on the display module and which is used for
`focus control (for example, an AF frame control process
`shown in FIG. 7); and controlling focus based on an image
`inside the focus frame in the image displayed on the display
`module (for example, an AF control process shown in FIG.
`8).
`0029. Hereinafter, an embodiment of the invention will
`be described with reference to the drawings.
`0030 FIG. 1 shows a perspective view depicting an
`exemplary configuration of the appearance of an embodi
`ment of a digital camera to which an embodiment of the
`invention is applied.
`0031. In addition, a digital camera is shown on the upper
`side in FIG. 1 as the front (the lens side facing a subject) is
`frontward, and it is shown on the lower side in FIG. 1 as the
`back side (the panel side facing a user (operator) of the
`digital camera) is frontward.
`0032) Facing toward the drawing, on the right side of the
`front of the digital camera (the upper side in FIG. 1), a lens
`part 1 is disposed. The lens part 1 is formed of an optical
`system including a lens which collects lights from a Subject,
`a focus lens which adjusts focus, and a diaphragm, and other
`elements (they are all not shown). The lens part is configured
`which is exposed out of a case of the digital camera when a
`power Source of the digital camera is turned on whereas it is
`housed inside the case of the digital camera when the power
`source of the digital camera is turned off. In FIG. 1, the lens
`part 1 is in the state in which it is housed inside the case of
`the digital camera.
`0033) Facing toward the drawing, on the upper right side
`of the center in the front of the digital camera, an AF
`(AutoFocus) fill light projecting part 2 is disposed. The AF
`fill light projecting part 2 emits light as AF fill light toward
`the optical axis direction of the optical system of the lens
`part 1 to illuminate the subject. Thus, for example, it is
`configured to work a so-called autofocus function that takes
`an image of the Subject even in a dark place and achieves
`focus on the Subject based on the image.
`0034) Facing toward the drawing, on the upper left side
`of the center in the front of the digital camera, a viewfinder
`
`Qualcomm, Exh. 2010, p. 11
`Apple v. Qualcomm, 2018-01278
`
`

`

`US 2007/0018069 A1
`
`Jan. 25, 2007
`
`3 is disposed which continues to the back side of the digital
`camera. On the left of the viewfinder 3, a flash 4 is disposed.
`0035). On the left side of the upper part of the digital
`camera seen from the front side, a power source switch 5 is
`disposed which is manipulated when the power source is
`turned on/off, and a shutter button (release button) 6 is
`disposed which is operated when an image is recorded.
`0.036
`Facing toward the drawing, on the upper right side
`of the back side of the digital camera (on the lower side in
`FIG. 1), a Zoom button 7 is disposed which is manipulated
`when the magnification of Zooming is adjusted. On the left
`side and the lower side of the Zoom button 7, a mode dial 8
`and a manipulation button 9 are disposed, respectively. The
`mode dial 8 is manipulated when the modes of the digital
`camera are selected Such as a mode that forcefully turns
`on/off light emission of the flash 4, a mode that uses a
`self-timer, and a mode that displays a menu screen on a
`liquid crystal panel 11, described later. The manipulation
`button 9 is manipulated at such a time when a cursor is
`moved to select items of the menu screen displayed on the
`liquid crystal panel 11, or when a confirmation is made for
`selecting an item.
`0037. A touch screen 10 is a device that combines the
`liquid crystal panel 11 with a touch panel 12 in one piece,
`which various images are displayed on the liquid crystal
`panel 11 and user operation can be accepted with the touch
`panel 12.
`0038 Next, FIG. 2 shows an exemplary internal configu
`ration of the digital camera shown in FIG. 1.
`0039. In addition, in FIG. 2, the AF fill light projecting
`part 2, the viewfinder 3, and the flash 6 shown in FIG. 1 are
`omitted in the drawing.
`0040 A CCD (Charge Coupled Device) 21 is manipu
`lated in response to a timing signal Supplied from a timing
`generator (TG) 31 to receive the light from the subject
`coming through the lens part 1 for photoelectric conversion,
`and Supplies an analog image signal as an electrical signal in
`accordance with the received light quantity to an analog
`signal processing part 22.
`0041. The analog signal processing part 22 performs
`analog signal processing Such as amplification for the analog
`image signal from the CCD 21 in accordance with control
`done by a CPU (Central Processing Unit) 26, and supplies
`an image signal resulted from the analog signal processing
`to an A/D (Analog/Digital) converting part 23.
`0042. The A/D converting part 23 performs A/D conver
`sion of the analog image signal from the analog signal
`processing part 22 in accordance with control done by the
`CPU 26, and supplies image data of the resulted digital
`signal to a digital signal processing part 24.
`0043. The digital signal processing part 24 performs
`digital signal processing Such as noise cancellation process
`ing for the image data from the A/D converting part 23 in
`accordance with control done by the CPU 26, and supplies
`it to the liquid crystal panel 11 for display. In addition, the
`digital signal processing part 24 compresses the image data
`from the A/D converting part 23 by JPEG (Joint Photo
`graphic Experts Group) mode, for example, and Supplies the
`resulted compressed image data to a recording device 25 for
`recording. Furthermore, the digital signal processing part 24
`
`expands the compressed image data recorded in the record
`ing device 25, and Supplies the resulted image data to the
`liquid crystal panel 11 for display. In addition to this, the
`digital signal processing part 24 creates an image of an AF
`frame (a focus frame) used for focus control in accordance
`with control done by the CPU 26, and supplies it to the liquid
`crystal panel 11 for display.
`0044) The recording device 25 is a removable recording
`medium such as a disc including a DVD (Digital Versatile
`Disc), a semiconductor memory including a memory card
`and other devices, which is easily detachable from the digital
`CaCa.
`0045. The CPU 26 runs a program recorded in a program
`ROM (Read Only Memory) 29 to control each part config
`uring the digital camera, and runs various processes in
`response to a signal from the touch panel 12 and a signal
`from a manipulating part 27.
`0046) The manipulating part 27 is manipulated by a user
`to Supply a signal associated with that manipulation to the
`CPU 26. In addition, the manipulating part 27 corresponds
`to the power source switch 5, the shutter button 6, the Zoom
`button 7, and the mode dial 8 shown in FIG. 1.
`0047. An EEPROM (Electrically Erasable Program
`mable ROM) 28 stores data that has to be held even when
`the power source of the digital camera is turned off in
`accordance with control done by the CPU 26, the data
`including various items of information set in the digital
`camera and other information.
`0048. The program ROM 29 stores a program run by the
`CPU 26 as well as data necessary to run the program by the
`CPU 26. A RAM (Read Only Memory) 30 temporarily
`stores a program and data necessary to run various processes
`by the CPU 26.
`0049. The timing generator 31 supplies a timing signal to
`the CCD 21 in accordance with control done by the CPU 26.
`The timing signal Supplied from the timing generator 31 to
`the CCD 21 controls an exposure time period (shutter speed)
`and other time periods in the CCD 21.
`0050. A motor driver 32 drives an actuator (motor) 33 in
`accordance with control done by the CPU 26. The actuator
`33 is driven to cause the lens part 1 to be exposed out of the
`case of the digital camera, or to be housed inside the case of
`the digital camera. In addition, the actuator 33 is driven to
`adjust the diaphragm configuring the lens part 1 and to move
`the focus lens configuring the lens part 1.
`0051. In the digital camera thus configured, the CCD 21
`receives the incoming light from the Subject through the lens
`part 1 for photoelectric conversion, and outputs the resulted
`analog image signal. The analog image signal outputted
`from the CCD 21 is made to be image data of the digital
`signal through the analog signal processing part 22 and the
`A/D converting part 23, and is Supplied to the digital signal
`processing part 24.
`0052 The digital signal processing part 24 supplies the
`image data from the A/D converting part 23 to the liquid
`crystal panel 11, and thus a so-called through-image is
`displayed on the liquid crystal panel 11.
`0053. After that, when a user manipulates the shutter
`button 6 (FIG. 1), the signal associated with that manipu
`
`Qualcomm, Exh. 2010, p. 12
`Apple v. Qualcomm, 2018-01278
`
`

`

`US 2007/0018069 A1
`
`Jan. 25, 2007
`
`lation is supplied from the manipulating part 27 to the CPU
`26. When the signal associated with the manipulation of the
`shutter button 6 is supplied from the manipulating part 27,
`the CPU 26 controls the digital signal processing part 24 to
`compress image data Supplied from the A/D converting part
`23 to the digital signal processing part 24 and to record the
`resulted compressed image data in the recording device 25.
`0054 As described above, a so-called photograph is
`taken.
`0055. In addition, the program run by the CPU 26 is
`installed (stored) in the program ROM 29 beforehand. In
`addition to this, this scheme may be done in which it is
`recorded in the recording device 25, offered as a package
`medium for the user, and installed from the recording device
`25 to the EEPROM 28 through the digital signal processing
`part 24 and the CPU 26. In addition, this scheme may be
`done as well in which the program run by the CPU 26 is
`directly downloaded from a download site to the digital
`camera shown in FIG. 2, or downloaded to a computer, not
`shown, Supplied to the digital camera shown in FIG. 2, and
`installed in the EEPROM 28.
`0056 Next, the digital camera shown in FIG. 2 has an
`autofocus function. In the autofocus function, the AF frame
`(detection frame) is set on an image taken by the CCD 21,
`and the focus is controlled (the focus lens is moved) based
`on the image inside the AF frame.
`0057. Furthermore, in the autofocus function of the digi
`tal camera shown in FIG. 2, the AF frame is configured
`which can be set at a given position on the image displayed
`on the liquid crystal panel 11, and control over the position
`and size thereof can be done only by manipulation over the
`touch panel 12 configured integrally with the liquid crystal
`panel 11.
`0.058. In the digital camera shown in FIG. 2, an AF
`process for the autofocus function is done by running the
`program by the CPU 26.
`0059. Then, FIG. 3 shows an exemplary functional con
`figuration of the AF processing part 50 which performs the
`AF process. In addition, the AF processing part 50 is
`implemented in a so-called virtual manner by running the
`program by the CPU 26.
`0060. The AF processing part 50 is configured of a touch
`detecting part 51, an AF frame control part 52, and an AF
`control part 53.
`0061. To the touch detecting part 51, a signal is supplied
`from the touch panel 12 of the touch screen 10. The touch
`detecting part 51 detects the descriptions of user manipula
`tion with respect to the touch screen 10 (the touch panel 12
`of the touch screen 10) based on the signal from the touch
`screen 10 (the touch panel 12 of the touch screen 10), and
`Supplies manipulation information showing the descriptions
`of the manipulation to the AF frame control part 52.
`0062) The AF frame control part 52 controls the AF frame
`set at a given position on the image displayed on the liquid
`crystal panel 11 of the touch screen 10 in accordance with
`manipulation information from the touch detecting part 51,
`and supplies information about the AF frame (hereinafter,
`properly called AF frame information) to the digital signal
`processing part 24 (FIG. 2) and the AF control part 53.
`
`0063 Here, when the digital signal processing part 24
`(FIG. 2) receives AF frame information supplied from the
`AF frame control part 52, it creates an AF frame (an image
`of an AF frame) expressed by the AF frame information.
`Furthermore, the digital signal processing part 24 Superim
`poses the AF frame (the image of the AF frame) on data of
`an image that is taken by the CCD 21 and supplied from the
`A/D converting part, and supplies it to the touch screen 10
`(the liquid crystal panel 11 of the touch screen 10) for
`display. Therefore, on the touch screen 10 (the liquid crystal
`panel 11 of the touch screen 10), the AF frame is displayed
`along with the image taken by the CCD 21.
`0064 Consequently, a user simply views the display on
`the touch screen 10 to easily confirm on which part the AF
`frame is set on the image taken by the CCD 21.
`0065. In addition, the AF frame control part 52 has a
`status flag, a history flag, and a counter therein. In the
`embodiment, the status flag, the history flag, and the counter
`are used to control the AF frame.
`0.066. The AF control part 53 is configured to receive AF
`frame information from the AF frame control part 52 thereto
`as well as data of the image taken by the CCD 21 from the
`digital signal processing part 24 (FIG. 1). The AF control
`part 53 creates a focus control signal for focus control based
`on image data inside the AF frame specified by AF frame
`information from the AF frame control part 52 in image data
`from the digital signal processing part 24, and Supplies it to
`the motor driver 32 (FIG. 1).
`0067 More specifically, the AF control part 53 creates a
`focus control signal that moves the focus lens of the lens part
`1 in the direction in which the high frequency component of
`image data inside the AF frame becomes greater in the image
`data from the digital signal processing part 24, and Supplies
`it to the motor driver 32.
`0068. Here, the motor driver 32 drives the actuator 33 in
`response to the focus control signal from the AF control part
`53, and thus the focus lens is moved in the direction in which
`the high frequency component of the image data inside the
`AF frame becomes greater.
`0069. Next, AF frame control done by the AF control part
`52 of the AF processing part 50 shown in FIG. 3 will be
`described with reference to FIGS. 4 to 6.
`0070 When the power source of the digital camera is
`turned on, for example, the AF frame control part 52
`displays the AF frame in the default size on the touch screen
`10 at the barycenter of the image displayed on the touch
`screen 10 (the liquid crystal panel 11 of the touch screen 10)
`as the default position. More specifically, the AF frame
`control part 52 supplies AF frame information including the
`default position and default size of the AF frame to the
`digital signal processing part 24. The digital signal process
`ing part 24 creates an image of the AF frame in accordance
`with AF frame information from the AF frame control part
`52, and supplies it to the touch screen 10 (the liquid crystal
`panel 11 of the touch screen 10). Thus, the AF frame in the
`default size is displayed at the default position on the touch
`screen 10. In addition, for another AF frame right after the
`power source is turned on, an AF frame may be adopted that
`is the same as the AF frame displayed right before the power
`Source is turned off, for example.
`
`Qualcomm, Exh. 2010, p. 13
`Apple v. Qualcomm, 2018-01278
`
`

`

`US 2007/0018069 A1
`
`Jan. 25, 2007
`
`0071 FIG. 4 shows the state in which the AF frame in the
`default size is displayed at the default position on the touch
`screen 10.
`0072 The AF frame has a landscape rectangular shape,
`for example, and is displayed so that its barycenter position
`is matched with the default position at the default size.
`0073. After that, when a user touches a certain position
`on the touch screen 10 (the touch panel 12 of the touch
`screen 10), that is, when the user makes one touch at a
`certain position on the touch screen 10 and moves his/her
`finger off, the AF frame control part 52 instantaneously
`moves the AF frame to the position at which the user has
`made one touch as shown by a dotted lien in FIG. 4.
`0074 More specifically, when the user makes one touch
`at a certain position on the touch screen 10, manipulation
`information including the position at which the user has
`made one touch is supplied from the touch detecting part 51
`to the AF frame control part 52. The AF frame control part
`52 supplies AF frame information including the position (the
`position at which the user has made one touch) included in
`manipulation information from the touch detecting part 51
`and the current size of the AF frame to the digital signal
`processing part 24. The digital signal processing part 24
`creates an image of the AF frame in accordance with the AF
`frame information from the AF frame control part 52, and
`supplies it to the touch screen 10. On the touch screen 10, as
`shown by a doted line in FIG. 4, the AF frame is displayed
`at the position at which the user has made one touch as the
`size is maintained. In this case, the AF frame is to be
`instantaneously moved to the position at which the user has
`made one touch.
`0075. In addition, when a user moves the touched posi
`tion while he/she is touching on the touch screen 10, the AF
`frame control part 52 moves the AF frame in accordance
`with the user moving the touched position.
`0076 More specifically, FIG. 5 shows the manner of
`moving the AF frame when the user moves the touched
`position while he/she is touching on the touch screen 10.
`0077. When the user moves the touched position while
`he/she is touching on the touch screen 10, manipulation
`information including the position after moved is Supplied
`from the touch detecting part 51 to the AF frame control part
`52. The AF frame control part 52 supplies AF frame infor
`mation including the position included in manipulation
`information from the touch detecting part 51 and the current
`size of the AF frame to the digital signal processing part 24.
`The digital signal processing part 24 creates an image of the
`AF frame in accordance with the AF frame information from
`the AF frame control part 52, and supplies it to the touch
`screen 10.
`0078. The supply from the touch detecting part 51 to the
`AF frame control part 52 of manipulation informatio