(12) United States Patent
`Watanabe
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,027,171 B1
`Apr. 11, 2006
`
`US0070271 71B1
`
`(54) DIGITAL CAMERA AND DOCUMENT
`PHOTOGRAPHING AND TRANSMITTING
`METHOD OF THE SAME
`
`(75) Inventor: Yoshikazu Watanabe, Tokyo (JP)
`
`(73) Assignee: Ricoh Company, Ltd., Tokyo (JP)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/537,405
`
`(22) Filed:
`
`Mar. 29, 2000
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 11-09.0224
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - 2OOO-O 12217
`
`30
`Foreign Application PrioritV Data
`gn App
`ty
`Mar. 30, 1999 (JP)
`Jan. 20, 2000
`(JP)
`(51) Int. Cl.
`(2006.01)
`G06K L/00
`(2006.01)
`G06F 5/00
`(52) U.S. Cl. ..................... 358/1.15: 358/488; 382/112:
`382/164
`(58) Field of Classification Search ............... 358/1.15,
`358/18, 488, 1.14; 355/18: 396/429,55,
`396/229, 266; 382/313,317, 318,321, 112,
`382/164, 289, 488; 39971, 38
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`6,167.469 A 12/2000 Safai et al. ................... T10.62
`6,304,313 B1 * 10/2001 Honma ........................ 355.18
`2001/0015760 A1* 8/2001 Fellegara et al. ...... 348,333.01
`FOREIGN PATENT DOCUMENTS
`2-21782
`1, 1990
`6-256907
`9, 1994
`7-212707
`8, 1995
`T-336581
`12/1995
`E.
`g
`1O-3109
`1, 1998
`10-65867
`3, 1998
`1O-336574
`12/1998
`11-46331
`2, 1999
`11084482 A * 3, 1999
`
`JP
`JP
`JP
`JP
`E.
`JP
`JP
`JP
`JP
`JP
`
`* cited by examiner
`y
`Primary Examiner Gabriel Garcia
`Assistant Examiner Thierry L. Pham
`(74) Attorney, Agent, or Firm Oblon, Spivak, McClelland,
`Maier & Neustadt, P.C.
`
`(57)
`
`ABSTRACT
`
`An image processing section provided in a digital camera
`converts the image photographed in a document photograph
`ing mode to any data format that a destination (a facsimile
`or a personal computer) selected by a user requires.
`
`61 Claims, 12 Drawing Sheets
`
`SO
`
`docum
`PHCOGRAPNS
`ME
`
`mo
`
`Yes
`
`- ReLAs button
`
`PRESSEC
`
`Yes
`GUDANCE FRAM
`E
`SPAY
`
`STARTICKING UPMAG
`AND OSPLAYING PREWEW
`HEMAGE
`
`CEECANGLE OF
`PCAPHY
`
`st 10
`COGRAPH AND
`RECORN
`NORMAMCDE
`
`S10s
`RELEASE BUN
`PRESSE
`
`No.
`
`Sof
`cArture, compress, And
`RECOR TE MAGE
`
`
`
`SiO3
`CACULATE MAGNIFICATION
`ATHEIM OF photography
`S109
`Record the MAGNIFICATION AND
`THFRAMINForMATION
`
`
`
`
`
`
`
`
`
`PNC 1106
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 1 of 12
`
`US 7,027,171 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`NOI LVHEIdO
`
`NO I LOBS
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 2 of 12
`
`US 7,027,171 B1
`
`FIG.2
`
`MAGE FILE
`
`COMPRESSED
`MAGE DATA
`
`151
`
`152
`
`HEADER
`
`
`
`MODE OF
`PHOTOGRAPHY
`
`DATE AND TIME
`OF PHOTOGRAPHY
`MAGNIFICATION AT
`THE TIME OF
`PHOTOGRAPHY
`
`153
`
`154
`
`155
`
`FRAME TYPE
`
`156
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 3 of 12
`
`US 7,027,171 B1
`
`FG.3
`
`S100
`
`No
`
`DOCUMENT
`PHOTOGRAPHING
`MODE
`
`RELEASE BUTTON
`PRESSED
`
`DISPLAY GUIDANCE FRAME
`S110
`S' PHOTOGRAPH AND
`START PICKING UP IMAGE
`RECORD IN
`AND DISPLAYING PREVIEW
`NORMA MODE
`THE IMAGE
`
`a
`
`DETECT ANGLE OF
`PHOTOGRAPHY
`
`RELEASE BUTTON
`PRESSED?
`
`S107
`CAPTURE, COMPRESS, AND
`RECORD THE MAGE
`
`S108
`CAL CULATE MAGNIFICATION
`AT THE TIME OF PHOTOGRAPHY
`S109
`RECORD THE MAGNIFICATION AND
`THE FRAME INFORMATION
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 4 of 12
`
`US 7,027,171 B1
`
`FG.4
`
`
`
`TOTAL OUALITY S THE GOAL OF THE MEGA
`PXEL DIGITAL CAMERA PROVIDED BY RICOH.
`THE WORLD IN EXCESS OF MEGA PIXELS
`DEMANDS ADVANCED TECHNOLOGY FOR
`: ALL THE LENS PERFORMANCE,
`THE SHUTTER MECHANISM, AND THE IMAGE
`PROCESSING ALGORITHM.
`AS YOU MAY KNOW, RICOH HAS REALIZED
`THE NEW TECHNOLOGY AND ALSO
`: HIGH-QUALITY IMAGE AS ARESULT OF
`GETTING THE BEST PERFORMANCE OF
`THE MEGA-PXE CCD BASED ON THE
`COMBINATION OF THESE TECHNOLOGES.
`FURTHER, RICOH DC-4 HAS A COMPACT
`BOOY WITH A BUILT-N 3X ZOOM OPTICAL
`LENS, AND DC-4T ALSO HAS A COMPACT BODY :
`WITH A BUILT-N 2X ZOOM OPTICAL LENS.
`: YOU CAN SEE ALL THE TECHNOLOGIES,
`THAT RCOH HAS DEVELOPED,
`ON SETTING OF AN OPTIMAL MAGE SIZE
`THAT IS USED FURTHER FOR TV
`; REPRODUCTION AND PCS, AND ALSO
`ONUSER-FRIENDLY DESIGN.
`WHY NOT MAKE SURE HOW HIGH
`THE QUALITY OF RICOH DC-4 SERIES IS2
`
`5O2
`
`503
`
`504
`
`501
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet S of 12
`
`US 7,027,171 B1
`
`FG.5A
`
`606
`
`co
`?
`
`S ge DOCUMENT
`
`FG5B
`
`"&
`604-/
`605
`
`606
`
`6O7
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 6 of 12
`
`US 7,027,171 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FG.6
`
`SELECT DESTINATION
`
`S200
`
`SELECT MAGE TO BE
`TRANSMITTED
`
`S2O1
`
`READ IMAGE
`
`S2O2
`
`IMAGE
`PHOTOGRAPHED IN DOCUMENT
`PHOTOGRAPHNG
`MODE?
`
`READ MAGNIFICATION AND
`FRAME INFOMATION
`
`S205
`IS DESTINATION FACSMILE 2
`
`Y
`
`No
`
`S DESTINATION MAL
`DDRESS
`
`S2O6
`
`
`
`S213
`
`EXPAND IMAGE DATA
`S208
`S24
`
`
`
`EXPAND MAGE DATA
`
`SEND IN NORMAL MODE
`(FTP, DEDICATED TERMINAL)
`
`S215
`
`SCALE
`
`
`
`
`
`
`
`S2O
`CONVERT TO BINARY
`CODE
`
`S216
`CONVERT TO
`BNARY CODE
`
`S21
`CHARACTER
`RECONGINITION
`
`S212
`
`SEND MAIL
`
`S217
`
`COMPRE
`(MH, MR, MMR)
`S28
`
`SEND BY
`FACSMILE
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 7 of 12
`
`US 7,027,171 B1
`
`Pot eee dew eee cee w ewe ewe c ene ewes aces eee cores en esessenseneas
`
`c0f
`
`Ny
`
`AL
`
`JOLINOW
`20d
`
`OLL
`
`esNOILVOINNNWOO
`
`Gorere
`
`002Z01JOVIUAININOILYuagO
`290NOILOAS1ji000FOVAYSLNI8060
`asA3XGYVH
`
`
`
`
`
`
`
`dNXOldJOVI
`
`
`
`NOILOISPOLSOL
`
`JOVI
`
`NOILOAS
`
`ONISSIOOUd901ZO
`
`NOILOAS
`
`AVdsid
`
`TOYLNOOgo
`
`NOILOSS
`
`NOILO3S
`
`LOLwnigsaw
`
`WALSAS
`
`JTOYLNOOD
`
`NOILOAS
`
`NOILVNILSSG
`
`AHOWAW
`
`NOILOSS
`
`ONIGHOOSY
`
`WNIGAW
`
`SOVSAYALNI
`
`SNIGHUODSY
`
`eeeeeeeeey”
`
`ee ee ce ee eee sete weer sm esemessanesaeseeeeomanece
`
`
`
`
`
`
`

`

`Apr. 11
`’
`Apr. 11
`9
`
`2006
`2006
`
`Sheet 8 of 12
`Sheet 8 of 12
`
`US 7,027,171 B1
`US 7,027,171 B1
`
`Sv14dNOIL3130
`
`ADVANI
`
`U.S. Patent
`U.S. Patent
`
`
`
`
`
`
`
`
`
`NOILVWHOANIAVTdSIG
`eAHH-EDGE-CO]Xy4Re
`*kKR-EBOE-EO]XV|oauois
`
`weKOKLPGE-EO]XVvovwe
`--VWIVAIHSI
`
`
`
`AJWVYsFJONVGIND
`
`ANOHd3a151
`
`YASWNN
`
`
`
`€@ANWdWOOOdONIGVHL
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 9 of 12
`
`US 7,027,171 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FG.9
`
`START
`
`SELECT PHOTOGRAPHING MODE --S300
`
`SELECT DESTINATION
`
`S301
`
`DOCUMENT
`PHOTOGRAPHING MODE?
`
`No
`
`Yes
`
`BUTTON PRESSED?
`
`Yes
`
`GUIDANCE
`FRAME DISPLAYED2
`
`
`
`S304
`
`S305
`
`DISPLAY GUIDANCE FRAME
`
`al
`ar.
`S306
`START PCKING UP MAGE AND
`DISPLAYING PREVIEW OF THE IMAGE
`ha
`
`S307
`
`DETECT ANGLE OF PHOTOGRAPHY
`
`PHOTOGRAPH
`AND RECORD IN
`NORMAL MODE
`
`RELEASE BUTTON
`PRESSED?
`
`CAPTURE, COMPRESS AND
`RECORD THE IMAGE
`
`CAL CULATE MANFICATION
`AT THE TIME OF PHOTOGRAPHY
`
`RECORD THE MAGNIFICATION
`AND THE FRAME INFORMATION
`1.
`
`
`
`ENO
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 10 of 12
`
`US 7,027,171 B1
`
`FG.10
`
`SELECT iMAGE TO BE
`TRANSMITTED
`
`S4O1
`
`READ IMAGE
`
`S4O2
`
`
`
`MAGE
`PHOTOGRAPHED IN DOCUMENT
`PHOTOGRAPHING
`MODE
`
`S404
`READ MAGNIFICATION AND
`FRAME INFOMATION
`
`S405
`S DESTINATION FACSMLE 2
`
`
`
`No
`
`IS DESTINATION MAL
`ADDRESS 2
`
`SEND IN NORMAL MODE
`(FTP, DEDICATED TERMINAL)
`
`S408
`EXPAND IMAGE DATA
`
`S409
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`S419
`ISDELETION FLAGNY
`ON ?
`
`S410
`CONVERT TO BINARY
`CODE
`
`S411
`CHARACTER
`RECONGNITION
`S412
`
`SEND MA
`
`
`
`No
`
`DELETE TRANSMITTED IMAGE
`
`S420
`
`S413
`
`EXPAND IMAGE DATA
`
`S414
`
`S415
`
`CLP
`
`SCALE
`
`S416
`CONVERT TO
`BINARY CODE
`
`S417
`COMPRESS
`(MH, MR, MMR)
`S418
`SEND BY
`FACSMLE
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 11 of 12
`
`US 7,027,171 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG 11
`
`
`
`
`
`S500
`
`DOCUMENT
`PHOTOGRAPHNG
`MODE?
`
`NO
`
`RELEASE BUTTON
`PRESSED?
`
`S502
`DISPLAY GUIDANCE FRAME
`
`S503
`START PICKING UP MAGE
`AND DISPLAYING PREVIEW
`OF THE IMAGE
`
`N
`
`S504
`DETECT ANGLE OF
`PHOTOGRAPHY
`
`PHOTOGRAPH AND
`RECORD IN
`NORMAL MODE
`
`RELEASE BUTTON
`PRESSEDT
`
`
`
`S507
`
`CAPTURE MAGE
`
`
`
`
`
`
`
`CALCULATE MAGNIFICATION
`AT THE TIME OF
`PHOTOGRAPHY
`1
`
`

`

`U.S. Patent
`
`Apr. 11, 2006
`
`Sheet 12 of 12
`
`US 7,027,171 B1
`
`F.G. 12
`
`
`
`
`
`
`
`
`
`S511
`
`MAGE
`PHOTOGRAPHED IN DOCUMENT
`PHOTOGRAPHING
`MODE?
`
`S512
`IS DESTINATION FACSMILE 2
`
`No
`
`IS DESTNATON MAL
`ADDRESS 2
`
`
`
`SEND IN NORMAL MODE
`(FTP, DEDICATED TERMINAL)
`
`
`
`
`
`
`
`
`
`S516
`CONVERT TO BINARY
`CODE
`
`S521
`CONVERT TO
`BNARY CODE
`
`S517
`CHARACTER
`RECONGINITION
`S518
`
`SEND MAIL
`
`S522
`
`COMPRE
`(MH, MR, MMR)
`S523
`
`SEND BY
`FACSMILE
`
`

`

`1.
`DIGITAL CAMERA AND DOCUMENT
`PHOTOGRAPHING AND TRANSMITTING
`METHOD OF THE SAME
`
`FIELD OF THE INVENTION
`
`The present invention relates to a digital camera. More
`particularly, this invention relates to a digital camera which
`has a document photographing mode in addition to the
`normal photographing mode.
`
`10
`
`BACKGROUND OF THE INVENTION
`
`The present day digital camera includes many functions.
`For example, there is known a digital camera which has a
`character photographing mode in addition to a normal
`photographing mode. The normal photographing mode is
`the mode in which ordinary Snapshots, for example, photo
`graphs of scenery are taken. In the character photographing
`mode, the digital camera Subjects data to image processing
`So as to improve the appearance of the characters.
`There is a digital still camera disclosed in Japanese patent
`application laid open No. HEI 08-125870. This digital still
`camera has a structure as follows. The digital still camera
`has the normal photographing mode and the document
`photographing mode. Any one of these two modes can be
`selected. When the normal photographing mode is selected,
`image data is compressed by a natural picture compression
`unit. Whereas image data is compressed by a document
`compression unit (a compression method appropriate for an
`image with a small number of gray levels in achromatic
`color) when the document photographing mode is selected.
`The compressed image data is then stored in an externally
`provided memory. Therefore, the image data can efficiently
`be compressed irrespective of whether the data belongs to a
`picture or belongs to a photograph of a document without
`degradation in image quality.
`However, the conventional type of digital camera has a
`problem that the data of the captured image can not effec
`tively be used. More specifically, the digital camera having
`the character photographing mode can not transmit the
`captured image as through a facsimile. In order to transmit
`the image as a facsimile, following process is carried out.
`First, the image is transmitted to a computer where the
`image is subjected to processing Such as expansion, image
`conversion, compression, or the like and then only the image
`can be transmitted as a facsimile.
`Further, in the digital still camera described above, the
`compression method is uniquely determined based on the
`photographing mode. For example, when a document (for
`example, an encyclopedia) which contains picture of scen
`ery is photographed, and if the picture is photographed in the
`document mode, the image data is compressed by the
`compression method suitable for an image with a small
`number of gray levels in achromatic color. Resultantly, the
`picture of the scenery can not be reproduced properly.
`Therefore, the user is required to photograph the same
`document in the normal photographing mode. Thus, the user
`has to choose the photographing modes based on the pur
`pose of using the document.
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`SUMMARY OF THE INVENTION
`
`It is an object of this invention to provide a digital camera
`which can improve the use of the image photographed in the
`document photographing mode.
`
`65
`
`US 7,027,171 B1
`
`2
`According to one aspect of this invention, an expansion
`unit expands compressed image data photographed in the
`document photographing mode and stored in a storage unit
`and an image processing unit then subjects the data to any
`image processing that a destination requires. Therefore, the
`image photographed in the document photographing mode
`can be converted to any format suitable for the destination.
`According to another aspect of this invention, an image
`processing unit Subjects the image data photographed in the
`document photographing mode to any image processing that
`a destination requires. Therefore, the image photographed in
`the document photographing mode can be converted to any
`format suitable for the destination.
`According to still another aspect of this invention, an
`expansion unit expands a compressed image data acquired in
`the document photographing mode and stored in a storage
`unit, and an image processing unit then Subjects the data to
`the processing Such as clipping, conversion to a smaller
`number of gray levels in achromatic color, and resolution
`conversion, and once more compresses the data. Therefore,
`the image photographed in the document photographing
`mode can be converted to any format suitable for a desti
`nation (e.g., a facsimile).
`According to still another aspect of this invention, an
`image processing unit Subjects the image data acquired in
`the document photographing mode to the processing Such as
`clipping, conversion to a smaller number of gray levels in
`achromatic color, and resolution conversion, and once more
`compresses the data. Therefore, the image photographed in
`the document photographing mode can be converted to any
`format Suitable for a destination (e.g., a facsimile).
`According to still another aspect of this invention, an
`expansion unit expands the compressed image data acquired
`in the document photographing mode and stored in a storage
`unit, and an image processing unit then subjects the image
`data to the processing Such as clipping, and conversion to a
`Smaller number of gray levels in achromatic color, and
`character recognition. Therefore, the image photographed in
`the document photographing mode can be converted to any
`format Suitable for a destination (e.g., a facsimile).
`According to still another aspect of this invention, an
`image processing unit Subjects the image data acquired in
`the document photographing mode to the processing Such as
`clipping, and conversion to a smaller number of gray levels
`in achromatic color, and character recognition. Therefore,
`the image photographed in the document photographing
`mode can be converted to any format (e.g., a text document)
`suitable for a destination.
`According to still another aspect of this invention, in the
`document photographing mode, a display unit displays the
`guidance to notify a user of photographing conditions of a
`document during displaying of the picture of the Subject on
`the monitor before it is photographed. Therefore, the user
`can easily fix the location of the document.
`According to still another aspect of this invention, an
`angle of photography detection unit which detects the angle
`of photography is provided. In the document photographing
`mode, photography is started only when the angle of pho
`tography is substantially vertical to the surface of the
`Subject. Therefore, a proper image of the document can be
`obtained.
`According to still another aspect of this invention, there
`are provided the steps of monitoring a Subject on the display
`unit in response to instructions for monitoring, displaying
`guidance on the display unit when the monitoring is per
`formed, capturing an image and compressing the image data
`in response to instructions for photographing, storing the
`
`

`

`US 7,027,171 B1
`
`10
`
`15
`
`3
`compressed image data in a storage unit, reading the com
`pressed image data stored in the storage unit and expanding
`the data in response to instructions for transmission, Sub
`jecting the expanded image data to any image processing
`that a destination requires, and transmitting the image data,
`that has been Subjected to image processing, to the destina
`tion. Therefore, the image can be converted to any format
`suitable for the destination.
`According to still another aspect of this invention, there
`are provided the steps of monitoring a Subject on the display
`unit in response to instructions for monitoring, displaying
`guidance on the display unit when the monitoring is per
`formed, capturing an image in response to instructions for
`photographing, Subjecting the data of the captured image to
`any image processing that a destination requires, and trans
`mitting the image data, that has been Subjected to image
`processing, to the destination. Therefore, the image can be
`converted to any format suitable for the destination and
`transmitted immediately.
`Other objects and features of this invention will become
`apparent from the following description with reference to
`the accompanying drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 shows a configuration of a digital camera accord
`ing to a first embodiment;
`FIG. 2 shows an example of an image-file format;
`FIG. 3 shows a flow chart of photographing operation
`when the document photographing mode is selected in the
`first embodiment;
`FIG. 4 shows an example of guidance display;
`FIG. 5A and FIG. 5B explain about the angle of photog
`raphy;
`FIG. 6 shows a flow chart of operation when a photo
`graphed image is transmitted to an external device in the first
`embodiment;
`FIG. 7 shows a configuration of a digital camera accord
`ing to a second embodiment;
`FIG. 8 shows an example of the structure of the destina
`tion memory shown in FIG. 7:
`FIG. 9 shows a flow chart of photographing operation
`when the document photographing mode is selected in the
`second embodiment;
`FIG. 10 shows a flow chart of operation when a photo
`graphed image is transmitted to an external device in the
`second embodiment;
`FIG. 11 shows a flow chart of operation when the docu
`ment photographing/transmission mode is selected in a third
`embodiment; and
`FIG. 12 is the continuation of the flow chart of FIG. 11.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`Preferred embodiments of the present invention are
`explained in detail below with reference to the attached
`drawings.
`FIG. 1 shows a configuration of a digital camera accord
`ing to a first embodiment. Reference numeral 100 represents
`the digital camera. This digital camera 100 comprises, as
`shown in FIG. 1, a system control section 101 which
`controls the entire system of the digital camera, and an
`image pickup section 102 which picks up a subject image
`and converts the image to image data. The digital camera
`100 further comprises an image processing section 103
`which Subjects the image data output from the image pickup
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`section 102 to image processing, and a display control
`section 104 which controls the display of the image pro
`cessed in the image processing section 103 to an LCD 105.
`The LCD 105 is for displaying the image. There is also
`provided a recording medium interface section 106 which is
`an interface of a recording medium 107. The recording
`medium 107 stores the compressed image data. There is
`further provided a hard key interface section 108 which
`detects key operations in an operation section 109. Through
`the operation section 109, a user gives instructions to the
`digital camera. There is provided a communication interface
`section 110 which performs data communications with the
`outside.
`The system control section 101 provides controls for the
`entire system of the digital camera as explained above. More
`specifically, although not shown here, this system control
`section 101 comprises a ROM, a RAM, and a timer. The
`CPU controls the entire system of the digital camera accord
`ing to a program stored in a ROM. The ROM stores the
`program to operate the CPU. The RAM is used as a work
`area of the CPU. The timer counts the time.
`The image pickup section 102 picks up an image of a
`Subject (Subject image) and outputs image data as explained
`above. More specifically, although not shown here, this
`image pickup section 102 comprises optical system compo
`nents including a lens, a CCD, a lens driving motor, a CCD
`drive circuit, and an A/D converter. The lens forms the
`subject image. The lens driving motor drives the lens. The
`CCD converts the Subject image into electric signals (analog
`image data). The CCD drive circuit drives the CCD. The
`A/D converter converts the analog image data output from
`the CCD to digital signals (digital image data).
`The image processing section 103 comprises a DSP
`(Digital Signal Processor) for image processing and
`memory. More specifically, this DSP subjects the image data
`obtained in the image pickup section 102 to various types of
`image processing. Further, the DSP performs focusing and
`adjustments to exposure by controlling timing of driving the
`CCD in the image pickup section 102 and the lens driving
`motor, and also performs compression or expansion of the
`image data.
`The display control section 104 subjects the image data
`processed in the image processing section 103 to signal
`processing so that it can be displayed on the LCD 105.
`Further, the display control section 104 generates various
`graphical images for the user interface, and displays the
`generated images on the LCD 105. The LCD 105 displays a
`Subject image, and also displays graphics for the user
`interface.
`The recording medium interface section 106 comprises a
`memory card controller that is provided for an interface with
`the recording medium 107. Various types of information
`related to the compressed image data and images are
`recorded in the recording medium 107.
`The hard key interface section 108 comprises a parallel
`port that is provided to detect a state of hardware for the user
`interface such as keys and a dial in the operation section 109.
`The operation section 109 is used when the user wants to
`give any instructions regarding the operations to the digital
`camera. More specifically, although not shown here, the
`operation section 109 comprises a release button to instruct
`photographing, and a photographing mode key used to select
`between the normal photographing mode to photograph a
`natural picture and the document photographing mode to
`photograph characters clearly. The operation section 109
`further comprises a fixed document size setting key used to
`select between fixed document sizes (A size, letter, legal
`
`

`

`US 7,027,171 B1
`
`10
`
`15
`
`5
`size, and so forth). The communication interface 110 com
`prises a communication controller, which is provided for
`performing data communications with the outside through a
`communication device such as a portable telephone 200.
`In FIG. 1, reference numeral 200 represents a portable
`telephone that is connected to the communication interface
`section 110 of the digital camera to perform data commu
`nication with the outside. Reference numeral 300 represents
`a telephone network. Reference numeral 301 represents a
`facsimile connected to the telephone network 300. Refer
`ence numeral 302 represents a dedicated terminal (which
`receives and stores images from the digital camera and
`displays the images on a TV monitor) connected to the
`telephone network 300.
`Further, reference numeral 400 represents the Internet to
`which the telephone network 300 is connected. Reference
`numeral 401 represents a personal computer connected to
`the Internet 400. The digital camera 100 can perform data
`communications, via the portable telephone 200, with any
`device (e.g., the facsimile 301 or the dedicated terminal 302)
`connected to the telephone network 300 and any device
`(e.g., the personal computer 401) connected to the Internet
`400.
`The overview of photographing operation of the digital
`camera 100 having the configuration is explained below. The
`user operates a photographing mode key of the operation
`section 109 before photographing, and sets the digital cam
`era in a photographing mode (a normal photographing
`mode, a document photographing mode, and so forth). The
`contents of operation through the operation section 109 are
`determined by the system control section 101 through the
`hard key interface section 108. The system control section
`101 generates a guidance graphic on the display control
`section 104 according to the operation, and then guides the
`user to perform the next operation.
`The system control section 101 sets, at the instant the
`photographing mode is selected, processing parameters cor
`responding to the mode in the image processing section 103.
`If the state of the release button, that is not shown in FIG.
`1, being half-pressed has been detected after the camera is
`ready for photographing, this half-pressed operation is deter
`mined by the system control section 101 via the hard key
`interface section 108 in the same manner as the mode
`Setting.
`The image pickup section 102 starts an image pickup
`45
`operation to display the preview of the image on the LCD
`105 before photographing is actually performed, under the
`controls of the image processing section 103. The data for
`the image picked up by the image pickup section 102 is
`continuously sent to the image processing section 103. The
`image processing section 103 then Subjects the image data to
`the processing Such as color space conversion, Y correction,
`and white balance adjustment, and transfers the processed
`image data to the display control section 104. Concurrently
`with these operations, the image processing section 103
`detects how focus and exposure are achieved, and makes
`necessary adjustment to focus and exposure by controlling
`the image pickup section 102.
`The display control section 104 subjects the image data to
`signal processing and displays the data on the LCD 105 to
`show how the image is photographed to the user. The
`operation of pressing the release button of the operation
`section 109 is then determined by the system control section
`101 through the hard key interface section 108 in a like
`manner. The image pickup section 102 captures a subject
`image according to the controls of the image processing
`section 103, and outputs the data for the image to the image
`
`55
`
`6
`processing section 103. Whereas the image processing sec
`tion 103 Subjects the data to image processing and com
`pression processing corresponding to the photographing
`mode.
`The system control section 101 reads the image data
`compressed in the image processing section 103, adds
`header information to this compressed image data, and then
`writes the data as an image file in the recording medium 107
`via the recording medium interface section 106. This header
`information includes information for the selected photo
`graphing mode and information for the photographed date
`and time, or the like. A series of photographing operations is
`then complete.
`FIG. 2 shows an example of an image-file format. This
`image file consists of compressed image data and a header
`as shown in the figure. The header includes information Such
`as the mode of photography, date and time of photography,
`magnification at the time of photography, and a frame type.
`The overview of operation of data communications in the
`digital camera 100 is explained below. The user connects the
`portable telephone 200 to the digital camera 100. The user
`then specifies a destination of the image, through operation
`of the operation section 109, and selects the image to be
`transmitted in the same manner as the setting of a photo
`graphing mode. The system control section 101 originates a
`call via the portable telephone 200 and establishes a com
`munication line by controlling the communication interface
`section 110. The system control section 101 then reads the
`file of the specified image from the recording medium 107.
`and transmits the image file in accordance with a predeter
`mined protocol.
`The schematic operations in the cases where the digital
`camera 100 performs data communications with the fac
`simile 301, the personal computer 401, and the dedicated
`terminal 302 are explained below.
`When data communications with the facsimile 301 (fac
`simile transmission) are performed, the digital camera 100
`transmits the image, that has been compressed and stored as
`binary information on photographing, to the facsimile 301 in
`accordance with the facsimile protocol on the telephone
`network 300 using the method, for instance, disclosed in
`Japanese patent application laid open No. HEI 08-125870.
`When data communications with the personal computer
`401 are performed, the digital camera 100 transmits the
`image to the personal computer 401 via the telephone
`network 300 and the Internet 400. In this case, the digital
`camera 100 transmits the image, compressed and stored in
`the normal photographing mode (JPEG compression), to the
`personal computer 401 in accordance with FTP (File-Trans
`fer Protocol) or SMTP (Simple Mail Transfer Protocol) as an
`attached file to a mail document. In the above case, however,
`the digital camera 100 is generally connected to a server (not
`shown), which is connected to the Internet 400 using PPP
`(Point-to-Point Protocol).
`When data communications with the dedicated terminal
`302 are performed, the digital camera 100 transmits the
`image to the dedicated terminal 302 via the telephone
`network 300. In this case a particular protocol is used for the
`data communications. Each type of these communications
`protocols (attribute of destination) is stored as destination
`information in a one-to-one correspondence between a type
`of protocol, a telephone number, and an Internet address.
`The user only selects a destination, and then the correspond
`ing protocol is automatically selected and executed.
`Photographing operation in the case where the document
`photographing mode is selected is explained below with
`reference to FIG. 3 to FIG. 5. FIG. 3 shows a flow chart of
`
`25
`
`30
`
`35
`
`40
`
`50
`
`60
`
`65
`
`

`

`US 7,027,171 B1
`
`7
`photographing operation when the document photographing
`mode is selected. FIG. 4 shows an example of guidance
`display on the LCD 105. FIG. 5A and FIG. 5B show how to
`detect the angle of photography.
`The user selects, when photographing is to be carried out
`in the document photographing mode, the document photo
`graphing mode with the photographing mode key of the
`operation section 109, and further selects the fixed document
`size (A size, letter, legal size, and so forth) of an image to be
`picked up with the regular document size setting key.
`In FIG. 3, the system control section 101 first identifies
`the current photographing mode (step S100). When the
`current mode is the normal photographing mode, the system
`control section 101 proceeds to step S110, and then performs
`normal photographing and recording.
`On the other hand, when it is determined, at step S100,
`that the current mode is the document photographing mode,
`the system control section 101 monitors the information
`relating to keys pressed in the hard key interface section 108.
`When it is determined that the release button has been
`pressed (step S101), the system control section 101 displays
`a guidance frame on the LCD 105 in order that the user can
`easily fix the location of a document (step S102). The system
`control section 101 then starts picking up a document image
`and displays the preview of the image (the Subject is
`displayed on the monitor) (step S103).
`The display of a guidance frame is explained below with
`reference to FIG. 4. In FIG. 4, reference numeral 501
`represents the frame of the LCD 105, 502 represents the
`displayed guidance frame. Reference numeral 503 repre
`sents a document to be photographed, and 504 represents an
`area to be cut out by the processing of clipping, that is
`explained later. The frame to be displayed here is displayed
`based on the aspect ratio of a regular document size selected
`when the document photographing mode is selected.
`The system control section 101 then issues an instruction
`to detect an angle of photography of the Subject (document)
`to the image processing section 103. In response to reception
`of the instruction, the image processing section 103 detects
`the angle of photography of the Subject, and the system
`control section 101 reads the detected angle of photography
`(step S104). The system control section 101 then determines
`whether the angle of photography is vertical to the Surface
`of the subject (step S105). About the angle of photography
`and the method of detecting this angle are explained below
`with reference to FIG. 5A and FIG. 5B.
`In FIG. 5A and FIG. 5B, reference numeral 100 is the
`digital camera, 602 represents a base where a docu