VWGoA - Ex. 1035
`Case No. IPR2016-00156
`Volkswagen Group of America, Inc. - Petitioner
`West View Research, LLC - Patent Owner
`
`1
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 1 of 16
`
`6,133,947
`
`/1 DIGITAL CAMERA
`
`10
`
`DISPLAY
`°°L';‘,IlF1i°L
`
`8
`
`7
`
`2
`
`11
`
`EXTERNAL
`DATA
`INPUT/OUTPUT
`
`
`
`CPU
`
`I
`I
`!
`I
`'
`I
`I
`I
`‘
`I
`!
`!
`I
`.
`I
`I
`I
`I
`I
`I
`I
`L ............ ___I
`-
`KEY
`I OPERANON
`UNIT
`
`_|
`!
`I
`I
`I
`'
`
`5
`
`4
`
`V
`
`5
`IMAGE SENSOR
`I/F CIRCUIT
`
`3
`
`A
`COD IMAGE
`INPUT UNIT <' '
`I
`I
`i
`!
`I
`I
`I
`I
`!
`STORAGE
`I
`UNIT
`I
`-_-W
`!
`. STORAGEI
`I
`I MEDIUM _J.
`_'__.'____:____ ___I
`COMMLhiI'IJ(3EATION
`
` I
`
`
`
`EXTERNAL
`APPLIANCE
`
`(WORDPROCESSOR)
`
`
`
`21
`
`
`
`i
`
`2
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 2 of 16
`
`6,133,947
`
`UPPER FACE
`
`O O O O 0
`
`
`
`
`
`KEY OPERATION UNIT
`
`0 E D
`
`FRONT FACE
`
`SIDE FACE
`
`REAR FAcE
`
`PLAY
`
`POWER
`K1 K2
`K3 K4 K5
`bbcédd
`OK NG +
`-
`FUNCTION
`
`REC
`
`3
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 3 of 16
`
`6,133,947
`
`F|G.4
`
`
` DATA BLOCK OF FIRST IMAGE
`POSITIONAL
`
`
`OOOCH,
`OOH,
`INFORMAHON (11 BYTES)
`(DATA LENGTH
`POSITIONAL
`SACTNAL POSITIONAL
`: 12 BYTES)
`I FORMATION)
`NFORMATION DATA)
`
`
`
`
`0384H,
`02H,
`|NF(g'g§l<)§fT5lON(23o BYTES)
`
`
`(255 xeoo BYTES)
`(IMAGE
`ACTNAL IMAGE
`
`IN ORMATION DATA)
`INFORMATION)
`
`0004CH,
`03H,
`OOH
`
`BLOCK FOR1 IMAGE)
`(DATALENGTH
`CONTROL
`(ENDOFINFORMATION
`:4BYTES)
`IN ORMATION)
`
`
`
`
`
`
`STORAGE FORMAT OF IMAGE DATA
`
`
`
` RED DATA (1 BYTE)
`
`GREEN DATA (1 BYTE)
`BLUE DATA (1 BYTE)
`
`
`
`RED DATA (1 BYTE)
`
`GREEN DATA (1 BYTE)
`
`BLUE DATA (1 BYTE)
`
`
`
`
`
`
`RED DATA (1 BYTE)
`GREEN DATA (1 BYTE)
`BLUE DATA (1 BYTE)
`
`
`
`
`ACTNAL IMAGE
`INFORMATION DATA
`
`."r
`-rr
`
`
`
`320 DOT
`
`
`
`
`
`ADDITIONAL
`
`INFORMATION (21 BYTES)
`01”’
`(ACTNAL ADDITION
`ADDITIONAL
`
`INFORMATION DATA)
`I FORMATION)
`
`
`0015"’
`(DATA LENGTH
`: 22 BYTES)
`
`SYSTEM
`WORK
`AREA
`
`
`
`
`
`
`
`
`
`4
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 4 of 16
`
`6,133,947
`
`7.
`!
`I
`
`I
`
`I
`|
`
`I E I i
`
`m
`
`26
`
`25
`
`DISPLAY - 33
`CONTROL
`PRINTER UNIT
`UNIT
`
`32
`
`FLOPPY DISK
`
`
`
`23
`
`22
`
`I/FCIRCUIT
`
`31
`
`CAMERA
`I/F CIRCUIT
`
`CPU
`
`29
`
`UNIT —“]
`
`‘L I/F CIRCUIT !
`
`PLAYER
`I/F CIRCUIT
`
`30
`
`UNIT CAMERA
`
`KEY
`OPERATION
`
`5
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 5 of 16
`
`6,133,947
`
`FlG.6
`
`
`
`PHOTOGRAPH (REC) MODE
`
`ACQUIRE IMAGE DATA FROM CCD
`
`
`
`DISPLAY PHOTOGRAPHED IMA GE
`
`A3
`
`
` STORE IMAGE DATA INTO RAM WHEN
`
`
`
`
`DISPLAY "IS PLACE RECORDE D ?II
`
`A6
`
`
`
`
`
`SHIFT BACKWORDLY IMAGE DATA
`BY BYTE NUMBER OF POSITIONAL
`INFORMATION DATA AND INSERT
`POSITIONAL INFORMATION INTO
`SHIFTED DATA AREA
`
`
`
`
`
`
`
`DISPLAY "RECORDED",
`AND UPDATE RAM POINTER
`
`
`
`SHOT KEY INPUT IS MODE,
`AND STOP IMAGE ACQUISITION
`
`6
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 6 of 16
`
`6,133,947
`
`(0) DEPRESS SHOT(SHUTTER)
`BOTTON
`
`O DEPRESS OK BUTTON \\.." .3"’5;
`
`
`.3 \
`IS PLACE RECORDED ?
`
`0*‘
`
`NUMERAL IS
`INCREASED BY
`+ BUTTON
`-
`NUMERAL IS
`DECREASED
`1' i O O oo BY—BUTTON
`u
`OK NG + ——
`SUCCEED TO
`
`NEXT COLUMN
`BY OK BUTTON
`BACKTO
`PREVIOUS
`COLUMN BY
`NG BUTTON
`
`
`
`—
`
`O DEPRESS OK BUTTON
`
`OK
`
`NORTH LATITUDE
`as DEG, 35 MIN, 22.00 SEC
`EAST LONGITUDE
`135 DEG. 22 MIN, 11.00 sEc
`
`ALL RIGHT 7
`
`
`KEY OPERATION/IMAGE SAMPLE IN PHOTOGRAPH MODE
`
`7
`
`

`
`U.S. Patent
`
`Oct. 17, 2000
`
`Sheet 7 of 16
`
`6,133,947
`
`FlG.8
`
`REPRODUCE (PLAY) MODE
`
`
`
`
`DISPLAY INFORMATION OF PLACE
`
`WAITING KEY INPUT
`
`B6
`
`MOVE POINTER TO NEXT OR
`PREVIOUS IMAGE
`
`DISPLAY IMAGE STORED IN RAM
`
`NO
`
`POSITIONAL
`DATA IS PRESENT
`
`POSITIONAL
`DISPLAY?FLAG ON
`
`B2
`
`B3
`
`8
`
`

`
`U.S. Patent
`
`Oct. 17, 2000
`
`Sheet 8 of 16
`
`6,133,947
`
`
`
`
`IS PLACE DISPLAYED ?
`YES **OK,NO ->NG
`
`
`
`
`-K.
`
`‘
`
`-\._. ,
`NORTH LATITUDE
`as DEG, 35 MIN, 22.00 SEC
`EAST LONGITUDE
`135 DEG, 22 MIN. 11.00 sEc
`
`DEPRESS +, — BUTTONS
`TO SELECT IMAGE
`
`NORTH LATITUDE
`38 DEG, 36 MIN, 55.00 SEC
`EAST LONGITUDE
`135 DEG, 33 MIN. 33.00 SEC
`
`KEY OPERATION/IMAGE SAMPLES IN REPRODUCTION MODE
`
`O
`
`DEPFIESS FUNCTION
`BUTTON
`
`DEPRESS OK BUTTON
`
`O O
`
`K
`
`.
`
`\—
`
`—/
`
`9
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 9 of 16
`
`6,133,947
`
`IMAGE SYNTHESIZING
`PROCESS
`
`FIG.1O
`
`CONNECT
`DIGITAL CAMERA
`
` SELECT IMAGE
`
`TRANSFER IMAGE DATA
`
`PHOTOGRAPH
`POSITION
`NORTH LATITUDE
`38 DEG, 35 MIN,
`22.00 SEC
`EAST LONGITIJDE
`135 DEG, 22 MIN,
`11.00 SEC
`
`MAKE UP IMAGE FILE
`
`C4
`
`NO
`
`SIMPLE ARRANGEMENT
`(SEPARATE PROCESS)
`
`C5
`
`
`C5
` POSITIONAL
`INFORMATION IS
`
`
`PRES’ENT
`' YES
`
`
`
`PICK UP POSITIONAL
`INFORMATION
`
`C7
`
`REQUIRE MAP SET
`
`C8
`
`RETRIEVE MAP DATA
`READ MAP DATA
`As IMAGE FILE
`
`MAKE UP MAP DATA
`
`C9 R
`C10 ------—>X and q:
`/\/\<-\/
`
`C11
`
`IN DOCUMENT
`
`ARRANGE MAP IMAGE
`
`CALCULATE POSITIONAL
`OFFSET IN MAP OF
`
`C12
`
`Le»-r
`COORDWATE
`C13 NORTH LATITUDE
`38 DEG, 32 MIN,
`— -+-
`00.00 SEC.
`C14 EAST LONGITUDE
`135 DEG, 21 MIN,
`oo_oo sec
`.................. -->
`
`
`
`NORTH LATITUDE
`38 DEG, 35 MIN,
`EAST LONGITUDE
`135 DEG, 21 MIN
`
`
`
`
`CAMERA IMAGE
`
`ARRANGE BALLOON
`PATTERN
`
`C15
`
`-----------------------
`
`ARRANGE IMAGE DATA
`
`_L U)
`
`END OF
`PROCESSING
`
`10
`
`

`
`U.S. Patent
`
`Oct. 17, 2000
`
`Sheet 10 of 16
`
`6,133,947
`
`[IMAGE ACQUISITION 1
`CONNECT DIGITAL CAMERA,
`
`DEPRESS EXECUTION KEY
`-FADVANCE
`DERREss EXECUTE KEY
`
`F|G.11B
`
`EXECUTE
`
`-P DECIDE
`
`" PRECEDING
`.SUBJECT
`SUCEEDING
`. SUBJECT
`
`"’RET”R”
`
`‘I IMAGE AcOuIsITION)
`- PLACE INFORMATION IS RECORDED
`IN THIS IMAGE. SET MAP CD AND
`
`F|G.1‘| D
`
`' INFRONT OE
`
`OO PUND IN
`
`ROUTE 111,
`I °.'TY:.
`X-X
`
`PREFECTURE.
`
`11
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 11 of 16
`
`6,133,947
`
`
`
`matm._o_:m>-zo:V
`
`:2:._<z_sEmp\...............................................I-I
`
`
`
`
`
`3.0.”.
`
`
`
`AIIWIIIIV_I-I:2:
`
`MVm0<mOFw
`
`_m0<mo»m
`#s_:Ems_4.
`
`:06
`
`_.IIIIIIIIIIIIIIIIIIIIL
`
`0?W10<P<D
`
`izmmhxm
`
`._.5om=o“S._.Dn:.DOD.Dn_z_
`
`._._ZD
`
`._<zO_.:wOn_>5.
`
`ZOE.<_>=n_Ou_z_
`
`._<z0_m
`
`0z_Em>zoo
`
`::om_o
`
`zo_»<mmn_o
`
`E2:
`
`._<zmmbm_
`
`m0Z<_._n_n_<
`
`Eommmoomaomoi
`
`_.N
`
`
`
`momzmmmw<s=
`
`::om_o“S
`
`mo<s__D00
`
`
`
`._._ZD._.Dn_Z_
`
`><._n_w_D
`
`40m._.zOO
`
`._._ZD
`
`mm><._n_
`
`::om_o“S
`
`s_om-no
`
`mm><.E
`
`12
`
`
`
`
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 12 of 16
`
`6,133,947
`
`F|G.13
`
`48 ANTENNA STORAGE UNIT
`
`
`
`49 KEYBOARD
`(EG. CHARACTER KEYS)
`
`8 DISPLAY UNIT
`47 MOUNTING
`HOOK
`
`FRONT FACE
`
`-
`
`SIDE FACE
`
`REAR FACE
`
`13
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 13 0f 16
`
`6,133,947
`
`
`
`._._ZD_u_<Z=>_EmFmn_>._._
`
`m._o_:m>ZOmam_.mr:
`
`ZO_._.<0_ZD_>__>_O0
`
`mz_._
`
`wemam
`
`::om_ous
`
` .mu<mo5Ti:2:
`
`
`mm><.E1a_._._.0.sJ_
`
`mmm_w<mo»m
`
`
`
`::om_on_\_
`
`Nm
`
`>5.
`
`ZO_._.<mmn_O
`
`:2:
`
`3&0
`
`s_<m
`
`mm
`
`
`
`._<zw_momo_>
`
`::om_o“S
`
`u_<ZO_._._wOn_
`
`ZO_._.<_>_mOn_Z_
`
`._<zw_m
`
`uz_Em>zoo
`
`::om_o
`
`><._n_m_D
`
`._oEzoo
`
`._._ZD
`
`
`
`v_m_o>n_n_O._n_
`
`m>_mo
`
`xma
`
`::om_on<_
`
`14
`
`
`
`
`

`
`U.S. Patent
`
`Oct. 17, 2000
`
`Sheet 14 of 16
`
`6,133,947
`
`FIG.15
`
`IMAGE RECORDING
`PROCESS
`
`
`
`ACOUIRE DIGITAL IMAGE DATA
`BY VIDEO SIGNAL-TO-DIGITAL
`INFORMATION CONVERSION
`(VIDEO SIGNAL I/F CIRCUIT)
`
`
`D1
`
`D2
`
`D3
`
`'34
`
`D5
`
`D6
`
`
`
`TRANSFER ACQUIRED
`DATA TO RAM
`
`DISPLAY OF DATA IN RAM
`
`
`ACQUISITION BUTTON
`
`YES
`
`PRODUCE POSITIONAL
`INFORMATION FOR FILE
`FROM POSITIONAL
`INFORMATION OF CAN
`NAVIGATION
`
`CONVERT IMAGE DATA STORED
`IN RAM INTO FILING FORMAT
`AND SAVE CONVERTED IMAGE
`DATA IN FLOPPY DISK
`
`15
`
`

`
`U.S. Patent
`
`Oct. 17, 2000
`
`Sheet 15 of 16
`
`6,133,947
`
`F|G.16
`
`NORMAL MODE
`
`
`
`
`E6
`
`IMAGE
`IS PRESENT
`
`ENTER KEY "IS IMAGE DISPLAYED"
`
`DISPLAY IMAGE
`
` ACQUIRE POSITIONAL
`
`INFORMATION FROM
`POSITIONAL INFORMATION
`SIGNAL CONVERTING CIRCUIT
`
`
`
`CONVERT POSITIONAL
`INFORMATION INTO DIGITAL
`SIGNAL BY I/F CIRCUIT
`
`SELECT MAP TO BE DISPLAYED
`BY POSITION, READ MAP IMAGE
`FROM CD TO DISPLAY MAP
`
`DISPLAY OWN POSITION ON MAP
`
`ACCESS TO FLOPPY DISK SO AS
`TO CHECK WHETHER OR NOT IMAGE
`IS LOCATED NEAR OWN PLACE
`
`16
`
`

`
`U.S. Patent
`
`Oct. 17,2000
`
`Sheet 16 0f 16
`
`6,133,947
`
`FlG.17A §:
`
`
`
`,
`/
`
`
`
`
`
`IMAGEISRECORDED 5
`EFYES
`NO
`
`F|G.17D
`
`F|G.17E
`
`IMAGE INFORMATION
`IS PRESENT ?
`AND DISPLAYED ?
`6’ YES
`NO
`
`17
`
`

`
`6,133,947
`
`1
`IMAGE PROCESSING SYSTEM CAPABLE
`OF DISPLAYING PHOTOGRAPHED IMAGE
`IN COMBINATION WITH RELEVANT MAP
`IMAGE
`
`TECHNICAL FIELD
`
`The present invention generally relates to an image pro-
`cessing system and an image processing method. More
`specifically, the present invention is directed to an image
`processing method and system capable of processing image
`data acquired by an electronic camera and map data to
`display a photographed image in relation with a map.
`BACKGROUND ART
`
`Very recently, so called “digital cameras” (namely, elec-
`tronic cameras) are commercially available. In a digital
`camera, an image of a subject optically received by a CCD
`image sensor corresponding to a solid-state imaging system
`is acquired as a digital image signal, and then this digital
`image signal is saved in a RAM. Since the image of the
`photographed subject is converted into the digital image
`data, this digital image data can be transferred/processed in
`digital information processing apparatuses such as personal
`computers and Wordprocessors, so that digital cameras may
`function as easy-operable image input devices having Wide
`applications.
`However, this sort of image input device merely saves
`photographed images. Therefore, in order to grasp Where the
`image is acquired, a photographer must make a place name
`memorandum when this image is taken. Then, when this
`photographed image data is
`transferred to the
`Wordprocessor,
`the photographer should enter the photo-
`graph place by manipulating the keyboard with reference to
`this memorandum.
`
`On the other hand, car navigation systems are commer-
`cially available, in which present positions are sequentially
`detected by utilizing satellite communications, and map
`image data about the detected positions are displayed in real
`time in accordance with this position detection. In this sort
`of car navigation, although the present place may corre-
`spond to the map image, merely the map is displayed or a
`voice response is made. This type of car navigation system
`cannot supply positional information with respect to photo-
`graphs also cannot provide a navigation function with
`respect to photographs.
`DISCLOSURE OF THE INVENTION
`
`The present invention has been made to solve the above-
`described problems, and therefore has an object to provide
`an image processing system, and an image processing
`method which are capable of easily recognizing a photo-
`graphing location by outputting photographed image data
`and map image data indicative of this photograph place in
`relation thereto. Moreover, another object of the present
`invention is to provide an image processing system and an
`image processing method which are capable of effectively
`achieving a navigation function by outputting map image
`data corresponding to a present position, and further out-
`putting previously photographed image data about this posi-
`tion when a vehicle comes to this position.
`To achieve the above-described objects, an image pro-
`cessing system, according to a first aspect of the present
`invention, is featured by comprising:
`image storage means for storing photographed image data
`and positional information data acquired in correspon-
`dence with said photographed image data;
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`map image storage means for storing map image data;
`retrieval means for retrieving a position with respect to
`the map image data stored in said map image storage
`means based upon the positional
`information data
`stored in said image storage means; and
`image output means for outputting a map image of the
`map image data about the position retrieved by said
`retrieval means, and a photographed image of the
`photographed image data in correspondence with said
`map image data.
`Also, an image processing system, according to a second
`aspect of the present invention, is featured by comprising:
`image record means for recording data about a photo-
`graphed image;
`present position storage means for storing data about
`present positional information of a photograph place in
`correspondence with said photographed image data;
`map image storage means for storing data about a map
`image;
`retrieval means for retrieving a position with respect to
`said map image data based upon said present positional
`information data stored in said present position storage
`means; and
`image output means for outputting the map image data
`retrieved by said retrieve means, and the photographed
`image data in correspondence with said image data.
`In accordance with a third aspect of the present invention,
`an image processing system coupled to a navigation system
`for sequentially detecting a present position and for sequen-
`tially outputting map image data about said present position
`in response to the detected present position, is featured by
`comprising:
`photograph means for optically receiving an image of a
`photographed subject by a solid-state imaging element
`to produce digital image data;
`image storage means for storing the digital image data
`produced from said photograph means;
`present position storage means for storing present posi-
`tional information data about a place photographed by
`said photograph means in correspondence with said
`photographed image data as photographed present
`positional information data;
`comparing means for comparing said photographed
`present positional
`information data stored in said
`present position storage means with said present posi-
`tion data produced by the navigation system; and
`image output means for reading out the photographed
`image data corresponding to said photographed present
`position information based upon a comparison result of
`said comparing means to thereby output the image of
`the photographed subject.
`Also, an image processing method, according to a fourth
`aspect of the present invention, is featured by comprising the
`steps of:
`photographing an image of a subject to produce photo-
`graphed image data;
`acquiring positional information in correspondence with
`said photographed image data to store the acquired
`positional information;
`previously storing map image data;
`retrieving a position with respective to the stored map
`image data based on the acquired positional informa-
`tion; and
`outputting a map image of map image data about said
`retrieved position, and a photograph image of said
`photographed image data in relation thereto.
`
`18
`
`

`
`6,133,947
`
`3
`Further, according to a fifth aspect of the present
`invention, a storage medium is featured by comprising at
`least:
`
`a program code readable by a computer, for retrieving a
`position with respect to stored map image data based
`upon photographed positional
`information stored in
`correspondence with photographed image data derived
`from a photographing unit; and
`for
`another program code readable by the computer,
`outputting the retrieved map image data and the pho-
`tographed image data in relation therewith.
`Moreover, according to a sixth embodiment of the present
`invention, a storage medium is featured by comprising at
`least:
`
`a program code readable by a computer, for comparing
`photographed positional information stored in corre-
`spondence with photographed image data derived from
`a photographing unit with present positional informa-
`tion acquired by a navigation system; and
`for
`another program code readable by the computer,
`reading out the photographed image data correspond-
`ing to said photographed positional information based
`on a comparison result to thereby output said photo-
`graphed image data.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`A more complete understanding of the teachings of the
`present
`invention may be acquired by referring to the
`accompanying figures,
`in which like reference numbers
`indicate like features and wherein:
`
`FIG. 1 is a schematic block diagram for representing an
`overall arrangement of a digital camera 1 for constituting an
`image processing system according to a first embodiment of
`the present invention.
`FIG. 2 explanatorily shows an outer view of the digital
`camera 1 indicated in FIG. 1;
`FIG. 3 represents a structure of the key operation unit 9
`in FIG. 1;
`FIG. 4 schematically indicates a storage area structure of
`the RAM 10 shown in FIG. 1 and a data structure thereof;
`FIG. 5 is a schematic block diagram for representing an
`internal arrangement of the wordprocessor 21 connectable to
`the digital camera 1 of FIG. 1;
`FIG. 6 is a flow chart for explaining operations of the
`digital camera 1 in a photograph mode;
`FIGS. 7A to 7E explanatorily show key operation/image
`sample of the digital camera 1 in the photograph mode;
`FIG. 8 is a flow chart for describing operations of the
`digital camera 1 in a reproduce mode;
`FIGS. 9A to 9D explanatorily indicate operation/image
`sample of the digital camera 1 in the reproduce mode;
`FIG. 10 is a flow chart for explaining operations of the
`wordprocessor 21 in an image synthesizing process;
`FIGS. 11A to 11D explanatorily indicate an image sample
`of the wordprocessor 21 in the image synthesizing process;
`FIG. 12 is a schematic block diagram for showing an
`overall arrangement of a GPS on-vehicle terminal unit 41 for
`constituting an image processing system according to a
`second embodiment of the present invention;
`FIG. 13 explanatorily illustrates an outer view of the GPS
`on-vehicle terminal unit 41 shown in FIG. 12;
`FIG. 14 is a schematic block diagram for indicating an
`overall arrangement of another GPS on-vehicle terminal unit
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`51 for constituting an image processing system according to
`a third embodiment of the present invention;
`FIG. 15 is a flow chart for describing operations of the
`GPS on-vehicle terminal unit 51 in an image recording
`process;
`FIG. 16 is a flow chart for representing operations of the
`GPS on-vehicle terminal unit 51 in a normal mode; and
`FIGS. 17A to 17E explanatorily represent display image
`samples of the GPS on-vehicle 51 in the normal mode and
`an image recording mode.
`BEST MODE OF CARRYING OUT THE
`INVENTION
`
`Referring now to the drawings, a description will be made
`of various image processing systems according to presently
`preferred embodiments of the present invention.
`[Arrangement of First Digital Camera]
`FIG. 1 is a schematic block diagram for showing an
`overall arrangement of a so-called “digital camera (namely,
`electronic camera)” which may constitute an image process-
`ing system according to a first preferred embodiment of the
`present invention. The image processing system includes the
`digital camera 1 and a wordprocessor 21 functioning as an
`external appliance electrically connected to this digital cam-
`era 1 by way of an electric cable.
`The digital camera 1 is a portable type electronic still
`camera operable by a cell. This digital camera 1 is arranged
`by, as shown in FIG. 1, a CPU 2, a storage unit 3, a CCD
`image input unit 4, an imaging lens 5, an image sensor I/F
`circuit 6, a display control unit 7, a display unit 8, a key
`operation unit 9, a RAM 10, and an external data input/
`output unit 11. The CPU (central processing unit) 2 is such
`a central processing unit capable of controlling an entire
`operation of this digital camera 1 in response to various sorts
`of programs previously stored in the storage unit 3. The
`storage unit 3 contains a storage medium for previously
`storing thereinto a program and data. This storage medium
`may be made from a magnetic storage medium, an optical
`storage medium, or a semiconductor memory. The storage
`medium may be fixedly employed in the storage unit 3, or
`may be detachably provided with the storage unit 3.
`Alternatively, the above-described program and data may be
`accepted from other appliances via a communication line to
`be stored into this storage medium. Furthermore, another
`storage unit equipped with the storage medium is provided
`on the side of other appliances connected thereto via a
`communication line, and the program and/or data stored in
`this storage medium may be used via this communication
`line. The CCD image input unit 4 is a CCD (charge-coupled
`device) image sensor as a solid-state imaging element. An
`image of a photographic object which is received via the
`imaging lens 5 is photoelectrically converted into an image
`signal by the CCD image input unit 4. Then,
`the image
`signal is supplied to the image sensor I/F circuit 6. The
`image sensor I/F circuit 6 converts the analog image signal
`into a digital
`image signal. This digitally photographed
`image data is fetched into the CPU 2. In this embodiment,
`the CPU 2 supplies the photographed image data as one
`image screen data to the display control unit 7. One image
`screen data is furnished to the display unit 8 for display
`purposes. The display unit 8 is constructed of a liquid crystal
`display device and the like, and may function as an image
`reproduced screen or a finder screen. When a shutter switch
`(not shown in detail) employed on the key operation unit 9
`is operated in this digital camera 1, the image data obtained
`during this photographing operation is stored into the RAM
`10 as one screen image data.
`
`19
`
`

`
`6,133,947
`
`5
`
`The RAM (random access memory) 10 is an image
`memory for temporarily storing thereinto the photographed
`image data and various sorts of input information. When an
`image reproducing instruction is issued from the key opera-
`tion unit 9, the CPU 2 reads both the image data instructed
`for the image reproduction, and the input information cor-
`responding thereto from the RAM 10, and then supplies this
`image data together with the corresponding input informa-
`tion to the display control unit 7 so as to display the image
`on the display unit 8. Also, when an image transferring
`instruction is entered from the key operation unit 9, the CPU
`2 transfers the photographed image data stored in the RAM
`10 via the external data input/output unit 11 to the word-
`processor 21.
`It should be noted that
`this external data
`input/output unit 11 corresponds to, for example, an RS232C
`serial interface. It should also be understood that although
`the wordprocessor 21 is employed as the external appliance
`of this first image processing system, when a floppy disk unit
`is employed as this external appliance,
`the external data
`input/output unit 11 corresponds to a disk driver.
`[Outer View of First Digital Camera]
`FIG. 2 shows an outer View of the digital camera 1 of FIG.
`1. On the side of a front face, the imaging lens 5 and the
`CCD image input unit 4 positioned opposite to this imaging
`lens 5 are built in this digital camera 1. Various sorts of keys
`(will be discussed later) for constructing the key operation
`unit 9 are provided in an upper face. A cord connection
`terminal (jack) 12 for connecting the external data input/
`output unit 11 to the wordprocessor 21 in a side face. Then,
`the display unit 8 is provided in a rear face of the digital
`camera 1, and may function as a finder screen under such a
`condition that the imaging lens 5 is directed to the photo-
`graph object.
`[Panel of Key Operation Unit]
`FIG. 3 is a panel for representing the key operation unit
`9 in more detail. This key operation unit 9 is provided with
`a power switch “POWER”, a shutter switch “SHOT”, a
`slide-type mode selecting switch “MOD” for selecting a
`photograph mode (PLAY)/a reproduce mode (REC), and
`various sorts of keys K1, K2, K3, K4, K5. These keys own
`the following functions. For instance, in the case that the
`input information is set to the RAM 10 in correspondence
`with the photographed image, the OK key K1 may function
`as an execution key and a carry key, whereas the NG key K2
`may function as a release key and a shift down key. Every
`time the plus key K3 is manipulated, the numeral data is
`incremented by “1”, namely a numeral value entry key.
`Every time the minus key K4 is manipulated, the numeral
`data is decremented by “1”, namely a numeral value entry
`key. In the reproduce mode, the plus key K3/the minus key
`K4 may function as image selection keys. In this reproduce
`mode,
`the functioning key corresponds to a key used to
`instruct whether or not the input information set in the RAM
`10 in correspondence with the image to be produced is
`displayed in combination with the photographed image.
`[Storage Contents of RAM 10]
`The storage contents of the RAM 10 will now be
`described with reference to FIG. 4.
`
`As represented in FIG. 4, the RAM 10 contains a system
`work area 10-1 used to store various sorts of conditions, an
`image data area 10-2 used to store a photographed image and
`input
`information corresponding to this photographed
`image, a stack area 10-3 for temporarily storing data. Now,
`the storage content of the image data area 10-2 will be
`explained. For instance, a first image is employed, and a data
`format thereof is indicated. That is, data is arranged by
`identifiers for data byte numbers+data sorts (identifiers for
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`identifying positional information, additional information,
`image information, and control
`information), and actual
`data. In this embodiment, a first record, namely a record
`containing positional information as an identifier is consti-
`tuted by a flag indicative of north/south/east/west (1 byte),
`latitude data (5 bytes),
`longitude data (5 bytes), and an
`identifier (1 byte),
`i.e., a total of 12 bytes. This actual
`positional information data is set by entering from the key
`operation unit 9, present position information being dis-
`played on a display screen of a car navigation system. Then,
`a data length (12 bytes),
`the identifier (positional
`information), the actual position information data (latitude/
`longitude data etc.) are set to the RAM 10 in the arranging
`order.
`
`The next record, namely a record containing additional
`information as an identifier, is arranged by a data length (22
`bytes), an identifier (additional
`information), and actual
`additional information data (21 bytes) in this order. The
`actual additional
`information data corresponds to,
`for
`example, a title of an image. Furthermore, a record contain-
`ing image information as an identifier is stored. Since the
`actual
`image information data requires a large memory
`capacity, a data length is indicated by a quantity of block,
`while 256 bytes are handled as 1 block. FIG. 4 concretely
`represents the contents of the actual image information data
`in unit of byte. That is, the actual image information data are
`subdivided into three primary colors such as red, blue, green
`colors every 1 dot from the upper left 1 dot of the image,
`which are stored. In this case, as indicated in FIG. 4, the
`image is arranged by 240 dots><320 dots. As a result,
`approximately, 230 Kbytes defined by 240 dots><320 dots><3
`(byte number for three primary colors) may constitute the
`actual image information data. It should be noted that as to
`the final record, an end code indicative of an end of the first
`data is used as actual data thereof. The CPU 2 may store the
`photographed image data into the RAM 10 in such a filing
`format.
`
`[Internal Arrangement if Wordprocessor]
`Referring now to a block diagram of FIG. 5, an internal
`arrangement of the above-described wordprocessor 21 will
`be described.
`
`This wordprocessor 21 is mainly arranged by the below-
`mentioned units/circuit elements. That
`is, a CPU 22 is
`employed so as to control
`the overall operation of this
`wordprocessor 21 in accordance with various sorts of pro-
`grams stored in a storage unit 23. When document data is
`inputted from a key operation unit 24, the CPU 22 converts
`this entered document data into display data, and then
`supplies this display data to a display control unit 25 so as
`to display the document on a display unit 26 based on this
`display data. Furthermore, the CPU 22 stores document data
`defined by kana/kanji-character conversions into a RAM 27.
`The storage unit 23 contains a storage medium for previ-
`ously storing thereinto a program and data. This storage
`medium may be made from a magnetic storage medium, an
`optical storage medium, or a semiconductor memory. The
`storage medium may be fixedly employed in the storage unit
`23, or may be detachably provided with the storage unit 23.
`Alternatively, the above-described program and data may be
`accepted from other appliances via a communication line to
`be stored into this storage medium. Moreover, another
`storage unit equipped with the above-explained storage
`medium is provided which is connected via a communica-
`tion line to other appliances, and then the program and the
`data previously stored in this recording medium may be used
`through the communication line. Also, various sorts of
`interface circuits are connected to the CPU 2. Namely, a disk
`
`20
`
`

`
`6,133,947
`
`7
`I/F circuit 28, a printer I/F circuit 29, a player I/F circuit 30,
`and a camera I/F circuit 31. Thus, this CPU 22 may control
`input/output operations of a floppy disk drive 32, a printer
`unit 33, a CD-ROM player 34, and the digital camera 1 via
`these I/F circuits 28 to 31.
`The CD-ROM player 34 drives a CD-ROM 35 used in a
`car navigation system. This CD-ROM 35 is constituted by
`storing thereinto positional information of maps in corre-
`spondence with various sorts of map image data. The camera
`I/F circuit 31 is an RS-232 serial interface circuit. The CPU
`22 acquired photographed image data transferred from the
`digital camera 1 and positional information indicative of this
`photographing place via the camera I/F circuit 31. In this
`case, the CPU 22 retrieves the map image data stored in the
`CD-ROM 35 based upon the positional information acquired
`from the digital camera 1. Then, the CPU 22 acquires this
`map image data, and combines or synthesizes this map
`image data with the photographed image data to produce
`synthesized image data. The synthesized image data is
`stored in the RAM 27. In this case, the synthesized image
`data is stored in such a manner that this synthesized image
`data is inserted into the document data. The memory con-
`tents of the RAM 27 are recorded, or registered via the disk
`I/F circuit 28, and the floppy disk drive 32 on the floppy
`disk. Alternatively, instead of the floppy disk, an optical
`memory disc having a large memory capacity and/or a
`high-speed memory card may be employed so as to record/
`save the memory contents of the RAM 27.
`[Photograph Mode Operation of Digital Camera]
`FIG. 6 is a flow chart for representing operations of the
`digital camera 1 in a photograph mode.
`It should be understood that a program used to realize
`various functions described in this flow chart has previously
`been stored in the above-explained storage medium in a
`program code format readable by the CPU (this is similarly
`applied to another flow chart of FIG. 8).
`That is, when the mode selecting switch MOD is changed
`into the REC position, the CPU 2 executes the operations in
`accordance with the process sequence of the flow chart
`shown in FIG. 6. FIGS. 7A to 7E schematically represent
`key operations and image samples in the photograph mode.
`First, in the flow chart of FIG. 6, the CPU 2 causes the
`CCD image input unit 4 and the image sensor I/F circuit 6
`to be driven. Thereafter, the image of the photographed
`object is optically received by the CCD image input unit 4
`so as to be photoelectrically converted into the analog image
`signal. Then, this analog image signal is converted into the
`digital image data by the image sensor I/F circuit 6. The
`CPU 2 acquires this photographed image data (step A1) and
`displays the photographed image on the display unit 8 (step
`Then, since the process operations defined at the steps
`A1 and A2 are repeated until the shutter switch SHOT is
`manipulated, the photographer operates the digital camera 1
`to be focused onto a desired scene while confirming the
`displayed image functioning as the finder. When the shutter
`switch SHOT is depressed, the CPU 2 stores the photo-
`graphed image data acquired at this time into the RAM 10,
`and stops the image acquisition (step A4). Now, FIG. 7A
`represents a photographed image produced when the shutter
`switch SHOT is depressed. Under such a condition that the
`photographed image is displayed, the CPU 2 displays mes-
`sage data for inquiring whether or not the photographing
`place is recorded in relation to this photographed image on
`the display screen of the display unit 8 (step A5). FIG. 7B
`represents a display condition in this case. When the pho-
`tographer confirms the content of this displayed message
`and wishes to record the photographing place, the photog-
`rapher manipulates the OK key K1 (step A6).
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`In such a case that the positional information about the
`photographing place, the photographer selectively manipu-
`lates the OK key K1, the NG key K2, the plus key K3, and
`the minus key K4, while confirming the present position
`being outputted on the display screen of the car navigation
`system, so that
`the numeral values of the latitudinal/
`longitudinal data are inputted one digit by one digit (step
`A7). In other words, when the plus key K3 is manipulated,
`the numeral value is incremented, whereas when the minus
`key K4 is manipulated, the numeral value is decremented.
`When, the OK key K1 is manipulated, the present digit is
`advanced to the subsequent digit, whereas when the N