`Saito
`
`US005724155A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,724,155
`Mar. 3, 1998
`
`[54] ELECTRONIC IMAGING SYSTEM
`[75]
`Inventor: Yawara Saito, Hachiohji, Japan
`[73] Assignee: Olympus Optical Co., Ltd.. Tokyo,
`Japan
`
`[21] Appl. No.: 366,893
`[22] Filed:
`Dec. 30, 1994
`130]
`Foreign Application Priority Data
`Dec. 30, 1993
`[JP]
`Jappath oo....nesssenneeeeenenerenenenres 5-351087
`[51] Hint, CS onessssssseeereenns HOAN 1/00; HOAN 1/32
`[52] U.S. Cl.358/402; 358/403; 358/407;
`” "358/468
`[58] Field of Searchreesnnnueunnan 358/402, 403,
`358/407 468 462
`ao
`[56]
`References Cited
`U.S. PATENT DOCUMENTS
`4.553206 11/1985 Smutek et a. cevnsnnnenene 364/300
`
`4,587,633
`5/1986 Wang etal. ....
`serves 358/462
`5,231,501
`7/1993 Sakai ......scssccossssssnveesseeenreonnense 358/906
`
`OTHER PUBLICATIONS
`“Microsoft Mail for Windows”, May 1993. p- 5,
`“Microsoft Mail”for Windows, May 1993, pp. 1, 5, 17.
`
`Primary Examiner—Edward L. Coles,Sr.
`Assistant Examiner—Tia M. Harris
`Attorney, Agent, or Firm—Cushman, Darby & Cushman IP
`Group of Pillsbury Madison, & Sutro LLP
`[57]
`ABSTRACT
`An electronic imaging system is disclosed which is capable
`OF transmission and reception of image data and/or data
`Stored in recording media with a small size modem and
`(EINE @ great AOU of picked-up image, andfiling and
`taking them for a personal computer network host at a
`desired timing. Data communication meanstransmits image
`data obtained through by an image meansand/or data stored
`in a mounted information storage medium in a system
`conforming to an inter-personal computer communication
`S¥Stem fitted for network organization.
`26 Claims, 25 Drawing Sheets
`
`
`
`
`IMAGE PICK-UP
`FRAME
`
`CKT.
`MEMORY
`
`7
`
`.
`
`©
`
`VIDEO
`ENCODER
`
`"
`
`77
`
`SUBJECT
`
`EVE
`
`LcD
`DISPLAY
`
`OPERATION
`SWITCHES
`
`
`as
`
`
`
`
`SYSTEM
`
`CONTROLLER
`
`
`
`
`102
`
` TO TEL.LINE
`
`EEPROM
`
`14e~ide
`
`CARD I/F
`
`RS—-232C I/F
`
`?
`
`MEMORY
`CARD
`
`HUAWEI EX. 1213 - 1/35
`
`Canon Exhibit 1213
`Page 1
`
`Canon Exhibit 1213
`Page 1
`
`HUAWEI EX. 1213 - 1/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 1 of 25
`
`5,724,155
`
`102
`
`103
`
` 20
`
`CAMERA
`
`CAMERA
`
`HUAWEI EX. 1213 - 2/35
`
`Canon Exhibit 1213
`Page 2
`
`Canon Exhibit 1213
`Page 2
`
`HUAWEI EX. 1213 - 2/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 2 of 25
`
`5,724,155
`
`14g
`
`\ 14f
`
`14(14a~14e)
`
`HUAWEI EX. 1213 - 3/35
`
`Canon Exhibit 1213
`Page 3
`
`Canon Exhibit 1213
`Page 3
`
`HUAWEI EX. 1213 - 3/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 3 of 25
`
`5,724,155
`
`FIG.3
`
`[ ria
`
`iN
`
`CAMERA PLAY RECORD
`COWM.TRANSNIT RECEIVE
`
`HUAWEI EX. 1213 - 4/35
`
`Canon Exhibit 1213
`Page 4
`
`Canon Exhibit 1213
`Page 4
`
`HUAWEI EX. 1213 - 4/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 4 of 25
`
`5,724,155
`
`INIT131OL
`
`go1
`
`AW1dS10
`
`NOILVudd0
`
`SSHOLIMS
`
`YALIVYVHO
`
`
`
`YILVYSN39*JN0330/"dN09
`
`WOudaS
`
`cl
`
`4/1Jeee-Su
`
`WALSAS
`
`YATIOYULNOD
`
`“LH
`
`duvo
`
`AMOWSINllLt
`
`y'Old
`
`
`
`4A3OSGIA
`
`NETIOM)\E
`
`IW
`
`AYOWSA
`
`
`
`di-WldJ9¥NI
`
`"Ly
`
`LO3rans
`
`HUAWEI EX. 1213 - 5/35
`
`Canon Exhibit 1213
`Page 5
`
`Canon Exhibit 1213
`Page 5
`
`HUAWEI EX. 1213 - 5/35
`
`
`
`
`
`
`
`
`
`
`US. Patent
`
`Mar. 3, 1998
`
`Sheet 5 of 25
`
`5,724,155
`
`FIG.5
`
`MAP OF PROTOCOL REGISTRATION PORTION ( EEPROM )
`
`PROTOCOL ID
`
`
`| PROTOCOL | START ADDRESS
`
`PROTOCOL 2 START ADDRESS
`
`iPROTOCOL 4 START ADDRESS
`
`
`
`
`
`TRANSMISSION START ADDRESS 5
`
`
`
`
`
`
`
`
`PROTOCOL 3 START ADDRESS
`
`LOGIN START ADDRESS
`
`LOGOUT START ADDRESS
`
`
`
`RECEPTION START ADDRESS
`
`PROTOCOL 1 COMMENT
`
`LOGIN PROCEDURE
`FOR PROTOCOL 1
`
`LOGOUT PROCEDURE
`FOR PROTOCOL|
`
`TRANSMISSION PROCEDURE
`FOR PROTOCOL 1
`
`RECEPTION PROCEDURE
`FOR PROTOCOL |
`
`
`
`LOGIN START ADDRESS
`
`HUAWEI EX. 1213 - 6/35
`
`Canon Exhibit 1213
`Page 6
`
`Canon Exhibit 1213
`Page 6
`
`HUAWEI EX. 1213 - 6/35
`
`
`
`US. Patent
`
`Mar. 3, 1998
`
`Sheet 6 of 25
`
`5,724,155
`
`FIG.6
`
`PROTOCOL DESCRIPTION LANGUAGE
`
`» CHECK WHETHER ASSIGNED CHARACTER SERIES CAN BE
`RECEIVED IN ASSIGNED TIME
`- 2ND BYTE [S ASSIGNED TIME
`-3RD & FOLLOWING BYTES ARE RETRIEVAL CHARACTER SERIES
`( LEADING REPRESENTS NUMBER OF CHARACTERS )
`
`
`
`O2
`
`‘TRANSMIT ASSIGNED CHARACTER SERIES
`|-OND & FOLLOWING BYTES ARE CHARACTER SERIES 10 BE TRANS-
`MITED
`( LEADING REPRESENTS NUMBER CHARACTERS)
`
`TRANSMISSION OF ASSIGNED 1D
`
`TRANSMISSION OF ASSIGNED PASSWORD
`
`
`
`
`
`
`
`
`
`
`|06|TRANSMISSION OF ASSIGNED FILE ACCORDING TO XMODEM PROTOCOL
`
`
`|08|MAKE LIST OF IMAGE FILE FROM MAIL LIST |
`
`
`09|ER “ON” AND DR CONFIRMATION
`
`
`Pon[eer
`
`|oB|RS "ON" AND CS CONFIRMATION
`Seles
`
`CD CONFIRMATION
`
`HUAWEI EX. 1213 - 7/35
`
`Canon Exhibit 1213
`Page 7
`
`Canon Exhibit 1213
`Page 7
`
`HUAWEI EX. 1213 - 7/35
`
`
`
`US. Patent
`
`Mar.3, 1998
`
`Sheet 7 of 25
`
`5,724,155
`
`FIG.7
`
`PROTOCOL DESCRIPTION EXAMPLE ( LOGIN )
`
`
`
`
`
`( MODEM SETTING )
`02,07 AT&F¥ENS
`02,0D, "DT XXXXXXXXXX” (DIAL )
`01,20,04, "NET1~
`
`F1IG.8
`MAP OF COMM. DESTINATION REGISRATION PORTION
`PROTOCOL
`TEL. NO.
`ID
`PASSWORD
`COMMENT
`COMM. DEST.
`
`COMM DEST.
`cowDEST.
`BiWw
`COMM. DEST
`
`
`
`
`
`
`
`
`
`FIG.9
`CODE ASSIGNMENT OF PROTOCOL COLUMNa
`|00|NON-REGISTRATION
`
`|Ot|PROTOCOL |
`
`PROTOCOL
`
`
`
`HUAWEI EX. 1213 - 8/35
`
`Canon Exhibit 1213
`Page 8
`
`
`
`
`
`
`
`
`
`
`
`
`roeLa
`
`
`
`2|0
`
`4|PROTOCOL 4
`
`Canon Exhibit 1213
`Page 8
`
`HUAWEI EX. 1213 - 8/35
`
`
`
`U.S. Patent
`
`Mar.3, 1998
`
`Sheet 8 of 25
`
`5,724,155
`
`FIG. 10
`
`REGISTRATION MENU
`
`PROTOCOL REGISTRATION
`
`[> COMM. DEST. REGISTRATION
`
`FIG. 11
`
`IN PROTOCOL REGISTRATION
`
`PROTOCOL.DAT
`
`FIG. 12
`
`XXXXXXXX
`
`COMM. DEST. REGISTRATION
`COMM. DEST.1
`XXXXXX
`PROTOCOL 01
`NETWORK|
`TEL
`TONE XXXXXXX
`10
`XxXXXXXXX
`PASSWORD
`
`HUAWEI EX. 1213 - 9/35
`
`Canon Exhibit 1213
`Page 9
`
`Canon Exhibit 1213
`Page 9
`
`HUAWEI EX. 1213 - 9/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 9 of 25
`
`5,724,155
`
`FIG. 13
`
`REGISTRATION PROCESS
`
`S|
`
`$8
`<omate>
`YT 2©aoersn
`
`
`N
`
`DISPLAY
`REGISTRATION MENU
`
`SELECT A OR V SW.
`
`/83
`
`$4
`
`Y
`
`$5
`
`Y
`COMM.DEST.
`
`REGISTRATION?
`
`
`
`
`
`PROTOCOL REGISTRATION
`PROCESS
`
`S/
`
`COMM.DEST.REGISTRATION
`PROCESS
`
`HUAWEI EX. 1213 - 10/35
`
`Canon Exhibit 1213
`Page 10
`
`Canon Exhibit 1213
`Page 10
`
`HUAWEI EX. 1213 - 10/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 10 of 25
`
`5,724,155
`
`FIG. 14
`
`PROTOCOL REGISTRATION PROCESS
`
`S
`
`1"
`
`S12
`
`DISPLAY REGISTRATION PROCESS
`
`RETREIVE PROTOCOL
`DAT’FILE IN MEDIUM
`
`S13
`
`Y
`
`si4
`
`DISPLAY OF ERROR
`
`CHECK WHETHER FORMAT
`IS RIGHT
`
`$15
`
`
`
`N
`[S 1D PREDETERMINED
`DATA?
`
`
`Y
`
`
`S16
`
`S20
`
`DISPLAY OF ERROR
`
`
`
`
`
`READ OUT DATA SUCCESSIVEL
`AND WRITE IN ASSIGNED
`ADDRESS OF EEPROM
`
`DISPLAY END OF REGISTRATION
`
`DISPLAY COMM. MODE SCREEN
`
`Si7
`
`$i8
`
`HUAWEI EX. 1213 - 11/35
`
`Canon Exhibit 1213
`Page 11
`
`Canon Exhibit 1213
`Page 11
`
`HUAWEI EX. 1213 - 11/35
`
`
`
`US. Patent
`
`Mar.3, 1998
`
`Sheet 11 of 25
`
`5,724,155
`
`FIG. 15
`
`COMM.DEST.REGISTRATION
`PROCESS
`
`DISPLAY COMM.DEST.REGISTRATION
`SCREEN
`
`OPERATE A OR V SW.
`
`$23
`
`S2l
`
`S22
`
`STORE DATA IN MEMORYJ><¢
`AREA-AND MOVE CURSOR
`TO NEXT DIGIT
`
`$25
`
`=HI $26
`
`DISPLAY REGISTRATION
`END SCREEN
`
`DISPLAY COMM.MODE SCREEN
`
`S27?
`
`END
`
`HUAWEI EX. 1213 - 12/35
`
`Canon Exhibit 1213
`Page 12
`
`Canon Exhibit 1213
`Page 12
`
`HUAWEI EX. 1213 - 12/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 12 of 25
`
`5,724,155
`
`FIG. 16
`
`TRANSMISSION LOGIN
`
`[> COMM. DEST.1~~NET |
`
`
`SCREEN SELECTION
`
`
`COMM. DEST.2
`
`NET 2
`
`COMM. DEST.3
`
`OLYMPUS
`
`COMM. DEST. 4
`
`MANUAL
`
`FIG. 17
`
`FIG. 18
`
`IN TRANSMISSION
`
`10%
`
`HUAWEI EX. 1213 - 13/35
`
`Canon Exhibit 1213
`Page 13
`
`Canon Exhibit 1213
`Page 13
`
`HUAWEI EX. 1213 - 13/35
`
`
`
`U.S. Patent
`
`Mar.3, 1998
`
`Sheet 13 of 25
`
`5,724,155
`
`FIG. 19
`
`SCREEN SELECTION
`
`END
`
`HUAWEI EX. 1213 - 14/35
`
`Canon Exhibit 1213
`Page 14
`
`Canon Exhibit 1213
`Page 14
`
`HUAWEI EX. 1213 - 14/35
`
`
`
`U.S. Patent.
`
`Mar. 3, 1998
`
`Sheet 14 of 25
`
`5,724,155
`
`FIG.20
`
`TRANSMISSION PROCESS
`
`DISPLAY TRANSMISSION
`LOGIN
`
`$31
`
`——————__|s32
`OPERATE A OR V SW.
`
`S44
`
`
`
`<<BecuTeSid
`S48
`EXECUTE FILE TRANS‘ISSION
`ACCORDING TO TRANSMISSION
`
`READ OUT TRANSMISSION
`PROCEDURE OF ASSIGNED
`COMM.OES7.
`
`PROCEDURE (IN % }
`
`READ OUT LOGIN PROCEDURE
`BASED ON COMM.PROTOCOL OF
`
`ASSIGNED COMM.DEST.
`
`S46
`S35 $49 N
`
`EXECUTE LOGIN PROCEDURE
`SUCCESSIVELY
`
`DISPLAY OF ERROR
`
`Y
`
`S47
`|t
`
`S
`
`36
`
`<i>
`
`s4g|
`
`SET “J6I"AS FILE
`
`Y S37
`
`DISPLAY OF ERROR
`
`DISPLAY “LOGIN SUCCESS’
`
`DISPLAY SCREEN SELECTION
`
`542
`
`
`$39 eureS
`
`EXECUTE LOGOUT PROCEDURE
`
`DISPLAY END SCREEN
`
`:
`OPERATE A OR V SW
`
`. G
`
`U
`
`y
`
` S4i
`
`
`
`Y
`
`HUAWEI EX. 1213 - 15/35
`
`Canon Exhibit 1213
`Page 15
`
`Canon Exhibit 1213
`Page 15
`
`HUAWEI EX. 1213 - 15/35
`
`
`
`U.S. Patent
`
`Mar.3, 1998
`
`Sheet 15 of 25
`
`5,724,155
`
`FIG.21
`
`RECEPTION LOGIN
`
`[> COMM. DEST. 1.
`
`NET |
`
`COMM. DEST. 2
`
`NET 2
`
`COMM. DEST. 3
`
`OLYMPUS
`
`COMM. DEST. 4
`
`MANUAL
`
`FIG. 22
`
`
`
`65%
`
`MAIL LIST
`
`o 3 FILES
`
`o TOTAL 126K BYTES
`
`RECEIVE ?
`
`FIG. 23
`
`IN RECEPTION
`
`o IN 1ST FILE RECEPTION
`( TOTAL 3 FILES }
`o FILE NAME 0S000001.J61
`
`HUAWEI EX. 1213 - 16/35
`
`Canon Exhibit 1213
`Page 16
`
`Canon Exhibit 1213
`Page 16
`
`HUAWEI EX. 1213 - 16/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 16 of 25
`
`5,724,155
`
`FIG. 24
`
`RECEPTION PROCESS
`
`DISPLAY RECEPTION LOGIN P
`
`$5]
`
`TT
`e
`
`OPERATE A OR V SW .
`
`$52
`
`S70
`
`S63
`
`N—-cUECESSFULLY MADE
`
`Y
`
`
`READ OUT LOGIN PROCEDURE
`OF COMM. PROCEDURE OF
`ASSIGNED COMM. DEST.
`
`
`358
`EXECUTE LOGIN PROCEDURE
`DELETE THE SUCCESSFULLY
`g@&|RECEIVED FILES
` AUTOMATICALLY
`SUCCESSIVELY
`S56
`
`o
`
`DISPLAY OF ERROR
`
`$54
`
`$64
`
`CLOSE FILE
`
`
`
`(
`
`S57
`
`N
`
`S69
`
`DISPLAY OF ERROR
`
`S66
`ACL MAILS COMPLETEOL>"
`S67
`
`Y
`
`DISPLAY END
`
`EXECUTE LOGIN PROCEDURE
`
`ASSIGNED COMM. DEST.
`
`END
`
`S68
`
`DISPLAY “LOGIN SUCCESS”
`
`
`
`$58
`MAKE TABLE OF FILES
`
`WITH TITLE “J6]" FROM
`LIST IN MAIL BOX
`
`
`DISPLAY MAIL LIST \
`
`Y
`CREATE FILE NAME
`
`READ OUT RECEPTION PROCEDURE
`OF ASSIGNED COMM. DEST.
`
`S6I
`
`$62
`
`HUAWEI EX. 1213 - 17/35
`
`Canon Exhibit 1213
`Page 17
`
`Canon Exhibit 1213
`Page 17
`
`HUAWEI EX. 1213 - 17/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 17 of 25
`
`5,724,155
`
`FIG. 25
`
`" 14(144,14d,14e)
`
`HUAWEI EX. 1213 - 18/35
`
`Canon Exhibit 1213
`Page 18
`
`Canon Exhibit 1213
`Page 18
`
`HUAWEI EX. 1213 - 18/35
`
`
`
`US. Patent
`
`Mar.3, 1998
`
`Sheet 18 of 25
`
`5,724,155
`
`FIG. 26
`
`"0
`
`CAMERA PLAY RECORD
`
`149°
`
`HUAWEI EX. 1213 - 19/35
`
`Canon Exhibit 1213
`Page 19
`
`Canon Exhibit 1213
`Page 19
`
`HUAWEI EX. 1213 - 19/35
`
`
`
`USS. Patent
`
`Mar. 3, 1998
`
`Sheet 19 of 25
`
`5,724,155
`
`
`
`YAGOON]AYOWSW
`
`IWVU
`
`gq91
`
`AW1dSI
`
`NOLLVYdd0
`
`SJHOLIMS
`
`YSLIVYVHD
`
`YOLVHANAS
`
`WALSAS
`
`YSTIONLNOO
`
`7’dWO09
`
`dW0950
`
`"1
`
`et
`
`HUAWEI EX. 1213 - 20/35
`
`Canon Exhibit 1213
`Page 20
`
`Canon Exhibit 1213
`Page 20
`
`HUAWEI EX. 1213 - 20/35
`
`
`
`
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 20 of 25
`
`5,724,155
`
`FIG. 28
`
`FIG. 29
`
`
`
`FIG. 30
`
`HUAWEI EX. 1213 - 21/35
`
`Canon Exhibit 1213
`Page 21
`
`Canon Exhibit 1213
`Page 21
`
`HUAWEI EX. 1213 - 21/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 21 of 25
`
`5,724,155
`
`FIG.31
`
`CAMERA SETTING
`
`S71
`
`CONNECT BUS OF HD UNIT
`TO SIDE OF COMP./3ECOMP.CKT.
`
`RECORD MODE?
`
`S72
`
`Y
`$73
`
`$76
`
`OISPLAY PLAY MODE
`
`DISPLAY RECORD MODE
`
`S74
`
`S75
`
`RETREIVE FRAMES CAPABLE
`OF RECORDING
`
`S77
`
`|
`
`REPRODUCE 1ST FRAME
`
`PERMIT SW. INPUT
`
`END
`
`FIG. 32
`
`HD UNIT SETTING
`
`CONNECT BUS OF HD UNIT
`TO SIDE OF SCSI I/F
`
`
`
`DISPLAY HD MODE
`
`PROHIBIT SW. INPUT
`
`S81
`
`$82
`
`$83
`
`HUAWEI EX. 1213 - 22/35
`
`Canon Exhibit 1213
`Page 22
`
`Canon Exhibit 1213
`Page 22
`
`HUAWEI EX. 1213 - 22/35
`
`
`
`US. Patent
`
`Mar. 3, 1998
`
`Sheet 22 of 25
`
`5,724,155
`
`FIG. 33
`
`TRANSMISSION IMAGE
`IMAGE REGISTRATION
`
`S91
`
`
`CHECK WHETHER IMAGE
`BEING REPRODUCED IS IN
`TRANSMISSION LIST
`
`
`
`
`
`
`
`
`
`DELETE IMAGE BEING REPRODUCED
`FROM TRANSMISSION LIST
`
`
`
`ADD IMAGE BEING REPRODUCED
`TO TRANSMISSION LIST
`
`DISPLAY REGISTERED
`SCREEN AGAIN
`
`HUAWEI EX. 1213 - 23/35
`
`Canon Exhibit 1213
`Page 23
`
`Canon Exhibit 1213
`Page 23
`
`HUAWEI EX. 1213 - 23/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 23 of 25
`
`5,724,155
`
`FIG. 34
`
`TRANSMISSION PROCESS
`
`
`
`=
`
`END
`
`$101
`
`
`
` ]
`WHETHER IMAGE TO BE
`TRANSMITTED IS REGISTERED IN
`
`TRANSMISSION LIST?
`
`
`S102
`Y
`
`MUTE SCREEN
`
`DISPLAY COMM. DEST.
`SELECTION PROCESS
`
`DISPLAY “IN LOGIN” PROCESS
`
`READ OUT AND EXECUTE
`LOGIN PROCEDURE
`
`READ OUT FILE TRANSMISSION
`PROCEDURE
`
`S103
`
`stds
`
`w)
`
`106
`
`$107
`
`
`REPRODUCE TRANSMISSION FILE P
`
`
`
`DISPLAY AS TO HOW MUCH FILE
`HAS BEEN TRANSMITTED
`
`
`
`SET “J6I" AS TITLE
`
`
`
`WHETHER ALL
`REGISTERED FILES
`BEEN TRANSMITTED}
`
`
`
`S108
`
`sii
`
`MUTE SCREEN AND DISPLAY
`“IN LOGOUT” PROCESS
`
`READ QUT AND EXECUTE
`LOGOUT PROCEDURE
`
`Sil2
`
`DISPLAY END SCREEN
`
`END
`
`SUS
`
`HUAWEI EX. 1213 - 24/35
`
`Canon Exhibit 1213
`Page 24
`
`Canon Exhibit 1213
`Page 24
`
`HUAWEI EX. 1213 - 24/35
`
`
`
`U.S. Patent
`
`Mar. 3, 1998
`
`Sheet 24 of 25
`
`5,724,155
`
`FIG. 35
`
`SELECT PIC.
`
`F/G. 36
`
`32 KBYTES
`: 0426910181
`
`SEND TO C-1
`
`NAME : NETWRKI
`
`HOST : NIF2
`
`LINE : TONE
`
`NO.
`
`HUAWEI EX. 1213 - 25/35
`
`Canon Exhibit 1213
`Page 25
`
`Canon Exhibit 1213
`Page 25
`
`HUAWEI EX. 1213 - 25/35
`
`
`
`U.S. Patent
`
`Mar.3, 1998
`
`Sheet 25 of 25
`
`5,724,155
`
`F1IG.37
`
`2
`
`SEND TO C-1
`
`REST : 32KBYTES
`
`HUAWEI EX. 1213 - 26/35
`
`Canon Exhibit 1213
`Page 26
`
`Canon Exhibit 1213
`Page 26
`
`HUAWEI EX. 1213 - 26/35
`
`
`
`1
`ELECTRONIC IMAGING SYSTEM
`
`5,724,155
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`2
`and reception of image data. In addition, for the transmission
`and reception of the image data or the like by the DSC,the
`storage medium is mounted, causing difficulty in handling.
`BACKGROUND OF THE INVENTION
`The present invention generally relates to an electronic
`SUMMARY OF THE INVENTION
`imaging systems for taking, storing, reproducing or retriev-
`An object of the present invention is therefore to provide
`ing image data from an applied storage device or medium,
`an electronic imaging system capable of transmission and
`the systems inclusive of such apparatuses as an electronic
`reception of image data and/or data stored in recording
`still camera or an electronic image data filling apparatus.
`media only with a small size modem orthelike.
`More particularly. the invention relates to an electronic
`Another object of the present invention is to provide an
`imaging systems mentioned above further comprising com-
`electronic imaging system capable of taking a great amount
`munication means capable of transmitting or receiving
`of picked-up image. and filing and taking the images for a
`image data utilizing a personal computer network.
`personal computer network host at a desired timing.
`In recent years, an image information storing or recording
`According to an aspect of the present invention, there is
`apparatus, and/or, retrieving or reproducing apparatus, such
`provided an electronic imaging system comprising data
`as an electronic still camera or an electronic image data
`communication meansfor transmitting image data obtained
`filling apparatus for storing or retrieving image data on or
`through an image means and/or data stored in a mounted
`from an applied storage device or medium, have been
`information storage medium in a system conforming to an
`developed. Electronic still cameras of conventional type
`inter-personal computer communication system fitted for
`generally employ solid state electronic imaging devices,
`network organization.
`such as CCD imagers,for photoelectric conversion to obtain
`According to another aspect of the present invention,
`a picture signal corresponding to objects intended to be
`there is provided an electronic imaging system incorporating
`picked up or photographed. The picture signal issued from
`information storing means of comparatively large capacity
`the imaging device is processed by a conventional process-
`and comprising external control mode means for permitting
`ing circuit to obtain a video or TV signal able to be recorded
`independent accessing of the information storing means
`or stored, and the processed signal is converted into a digital
`from an external unit via communication means.
`form representative of the image information intended to be
`According to other aspect of the present invention, there
`stored. In the above mentioned cameras, the image infor-
`is provided an electronic imaging system comprising image
`mation is represented and conveyed in the form of digital
`pick-up meansfor generating and outputting an image signal
`data. Following the trend of the times, an electronic still
`photoelectrically converted from an image incident thereon,
`camera, which outputs image data whose format may be
`image data storing means for storing an image data corre-
`compatible for either the IBM Personal Computer and
`sponding to the image signal issued from the image pick-up
`related architectures or the Apple Mackintosh PC architec-
`means on an applied storage device or medium, data com-
`ture as selected by the operator is proposed. This electronic
`munication means for transmitting a designated image data
`still camera is disclosed in the U.S. Pat. No. 5,138,459. The
`in the device or medium through a personal computer
`digital data stored in the applied storage device or medium
`network organization while an operation mode of the system
`preferably takes the compressed form thereof, utilizing the
`is set for communication, and switch means for causing the
`encoding data compression technique (see U.S. Pat. No.
`communication means to start a communication mode
`5.034,804)or variable-length encoding data compression
`technique (see U.S. Pat. No. 5,027,214). According to such
`operation.
`Other objects and features will be clarified from the
`variable-length data compression encoding, since an image
`following description with reference to attached drawings.
`data can be compressed in accordance with contents of an
`image so as to be reduced in amount, a large number of
`BRIEF DESCRIPTION OF THE DRAWINGS
`electronic still images can be stored in a semiconductor
`FIG. 1 is a block diagram showingafirst embodiment of
`43
`memory card as the applied storage device or medium while
`the electronic imaging system according to the present
`the memory area on the memory card required to store one
`invention;
`electronic still image is reduced.
`FIG.2 is a perspective view showing the DSC 20 in the
`Meanwhile,a still video apparatus which has a device for
`interfacing with an external image data processing device
`embodiment;
`has been previously proposed (see U.S. Pat. No. 5,231,501).
`FIG. 3 shows, in an enlarged scale. the operation switches
`The still video apparatus comprises a signal output device
`14 (14a to 14g) and LCDdisplay 13 provided on the top of
`for outputting an electrical image signal and a signal con-
`the DSC housing 18;
`verter for converting the image signal to an image data
`FIG.4 is a block diagram showinga controller of the DSC
`signal which can be processed by an external image data
`20;
`processing device such as a personal computer.
`FIG. 5 shows a map of a protocol registration portion
`Recently. there have been many proposals for electronic
`stored in the EEPROM 16 of the DSC 20;
`imaging systems having multiple functions, such as DSC
`FIG.6 showsthe protocol description language applied to
`(digital still video camera), using such a storage media as an
`the DSC 20;
`IC memory card, magnetic storage medium. opto-magnetic
`FIG. 7 is a view showing a protocol description example
`storage medium. fiash memory, etc. As one of such
`for login process using the code in FIG. 6;
`proposals, there is a DSC capable of personal computer
`FIG. 8 shows the map of the communication destination
`network communication with image data transmission and
`registration portion which is written in the EEPROM 16;
`reception system for external apparatuses.
`FIG. 9 showsthe codesto be written in the above protocol
`For personal computer network application to the above
`column;
`prior art image data transmission and reception by the DSC,
`FIGS. 10 to 12 show the EVF or a monitor screen for
`however,it is necessary to make use of personal computers.
`describing a communication protocol write-in operation;
`and it has been impossible to easily realize the transmission
`
`55
`
`65
`
`HUAWEI EX. 1213 - 27/35
`
`Canon Exhibit 1213
`Page 27
`
`Canon Exhibit 1213
`Page 27
`
`HUAWEI EX. 1213 - 27/35
`
`
`
`5,724,155
`
`illustrating
`
`3
`FIG. 13 to 15 show flow charts illustrating “registration
`process”, “protocol registration process” and “communica-
`tion destination registration process”;
`FIGS. 16 to 19 show the routines of the image file
`transmission;
`FIG. 20 shows a flow chart illustrating “transmission
`process”;
`FIG. 21 shows a selected communication destination
`displayed on monitor;
`FIG. 22 shows a mail list;
`FIG. 23 shows a screen “IN RECEPTION”;
`FIG. 24 shows a screen of a flow chart
`“reception process”;
`FIG. 25 is a perspective view showing the second embodi-
`ment of the DSC 30 according to the present invention;
`FIG. 26 is an enlarged-scale view showing a display 13
`and an operation switches 14 in the DSC
`FIG. 27 is a block diagram showing a controller in the
`DSC 36,
`FIG. 28 shows the display 13 in this embodimentof the
`DSC 30,
`FIG. 29 shows a state of screen in the camera mode but
`with the slide switch 14f switched to the play mode side;
`FIG. 30 showsa state of screen with the slide switch 14g’
`switched to the HD modeside;
`FIG. 31 is a flow chart illustrating a routine when the
`camera mode of the DSC 39 is set;
`FIG. 32 is a flow chart showing a routine which is
`executed when the HD mode of the DSC 30 is set;
`FIG. 33 shows a transmission image registration proce-
`dure of the embodiments;
`FIG. 34 shows a modification of FIG. 20 in the first
`embodiment;
`FIG. 35 showsthe registration of image to be transmitted;
`FIG. 36 shows an embodiment of the transmission des-
`tination selection part; and
`transmission
`FIG. 37 is a screen showing the actual
`processes subsequent to the step $104 in FIG. 34.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`Now,preferred embodiments of the present invention will
`be described with reference to the drawings.
`FIG.1 is a block diagram showinga first embodiment of
`the electronic imaging system according to the present
`invention applied to the case where image data and/or
`speech data, control data, etc. from DSC 20 or 20A are
`transmitted and received by making use of a personal
`computer network.
`As shown, communication of the image data or the like
`between the DSC 20 or 20A and a personal computer (PC)
`network host 104 is made via a modem 102 or 106 and
`telephone lines 103 and 105. Image data transmitted from
`the DSC 20 is uploadedly written in a mail box 104a in the
`personal computer (PC) network host 104. The image data
`in the mail box 104a is downloadedly written in the receiv-
`ing side DSC 20A.
`FIG.2 is a perspective view showing the DSC 20 in this
`embodiment.It is assumed that the DSC 20 is provided with
`a personal computer card or like memory card 17 as the
`image information storage medium. As shownin FIG.2. the
`DSC 20 has a camera housing 18, and an image pick-up lens
`1 is provided in the front of the housing. The top of the
`
`4
`housing 18 is provided with operation switches 14 (14a to
`14g), an LCD display 13 and a release switch 19. Further,
`one side of the housing 18 is provided with a video signal
`output terminal 7, a connector 15a (See FIG. 4) which is a
`RS-232C IF connection portion for transmitting and receiv-
`ing signals to and from modems or the like external
`apparatuses, and a slit 18a for inserting a memory card 17
`as the storage medium.
`FIG. 3 shows, in an enlargedscale, the operation switches
`14 (14a to 14g) and LCD display 13 provided on the top of
`the DSC housing 18.
`Of the switches, shown at 14a is a “POWER” switch for
`the DSC, at 14b a “REGISTER” switch for registering
`communication protocol (procedure), telephone No.., etc. at
`the time of data communication, at 14c an “EXECUTE”
`switch to be operated when executingthe registration or the
`data communication, and at 14d and 1lde an “UP” and a
`“DOWN” switch for assigning the reproduction frame No.,
`registered telephone No., etc. Further, shownat 14¢is a slide
`switch for switching a camera mode and a communication
`mode of the DSC, and at 14fis a slide switch for switching
`between a “PLAY” and a “RECORD” modein the camera
`modes and switching between a “RECEIVE” and a
`“TRANSMIT” mode in the communication modes. When
`the DSCis in a mode other than the “RECORD” mode,i.e.,
`the “PLAY”, “TRANSMIT” or “RECEIVE” mode,
`the
`characters “PLAY”, “TRANSMIT” or “RECEIVE”in the
`LCD display 13 are turned on. Further, in the display 13,
`central seven-segment digits are for displaying the frame
`No. being processed or the like, and right upper small-size
`seven-segment digits are for displaying the number of
`frames ready for picking up image or number of residual
`frames that can be reproduced.
`FIG.4 is a block diagram showing a controller of the DSC
`20. The operation of the individual system components is
`controlled by a system controller 12. In the DSC 20, an
`image signal can be recorded in the mounted memory card
`17 in response to the depression ofthe release switch 19 (see
`FIG. 1). Also, by operating the operation switches 14d and
`1de it become possible to reproduce the image recording
`signal of an image file of an assigned frame No. on the
`memory card 17. In this case, the video signal is displayed
`as the viewfinder image in an EVF 8 and also supplied from
`a video signal output terminal to an external monitor.
`Further, as shown in FIG. 1, the DSC 26 can transmit or
`receive data to or from the personal computer network host
`104 via the modem 162 and telephoneline 103 onthebasis
`of a system conforming to a personal computer communi-
`cation system applicable to the network organization.
`Further, aside from the example of FIG. 1,it is possible to
`realize the data communication between the DSC 20 and a
`personal computer or data communication between the DSC
`20 and a DSCoflike type.
`In picking up the image, an object image is focused by an
`image lens 1 on an imaging element, such as CCD, provided
`in an image pick-up circuit 2. In the A/D converter 3 the
`image data from thecircuit 2 is converted into digital data
`whichis to be stored temporarily in a frame memory 4 of the
`image memory. The digital image data read out from the
`frame memory 4 is converted again in a D/A converter 5 into
`analog signals as video signals through a video encoder 6
`and from a video output terminal 7. The video signal is
`displayed as the viewfinder image in the EVF 8.
`When recording image data in the memory card 17. the
`image data is read out in a unit of blocks from the frame
`memory 4 for data compression by a JPEG (Joint Photo-
`
`10
`
`15
`
`25
`
`30
`
`35
`
`45
`
`50
`
`35
`
`65
`
`HUAWEI EX. 1213 - 28/35
`
`Canon Exhibit 1213
`Page 28
`
`Canon Exhibit 1213
`Page 28
`
`HUAWEI EX. 1213 - 28/35
`
`
`
`5,724,155
`
`10
`
`15
`
`25
`
`30
`
`35
`
`6
`5
`FIG. 6 shows the correspondence between code and
`graphic Effect Group) methodorthe like in a compression/
`function of the descriptive language ofthe file. The code is
`decompression circuit 10 to be coupled through a bus to a
`shown hexadecimally (&H). For example, eode “&HOO”
`card I/F 11 as a recording signal supply means. Then, the
`represents NOP, i.c., no operation. Code “&H01” is for
`compressed data is written in an assigned area on the
`checking whether an assigned character series can be
`memory card 17.
`received in an assigned time. Here. the second byte shows
`In reproduction, the frame No.orthelike is assigned by
`the assigned time,and the third and following bytes provide
`operating the “UP” and “DOWN” switches 14d and 1de.
`the retrieval character series. The leading byte shows the
`The frame No. or the file No.
`is displayed on the LCD
`number of characters.
`display 13. According to the assignment, a memory area in
`The other codes are as shown in FIG.6. Particularly, code
`the memory card 17 is selected, and the corresponding
`“2HO8” is for reading out and producing a list of files
`image data is coupled through the card UF 11 and busto the
`amongthe image data files uploaded in the mail box 104a in
`compression/decompression circuit 10. The image data is
`the accessed network, the list files each being withatitle
`thus subjected to the decompression process before being
`“J6r” as a predetermined mark representing file attribute
`stored in the frame memory 4. The image data is read out
`information. Thefile title “J6I’ is automatically provided to
`again from the frame memory 4 to be converted in the D/A
`the imagefile uploaded in the DSC 20 of this embodiment.
`converter 5 into the analog data, as described before. The
`Specifically, the title corresponds to an extender or the like
`encoder 6 encodes the analog data to produce the video
`in the data file.
`signal from the video signal output terminal 7.
`Shown as “XMODEM”in the function is a transmission
`Further, for the data communication the system controller
`or reception protocol in an ordinary file. Shown at ER is a
`12 reads out a communication protocol (communication
`signal informing the modem of the completion of prepara-
`procedure) which has been written in an EEPROM 16 as a
`tion for communication on the DSC side, and at DR is a
`procedure of accessing a network. and according to this
`signal showing that the modem has become capable of
`protocol the data transmission or reception is performed
`transmission or reception. Shown at RS is a transmission
`with respect to the personal computer network host 104
`request signal, at CS is a transmission approval signal and at
`accessed by the telephoneline or with a camera, a personal
`CDa signal which is turned upon detection of carrier from
`computer, etc. of the same type via the RS-232C I/F 15 and
`the partner modem.
`modem 102.
`FIG. 7 is a view showing a protocol description example
`FIG. 5 shows the map of a communication protocol
`for login process using the code in FIG. 6. In FIG. 7. the
`registration portion stored in the EEPROM 16. The regis-
`code data &H is omitted.
`tration data file of this communication protocol constitutes a
`Accordingto this protocol description. “On”ofthe signal
`“PROTOCOL. DAT”file to be describedlater.
`ER informing the modem 102 of the completion of prepa-
`In the protocal registration portion, protocol ID is
`ration of the communication on the DSCside and the signal
`recorded at the leading address for identifying the protocol
`DR showing that the modem has become capable of trans-
`rewriting. In this embodiment, four different protocols are
`mission and reception are confirmed by the code “09”.
`stored, and subsequent to the above ID addresses (pointers)
`Subsequently, a character series for modem initial setting is
`of start of storage of the four protocols 1 to 4 are recorded.
`transmitted. Code 02” shows subsequent transmissionof a
`Of the abovefour different protocols, the protocols 1 and
`character series. Subsequent to code “07” indicative of the
`2 may be applied to domestic commercial services; for
`number of characters, a character series “AT&F¥N3” as AT
`instance the protocol 1 may be applied to NIKKEL MIX,
`command is described to execute initial the setting of the
`and the protocol 2 to NIFTY. SERVE. Asfor the other
`modem 102.
`protocols, the protocol 3 may be applied to DSCof the same
`For accessing the network host 104 as the object of
`type, and the protocol 4 to the case where a personal
`communication, likewise code “02” and “OD”as the number
`computer is used as a terminal.
`of characters are described. Then, “DT XXXXXXXXKX”
`At the protocol start address is stored a storage start
`is described for dialing number “XXXXXXXXXX”by the
`address of the data body of a log procedure (protocol)for the
`tone dialing. Subsequently, for confirming the response from
`pertinent protocol. Subsequently, a start address of logout
`the partner side through the above dial processing. code
`procedure (protocol), a start address of transmission proce-
`“01”, code “20” providing waiting time (of 32 seconds) and
`dure (protocol), and a start address of reception procedure
`“02” indicative of the number of confirmed response char-
`(protocol) are stored. Subsequently. comment information
`acters are described. Further, “NET1”, for instance,
`is
`indicative of the content of the pertinent protocol is stored.
`described as a confirmation character series.
`The comment data, whenit is displayed. is converted in a
`The protocol description data about the login. logout
`character generator 9 into character information for display-
`protocol or the transmission or reception protocol, is con-
`ing it in the EVF 8 or on an external monitor. Subsequent to
`verted into the normal object file format to be produced at
`the commentinformationstorage area the data body of each
`each process time.
`protocol is stored.
`FIG. 8 shows the map of the communication destination
`The term “login” meansan operation until bringing about
`registration portion which is written in the EEPROM 16.
`a state ready for writing the data in the main box 1042 (FIG.
`The communication is executed by selecting the destinations
`1) of the host 104 by accessing the network host 104. The
`such as destinations 1 to 4. For each communication
`term “logout” means an operation of ending the modem
`destination, protocol distinction code. telephone No.. ID.
`control after the completion of the data transfer. The trans-
`password and commentto enable the utilizer to acknowl-
`mission protocol is a write procedure for uploading data in
`_ e