e
`
`United States Patent [19]
`Medina
`
`US005274474A
`
`[11] Patent Number:
`[45] Date of Patent:
`
`-
`
`5,274,474
`Dec. 28, 1993
`
`5,050,004 9/1991 Morton, Jr. ......................... 358/434
`[54] INTEGRATED TELEFACSIMILE AND
`5,095,445 3/1992 Sekiguchi............................ 379/100
`CHARACTER COMMUNICATION SYSTEM
`FOREIGN PATENT DOCUMENTS
`Mºstandard as high speed
`0054170 5/1981 Japan ................................... 358/462
`º
`-
`57-57078 4/1982 Japan .
`[75] Inventor: Mitchell Medina, Essex Fells, N.J.
`º; !; #. **s-s----------------4-4 tº * * * * * * *-- 358/468
`[73] Assignee: Randolph-Rand Corporation, New
`-
`apan .
`k, N.Y
`0.178766 9/1985 Japan ................................... 358/468
`York, N.Y.
`60-246.153 12/1985 Japan .
`[21] Appl. No.: 644,602
`Primary Examiner—Edward L. Coles, Sr.
`Filed:
`-
`Assistant Examiner—Jill Jackson
`[22] Filed
`Jan. 23, 1991
`Attorney, Agent, or Firm—Foley & Lardner
`[51] Int. Cl* ........................................... ... H04N 1/40
`[52] U.S. Cl. .................................... 358/462; 358/468;
`[57]
`ABSTRACT
`353/.35.3%/iod
`[58] Field of Search ............... 358/468, 435, 436, 438, A telefacsimile machine selectively operates in standard
`358/462, 439; 379/100; 382/41
`and high speed modes depending on the compatibility
`-
`-
`of equipment communicating with the telefacsimile
`References Cited
`machine at a particular time. The standard mode com
`U.S. PATENT DOCUMENTS
`munication employs bit mapped pixels for both text and
`. 358/.435
`4,000,371 12/1976 Ogawa
`-
`graphics The high speed mode distinguishes text from
`4.0.4.34; 7/1977 wine, .32%; graphics. Scanned text characters to be transmitted in
`4,410,916 10/1983 Pratt et al. ...
`... 358/435
`the high speed mode are compared to characters in a
`4,566,127 1/1986 Sekiya et al. .......................... 382/56
`library. When a match is found only a code, e.g. ASCII,
`4,630,126 12/1986 Kaku et al. .......
`... 358/438
`and the location of the character is transmitted. Graph
`4.672,459 6/1987 Kudo ...…..
`... 358/462
`ics and unrecognizable characters are transmitted as bit
`4.736,249 4/1988 Iizuka et al. …
`• 358/.435
`mapped pixels. When a document is received in the high
`§ ! º: sº et º -------------------------sº3
`speed mode, the received code identifies the text char
`;49 #: sº . al. ....
`... 3 :::::
`acter and bit-mapped pixels to be printed or otherwise
`4.322.54s 3/i990 Endohe ai".
`... 33%/56
`recorded in a storage medium. Any desired printing
`5,034.9% 7/1991 Kies". º ... 3.2/33
`resolution can then be selected for text characters.
`5,041,915 8/1991 Hirota et al. .....
`... 358/438
`5,041,917 8/1991 Koshiishi ............................. 358/434
`31 Claims, 11 Drawing Sheets
`
`[56]
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Iol
`
`SCAN PAGE INTO
`BIT - MAPPEO MAGE
`
`standard
`or HIGH-SPEED
`TRANSMission 2
`
`Koz
`standard
`
`HIGH-SPEED
`Pºgg SEGMENTATION
`SEPARATE PAGE. iNTo
`LINEs a GRAPHics AREAS
`
`CHARACTER SEPARATION
`SCAN CHARACTERAREAS for
`CHARACTER ONATA
`
`Place CHARACTER cooes
`!N MEMORY WITH LOCATIONS
`
`Yos
`
`Place in standard
`FACsºle oata format
`
`PAGES to 8:
`scaynep
`
`
`
`Page 1
`
`Commvault Ex. 1004
`Commvault v. Realtime
`US Patent No. 9,054,728
`
`

`

`U.S. Patent
`
`5,274,474
`
`92
`
`TlOH.L.NOO
`
`
`
`Ol
`
`8BINNVOS
`
`
`
`Page 2
`
`

`

`U.S. Patent
`
`5,274,474
`
`
`
`
`
`30v383 INI HENNwos
`
`
`
`
`
`
`
`
`
`Page 3
`
`

`

`US. Patent
`
`Dec. 28, 1993
`
`Sheet 3 of 11
`
`5,274,474
`
`
`
`mmho<¢<zo
`
`mucouuo
`
`>m<zm.4
`
`KOkouhwo
`
`moo:
`
`w>.wowz
`
`,wz_4
`
`mzozl
`
`wu<u¢mkz.
`uzozanWFOh
`
`w2_4
`
`
`
`Am5:32.55.woos.
`
`
`
`moduzwbz_mmzz<um
`
`main.
`
`965“zoammmazomm
`u..m<~.zoouumz:_quill_
`
`
`
`czamuooma-muhz.5:»sz
`
`
`m<u¢<mwo<amw2_4
`
`8.225mMfififlWofi:zoifizuzomm
`
`mw<a,
`
`.
`
`_
`
`
`
`
`
`___"584$an__\8
`
`_“
`
`mzmho<m<zo$5535mu~5<z<_965.58%..33__lllllllllHill!L8
`
`muzz<om
`
`Jomkzou
`
`_______.___._____________J
`
`Page 4
`
`Page 4
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 4 of 11
`
`5,274,474
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`START
`
`SCAN PAGE INTO
`BIT - MAPPED IMAGE
`
`STANDARD
`OR HIGH-SPEED
`TRANSMISSION 2
`
`IO2
`STANDARD
`
`HIGH-SPEED
`PAGE SEGMENTATION
`SEPARATE PAGE. INTO
`LINES 8 GRAPHICS AREAS
`
`-- - - - - - - - - - - - - - - - -
`
`GRAPHICS
`
`CHARACTER SEPARATION
`SCAN CHARACTER AREAS FOR
`CHARACTER DATA
`
`CHARACTER
`DATA PRESENT 7
`
`PRINTOUT
`OK?
`
`
`
`MORE
`PAGES TO BE
`SCANNED
`
`
`
`Page 5
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 5 of 11
`
`-
`
`5,274,474
`
`
`
`
`
`
`
`SCAN PAGE INTO
`BIT- MAPPED IMAGE
`
`
`
`
`
`
`
`STANDARD
`OR HIGH - SPEED
`TRANSMISSION
`
`
`
`iOld
`|NSTRUCTIONS
`FROM RECEIVING
`FAx,USER OR PROTOCOL
`MEMORY
`
`STANDARD
`
`
`
`HIGH-SPEED
`PAGE SEGMENTATAON
`SEPARATE PAGE INTO He — — — — — — — — — — — — — — — —
`LINES 8 GRAPHICS AREAS
`
`LINES
`CHARACTER SEPARATION
`SCAN CHARACTER AREAS
`FOR CHARACTER DATA
`
`
`
`
`
`CHARACTER
`DATA ºnese:
`
`
`
`PLACE IN STANDARD
`FACSIMILE DATA FORMAT
`
`(OVERRIDE
`OLR)
`
`MERGE CHARACTER
`8 GRAPHICS INFO
`
`
`
`MONITOR OR PRINTOUT
`
`YES
`
`i
`
`COMPRESS DATA
`- - - - - - - - - - - STORE IN MEMORY
`
`PAGES TO ge SCANNEC
`
`N
`C ENDTD
`
`FIG. 40
`
`Page 6
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 6 of 11
`
`5,274,474
`
`83.1 N | Jd
`
`TOM_1 NOO
`
`
`
`BINOHid
`
`Page 7
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 7 of 11
`
`5,274,474
`
`READ DATA
`FROM MEMORY
`OR PHONE LINE
`
`CHARACTER
`DATA OR GRAPHICS
`DATA P
`
`CHARACTER
`
`GRAPHICS
`
`| 32
`
`SEND GRAPHICS
`|NFORMAT |ON
`TO PR NTER
`
`
`
`SEND CHARACTER
`|NFORMATION
`TO PR INTER
`
`|33
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`F | G. 6
`
`Page 8
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 8 of 11
`
`5,274,474
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`READ DATA
`FROM MEMORY
`OR PHONE LINE
`
`CHARACTER
`DATA OR GRAPHICS
`DATA P
`
`CHARACTER
`
`GRAPHICS
`
`|32
`
`SEND GRAPHICS
`|NFORMAT iON
`TO PRINTER
`
`SEND CHARACTER
`|NFORMAT ION
`TO PR NTER
`
`|33
`
`MERGE
`CHARACTER B,
`GRAPHICS
`| NFO
`
`
`
`
`
`Page 9
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 9 of 11
`
`5,274,474
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`RECEIVEE
`
`ANSWER
`TONE.
`RECEIVED
`
`HIGH-SPEED
`ACKNOWLEDGEMENT
`RECEIVED
`2
`
`
`
`
`
`
`
`
`
`SET HIGH-SPEED
`SEND MODE
`
`SEND STANDARD
`PROTOCOL. QUERY
`
`UPDATE
`Y
`STORE
`PROTOCOL
`PROTOCOL
`MEMORY ~ | NFO
`
`
`
`
`
`STANDARD
`ACKNOWLEDGEMEN
`RECEIVED
`2
`
`READ DATA
`AND SEND
`OVER PHONE LINE
`
`
`
`
`
`UPDATE
`PROTOCOL
`MEMORY
`
`STORE
`PROTOCOL
`INFO
`
`SET STANDARD
`FACSIMILE MODE
`
`
`
`LOCAL PRINT
`REQUIRED P
`
`
`
`PRINT DOCUMENT
`AS SCANNED
`
`Page 10
`
`

`

`U.S. Patent
`
`Dec.28, 1993
`
`Sheet 10 of 11
`
`5,274,474
`
`START
`
`SEND ANSWER TONE H-160
`
`L STEN FOR
`PROTOCOL TONE
`
`|6|
`
`|62
`TYPE OF
`PROTOCOL P STANDARD FACSIMILE
`
`HIGH-SPEED
`SEND HIGH-SPEED
`PROTOCOL. ACK
`
`SET H IGH-SPEED
`RECEIVE MODE
`
`SEND STANDARD
`FACSIM it E ACK
`
`SET STANDAND
`FACS IMILE MODE
`
`163
`
`I64
`
`
`
`
`
`
`
`
`
`READ DATA
`FROM PHONE
`Li NE
`
`|65
`
`STORE IN
`MEMORY
`
`PRINT
`
`(END)
`
`F | G.8
`
`Page 11
`
`

`

`U.S. Patent
`
`Dec. 28, 1993
`
`Sheet 11 of 11
`
`5,274,474
`
`START
`
`SEND ANSWER TONE F-1so
`
`L ISTEN FOR
`PROTOCOL TONE
`
`|6|
`
`|62
`TYPE OF
`PROTOCOL P STANDARD FACSIMILE
`
`HIGH-SPEED
`SEND HIGH-SPEED
`PROTOCOL. ACK
`
`SEND STANDARD
`fACSIMI LE ACK
`
`|63
`
`SET H IGH-SPEED
`RECE IVE MODE
`
`SET STANDAND
`FACS IMILE MODE
`
`!64
`
`READ DATA
`FROM PHONE
`Li NE
`
`|65
`
`STORE IN
`MEMORY
`
`PRINT
`
`
`
`
`
`
`
`(END)
`
`F | G.8
`
`Page 12
`
`

`

`1
`
`5,274,474
`
`INTEGRATED TELEFACSIMILE AND
`CHARACTER COMMUNICATION SYSTEM WITH
`STANDARD AND HIGH SPEED MODES
`
`15
`
`BACKGROUND OF THE INVENTION
`1. Field of the Invention
`This invention relates generally to telefacsimile ma
`chines and coding methods. More particularly, the in
`10
`vention relates to a telefacsimile machine having the
`ability to distinguish recognizable characters from un
`known graphics, and to transmit codes for the recogniz
`able characters with less data than that required by bit
`maps employed in known devices.
`2. Related Art
`-
`Known telefacsimile or fax machines scan a docu
`ment to produce pixel data. This pixel data is then com
`pressed and sent over communications media such as
`telephone lines to a receiving fax machine. A problem
`20
`with such telefacsimile machines is the lack of data
`compression for characters and the lack of efficient
`coding for character data.
`U.S. Pat. No. 4,410,916 issued to Pratt discloses a dual
`25
`mode telefacsimile compression technique, wherein
`spatially isolated black and white pixel patterns ex
`pected to recur in a document are extracted and coded
`by a matching process. A trial block area around a
`block pixel is examined to isolate symbols. Isolated
`30
`symbols are labeled and a set of measured features is
`used to build a library. Each symbol subsequently found
`in trial blocks of the scan is compared to the features of
`the blocks to eliminate unworthy symbols from a tem
`plate matching process If the matching error falls below
`35
`a threshold, the identification of the matching library
`number is stored for later coding. If no symbol is found
`within a trial block, the block is encoded as residue.
`using a modified relative address code and processed
`separately. The symbols' library identification codes
`and residue codes and the codes of unsuccessfully com
`pared symbols are transmitted to receivers. The special
`ized coding in Pratt is quite slow due to the need to
`perform extensive template matching for each charac
`ter. Pratt does not distinguish text from graphics, and
`45
`fails to provide flexible operation in other modes, such
`as transmission of bit maps, so that communication is
`only possible among similarly equipped units.
`U.S. Pat. No. 4,566,127 to Sekiya discloses a telefac
`simile having an optical character reader and a central
`processing unit which provide coding character infor
`mation and a telefacsimile mode. However, Sekiya is
`limited to operation with documents of a predetermined
`format in which character groups having predeter
`55
`mined attributes are disposed in a first location of the
`document and images having predetermined attributes
`are disposed in a predetermined second location
`U.S. Pat. No. 4,922,545 to Endo discloses a telefac
`simile image coding method in which an input image
`60
`pattern which occurs once is sequentially scanned and
`conventionally encoded. Patterns appearing twice or
`more, according to a matching pattern, are encoded by
`position coordinates and a library identification code is
`added at the time the pattern is registered in a library.
`65
`This system is primarily a handwriting recognition sys
`tem, and there is no provision for flexible operation
`with units not similarly equipped.
`
`50
`
`2
`SUMMARY OF THE INVENTION
`An objective of this invention is to provide a telefac
`simile system which transmits documents more quickly
`than previous systems and which provides a higher
`quality printout than previous systems.
`Another object of the invention is to provide a tele
`facsimile system which permits transmission of docu
`ments in either a high speed mode or a standard mode.
`A still further object of the invention is the transmis
`sion of documents in either a high speed mode or a
`standard mode directly or indirectly.
`A still further object of the invention is to provide a
`telefacsimile system which, while providing the above
`advantages when interfacing with other suitably
`equipped devices, is still compatible with the millions of
`conventional fax machines currently in use.
`A telefacsimile machine, according to this invention,
`has the capability of recognizing character areas on a
`document and graphics areas on a document. Character
`areas are then analyzed by an optical character recogni
`tion means to produce character codes for recognizable
`ASCII or the like. Both unrecognizable characters and
`areas of the document which are analyzed as graphics
`areas are coded according to standard telefacsimile
`methods. The document is then transmitted as a combi
`nation of character codes, such as ASCII codes, and
`standard telefacsimile codes. This results in a higher
`compression ratios for documents containing a number
`of recognizable characters and therefore allows reduc
`ing the transmission time of a document.
`A telefacsimile machine according to the invention
`may operate in either a standard telefacsimile mode or
`in the described high speed mode. A transmitting tele
`facsimile machine would typically query the receiving
`machine to recognize whether the receiving telefacsim
`ile machine can process the high speed mode containing
`character and telefacsimile data or whether the receiv
`ing machine can only process standard telefacsimile
`data. The transmitting machine may automatically
`switch modes between the described high speed mode
`or the standard telefacsimile mode according to
`whether the receiving machine can process the high
`speed mode. Therefore, a telefacsimile machine accord
`ing to this invention is compatible with existing telefac
`simile machines.
`In the high speed mode, since character codes, in
`ASCII or other defined character sets, are sent and then
`received by the receiving telefacsimile machine, charac-
`ters may be printed as fully formed characters rather
`than as low resolution pixel data. Therefore, documents
`sent over this improved telefacsimile system will be
`more legible in the character areas than documents sent
`by conventional telefacsimile machines.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a block diagram of a telefacsimile coding
`transmission and reception system.
`FIG. 2 is a typical conventional scanner interface.
`FIG. 3 is a scanner interface according to the inven
`tion.
`FIG. 4 is a flow chart of the operation of the scanner
`interface.
`FIG. 4a illustrates optional features and an alterna
`tive embodiment of the scanner interface.
`FIG. 5 is a block diagram of the printer interface.
`FIG. 6 is a flow chart of the operation of the printer
`interface.
`
`Page 13
`
`

`

`-
`
`transmission.
`
`5,274,474
`4
`3
`tionally, a page analyzer 50 may analyze a page of a
`FIG. 6a is a flow chart of another mode of operation
`of the printer interface.
`document or, alternatively, a section of a page, such as
`# to 4 of a page at a time and separates the document or
`FIG. 7 is a flow chart of the operation of document
`portion of the document into character areas and graph
`FIG. 7a illustrates the integration of optional features
`ics areas. Portions identified as character areas are sent
`to the optical character recognition block 60. Recogniz
`in FIG. 4a with an alternative method of document
`able characters are sent as character codes in ASCII or
`transmission.
`FIG. 8 is a flow chart of the operation of document
`the like to a compression block 70 to be further com
`reception.
`pressed and then sent to memory 14, or sent directly to
`transmit section 16 without intermediate storage in
`DETAILED DESCRIPTION OF THE
`memory 14. Unrecognizable pixel patterns and, option
`PREFERRED EMBODIMENTS
`ally, entire areas identified as graphics areas by the page
`analyzer 50, are sent to a graphics processing block 72
`FIG. 1 is a block diagram of a telefacsimile coding
`transmission and reception system. A scanner 10 con
`to be processed into a standard telefacsimile data format
`sent to the compressor 70, and then sent to memory 14,
`verts a document into bit-mapped pixels and sends them
`15
`through the scanner interface 12 to the memory 14 or
`or directly to transmit section 16 without intermediate
`storage in memory 14.
`directly to the transmit section 16. The scanner inter
`Inside the page analyzer 50 a page segmentation pro
`face 12 (otherwise referred to as a scanner control and
`data interface) controls the scanner 10 and processes the
`cessor 52 analyzes the pixels of the scanned page to
`identify interline spaces. Other methods of distinguish
`pixel data which is sent from the scanner 10 to the mem
`20
`ory 14 or sent directly to the transmit section 16. After
`ing character and non-character information may be
`used, as for example, segmentation of pages into sectors
`the pixel data has been processed by the scanner inter
`for analysis, comparison with predefined document
`face 12, the transmit section 16 sends this data through
`a phone line interface 18 and over a phone line 20 to a
`templates stored in memory, within the fax machine
`itself or in a computer peripheral to the fax assembly,
`receiving fax machine.
`25
`In the reception mode data comes in over the phone
`etc. Horizontal areas of low pixel density might indicate
`line 20 through a phone line interface 18 and is placed in
`spaces between lines of text if these horizontal lines are
`repetitive and evenly spaced. Horizontal spaces which
`memory 14 by the receiving block 22, or else is sent
`directly to the printer interface 24. Printer interface 24
`are not evenly spaced may indicate borders between
`reads this received data from memory 14, or directly
`graphics areas. Areas of low pixel density which run
`30
`from the receiving block 22 processes this data, and
`vertically may indicate spaces between columns of text
`sends it to a printer 26 to be printed as a received docu
`or graphics areas. Areas of a document which are tenta
`ment. A controller 28 containing, for example, a pro
`tively identified as containing character information by
`grammed microprocessor, sequences the operation of
`the page segmentation processor 52 are sent to block 54
`the telefacsimile machine.
`so that these character areas can be further identified
`35
`and mapped in preparation for optical character recog
`A conventional telefax scanner and telefax scanner
`interface is shown in FIG. 2. Scanner 30 converts the
`nition by block 60. Areas of a document which are
`tentatively identified by the page segmentation proces
`document into bit-mapped pixels which are fed through
`sor 52 as being composed of unrecognizable character,
`scanner control and data interface 32 to memory 33.
`This pixel data, coded in standard telefacsimile format
`non-characteror graphics information are sent to block
`by graphics processor 34, is compressed using standard
`56 to further map and identify these areas of the docu
`telefacsimile methods by compression block 36 and
`ment. The information is then sent to the graphics pro
`placed in memory 33 in preparation for transmission.
`cessing block 72 to be processed as standard telefacsim
`FIG. 3 is a block diagram of a telefax scanner inter
`ile data.
`face according to the present invention. The telefacsim
`Potential character data which is sent to the OCR
`45
`ile operates in either a standard or a high speed mode,
`block 60 is first analyzed by character separation block
`depending on the capability of the receiving fax ma
`62. Character separation block 62 separates a line into
`chine. A mode interrogator 90 has a mode query signal
`individual characters. These characters are then com
`generator 93 which transmits a mode query signal along
`pared against those contained in a character library 64
`line 91 to the receiving or destination fax machine, for
`which contains a set of standard ASCII characters or
`50
`example through multiplexer 92, and analyzes the re
`another or a variety of defined character sets. This is
`accomplished using well-known character recognition
`sponse. If detector 94 determines that the destination fax
`techniques which can identify a large variety of fonts
`has responded with a predetermined signal, the high
`speed mode is set by the transmitting fax. If the trans
`accurately. Characters which are positively identified
`mitting fax detects a signal other than the predeter
`are sent to the compression block 70 for further com
`55
`pression. Unrecognizable characters or graphics areas
`mined signal or if no response is detected within a pre
`are sent by the character separation block 62 to graphics
`determined time measured by timer 95, the transmitting
`processing block 72 to be coded as standard telefacsim
`fax sets the standard mode. A scanner 10 converts a
`document into pixel information under the control of a
`ile data. The standard telefacsimile data from 72 is also
`scanner interface 12 and places this data into memory
`sent to block 70 for further compression and to be con
`14. Optionally scanner interface 12 may analyze the
`catenated and/or merged with the compressed recog
`document separating it into character areas and graph
`nizable characters and placed into memory 14, or alter
`nately, this data may be sent directly to transmit section
`ics areas, code this information, compress this informa
`tion and place it back into memory 14. Alternatively,
`16.
`The scanner interface 12 operates efficiently by using
`the information could be provided directly to transmit
`standard character recognition and page segmentation
`section 16 without intermediate storage in memory 14.
`techniques. Repetitive matching techniques such as
`One portion of the scanner interface 12 is dedicated
`solely to scanner control as indicated in block 40. Op
`those described in U.S. Pat. Nos. 4,410,916 or 4,922,545
`
`10
`
`65
`
`Page 14
`
`

`

`15
`
`25
`
`5,274,474
`6
`5
`In another slightly different embodiment, the trans
`may also be used. The invention is, however, not limited
`mitting fax could maintain a preprogrammed or built up
`to any fixed algorithm or method for character recogni
`list of destination machine capabilities. For example,
`tion as it is envisioned that improved character recogni
`tion algorithms will be developed in the future which
`when a telefax number is dialed for the first time the
`would be equally applicable in performing the inven
`compatible format indicated by the destination machine
`tion. Even present day techniques offer high gains in
`could be stored and subsequent transmission to that
`coding efficiency over standard telefacsimile techniques
`destination provided in the indicated format without
`inquiry. Based on such stored protocol information (or
`thus allowing a telefacsimile page to be transmitted in
`on instructions from the receiving machine or the user),
`less time and, therefore, at less cost for telephone line
`as shown in step 101a, character and graphics informa
`usage then in a standard telefacsimile. Accurate recog
`10
`nition is important for correctly encoding and transmit
`tion may be merged (steps 101b and 101c)and sent to a
`receiver equipped to receive such information. How
`ting a document. Therefore, any characters which can
`ever, such a merge is preferrably implemented by the
`not be positively identified with a high degree of cer
`receiving machine during the printing process, as illus
`tainty by character separation block 62 are sent to block
`trated in FIG. 6a. As shown in step 101b, if the merge is
`72 to be processed as standard telefacsimile data.
`performed at the receiving machine, step 101c is
`FIG. 4 is a flow chart of the operation of the scanner
`bypssed. In addition, as shown in step 104c, information
`interface 12. In step 101 a page is scanned into a bit
`correctly formatted for printing or display can also be
`mapped image. In step 102 the scanner interface 12
`stored in a memory.
`decides whether the document is to be formatted for
`FIG. 5 is a block diagram of the printer interface 24.
`standard telefacsimile transmission or high speed trans
`20
`When a page or a portion of a page is to be printed, the
`mission. The determination is based on the capability of
`information is read from memory 14 or directly from
`the receiving fax machine. As previously discussed this
`the phone line, processed by the printer interface 24 and
`can be determined by transmitting a signal and looking
`for a predetermined response from the receiver. This
`sent to the printer 26. In the printer interface 24, the
`data from the memory or phone line 14 is decompressed
`can either be done in a brief querying telephone call
`or expanded in block 120, interpreted as character or
`which is disconnected prior to document processing, or
`else the line may be held open while processing begins
`graphics data in block 122, formatted as character codes
`immediately. Alternatively, a memory of stored proto
`or graphics codes for the printer in block 124, and sent
`through the printer control and data interface 126 to the
`col information relating to individual fax numbers might
`printer 26. By decoding character data codes, printer
`be consulted, either automatically, or manually by the
`interface 24 does not simply reproduce a received bit
`user, who would then input such information. If the
`map. Instead, printer interface 24 independently prints
`document is to be formatted for standard transmission,
`control passes to step 103 where the scanned pages of
`the character based on the coded information. One
`advantage which this printer interface 24 provides over
`the document are placed in a standard telefacsimile data
`other printer interfaces for telefacsimile machines is that
`format. This telefacsimile data is then compressed in
`35.
`character information may be printed at a higher resolu
`step 104. In step 105, the scanner interface 12 decides
`whether there are more pages to be scanned. If so, con
`tion. This is because a character which is scanned at 100
`trol is passed back to step 101.
`or 200 dots per inch and identified as, for instance, an A,
`If step 102 decides that a document is to be formatted
`is transmitted as the character code for an A in ASCII
`or the like. The printer interface 24 at the receiving end
`for high-speed transmission, control is passed to step
`40
`106. In the optional page segmentation of step 106, a
`recognizes this character code is the letter A. Since only
`page is separated into potential character areas or
`the character code is needed, the printer can be set to
`graphics areas. Areas that are to be encoded as graphics
`print at a different resolution, for instance 300 dots per
`are sent to step 103 for processing in standard telefac
`inch. Therefore, a document which is sent via this tele
`facsimile method and which is composed mainly of text
`simile data format. Areas which are to be processed as
`could be much more legible than a document sent via
`characters are sent to step 107 for character separation,
`whether page segmentation has been performed or not.
`conventional telefacsimile methods. In addition, lower
`resolution printing could be selected to speed the print
`In step 107 individual characters are isolated. A poten
`ing process.
`tial character is then processed in step 108 which de
`A flow chart of the operation of the printer interface
`cides whether an actual ASCII or other coded charac
`50
`is shown in FIG. 6. In step 130 the data to be printed is
`ter is present. If the isolated character does not match a
`read from memory directly or from the phone line.
`character in character library 64, it is sent to step 103
`Whether the information to be printed is either com
`where it is placed in standard telefacsimile data format.
`pressed character data or compressed graphics data is
`If the isolated character does match a character in the
`determined in step 131. If the information is compressed
`character library 64, then in step 109 a character code
`55
`for the identified character is placed in memory along
`character data, control passes to step 132, which ex
`pands the compressed character data. In step 133 this
`with the location of that character. This character data
`is then compressed in step 104. Step 105 decides
`character information is sent in the correct format to the
`printer. Step 134 determines whether the printing is
`whether there are more pages to be scanned and, if so,
`complete. If printing is incomplete control passes back
`control is passed back to step 101.
`60
`to step 130, where more data is read from memory or
`In FIG. 4a, a number of optional features and alterna
`the phone line.
`tive embodiments are illustrated. In one alterative em
`If step 131 processing determines that compressed
`bodiment the decision step 102 could be delayed and a
`graphics data has been read from memory, then this
`scanned document encoded and stored in a memory in
`compressed graphics information is decompressed or
`both the standard and high speed formats. Upon an
`65
`expanded in step 135. Control then passes to step 136
`indication from the receiving fax of its capability, trans
`mission could be performed in the corresponding for
`where the graphics information is formatted and sent to
`the printer. If document printing is not complete, con
`mat.
`
`30
`
`45
`
`Page 15
`
`

`

`5,274,474
`7
`8
`called from a memory of protocols of various fax num
`trol passes back to step 130. This process continues until
`the page or the document is printed.
`bers. However, it is preferable that even when a proto
`col memory is present, protocol queries are made with
`An alternate embodiment of the invention is illus
`every transmission. If any variance with protocol infor
`trated in FIG. 6a which is similar to that of FIG. 6 but
`includes a step 133a wherein a process module is em
`mation stored in memory is discovered, memory can be
`ployed to merge character and graphics data. The
`updated to reflect this new information. A method of
`verifying protocol and intergrating updates with a sys
`merged data is sent to the printer at step 133b. The
`merged data may be stored in a memory, such as a
`tem in which documents are scanned and preformatted
`printer memory, or routed directly to the printing appa
`(such as that shown in FIG. 4a) is shown in FIG. 7a.
`This is accomplished in steps 300-312. In step 300, in
`ratus in chunks of either 1 page, a fraction of a page, or
`10
`even in multi-page segments depending on the charac
`either the high or low speed modes, a preformatted
`teristics of the printer itself and its spooling capabilities.
`document taken from memory (step 304) is checked. If
`Information might also be routed to a spooler in the
`the document format is compatible, control passes to
`memory of a computer, and from there to printing appa
`step 148. If not, new compatible protocol information is
`ratus peripherally attached to the computer.
`stored (step 306). If this other protocol is already stored,
`15
`FIGS. 7 and 7a are flow charts of the operation of the
`it is selected (steps 308 and 312). If not, the reformatting
`telefacsimile machine according to the invention in the
`time may optionally be estimated in step 310. If refor
`matting time is long, or in an embodiment where step
`transmit mode. As mentioned earlier, one feature of this
`invention is that it can automatically switch between a
`310 is omitted, the process is terminated, while a rela
`tively short reformatting time results in executing the
`high-speed fax mode and a standard telefacsimile trans
`20
`mission mode. The phone number of the receiving fax is
`strategy beginning at step 101a, as shown in FIG. 4a.
`dialed in step 140. In step 201 (FIG. 7) or 200 (FIG. 7a),
`In step 148 the data to be sent is read from memory or
`if the system has a protocol memory for storing destina
`directly from the scanner interface and sent over the
`tion telefax protocols, the protocol memory can be
`phone line using either the high-speed mode or the
`checked. If a protocol memory is checked, and informa
`standard telefacsimile mode, depending on which mode
`25
`tion is present for the destination telefax machine, it is
`was previously set. The telefacsimile data is sent by step
`148 until the transmission is complete. At this point step
`determined if an answer is received from the destination
`machine (step 204). If the information is not present, the
`149 passes control to step 150 which determines if a
`number may be optionally entered in the protocol mem
`local printout of the transmitted document is required.
`ory (step 203 in FIG. 7a). If an answer is received in
`This feature allows an operator at a transmitting fax to
`30
`step 204, step 205 in FIG. 7a may be used to determine
`obtain a copy of the document that will actually be
`if the protocol is to be verified for some reason, such as
`printed at the receiving end so that it may be checked
`a periodic verification. If there is no protocol verifica
`for any possible errors in scanning and character recog
`tion option (FIG. 7), control may pass directly to step
`nition. If a local printout is required, then step 150
`148 as discussed below. If no protocol memory check
`passes control to step 151 where the document is
`takes place (steps 200 and 201) or the protocol for the
`printed as it was scanned and the transmission routine is
`number dialed is no