United States Patent
`Cotte et al.
`
`[19]
`
`[11] Patent Number:
`
`5,499,108
`
`[45] Date of Patent:
`
`Mar. 12, 1996
`
`lllllllllllllllllllllllllllllllllllll||l||lllllllllllllllllllllllllllllllll
`USOOS499108A
`
`[54] DOCUMENT-DRIVEN SCANNING INPUT
`DEVICE COMMUNICATING WITH A
`COMPUTER
`
`[75]
`
`Inventors: Pierre Cotte, Paris, France; Ronald C.
`Fish, Morgan Hill, Calif.
`
`[73] Assignee: Visioneer Communications, Inc., Palo
`Alto, Calif.
`
`[21] Appl. No.: 988,404
`
`[22]
`
`Filed:
`
`Dec. 9, 1992
`
`Related U.S. Application Data
`
`[63] Continuation-in-part of Ser. No. 922,169, Jul. 29, 1992.
`
`Int. Cl.6 .............................. H04N 1/00; G05B 13/02
`[51]
`[52] U.S. Cl.
`.......................... 358/400; 358/448; 358/498;
`364/181; 345/902
`[58] Field of Search ..................................... 358/400, 402,
`358/426, 439, 401, 444, 494, 496, 498,
`448; 364/181, 238.3, 241.2, 242.1, 927.99;
`345/902
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`D. 285,564
`
`9/1986 Bevilacqua et al. .
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`0159158 10/1985 European Pat. OE. .
`0358441
`3/1990 European Pat. OE. .
`0398185
`11/1990 European Pat. OE. .
`0426412
`5/1991
`European Pat. OE. .
`0478340
`4/1992 European Pat. OE. .
`0556067
`8/1993 European Pat. OE. .
`57—129578
`8/1982
`Japan .
`
`(List continued on next page.)
`
`Primary Examiner—Edward L. Coles, Sr.
`Assistant Examiner—Madeleine Nguyen
`Attorney, Agent, or Firm—Thomas A. Gallagher
`
`[57]
`
`p
`
`ABSTRACT
`
`An integral input/computer component combination is dis—
`closed wherein a input device may share a single data port
`on the host computer with a Fax modem and be mounted to
`a monitor, printer, keyboard etc. so as to have a small
`footprint. A pair of UARTS coupled to a a microprocessor in
`the input device implements a passthrough connection from
`the port of the input device coupled to the data port of the
`host to a data port of the input device coupled to the Fax
`modem whenever the input device using scanning technol—
`ogy is not in use. A relay makes the same passthrough
`connection whenever power is turned 0E to the input device.
`In one zero footprint embodiment, the input device input
`device has snap—in projections which are pushed into slots
`formed in the computer component housing to lock the input
`device into place. In another embodiment, the input device
`and computer component are mounted together by specially
`adapted brackets to adjust for differences in housing dimen—
`sions between the input device and the computer compo—
`nent. In some embodiments, the input device and computer
`component share a common element such as a paper tray. In
`other embodiments, the input device is completely enclosed
`by the computer component housing.
`In any of these
`embodiments, the input device and computer component can
`have separate power and data lines, or, alternatively, can
`share power and data lines such as by having the input
`device derive its power from the power supply of the
`computer component and time division multiplexing of the
`data cable of said computer component. In the preferred
`embodiment, the software of the input device can recognize
`special symbols placed on the document which represents
`commands the user desires to give to the host computer to
`control its operations to process the scanned image. In the
`preferred embodiment, these symbols are placed on the
`document with diEerent stickers, which may be diEerent for
`each command or which may be universal and contain boxes
`the user can darken to indicate the desired command and the
`
`parameters needed by the host carry out that command. In
`other embodiments, the symbols may be drawn or preprinted
`on the document to be scanned or printed on the document
`by software which stores diEerent graphic image symbols
`and which can print them on the document using a laser
`printer etc.
`
`50 Claims, 15 Drawing Sheets
`
`250
`
`
`
`HP 1011
`
`1
`
`

`

`5,499,108
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,019,916
`5,021,640
`5,038,158
`5,060,135
`5,062,058
`5,062,136
`5,072,923
`5,115,326
`5,191,622
`5,199,063
`5,208,873
`5,216,517
`5,227,893
`5,235,674
`5,243,437
`5,245,446
`5,267,058
`5,267,059
`5,267,303
`5,282,052
`5,289,570
`5,325,297
`5,332,207
`5,420,697
`
`5/ 1991
`6/ 1991
`8/1991
`10/1991
`10/1991
`10/1991
`12/1991
`5/ 1992
`3/ 1993
`3/ 1993
`5/1993
`6/1993
`7/ 1993
`8/ 1993
`9/1993
`9/1993
`11/1993
`11/1993
`11/1993
`1/ 1994
`2/ 1994
`6/ 1994
`7/ 1994
`5/ 1995
`
`Ogura ...................................... 358/401
`Muroi ...................................... 235/462
`Ayers et a1.
`.......................... 346/1531
`Levine et a1.
`395/155
`
`Morikawa ............................... 395/131
`Gattis et al.
`............................ 358/426
`Coy ................
`271/110.
`
`......................... 358/440
`Burgess et al.
`Shojima et a1.
`........................ 382/185
`Erickson et a1.
`358/400
`
`Nakajima ................................ 382/282
`...................... 358/400
`Kinoshita et a1.
`Ett ..........................
`358/400
`
`Cohen—Skalli et al.
`395/101
`Millman et al.
`358/400
`Takayanagi
`.
`358/400
`Sata ................
`358/498
`
`Kawabata et al.
`...................... 358/498
`......................... 358/468
`Johnson et al.
`Johnson et a1.
`.
`358/402
`Suzuki
`........
`358/452
`
`.......................... 364/419.07
`Bird et a1.
`Oonishi et a1.
`......................... 271/110
`Tuli
`......................................... 358/472
`
`
`
`FOREIGN PATENT DOCUMENTS
`
`0250430
`62-183255
`03013052
`WO9110969
`W09203884
`WO9207440
`
`12/1985
`8/1987
`1/1991
`7/1991
`3/1992
`4/1992
`
`Japan .
`Japan .
`Japan .
`WIPO .
`WIPO .
`WIPO .
`
`
`
`
`
`7/1977 Kashio .................................... 235/433
`4,034,209
`8/1977 Caldwell
`.......
`355/76
`4,043,665
`
`1/1979 Gauronski et al.
`271/245
`4,132,401
`......
`235/454
`6/1980 Burns et al.
`4,205,780
`
`8/1981 Pembroke ............................... 235/375
`4,283,621
`4/1982 Carpenter ................................ 235/473
`4,323,773
`4,410,945 10/1983 Merdan .....
`. 382/182
`
`4,415,981
`11/1983 Cutter et al.
`395/106
`..
`4,504,969
`3/1985 Suzuki et al.
`........................... 382/175
`4,525,788
`6/1985 Gottlieb et a1.
`......................... 364/478
`4,548,401
`10/1985 Nishikawa ........
`271/265.01
`4,558,373 12/1985 Plasencia et al
`358/484
`4,563,706
`1/1986 Nagashima
`. 358/444
`4,574,395
`3/1986 Kato ..............
`. 382/306
`4,631,598 12/1986 Burkhardt et al.
`358/425
`4,680,674
`7/1987 Moore ...........
`. 361/686
`
`4,743,974
`5/1988 Lockwood
`. 358/494
`4,760,458
`7/1988 Watanabe etal.
`358/452
`4,760,606
`7/1988 Lesnick et a1.
`382/306
`
`4,770,403
`7/1988 Akio ..............
`. 271/110
`4,802,204
`1/1989 Chang .......
`. 358/400
`4,815,029
`3/1989 Barker et al.
`395/146
`4,860,112
`8/1989 Nichols et a1.
`358/400
`4,868,672
`9/1989 Hiroki etal.
`358/494
`.
`4,885,704 12/1989 Takagiet al.
`345/166
`
`4,918,540
`4/1990 Ohtani ...........
`358/429
`4,918,588
`4/1990 Barrett et a1.
`.....
`395/600
`6/1990 Wanninger et al.
`4,937,439
`235/456
`
`4,944,031
`7/1990 Yoshino ........
`. 355/206
`11/1990 Burkhardt et al.
`4,972,273
`358/443
`
`.................
`4,982,293
`1/1991 Ishii
`358/429
`
`...................... 379/100
`4,996,707
`2/1991 O’Malley et a1.
`
`.
`
`
`
`2
`
`

`

`US. Patent
`
`A Mar. 12, 1996
`
`Sheet 1 of 15
`
`5,499,108
`
` \\\\\\\\\\\\‘
`
`FIG.
`
`1
`
`FIG. 2
`
`FIG. 3
`
`3
`
`

`

`U.S. Patent
`
`Mar. 12, 1996
`
`Sheet 2 of 15
`
`5,499,108
`
`
`
`4
`
`

`

`U.S. Patent
`
`Mar. 12, 1996
`
`Sheet 3 of 15
`
`5,499,108
`
` INPUT DEVICE
`
`SCANNER
`
` REMOTE
`
`FAX
`
`
`
`MACHINE/
`MODEM
`
`120
`
` Z180
`
`MICROPROC ESSOR
`
`
`
`
`| I i l l
`
`: | I
`
`INPUT
`DEVICE
`PWR
`SWITCH
`
`|
`l
`l
`
`5
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 4 of 15
`
`5,499,108
`
`
`
`
`
`IS INPUT
`DEVICE INACTIVE?
`
`YES
`
`
`
`$51232
`
`LOOP
`
`
`
`
`133
`SEND PROGRAM
`DATA TO UARTS
`
`TO PROGRAM THEM
`TO AUTOMATICALLY
`FORWARD DATA TO
`EACH OTHER
`
`
`
`
`
`
`FIG. 11B
`
`
` RECEIVE INTERRUPT
`
`INDICATING INPUT
`
`
`DEVICE HAS SENSED
`A DOCUMENT HAS
`
`
`
`
`
`
`137
`
`BEEN INSERTED FOR
`
`SCANNING
`
`
`
`141
`
`IS lNTER-UART DATA YES
`PATH BUSY?
`
`
`
`REJECT DOCUMENT OR
`SCAN AND STORE DATA
`
`143
`
`RETURN TO MAIN LOOP
`
`SEND PROGRAM DATA TO
`UARTS TO PROGRAM THEM
`
`TO STOP FORWARDING DATA
`TO EACH OTHER AND START
`TRANSMITTING DATA DERIVED
`FROM THE SCAN DATA RECEIVED
`
`FROM THE INPUT DEVICE
`MICROPROCESSOR TO THE
`APPROPRIATE DEVICE
`
`
`
`
`
`
`
`
`
`
`
` FIG. 11C
`
`6
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 5 of 15
`
`5,499,108
`
`250
`
`240
`
`242
`
`
` VECTOR PROCESSING
`TO APPROPRIATE
`
`
`
`PAPER
`ENSORS
`SENSE AN
`
`230
`
`
`
`
`
`
`
`
`232
`
`234
`
`236
`
`238
`
`SEND INTERRUPT
`
`TO HOST
`
`SCAN DATA FROM
`
`INPUT DOCUMENT
`
`TRANSMIT DATA
`OVER CABLE TO
`
`
`
`HOST COMPUTER
`
`WAIT FOR NEXT
`INPUT DOCUMENT
`
`
`
`INTERRUPT SERVICE
`ROUTINE
`
`244
`
`
`
`READ INCOMING DATA
`
`
`
`FROM INPUT PORT
`COUPLED TO INPUT
`
`
`
`
`246
`
`STORE DATA IN A FILE
`
`
`
`248
`
`
`
`
`
`
`RECOGNIZE COMMAND(S)
`REGARDING WHAT IS TO
`BE DONE WITH INCOMING
`DATA
`
`
` INVOKE APPROPRIATE
`HOST SOFTWARE
`
`
`
`
`
`PACKAGE, TELL IT WHAT
`TO DO WITH THE DATA AND
`PASS POINTER TO FILE
`
`FIG. 13A
`
`FIG. 13B
`
`7
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 6 of 15
`
`5,499,108
`
`235
`
`‘MMMMMMWMMfl-Ifl"MMMMMMIIIIIMMfl-MMMI
`
`lllllllllllllfllllllllmlllm“MMMMMIIIIMIIMMMMMMI
`
`
`nummmmumummmmmmmwummmmnm
`Immmmmmmuumummmmmummnm
`
`
`Imummmummummmummmmunm
`
`
`Immumummmmmmmmmmmmmmn
`
`IMMMMMMHMMMMMMMMMMMMMHI
`
`wummmummmmmummmuumnnul
`
`wummmummmmumummumnmul
`
`mmmmumumumumuwummmumnm -
`IMMMMMMWMMHWUWWHMMMI
`
`IWMMMMMMHMMMMMMWWMH
`
`mun-Mmummmmmuiluumummnumuumt
`
`IMMMMMMMMMWMMMMWMMMMMI
`
`IMMMMMMWMMMMMMMMMMMMHI
`
`”MMMMMWMHWMMMMMMMMMMHI
`241
`
`smummnmummmI-mmmmumumnm
`
`IMHMMMMMMMWMMMMWMMMMH
`
`IMHMMMMM“MMMUMMMMMMMHMMHMMI
`
`"IllMMMMMMMIIMMIIMMMMMMMIIMMMMM.
`
`IMMWMMMMMfl-mfl-MMMMMHHMMMMMIII"
`
`
`IMMMMMMMMMHMMHWMMMMMMMHMMM!
`IMMMMMMMMMMWMMMWuMMM“"MIDI"!
`
`
`IM"MMMMHMMHMMMMHHMMMIIMMMMMIII"
`
`"I'll-IllMMMMMMMMMMMMMMMMMMMMMMMI
`
`
`ImmumummmmmmmmmMMMMMMMMMMM
`
`tummmmmmmmmmmmummumur
`
`IMMMMWMMMMWMMWMWMMMMWI
`
`IMMMMMMMMMMMMMMMMMMMMMP
`
`'MMMMMMMMMHMMMMHMUMMW"Mull"
`Immmummmmmmmummummmmmumn
`
`
`"IllMMMMMMMWMMMMWMMMMMMMMMF
`IMMMMMHMMMMMMMMMMMMM“MMMMMMMF
`
`l"MMMMMMMMMMMMMMMMMMMMMMMMMI’
`
`
`
`243
`
`FIG. 14
`
`8
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 7 of 15
`
`5,499,108
`
`
`
`-"
`
`243
`
`
`
`245
`
`I
`
`
`I
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`nmmmumummnm
`.HMWMMMWWWM .
`mmnmnmmmu
`mmmmummmmmmr
`mmmmuuummumumn:
`UWWMWMMMWWMWMMMMM
`Muumuwummmuumummmumumn
`
`
`
`FIG. 15
`
`FOR EACH PIXEL OF
`
` RECEIVE 6 - 8 BIT DATA
`
`
`
`COMPRESS BLACK AND
`SCANNED DATA
`
`WHITE DATA PRIOR
`(256 GRAY LVLS)
`
`
`
`TO TRANSMISSION
`
`
`
`SELECT BLACK/WHITE
`268
`
`DISCRIMINATION
`
`
`TRANSMIT DATA
`THRESHOLD
`
`
`
`
` CONVERT EACH PIXEL
`
`GRAY LEVEL VALUE
`
`
`TO A BLACK OR
`
`
`WHITE LEVEL
`
`
`
`9
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 8 of 15
`
`5,499,108
`
`IMMMMMM
`‘MMMMMW
`
`IMMHMWMWMHMUMMBDMMWMMMMM
`unannouuuuuouunuuMuunuuuunumumummu
`
`243
`
`245 a FAX ——> DENIS
`
`247
`
`.SASEWSN
`
`i" +PIERRE - ALAIN
`nmuumummmuumm
`mummnmummumrauraaamumwm
`”MUMWMW
`mum
`mummummmmmnfluuumn
`
`.LOEPOHd.NI38013
`LINK TO HOST
`
`I I I
`
`I
`I
`
`I I I
`
`278
`
`TRANSMIT OVER
`HIGH SPEED, HIGH
`BANDWIDTH LINK
`TO HOST
`
`10
`
`TRANSMIT COM-
`PRESSED DATA
`OVER HIGH SPEED
`
`10
`
`

`

`US. Patent
`
`I
`
`Mar. 12, 1996
`
`Sheet 9 of 15
`
`5,499,108
`
`Incoming Pages
`
`@261 @259 I257 I255 .453
`
`Archive
`
`Clipboard
`
`Photocopy
`
`co: Mail
`
`Fax
`
`E
`
`{a
`Status: idle
`
`Pages: 2
`
`f
`
`E
`
`FIG. 17
`
`11
`
`11
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 10 of 15
`
`5,499,108
`
`PAPER SENSORS a
`
`SENSE PAPER
`INPUT?
`
`‘3 V
`
`
`
`SCAN GRAY SCALE
`PIXEL DATA FROM
`
`
`
`DOCUMENT (AND
`STORE)
`
`
`
`
`SELECT GRAY
`SCALE TO BLACK
`
`
`
`AND WHITE
`CONVERSION
`THRESHOLD
`
`
`
`
`
`
`
`
`
`
`
` CONVERT GRAY
`SCALE PIXEL
`
`DATA TO BLACK
`AND WHITE DATA
`
`
`RECEIVE MESSAGE FROM
`
`INPUT DEVICE AND BEGIN
`READING. DECOMPRESSING,
`AND STORING INCOMING
`BLACK AND WHITE DATA
`
`DISPLAY POP-UP WINDOW
`~ WITH MENU OPTIONS
`
`REGARDING WHAT TO DO
`WITH DATA
`
`READ USER SELECTION
`REGARDING WHAT TO DO
`
`WITH INCOMING DATA
`
`
`
`ISSUE APPROPRIATE
`
`COMMANDS TO INVOKE
`HOST SOFTWARE
`SELECTED BY USER TO
`
`PROCESS THE INCOMING
`
`DATA AND PASS THE
`
`INCOMING DATA TO THAT
`SOFTWARE
`
`PROMPT THE USER FOR
`
`OR READ APPROPRIATE
`AUXILIARY OR ATTRIBUTE
`
`DATA AND PASS THIS
`DATA TO INVOKED
`
`SOFTWARE
`
`280
`
`282
`
`284
`
`286
`
`288
`
`290
`
`292
`
`
`
`
`
`
`
`
`
`
`
`
`
`COMPRESS BLACK
`AND WHITE DATA
`
`PRIOR TO TRANS-
`MISSION USING
`
`FAX GROUP III
`OR FAX GROUP 11
`COMPRESSION
`ALGORITHM
`
`
`
`TRANSMIT COMPRESSED
`DATA VIA R5232
`
`PROTOCOL
`
`FIG. 21A
`
`FIG. 21B
`
`12
`
`12
`
`

`

`US. Patent
`
`Mar.12,1996
`
`Sheet 11 of 15
`
`5,499,108
`
`
`
`320
`322
`
`312
`
`310
`
`.
`
`314
`
`FIG. 22
`
`START
`
`
`
`
`HAS PHOTOCOPY E
`
`
`BUTTON BEEN
`
`PUSHED?
`
`TURN ON LED AND
`
`-
`
`
`
`BUTTON WAS PUSHED
`
`
`
`
`PROMPT USER FOR
`DESIRED NUMBER
`
`OF COPIES
`
`
`STORE NUMBER
`OF TIMES COPY
`
`
`
`SCAN IMAGE OF
`
`DOCUMENT
`
`SEND IMAGE DATA
`
`TO LASER PRINTER
`
`HAS TIMEOUT
`
`LAST DOCUMENT
`
`ARRIVAL?
`
`
`
`
`
`
`OCCURED FROM
`
`
`
`NEW DOCUMENT
`INSERTED?
`
`NO
`
`334
`
`TURN OFF LED AND
`RESUME NORMAL
`INPUT DEVICE MODE
`
`
`
`
`
`
`
`332
`
`FIG. 23
`
`13
`
`13
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 12 of 15
`
`5,499,108
`
`HAS FRONT
`
`AUXILIARY DATA OR READ
`
`AUXILIARY DATA
`SYMBOLS FROM
`DOCUMENT BEING
`
`
`
`
`PROMPT USER FOR
`PANEL BUTTON
`ANY NECESSARY
`
`
`
`BEEN PUSHED?
`
`
` SEND MESSAGE
`
`
`SCANNED
`
`
`HOST RESISDENT
`
`SOFTWARE THAT
`FRONT PANEL
`
`TO INPUT DEVICE
`
`BUTTON HAS BEEN
`
`PUSHED & SCAN DOC
`
`
`
`
`
`
`INPUT DEVICE HOST
`.
`RESIDENT SOFTWARE
`
`
`
`CHECKS CONFIGURATION
`
`PREFERENCES FILE
`
`
`
`
`
`FOR BUTTON SCRIPT
`
`AND RECEIVES SCAN DATA
`
`
`
`EXECUTES SCRIPT
`
`COMMANDS TO INVOKE
`
`APPROPRIATE HOST
`
`RESIDENT SOFTWARE
`
`
`INPUT DEVICE HOST
`RESIDENT SOFTWARE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`AND CAUSE SAME
`
`TO PROCESS THE
`
`SCANNED IMAGE
`
`
`
`ACCORDING TO SCRIPT
`
`
`
`FIG. 24
`
`14
`
`14
`
`

`

`US. Patent
`
`B
`
`%w
`
`hS
`
`m
`
`5,499,108
`
`wNmm
`
`
`
`a2%who.Mmémmm
`
`u«mun—3m
`
`Ohm
`
`M.mungmmxubj,._.m<:
`
`
`
`0mmmZOEmmmmmmhw4m._._<m<n_HmOmme
`mam.—
`
`
`
`#mm
`
`0mmmm>ED
`
`mOFOE
`
`.vmm
`
`mm>EO
`
`.EOm
`
`mm.OE
`
`mam<._.<O
`
`vn
`m
`
`Nm
`m
`
`mmemUOEOmQ—zO...
`o\<mIImhm
`A8me
`
`mnm
`
`mm,
`
`ummmmm
`
`Em
`
`20.5558
`
`2%
`
`mmm
`
`mmNmm
`
`Eu
`
`15
`
`15
`
`
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 14 of 15
`
`5,499,108
`
`FAX
`
`HOTZONE
`
` 406
`
`402
`
`400
`
`404
`
`
`WW FIG. 26
`
`
`
`406
`
`
`
`400
`
`
`
`404
`
`FIG. 27
`
`FAX
`
`OCR
`
`408
`E-MAIL ° ° -
`
`‘
`
`
` L: E El
`
`
`
`FIG.28
`
`16
`
`16
`
`

`

`US. Patent ‘
`
`V
`
`Mar. 12, 1996
`
`Sheet 15 of 15
`
`5,499,108
`
`
`
`
`
`
`
`4“
`
`FIG. 29
`
`FAX IT!
`
`RECIPIENT'S LAST NAME
`EEIIIIIII
`AAA...
`nun
`83:
`CEI
`D
`3
`Eggs
`S:
`E.
`
`4—413
`
`T '
`
`2'
`
`\AAAAAAAAAAAAAAAAAAAI‘
`
`0 WNW
`
`.0
`
`FAX
`
`E]
`
`PHOTOCOPY
`
`E-MAIL
`
`, E]
`
`E 41;; '
`
`412
`
`ATTRIBUTES K‘—
`
`AAAAAAAAAAAAAAAAAAAA;
`
`\AAAAAAAAAAAAAAAAAAA!
`
`400
`
`FIG. 30
`
`17
`
`17
`
`

`

`5,499,108
`
`2
`
`1
`DOCUNIENT-DRIVEN SCANNING INPUT
`DEVICE CONIMUNICATING WITH A
`COMPUTER
`
`.
`
`BACKGROUND OF THE INVENTION
`
`workstation to improve productivity. Because of the need to
`have various documents, files, books, etc. on the desk or
`work station surfaces with all of these personal productivity
`tools, working space on these surfaces is at a premium. Such
`considerations have led to “tower” designs for some per-
`sonal computers where the CPU unit can sit on the floor
`under a workstation and small footprint designs for other
`computers such as the original MacintoshTM personal com-
`puter designed to sit on top of a desk.
`An input device using scanning technology is a very
`useful
`tool
`in today’s environment. For example,
`in a
`contract negotiation, very frequently a written contract
`needs to be revised or new proposed terms need to be added
`by a person other than the person who originally wrote the
`contract. If the two people involved do not have compatible
`word processors, an input device using scanning technology
`allows one peon to send the draft and handwritten annota-
`tions to the other person for storage in his personal computer
`and possible revision.
`Because an input device using scanning technology is a
`personal productivity tool which will probably begin to
`appear more frequently on individual employee work sta—
`tions, a need has arisen for a input device using scanning
`technology with a small footprint to save space on already
`crowded surfaces for other productivity tools.
`
`SUlVIMARY OF THE INVENTION
`
`there is
`According to the teachings of the invention,
`disclosed an input device using scarming technology which
`is smart enough to share with another peripheral a single
`serial or parallel port thereby eliminating the need for a
`switch or a new driver circuit card to be installed in the host.
`In some embodiments,
`the input device using scanning
`technology has a zero footprint of space consumed on the
`surface of a workstation. The advantage of zero footprint is
`achieved by at least physical integration of the paper input
`device with another component of a host computer such as
`a monitor, keyboard, CPU, printer, etc.
`As the term in used herein, an “paper input device” is a
`computer peripheral which senses the insertion of a docu-
`ment to be scanned, initiates a host computer process, i.e.,
`controls the host process by insertion of the paper and
`symbols on the paper, scans the images and text on the paper,
`provides immediate user interface feedback while sending
`the scanned data to the host for further electronic processing
`such as display, transmission, storage or modification. Prin—
`cipally, this new technology is a paper input device using
`scanning technology which controls the host computer
`rather than the other way around, the latter being what is
`taught in the prior art. With such an input device, paper
`based computing is possible.
`the input device using
`In the preferred embodiment,
`scanning technology includes a scanning mechanism. Spe-
`cial software in the input device compresses the scanned
`data, sends the scanned data to the host and automatically
`carries out the desired processing either by receiving a
`command from the user by manual pointing to menu selec-
`tions presented to the user by the software or by automatic
`recognition of preprinted or hand drawn symbols on the
`document being scanned. Sharing of a single port of the host
`computer is accomplished by the software of the input
`device using scanning technology in implementing a
`passthrough connection to the other peripheral when the
`input device is not in use. In other words, the input device
`using scanning technology has its data cable plugged into
`
`This is a continuation-in-part of US. patent application
`serial number 07/922,169, filed Jul. 29, 1992 entitled COM-
`PUTER INPUT DEVICE USING PAPER INPUT DEVICE
`TECHNOLOGY FOR PAPER BASED COMPUTING. The
`
`invention pertains generally to the field of office equipment,
`and, more specifically,
`to the field of input devices for
`computer systems where a single serial port can be shared by
`the input device and by a FAX modern. In some embodi-
`ments, the input device is a low footprint scanning device
`which is mounted either by clips or permanently integrated
`into other peripherals for use with computer systems such as
`a monitor, keyboard etc.
`In today’s computing environment, simplicity is of
`increasing importance to users especially users who are
`unskilled in computer technology and who are not comfort-
`able with the notion of having to modify their computers to
`adapt them to new technology. Many computers, especially
`Macintosh personal computers have only one R8232 port for
`use modems, serial printers, FAX modems or other serial
`devices. Thus, when a new serial device is added, it is
`necessary to multiplex the serial port manually with a switch
`or add a card to the computer to add another serial port. The
`foregoing discussion is equally applicable to parallel ports as
`those skilled in the art will appreciate. However, the need to
`physically switch the port to the other peripheral device is
`inconvenient, and if the user forgets to operate the switch,
`his or her software will generate an error message which
`may confuse and frustrate the user. Likewise the prospect of
`having to open the computer case and add a peripheral card
`is unpleasant to the technically unsophisticated user.
`There are many applications of computer technology
`where having an input device which can scan images or text
`into a computer and automatically do something with the
`image such as perform electronic storage, electronic anno—
`tation, FAX the image or perform optical character recog—
`nition etc. This type of input device supports a growing trend
`called paper based computing. To add such a device to an
`existing computer system will often result in creating a
`problem for a user by presenting the user with two periph-
`erals and two data cables that need to be plugged into the
`host computer but only one port into which to plug the
`cables. The user is then faced with the problem of either
`making the connection to the port to be shared through a
`switch or multiplexer to which both peripherals are coupled
`and which has a single output for coupling to the port to be
`shared or adding a card to the computer. Either option is
`inconvient and can be intimidating for less sophisticated
`users.
`
`Therefore, a need has arisen for a smart input device using
`scanning technology which can share a single port on the
`host computer.
`Another problem in today’s computing environment with
`growing numbers of peripherals competing for space. Desk
`space is at a premium today as it is generally fixed in size
`while the number of personal productivity devices such as
`personal computers, FAX machines, paper input devices,
`printers, plotters, mice, mouse pads, calculators etc. contin-
`ues to rise. The proliferation of these devices and their
`continually falling cost has caused a trend for more and more
`of such equipment to be placed at each individual employees
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`18
`
`18
`
`

`

`3
`
`4
`
`5,499,108
`
`the port of the host computer to be shared. The other
`peripheral such as a FAX modem etc. which must also be
`plugged into the same port is plugged into an appropriate
`connector of the input device. The software of the input
`device using scanning technology then passes any data from
`the other peripheral to the host or vice versa through a
`passthrough data path when the input device is not active.
`When the input device is active, the data path through the
`input device to the other peripheral is cut, and is taken over
`by the input device using scanning technology so that the
`compressed scanned data and commands may be sent to the
`host computer.
`In some low or zero footprint embodiments, the input
`device using scanning technology is physically integrated
`with another computer component such as a computer
`monitor or CPU housing in any of several ways such that the
`input device does not have its own footprint but shares the
`footprint of the device to which it is attached. The input
`device using scanning technology may be plugged into
`specifically formed slots in the housing of the monitor,
`keyboard etc. by way of special pegs or legs extending from
`the paper input device chassis. Second, the input device
`using scanning technology can be physically mounted to the
`monitor, keyboard, etc. by mechanical adapters which are
`specially designed to be attached to both a surface of the
`input device and a surface of the monitor, keyboard, etc.
`This allows the monitor or keyboard to be used without
`being modified and allows upgrading to new monitors etc. A
`third way of mounting the input device using scanning
`technology is a partial inclusion option where the paper
`input device is mounted to, for example, a monitor, by any
`of the methods described above, and where some portion of
`the input device structure such as the paper receptacle is
`integrally formed as part of the housing of the monitor,
`keyboard, etc. This allows upgrading to different monitors
`etc. without buying a new input device. The final option is
`a full integration version where the electronics of the input
`device using scanning technology are enclosed within the
`housing of the monitor etc. The housing of the monitor etc.
`is modified in this option to have a slot through which papers
`to be scanned may be fed. The paper receptacle to received
`the papers after they have been scanned is also integrated
`into the housing of the monitor keyboard etc.
`In each of the embodiments described above, the power
`and data connections for the input device using scanning
`technology can be made through the monitor, keyboard, etc.
`In other words, power to the paper input device can be
`through a connection to the power supply of the monitor,
`CPU, or through a connection from the keyboard to the CPU
`as part of the normal cable connecting the keyboard to the
`CPU. Likewise, the data output of the paper input device to
`the CPU may also, in some embodiments, be made through
`the cable connecting the monitor, keyboard, printer, etc. to
`the CPU using the serial or parallel port on the computer.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is and exploded perspective view of a paper input
`device and computer monitor combination with zero foot-
`print for the paper input device.
`FIG. 2 is a perspective view of a combination monitor/
`paper input device with integral, mating electrical connec-
`tions for power and data between the paper input device and
`the monitor and a single set of shared power and data cables.
`FIG. 3 shows a perspective view of an integral paper input
`device/keyboard combination.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`4o
`
`45
`
`50
`
`55
`
`6O
`
`65
`
`FIG. 4 shows a typical snap—in connection arrangement to
`mount the paper input device to any computer component.
`FIG. 5 shows a bolt-on mounting arrangement to mount
`the paper input device to the computer component.
`FIG. 6 shows a front elevation view of a monitor with a
`paper input device mounted thereon by specifically adapted
`mounting brackets.
`FIG. 7 shows an embodiment wherein a paper input
`device and a computer component share a common element.
`FIG. 8 is a perspective view of a monitor with a paper
`input device completely enclosed therein.
`FIG. 9 shows and an embodiment for sharing a common
`element such as a paper tray between a paper input device
`and a laser printer.
`FIG. 10 shows a block diagram of the connections
`between the input device paper input device and a host and
`Fax modem for a passthrough connection.
`FIG. 11A shows a block diagram of the electronics of the
`input device using scanning technology to carry out the
`passthrough connection to allow the input device and Fax
`modem to share the same computer port.
`FIGS. 11B and 11C are flow diagrams of the software
`executed by the microprocessor of the input device to
`manage the “passthrough” connection from the host
`to
`another peripheral so that the input device can share a single
`data port with, for example, a Fax modem.
`FIG. 12 is a block diagram of a computer system using an
`input device.
`FIGS. 13A and 13B are flow charts representing, respec-
`tively, processing by the input device and the input device
`software resident on the host for the preferred embodiment
`of one type of an input device in which the teachings of the
`invention may be employed.
`FIG. 14 is a drawing of a typical input document using
`predefined command symbols and predefined auxiliary sym-
`bols located in a hot zone.
`
`FIG. 15 is a drawing of a typical input document using
`hand drawn command symbols and hand drawn auxiliary
`symbols that the input device must be trained to recognize,
`the symbols being located in a hot zone.
`FIG. 16 is a drawing of a typical input document using
`hand drawing command symbols and hand drawn auxiliary
`symbols located outside the hot zone or in hot zones not
`located at the top of the paper.
`FIG. 17 is a drawing of a typical pop-up window with
`menu options displayed therein, said menu option being
`determined by the input device software based upon the
`software which exists on the host machine.
`
`FIG. 18 is a flow chart of a process carried out by the
`preferred embodiment of the input device for converting
`gray scale pixel data to black and white data, compressing
`the data and transmitting it to the host for decompression and
`use or storage.
`FIG. 19 is a flow chart of the process of compressing gray
`scale scanned data and transmitting it over a high speed link
`to the host.
`
`FIG. 20 is a flow chart of the process of scanning gray
`scale data and transmitting it directly without compression
`from the input device to the host computer over a high speed,
`high bandwidth link.
`FIG. 21A is a flow chart of processing by the input device
`software resident in the paper input device and FIG. 213 is
`a flow chart of processing by the input device software
`resident on the host computer to implement the preferred
`embodiment according to the teachings of the invention.
`
`19
`
`19
`
`

`

`5
`
`6
`
`5,499,108
`
`FIG. 22 is a diagram of the front panel of an input device
`that implements a photocopy auxiliary function.
`FIG. 23 is a flow chart of processing by input device
`software resident in both the paper input device and the host
`to implement a photocopy option in addition to or in lieu of
`the other processing previously described herein.
`FIG. 24 is a flow chart of the processing for executing a
`set of scripted commands with which the front panel button
`on the input device has been programmed to cause prede-
`termined processing by the host computer.
`FIG. 25 is a block diagram of the electronic circuitry in
`the input device scanning mechanism.
`FIG. 26 is a drawing of a command sticker for a FAX
`command to the input device with an external hot zone, said
`sticker to be placed on a document to be scanned and thereby
`causing the scanned image to be FAXed to whatever desti-
`nation is identified by symbols written in the hot zone.
`FIG. 27 is a drawing of a command sticker for a FAX
`command to the input device with an internal hot zone in
`which the symbols identifying the destination FAX number
`are written.
`
`FIG. 28 is a drawing of a command sticker with two hot
`zones, one of which contains a number of boxes which can
`be checked to indicate which input device command is to be
`invoked, and the other of which is for writing symbols
`needed for some commands such as a FAX number.
`
`FIG. 29 is a drawing of a command sticker which is
`unique to the FAX command to the input device, but which
`includes a hot zone containing a number of boxes for all the
`letters of the alphabit by which the user can spell out the
`intended recipient by blackening the appropriate letter
`boxes.
`
`FIG. 30 is ‘a drawing of a general command sticker with
`two hot zones one of which contains numerous boxes for the
`universe of possible commands to the input device selection
`of one of which is by blackening the box and the other of
`which contains boxes which can be blackened to specify
`attributes needed for the specific command such as a FAX
`number.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`Referring to FIG. 1, there is shown an exploded view of
`a combination of a paper input device 10 and a computer
`monitor 12. In the embodiment shown in FIG. 1, the paper
`input device 10 is coupled to the monitor 12 by clips 14 and
`16 which snap into slots 18 and 20 formed in the housing of
`the monitor 12. In other embodiments, the projections could
`be formed on the monitor, keyboard, etc. and fit into slots in
`the paper input device.
`FIG. 2 shows the embodiment of a combined paper input
`device and monitor with the paper input device fully
`mounted. Note that the paper input device has zero footprint
`as is does not touch the workstation surface which supports
`the monitor, but is supported by the monitor itself.
`FIG. 3 shows a perspective view of an embodiment of a
`combined paper input device 10 and keyboard 22. The paper
`input device 10 may be mounted on the keyboard in any
`known manner such as clips or brackets which are fastened
`to the keyboard. In the embodiment of FIG. 2, the paper
`input device is also supported by the keyboard and has no
`footprint of its own.
`FIG. 4 shows in cross-section one type of mechanical
`connection between the paper input device and the computer
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`4o
`
`45
`
`50
`
`55
`
`60
`
`65
`
`component to which it is mounted. The attachment mecha-
`nism of FIG. 4 is a snap-in type arrangement wherein a
`projecting portion formed on either the paper input device or
`the peripheral to which it is mounted fits into a slot formed
`in a surface 32 of the device on the opposite side of the
`connection. The centerline of the projection 30 is offset
`relative to the centerline of the slot in surface 32,
`i.e.,
`misaligned slightly, such that when the projecting portion is
`pushed into the slot, the material of the projection or clip 30
`is stressed so as to bias 8. projecting barb 34 in the direction
`of arrow 36. When the projecting portion is pushed far
`enough into the slot in surface 32, the barb 34 clears the
`underside 38 of the surface 32. The barb 34 then snaps in the
`direction of arrow 36 and locks the paper input device into
`a mechanical connection to the computer component or
`printer (or vice versa). Any of the externally mounted paper
`input devices described herein can be mounted physically as
`shown in FIG. 4.
`
`FIG. 5 shows another embodiment by which the paper
`input device may be mechanically