United States Patent [19]
`Cotte et a].
`
`llllllllllllllIlllllllllllllllll||l|llllll|l|l|Illlllllllllllllllllllllllll
`US005499108A
`[11] Patent Number:
`5,499,108
`[45] Date of Patent:
`Mar. 12, 1996
`
`[54] DOCUMENT-DRIVEN SCANNING INPUT
`
`[57]
`
`ABSTRACT
`
`DEVICE COMMUNICATING WITH A
`
`COMPUTER
`
`[75] Inventors: Pierre Cone’ Pan-S, France; Ronald C_
`Fish’ Morgan Hill, Calif‘
`'
`
`-
`.
`- -
`-
`-
`[73] Asslgnce' xifglgs??commumcatmns’ Inc" Palo
`
`[21] APPl- Noi 988,404
`[22] Filed
`D e c_ 9 1992
`'
`’
`
`.
`.
`Related U'S' Apphcatlon Data
`[63] Continuation-in-part of Ser. No. 922,169, Jul. 29, 1992.
`
`[51] Int. Cl.6 ............................ .. H04N 1/00; GOSB 13/02
`[52] US. Cl. ........................ .. 358/400; 358/448; 358/498;
`364/181; 345/902
`[58] Field of Search ................................... .. 358/400, 402,
`358/426, 439, 401, 444, 494, 496, 498,
`448; 364/181, 2383, 2412, 2421, 92799;
`345/902
`
`[56]
`
`References Cited
`
`U-S- PATENT DOCUMENTS
`13.285564 9/1986 Bev?acqua et aL _
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`0159158 10/1985 European Pat. 011’.
`0358441 3/1990 European Pat. O?".
`0398185 11/1990 European Pat. O?".
`0426412 5/1991 European Pat. O?’.
`0478340 4/1992 European Pat. 011’.
`0556067 8/1993 European Pat. Off,
`57-129578 8/1982 Japan .
`
`(List continued on next page.)
`
`Primary Examiner—Edward L. Coles, Sr.
`Assistant Examiner—Madeleine Nguyen
`Attorney, Agent, or Firm—Thomas A. Gallagher
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`An integral input/computer component combmation 1s dis
`closed wherein 21 input device may share a single data port
`on the host computer with a Fax modem and be mounted to
`a monitor, printer, keyboard etc. so as to have a small
`footprint. A pair of UARTS coupled to a a microprocessor in
`the input device implements a passthrough connection from
`the port of the input device coupled to the data port of the
`host to a data port of the input device coupled to the Fax
`modem whenever the input device using scanning technol
`ogy is not in use. A relay makes the same passthrough
`connection whenever power is turned 011C to the input device.
`In one zero footprint embodiment, the input device input
`device has snap-in projections which are pushed into slots
`formed in the computer component housing to lock the input
`device into Place' In another embodiment’ the input deyice
`and computer component are mounted together by spec1ally
`adapted brackets to adjust for differences in housing dimen
`sions between the input device and the computer compo
`nent. In some embodiments, the input device and computer
`component share a common element such as a paper tray- In
`other embodiments, the input device is completely enclosed
`by the computer component housing. In any of these
`embodiments, the input device and computer component can
`have separate power and data lines, or, alternatively, can
`share power and data lines such as by having the input
`device derive its power from the power supply of the
`computer component and time division multiplexing of the
`data cable of said computer component. In the preferred
`embodiment, the software of the input device can recognize
`special symbols placed on the document which represents
`commands the user desires to give to the host computer to
`control its operations to process the scanned image. In the
`preferred’ embodiment, these symbols are placed on the
`document with diiferent stickers, which may be diiferent for
`each command or which may be universal and contain boxes
`the user can darken to indicate the desired command and the
`parameters needed by the host carry out that command. In
`other embodiments, the symbols may be drawn or preprinted
`on the document to be scanned or printed on the document
`by software which stores different graphic image symbols
`and which can print them on the document using a laser
`printer etc.
`
`50 Claims, 15 Drawing Sheets
`
`250
`
`210
`
`IHHHIIIII|||l1HIlllllllllllllllllllllllllllllll
`
`MPHJ 2010
`
`

`

`5,499,108
`Page 2
`
`US. PATENT DOCUMENTS
`_
`?xed --------------------------------- -' 232/522
`1/1979 Gauronski 6161.
`271/245
`
`318231132
`4,132,401
`
`235/454
`4,205,780 6/1980 13nrns6161. .... ..
`4,283,621
`8/1981 Pembroke ............................. .. 235/375
`4,323,773 4/1982 c61p6n16r .............................. .. 235/473
`
`
`
`Niel-‘1an 4,415,981 11/1983 Cutter et al_ __
`
`I
`
`395,106
`
`3/1985 Suzuki 6161. ......................... .. 382/175
`4,504,969
`6/1985 061111611 6161. ....................... .. 364/478
`4,525,788
`4,548,401 10/1985 Nishikawa ______ __
`271/265_01
`4,558,373 12/1985 Plasencia et a1, ,
`358/484
`4,563,706
`1/1986 Nagashima
`. 358/444
`4,574,395 3/1986 K616 ............ ..
`. 382/306
`4,631,598 12/1986 Burkhardt 61 61.
`358/425
`4,680,674 7/1987 M6616 _________ _,
`860686
`4,743,974 5/1988 Lockwood
`. 358/494
`4,760,458 7/1988 w616n6h6 6161.
`358/452
`4,760,606 7/1988 L6sn161< 61 61.
`382/306
`4,770,403 7/1988 AkiO ............ ..
`.271/110
`4,802,204
`1/1989 Chang ..... ..
`. 358/400
`4,815,029 3/1989 136111616161, _
`395/146
`4,860,112
`8/1989 Nichols 6161.
`358/400
`4,868,672 9/1989 Hiroki 6161.
`358/494
`4,885,704 12/1989 T61<6g16161 .
`345/166
`4,918,540 4/1990 0h16n1 ......... ..
`358/429
`4,918,588 4/1990 13611611 6161.
`395/600
`4,937,439 6/1990 w6nn1ng616161.
`235/456
`4,944,031
`7/1990 Yoshino ...... ..
`. 355/206
`4,972,273 11/1990 Burkhardt 61 61.
`358/443
`4,982,293
`1/1991 161111 ............... ..
`358/429
`4,996,707 2/1991 0114611637 6161. .................... .. 379/100
`
`5/1991 Ogura .................................... .. 358/401
`5,019,916
`6/1991 Muroi .................................... .. 235/462
`5,021,640
`8/1991 Ayers 6161. ........................ .. 346/1531
`5,038,158
`g’ggg’égg 18x33; llfvlf‘e et a1‘
`395,155
`
`onkawa ............................. .. 395/131
`.
`5’°62’136 10/1991 Gamsetal' ------------------------- " 358/426
`271/110
`5,072,923 12/1991 C°Y -------------- -
`
`,
`
`,
`
`5,191,622
`
`
`
`
`....................... .. Burgess 6t 3/1993 Shojima et a1. ...................... .. 382/185
`358/400
`3/1993 E?ckson e191
`561991063
`5/1993 Nakajima ------------------------------ -- 382/282
`5,208,873
`6/1993 Kinoshita 6161. .................... .. 358/400
`5,216,517
`7/1993 Ett ....................... ..
`358/400
`5,227,893
`8/1993 Cohen-Skalli 6161.
`395/101
`5,235,674
`9/1993 Millman 6161.
`358/400
`5,243,437
`9/1993 Talwyanagi
`358/400
`5,245,446
`5,267,058 11/1993 8616 .............. ..
`358/498
`5,267,059 11/1993 K661616616 6161. .................... .. 358/498
`5,267,303 11/1993 Johnson 6161. ....................... .. 358/468
`5,282,052
`1/1994 Johnson 6161. .
`358/402
`5,289,570
`2/1994 Suzuki ...... ..
`358/452
`5,325,297
`6/1994 Bird 6161. ........................ .. 364/419.07
`5,332,207
`7/1994 Oonishi 6161. ....................... .. 271/110
`5,420,697
`5/1995 Tuli ....................................... .. 358/472
`
`FOREIGN PATENT DOCUMENTS
`
`0250430 12/1985 J6P6n.
`62-183255
`8/1987 J6p6n.
`03013052 111991 161,611.
`WO9110969 7/1991 WIPO.
`w09203884 3/1992 WIPO.
`w092o7440 4/1992 WIPO.
`
`

`

`US. Patent
`
`‘
`
`Mar. 12,1996
`
`Sheet 1 of 15
`
`5,499,108
`
`FIG. 1
`
`FIG. 2
`
`-
`
`1 0
`‘if 46
`22
`
`mmmmmn Qua
`EB“
`@mmm <1 mm
`gammmmtmm mm
`@Em
`
`

`

`U.S. Patent
`
`Mar. 12, 1996
`
`Sheet 2 of 15
`
`5,499,108
`
`//
`
`llll H
`
`WP
`
`“q. E i §
`
`

`

`U.S. Patent
`
`Mar. 12, 1996
`
`Sheet 3 of 15
`
`5,499,108
`
`PC
`V _ EH
`E m l
`DE_ M Wm_ \1 A ?l.
`MS 2
`
`OP
`HC .\
`“?u n
`o
`
`..\
`
`\1 HM
`M w xw \\
`
`m H
`
`8
`
`2 2 4|
`
`REMOTE
`FAX
`MACHINE/
`MODEM
`
`\ 120
`
`FIG. 10
`
`SCANNING MECHANISM
`
`Z180
`MICROPROC ESSOR
`
`FIG. 11A
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 4 of 15
`
`5,499,108
`
`SEND PROGRAM
`DATA TO UARTS
`TO PROGRAM THEM
`TO AUTOMATICALLY
`FORWARD DATA TO
`EACH OTHER
`
`__/'137
`
`RECEIVE INTERRUPT
`INDICATING INPUT
`DEVICE HAS SENSED
`A DOCUMENT HAS
`BEEN INSERTED FOR
`SCANNING
`
`RETURN
`TO MAIN
`LOOP
`
`A \133
`
`FIG. 11B
`
`[-141
`
`|s INTER-UART DATA YES
`PATH BUSY?
`
`REJECT DOCUMENT OR
`SCAN AND STORE DATA
`
`I
`
`143
`r
`RETURN TO MAIN LOOP
`
`NO
`
`145
`f
`SEND PROGRAM DATA TO
`UARTS TO PROGRAM THEM
`TO STOP FORWARDING DATA
`TO EACH OTHER AND START
`TRANSMITTING DATA DERIVED
`FROM THE SCAN DATA RECEIVED
`FROM THE INPUT DEVICE
`MICROPROCESSOR TO THE
`APPROPRIATE DEVICE
`
`FIG. 11C
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 5 of 15
`
`5,499,108
`
`250
`
`lllIIlIlIlIIIIIIIIIIIIIII
`
`210
`
`IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
`
`START
`f‘ 240
`*
`RECEIVE INTERRUPT
`FROM INPUT DEVICE
`f
`r242
`vECTOR PROCESSING
`TO APPROPRIATE
`INTERRUPT SERVICE
`ROUTINE
`
`f244
`*
`READ INCOMING DATA
`FROM INPUT PORT
`COUPLED TO INPUT
`DEVICE
`
`/-246
`I
`STORE DATA IN A FILE
`+
`[-248
`RECOGNIZE COMMAND(S)
`REGARDING WHAT IS TO
`BE DONE WITH INCOMING
`DATA
`
`r250
`*
`INVOKE APPROPRIATE
`HOST SOFTWARE
`PACKAGE, TELL IT WHAT
`TO DO WITH THE DATA AND
`PASS POINTER TO FILE
`
`230
`
`SENSORS
`SENSE AN
`
`SEND INTERRUPT
`TO HOST
`/234
`I
`SCAN DATA FROM
`INPUT DOCUMENT
`
`I
`
`TRANSMIT DATA
`OVER CABLE TO
`HOST COMPUTER
`I
`WAIT FOR NEXT
`INPUT DOCUMENT
`
`236
`
`238
`
`FIG. 13A
`
`FIG. 13B
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 6 of 15
`
`5,499,108
`
`237
`239
`_ f 251 f
`
`‘
`
`I I
`
`I
`
`nr
`
`241
`mmxmmzzmmrzzzmz:
`:mxzxzzzzmmmmmzzzzr: /
`
`Jll
`
`llllll?lllllllllllllllllll?luullmllmllmlllllllllllllllllllllll
`ll
`IIIIIIIIIIIII"
`
`\MIIIMMIIMMWWMWMIIIIIMIIMMMI
`IMHIMMIIIIIIIIIMIUIIIIIMIIIIMIIMMMMMMMI
`IIIIIMMIIIIIHIIIIIIIIIIMIIIIIIIMHMIIIIIMMMIIIMI
`IIII'IIMIIIIII‘IIIIIIIII‘I‘MII
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 7 of 15
`
`5,499,108
`
`|§|~>PIERREALAIN
`
`FAx —>DENIS'
`
`|_/ 236 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _,
`
`I
`260
`|
`REcEIvE 6 - a BIT DATA _/ —_—q f 266 l
`FoR EACH PIxEL OF
`SCANNED DATA
`(256 GRAY LVLS)
`+
`262
`SELECT BLACK/WHITE J
`DISCRIMINATION
`THRESHOLD
`
`coMPREsS BLACK AND |
`WHITE DATA PRIoR
`I
`T0 TRANSMISSION
`|
`+
`/-268 I
`TRANSMIT DATA
`I
`
`'
`I
`
`I
`I
`'
`|
`I
`
`264
`+
`I
`I coNvERT EACH PIXEL J
`GRAY LEVEL VALUE
`I TO A BLACK OR
`| WHITE LEVEL
`l
`L_______
`
`I
`I
`|
`
`l
`I
`
`FIG. 1 8
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 8 of 15
`
`5,499,108
`
`13:323.,“
`
`\
`
`243 \. ____]2]-> PIERRE - ALAIN
`
`-245-— ——E FAX -—> DENIS
`f
`
`£3
`0
`ID
`247
`'3
`Z ,
`g r
`g
`O
`._.|
`2
`m_
`z
`m
`‘2
`a;
`
`\
`
`/
`
`236
`
`236
`
`,_f _ _ _ _ _ _ ..... ._
`
`F _ _ _ _ _ _ _ [
`
`I
`l
`
`I
`
`'
`|
`
`'
`l
`|
`I
`
`'
`
`l
`REcEwE GRAY 27°
`SCALE DATA J l
`|
`
`72
`
`COMPRESS GRAY
`SCALE DATA
`
`l
`|
`
`274
`+ f '
`TRANSMIT COM-
`'
`PREssED DATA
`|
`ovER HIGH SPEED
`I
`
`I
`I
`
`|
`
`RECEIVE GRAY /276 I
`SCALE DATA
`|
`
`$
`
`278 k
`
`|
`I
`
`I TRANSMIT ovER
`I
`HIGH SPEED, HIGH
`BANDWIDTH LINK
`I TO HosT
`I
`L
`
`l
`I
`I
`— — - - * _ _ _
`
`LINK To HOST
`
`'
`
`A
`
`FIG. 20
`
`

`

`U.S. Patent‘
`
`Mar. 12, 1996
`
`Sheet 9 0f 15
`
`5,499,108
`
`Incoming Pages
`
`~259 |g~257 E
`Photocopy
`Clipboard
`
`co: Mail
`
`255 i%~253
`
`Fax
`
`Status: idle
`
`Pages: 2
`
`FIG. 17
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 10 of 15
`
`5,499,108
`
`PAPER SENSORS u
`SENSE PAPER
`INPUT?
`
`280
`
`282
`
`SCAN GRAY SCALE i284
`PIXEL DATA FROM
`DOCUMENT (AND
`STORE)
`
`I
`
`#286
`SELECT GRAY
`SCALE TO BLACK
`AND WHITE
`CONVERSION
`THRESHOLD
`
`dzaa
`
`I
`
`CONVERT GRAY
`SCALE PIXEL
`DATA TO BLACK
`AND WHITE DATA
`
`I
`
`COMPRESS BLACK _/ 290
`AND WHITE DATA
`PRIOR TO TRANS
`MISSION USING
`FAX GROUP III
`OR FAX GROUP 11
`COMPRESSION
`ALGORITHM
`f 292
`+
`TRANSMIT COMPRESSED
`DATA VIA R5232
`PROTOCOL
`FIG. 21A
`
`i
`
`[294
`
`RECEIVE MESSAGE FROM
`INPUT DEVICE AND BEGIN
`READING, DECOMPRESSING,
`AND STORING INCOMING
`BLACK AND WHITE DATA
`
`I
`
`[296
`
`DISPLAY POP-UP WINDOW
`~ WITH MENU OPTIONS
`REGARDING WHAT TO DO
`WITH DATA
`
`‘
`
`[-298
`
`f 300
`
`READ USER SELECTION
`REGARDING WHAT TO DO
`WITH INCOMING DATA
`I
`ISSUE APPROPRIATE
`COMMANDS TO INVOKE
`HOST SOFTWARE
`SELECTED BY USER TO
`PROCESS THE INCOMING
`DATA AND PASS THE
`INCOMING DATA TO THAT
`SOFTWARE
`
`‘
`
`r302
`
`PROMPT THE USER FOR
`OR READ APPROPRIATE
`AUXILIARY OR ATTRIBUTE
`DATA AND PASS THIS
`DATA TO INVOKED
`SOFTWARE
`
`FIG. 21 B
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 11 of 15
`
`5,499,108
`
`fa12
`
`HAS PHOTOCOPY
`BUTTON BEEN
`PUSHED?
`YES
`
`-
`
`320
`322
`TURN ON LED AND :
`STORE NUMBER
`OF TIMES COPY
`BUTTON WAS PUSHED
`‘a
`r324
`PROMPT USER FOR
`DESIRED NUMBER
`OF COPIES
`
`+
`SCAN IMAGE OF
`DOCUMENT
`
`f" 326
`
`+
`SEND IMAGE DATA
`TO LASER PRINTER
`
`f- 328
`
`HAS TIMEOUT
`OCCURED FROM
`LAST DOCUMENT
`ARRIVAL?
`
`NEW DOCUMENT
`INSERTED?
`
`NO
`
`TURN OFF LED AND "332
`RESUME NORMAL
`INPUT DEVICE MODE
`
`FIG. 23
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 12 of 15
`
`5,499,108
`
`I
`
`K348.
`I
`I
`PRoIvIPT usER FDR
`ANY NECESSARY
`AUXILIARY DATA OR READ
`AUXILIARY DATA
`SYMBOLS FROM
`DOCUMENT BEING
`SCANNED
`
`HAS FRONT
`PANEL BUTTON,
`BEEN PUSHED-
`
`34o
`r342
`
`SEND MESSAGE
`T0 INPUT DEVICE
`HOST RESISDENT
`SOFTWARE THAT
`FRONT PANEL
`BUTTON HAS BEEN
`PUSHED & SCAN DOC
`
`‘
`
`K344
`
`INPUT DEVICE HOST ,
`RESIDENT SOFTWARE
`CHECKS CONFIGURATION
`PREFERENCES FILE
`FOR BUTTON SCRIPT
`AND RECEIVES SCAN DATA
`
`¢
`
`r346
`
`INPUT DEVICE HOST
`RESIDENT SOFTWARE
`EXECUTES SCRIPT
`COMMANDS TO INVOKE
`APPROPRIATE HOST
`RESIDENT SOFTWARE
`AND CAUSE SAME
`TO PROCESS THE
`SCANNED IMAGE
`ACCORDING TO SCRIPT
`
`FIG. 24
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 13 of 15
`
`5,499,108
`
`«memUOEOmQ—z0...
`
`mam<._.<O
`
`mnm
`
`mnm
`
`hazm_Nnm
`
`ommmnm
`
`mmmuam
`
`vn
`m
`
`
`
`m-mmmm
`
`o<
`
`Ohm
`
`mm
`m
`
`Amemzmm
`
`mm,
`
`Nmm
`
`zoEmmmoo
`
`2<m
`
`mmm
`
`
`
`ommacmzmm
`
`mum<a
`
`Nmm
`
`.5.<3
`
`#mm
`
`
`
`ommmm>EDmm>EQ
`
`mm.OE
`
`.vmm
`
`mmmmmkw
`
`mOFOE
`
`Jug-35$
`
`.EOQ
`
`0mmmmm
`
`mmNmm
`
`ago
`
`
`
`
`

`

`US. Patent
`
`Mar. 12, 1996
`
`Sheet 14 of 15
`
`5,499,108
`
`HOT ZONE
`\ 404
`
`FIG. 26
`
`/-406
`i FAX IT!
`
`r400
`
`HOT ZONE
`\4o4
`
`l
`
`FIG. 27
`
`FAX
`
`OCH E-MAIL ‘H /-——408
`
`1;! El E1
`HOT ZONE
`
`

`

`US. Patent ‘
`
`Mar. 12, 1996
`
`Sheet 15 of 15
`
`5,499,108
`
`FAX IT!
`
`HECIPIENT'S LAST NAME
`
`
`
`Ann 000 Inna.
`
`AU BU... Mn...
`AD BU CU... SE TD:
`
`3 M
`
`w
`
`\AAAAAAAAAAAAAAAAAAAI‘
`
`FIG. 29
`
`0..
`
`FAX
`
`PHOTOCOPY
`
`i E]
`
`E-MAIL I
`
`E
`
`415
`
`ATTFIIBUTES
`
`OU‘IDZU...
`
`guano
`
`AUBDQQQ
`
`col
`
`OD1D2D...
`
`2n...
`
`AAAAAAAAAAAAAAAAAAAA
`
`\AAAAAAAAAAAAAAAAAAAI
`
`FIG. 30
`
`000 C10
`
`

`

`5,499,108
`
`.
`1
`DOCUNIENT-DRIVEN SCANNING INPUT
`DEVICE CONIMUNICATING WITH A
`COMPUTER
`
`BACKGROUND OF THE INVENTION
`
`This is a continuation-in-part of US. patent application
`serial number 07/922,169, ?led Jul. 29, 1992 entitled COM
`PUTER INPUT DEVICE USING PAPER INPUT DEVICE
`TECHNOLOGY FOR PAPER BASED COMPUTING. The
`invention pertains generally to the ?eld of office equipment,
`and, more speci?cally, to the ?eld of input devices for
`computer systems where a single serial port can be shared by
`the input device and by a FAX modem. In some embodi
`ments, the input device is a low footprint scanning device
`which is mounted either by clips or permanently integrated
`into other peripherals for use with computer systems such as
`a monitor, keyboard etc.
`In today’s computing environment, simplicity is of
`increasing importance to users especially users who are
`unskilled in computer technology and who are not comfort
`able with the notion of having to modify their computers to
`adapt them to new technology. Many computers, especially
`Macintosh personal computers have only one RS232 port for
`use modems, serial printers, FAX modems or other serial
`devices. Thus, when a new serial device is added, it is
`necessary to multiplex the serial port manually with a switch
`or add a card to the computer to add another serial port. The
`foregoing discussion is equally applicable to parallel ports as
`those skilled in the art will appreciate. However, the need to
`physically switch the port to the other peripheral device is
`inconvenient, and if the user forgets to operate the switch,
`his or her software will generate an error message which
`may confuse and frustrate the user. Likewise the prospect of
`having to open the computer case and add a peripheral card
`is unpleasant to the technically unsophisticated user.
`There are many applications of computer technology
`where having an input device which can scan images or text
`into a computer and automatically do something with the
`image such as perform electronic storage, electronic anno
`tation, FAX the image or perform optical character recog
`nition etc. This type of input device supports a growing trend
`called paper based computing. To add such a device to an
`existing computer system will often result in creating a
`problem for a user by presenting the user with two periph
`erals and two data cables that need to be plugged into the
`host computer but only one port into which to plug the
`cables. The user is then faced with the problem of either
`making the connection to the port to be shared through a
`switch or multiplexer to which both peripherals are coupled
`and which has a single output for coupling to the port to be
`shared or adding a card to the computer. Either option is
`inconvient and can be intimidating for less sophisticated
`users.
`Therefore, a need has arisen for a smart input device using
`scanning technology which can share a single port on the
`host computer.
`Another problem in today’s computing environment with
`growing numbers of peripherals competing for space. Desk
`space is at a premium today as it is generally ?xed in size
`while the number of personal productivity devices such as
`personal computers, FAX machines, paper input devices,
`printers, plotters, mice, mouse pads, calculators etc. contin
`ues to rise. The proliferation of these devices and their
`continually falling cost has caused a trend for more and more
`of such equipment to be placed at each individual employees
`
`20
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`workstation to improve productivity. Because of the need to
`have various documents, ?les, books, etc. on the desk or
`work station surfaces with all of these personal productivity
`tools, working space on these surfaces is at a premium. Such
`considerations have led to “tower” designs for some per
`sonal computers where the CPU unit can sit on the ?oor
`under a workstation and small footprint designs for other
`computers such as the original MacintoshTM personal com
`puter designed to sit on top of a desk.
`An input device using scanning technology is a very
`useful tool in today’s environment. For example, in a
`contract negotiation, very frequently a written contract
`needs to be revised or new proposed terms need to be added
`by a person other than the person who originally wrote the
`contract. If the two people involved do not have compatible
`word processors, an input device using scanning technology
`allows one peon to send the draft and handwritten annota
`tions to the other person for storage in his personal computer
`and possible revision.
`Because an input device using scanning technology is a
`personal productivity tool which will probably begin to
`appear more frequently on individual employee work sta
`tions, a need has arisen for a input device using scanning
`technology with a small footprint to save space on already
`crowded surfaces for other productivity tools.
`
`SUlVIMARY OF THE lNVENTION
`
`According to the teachings of the invention, there is
`disclosed an input device using scarming technology which
`is smart enough to share with another peripheral a single
`serial or parallel port thereby eliminating the need for a
`switch or a new driver circuit card to be installed in the host.
`In some embodiments, the input device using scanning
`technology has a zero footprint of space consumed on the
`surface of a workstation. The advantage of zero footprint is
`achieved by at least physical integration of the paper input
`device with another component of a host computer such as
`a monitor, keyboard, CPU, printer, etc.
`As the term in used herein, an “paper input device” is a
`computer peripheral which senses the insertion of a docu
`ment to be scanned, initiates a host computer process, i.e.,
`controls the host process by insertion of the paper and
`symbols on the paper, scans the images and text on the paper,
`provides immediate user interface feedback while sending
`the scanned data to the host for further electronic processing
`such as display, transmission, storage or modi?cation. Prin
`cipally, this new technology is a paper input device using
`scanning technology which controls the host computer
`rather than the other way around, the latter being what is
`taught in the prior art. With such an input device, paper
`based computing is possible.
`In the preferred embodiment, the input device using
`scanning technology includes a scanning mechanism. Spe
`cial software in the input device compresses the scanned
`data, sends the scanned data to the host and automatically
`carries out the desired processing either by receiving a
`command from the user by manual pointing to menu selec
`tions presented to the user by the software or by automatic
`recognition of preprinted or hand drawn symbols on the
`document being scanned. Sharing of a single port of the host
`computer is accomplished by the software of the input
`device using scanning technology in implementing a
`passthrough connection to the other peripheral when the
`input device is not in use. In other words, the input device
`using scanning technology has its data cable plugged into
`
`

`

`5,499,108
`
`3
`the port of the host computer to be shared. The other
`peripheral such as a FAX modem etc. which must also be
`plugged into the same port is plugged into an appropriate
`connector of the input device. The software of the input
`device using scanning technology then passes any data from
`the other peripheral to the host or vice versa through a
`passthrough data path when the input device is not active.
`When the input device is active, the data path through the
`input device to the other peripheral is cut, and is taken over
`by the input device using scanning technology so that the
`compressed scanned data and commands may be sent to the
`host computer.
`In some low or zero footprint embodiments, the input
`device using scanning technology is physically integrated
`with another computer component such as a computer
`monitor or CPU housing in any of several ways such that the
`input device does not have its own footprint but shares the
`footprint of the device to which it is attached. The input
`device using scanning technology may be plugged into
`speci?cally formed slots in the housing of the monitor,
`keyboard etc. by way of special pegs or legs extending from
`the paper input device chassis. Second, the input device
`using scanning technology can be physically mounted to the
`monitor, keyboard, etc. by mechanical adapters which are
`specially designed to be attached to both a surface of the
`input device and a surface of the monitor, keyboard, etc.
`This allows the monitor or keyboard to be used without
`being modi?ed and allows upgrading to new monitors etc. A
`third way of mounting the input device using scanning
`technology is a partial inclusion option where the paper
`input device is mounted to, for example, a monitor, by any
`of the methods described above, and where some portion of
`the input device structure such as the paper receptacle is
`integrally formed as part of the housing of the monitor,
`keyboard, etc. This allows upgrading to different monitors
`etc. without buying a new input device. The ?nal option is
`a full integration version where the electronics of the input
`device using scanning technology are enclosed within the
`housing of the monitor etc. The housing of the monitor etc.
`is modi?ed in this option to have a slot through which papers
`to be scanned may be fed. The paper receptacle to received
`the papers after they have been scanned is also integrated
`into the housing of the monitor keyboard etc.
`In each of the embodiments described above, the power
`and data connections for the input device using scanning
`technology can be made through the monitor, keyboard, etc.
`In other words, power to the paper input device can be
`through a connection to the power supply of the monitor,
`CPU, or through a connection from the keyboard to the CPU
`as part of the normal cable connecting the keyboard to the
`CPU. Likewise, the data output of the paper input device to
`the CPU may also, in some embodiments, be made through
`the cable connecting the monitor, keyboard, printer, etc. to
`the CPU using the serial or parallel port on the computer.
`
`45
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is and exploded perspective view of a paper input
`device and computer monitor combination with zero foot
`print for the paper input device.
`FIG. 2 is a perspective view of a combination monitor/
`paper input device with integral, mating electrical connec
`tions for power and data between the paper input device and
`the monitor and a single set of shared power and data cables.
`FIG. 3 shows a perspective view of an integral paper input
`device/keyboard combination.
`
`60
`
`65
`
`20
`
`25
`
`30
`
`35
`
`40
`
`4
`FIG. 4 shows a typical snap-in connection arrangement to
`mount the paper input device to any computer component.
`FIG. 5 shows a bolt-on mounting arrangement to mount
`the paper input device to the computer component.
`FIG. 6 shows a front elevation view of a monitor with a
`paper input device mounted thereon by speci?cally adapted
`mounting brackets.
`FIG. 7 shows an embodiment wherein a paper input
`device and a computer component share a common element.
`FIG. 8 is a perspective view of a monitor with a paper
`input device completely enclosed therein.
`FIG. 9 shows and an embodiment for sharing a common
`element such as a paper tray between a paper input device
`and a laser printer.
`FIG. 10 shows a block diagram of the connections
`between the input device paper input device and a host and
`Fax modem for a passthrough connection.
`FIG. 11A shows a block diagram of the electronics of the
`input device using scanning technology to carry out the
`passthrough connection to allow the input device and Fax
`modem to share the same computer port.
`FIGS. 11B and 11C are ?ow diagrams of the software
`executed by the microprocessor of the input device to
`manage the “passthrough” connection from the host to
`another peripheral so that the input device can share a single
`data port with, for example, a Fax modem.
`FIG. 12 is a block diagram of a computer system using an
`input device.
`FIGS. 13A and 13B are ?ow charts representing, respec
`tively, processing by the input device and the input device
`software resident on the host for the preferred embodiment
`of one type of an input device in which the teachings of the
`invention may be employed.
`FIG. 14 is a drawing of a typical input document using
`prede?ned command symbols and prede?ned auxiliary sym
`bols located in a hot zone.
`FIG. 15 is a drawing of a typical input document using
`hand drawn command symbols and hand drawn auxiliary
`symbols that the input device must be trained to recognize,
`the symbols being located in a hot zone.
`FIG. 16 is a drawing of a typical input document using
`hand drawing command symbols and hand drawn auxiliary
`symbols located outside the hot zone or in hot zones not
`located at the top of the paper.
`FIG. 17 is a drawing of a typical pop-up window with
`menu options displayed therein, said menu option being
`determined by the input device software based upon the
`software which exists on the host machine.
`FIG. 18 is a flow chart of a process carried out by the
`preferred embodiment of the input device for converting
`gray scale pixel data to black and white data, compressing
`the data and transmitting it to the host for decompression and
`use or storage.
`FIG. 19 is a ?ow chart of the process of compressing gray
`scale scanned data and transmitting it over a high speed link
`to the host.
`FIG. 20 is a ?ow chart of the process of scanning gray
`scale data and transmitting it directly without compression
`from the input device to the host computer over a high speed,
`high bandwidth link.
`_
`FIG. 21A is a ?ow chart of processing by the input device
`software resident in the paper input device and FIG. 21B is
`a ?ow chart of processing by the input device software
`resident on the host computer to implement the preferred
`embodiment according to the teachings of the invention.
`
`

`

`5,499,108
`
`5
`
`15
`
`25
`
`5
`FIG. 22 is a diagram of the front panel of an input device
`that implements a photocopy auxiliary function.
`FIG. 23 is a ?ow chart of processing by input device
`software resident in both the paper input device and the host
`to implement a photocopy option in addition to or in lieu of
`the other processing previously described herein.
`FIG. 24 is a ?ow chart of the processing for executing a
`set of scripted commands with which the front panel button
`on the input device has been programmed to cause prede
`termined processing by the host computer.
`FIG. 25 is a block diagram of the electronic circuitry in
`the input device scanning mechanism.
`FIG. 26 is a drawing of a command sticker for a FAX
`command to the input device with an external hot zone, said
`sticker to be placed on a document to be scanned and thereby
`causing the scanned image to be FAXed to whatever desti
`nation is identi?ed by symbols written in the hot zone.
`FIG. 27 is a drawing of a command sticker for a FAX
`command to the input device with an internal hot zone in
`which the symbols identifying the destination FAX number
`are written.
`FIG. 28 is a drawing of a command sticker with two hot
`zones, one of which contains a number of boxes which can
`be checked to indicate which input device command is to be
`invoked, and the other of which is for writing symbols
`needed for some commands such as a FAX number.
`FIG. 29 is a drawing of a command sticker which is
`unique to the FAX command to the input device, but which
`includes a hot zone containing a number of boxes for all the
`letters of the alphabit by which the user can spell out the
`intended recipient by blackening the appropriate letter
`boxes.
`FIG. 30 is ‘a drawing of a general command sticker with
`two hot zones one of which contains numerous boxes for the
`universe of possible commands to the input device selection
`of one of which is by blackening the box and the other of
`which contains boxes which can be blackened to specify
`attributes needed for the speci?c command such as a FAX
`number.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`Referring to FIG. 1, there is shown an exploded view of
`a combination of a paper input device 10 and a computer
`monitor 12. In the embodiment shown in FIG. 1, the paper
`input device 10 is coupled to the monitor 12 by clips 14 and
`16 which snap into slots 18 and 20 formed in the housing of
`the monitor 12. In other embodiments, the projections could
`be formed on the monitor, keyboard, etc. and ?t into slots in
`the paper input device.
`FIG. 2 shows the embodiment of a combined paper input
`device and monitor with the paper input device fully
`mounted. Note that the paper input device has zero footprint
`as is does not touch the workstation surface which supports
`the monitor, but is supported by the monitor itself.
`FIG. 3 shows a perspective view of an embodiment of a
`combined paper input device 10 and keyboard 22. The paper
`input device 10 may be mounted on the keyboard in any
`known manner such as clips or brackets which are fastened
`to the keyboard. In the embodiment of FIG. 2, the paper
`input device is also supported by the keyboard and has no
`footprint of its own.
`FIG. 4 shows in cross-section one type of mechanical
`connection between the paper input device and the computer
`
`45
`
`60
`
`65
`
`6
`component to which it is mounted. The attachment mecha
`nism of FIG. 4 is a snap-in type arrangement wherein a
`projecting portion formed on either the paper input device or
`the peripheral to which it is mounted ?ts into a slot formed
`in a surface 32 of the device on the opposite side of the
`connection. The centerline of the projection 30 is offset
`relative to the centerline of the slot in surface 32, i.e.,
`misaligned slightly, such that when the projecting portion is
`pushed into the slot, the material of the projection or clip 30
`is stressed so as to bias a projecting barb 34 in the direction
`of arrow 36. When the projecting portion is pushed far
`enough into the slot in surface 32, the barb 34 clears the
`underside 38 of the surface 32. The barb 34 then snaps in the
`direction of arrow 36 and locks the paper input device into
`a mechanical connection to the computer component or
`printer (or vice versa). Any of the externally mounted paper
`input devices described herein can be mounted physically as
`shown in FIG. 4.
`FIG. 5 shows another embodiment by which the paper