Exhibit 1001
`Exhibit 1001
`
`

`
`US008508751B1
`US008508751B1
`
`(12) United States Patent
`(12) United States Patent
`ShenetaL
`Shen et a].
`
`(10) Patent N0.:
`(10) Patent No.:
`(45) Date of Patent:
`(45) Date of Patent:
`
`US 8,508,751 B1
`US 8,508,751 B1
`Aug. 13, 2013
`Aug. 13, 2013
`
`(54)
`(54)
`
`CAPTURING REAL-TIME VIDEO WITH
`CAPTURING REAL-TIME VIDEO WITH
`ZOOMING CAPABILITY AND SCANNING
`ZOOMING CAPABILITY AND SCANNING
`HIGH RESOLUTION STILL IMAGES OF
`HIGH RESOLUTION STILL IMAGES OF
`DOCUMENTS USING THE SAME
`DOCUMENTS USING THE SAME
`APPARATUS
`APPARATUS
`
`(75)
`(75)
`
`Inventors: Ji Shen, San Diego, CA (US); Dongbing
`Inventors: Ji Shen, San Diego, CA (US); Dongbing
`Zhang, Shanghai (CN)
`Zhang, Shanghai (CN)
`
`(73)
`(73)
`
`Assignee: Pathway Innovations and
`Assignee: Pathway Innovations and
`Technologies, Inc., San Diego, CA (US)
`Technologies, Inc., San Diego, CA (US)
`
`(*)
`
`Notice:
`Notice:
`
`Subject to any disclaimer, the term of this
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`patent is extended or adjusted under 35
`U.S.C. l54(b) by 0 days.
`U.S.C. 154(b) by 0 days.
`
`(21)
`(21)
`
`(22)
`(22)
`
`(63)
`(63)
`
`(60)
`(60)
`
`(51)
`(51)
`
`(52)
`(52)
`
`(58)
`(58)
`
`Appl. No.: 13/506,208
`Appl. N0.: 13/506,208
`
`Filed:
`Filed:
`
`Apr. 4, 2012
`Apr. 4, 2012
`
`Related U.S. Application Data
`Related US. Application Data
`
`No.
`No.
`
`application
`of
`Continuation
`application
`of
`Continuation
`PCT/US20l l/022549, filed on Jan. 26,2011.
`PCT/US2011/022549, ?led on Jan. 26,2011.
`Provisional application No. 61/298,912, filed on Jan.
`Provisional application No. 61/298,912, ?led on Jan.
`28, 2010.
`28, 2010.
`Int. Cl.
`Int. Cl.
`G06F 3/12
`(2006.01)
`(2006.01)
`G06F 3/12
`U.S. Cl.
`US. Cl.
`USPC ......................................................... .. 358/1.1
`USPC ......................................................... .. 358/11
`Field of Classification Search
`Field of Classi?cation Search
`USPC ......................................................... .. 358/1.1
`USPC ......................................................... .. 358/1.1
`See application file for complete search history.
`See application ?le for complete search history.
`
`(56)
`(56)
`
`References Cited
`References Cited
`U.S. PATENT DOCUMENTS
`U.S. PATENT DOCUMENTS
`5,894,529 A
`4/1999 Ting
`5,894,529 A
`4/1999 Ting
`RE42,898 E *
`11/2011 Shimizu et al.
`........ .. 348/240.99
`RE42,898 E * 11/2011 ShimiZu et al. ........ .. 348/24099
`2005/0177783 A1
`8/2005 Agrawala et al.
`2005/0177783 A1
`8/2005 AgraWala et al.
`2005/0206912 A1*
`9/2005 Megawa ...................... .. 358/1.1
`2005/0206912 A1* 9/2005 MegaWa ...................... .. 358/1.1
`2006/0012830 A1
`1/2006 Aiso
`2006/0012830 A1
`1/2006 Aiso
`2006/0277393 A1
`12/2006 Wu et al.
`2006/0277393 A1 12/2006 Wu et al.
`2009/0067724 A1
`3/2009 Hirohata
`2009/0067724 A1
`3/2009 Hirohata
`OTHER PUBLICATIONS
`OTHER PUBLICATIONS
`International Search Report mailed Mar. 25, 201 1, for PCT/US2011/
`International Search Report mailed Mar. 25, 201 1, for PCT/US2011/
`022549 filed Jan. 26, 2011.
`022549 ?led Jan. 26, 2011.
`
`* cited by examiner
`* cited by examiner
`
`Primary Examiner — Eric A Rust
`Primary Examiner * Eric A Rust
`(74) Attorney, Agent, or Firm — RatnerPrestia
`(74) Attorney, Agent, or Firm * RatnerPrestia
`
`ABSTRACT
`(57)
`ABSTRACT
`(57)
`Disclosed is a method of acquiring an image of a target to
`Disclosed is a method of acquiring an image of a target to
`provide an output video image that has a plurality of frame
`provide an output video image that has a plurality of frame
`images. The method includes the steps ofreceiving a series of
`images. The method includes the steps of receiving a series of
`frame images from a video camera, using a processor to
`frame images from a video camera, using a processor to
`manipulate the series of frame images, which includes deter-
`manipulate the series of frame images, Which includes deter
`mining a reference resolution for providing output frame
`mining a reference resolution for providing output frame
`images, and displaying and/or storing the manipulated series
`images, and displaying and/or storing the manipulated series
`of frame images as the output video image without changing
`of frame images as the output video image Without changing
`a resolution of the output frame images. Also disclosed is a
`a resolution of the output frame images. Also disclosed is a
`document imaging apparatus that includes a digital imaging
`document imaging apparatus that includes a digital imaging
`unit. The document imaging apparatus also includes a pro-
`unit. The document imaging apparatus also includes a pro
`cessor that is coupled to the digital imaging unit and that is
`cessor that is coupled to the digital imaging unit and that is
`configured to cause the digital imaging unit to zoom in or
`con?gured to cause the digital imaging unit to Zoom in or
`zoom out in real-time while maintaining a resolution value of
`Zoom out in real-time While maintaining a resolution value of
`stored images constant.
`stored images constant.
`20 Claims, 9 Drawing Sheets
`20 Claims, 9 Drawing Sheets
`
`
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 1 of9
`Sheet 1 019
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`FIG. 1
`aGE
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 2 of9
`Sheet 2 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`(PriorArt)
`e2 sea
`
`N .65
`FIG.2
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 3 of9
`Sheet 3 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`m m .UE
`
`FIG.3a
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 4 of9
`Sheet 4 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`FIG.3b
`mm .UE
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 5 of9
`Sheet 5 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`\O
`
`306
`9‘ 1
`
`o
`310
`¢'2\
`
`°¢°
`308
`"‘
`
`8
`
`V1
`V1
`‘"1
`Q
`("1
`
`9(
`
`2f
`
`O‘
`'1
`(‘'1
`
`G(
`
`\O
`O
`m
`
`FIG. 30
`
`o
`I;
`
`8
`m
`
`FIG.3c
`
`J
`
`m
`
`g
`
`W
`O
`m
`
`\0
`306
`O
`m \
`LJ_________._-J__
`309
`
`308
`2
`8
`31
`m
`M
`L
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 6 of9
`Sheet 6 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`318
`
`FIG.3d
`
`um .05
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 7 of9
`Sheet 7 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`404
`404
`r\/
`ERROR PROCESSING
`ERROR PROCESSING
`
`IEHNNII
`
`402
`
`406
`
`NO
`
`YES
`
`INITIAL BOOT SEQUENCE
`INITIAL BOOT SEQUENCE
`
`408
`408
`f\/
`I
`DETECT SENSOR TYPE
`DETECT SENSOR TYPE
`
`410
`410
`[J
`II
`ACQUIRE VIDEO STREAM
`ACQUIRE VIDEO STREAM
`OPEN DATA OUTPUT PORT 412
`OPEN DATA OUTPUT PORT
`.§ ._.x l\)
`[J
`II
`EXTRACT NEXT IMAGE
`
`EXTRACT NEXT IMAGE FRAME
`FRAME
`
`=
`
`ALIDATE
`AUDATE
`FRAME
`
`
`
`416
`f\/
`ERROR PROCESSING
`ERROR PROCESSING
`
`
`420
`,\/
`
`
`
`
`
`
`
`YES
`
`418
`418
`/\/
`ENCODE FRAMES INTo
`ENCODE FRAMES INTO
`USB DATA STREAM
`USB DATA STREAM
`
`‘
`'
`
`OUTPUT USB
`OUTPUT USB
`DATA STREAM
`DATA STREAM
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 8 M9
`Sheet 8 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`START
`502
`START
`502 I
`,,
`ACQUIRE LIVE VIDEO
`AOOUIRE LIVE VIDEO
`STREAM FROM USB
`STREAM FROM USB
`5041
`504
`
`"
`SET MAXIMUM
`SET MAXIMUM
`RESOLUTION PER
`RESOLUTION PER
`FRAME
`FRAME
`
`506K
`506
`ACQUIRE BITMAP
`IMAGE As VIDEO
`IMAGE AS VIDEO
`STREAM
`STREAM
`
`512
`-————-—I / 512
`RENDER VIDEO BITMAP
`RENDER VIDEO BITMAP
`STREAM CONTINUOUSLY B
`STREAM CONTINUOUSLY
`0“ SCREEN
`ON SCREEN
`
`,
`@F
`0,4
`
`516a
`I
`ENLéRiO/EDOER REOLhI'IéE
`YES ENLéE(\3/IIEDOER REDLIJEEE
`OF A
`EA
`0 F A
`EA
`BITMAP BY SCALING
`BITMAP BY SCALING
`FACTOR
`FACTOR
`
`I 516b
`IDEO
`T E
`OFIITIBANBO
`YES °§,§§“EAE B’,ITC,\',?A¥, BY
`I
`PAN MOVEMENT
`7
`PAN MOVEMENT
`VECTOR
`VECTOR
`
`.
`
`508
`508
`‘I
`I
`DETECT SCREEN
`DETECT SCREEN
`RESOLUTION
`RESOLUTION
`
`510
`
`510T
`SCALE MAGE
`SCALE IMAGE
`BITMAP To FIT
`BITMAP TO FIT
`SCREEN SIZE
`SCREEN SIZE
`L—-————-—————
`
`A
`
`Fl 5
`Fl 5
`
`RECORD \/|DEO
`RECORD V|DEO
`EVENT ’_)
`EVENT?
`
`YES
`
`END
`
`NO
`
`R5160
`ROTATE EACH VIDEO
`ROTATE EACH VIDEO
`FRAME BITMAP BY
`FRAME BITMAP BY
`ROTATION ANGLE
`ROTATION ANGLE
`& 516d
`REDUCE EACH VIDEO
`REDUCE EACH VIDEO
`FRAME BITMAP TO
`FRAME BITMAP TO
`AREA INSIOE CROP BOX
`AREA INSIDE CROP BOX
`y 5168
`CAPTURE CURRENT
`CAPTURE CURRENT
`VIDEO FRAME BITMAP
`VIDEO FRAME BITMAP
`AFTER ALL PREvIOUS
`AFTER ALL PREVIOUS
`TRANSFORMATION AND
`TRANSFORMATION AND
`SAVE IN FILE OR
`SAVE IN FILE OR
`MEMORY
`MEMORY
`CAPTURE CONTINUOUS
`CAPTURE CONTINUOUS
`AND MULTIPLE VIDEO
`AND MULTIPLE VIDEO
`FRAMES TO SAVE IN
`FRAMES TO SAVE IN
`MEMORY OR FILE
`MEMORY OR FILE
`L516T
`
`

`
`US. Patent
`U.S. Patent
`
`Aug. 13, 2013
`Aug. 13, 2013
`
`Sheet 9 0f 9
`Sheet 9 of9
`
`US 8,508,751 B1
`US 8,508,751 B1
`
`r
`
`614
`
`r‘) \
`
`REALTIME ZOOM-IN AND ZOOM-OUT PROCESSING
`REALTIME ZOOM-IN AND ZOOM-OUT PROCESSING
`616a
`616b
`616a
`616b
`
`CAPTURE 3 MEGA-PIXEL
`CAPTURE 3 MEGA-PIXEL
`TO 20 MEGA-PIXEL OR
`TO 20 MEGA-PIXEL OR
`INAGE OR vIDEO
`IMAGE OR VIDEO
`
`RKE§YPBOOII%B5gE
`R§§§$j§§5§
`
`6160
`N
`RESIzE DISPLAY IMAGE
`RESIZE DISPLAY IMAGE
`ON SCREEN TO ACHIEVE
`ON SCREEN TO ACHIEVE
`EFFECTS
`EFFECTS
`
`(
`
`"a
`
`604 (
`602
`~/ AuTO-STRAIGHTENING v AUTO-CORRECTION
`AUTO-STRAIGHTENING
`AUTO-CORRECTION
`PROCESSING
`PROCESSING
`PROCESSING
`PROCESSING
`
`i396
`
`\
`
`AUTO-CROPPING
`AUTO-CROPPING
`PROCESSING
`PROCESSING
`
`\
`
`J
`
`\
`
`J
`
`C
`
`(—“"—"_“"'—\
`608
`AUTOMATIC SHADOW
`AuTONATIC SHADOW A,
`REMOVAL PROCESSING
`REMOVAL PROCESSING
`
`w r
`610
`AUTOMATIC GLARE
`AUTOMATIC GLARE v
`SPOT REMOVAL
`SPOT REMOVAL
`
`IMAGE FILE
`INAGE FILE
`MANAGEMENT
`NANAGENIENT
`
`J
`612
`/\/
`N
`
`L_—_—_) x
`
`J
`
`k
`
`1
`
`FIG. 6
`FIG. 6
`
`

`
`US 8,508,751 B1
`US 8,508,751 B1
`
`1
`1
`CAPTURING REAL-TIME VIDEO WITH
`CAPTURING REAL-TIME VIDEO WITH
`ZOOMING CAPABILITY AND SCANNING
`ZOOMING CAPABILITY AND SCANNING
`HIGH RESOLUTION STILL IMAGES OF
`HIGH RESOLUTION STILL IMAGES OF
`DOCUMENTS USING THE SAME
`DOCUMENTS USING THE SAME
`APPARATUS
`APPARATUS
`
`This is a ContinuationApplication under 35 U.S.C. §111 of
`This is a ContinuationApplication under 35 U.S.C. §111 of
`International Application PCT/US2011/022549 filed Jan. 26,
`International Application PCT/US2011/022549 ?led J an. 26,
`2011, which claims priority to Provisional Application No.
`2011, Which claims priority to Provisional Application No.
`61/298,912 filed Jan. 28, 2010; the contents of are each
`61/298,912 ?led Jan. 28, 2010; the contents of are each
`hereby incorporated by reference in their entirety.
`hereby incorporated by reference in their entirety.
`FIELD
`FIELD
`
`The disclosure generally relates to document cameras and
`The disclosure generally relates to document cameras and
`to the field of document scarming apparatuses, and methods
`to the ?eld of document scanning apparatuses, and methods
`for both capturing real-time video with zooming capability
`for both capturing real-time video With Zooming capability
`and scarming high resolution still images of documents using
`and scanning high resolution still images of documents using
`the same apparatus.
`the same apparatus.
`
`BACKGROUND
`BACKGROUND
`
`In the field of document cameras, it is desirable for an
`In the ?eld of document cameras, it is desirable for an
`apparatus to capture real-time video streams with the highest
`apparatus to capture real-time video streams With the highest
`clarity possible With Zooming-in and Zooming-out capability.
`clarity possible with zooming-in and zooming-out capability.
`Prior art of this field have achieved zoomable video directly
`Prior art of this ?eld have achieved Zoomable video directly
`output to video projectors with video resolution normally in
`output to video projectors With video resolution normally in
`Video Graphics Array (“VGA”) range of 640x480 or Super
`Video Graphics Array (“VGA”) range of 640x480 or Super
`VGA (SVGA) 800><600 display resolution range and rarely
`VGA (SVGA) 800x600 display resolution range and rarely
`can reach a resolution as high as 1920><1280 without drasti-
`can reach a resolution as high as 1920x1280 Without drasti
`cally increasing the cost needed to build such as device.
`cally increasing the cost needed to build such as device.
`Such a limitation often comes from the limited resolution
`Such a limitation often comes from the limited resolution
`ofvideo display projectors and the processing capacity of the
`of video display projectors and the processing capacity of the
`electronic components which must support the document
`electronic components Which must support the document
`carnera’s ability to directly out put analog video signal to the
`camera’s ability to directly out put analog video signal to the
`projector. In order for a document camera based on prior art to
`projector. In order for a document camera based on prior art to
`capture real-time video with high resolution images, high
`capture real-time video With high resolution images, high
`quality tele-focal lens assembly must be employed to zoom in
`quality tele-focal lens assembly must be employed to Zoom in
`and/or out on the object of interest to compensate the limita-
`and/ or out on the object of interest to compensate the limita
`tion in the electronic circuitry responsible for sensing, gen-
`tion in the electronic circuitry responsible for sensing, gen
`erating, and outputting frames of images in a video stream.
`erating, and outputting frames of images in a video stream.
`Such limitation in the electronic circuitry of document cam-
`Such limitation in the electronic circuitry of document cam
`eras based on prior art makes it unsuitable for capturing high
`eras based on prior art makes it unsuitable for capturing high
`resolution still
`images required for document archiving,
`resolution still images required for document archiving,
`copying and display applications. The necessary employment
`copying and display applications. The necessary employment
`of an optical lens assembly makes it mandatory for these
`of an optical lens assembly makes it mandatory for these
`document cameras to often have elaborate motorized housing
`document cameras to often have elaborate motoriZed housing
`for the lenses, which results inevitably in relatively heavy
`for the lenses, Which results inevitably in relatively heavy
`structural configurations requiring considerably sized bottom
`structural con?gurations requiring considerably siZed bottom
`panels serving as both a stabilizing plate and a housing for the
`panels serving as both a stabiliZing plate and a housing for the
`electronics. Due to such reasons, these document cameras
`electronics. Due to such reasons, these document cameras
`take away significant desktop space and have less than desir-
`take aWay signi?cant desktop space and have less than desir
`able portability. As an example, a prior art digital document
`able portability. As an example, a prior art digital document
`camera is commercially available from an unbranded inter-
`camera is commercially available from an unbranded inter
`national OEM supplier, is shown in FIG. 1.
`national OEM supplier, is shoWn in FIG. 1.
`Other document scarming prior art methods teach methods
`Other document scanning prior art methods teach methods
`offlatbed scanners or scarming assembly working in conjunc-
`of ?atbed scanners or scanning assembly Working in conjunc
`tion with a motorized document feeder to capture high reso-
`tion With a motoriZed document feeder to capture high reso
`lution images often in the range of 150 dpi to 600 dpi range.
`lution images often in the range of 150 dpi to 600 dpi range.
`FIG. 2 shows a typical flatbed scarmer apparatus, such as a
`FIG. 2 shoWs a typical ?atbed scanner apparatus, such as a
`ScanJet 5590 Digital Flatbed Scanner by Hewlett Packard.
`ScanJet 5590 Digital Flatbed Scanner by HeWlett Packard.
`However, such an apparatus must require a platen of certain
`HoWever, such an apparatus must require a platen of certain
`minimum dimensions, which can accommodate various sizes
`minimum dimensions, Which can accommodate various siZes
`of commonly used paper, and must have significant height in
`of commonly used paper, and must have signi?cant height in
`order to accomplish the scanning functions in their enclosed
`order to accomplish the scanning functions in their enclosed
`housing of the various mechanical and electronic scanning
`housing of the various mechanical and electronic scanning
`components.As the size ofpaper to be scarmed gets larger, the
`components.As the siZe of paper to be scanned gets larger, the
`
`10
`
`15
`
`20
`20
`
`25
`25
`
`30
`30
`
`35
`35
`
`40
`40
`
`45
`45
`
`50
`50
`
`55
`55
`
`60
`60
`
`65
`65
`
`2
`2
`size of the traditional scarmers will also have to be larger.
`siZe of the traditional scanners Will also have to be larger.
`Such an apparatus is not space eflicient and often has poor
`Such an apparatus is not space e?icient and often has poor
`portability.
`portability.
`Additionally, prior art scanners do not have any ability to
`Additionally, prior art scanners do not have any ability to
`capture real-time video of any objects, and almost impossible
`capture real-time video of any objects, and almost impossible
`to capture any images of three dimensional objects. These
`to capture any images of three dimensional objects. These
`scanners select a sub-area within a preview image of the
`scanners select a sub-area Within a previeW image of the
`document ahead of time, which requires a pre-scan of the
`document ahead of time, Which requires a pre-scan of the
`document and therefore takes longer than a desirable amount
`document and therefore takes longer than a desirable amount
`oftime. Scarming ofpaper documents is also time consuming
`of time. Scanning of paper documents is also time consuming
`ranging from approximately 6 seconds in highly expensive
`ranging from approximately 6 seconds in highly expensive
`professional grade scanners to 12 to 80 seconds in order to
`professional grade scanners to 12 to 80 seconds in order to
`finish a Legal sized document.
`?nish a Legal siZed document.
`U.S. Pat. No. 6,965,460 B1 describes a look-down digital
`US. Pat. No. 6,965,460 B1 describes a look-doWn digital
`imaging device having a linear sensor for imaging a raster line
`imaging device having a linear sensor for imaging a raster line
`of an original image placed substantially below the look-
`of an original image placed substantially beloW the look
`down device, and achieving the capture of a relatively high
`doWn device, and achieving the capture of a relatively high
`resolution image by sweeping a raster line across the scan
`resolution image by sWeeping a raster line across the scan
`area in the same fashion of a flatbed scarmer, also with the aid
`area in the same fashion of a ?atbed scanner, also With the aid
`of a video camera device housed in the same housing unit.
`of a video camera device housed in the same housing unit.
`Although the apparatus described in this reference suspends
`Although the apparatus described in this reference suspends
`the imaging unit on a stand, the time cost, electronic compo-
`the imaging unit on a stand, the time cost, electronic compo
`nents, mechanical components, and potentially motorized
`nents, mechanical components, and potentially motoriZed
`components necessary in tilting and sweeping the raster line
`components necessary in tilting and sWeeping the raster line
`across the entire surface area of a target while capturing the
`across the entire surface area of a target While capturing the
`reflected linear line sequentially one line at a time, were not
`re?ected linear line sequentially one line at a time, Were not
`fully disclosed. It is conceivable that the scanning time con-
`fully disclosed. It is conceivable that the scanning time con
`sumed to sweep the raster line across the entire scarming area
`sumed to sWeep the raster line across the entire scanning area
`can be similar to and not significantly better than the time
`can be similar to and not signi?cantly better than the time
`required by commercial available flatbed scanners. However,
`required by commercial available ?atbed scanners. HoWever,
`this reference does not address the need for speed efliciency
`this reference does not address the need for speed e?iciency
`gains over existing flatbed scanners. The employment of a
`gains over existing ?atbed scanners. The employment of a
`second assisting video camera required in the prior art
`second assisting video camera required in the prior art
`increases the volume and weight of the housing unit. In
`increases the volume and Weight of the housing unit. In
`another aspect, by requiring the inclusion of multiple com-
`another aspect, by requiring the inclusion of multiple com
`ponents, such as the zoomable lenses, the linear scanning
`ponents, such as the Zoomable lenses, the linear scanning
`components, and the video camera, this reference is not
`components, and the video camera, this reference is not
`advantageous in achieving suflicient compactness in possible
`advantageous in achieving su?icient compactness in possible
`embodiments of the apparatus described.
`embodiments of the apparatus described.
`U.S. Pat. No. 6,540,415 B1 describes a stand with a hinged
`US. Pat. No. 6,540,415 B1 describes a stand With a hinged
`housing unit which can hold in place a fully self-contained,
`housing unit Which can hold in place a fully self-contained,
`ready-made, commercially available digital camera, which
`ready-made, commercially available digital camera, Which
`closely resembles a point-and-shoot camera. As commercial
`closely resembles a point-and-shoot camera. As commercial
`digital camera products vary in design form factors, output
`digital camera products vary in design form factors, output
`connection technologies, control button accessibilities, and
`connection technologies, control button accessibilities, and
`built-in imaging functions, this reference may not be adapt-
`built-in imaging functions, this reference may not be adapt
`able to many possible variations to make a commercial
`able to many possible variations to make a commercial
`embodiment practical or advantageous in real life applica-
`embodiment practical or advantageous in real life applica
`tions.
`tions.
`
`SUMMARY
`SUMMARY
`
`Recent advancements in electronic image sensing tech-
`Recent advancements in electronic image sensing tech
`nologies, such as CMOS or CCD sensors, and in compact
`nologies, such as CMOS or CCD sensors, and in compact
`optical lenses, supported by wide commercial adoption of
`optical lenses, supported by Wide commercial adoption of
`compact digital cameras in cellular phones, personal desktop
`compact digital cameras in cellular phones, personal desktop
`computers,
`laptop computers, and myriad other portable
`computers, laptop computers, and myriad other portable
`computing devices, has reduced the cost of digital imaging
`computing devices, has reduced the cost of digital imaging
`optical and sensor units dramatically. The latest webcarn like
`optical and sensor units dramatically. The latest Webcam like
`digital camera imaging units are highly compact in terms of
`digital camera imaging units are highly compact in terms of
`form factor, and can capture images with resolutions ranging
`form factor, and can capture images With resolutions ranging
`from 2 mega-pixel to 10 mega-pixel instantaneously with one
`from 2 mega-pixel to 10 mega-pixel instantaneously With one
`click for an entire US Legal sized paper surface area, and
`click for an entire US Legal siZed paper surface area, and
`more importantly with costs at a fraction of what they used to
`more importantly With costs at a fraction of What they used to
`be. Pixel resolution will increase beyond mega-pixel as much
`be. Pixel resolution Will increase beyond mega-pixel as much
`as 30 mega-pixels and higher, while costs continue to stay low
`as 30 mega-pixels and higher, While costs continue to stay loW
`at the current level as demand for high resolution digital
`at the current level as demand for high resolution digital
`
`

`
`US 8,508,751 B1
`US 8,508,751 B1
`
`3
`3
`imaging units remains strong. With 9 to 10 mega-pixel image
`imaging units remains strong. With 9 to 10 mega-pixel image
`sensing ability in the digital imaging units, one can capture a
`sensing ability in the digital imaging units, one can capture a
`digital image with native resolution equivalent to approxi-
`digital image With native resolution equivalent to approxi
`mately 300 dots per inch (dpi) scanned in image ofa US Legal
`mately 300 dots per inch (dpi) scanned in image of a US Legal
`sized document. With 30 mega-pixels and above image sens-
`siZed document. With 30 mega-pixels and above image sens
`ing ability, one can even approach near 600 dpi native reso-
`ing ability, one can even approach near 600 dpi native reso
`lution for scanning a US Legal sized document.
`lution for scanning a US Legal siZed document.
`Recent developments of personal computing devices have
`Recent developments of personal computing devices have
`made PC’s and other personal computing devices nearly
`made PC’s and other personal computing devices nearly
`ubiquitously available in most developed and developing
`ubiquitously available in most developed and developing
`countries. The presence of such personal computing devices
`countries. The presence of such personal computing devices
`has become a necessary and indispensable part of virtually
`has become a necessary and indispensable part of virtually
`every home and professional office. The application of a
`every home and professional of?ce. The application of a
`document imaging device in accomplishing common docu-
`document imaging device in accomplishing common docu
`ment capturing tasks becomes naturally and necessarily con-
`ment capturing tasks becomes naturally and necessarily con
`nected to personal computing machines, such as a PC or
`nected to personal computing machines, such as a PC or
`Macintosh computer.
`Macintosh computer.
`In view of the aforementioned, a desire exists for a docu-
`In vieW of the aforementioned, a desire exists for a docu
`ment imaging system that is cost efiicient, highly compact or
`ment imaging system that is cost e?icient, highly compact or
`space efiicient, highly portable, and virtually instantaneous in
`space e?icient, highly portable, and virtually instantaneous in
`terms of time efficiency, while at the same time, also being
`terms of time ef?ciency, While at the same time, also being
`capable of producing real-time high resolution zoomable
`capable of producing real-time high resolution Zoomable
`video and being capable of capturing high resolution still
`video and being capable of capturing high resolution still
`images of documents with one click “scan” processing. As an
`images of documents With one click “scan” processing. As an
`example, a user can keep the system on a commonly used
`example, a user can keep the system on a commonly used
`desk surface, without consuming more than approximately
`desk surface, Without consuming more than approximately
`10 square inches of surface area, and can put a document or a
`10 square inches of surface area, and can put a document or a
`3D object under the facing-down image sensing unit of vir-
`3D object under the facing-doWn image sensing unit of vir
`tually any size or shape, and be able to click one button to snap
`tually any siZe or shape, and be able to click one button to snap
`a high resolution image of the object. At the same time, the
`a high resolution image of the object. At the same time, the
`user can transport the apparatus to a classroom setting to
`user can transport the apparatus to a classroom setting to
`visually presenting instructional materials through a con-
`visually presenting instructional materials through a con
`nected projector on a large screen, with real-time video, while
`nected projector on a large screen, With real-time video, While
`maintaining the ability to zoom in and out on the object.
`maintaining the ability to Zoom in and out on the object.
`A further desire exists for the compact document imaging
`A further desire exists for the compact document imaging
`system to be fully self-contained with internally integrated
`system to be fully self-contained With internally integrated
`and fully controllable image or video sensing and processing
`and fully controllable image or video sensing and processing
`units, without externally combining or fitting with any other
`units, Without externally combining or ?tting With any other
`self-contained product, such as a commercial point-and-
`self-contained product, such as a commercial point-and
`shoot digital camera. For example, such a compact and self-
`shoot digital camera. For example, such a compact and self
`contained nature shall enable a business user to easily carry
`contained nature shall enable a business user to easily carry
`the system in a briefcase or other travel sized bag.
`the system in a briefcase or other travel siZed bag.
`Disclosed is a method of acquiring an image of a target to
`Disclosed is a method of acquiring an image of a target to
`provide an output video image that has a plurality of frame
`provide an output video image that has a plurality of frame
`images. The method includes the steps ofreceiving a series of
`images. The method includes the steps of receiving a series of
`frame images from a video camera, using a processor to
`frame images from a video camera, using a processor to
`manipulate the series of frame images, which includes deter-
`manipulate the series of frame images, Which includes deter
`mining a reference resolution for providing output frame
`mining a reference resolution for providing output frame
`images, and displaying and/or storing the manipulated series
`images, and displaying and/or storing the manipulated series
`of frame images as the output video image without ever
`of frame images as the output video image Without ever
`changing a resolution of the output frame images.
`changing a resolution of the output frame images.
`Alternative embodiments of the method also include the
`Altemative embodiments of the method also include the
`step of executing the manipulation in an amount of time short
`step of executing the manipulation in an amount of time short
`enough so that the manipulation step is not perceived by a
`enough so that the manipulation step is not perceived by a
`user, i.e., in real time. Typically, manipulation in real time
`user, i.e., in real time. Typically, manipulation in real time
`would be such that the manipulation would cause no more
`Would be such that the manipulation Would cause no more
`than a delay of twenty milliseconds between the time that the
`than a delay of tWenty milliseconds betWeen the time that the
`user enters a command and the command is executed. Addi-
`user enters a command and the command is executed. Addi
`tional steps of the alternative embodiments include identify-
`tional steps of the alternative embodiments include identify
`ing a first resolution for the received plurality offrame images
`ing a ?rst resolution for the received plurality of frame images
`and identifying a second resolution for the reference resolu-
`and identifying a second resolution for the reference resolu
`tion. In the case ofa manipulated frame image having a higher
`tion. In the case of a manipulated frame image having a higher
`resolution, as manipulated, than the second resolution, reduc-
`resolution, as manipulated, than the second resolution, reduc
`ing the resolution of the frame image to that of the second
`ing the resolution of the frame image to that of the second
`resolution; and in the case of the manipulated frame image
`resolution; and in the case of the manipulated frame image
`having a lower resolution, as manipulated, than the second
`having a loWer resolution, as manipulated, than the second
`resolution, using the processor to further manipulate the
`resolution, using the processor to further manipulate the
`
`10
`
`15
`
`20
`20
`
`25
`25
`
`30
`30
`
`35
`35
`
`40
`40
`
`45
`45
`
`50
`50
`
`55
`55
`
`60
`60
`
`65
`65
`
`4
`4
`frame image to reduce pixilation. The disclosed method will
`frame image to reduce pixilation. The disclosed method Will
`work whether the processor is housed in an external personal
`Work Whether the processor is housed in an external personal
`computer or if it is housed in an apparatus that contains all of
`computer or if it is housed in an apparatus that contains all of
`the disclosed components.
`the disclosed components.
`When the processor manipulates the frame image, manipu-
`When the processor manipulates the frame image, manipu
`lation can be any one or more of re-sizing the image, panning
`lation can be any one or more of re-siZing the image, panning
`the image in a selected direction, rotating the image in a
`the image in a selected direction, rotating the image in a
`selected direction, or armotating the image. If the image is
`selected direction, or annotating the image. If the image is
`resized it can also be annotated at the same time that it is b