PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Application Data Sheet 37 CFR 1.76
`
`Attorney Docket Number
`_
`_
`Application Number
`
`117313—003UTL
`
`Title of Invention
`
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
`
`The application data sheet is part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paper filed application.
`
`Secrecy Order 37 CFR 5.2
`
`|:| Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`Applicant Information:
`Applicant 1
`Applicant Authority @|nventor | OLegal Representative under 35 U.S.C. 117
`Prefix Given Name
`Middle Name
`
`|OParty of Interest under 35 U.S.C. 118
`Family Name
`Suffix
`
`Residence Information (Select One) @ US Residency Q Non US Residency O Active US Military Service
`
`City
`
`San Diego
`
`
`StateIProvince
`CA
`Country of Residencei
`US
`
`Citizenship under 37 CFR1.41(b)i
`
`US
`
`Mailing Address of Applicant:
`
`Address 1
`
`Address 2
`
`16340 Avenida Venusto, Unit A
`
`Applicant 2
`C)Party of Interest under 35 U.S.C. 118
`Applicant Authority @|nventor OLegal Representative under 35 U.S.C. 117
`Family Name
`Suffix
`Prefix Middle Name
`— DeBe“°
`Residence Information (Select One) @ US Residency O Non US Residency O Active US Military Service
`StateIProvince
`Country of Residencei
`S
`
`
`
`Citizenship under 37 CFR1.41(b)i
`
`Mailing Address of Applicant:
`
`373 San Gorgonio Street
`
` Address 1
`
`
`Address 2
`
`Postal Code
`
`S*a*elPr°vl"ce
`US
`
`Inventor Information blocks may be
`Inventors Must Be Listed - Additional
`All
`generated within this form by selecting the Add button.
`
`Add
`
`Correspondence Information:
`
`Enter either Customer Number or complete the Correspondence Information section below.
`
`For further information see 37 CFR 1.33(a). |:| AP
`
`afing provided for the correspondence |nformaf¥mr?HlS'sjpHilT§tE§{HIBH~ 1011
`
`EFS Web 2.2.2
`
`Page 1 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`
` Attorney Docket Number
`117313—003UTL
`
`Application Number
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
` Title of Invention
`
`
`Application Data Sheet 37 CFR 1.76
`
`
`
`Customer Number
`
`27189
`
`Email Address Amman
`
`Application Information:
`
`Title of the Invention
`
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
`
`Attorney Docket Number
`
`117313—003UTL
`
`Small Entity Status Claimed
`
`Application Type
`
`Subject Matter
`
`Nonprovisional
`
`Utility
`
`
`
`
`
`
`Suggested Technology Center (if any)
`
`
`Suggested Figure for Publication (if any)
`
`
`Total Number of Drawing Sheets (if any)
`
`Suggested Class (if any)
`
`Sub Class (if any)
`
`Publication Information:
`
`|:| Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Request N012 IEO Publish. I hereby request that the attached application not be published under 35 U.S.
`E] C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the subject of
`an application filed in another country, or under a multilateral international agreement, that requires publication at
`eighteen months after filing.
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Enter
`either Customer Number
`or
`complete
`the
`Representative Name
`section
`below.
`If
`both
`are completed the Customer Number will be used for the Representative Information during processing.
`
`sections
`
`27189
`
`Please Select One:
`Customer Number
`
`@ Customer Number
`
`0 US Patent Practitioner 0 Limited Recognition (37 CFR 11.9)
`
`Domestic BenefitINational Stage Information:
`
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, or 365(0) or indicate National Stage
`entry from a PCT application. Providing this information in the application data sheet constitutes the specific reference required by
`35 U.S.C. 119(e) or 120, and 37 CFR 1.78(a)(2) or CFR 1.78(a)(4), and need not otherwise be made part of the specification.
`
`Prior Application Status
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Filing Date (YYYY-MM-DD)
`
`Continuation in part of
`
`12/778943
`
`2010-05-12
`
`Prior Application Status
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Filing Date (YYYY-MM-DD)
`
`Page ,) Gf L40
`EFS Web 2.2.2
`
`Continuation in part of
`
`12/346026 ROTHSCHHJfg0fi— T L01 1
`
`Page 2 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`
` Attorney Docket Number
`117313—0O3UTL
`
`Application Number
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
` Title of Invention
`
`
`Application Data Sheet 37 CFR 1.76
`
`
`
`Prior Application Status
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Filing Date (YYYY-MM-DD)
`
`12346026
`
`non provisional of
`
`61/022279
`
`2008-01-18
`
`Additional Domestic Benefit/National Stage Data may be generated within this form
`by selecting the Add button.
`
`Add
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim benefit of foreign priority and to identify any prior foreign application for which priority is
`not claimed. Providing this information in the application data sheet constitutes the claim for priority as required by 35 U.S.C. 119(b)
`and 37 CFR 1.55(a).
`
`.
`
`.
`
`Application Number
`
`Country I
`Parent Filing Date (YYYY-MM-DD}
`
`
`Priority Claimed
`
`0 Yes @ No
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`Add
`
`Assignee Information:
`Providing this information in the application data sheet does not substitute for compliance with any requirement of part 3 of Title 37
`of the CFR to have an assignment recorded in the Office.
`
`Assi nee 1
`
`
`If the Assignee is an Organization check here.
`
`Organization Name
`
`Mitek systems
`
`Mailing Address Information:
`
`Address 1
`
`Address 2
`
`8911 Balboa Avenue, Suite B
`
`Ph°"eNUmber —
`Email Address
`
`Additional Assignee Data may be generated within this form by selecting the Add
`button.
`
`Add
`
`Signature:
`
`A signature of the applicant or representative is required in accordance with 37 CFR 1.33 and 10.18. Please see 37
`CFR 1.4(d) for the form of the signature.
`
`Signature First Name
`
`/Jeffrey S. King.’
`
`Jeffrey 8.
`
`Date (YYYY-MM-DD)
`
`Registration Number
`
`2010-10-15
`
`58791
`
`Page 3 of 140
`EFS Web 2.2.2
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 3 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`PTOISBI14 (07-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`.
`.
`Application Data Sheet 37 CFR 1.76
`
`Aeemev eeeke Number
`_
`_
`
`Aeeheeeee Nemeer T Title of Invention
`
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U_S_C_ 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.0. Box 1450, Alexandria, VA 22313-1450.
`
`Page 4 of 140
`EFS Web 2.2.2
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 4 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to
`a patent application or patent. Accordingly, pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the collection
`of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is
`used by the U.S. Patent and Trademark Office is to process and/or examine your submission related to a patent application or patent.
`If you do not
`furnish the requested information, the U.S. Patent and Trademark Office may not be able to process and/or examine your submission, which may
`result in termination of proceedings or abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1.
`
`The information on this form will be treated confidentially to the extent allowed under the Freedom of Information Act (5 U.S.C. 552)
`and the Privacy Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Department of Justice to determine
`whether the Freedom of Information Act requires disclosure of these records.
`
`A record from this system of records may be disclosed, as a routine use, in the course of presenting evidence to a court, magistrate, or
`administrative tribunal, including disclosures to opposing counsel in the course of settlement negotiations.
`
`A record in this system of records may be disclosed, as a routine use, to a Member of Congress submitting a request involving an
`individual, to whom the record pertains, when the individual has requested assistance from the Member with respect to the subject matter of
`the record.
`
`A record in this system of records may be disclosed, as a routine use, to a contractor of the Agency having need for the information in
`order to perform a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`
`A record related to an International Application filed under the Patent Cooperation Treaty in this system of records may be disclosed,
`as a routine use, to the International Bureau of the World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`
`A record in this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security
`review (35 U.S.C. 181) and for review pursuant to the Atomic Energy Act (42 U.S.C. 218(c)).
`
`A record from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or his/her designee,
`during an inspection of records conducted by GSA as part of that agency's responsibility to recommend improvements in records
`management practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the
`GSA regulations governing inspection of records for this purpose, and any other relevant (i.e., GSA or Commerce) directive. Such
`disclosure shall not be used to make determinations about individuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public after either publication of the application pursuant
`to 35 U.S.C. 122(b) or issuance ofa patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record was filed in an application which became abandoned or in which the proceedings were
`terminated and which application is referenced by either a published application, an application open to public inspections or an issued
`patent.
`
`A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local law enforcement agency, if the
`USPTO becomes aware of a violation or potential violation of law or regulation.
`
`Page 5 of 140
`EFS Web 2.2.2
`
`ROTHSCHILD EXHIBIT 101 1
`
`Page 5 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: 117313-003UTL
`
`PATENT
`
`SPECIFICATION
`
`SYSTEMS FOR MOBILE IMAGE CAPTURE AND REMITTANCE PROCESSING
`
`RELATED APPLICATIONS INFORMATION
`
`[0001]
`
`This application is a continuation in part of copending U.S. Patent Application Serial
`
`No. 12/778,943 filed on May 12, 2010, and is also a continuation in part of U.S. Patent
`
`application Serial Number 12/346,026 filed December 30, 2008, which in turn claims the benefit
`
`of U.S. Provisional application Serial Number 61/022,279 filed January 18, 2008, all of which
`
`are incorporated herein by reference in their entirety as if set forth in full. This application is
`
`also related to U.S. Patent Application Serial No. 12/717,080 filed March 3, 2010, which is now
`
`U.S. Patent No. 7,778,457, which is incorporated herein by reference in its entirety as if set forth
`
`in full.
`
`1.
`
`Technical Field
`
`BACKGROUND
`
`[0002]
`
`The embodiments described herein generally relate to automated document
`
`processing and more particularly, to systems and methods for document image processing that
`
`enhances an image for data extraction from images captured on a mobile device with camera
`
`capabilities.
`
`2.
`
`Related Art
`
`[0003]
`
`Remittance processing services provide payment processing services for other
`
`businesses. A remittance processing service may be set up by a bank. Often these services set
`
`up one or more post office boxes for receiving payments from customers in the form of paper
`
`checks. Typically the user will include a remittance slip or remittance coupon with the payment.
`
`[0004]
`
`Banks and other businesses often provide remittance slips or coupons that a customer
`
`can include with a payment. These coupons may be included with an invoice or provided to a
`
`customer in advance. For example, some mortgage lenders or automobile lenders provide a book
`
`117313/003UTL/1251947.03
`
`Page 6 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 6 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: 117313-003UTL
`
`PATENT
`
`of remittance coupons to customers who then tear out a mail a remittance coupon with each
`
`scheduled payment. The remittance coupons generally include customer account information, an
`
`amount due, and a due date for the payment. The customer account information might include
`
`an account holder name, mailing address, and a customer account number. Other information,
`
`such as the mailing address of the bank or business may also be included on the remittance
`
`coupon. Some remittance coupons also include computer-readable bar codes or code lines that
`
`include text or other computer-readable symbols that can be used to encode account-related
`
`information that can be used to reconcile a payment received with the account for which the
`
`payment is being made. The bar code or code line can be detected and decoded by a computer
`
`system to extract the information encoded therein.
`
`[0005]
`
`In general, the remittance coupon is mailed with a check or other form of payment to
`
`the bank or other business or to a payment processing company designated by the bank or other
`
`business.
`
`In some systems, data entry clerks may manually enter payment information into a
`
`payment processing system.
`
`In other systems, the remittance coupon and/or the check may be
`
`scanned by a computer system for automated processing.
`
`SUMMARY
`
`[0006]
`
`Systems and method are provided for capturing and processing images of remittance
`
`coupons using a mobile device, such as a mobile phone. Embodiments of the systems and
`
`methods described herein provide image optimization and enhancement such that data can be
`
`extracted from the remittance coupon for processing by a remittance processing service. In some
`
`embodiments, an image of a check can also be captured to be processed as a payment associated
`
`with the remittance coupon.
`
`Some embodiments described herein involve a mobile
`
`communication device capturing an image of a document and transmitting the captured image to
`
`a server for image optimization and enhancement. Techniques for assessing the quality of
`
`images of documents captured using the mobile device are also provided. The tests can be
`
`selected based on the type of document that was imaged, the type of mobile application for
`
`which the image quality of the mobile image is being assessed, and/or other parameters such as
`
`the type of mobile device and/or the characteristics of the camera of the mobile device that was
`
`117313/003UTL/125194703
`
`Page 7 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 7 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 17313-003UTL
`
`PATENT
`
`used to capture the image. In some embodiments, the image quality assurance techniques can be
`
`implemented on a remote server, such as a mobile phone carrier’s server or a web server, and the
`
`mobile device routes the mobile image to be assessed and optional processing parameters to the
`
`remote server processing and the test results can be passed from the remote server to the mobile
`
`device.
`
`[0007]
`
`According to an embodiment, a computer implemented method for mobile image
`
`capture and remittance processing is provided where one or more processors are programmed to
`
`perform steps of the method. The steps of the method include receiving a mobile image of a
`
`remittance coupon captured using a mobile device, detecting the remittance coupon within the
`
`mobile image of the remittance coupon, generating a document subimage that includes a portion
`
`of the mobile image that corresponds to the remittance coupon, geometrically correcting the
`
`mobile document image of the remittance coupon to generate a geometrically corrected image,
`
`processing the geometrically corrected image to generate a processed image, executing the one
`
`or more mobile image quality assurance tests on the processed image to assess the quality of the
`
`processed image; and executing one or more remittance processing steps on the processed image
`
`if the processed image passes the mobile image quality assurance tests.
`
`[0008]
`
`According to another embodiment, a system for mobile image capture and remittance
`
`processing is provided. The system includes a mobile device that is configured to capture a
`
`mobile image of a remittance coupon using a mobile device, detect the remittance coupon within
`
`the mobile image of the remittance coupon using a processor of the mobile device and generating
`
`a document subimage that includes a portion of the mobile image that corresponds to the
`
`remittance coupon, and transmit the mobile document subimage to a server. The system also
`
`includes a mobile remittance server that includes an image correction module, a test execution
`
`module, and a remittance processing module. The image correction module is configured to
`
`geometrically correct the mobile document
`
`image of the remittance coupon to generate a
`
`geometrically corrected image, process the geometrically corrected image at
`
`the server to
`
`generate a processed image. The test execution module is configured to execute the one or more
`
`mobile image quality assurance tests on the processed image to assess the quality of the
`
`processed image and to provide the processed image to the remittance processing module if the
`
`117313/003UTL/125194703
`
`Page 8 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 8 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 17313-003UTL
`
`PATENT
`
`processed image passes the mobile image quality assurance tests. The remittance processing
`
`module is configured to execute one or more remittance processing steps on the processed
`
`image.
`
`[0009]
`
`Other features and advantages of the present invention should become apparent from
`
`the following description of the preferred embodiments,
`
`taken in conjunction with the
`
`accompanying drawings, which illustrate, by way of example, the principles of the invention.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0010]
`
`The various embodiments provided herein are described in detail with reference to the
`
`following figures. The drawings are provided for purposes of illustration only and merely depict
`
`typical or example embodiments.
`
`These drawings are provided to facilitate the reader’s
`
`understanding of the invention and shall not be considered limiting of the breadth, scope, or
`
`applicability of the embodiments. It should be noted that for clarity and ease of illustration these
`
`drawings are not necessarily made to scale.
`
`[0011]
`
`FIG.
`
`1
`
`is an image of a remittance coupon 100 illustrating an example remittance
`
`coupon that might be imaged with the systems and methods described herein.
`
`[0012]
`
`FIG. 2 is a geometrically corrected image created using image processing techniques
`
`disclosed herein using the mobile image of the remittance coupon 100 illustrated in FIG. l.
`
`[0013]
`
`FIG. 3 is high level block diagram of a system that can be used to implement the
`
`systems and methods described herein.
`
`[0014]
`
`FIG. 4 is a flow diagram of an example method for capturing an image of a
`
`remittance coupon using a mobile device according to an embodiment.
`
`[0015]
`
`FIG. 5 is a flow diagram of an example method for processing an image of a
`
`remittance coupon captured using a mobile device according to an embodiment.
`
`[0016]
`
`FIG. 6 is a flow diagram illustrating a method for correcting defects to mobile image
`
`according to an embodiment.
`
`117313/003UTL/125194703
`
`Page 9 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 9 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 17313-003UTL
`
`PATENT
`
`[0017]
`
`FIG. 7 and its related description above provide some examples of how a perspective
`
`transformation can be constructed for a quadrangle defined by the comers A, B, C, and D
`
`according to an embodiment.
`
`[0018]
`
`FIG. 8 is a diagram illustrating an example original image, focus rectangle and
`
`document quadrangle ABCD in accordance with the example of FIG. 7.
`
`[0019]
`
`FIG. 9 is a flow chart for a method that can be used to identify the comers of the
`
`remittance coupon in a color image according to an embodiment.
`
`[0020]
`
`FIG. l0 is a flow diagram of a method for generating a bi-tonal image according to an
`
`embodiment.
`
`[0021]
`
`FIG. ll illustrates an example image binarized image of a remittance coupon
`
`generated from the remittance geometrically corrected remittance coupon image illustrated in
`
`FIG. 2.
`
`[0022]
`
`FIG. 12 is a flow diagram of a method for converting a document image into a
`
`smaller color icon image according to an embodiment.
`
`[0023]
`
`FIG. l3A is a mobile image of a check according to an embodiment.
`
`[0024]
`
`FIG 13B is an example of a color icon image generated using the method of FIG. 12
`
`on the example mobile image of a check illustrated in FIG. l3A according to an embodiment.
`
`[0025]
`
`FIG. l4 is a flow diagram of a method for reducing the color depth of an image
`
`according to an embodiment.
`
`[0026]
`
`FIG. l5A depicts an example of the color “icon” image of FIG. l3B after operation
`
`1302 has divided it into a 3x3 grid in accordance with one embodiment of the invention.
`
`[0027]
`
`FIG. l5B depicts an example of the color “icon” image of FIG. l3B converted to a
`
`gray “icon” image using the method illustrated in FIG. 14 according to an embodiment.
`
`117313/003UTL/125194703
`
`Page 10 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 10 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: 117313-003UTL
`
`PATENT
`
`[0028]
`
`FIG. l6 is a flowchart illustrating an example method for finding document comers
`
`from a gray “icon” image containing a document according to an embodiment.
`
`[0029]
`
`FIG. l7 is a flowchart that illustrates an example method for geometric correction
`
`according to an embodiment.
`
`[0030]
`
`FIG.
`
`l8A is an image illustrating a mobile image of a check that is oriented in
`
`landscape orientation according to an embodiment.
`
`[0031]
`
`FIG. l8B example gray-scale image of the document depicted in FIG. l3A once a
`
`geometrical correction operation has been applied to the image according to an embodiment.
`
`[0032]
`
`FIG. l9 is a flow chart illustrating a method for correcting landscape orientation of a
`
`document image according to an embodiment.
`
`[0033]
`
`FIG. 20 provides a flowchart illustrating an example method for size correction of an
`
`image according to an embodiment.
`
`[0034]
`
`FIG. 21 illustrates a mobile document image processing engine (MDIPE) module
`
`2100 for performing quality assurance testing on mobile document images according to an
`
`embodiment.
`
`[0035]
`
`FIG. 22 is a flow diagram of a process for performing mobile image quality assurance
`
`on an image captured by a mobile device according to an embodiment.
`
`[0036]
`
`FIG. 23 is a flow diagram of a process for performing mobile image quality assurance
`
`on an image of a check captured by a mobile device according to an embodiment.
`
`[0037]
`
`FIG. 24A illustrates a mobile image where the document captured in the mobile
`
`document image exhibits view distortion.
`
`[0038]
`
`FIG. 24B illustrates an example of a grayscale geometrically corrected subimage
`
`generated from the distorted image in FIG. 24A according to an embodiment.
`
`[0039]
`
`FIG. 25A illustrates an example of an in-focus mobile document image.
`
`117313/003UTL/125194703
`
`Page 11 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 11 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 173 l3-003UTL
`
`PATENT
`
`[0040]
`
`FIG. 25B illustrates an example of an out of focus document.
`
`[0041]
`
`FIG. 26 illustrates an example of a shadowed document.
`
`[0042]
`
`FIG. 27 illustrates an example of a grayscale snippet generated from a mobile
`
`document image of a check where the contrast of the image is Very low according to an
`
`embodiment.
`
`[0043]
`
`FIG. 28 illustrates a method for executing a Contrast IQA Test according to an
`
`embodiment.
`
`[0044]
`
`FIG. 29A is an example of a mobile document image that includes a check that
`
`exhibits significant planar skew according to an embodiment.
`
`[0045]
`
`FIG. 29B illustrates an example of a document subimage that exhibits View skew
`
`according to an embodiment.
`
`[0046]
`
`FIG. 30 is a flow chart illustrating a method for testing for View skew according to an
`
`embodiment.
`
`[0047]
`
`FIG. 31 illustrates an example of a mobile document image that features an image of
`
`a document where one of the comers of the document has been cut off in the picture.
`
`[0048]
`
`FIG. 32 illustrates a Cut-Off Comer Test that can be used for testing whether comers
`
`of a document in a document subimage have been cut off when the document was imaged
`
`according to an embodiment.
`
`[0049]
`
`FIG. 33 illustrates an example of a mobile document image that features a document
`
`where one of the ends of the document has been cut off in the image.
`
`[0050]
`
`FIG. 34 is a flow diagram of a method for determining whether one or more sides of
`
`the document are cut off in the document subimage according to an embodiment.
`
`[0051]
`
`FIG. 35 illustrates an example of a mobile document image where the document is
`
`warped according to an embodiment.
`
`117313/003UTL/l25l947.03
`
`Page 12 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 12 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 173 l3-003UTL
`
`PATENT
`
`[0052]
`
`FIG. 36 is a flow diagram of a method for identifying a warped image and for scoring
`
`the image based on how badly the document subimage is warped according to an embodiment.
`
`[0053]
`
`FIG. 37 illustrates an example of a document subimage within a mobile document
`
`image that is relatively small in comparison to the overall size of the mobile document image
`
`according to an embodiment.
`
`[0054]
`
`FIG. 38 is a flow diagram of a process that for performing an Image Size Test on a
`
`subimage according to an embodiment.
`
`[0055]
`
`FIG. 39A is a flow chart of a method for executing a MICR-line Test according to an
`
`embodiment.
`
`[0056]
`
`FIG. 39B is a flow chart of a method for executing a code line Test according to an
`
`embodiment.
`
`[0057]
`
`FIG. 40 illustrates a method for executing an Aspect Ratio Test according to an
`
`embodiment.
`
`[0058]
`
`FIG. 4l illustrates a method for performing a front-as-rear test on a mobile document
`
`image.
`
`[0059]
`
`FIG 42 is a flow chart of a method for processing an image of a remittance coupon
`
`using form identification according to an embodiment.
`
`[0060]
`
`FIG 43 is a flow chart of a method for processing an image of a remittance coupon
`
`using form identification according to an embodiment.
`
`[0061]
`
`FIG. 44 is a block diagram of various functional elements of a mobile device that can
`
`be used with the various systems and methods described herein according to an embodiment.
`
`[0062]
`
`FIG. 45 is a block diagram of functional elements of a computer system that can be
`
`used to implement the mobile device and/or the servers described in the systems and methods
`
`disclosed herein.
`
`117313/003UTL/125194703
`
`Page 13 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 13 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: 117313-003UTL
`
`PATENT
`
`[0063]
`
`FIG. 46A-46F are images representing application that can reside on mobile device
`
`and be using in according with the systems and method disclosed herein according to an
`
`embodiment.
`
`DETAILED DESCRIPTION
`
`[0064]
`
`The embodiments described herein are directed towards automated document
`
`processing and systems and methods for document image processing using mobile devices.
`
`System and methods are provided for processing a remittance coupon captured using a mobile
`
`device. Generally, in some embodiments an original color image of a document is captured
`
`using a mobile device and then converted the color image to a bi-tonal image. More specifically,
`
`in some embodiments, a color image of a document taken by a mobile device is received and
`
`converted into a bi-tonal image of the document that is substantially equivalent in its resolution,
`
`size, and quality to document images produced by “standard” scanners.
`
`[0065]
`
`The term “standard scanners” as used herein, but is not limited to, transport scanners,
`
`flat-bed scanners, and specialized check-scanners. Some manufacturers of transport scanners
`
`include UNISYS®, BancTec®, IBM®, and Canon®. With respect to specialized check-scanners,
`
`some models include the TellerScan® TS200 and the Panini® My Vision X. Generally,
`
`standard scanners have the ability to scan and produce high quality images, support resolutions
`
`from 200 dots per inch to 300 dots per inch (DPI), produce gray-scale and bi-tonal images, and
`
`crop an image of a check from a larger full-page size image. Standard scanners for other types
`
`of documents may have similar capabilities with even higher resolutions and higher color-depth.
`
`[0066]
`
`The term “color images” as used herein, but is not limited to, images having a color
`
`depth of 24 bits per a pixel (24 bit/pixel), thereby providing each pixel with one of 16 million
`
`possible colors. Each color image is represented by pixels and the dimensions W (width in
`
`pixels) and H (height in pixels). An intensity function I maps each pixel in the [W x H] area to
`
`its RGB-value. The RGB-value is a triple (R,G,B) that determines the color the pixel represents.
`
`Within the triple, each of the R(Red), G(Green) and B(Blue) values are integers between 0 and
`
`255 that determine each respective color’s intensity for the pixel.
`
`117313/003UTL/125194703
`
`Page 14 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`Page 14 of 140
`
`ROTHSCHILD EXHIBIT 1011
`
`

`
`Atty. Docket No.: l 17313-003UTL
`
`PATENT
`
`[0067]
`
`The term, “gray-scale images” as used herein, but is not limited to, images having a
`
`color depth of 8 bits per a pixel (8 bit/pixel), thereby providing each pixel with one of 256 shades
`
`of gray. As a person of ordinary skill in the art would appreciate, gray-scale images also include
`
`images with color depths of other various bit