(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2005/0100216A1
`Myers et al.
`(43) Pub. Date:
`May 12, 2005
`
`US 2005O1 00216A1
`
`(54) METHOD AND APPARATUS FOR
`CAPTURING PAPER-BASED INFORMATION
`ON A MOBILE COMPUTING DEVICE
`
`Related U.S. Application Data
`(60) Provisional application No. 60/519,368, filed on Nov.
`11, 2003.
`
`(75) Inventors: Gregory Myers, San Francisco, CA
`(US); Douglas Bercow, Menlo Park,
`CA (US)
`Correspondence Address:
`MOSER, PATTERSON & SHERIDAN L.L.P.
`595 SHREWSBURY AVE, STE 100
`FIRST FILOOR
`SHREWSBURY, NJ 07702 (US)
`(73) Assignee: SRI International
`(21) Appl. No.:
`10/988,110
`
`(22) Filed:
`
`Nov. 12, 2004
`
`Publication Classification
`
`(51) Int. Cl. ................................................... G06K 9/00
`(52) U.S. Cl. ......................... 382/181; 358/473; 361/683;
`382/313
`
`ABSTRACT
`(57)
`A method and apparatus are provided for capturing paper
`based information on a mobile computing device. In one
`embodiment, the inventive method includes capturing a
`digital image of the paper-based information, where the
`digital image comprises text (and in Some cases non-text)
`components of the paper-based information. At least a
`portion of the paper-based information is then categorized
`based on the content of the text components and Stored
`accordingly in either a local or remote database.
`
`100
`
`
`
`CAPTURE IMAGE OF PAPER-BASED INFORMATION
`
`104
`
`
`
`CONVERT TEXT COMPONENTS TO
`TEXT FORMAT
`
`
`
`
`
`11
`RECEIVE USER FEEDBACK CONCERNING |
`RECOGNIZEDTEXTAND CATEGORIZATION r-110
`
`- are rrrr m m. m. m. -
`
`-
`
`- - - - - - - - - - I
`
`YES
`
`
`
`
`
`112
`
`- ..., N/
`-
`WAS
`--- TEXT RECOGNITION AND N - NO
`CATEGORIZATION
`1
`is N SUCCESSFUL 2 - - 1
`
`STORE PAPER-BASED -N-114
`INFORMATION
`
`-116
`Modify text
`RECOGNITIONANP.
`CATEGORIZATION RESULTs
`
`
`
`
`
`PNC 1121
`
`

`

`Patent Application Publication May 12, 2005 Sheet 1 of 3
`
`US 2005/0100216 A1
`
`100
`
`CAPTURE IMAGE OF PAPER-BASED INFORMATION
`
`104
`
`
`
`CONVERT TEXT COMPONENTS TO
`TEXT FORMAT
`
`106
`
`
`
`
`
`CATEGORIZE RECOGNIZED TEXT
`
`
`
`
`
`
`
`
`
`
`
`
`
`- - - - - - - - - -
`
`e
`
`N
`
`110
`RECEIVE USER FEEDBACK CONCERNING
`RECOGNIZED TEXT AND CATEGORIZATION r
`I
`112
`1.
`N 4.
`-
`WAS
`N
`- 1 TEXT RECOGNITION AND N
`CATEGORIZATION
`N -
`-
`N N SUCCESSFUL 2 - ~ 1.
`
`YES
`
`NO
`
`STORE PAPER-BASED -N-114
`INFORMATION
`
`-116
`TTMoDIFYText TT
`RECOGNITIONAND
`CATEGORIZATION RESULTs
`
`
`
`FIG. 1
`
`

`

`Patent Application Publication May 12, 2005 Sheet 2 of 3
`
`US 2005/0100216 A1
`
`200
`
`
`
`202
`
`RECEIVE INPUT FROM REMOTE USER DEVICE
`
`204
`
`
`
`PROCESS USER INPUT
`
`206
`
`CATEGORIZE RECOGNIZED TEXT AND
`TRANSMIT TO USER FORVERIFICATION
`
`|
`
`208
`1
`
`STORE TEXT
`
`
`
`SEND TEXT TO USER
`DEVICE FOR STORAGE
`
`FIG. 2
`
`

`

`Patent Application Publication May 12, 2005 Sheet 3 of 3
`
`US 2005/0100216 A1
`
`--
`
`
`
`306
`
`I/O DEVICE
`e.g. STORAGE
`DEVICE
`
`MEMORY
`
`304
`
`302
`
`PROCESSOR
`
`FIG. 3
`
`

`

`US 2005/01 00216 A1
`
`May 12, 2005
`
`METHOD AND APPARATUS FOR CAPTURING
`PAPER-BASED INFORMATION ON A MOBILE
`COMPUTING DEVICE
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`0001) This application claims the benefit of U.S. Provi
`sional Patent Application Ser. No. 60/519,368, filed Nov. 11,
`2003 (titled “Method and Apparatus for Reading and Storing
`Contact Information”), which is herein incorporated by
`reference in its entirety.
`
`FIELD OF THE INVENTION
`0002 The present invention relates generally to image
`processing and relates more Specifically to the capture and
`Storage of paper-based information by a mobile computing
`device.
`
`BACKGROUND OF THE DISCLOSURE
`0003. The storage of information such as contact infor
`mation in a digital format offers Several advantages (e.g.,
`ease of Searching, Synchronization between multiple digital
`devices) over paper-based Storage. However, in many cases,
`the information to be stored is distributed in a paper-based
`format. For example, paper busineSS cards are Still the
`predominant means of distributing contact information.
`Manual entry of Such paper-based information into a com
`puting device is time-consuming, especially as the Volume
`of information conveyed on business cards (e.g., multiple
`phone numbers or email addresses, multiple languages)
`increases.
`0004 Existing methods for digitally exchanging tradi
`tionally paper-based information, Such as business card
`information, typically require both the Sender and receiver
`devices to Support Specific file formats and communication
`protocols. Moreover, Such methods typically exchange
`Solely ASCII text Strings, and are not capable of capturing
`critical non-text information, Such as the design or presen
`tation of the information to be captured. This information
`may be Selected by a corporation or an individual in order to
`convey a desired image, e.g., as embodied in a corporate
`logo. Other methods involve using purpose-built devices
`(e.g., comprising Scanners and character recognition Soft
`ware) that connect to a computing device but are not
`portable and thus do not allow a user to immediately update
`previously Stored information.
`0005 Thus, there is a need in the art for a method and
`apparatus for capturing paper-based information on a mobile
`computing device.
`
`SUMMARY OF THE INVENTION
`0006 Amethod and apparatus are provided for capturing
`paper-based information on a mobile computing device. In
`one embodiment, the inventive method includes capturing a
`digital image of the paper-based information, where the
`digital image comprises text (and in Some cases non-text)
`components of the paper-based information. At least a
`portion of the paper-based information is then categorized
`based on the content of the text components and Stored
`accordingly in either a local or remote database.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0007. The teachings of the present invention can be
`readily understood by considering the following detailed
`description in conjunction with the accompanying drawings,
`in which:
`0008 FIG. 1 is a flow diagram illustrating one embodi
`ment of a method for capturing and Storing paper-based
`information in a database of a mobile computing device
`according to the present invention;
`0009 FIG. 2 is a flow diagram illustrating one embodi
`ment of a Server-Side method for processing and/or storing
`paper-based information, according to the present invention;
`and
`0010 FIG. 3 is a high level block diagram of the present
`method for capturing and Storing paper-based information
`on mobile computing device that is implemented using a
`general purpose computing device.
`0011 To facilitate understanding, identical reference
`numerals have been used, where possible, to designate
`identical elements that are common to the figures.
`
`DETAILED DESCRIPTION
`0012. The present invention relates to a method and
`apparatus for capturing paper-based information, Such as
`contact information from a paper business card, in a digital
`format on a mobile computing device (e.g., a cellular phone,
`a digital camera, a personal digital assistant or any other
`portable device in which image capture and processing
`capabilities can be incorporated). In one embodiment, a
`novel method is disclosed that enables real-time digital
`capture, Storage and categorization of paper-based informa
`tion on a mobile computing device without connections to
`additional external hardware. Moreover, the novel method
`allows for the capture and Storage of non-text components of
`the paper-based information as well as the text components,
`including corporate logos and Stylized typefaces.
`0013 FIG. 1 is a flow diagram illustrating one embodi
`ment of a method 100 for capturing and Storing paper-based
`information in a database of a mobile computing device
`according to the present invention. AS used herein, the term
`"paper-based information” means the information presented
`in any hard-(e.g., non-digital) format, Such as information
`found on paper busineSS cards, mail pieces, checks, adver
`tisements, books, napkins, Stationery, whiteboards and the
`like. In one embodiment, the database in which the captured
`information is stored may be a local database (e.g., residing
`at the same device as the capturing mechanism) or a remote
`database (e.g., residing at a different device than the cap
`turing mechanism).
`0014) The method 100 is initialized at step 102 and
`proceeds to step 104, where the method 100 captures an
`image of paper-based information. In one embodiment, the
`image of the paper-based information comprises both text
`and non-text components (e.g., logos or designs) present in
`the paper-based information. In one embodiment, the image
`is captured in a high-resolution image format having reso
`lution that allows accurate recognition of characters in the
`image even after the image is compressed. In one embodi
`ment, the image is captured in Tag Image File Format (TIFF)
`or Joint Photographic Experts Group (JPEG) format.
`
`

`

`US 2005/01 00216 A1
`
`May 12, 2005
`
`0.015. In step 106, at least some of the text components in
`the captured image of the paper-based information are
`converted to text format by a recognition process, to create
`recognized text. In one embodiment, known optical charac
`ter recognition (OCR) techniques are applied to recognize
`portions of the captured image of the paper-based informa
`tion. In another embodiment, specialized techniques are
`applied to locate text within the captured image of the
`paper-based information and to Separate the text from the
`background. For example, in step 106 the method 100 may
`apply character recognition techniques Such as those
`described in co-pending, commonly assigned U.S. patent
`application Ser. No. 09/895,868, filed Jun. 29, 2001, the
`teachings of which are herein incorporated by reference.
`0016. In another embodiment, character recognition in
`accordance with step 106 further involves disambiguation.
`In this embodiment, recognized text is compared to an
`information Source (e.g., including one or more databases of
`addresses, Zip codes, phone numbers, existing contact infor
`mation, corporate logos, and the like), and the recognition
`proceSS is refined or constrained to produce results that are
`meaningful with respect to the information Source. For
`example, if the recognized text includes an address, infor
`mation such as the street address and the ZIP+4 code may be
`compared to ensure that a meaningful or accurate recogni
`tion has been performed. That is, if the street address is
`recognized to be X, and the ZIP+4 code is recognized to be
`Y, the method 100 may confirm the recognition results with
`a greater degree of certainty by verifying that Street address
`X exists within ZIP+4 code Y. If a meaningful recognition
`has not been performed, the recognition proceSS may be
`repeated using data from the information Source. Alterna
`tively, data from the information Source may be integrated in
`a first recognition attempt. Address recognition techniques
`suitable for use in conjunction with step 106 include tech
`niques disclosed in co-pending, commonly assigned U.S.
`patent application Ser. No. 09/967,228, filed Sep. 28, 2001,
`the teachings of which are herein incorporated by reference.
`0.017. By way of further example, recognition of non-text
`components of the image of the paper-based information,
`comprising a corporate name or logo presented in a stylized
`typeface, could be performed by comparing a recognized
`Street address to names of known corporations (e.g., using an
`information Source including a telephone directory and/or
`register of corporations). Alternatively, an image of the
`Stylized presentation of a corporate name or a corporate logo
`could be compared to an information Source containing
`corporate logos (e.g., trademark records) using image
`matching techniques known in the art. In one embodiment,
`the method 100 may apply image matching techniques in
`accordance with the techniques taught by co-pending, com
`monly assigned U.S. patent application Ser. No. 10/925,335,
`filed Aug. 24, 2004, the teachings of which are herein
`incorporated by reference.
`0.018. In another example, recognized text representing a
`uniform resource locator (URL) can be verified substantially
`automatically by confirming the URL's existence, e.g.,
`through a web browser. Additional recognized text repre
`Senting a corporate address, employee name and the like can
`also be verified by Searching for the items on the corporate
`web site.
`0019. In step 108, the method 100 categorizes the rec
`ognized text according to the content of the recognized text
`
`(e.g., what the recognized text represents, Such as a name, a
`phone number, an address, etc.). That is, the method 100
`uses the content of the recognized text to place or classify
`the recognized text within Some Sort of context for use. In
`one embodiment, categorization in accordance with Step 108
`also involves language translation, wherein the recognized
`text is translated from a first language into a different Second
`language before the text is processed further. Language
`translation advantageously allows a user to maintain a
`database of captured information in a Single language, So
`that the information is easily Searchable even though it may
`be received or captured in Several different languages. In
`Such an embodiment, a multilingual OCR technique may be
`implemented in Step 106, or a language identification Step
`(e.g., automatic or manually set) may precede one or more
`Single-language OCR implementations.
`0020. In an alternative embodiment, recognition and cat
`egorization of the captured paper-based information (e.g., in
`accordance with steps 106-108) are accomplished by trans
`mitting the captured image of the paper-based information to
`a remote Server that is in communication with the mobile
`computing device (e.g., over a public telephone network,
`cellular telephone network or the Internet). The server
`processes the transmitted image of the paper-based infor
`mation and returns one or more identified text components
`contained within the transmitted image of the paper-based
`information. In one embodiment, the identified text compo
`nents contained within the image of the paper-based infor
`mation are categorized by the server prior to returning the
`results to the user. Those skilled in the art will appreciate,
`however, that other combinations of local- and Server-based
`methods may be implemented to capture, proceSS and Store
`paper-based information in digital format for display on a
`mobile computing device in accordance with the present
`invention. For example, recognition may be performed
`locally, and the recognized text, rather than the original
`image of the paper-based information containing the text,
`may be sent to the Server. Considerations Such as the
`processing and memory capabilities of the user device, the
`cost of data transmissions to the remote Server, and concerns
`of data privacy will be readily appreciated to influence the
`distribution of local and remote tasks.
`0021. In one embodiment, once recognized text is cat
`egorized, the method 100 proceeds to optional step 110
`(illustrated in phantom) and receives feedback from a user
`either confirming that the recognition and characterization of
`the text (e.g., in steps 106 and 108) are accurate or indicating
`that corrections are necessary. In one embodiment, the text
`recognition and characterization results are presented Visu
`ally to the user (in Some embodiments along with the
`original captured image of the paper-based information),
`and the feedback is received in the form of audible input
`(e.g., voice confirmation) or manual input (e.g., from a
`physical interface located on the mobile computing device,
`Such as a stylus or key press interface).
`0022. In one embodiment, the user feedback further
`includes feedback related to conflicts between the catego
`rized text information and information already Stored in the
`user's database. For example, the categorized text informa
`tion may be matched against the current contents of the
`user's database, and if a matching entry within the database
`is located, the method 100 may query the user as to whether
`the categorized text information should replace or augment
`
`

`

`US 2005/01 00216 A1
`
`May 12, 2005
`
`the existing entry, or create a new entry. In one embodiment,
`matching the categorized text information against existing
`database entries is performed using “fuzzy' matching tech
`niques such as those described in U.S. Pat. No. 1,261,167 to
`Russell, issued Apr. 2, 1918.
`0023. In step 112, the method 100 determines, based on
`the user input, whether the text recognition and categoriza
`tion was successful or accurate. If the method 100 deter
`mines in Step 112 that the recognized and categorized text
`information is not accurate, the method 100 proceeds to step
`116 and modifies the text recognition and categorization
`results. In one embodiment, text recognition and categori
`Zation modification in accordance with Step 116 involves
`asking the user to correct the results (e.g., manually or
`verbally). In another embodiment, the method 100 attempts
`to re-recognize and categorize the text in the captured image
`of the paper-based information (e.g., in accordance with
`steps 106-108 as described above). Once the text recognition
`and categorization results have been modified, the method
`100 returns to step 110 and again receives user feedback, this
`time regarding the modified text recognition and categori
`Zation results.
`0024.
`Alternatively, if the method 100 determines in step
`112 that the recognized and categorized text information is
`accurate, the method 100 proceeds to step 114 and stores at
`least a portion of the recognized and categorized text con
`tained within the image of the paper-based information in
`the user's database. In Some embodiments, images repre
`Senting non-text components of the paper-based information
`are also stored in the user's database. In embodiments where
`the database is stored on a remote device (e.g., not the device
`that captured and/or processed the image of the paper-based
`text information), Storage in accordance with Step 112
`involves transmitting the text information, e.g., over a
`communications network, to the database for update or
`entry. The method 100 then terminates in step 118.
`0025. The method 100 thereby enables real-time digital
`capture, Storage and categorization of paper-based informa
`tion, Such as contact information from a paper busineSS card,
`on a truly mobile computing device. Connections to non
`mobile external hardware are not required for real-time
`capture, Storage and categorization. Moreover, the method
`100 allows for the capture and storage of non-text compo
`nents of the paper-based information as well, including
`corporate logos and Stylized typefaces.
`0.026
`FIG. 2 is a flow diagram illustrating one embodi
`ment of a server-side method 200 for processing and/or
`Storing paper-based information, according to the present
`invention. The method 200 is initialized at step 202 and
`proceeds to step 204, where the method 200 receives input
`from a remote user device in communication with the Server.
`In one embodiment, the received input is a digital image of
`paper-based information containing text. In another embodi
`ment, the input comprises one or more text components
`derived from an image of paper-based information that was
`previously captured and processed by the remote user
`device.
`
`0027. In step 206, the method 200 processes the user
`input. In one embodiment, where the input is a digital image
`of paper-based information containing text (and possibly
`non-text) components, the method 200 processes the image
`to recognize at least Some of the text contained therein. In
`another embodiment, where the input comprises one or more
`text components derived from a previously processed digital
`image of paper-based information, the method 200 further
`processes the text components to facilitate categorization
`(e.g., by comparing the recognized text to one or more
`information sources in order to refine the results). This
`Second embodiment advantageously reduces the size of the
`transmission received from the user in step 204.
`0028. In one embodiment, the method 200 then proceeds
`to optional step 208, where the method 200 categorizes the
`recognized text (e.g., as described above) and transmits the
`recognized and categorized text to the user for Verification.
`0029. In step 210, the method 200 inquires if the pro
`cessed (e.g., recognized and categorized) text information
`should be stored at the server. If the method 200 determines
`that the text information should be stored at the server, the
`method 200 proceeds to step 212 and stores the text infor
`mation at the server. Alternatively, if the method 200 deter
`mines that the text information should not be stored at the
`server, the method 200 proceeds to 214 and sends the text
`information back to the user device for local Storage. The
`method 200 then terminates at step 216.
`0030 FIG.3 is a high level block diagram of the present
`method for capturing paper-based information on a mobile
`computing device that is implemented using a general
`purpose computing device 300. In one embodiment, a gen
`eral purpose computing device 300 comprises a processor
`302, a memory 304, a data capture and analysis module 305
`and various input/output (I/O) devices 306 such as a display,
`a keyboard, a mouse, a modem, and the like. In one
`embodiment, at least one I/O device is a storage device (e.g.,
`a disk drive, an optical disk drive, a floppy disk drive). It
`should be understood that the data capture and analysis
`module 305 can be implemented as a physical device or
`Subsystem that is coupled to a processor through a commu
`nication channel. In one embodiment, the data capture and
`analysis module 305 includes an imaging Sensor.
`0031. Alternatively, the data capture and analysis module
`305 can be represented by one or more software applications
`(or even a combination of Software and hardware, e.g., using
`Application Specific Integrated Circuits (ASIC)), where the
`Software is loaded from a storage medium (e.g., I/O devices
`306) and operated by the processor 302 in the memory 304
`of the general purpose computing device 300. Thus, in one
`embodiment, the data capture and analysis module 305 for
`capturing paper-based information on a mobile computing
`device described herein with reference to the preceding
`Figures can be stored on a computer readable medium or
`carrier (e.g., RAM, magnetic or optical drive or diskette, and
`the like).
`0032. Thus, the present invention represents a significant
`advancement in the field of image processing. In one
`
`

`

`US 2005/01 00216 A1
`
`May 12, 2005
`
`embodiment, a novel method is disclosed that enables real
`time digital capture, Storage and categorization of paper
`based information on a mobile computing device without
`connections additional external hardware. Moreover, the
`novel method allows for the capture and Storage of non-text
`components of the paper-based information as well as the
`text components, including corporate logos and Stylized
`typefaces.
`0.033 Although various embodiments which incorporate
`the teachings of the present invention have been shown and
`described in detail herein, those skilled in the art can readily
`devise many other varied embodiments that Still incorporate
`these teachings.
`
`What is claimed is:
`1. A method for Storing paper-based information on a
`mobile computing device, the method comprising:
`capturing a digital image Said paper-based information,
`where Said paper-based information comprises text
`components,
`categorizing at least a portion of Said paper-based infor
`mation based on content of Said text components, and
`Storing Said at least a portion of Said paper-based infor
`mation.
`2. The method of claim 1, wherein Said capturing, cat
`egorizing and Storing are all performed on Said mobile
`computing device.
`3. The method of claim 1, wherein at least one of Said
`capturing, indexing and Storing is performed locally at Said
`mobile computing device and at least one of Said capturing,
`indexing and Storing is performed at a remote Server in
`communication with Said mobile computing device.
`4. The method of claim 1, wherein Said categorizing
`comprises:
`processing Said digital image of Said paper-based infor
`mation to recognize at least Some of Said text compo
`nents, and
`indexing Said at least a portion of Said paper-based
`information based on Said recognized text components.
`5. The method of claim 4, wherein Said processing com
`prises:
`comparing Said recognized text components to an infor
`mation Source in order to refine Said recognized text
`components.
`6. The method of claim 4, wherein said information
`Source is obtained from a remote Server.
`7. The method of claim 4, wherein Said categorizing
`further comprises:
`translating Said recognized text components from a first
`language into a Second language.
`8. The method of claim 4, further comprising:
`receiving user input indicating an accuracy of Said rec
`ognized text components.
`9. The method of claim 8, wherein said user input includes
`a correction to Said recognized text components.
`10. The method of claim 8, wherein said user input is a
`Verbal Signal.
`
`11. The method of claim 8, wherein said user input is
`received from a physical interface located on Said mobile
`computing device.
`12. The method of claim 8, wherein the user input further
`indicates whether the paper-based information contained in
`Said digital image should replace or augment information
`already Stored.
`13. The method of claim 1, wherein said storing com
`prises:
`Storing Said at least a portion of Said paper-based infor
`mation in a local database.
`14. The method of claim 1, wherein said storing com
`prises:
`transmitting Said at least a portion of Said paper-based
`information to a remote database for Storage.
`15. A computer readable medium containing an execut
`able program for Storing paper-based information on a
`mobile computing device, where the program performs the
`Steps of
`capturing a digital image Said paper-based information,
`where Said paper-based information comprises text
`components,
`categorizing at least a portion of Said paper-based infor
`mation based on content of Said text components, and
`Storing Said at least a portion of Said paper-based infor
`mation.
`16. The computer readable medium of claim 15, wherein
`Said capturing, categorizing and Storing are all performed on
`Said mobile computing device.
`17. The computer readable medium of claim 15, wherein
`at least one of Said capturing, categorizing and storing is
`performed locally at Said mobile computing device and at
`least one of Said capturing, indexing and categorizing is
`performed at a remote Server in communication with Said
`mobile computing device.
`18. The computer readable medium of claim 15, wherein
`Said categorizing comprises:
`processing Said digital image of Said paper-based infor
`mation to recognize at least Some of Said text compo
`nents, and
`indexing Said at least a portion of Said paper-based
`information based on Said recognized text components.
`19. The computer readable medium of claim 18, wherein
`Said processing comprises:
`comparing Said recognized text components to an infor
`mation Source in order to refine Said recognized text
`components.
`20. The computer readable medium of claim 18, wherein
`Said categorizing comprises:
`translating Said recognized text components from a first
`language into a Second language.
`21. The computer readable medium of claim 18, wherein
`Said information Source is obtained from a remote Server.
`22. The computer readable medium of claim 18, further
`comprising:
`receiving user input indicating an accuracy of Said rec
`ognized text components.
`
`

`

`US 2005/01 00216 A1
`
`May 12, 2005
`
`23. The computer readable medium of claim 22, wherein
`Said user input includes a correction to Said recognized text
`components.
`24. The computer readable medium of claim 22, wherein
`Said user input is a verbal Signal.
`25. The computer readable medium of claim 22, wherein
`Said user input is received from a physical interface located
`on Said mobile computing device.
`26. The computer readable medium of claim 22, wherein
`the user input further indicates whether the paper-based
`information contained in Said digital image should replace or
`augment information already Stored.
`27. The computer readable medium of claim 15, wherein
`Said Storing comprises:
`Storing Said at least a portion of Said paper-based infor
`mation in a local database.
`
`28. The computer readable medium of claim 15, wherein
`Said Storing comprises:
`transmitting Said at least a portion of Said paper-based
`information to a remote database for Storage.
`28. Apparatus for Storing paper-based information on a
`mobile computing device, the apparatus comprising:
`means for capturing a digital image Said paper-based
`information, where said paper-based information com
`prises text components,
`means for categorizing at least a portion of Said paper
`based information based on content of Said text com
`ponents, and
`means for Storing Said at least a portion of Said paper
`based information.
`
`k
`
`k
`
`k
`
`k
`
`k
`
`