.....
`.....
`C)
`c.:,
`0:,
`
`C
`i-n
`r--o
`-i
`0
`
`'"
`
`0
`1-C') o.o
`(I) r--,.
`PTO/SB/05 (04-05) :j O')
`Approved for use through 07/31/2006. 0MB 0651-0032 O
`U.S. Patent and Trademark Office. U.S. DEPARTMENT OF COMMERCE CO ,q-
`Under the Paoerwork Reduction Act of 1995 no oersons are reouired to resoond to a collection of information unless it disolavs a valid 0MB control number. ~
`"2
`,-
`
`UTILITY
`PATENT APPLICATION
`TRANSMITTAL
`
`Attorney Docket No.
`
`015749-0140
`
`First Inventor
`
`Title
`
`Alexander Kurganov
`
`Robust Voice Browser System ...
`
`-,-
`
`(Only for new nonprovisional applications under 37 CFR 1.53(b))
`
`Express Mail Label No. EV 649544830 US
`
`,J
`
`APPLICATION ELEMENTS
`See MPEP chapter 600 concerning utility patent application contents.
`
`ADDRESS TO:
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria VA 22313-1450
`
`2.0
`
`1.0 Fee Transmittal Form (e.g., PTO/SB/17)
`(Submit an original and a duplicate for fee processing)
`Applicant claims small entity status.
`See 37 CFR 1.27.
`3.0 Specification
`[Total Pages
`45
`Both the claims and abstract must start on a new page
`(For information on the preferred anangement, see MPEP 608.01/a))
`4.0 Drawing(s) (35 U.S.C. 113)
`[Total Sheets
`4
`
`4
`
`5. Oath or Declaration
`[Total Sheets
`a. ~ Newly executed (original or copy)
`b.
`.,. A copy from a prior application (37 CFR 1.63(d))
`[]or continuation/divisional with Box 18 completed)
`DELETION OF INVENTOR{S}
`Signed statement attached deleting inventor(s)
`name in the prior application, see 37 CFR
`1.63(d)(2) and 1.33(b).
`
`i.
`
`6.(cid:143)
`1.(cid:143)
`
`Application Data Sheel See 37 CFR 1.76
`
`CD-ROM or CD-R in duplicate, large table or
`caputer Program (Appendix)
`Landscape Table on CO
`
`1
`
`I
`1
`
`ACCOMPANYING APPLICATION PARTS
`9. D Assignment Papers (cover sheet & document(s))
`
`Name of Assignee
`
`10. D 37 CFR 3.73(b) Statement
`(when there is an assignee)
`11.(cid:143) English Translation Document (if applicable)
`
`0Powerof
`Attorney
`
`12.0 lnfoEftion Disclosure Statement (PTO/SB/08 or PT0-1449)
`Copies of citations attached_
`_ ..
`
`13. D Preliminary Amendment
`14. 0 Return Receipt Postcard (MPEP 503)
`(Should be specifically itemized)
`15. D Certified Copy of Priority Document(s)
`(if foreign priority is claimed)
`16. D Nonpublication Request under 35 U.S.C. 122(b)(2)(B)(i).
`Applicant must attach form PTO/SB/35 or equivalent.
`17. D Other:
`
`8. Nucleotide and/or Amino Acid Sequence Submission
`(if applicable, items a. - c. are required)
`a. D Computer Readable Form (CRF)
`(cid:143)
`
`b.
`
`Specification Sequence Listing on:
`
`i.
`CD-ROM or CD-R (2 copies); or
`ii.O Paper
`
`(cid:143)
`
`Statements verifying identity of above copies
`C.
`18. If a CONTINUING APPLICATION, check appropriate box, and supply the requisite information below and in the first sentence of the
`specification following the title, or in an Application Data Sheet under 37 CFR 1. 76:
`D Continuation-in-part (CIP)
`D Divisional
`0 Continuation
`Examiner McFadden Susan Iris
`Prior application information:
`
`of prior application No.: H)/821.690 .................
`
`AttUnit: 2655
`
`0 The address associated with Customer Number: I
`
`47670
`
`I OR D Correspondence address below
`
`19. CORRESPONDENCE ADDRESS
`
`Name
`
`Address
`
`City
`
`Country
`
`Signature
`
`Name
`(Print/Tvoe\
`
`I State
`I Telephone
`(.-4 IA ..
`?
`Scott Kaspar u-
`
`/ ' ·
`
`I ZipCode I
`I Email
`I
`I Date April24,2006
`Registration No. I
`(Attomev/Aaent) 54•583
`
`This collection of information is required by 37 CFR 1.53(b). The information is required to obtain or retain a benefit by the public which is to file (and by the
`USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 12 minutes to
`complete, including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any
`comments on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer,
`U.S. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED
`FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`Petitioner’s Ex. 1002, Page 1
`
`

`

`PTO/SB/17 (01-06)
`Approved for use through 07/31/2006. 0MB 0651-0032
`U.S. Patent and Trademarll Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paoerworll Reduction Act of 1995 no persons are reQuired to respond to a collection of information unless it displays a valid 0MB control number
`Complete if Known
`TBA
`Aoril 24 2006
`First Named Inventor Alexander Kurganov
`Examiner Name
`TBA
`Art Unit
`TBA
`Attorney Docket No.
`015749-0140
`
`Application Number
`
`"'
`
`.J
`
`r
`
`Fees pursuant to the Consolidated Appropriations Act, 2005 (H.R. 4818).
`
`FEE TRANSMITTAL Filing Date
`For FY 2006
`0 Applicant claims small entity status. See 37 CFR 1.27
`\.TOTAL AMOUNT OF PAYMENT I ($)
`500
`
`METHOD OF PAYMENT (check all that apply)
`
`D Check D Credit Card D Money Order 0None Oother (please identify):
`0 Deposit Account Deposit Account Number: 11-0404
`
`Deposit Account Name: Kelle~ D[Ye & Warren
`For the above-identified deposit account, the Director is hereby authorized to: (check all that apply)
`
`0charge fee(s) indicated below
`~ Charge any additional fee(s) or underpayments of fee(s)
`under37CFR 1.16and 1.17
`WARNING: Information on this fonn may become public. Credit card information should not be Included on this form. Provide credit card
`Information and authorization on PTO-2038.
`FEE CALCULATION (All the fees below are due upon filing or may be subject to a surcharge.)
`
`D Charge fee(s) indicated below, except for the filing fee
`0 Credit any overpayments
`
`1. BASIC FILING, SEARCH, AND EXAMINATION FEES
`FILING FEES
`SEARCH FEES
`Small Entit~
`Small Entit~
`·
`lli.ID
`lli.ID
`lli.ID
`fti!.W
`300
`150
`500
`250
`200
`100
`100
`50
`200
`100
`300
`150
`300
`150
`500
`250
`200
`100
`0
`0
`
`EXAMINATION FEES
`· Small Entit~
`lli.ID
`Fee(.i)
`200
`100
`130
`65
`160
`80
`600
`300
`0
`0
`
`Fees Paid (U
`
`(;iQQ
`
`Aeglication Tme
`Utility
`Design
`Plant
`Reissue
`Provisional
`2. EXCESS CLAIM FEES
`Fee Descrietion
`Each claim over 20 (including Reissues)
`Each independent claim over 3 (including Reissues)
`Multiple dependent claims
`Total Claims
`Extra Claims
`• 20 or HP=
`Hi
`Q
`X
`HP= highest number of total daims paid for, if greater than 20.
`lli.ID
`lndee. Claims
`Extra Claims
`• 3 or HP=
`=
`2
`I)
`X
`HP = highest number of independent daims paid for, if greater than 3.
`3. APPLICATION SIZE FEE
`If the specification and drawings exceed 100 sheets of paper (excluding electronically filed sequence or computer
`listings under 37 CFR 1.52(e)), the application size fee due is $250 ($125 for small entity) for each additional 50
`sheets or fraction thereof. See 35 U.S.C. 41(a)(l)(G) and 37 CFR l.16~s).
`Total Sheets
`Extra Sheets
`Number of each additional 50 or raction thereof
`(round up to a whole number) X
`45
`-100 =
`/ 50 =
`4. OTHER FEE(S)
`Non-English Specification, $130 fee (no small entity discount)
`Other (e.g., late filing surcharge):
`
`lli.ID
`
`=
`
`Fee Paid (I}
`
`Fee Paid (I}
`
`Small Entity
`lli.ID
`lli.ID
`25
`50
`JOO
`200
`180
`360
`Multiele Degendent Claims
`lli.ID
`Fee Paid (I}
`
`lli.ID
`
`=
`
`Fee Paid {fl
`
`Fees Paid (I}
`
`SUBMITTED BY
`( ti,
`Signature
`-
`Name (PrinVType) Scott Kaspar Cl -
`
`./"
`
`)
`
`I Registration No. 54 583
`
`IAttomev/Aaentl
`
`•
`
`Telephone 312-857-7088
`Date April 24, 2006
`
`This collection of information is required by 37 CFR 1.136. The information is required to obtain or retain a benefit by the public which is to file (and by the
`USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 30 minutes to complete,
`including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments
`on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent
`and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS
`ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`Petitioner’s Ex. 1002, Page 2
`
`

`

`.....
`.....
`C)
`c.:,
`0:,
`
`C
`i-n
`r--o
`-i
`0
`
`'"
`
`0
`1-C') o.o
`(I) r--,.
`PTO/SB/05 (04-05) :j O')
`Approved for use through 07/31/2006. 0MB 0651-0032 O
`U.S. Patent and Trademark Office. U.S. DEPARTMENT OF COMMERCE CO ,q-
`Under the Paoerwork Reduction Act of 1995 no oersons are reouired to resoond to a collection of information unless it disolavs a valid 0MB control number. ~
`"2
`,-
`
`UTILITY
`PATENT APPLICATION
`TRANSMITTAL
`
`Attorney Docket No.
`
`015749-0140
`
`First Inventor
`
`Title
`
`Alexander Kurganov
`
`Robust Voice Browser System ...
`
`-,-
`
`(Only for new nonprovisional applications under 37 CFR 1.53(b))
`
`Express Mail Label No. EV 649544830 US
`
`,J
`
`APPLICATION ELEMENTS
`See MPEP chapter 600 concerning utility patent application contents.
`
`ADDRESS TO:
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria VA 22313-1450
`
`2.0
`
`1.0 Fee Transmittal Form (e.g., PTO/SB/17)
`(Submit an original and a duplicate for fee processing)
`Applicant claims small entity status.
`See 37 CFR 1.27.
`3.0 Specification
`[Total Pages
`45
`Both the claims and abstract must start on a new page
`(For information on the preferred anangement, see MPEP 608.01/a))
`4.0 Drawing(s) (35 U.S.C. 113)
`[Total Sheets
`4
`
`4
`
`5. Oath or Declaration
`[Total Sheets
`a. ~ Newly executed (original or copy)
`b.
`.,. A copy from a prior application (37 CFR 1.63(d))
`[]or continuation/divisional with Box 18 completed)
`DELETION OF INVENTOR{S}
`Signed statement attached deleting inventor(s)
`name in the prior application, see 37 CFR
`1.63(d)(2) and 1.33(b).
`
`i.
`
`6.(cid:143)
`1.(cid:143)
`
`Application Data Sheel See 37 CFR 1.76
`
`CD-ROM or CD-R in duplicate, large table or
`caputer Program (Appendix)
`Landscape Table on CO
`
`1
`
`I
`1
`
`ACCOMPANYING APPLICATION PARTS
`9. D Assignment Papers (cover sheet & document(s))
`
`Name of Assignee
`
`10. D 37 CFR 3.73(b) Statement
`(when there is an assignee)
`11.(cid:143) English Translation Document (if applicable)
`
`0Powerof
`Attorney
`
`12.0 lnfoEftion Disclosure Statement (PTO/SB/08 or PT0-1449)
`Copies of citations attached_
`_ ..
`
`13. D Preliminary Amendment
`14. 0 Return Receipt Postcard (MPEP 503)
`(Should be specifically itemized)
`15. D Certified Copy of Priority Document(s)
`(if foreign priority is claimed)
`16. D Nonpublication Request under 35 U.S.C. 122(b)(2)(B)(i).
`Applicant must attach form PTO/SB/35 or equivalent.
`17. D Other:
`
`8. Nucleotide and/or Amino Acid Sequence Submission
`(if applicable, items a. - c. are required)
`a. D Computer Readable Form (CRF)
`(cid:143)
`
`b.
`
`Specification Sequence Listing on:
`
`i.
`CD-ROM or CD-R (2 copies); or
`ii.O Paper
`
`(cid:143)
`
`Statements verifying identity of above copies
`C.
`18. If a CONTINUING APPLICATION, check appropriate box, and supply the requisite information below and in the first sentence of the
`specification following the title, or in an Application Data Sheet under 37 CFR 1. 76:
`D Continuation-in-part (CIP)
`D Divisional
`0 Continuation
`Examiner McFadden Susan Iris
`Prior application information:
`
`of prior application No.: H)/821.690 .................
`
`AttUnit: 2655
`
`0 The address associated with Customer Number: I
`
`47670
`
`I OR D Correspondence address below
`
`19. CORRESPONDENCE ADDRESS
`
`Name
`
`Address
`
`City
`
`Country
`
`Signature
`
`Name
`(Print/Tvoe\
`
`I State
`I Telephone
`(.-4 IA ..
`?
`Scott Kaspar u-
`
`/ ' ·
`
`I ZipCode I
`I Email
`I
`I Date April24,2006
`Registration No. I
`(Attomev/Aaent) 54•583
`
`This collection of information is required by 37 CFR 1.53(b). The information is required to obtain or retain a benefit by the public which is to file (and by the
`USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 12 minutes to
`complete, including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any
`comments on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer,
`U.S. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED
`FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`Petitioner’s Ex. 1002, Page 3
`
`

`

`PTO/SB/17 (01-06)
`Approved for use through 07/31/2006. 0MB 0651-0032
`U.S. Patent and Trademarll Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paoerworll Reduction Act of 1995 no persons are reQuired to respond to a collection of information unless it displays a valid 0MB control number
`Complete if Known
`TBA
`Aoril 24 2006
`First Named Inventor Alexander Kurganov
`Examiner Name
`TBA
`Art Unit
`TBA
`Attorney Docket No.
`015749-0140
`
`Application Number
`
`"'
`
`.J
`
`r
`
`Fees pursuant to the Consolidated Appropriations Act, 2005 (H.R. 4818).
`
`FEE TRANSMITTAL Filing Date
`For FY 2006
`0 Applicant claims small entity status. See 37 CFR 1.27
`\.TOTAL AMOUNT OF PAYMENT I ($)
`500
`
`METHOD OF PAYMENT (check all that apply)
`
`D Check D Credit Card D Money Order 0None Oother (please identify):
`0 Deposit Account Deposit Account Number: 11-0404
`
`Deposit Account Name: Kelle~ D[Ye & Warren
`For the above-identified deposit account, the Director is hereby authorized to: (check all that apply)
`
`0charge fee(s) indicated below
`~ Charge any additional fee(s) or underpayments of fee(s)
`under37CFR 1.16and 1.17
`WARNING: Information on this fonn may become public. Credit card information should not be Included on this form. Provide credit card
`Information and authorization on PTO-2038.
`FEE CALCULATION (All the fees below are due upon filing or may be subject to a surcharge.)
`
`D Charge fee(s) indicated below, except for the filing fee
`0 Credit any overpayments
`
`1. BASIC FILING, SEARCH, AND EXAMINATION FEES
`FILING FEES
`SEARCH FEES
`Small Entit~
`Small Entit~
`·
`lli.ID
`lli.ID
`lli.ID
`fti!.W
`300
`150
`500
`250
`200
`100
`100
`50
`200
`100
`300
`150
`300
`150
`500
`250
`200
`100
`0
`0
`
`EXAMINATION FEES
`· Small Entit~
`lli.ID
`Fee(.i)
`200
`100
`130
`65
`160
`80
`600
`300
`0
`0
`
`Fees Paid (U
`
`(;iQQ
`
`Aeglication Tme
`Utility
`Design
`Plant
`Reissue
`Provisional
`2. EXCESS CLAIM FEES
`Fee Descrietion
`Each claim over 20 (including Reissues)
`Each independent claim over 3 (including Reissues)
`Multiple dependent claims
`Total Claims
`Extra Claims
`• 20 or HP=
`Hi
`Q
`X
`HP= highest number of total daims paid for, if greater than 20.
`lli.ID
`lndee. Claims
`Extra Claims
`• 3 or HP=
`=
`2
`I)
`X
`HP = highest number of independent daims paid for, if greater than 3.
`3. APPLICATION SIZE FEE
`If the specification and drawings exceed 100 sheets of paper (excluding electronically filed sequence or computer
`listings under 37 CFR 1.52(e)), the application size fee due is $250 ($125 for small entity) for each additional 50
`sheets or fraction thereof. See 35 U.S.C. 41(a)(l)(G) and 37 CFR l.16~s).
`Total Sheets
`Extra Sheets
`Number of each additional 50 or raction thereof
`(round up to a whole number) X
`45
`-100 =
`/ 50 =
`4. OTHER FEE(S)
`Non-English Specification, $130 fee (no small entity discount)
`Other (e.g., late filing surcharge):
`
`lli.ID
`
`=
`
`Fee Paid (I}
`
`Fee Paid (I}
`
`Small Entity
`lli.ID
`lli.ID
`25
`50
`JOO
`200
`180
`360
`Multiele Degendent Claims
`lli.ID
`Fee Paid (I}
`
`lli.ID
`
`=
`
`Fee Paid {fl
`
`Fees Paid (I}
`
`SUBMITTED BY
`( ti,
`Signature
`-
`Name (PrinVType) Scott Kaspar Cl -
`
`./"
`
`)
`
`I Registration No. 54 583
`
`IAttomev/Aaentl
`
`•
`
`Telephone 312-857-7088
`Date April 24, 2006
`
`This collection of information is required by 37 CFR 1.136. The information is required to obtain or retain a benefit by the public which is to file (and by the
`USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 30 minutes to complete,
`including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments
`on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent
`and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS
`ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`Petitioner’s Ex. 1002, Page 4
`
`

`

`,,
`
`.
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`APPLICATION FOR UNITED STATES
`LETTERS PATENT
`
`FOR
`
`ROBUST VOICE BROWSER SYSTEM AND
`VOICE ACTIVATED DEVICE CONTROLLER
`
`BY
`
`Alexander Kurganov
`Valery Zhukoff
`
`EXPRESS MAIL MAILING LABEL
`
`EV 649544830 US
`NUMBER
`DATE OF DEPOSIT ___ A_p-ril ~24_2=0-06~--,------,---,--.,..,.....,----,---,-.,...,,,--,,,....---,--,,--
`1 hereby certify that this paper or fee is being deposited with the United States Postal Service
`"EXPRESS MAIL POST OFFICE TO ADDRESSEE" service under 37 C.F.R. 1.10 on the date
`indicated above and is addressed to: Commissioner for Patents, P.O. Box 1450, Alexandria, VA
`22313.
`
`()
`
`'-"
`
`-
`
`Signature
`
`CH0I/KASPS/208188. I
`
`1
`
`Petitioner’s Ex. 1002, Page 5
`
`

`

`CROSS-REFERENCE TO RELATED APPLICATIONS
`
`[001] This application is a continuation of U.S. Patent Application No. 10/821,690, filed
`
`April 9, 2004, now allowed, which is a continuation of U.S. Patent Application No.
`
`09/776,996, filed February 5, 2001 and issued as U.S. Patent No. 6,721,705 on April 13,
`
`2004, which claims the benefit of priority to U.S. Provisional Application No. 60/180,344,
`
`filed February 4, 2000, entitled "Voice-Activated Information Retrieval System" and U.S.
`
`Provisional Application No. 60/233,068, filed September 15, 2000, entitled "Robust Voice
`
`Browser System and Voice Activated Device Controller," all of which are herein
`
`incorporated by reference in their entirety.
`
`CHOI /KASPS/208188.1
`
`2
`
`Petitioner’s Ex. 1002, Page 6
`
`

`

`FIELD OF THE INVENTION
`
`[002] The present invention relates to a robust and highly reliable system that allows users
`
`to browse web sites and retrieve information by using conversational voice commands.
`
`Additionally, the present invention allows users to control and monitor other systems and
`
`devices that are connecte~ the Internet or any other network by using voice commands.
`
`CHO I /KASPS/208188.1
`
`3
`
`Petitioner’s Ex. 1002, Page 7
`
`

`

`BACKGROUND OF THE INVENTION
`
`(003] Currently, three options exist for a user who wishes to gather information from a
`
`web site accessible over the Internet. The first option is to use a desktop or a laptop
`
`computer connected to a telephone line via a modem or connected to a network with
`
`Internet access. The second option is to use a Personal Digital Assistant (PDA) that has the
`
`capability of connecting to the Internet either through a modem or a wireless connection.
`
`The third option is to use one of the newly designed web-phones or web-pagers that are
`
`now being offered on the market. Although each of these options provide a user with
`
`access to the Internet to browse web sites, each of them have their own drawbacks.
`
`(004] Desktop computers are very large and bulky and are difficult to transport. Laptop
`
`computers solve this inconvenience, but many are still quite heavy and are inconvenient to
`
`carry. Further, laptop computers cannot be carried and used everywhere a user travels. For
`
`instance, if a user wishes to obtain information from a remote location where no electricity
`
`or communication lines are installed, it would be nearly impossible to use a laptop
`
`computer. Oftentimes, information is needed on an immediate basis where a computer is
`
`not accessible. Furthermore, the use of laptop or desktop computers to access the Internet
`
`requires either a direct or a dial-up connection tan an Internet Service Provider (ISP).
`
`Oftentimes, such connections are not available when a user desires to connect to the
`
`Internet to acquire information.
`
`(005] The second option for remotely accessing web sites is the use of PDAs. These
`
`devices also have their own set of drawbacks. First, PD As with the ability to connect to the
`
`Internet and access web sites are not readily available. As a result, these PDAs tend to be
`
`very expensive. Furthermore, users are usually required to pay a special service fee to
`
`CHOI/KASPS/208188.1
`
`4
`
`Petitioner’s Ex. 1002, Page 8
`
`

`

`enable the web browsing feature of the PDA. A further disadvantage of these PDAS is that
`
`web sites must be specifically designed to allow these devices to access information on the
`
`web site. Therefore, a limited number of web sites are available that are accessible by
`
`these web-enabled PDAs. Finally, it is very common today for users to carry cell phones,
`
`however, users must also carry a separate PDA if they require the ability to gather
`
`information from various web sites. Users are therefore subjected to added expenses since
`
`they must pay for both cellular telephone service and also for the web-enabling service for
`
`the PDA. This results in a very expensive alternative for the consumer.
`
`[006] The third alternative mentioned above is the use of web-phones or web-pagers.
`
`These devices suffer many of the same drawbacks as PDAs. First, these devices are
`
`expensive to purchase. Further, the number of web sites accessible to these devices is
`
`limited since web sites must be specifically designed to allow access by these devices.
`
`Furthermore, users are often required to pay an additional fee in order to gain wireless :web
`
`access. Again, this service is expensive. Another drawback of these web-phones or web(cid:173)
`
`pagers is that as technology develops, the methods used by the various web sites to allow
`
`access by these devices may change. These changes may require users to purchase new
`
`web-phones or web-pagers or have the current device serviced in order to upgrade the
`
`firmware or operating system stored within the device. At the least, this would be
`
`inconvenient to users and may actually be quite expensive.
`
`[007] Therefore, a need exists for a system that allows users to easily access and browse
`
`the Internet from any location. Such a system would only require users to have access to
`
`any type of telephone and would not require users to subscribe to multiple services.
`
`[008]
`
`In the rapidly changing area of Internet applications, web sites change frequently.
`
`The design of the web site may change, the information required by the web site in order to
`
`CHO I /KASPS/208188.1
`
`5
`
`Petitioner’s Ex. 1002, Page 9
`
`

`

`perform searches may change, and the method of reporting search results may change.
`
`Web browsing applications that submit search requests and interpret responses from these
`
`web sites based upon expected formats will produce errors and useless responses when
`
`such changes occur. Therefore, a need exists for a system that can detect modifications to
`
`web sites and adapt to such changes in order to quickly and accurately provide the
`
`information requested by a user through a voice enabled device, such as a telephone.
`
`[009] When users access web sites using devices such as personal computers, delays in
`
`receiving responses are tolerated and are even expected, however, such delays are not
`
`expected when a user communicates with a telephone. Users expect communications over
`
`a telephone to occur immediately with a minimal amount of delay time. A user attempting
`
`to find information using a telephone expects immediate responses to his search requests.
`
`A system that introduces too much delay between the time a user makes a request and the
`
`time of response will not be tolerated by users and will lose its usefulness. Therefore, it is
`
`important that a voice browsing system that uses telephonic communications selects web
`
`sites that provide rapid responses since speed is an important factor for maintaining the
`
`system's desirability and usability. Therefore, a need exists for a system that accesses web
`
`sites based upon their speed of operation.
`
`CH0I/KASPS/208188.1
`
`6
`
`Petitioner’s Ex. 1002, Page 10
`
`

`

`SUMMARY OF THE INVENTION
`
`[0010] It is an object of an embodiment of the present invention to allow users to gather
`
`information from web sites by using voice enabled devices, such as wireline or wireless
`
`telephones.
`
`[0011] An additional object of an embodiment of the present invention is to provide a
`
`system and method that allows the searching and retrieving of publicly available
`
`information by controlling a web browsing server using naturally spoken voice commands.
`
`[0012] It is an object of another embodiment of the present invention to provide a robust
`
`voice browsing system that can obtain the same information from several web sites based
`
`upon a ranking order. The ranking order is automatically adjusted if the system detects that
`
`a given web site is not functioning, is too slow, or has been modified in such a way that the
`
`requested information cannot be retrieved any longer.
`
`[0013] A still further object of an embodiment of the present invention is to allow users to
`
`gather information from web sites from any location where a telephonic connection can be
`
`made.
`
`[0014] Another object of an embodiment of the present invention is to allows users to
`
`browse web sites on the Internet using conversational voice commands spoken into
`
`wireless or wireline telephones or other voice enabled devices.
`
`[0015] An additional object an embodiment of the present invention is to provide a system
`
`and method for using voice commands to control and monitor devices connected to a
`
`network.
`
`[0016] It is an object of an embodiment of the present invention to provide a system and
`
`method which allows devices connected to a network to be controlled by conversational
`
`CHO l /KASPS/208188.1
`
`7
`
`Petitioner’s Ex. 1002, Page 11
`
`

`

`voice commands spoken into any voice enabled device interconnected with the same
`
`network.
`
`[0017] The present invention relates to a system for acquiring information from sources on
`
`a network, such as the Internet. A voice browsing system maintains a database containing
`
`a list of information sources, such as web sites, connected to a network. Each of the
`
`information sources is assigned a rank number which is listed in the database along with
`
`the record for the information source. In response to a speech command received from a
`
`user, a network interface system accesses the information source with the highest rank
`
`number in order to retrieve information requested by the user.
`
`[0018] The a preferred embodiment of the present invention allows users to access and
`
`browse web sites when they do not have access to computers with Internet access. This is
`
`accomplished by providing a voice browsing system and method that allows users to
`
`browse web sites using conversational voice commands spoken into any type of voice
`
`enabled device (i.e., any type ofwireline or wireless telephone, IP phone, wireless PDA, or
`
`other wireless device). These spoken commands are then converted into data messages by
`
`a speech recognition software engine running on a user interface system. These data
`
`messages are then sent to and processed by a network interface system. This network
`
`interface system then generates the proper requests that are transmitted to the desired web
`
`site over the Internet. Responses sent from the web site are received and processed by the
`
`network interface system and then converted into an audio message via a speech synthesis
`
`engine or a pre-recorded audio concatenation application and finally transmitted to the
`
`user's voice enabled device.
`
`[0019] A preferred embodiment of the voice browser system and method uses a web site
`
`polling and ranking methodology that allows the system to detect changes in web sites and
`
`CH0IIKASPS/208188.1
`
`8
`
`Petitioner’s Ex. 1002, Page 12
`
`

`

`adapt to those changes in real-time. This enables the voice browser system of a preferred
`
`embodiment to deliver highly reliable information to users over any voice enabled device.
`
`This ranking system also enables the present invention to provide rapid responses to user
`
`requests. Long delays before receiving responses to requests are not tolerated by users of
`
`voice-based systems, such as telephones. When a user speaks into a telephone, an almost
`
`immediate response is expected.
`
`This expectation does not exist for non-voice
`
`communications, such as email transmissions or accessing a web site using a personal
`
`computer. In such situations, a reasonable amount of transmission delay is acceptable. The
`
`ranking system of implemented by a preferred embodiment of the present invention ensures
`
`users will always receive the fastest possible response to their request.
`
`[0020] An alternative embodiment of the present invention allows users to control and
`
`monitor the operation of a variety of household devices connected to a network using
`
`speech commands spoken into a voice enabled device.
`
`CH0IIKASPS/208188.1
`
`9
`
`Petitioner’s Ex. 1002, Page 13
`
`

`

`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0021] FIG. 1 is a depiction of the voice browsing system of the first embodiment of the
`
`present invention;
`
`[0022] FIG. 2 is a block diagram of a database record used by the first preferred
`
`embodiment of the present invention;
`
`[0023] FIG. 3 is a block diagram of a media server used by the preferred embodiment;
`
`[0024] FIG. 4 is a block diagram of a web browsing server used by the preferred
`
`embodiment; and
`
`[0025] FIG. 5 is a depiction of the device browsing system of the second embodiment of
`
`the present invention.
`
`CH0I/KASPS/208188.1
`
`10
`
`Petitioner’s Ex. 1002, Page 14
`
`

`

`DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
`
`(0026] A first embodiment of the present invention is a system and method for allowing
`
`users to browse information sources, such as web sites, by using naturally spoken,
`
`conversational voice commands spoken into a voice enabled device. Users are not required
`
`to learn a special language or command set in order to communicate with the voice
`
`browsing system of the present invention. Common and ordinary commands and phrases
`
`are all that is required for a user to operate the voice browsing system. The voice browsing
`
`system recognizes naturally spoken voice commands and is speaker-independent; it does
`
`not have to be trained to recognize the voice patterns of each individual user. Such speech
`
`recognition systems use phonemes to recognize spoken words and not predefined voice.
`
`patterns.
`
`(0027] The first embodiment allows users to select from various categories of information
`
`and to search those categories for desired data by using conversational voice commands.
`
`The voice browsing system of the first preferred embodiment includes a user interface
`
`system referred to as a media server. The media server contains a speech recognition
`
`software engine.
`
`This speech recognition engine is used to recognize natural,
`
`conversational voice commands spoken by the user and converts them into data messages
`
`based on the available recognition grammar. These data messages are then sent to a
`
`network interface system. In the first preferred embodiment, the network interface system
`
`is referred to as a web browsing server. The web browsing server then accesses the
`
`appropriate information source, such as a web site, to gather information requested by the
`
`user.
`
`(0028] Responses received from the information sources are then transferred to the media
`
`CHOI/KASPS/208188.1
`
`11
`
`Petitioner’s Ex. 1002, Page 15
`
`

`

`server where speech synthesis engine converts the responses into audio messages that are
`
`tran