==== c:
`=·
`~
`= t r t
`~d
`
`I
`
`00-\'6-00
`PROVISIONAL APPLICATION COVER SHEET
`Th ..
`fir
`
`
`
`d 37 CFR 1 53 (b)(2) PROVISIONAL APPLICATION 1s 1s a request or 1 mga un er
`:6
`
`A IPRoV
`
`Docket
`Number
`
`47242-00034
`
`Type a plus sign (+)inside this box
`
`+
`
`LAST NAME
`
`FIRST NAME
`
`MIDDLE
`INITIAL
`
`RESIDENCE (CITY AND EITHER STATE OR
`FOREIGN COUNTRY)
`
`INVENTOR(s)/ APPLICANT(s)
`
`Kurganov
`
`Alex
`
`2099 Sheridan Road, Buffalo Grove, IL 60089
`
`.
`
`...
`
`Invention: Robust Voice Browser System and Voice Activated Device Controller
`
`TITLE OF THE INVENTION (280 characters max)
`
`CORRESPONDENCE ADDRESS
`
`S.Z. Szczepanski Esq.
`Jenkens & Gilcrhist
`1445 Ross Avenue, Suite 3200
`Dallas
`
`STATE I Texas
`
`ZIP CODE
`
`75202
`
`COUNTRY I USA
`
`ENCLOSED APPLICATION PARTS (check all that apply)
`
`~ Specification
`~ Drawings
`
`Number of Pages -21_
`
`Number of Sheets_1_
`
`D Small Entity Statement
`D Other (specify)
`
`• CW>
`
`.....
`0 ~
`co~
`·'° m-~
`--~-~
`'Id'---
`~W>.
`
`METHOD OF PAYMENT (check one)
`~ A check or money order is enclosed to cover the Provisional filing fees
`D The Commissioner is hereby authorized to charge ming fees and credit
`
`Deposit Account Number: 10-0447 (47242-00034)
`
`PROVISIONAL FILING FEE AMOUNT $75.00
`
`The invention was made by an agency of the United States Government or under a contract with an agency of the United States
`Government.
`
`~No.
`D Yes, the name of the U.S. Government agency and the Government contract number a r e : - - - - - - - - - - - - - - -
`
`Date: p s-/;1, 0 o eJ
`
`7
`
`Respectfully submitted,
`
`RU8SeiliGenet
`Registration No: 42,571
`JENKENS & GILCHRIST
`1445 Ross Avenue, Suite 3200
`Dallas, TX 75202
`(312) 425-3900
`
`NUMBER EK506616956US
`
`EXPRESS MAIL MAILING LABEL
`DATE OF DEPOSIT: September 15, 2000
`
`I hereby certify that this paper or fee is being deposited with the United States Postal Service "EXPRESS
`MAIL POST OFFICE TO ADDRESSEE" service under 37 C.F.R. 1.10 on the date indicated above and is
`c. 20231.
`
`CHICAGO 128603vl 47242-00034
`
`Google Ex 1023 - Page 1
`
`

`

`47242-00034
`
`PROVISIONAL APPLICATION FOR UNITED STATES LETTERS
`
`PATENT
`
`for
`
`ROBUST VOICE BROWSER SYSTEM AND
`
`VOICE ACTIVATED DEVICE CONTROLLER
`
`INVENTORS:
`
`Alex Kurganov
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 2
`
`

`

`2
`
`ROBUST VOICE BROWSER SYSTEM AND
`
`VOICE ACTIVATED DEVICE CONTROLLER
`
`FIELD OF THE INVENTION
`
`5
`
`The present invention relates to a robust and highly reliable system that allows
`
`users to browse web sites and retrieve information by using conversational voice
`
`commands. Additionally, the present invention allows users to control and monitor other
`
`systems and devices that are connected the Internet or any other network by using voice
`
`commands.
`
`10
`
`BACKGROUND OF THE INVENTION
`
`Currently, three options exist for a user who wishes to gather information from a
`
`web site accessible over the Internet. The first option is to use a desktop or a laptop
`
`computer connected to a telephone line via a modem or connected to a network with
`
`15
`
`Internet access. The second option is to use a Personal Digital Assistant (PDA) that has
`
`the capability of connecting to the Internet either through a modem or a wireless
`
`connection. The third option is to use one of the newly designed web-phones or web(cid:173)
`
`pagers that are now being offered on the market. Although each of these options can
`
`allow a user to access the Internet and browse web sites, each of them have their own
`
`20
`
`drawbacks.
`
`Desktop computers are very large and bulky and are difficult to transport. Laptop
`
`computers solve this inconvenience, but many are still quite heavy and are inconvenient
`
`to carry. Further, laptop computers cannot be carried and used everywhere that a user
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 3
`
`

`

`3
`
`travels. For instance, if a user wishes to obtain information from a remote location where
`
`no electricity or communication lines are installed, it would be nearly impossible to use a
`
`laptop computer. Oftentimes, information is needed on an immediate basis where a
`
`computer is not accessible. Furthermore, the use of laptop or desktop computers to
`
`5
`
`access the Internet requires a connection to either a network or a POTS (Plaint Old
`
`Telephone Service) line. Oftentimes, such connections are not available when a user
`
`desires to connect to the Internet.
`
`The second option for remotely accessing web sites is the use of PD As. These
`
`devices also have their own set of drawbacks. First, PDAs that have the ability to
`
`10
`
`connect to the Internet and access web sites are not readily available. As a result, these
`
`PDAs tend to be very expensive. Furthermore, users are usually required to pay a special
`
`service fee to enable the web browsing feature of the PDA. A further disadvantage of
`
`these PDAs is that web sites must be specifically designed to allow these devices to
`
`access information on the web site. Therefore, a limited number of web sites are
`
`15
`
`available that are accessible by these web-enabled PDAs. Finally, it is very common
`
`today for users to carry cell phones, however, users must also carry a separate PDA if
`
`they require the ability to gather information from various web sites. Therefore, users
`
`must carry two separate devices and must also subscribe to and pay for two separate
`
`services. That is, a user must pay for both cellular telephone service and also for the
`
`20 web-enabling service for the PDA. This results in a very expensive alternative for the
`
`consumer.
`
`The third alternative mentioned above is the use of web-phones or web-pagers.
`
`These devices suffer many of the same drawbacks as PD As. First, these devices are
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 4
`
`

`

`4
`
`expensive to purchase. Further, the number of web sites accessible to these devices is
`
`limited since web sites must be specifically designed to allow access by these devices.
`
`Furthermore, users are often required to pay an additional fee in order to gain wireless
`
`web access. Again, this service is expensive. Another drawback of these web-phones or
`
`5 web-pagers is that as technology develops, the methods used by the various web sites to
`
`allow access by these devices may change. These changes may require users to purchase
`
`new web-phones or web-pagers or have the current device serviced in order to upgrade
`
`the firmware or operating system stored within the device. At the least, this would be
`
`inconvenient to users and may actually be quite expensive.
`
`10
`
`SUMMARY OF THE INVENTION
`
`The present invention allows users to access and browse web sites without being
`
`subjected to the added expenses, inconveniences, and limitations that exist in currently
`
`available web browsing systems. This is accomplished by providing a system and
`
`15 method that allows users to browse web sites using conversational voice commands
`
`spoken into any type of voice receiving device (i.e., any type ofwireline or wireless
`
`telephone, IP phone, or other wireless device). These spoken commands are then
`
`converted into data messages by a speech recognition engine running on a media server.
`
`These data messages are then processed by a web browsing module and transmitted to
`
`20
`
`the desired web site using the Internet. Responses sent from a web site are received and
`
`processed by the web browsing module and transmitted as formatted data to the media
`
`server. The media server converts this data into audible messages by either matching the
`
`data with a prerecorded audio prompt or by using a speech synthesizer.
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 5
`
`

`

`5
`
`The voice browser system and method of the present invention uses a web site
`
`polling and ranking methodology that allows the system to detect changes in web sites
`
`and adapt to those changes in real-time. This enables the voice browser system to deliver
`
`highly reliable information to users over any voice enabled device. This ranking system
`
`5
`
`also enables the present invention to provide rapid responses to user requests. Long
`
`delays before receiving responses to requests are not tolerated by users of voice-based
`
`systems, such as telephones. When a user speaks into a telephone, an almost immediate
`
`response is expected. This expectation does not exist for non-voice communications,
`
`such as email transmissions or accessing a web site using a personal computer. In such
`
`10
`
`situations, a reasonable amount of transmission delay is acceptable. The ranking system
`
`of the present invention ensures users will always receive the fastest possible response to
`
`their request.
`
`An alternative embodiment of the present invention allows users to control and
`
`monitor the operation of a variety of devices connected to a network using voice
`
`15
`
`commands spoken into a voice receiving device.
`
`It is an object of the present invention to allow users to gather information from
`
`web sites by using voice receiving devices, such as wireline or wireless telephones.
`
`An additional object of the present invention is to provide a system and method
`
`that allows the searching and retrieving of publicly available information by controlling a
`
`20 web browsing module using naturally spoken voice commands.
`
`It is an object of the present invention to provide a robust voice browsing system
`
`that can obtain the same information from several web sites based upon a ranking order.
`
`The ranking order is automatically adjusted if the system detects that a given web site is
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 6
`
`

`

`6
`
`not functioning, is too slow, or has been modified in such a way that the requested
`
`information cannot be retrieved any longer.
`
`A further object of the present invention is to provide a system and method that
`
`allows users to browse web sites using a single device that requires only one subscription
`
`5
`
`service.
`
`A still further object of the invention is to allow users to gather information from
`
`web sites from any location where a telephonic connection can be made.
`
`Another object of the present invention is to allows users to browse web sites on
`
`the Internet using conversational voice commands spoken into wireless or wireline
`
`10
`
`telephones.
`
`An additional object of the present invention is to provide a system and method
`
`for using voice commands to control and monitor devices connected to a network.
`
`It is an object of the present invention to provide a system and method which
`
`allows devices connected to a network to be controlled by conversational voice
`
`15
`
`commands spoken into any voice enabled device interconnected with the same network.
`
`A further object of the present invention is to allow devices connected to the
`
`Internet to be controlled by conversational voice commands spoken into any voice
`
`enabled device connected to the Internet.
`
`20
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a depiction of the voice browsing system of the first embodiment of the
`
`present invention.
`
`FIG. 2 is a depiction of the device browsing system of the second embodiment of
`
`CHICAGO l24483vl 47242-00034
`
`Google Ex 1023 - Page 7
`
`

`

`the present invention.
`
`7
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`A first embodiment of the present invention is a system and method for allowing
`
`5
`
`users to browse web sites by using conversational voice commands spoken into a voice(cid:173)
`
`receiving device. Users are not required to learn a special language or command set in
`
`order to communicate with the voice browsing system of the present invention.
`
`Common and ordinary commands and phrases are all that is required for a user to operate
`
`the voice browsing system. The voice browsing system recognizes naturally spoken
`
`10
`
`voice commands and does not have to be trained to recognize the voice patterns of each
`
`individual user. Such voice recognition systems use phonemes to recognize spoken
`
`words and not voice patterns.
`
`The first embodiment allows users to select from various categories of
`
`information and to search those categories for desired data by using conversational voice
`
`15
`
`commands. The present invention uses a media server containing a speech recognition
`
`engine. This speech recognition engine is used to recognize natural, conversational voice
`
`commands spoken by the user and converts them into data messages. These data
`
`messages are processed by a web browsing module and used to access the appropriate
`
`web site to gather information requested by the user. The media server also contains a
`
`20
`
`speech synthesis engine that converts the data responses received from the various web
`
`sites into audio messages that are transmitted to the user. A more detailed description of
`
`this embodiment will now be provided.
`
`Referring to FIG. 1, a database 2 designed by Webley Systems Incorporated is
`
`CHICAGO l24483vl 47242-00034
`
`Google Ex 1023 - Page 8
`
`

`

`8
`
`connected to one or more web browsing modules 4 as well as to one or more media
`
`servers 6. This database 2 contains a listing of accessible web sites, parameters required
`
`to access each listed web site, "content descriptors" that describe the expected format of
`
`the responses received from each web site, and the rank number of each web site. These
`
`5
`
`features will be further described later. The database also contains a listing of pre(cid:173)
`
`recorded voice responses. Further, database 2 may contain customer profile information,
`
`system activity reports, and any other data or software modules necessary for the testing
`
`or administration of the voice browsing system.
`
`The web browsing modules 4 provide access to any computer network such as the
`
`IO
`
`Internet 8. These modules also perform the task ofreceiving responses from web sites
`
`and extracting the data requested by the user. This task is also known as "content
`
`extraction." The web browsing modules 4 also perform the task of periodically polling
`
`or "pinging" various web sites and modifying the ranking numbers of these web sites
`
`depending upon their response and speed. This polling feature is further discussed
`
`15
`
`below. The media servers 6 provide speech recognition, speech synthesis, and call
`
`handling functions. The speech recognition function is performed by a speech
`
`recognition engine that converts voice commands received from the user's voice
`
`receiving device 10 (i.e., any type of wireline or wireless telephone, Internet Protocol (IP)
`
`phones, or other special wireless units) into data messages that comply with the
`
`20
`
`appropriate communications protocol. In the preferred embodiment, the data messages
`
`must comply with the TCP/IP communication protocol. These data messages are then
`
`processed by the web browsing modules 4 and the appropriate web site 12 is accessed
`
`over the Internet 8 to obtain the desired information. The web sites accessible by this
`
`CHICAGO l24483vl 47242-00034
`
`Google Ex 1023 - Page 9
`
`

`

`9
`
`system may be written in any type of software language, including XML, HDML,
`
`HTML, or any variation of these languages. The speech synthesis function of media
`
`server 6 is performed by a speech synthesis engine that converts the data messages
`
`received from the web site 12 into audio messages. These audio messages are then
`
`5
`
`transmitted to the user's voice receiving device 10.
`
`A preferred speech recognition engine is developed by Nuance Communications
`
`of 1380 Willow Road, Menlo Park, California 94025 (www.nuance.com). A preferred
`
`speech synthesis engine is developed by Lernout and Hauspie Speech Products, 52 Third
`
`Avenue, Burlington, Massachusetts 01803 (www.lhsl.com). Further, a preferred media
`
`10
`
`server is based on an Intel Dual Pentium III 650 MHz microprocessor running a Natural
`
`Speech Recognition Engine from Nuance Communications and a Speech Synthesis
`
`Engine developed by Webley Systems using Lernout and Hauspie software. The Nuance
`
`engine delivers 40 recognition units as defined in the vendor specification.
`
`In operation, a user establishes a connection between his voice receiving device
`
`15
`
`10 and a media server 6. This may be done through the Public Switched Telephone
`
`Network (PSTN) 16 by calling a telephone number associated with the voice browsing
`
`system. Once the connection is established, the media server 6 initiates an interactive
`
`voice response (NR) application. The NR application aurally provides the user with a
`
`list of options, such as, "stock quotes", "flight status", "yellow pages'', ''weather", and
`
`20
`
`"news". The user selects the desired option by speaking the name of the option into the
`
`voice receiving device 10.
`
`As an example, if a user wishes to obtain restaurant information, he may speak
`
`into his telephone the word "yellow pages". The NR application would then ask the
`
`CHICAGO l24483vl 47242-00034
`
`Google Ex 1023 - Page 10
`
`

`

`10
`
`user what he would like to find and the user may respond by stating "restaurants". The
`
`user may then be provided with further options related to searching for the desired
`
`restaurant. For instance, the user may be provided with the following restaurant options,
`
`"Mexican Restaurants", "Italian Restaurants", or "American Restaurants". The user then
`
`5
`
`speaks into his voice receiving device 10 the restaurant type of interest. The IVR
`
`application running on the media server 6 may also request additional information
`
`limiting the geographic scope of the restaurants to be reported to the user. For instance,
`
`the IVR application may ask the user to identify the zip code of the area where the
`
`restaurant should be located. The media server 6 uses the speech recognition engine to
`
`10
`
`interpret the speech commands received from the user. The speech recognition engine
`
`converts the user's voice signals into properly formatted data messages that are
`
`subsequently used by a web browsing module 4 to access the appropriate web sites 12 via
`
`the Internet.
`
`The content information received from the responding web site 12 is then
`
`15
`
`processed by the web browsing module 4 according to the "content descriptor"
`
`information stored in database 2. This processed response is then transmitted to the
`
`media server 6 for conversion into audio messages using either the speech synthesis
`
`software or selecting among a database of prerecorded voice responses contained within
`
`the database 2.
`
`20
`
`The database 2 contains a listing of web sites 12 that may be accessed by the
`
`voice browser system of the present invention. This database 2 is an integral part of the
`
`voice browsing system of the present invention. The web sites listed in this database 2
`
`are grouped by the various categories to which they apply. For instance, a set of web
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 11
`
`

`

`11
`
`sites useful in obtaining restaurant information is listed under the "restaurants" category.
`
`For each web site listed within database 2, a table exists listing the parameters required
`
`to access the particular web site and the data formatting requirements. For instance,
`
`certain web sites may require inputting a zip code or a user identification number in order
`
`5
`
`to access the site. The database 2 also contains "content descriptors" related to each
`
`listed web site. These "content descriptors" provide information regarding how to
`
`interpret responses received from that web site. Individual web sites may provide
`
`response data in varying formats. The "content descriptors" allow the web browsing
`
`modules 4 to successfully recognize the data received from each web site and reformat
`
`10
`
`the data into a format useable by the media servers 6.
`
`For each category searchable by a user, the database 2 may list several web sites
`
`that may be searched. Each of these web sites is assigned a rank number. As an
`
`example, three different web sites may be listed as searchable under the category of
`
`"restaurants". Each of those web sites will be assigned a rank number such as I, 2, or 3.
`
`15
`
`The site with the highest rank (rank= 1) will be the first web site accessed by a web
`
`browser module 4. If the information requested by the user cannot be found at this first
`
`web site, then the web browser module 4 will search the second ranked web site and so
`
`forth down the line until it is able to obtain all information requested by the user or has
`
`no more web sites left to check.
`
`20
`
`The web site ranking method and system of the present invention enables the
`
`voice browser system to be robust and adaptable to changes that may occur as web sites
`
`evolve. In the rapidly changing area of Internet applications, web sites change
`
`frequently. For instance, the information required by a web site 12 to perform a search or
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 12
`
`

`

`12
`
`the format of the reported response data may change. Without the ability to adequately
`
`monitor and detect these changes, a search requested by users may tum-up with an
`
`incomplete response, no response, or an error. Such useless responses may result from
`
`incomplete data being provided to the web site or the web browser module 4 being
`
`5
`
`unable to recognize the response data messages received from the searched web site 12.
`
`The robustness and reliability of the voice browsing system of the present
`
`invention is further improved by continually polling or "pinging" each of the sites listed
`
`in the database 2. During this polling function, a web browsing module 4 sends brief
`
`requests to each web site listed in database 2. The web browsing module 4 monitors the
`
`10
`
`response received from each web site and determines whether it is a complete response
`
`and whether the response is in the expected format specified by the "content descriptors"
`
`listed in database 2. Those polled web sites that provide complete responses in the
`
`format specified by the "content descriptors" have their ranking established based on the
`
`speed of their responses. W eh sites that provide fast response times will be assigned
`
`15
`
`higher rankings than those with slow response times. If the web browsing module 4
`
`receives no response from the polled web site or if the response received is not in the
`
`expected format, then the rank of that web site is lowered. Additionally, an alarm may be
`
`generated for the system administrator indicating that the specified web site has been
`
`modified and requires further review.
`
`20
`
`Since the web browsing modules 4 access web sites based upon their ranking
`
`number, only those web sites that produce useful and error-free responses will be used by
`
`the voice browser system to gather information requested by the user. Further, since the
`
`ranking numbers are also based upon the speed of a web site in providing responses, only
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 13
`
`

`

`13
`
`the most time efficient sites are accessed. Those web sites that the voice browser system
`
`has trouble accessing will be assigned lower rank numbers and therefore will not be
`
`primarily used in performing searches. This system assures that users will get complete,
`
`timely, and relevant responses to their requests. Without this feature, users may often be
`
`5
`
`provided with information that is not relevant to their request or may not get any
`
`information at all. The constant polling and re-ranking of the web sites used within each
`
`category allows the voice browser of the present invention to operate efficiently. Finally,
`
`it allows the voice browser system of the present invention to dynamically adapt to
`
`changes in the rapidly evolving web sites that exist on the Internet.
`
`10
`
`Selecting only those web sites that provide rapid responses is an important factor
`
`for maintaining the desirability and usability of the present invention to users. When
`
`users access web sites using devices such as personal computers, delays in receiving
`
`responses are tolerated and are even expected, however, such delays are not expected
`
`when a user communicates with a telephone. Users expect communications over a
`
`15
`
`telephone to occur immediately with a minimal amount of delay time. A user attempting
`
`to find information using a telephone expects immediate responses to his search requests.
`
`A system that introduces too much delay between the time user makes a request and the
`
`time of response will not be tolerated by users and will lose its usefulness. The ranking
`
`system of the present invention is crucial to avoiding this problem and providing a useful
`
`20
`
`system to users.
`
`A second embodiment of the present invention provides is depicted in FIG. 2.
`
`This embodiment provides a system and method for controlling a variety of devices 20
`
`connected to a network 22 by using voice conversational commands spoken into a voice
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 14
`
`

`

`14
`
`receiving device 24 (i.e., wireline or wireless telephones, futernet Protocol (IP) phones,
`
`or other special wireless units). The networked devices may include various household
`
`devices or household systems. For instance, voice commands may be used to control
`
`household security systems, VCRs, TVs, outdoor or indoor lighting, sprinklers, or
`
`5
`
`heating and air conditioning systems.
`
`Each of these systems or devices 20 is connected to a network 22. These devices
`
`20 may contain embedded microprocessors or may be connected to other computer
`
`equipment that allow the device 20 to communicate with network 22. This network 22
`
`interfaces with one or more device browsing modules 26 manufactured by Webley
`
`10
`
`Systems fucorporated. The device browsing modules perform many of the same
`
`functions as the web browsing modules 4 discuss above in the first preferred
`
`embodiment. The device browsing modules 26 are also connected to a database 28.
`
`Database 28 lists all devices that are connected to the network 22. The database
`
`28 also contains a listing of the options and functions available for each of the devices 20
`
`15
`
`connected on the network 22. Furthermore, database 28 contains the information
`
`necessary to properly communicate with the networked devices 20. Such information
`
`would include, for example, communication protocols, message formatting requirements,
`
`and required operating parameters. Database 2 may also include any other data or
`
`software necessary to test and administer the device browsing system.
`
`20
`
`A device browsing module 26 also receives messages from the various networked
`
`devices 20, appropriately formats those messages, and transmits them to one or more
`
`media servers 30 which are part of the device browsing system. The user's voice
`
`receiving devices 24 access the device browsing system by calling into a media server 30
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 15
`
`

`

`via the Public Switched Telephone Network (PSTN) 32.
`
`15
`
`The function of the media servers 30 is to provide speech synthesis and natural
`
`speech recognition. When data messages are received from the device browser module
`
`26, a media server 30 will convert the data message into audio messages that are
`
`5
`
`transmitted to the voice receiving device of the user 24. Voice commands received from
`
`the voice receiving device of the user 24 are converted by a media server 30 into data
`
`messages conforming to the appropriate communication protocol via the speech
`
`recognition software engine running on the media server 30. A preferred speech
`
`recognition engine is developed by Nuance Communications of 1380 Willow Road,
`
`10 Menlo Park, California 94025 (www.nuance.com). A preferred speech synthesis engine
`
`is developed by Lemout and Hauspie Speech Products, 52 Third A venue, Burlington,
`
`Massachusetts 01803 (www.lhsl.com). A preferred media server 30 is based on the Intel
`
`Dual Pentium ill 650 MHz microprocessor running a Natural Speech Recognition Engine
`
`from Nuance Communications. This engine delivers 40 recognition units as defined in
`
`15
`
`the vendor specification.
`
`A specific example for using the system and method of this embodiment of the
`
`invention will now be given. First, a user may call into a media server 30 by dialing a
`
`telephone number associated with an established device browsing system. Once the user
`
`is connected, the media server 30 will provide the user with a list of available systems
`
`20
`
`that may be monitored or controlled based upon information contained in database 28.
`
`For example, the user may be provided with the option to select "Home Systems"
`
`or "Office Systems". The user may then speak the command "access home systems".
`
`The media server 30 would then access the database 28 and provide the user with a
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 16
`
`

`

`16
`
`listing of the home subsystems or devices 20 available on the network 22 for the user to
`
`monitor and control. For instance, the user may be given a listing of subsystems such as
`
`"Outdoor Lighting System", "Indoor Lighting System", "Security System", or "Heating
`
`and Air Conditioning System". The user may then select the indoor lighting subsystem
`
`5
`
`by speaking the command "Indoor Lighting System". The media server 30 would then
`
`provide the user with a set of options related to the indoor lighting system. For instance
`
`the media server 30 may then provide a listing such as "Dining Room", "Living Room",
`
`"Kitchen", or "Bedroom". After selecting the desired room, the media server 30 would
`
`provide the user with the options to hear the "status" of the lighting in that room or to
`
`10
`
`"tum on'', "tum off', or "dim" the lighting in the desired room. These commands are
`
`provided by the user by speaking the desired command into the users voice receiving
`
`device 24. The media server 30 receives this command and translates it into an
`
`appropriately formatted data message based upon the communication parameters defined
`
`in database 28. This data message is then forwarded to the device browser module 26
`
`15 which routes the message appropriate device 20.
`
`The device browser system of this embodiment of the present invention also
`
`provides the same robust and reliability features described in the first embodiment. The
`
`device browser system has the ability to detect whether new devices have been added to
`
`the system or whether current devices are out-of-service. This robustness is achieved by
`
`20
`
`periodically polling or "pinging" all devices 20 listed in database 28. The device
`
`browsing module 26 periodically polls each device 20 and monitors the response. If the
`
`device browsing module 26 receives a recognized and expected response from the polled
`
`device, then the device is categorized as being recognized and in-service. However, if
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 17
`
`

`

`17
`
`the device browsing module 26 does not receive a response from the polled device 20 or
`
`receives an unexpected response, then the device 20 is marked as being either new or
`
`out-of-service. A report may then be generated for the user indicating that a new device
`
`has been detected or that an existing device is experiencing trouble.
`
`5
`
`Therefore, this embodiment allows users to remotely monitor and control any
`
`devices that are connected to a network, such as devices within a home or office.
`
`Furthermore, no special telecommunications equipment is required for users to remotely
`
`access the device browser system. Users may use any type of voice receiving device (i.e.,
`
`wireline or wireless telephones, IP phones, or other wireless units) available to them.
`
`Io
`
`Furthermore, a user may perform these functions from anywhere without having to
`
`subscribe to any type of special services. Therefore, no additional expenses are incurred
`
`by the user.
`
`The descriptions of the preferred embodiments described above are set forth for
`
`illustrative purposes and are not intended to limit the present invention in any manner.
`
`15
`
`Equivalent approaches are intended to be included within the scope of the present
`
`invention. While the present invention has been described with reference to the
`
`particular embodiments illustrated, those skilled in the art will recognize that many
`
`changes and variations may be made thereto without departing from the spirit and scope
`
`of the present invention. These embodiments and obvious variations thereof are
`
`20
`
`contemplated as falling within the scope and spirit of the claimed invention.
`
`CHICAGO 124483vl 47242-00034
`
`Google Ex 1023 - Page 18
`
`

`

`18
`
`CLAIMS
`
`I claim:
`
`1.
`
`A system for a