`
`1
`
`Parus Exhibit 2027
`Google, et al. v. Parus Holdings, Inc.
`IPR2020-00846
`Page 1 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`The Webley System is a system for retrieving information from pre-selected web sites by uttering speech commands into
`a voice enabled device and for providing to users retrieved information in an audio form via said voice enabled device,
`said system.
`
`[1pre] 1. A system for
`retrieving information from
`pre-selected web sites by
`uttering speech commands
`into a voice enabled device
`and for providing to users
`retrieved information in an
`audio form via said voice
`enabled device, said system
`comprising:
`
`The Webley System, which included the Webley Assistant, was a virtual voice assistant accessible by telephone or web
`was created by Webley Inc., and predates U.S. Provisional Patent Application No. 60/174,371 to Kovatch (the “Kovatch
`Provisional”) which has a priority date of January 4, 2000.
`
`See, e.g., Ex. 2029.
`
`2
`
`Parus Exhibit 2027, Page 2 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`See, e.g., Ex. 2030.
`
`The Webley Assistant accepted spoken commands from users and carried out the users instructions.
`
`3
`
`Parus Exhibit 2027, Page 3 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`See, e.g., Ex. 2031.
`
`The Webley Assistant is based on source code that predates the Kovatch reference. For example, the mc_vm.c, which is
`the main source code file for the Webley Assistant, has a date of last being modified 12/31/1999:
`
`4
`
`Parus Exhibit 2027, Page 4 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`Ex. 2025 at lines 1-18.
`
`Further, the Webley System retrieves information from pre-selected web sites by uttering speech commands into a voice
`enabled device and for providing to users retrieved information in an audio form via said voice enabled deivce. For
`example, the mc_vm.c source code file includes a “getWeather()” function that further calls a “webget.pl” PERL module
`using weather as an argument:
`
`5
`
`Parus Exhibit 2027, Page 5 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`Ex. 2025 at lines 13,607-13,641.
`
`The webget.pl PERL script, which was last modified on 12/13/1999, determines that the service is “weather” because it
`was an argument and reads in a weather.ini content descriptor:
`
`6
`
`Parus Exhibit 2027, Page 6 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`Ex. 2032 at lines 1-10 and 24-31.
`
`The weather.ini file includes a plurality of pre-selected web site addresses, each web site address identifying a web site
`address identifying a web site containing weather information to be retrieved. For example, the weather.ini file included
`URLs, or web site addresses, for cnn.com, lycos.com, weather.com, snap.com, and infospace.com:
`
`7
`
`Parus Exhibit 2027, Page 7 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1pre] 1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to
`users retrieved information in an audio form via said voice enabled device, said system comprising:"
`
`Ex. 2033 at lines 1-4, 63-68, 121-124, 183-186, and 241-245.
`
`A user would utter speech commands into the telephone, which is a voice enabled device. The Webley Assistant used
`licensed Automatic Speech Recognition (“ASR”) software from Nuance to understand the speech commands. The
`Webley Assistant used Nuance’s version 6.11 ASR software:
`
`Ex. 2025 at lines 68-71.
`
`After uttering the commands, such as “weather,” into the phone, the Webley Assistant would retrieve the information
`from a pre-selected web site and then convert the textual information into audio by using the Lernout & Hauspie TTS
`software. Evidence demonstrating that Lernout & Hauspie TTS was being used can be found in the mc_vm.c file which
`includes the “app_lnhtts.h” which was a Lernout & Hauspie file that included internal TTS definitions:
`
`Ex. 2025 at lines 43-50.
`
`The Webley Assistant would convert the retrieved textual information into audio form and would provide the information
`to the user via the telephone.
`
`8
`
`Parus Exhibit 2027, Page 8 of 51
`
`
`
`[1.a] a computer, said
`computer operatively
`connected to the internet;
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.a] a computer, said computer operatively connected to the internet;"
`The Webley System includes a computer, said computer operatively connected to the internet.
`
`For example, the Webley System is an application deployed on a Unix cluster of voice and Web servers which share
`several database servers.
`
`See, e.g., Ex. 2024.
`
`Further, a review of the source code of the Webley Assistant, as well as information from the web at the time of its
`introduction, demonstrates that it was designed to be run on a computer operatively connected to the Internet.
`
`9
`
`Parus Exhibit 2027, Page 9 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.a] a computer, said computer operatively connected to the internet;"
`
`See, e.g., Ex. 2034.
`
`10
`
`Parus Exhibit 2027, Page 10 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.b] a voice enabled device operatively connected to said computer, said voice enabled device configured to receive speech commands from users;"
`[1.b] a voice enabled device
`The Webley Assistant includes a voice enabled device operatively connected to said computer, said voice enabled device
`operatively connected to said
`configured to receive speech commands from users.
`computer, said voice enabled
`device configured to receive
`speech commands from
`users;
`
`For example, the Webley Assistant was designed to be used by a telephone, which is a voice enabled device configured to
`receive speech commands from users.
`
`See, e.g., Ex. 2031.
`
`11
`
`Parus Exhibit 2027, Page 11 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.b] a voice enabled device operatively connected to said computer, said voice enabled device configured to receive speech commands from users;"
`
`See, e.g., Ex. 2034.
`
`12
`
`Parus Exhibit 2027, Page 12 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.c] at least one speaker-independent speech recognition device, said speaker-independent speech recognition device operatively connected to said
`computer and to said voice enabled device;"
`The Webley System includes at least one speaker-independent speech recognition device, said speaker-independent
`speech recognition device operatively connected to said computer and to said voice enabled device.
`
`[1.c] at least one speaker-
`independent speech
`recognition device, said
`speaker-independent speech
`recognition device
`operatively connected to said
`computer and to said voice
`enabled device;
`
`For example, the Webley Assistant, which is part of the Webley System, did not need to be trained to identify the speaker.
`
`See, e.g., Ex. 2031.
`
`Further, the Webley System licensed Nuance’s Speech Recognition System, which was a speaker-independent recognition
`system.
`
`13
`
`Parus Exhibit 2027, Page 13 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.c] at least one speaker-independent speech recognition device, said speaker-independent speech recognition device operatively connected to said
`computer and to said voice enabled device;"
`
`See, e.g. Ex. 2035.
`
`See, e.g., Ex. 2024.
`
`Further, inspection of the source code shows that the Webley System used Nuance’s Automatic Speech Recognition
`(“ASR”). For example, mc_vr.c, which was last modified 4/3/1999, is the module that includes the Webley ASR code.
`
`14
`
`Parus Exhibit 2027, Page 14 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.c] at least one speaker-independent speech recognition device, said speaker-independent speech recognition device operatively connected to said
`computer and to said voice enabled device;"
`
`Ex. 2036 at lines 1-18.
`
`Ex. 2036 at lines 69-85.
`
`15
`
`Parus Exhibit 2027, Page 15 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.d] at least one speech synthesis device, said speech synthesis device operatively connected to said computer and to said voice enabled device;"
`[1.d] at least one speech
`The Webley Assistant includes at least one speech synthesis device, said speech synthesis device operatively connected to
`synthesis device, said speech
`said computer and to said voice enabled device.
`synthesis device operatively
`connected to said computer
`and to said voice enabled
`device;
`
`For example, the Webley System licensed its speech synthesis, or Text-To-Speech (“TTS”), from a leading speech industry
`vendor called Lernout and Hauspie, or (“L&H”).
`
`See, e.g., Ex. 2037.
`
`The Webley Assistant used Lernout and Hauspie’s RealSpeak natural sounding TTS by at least July 12, 1999. Ex. 2038.
`The RealSpeak TTS allowed the Webley Assistant to provide a natural sounding voice to read emails allowed as well as
`perform other functions. Id.
`
`An inspection of the source code demonstrates that the Webley System used the L&H package for speech synthesis. For
`example, in the source code file mc_vm.c, which was last modified on 12/31/1999, in the include files, one can see that the
`Webley System included “app_lnhtts.h” which was a L&H file that included the internal TTS definitions.
`
`16
`
`Parus Exhibit 2027, Page 16 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.d] at least one speech synthesis device, said speech synthesis device operatively connected to said computer and to said voice enabled device;"
`
`17
`
`Parus Exhibit 2027, Page 17 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.d] at least one speech synthesis device, said speech synthesis device operatively connected to said computer and to said voice enabled device;"
`
`Ex. 2025 at lines 1-50.
`
`Further in the same source code file, in the C-code subroutine “stringToSpeech(),” it accepts a text buffer as a parameter
`and uses a L&H library function to convert that text buffer into an audio file in the proper format, and then plays back the
`file to the user.
`
`18
`
`Parus Exhibit 2027, Page 18 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.d] at least one speech synthesis device, said speech synthesis device operatively connected to said computer and to said voice enabled device;"
`
`Ex. 2025 at lines 12,365-12,410.
`
`The speech synthesis device, the licensed L&H speech synthesis libraries, were operatively connected to said computer
`because they were running on the computer. The speech synthesis device was further operatively connected to said voice
`enabled device because the TTS files were then played back to the user through the Webley Assistant.
`19
`
`Parus Exhibit 2027, Page 19 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.e] at least one instruction set for identifying said information to be retrieved, said instruction set being associated with said computer, said instruction set
`comprising: a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;"
`[1.e] at least one instruction
`The Webley System includes at least one instruction set for identifying said information to be retrieved, said instruction
`set for identifying said
`set being associated with said computer, said instruction set comprising: a plurality of pre-selected web site addresses,
`information to be retrieved,
`each said web site address identifying a web site containing said information to be retrieved.
`said instruction set being
`associated with said
`computer, said instruction set
`comprising: a plurality of
`pre-selected web site
`addresses, each said web site
`address identifying a web
`site containing said
`information to be retrieved;
`
`For example, the Webley System includes source code comprised of C and PERL functionality that includes a content
`descriptor containing a plurality of pre-selected web site addresses, each said web site address identifying a web site
`containing said weather information to be retrieved.
`
`The mc_vm.c source code file includes a “getWeather()” function that further calls a “webget.pl” PERL module using
`weather as an argument:
`
`Ex. 2025 at lines 13,607-13,641.
`
`20
`
`Parus Exhibit 2027, Page 20 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.e] at least one instruction set for identifying said information to be retrieved, said instruction set being associated with said computer, said instruction set
`comprising: a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;"
`The webget.pl PERL module, which was last modified on 12/13/1999, determines that the service is “weather” because it
`was an argument and reads in a weather.ini content descriptor:
`
`Ex. 2032 at lines 1-10 and 24-31.
`
`The weather.ini file includes a plurality of pre-selected web site addresses, each web site address identifying a web site
`address identifying a web site containing weather information to be retrieved. For example, the weather.ini file included
`URLs, or web site addresses, for cnn.com, lycos.com, weather.com, snap.com, and infospace.com:
`
`21
`
`Parus Exhibit 2027, Page 21 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.e] at least one instruction set for identifying said information to be retrieved, said instruction set being associated with said computer, said instruction set
`comprising: a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;"
`
`Ex. 2033 at lines 1-4, 63-68, 121-124, 183-186, and 241-245.
`
`The getWeather() function, the webget.pl PERL module, and the weather.ini content descriptor are an instruction set for
`identifying weather information to be retrieved, said instruction set being associated with said computer because it runs on
`the computer, and the instruction set comprises a plurality of pre-selected web site addresses, which are in the weather.ini
`content descriptor, and each web site address identifies a web site containing weather information to be retrieved.
`
`22
`
`Parus Exhibit 2027, Page 22 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.f] at least one recognition grammar associated with said computer, each said recognition grammar corresponding to each said instruction set and
`corresponding to a speech command; said speech command comprising an information request selectable by the user;"
`[1.f] at least one recognition
`The Webley Assistant includes at least one recognition grammar associated with said computer, each said recognition
`grammar associated with
`grammar corresponding to each said instruction set and corresponding to a speech command; said speech command
`said computer, each said
`comprising an information request selectable by the user.
`recognition grammar
`corresponding to each said
`instruction set and
`corresponding to a speech
`command; said speech
`command comprising an
`information request
`selectable by the user;
`
`For example, the Webley System licensed Nuance’s Speech Recognition System which includes at least one recognition
`grammar.
`
`See, e.g., Ex. 2024.
`
`Nuance featured Webley’s use of Nuance 6 on its web site.
`
`See, e.g., Ex. 2039.
`
`The Webley Assistant used recognition grammars for recognizing commands. For example, the menuProto.grammar,
`which was last modified on January 8, 2000, was a prototype grammar for the Webley Assistant:
`
`23
`
`Parus Exhibit 2027, Page 23 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.f] at least one recognition grammar associated with said computer, each said recognition grammar corresponding to each said instruction set and
`corresponding to a speech command; said speech command comprising an information request selectable by the user;"
`
`See, e.g., Ex. 2040 at 1-11.
`
`The Webley Assistant used both static and dynamic grammars. Static grammars would be developed in advance
`(normally one per particular interaction dialog) and included into one or more grammar source files such as
`menuNew.grammar. These files would be compiled in advance, and then at run-time loaded into the speech recognition
`engine (Nuance engine in the Webley case) memory during the engine start. Each static grammar contained in a given
`grammar file would be referenced by its assigned name within the Webley Assistant application before the application
`enters the corresponding speech dialog with the user.
`
`The menuProto.grammar includes several sub-grammars that correspond to instruction sets and to speech commands
`including the weather sub-grammar, “MENU90.”
`
`Ex. 2040 at lines 201-215.
`
`24
`
`Parus Exhibit 2027, Page 24 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.f] at least one recognition grammar associated with said computer, each said recognition grammar corresponding to each said instruction set and
`corresponding to a speech command; said speech command comprising an information request selectable by the user;"
`
`When a user utters the “weather” command the Nuance ASR would determine the command is weather and the weather
`instruction set would be called. For example, in the login_vmail() function, the command is determined and then a long
`switch statement is iterated through looking for the matching command:
`
`Ex. 2025 at lines 1816-1817.
`
`Ex. 2025 at lines 2226-2227.
`
`At line 2766, the weather command is matched to case “MD_WEATHER.” Although the getWeather() function is
`commented out in this code, it demonstrates that it was working as of the date of the mc_vm.c file which was last
`modified 12/31/1999.
`
`Ex. 2025 at lines 2766-2775.
`
`In the mcall.h file we see that “MD_WEATHER” is command option 194, which is what the MENU90 sub-grammar
`returned.
`
`25
`
`Parus Exhibit 2027, Page 25 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.f] at least one recognition grammar associated with said computer, each said recognition grammar corresponding to each said instruction set and
`corresponding to a speech command; said speech command comprising an information request selectable by the user;"
`
`Ex. 2041 at 505-517.
`
`Once the weather command is matched, the weather instruction set is called with the getWeather() call. Although the
`getWeather() function is commented out in this code, it demonstrates that it was working as of the date of the mc_vm.c
`file which was last modified 12/31/1999.
`
`26
`
`Parus Exhibit 2027, Page 26 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.g] said speaker-independent speech recognition device configured to receive from users via said voice enabled device said speech command and to
`select the corresponding recognition grammar upon receiving said speech command;"
`The Webley System includes said speaker-independent speech recognition device configured to receive from users via
`said voice enabled device said speech command and to select the corresponding static or dynamic recognition grammar
`upon receiving said speech command.
`
`[1.g] said speaker-
`independent speech
`recognition device
`configured to receive from
`users via said voice enabled
`device said speech command
`and to select the
`corresponding recognition
`grammar upon receiving said
`speech command;
`
`For example, as previously discussed, in the Webley System, the speaker-independent speech recognition device, the
`licensed Nuance ASR, receives speech commands from the user via the Webley Assistant, and the corresponding static or
`dynamic recognition grammar is selected. The following is the example of the Webley System using a dynamic grammar:
`
`The menuProto.grammar is a static grammar that includes the weather sub-grammar called “MENU90.” When a user
`utters the “weather” command the Nuance ASR would select the weather sub-grammar, MENU90, from the menuProto
`grammar.
`
`Ex. 2040 at lines 201-215.
`
`Once the requisite weather parameters are filled in, the MENU90 sub-grammar returns command option 194. In the
`login_vmail() function, the command is determined and then a long switch statement is iterated through looking for the
`matching command:
`
`Ex. 2025 at lines 2226-2227.
`
`27
`
`Parus Exhibit 2027, Page 27 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.g] said speaker-independent speech recognition device configured to receive from users via said voice enabled device said speech command and to
`select the corresponding recognition grammar upon receiving said speech command;"
`At line 2766, the weather command is matched to case “MD_WEATHER.” Although the getWeather() function is
`commented out in this code, it demonstrates that it was working as of the date of the mc_vm.c file which was last
`modified 12/31/1999.
`
`Ex. 2025 at lines 2766-2775.
`
`Once the weather command is matched, the weather instructions set is called with the getWeather() call.
`
`28
`
`Parus Exhibit 2027, Page 28 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.h] said computer configured to retrieve said instruction set corresponding to said recognition grammar selected by said speaker-independent speech
`recognition device;"
`The Webley System includes said computer configured to retrieve said instruction set corresponding to said recognition
`grammar selected by said speaker-independent speech recognition device.
`
`[1.h] said computer
`configured to retrieve said
`instruction set corresponding
`to said recognition grammar
`selected by said speaker-
`independent speech
`recognition device;
`
`For example, in the Webley System, the weather grammar is static, and when a user utters the “weather” command the
`Nuance ASR would determine the command is weather and the weather instruction set would be called. In the
`login_vmail() function, the command is determined and then a long switch statement is iterated through looking for the
`matching command:
`
`Ex. 2025 at lines 1816-1818.
`
`Ex. 2025 at lines 2226-2227.
`
`At line 2766, the weather command is matched to case “MD_WEATHER.” Although the getWeather() function is
`commented out in this code, it demonstrates that it was working as of the date of the mc_vm.c file which was last
`modified 12/31/1999.
`
`Ex. 2025 at lines 2766-2775.
`
`Once the weather command is matched, the weather instructions set is called with the getWeather() call.
`
`29
`
`Parus Exhibit 2027, Page 29 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.i] said computer further configured to access at least one of said plurality of web sites identified by said instruction set to obtain said information to be
`retrieved,"
`The Webley System includes said computer further configured to access at least one of said plurality of web sites
`identified by said instruction set to obtain said information to be retrieved.
`
`[1.i] said computer further
`configured to access at least
`one of said plurality of web
`sites identified by said
`instruction set to obtain said
`information to be retrieved,
`
`For example, as described above the getWeather() function calls the webget.pl PERL module with “weather” as an
`argument.
`
`Ex. 2025 at lines 13607-13641.
`
`The webget.pl PERL script determines that the service is “weather” because it was an argument and reads in a weather.ini
`content descriptor:
`
`30
`
`Parus Exhibit 2027, Page 30 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.i] said computer further configured to access at least one of said plurality of web sites identified by said instruction set to obtain said information to be
`retrieved,"
`
`Ex. 2032 at lines 1-10 and 24-31.
`
`After loading the content descriptor that includes the plurality of web sites identified by said instruction set to obtain the
`weather information to be retrieved, the webget.pl PERL script calls the process_section subroutine, which accesses at
`least one of said plurality of web sites:
`
`31
`
`Parus Exhibit 2027, Page 31 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.i] said computer further configured to access at least one of said plurality of web sites identified by said instruction set to obtain said information to be
`retrieved,"
`
`Ex. 2032 at lines 96-132.
`
`32
`
`Parus Exhibit 2027, Page 32 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.j] said computer configured to first access said first web site of said plurality of web sites and, if said information to be retrieved is not found at said first
`web site, said computer configured to sequentially access said plurality of web sites until said information to be retrieved is found or until said plurality of
`web sites has been accessed;"
`The Webley System includes said computer configured to first access said first web site of said plurality of web sites and,
`if said information to be retrieved is not found at said first web site, said computer configured to sequentially access said
`plurality of web sites until said information to be retrieved is found or until said plurality of web sites has been accessed.
`
`[1.j] said computer
`configured to first access
`said first web site of said
`plurality of web sites and, if
`said information to be
`retrieved is not found at said
`first web site, said computer
`configured to sequentially
`access said plurality of web
`sites until said information to
`be retrieved is found or until
`said plurality of web sites
`has been accessed;
`
`For example, as discussed in the last claim limitation, the process_section subroutine of the webget.pl PERL script
`accesses the first web site. In the webget.pl PERL script, the process_section subroutine is in a do-while loop:
`
`Ex. 2032 at lines 24-31.
`
`After the URL is accessed, the result is filtered by a regular expression, and if the information is not found the subroutine
`is exited with a non-zero value for $section, and the do-while continues on to the next iteration:
`
`Ex. 2032 at lines 130-145.
`
`At the next iteration of the do-while loop the process_section subroutine is called again, and the subroutine moves to the
`next URL and accesses it for the said weather information to be retrieved:
`
`33
`
`Parus Exhibit 2027, Page 33 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.j] said computer configured to first access said first web site of said plurality of web sites and, if said information to be retrieved is not found at said first
`web site, said computer configured to sequentially access said plurality of web sites until said information to be retrieved is found or until said plurality of
`web sites has been accessed;"
`
`Ex. 2032 at lines 96-122.
`
`Ex. 2032 at lines 130-145.
`
`The do-while loop is executed until the said weather information has been found or if there are no more URLs to access
`from the weather.ini file.
`
`34
`
`Parus Exhibit 2027, Page 34 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.k] said speech synthesis device configured to produce an audio message containing any retrieved information from said pre-selected web sites, and said
`speech synthesis device further configured to transmit said audio message to said users via said voice enabled device."
`[1.k] said speech synthesis
`The Webley System includes said speech synthesis device configured to produce an audio message containing any
`device configured to produce
`retrieved information from said pre-selected web sites, and said speech synthesis device further configured to transmit
`an audio message containing
`said audio message to said users via said voice enabled device.
`any retrieved information
`from said pre-selected web
`sites, and said speech
`synthesis device further
`configured to transmit said
`audio message to said users
`via said voice enabled
`device.
`
`For example, as discussed above, after the getWeather() function obtains the weather, it calls the stringToSpeech() function
`that accepts the weather information as a text buffer as a parameter and uses a L&H library function to convert that text
`buffer into an audio file in the proper format, and then plays back the file to the user.
`
`Ex. 2025 at lines 13607-13641.
`
`35
`
`Parus Exhibit 2027, Page 35 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 1
`"[1.k] said speech synthesis device configured to produce an audio message containing any retrieved information from said pre-selected web sites, and said
`speech synthesis device further configured to transmit said audio message to said users via said voice enabled device."
`
`Ex. 2025 at lines 12,365-12,410.
`
`36
`
`Parus Exhibit 2027, Page 36 of 51
`
`
`
`2. The system of claim 1
`wherein said internet is the
`Internet.
`
`U.S. Patent No. 7,076,431: Claim 2
`"2. The system of claim 1 wherein said internet is the Internet."
`The Webley System includes the system of claim 1 wherein said internet is the Internet.
`
`For example, the Webley System is an application deployed on a Unix cluster of voice and Web servers which share
`several database servers.
`
`See, e.g., Ex. 2024.
`
`Further, a review of the source code of the Webley Assistant, as well as information from the web at the time of its
`introduction, demonstrates that it was designed to be run on a computer operatively connected to the Internet.
`
`37
`
`Parus Exhibit 2027, Page 37 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 2
`"2. The system of claim 1 wherein said internet is the Internet."
`
`See, e.g., Ex. 2034.
`
`38
`
`Parus Exhibit 2027, Page 38 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 4
`"4. The system of claim 1 wherein said voice enabled device is a standard telephone, an IP telephone, a cellular phone, a PDA, a personal computer, a DVD
`player, a television or other video display device, a CD player, a MP3 player, or any other device capable of transmitting said audio message."
`4. The system of claim 1
`The Webley System includes the system of claim 1 wherein said voice enabled device is a standard telephone, an IP
`wherein said voice enabled
`telephone, a cellular phone, a PDA, a personal computer, a DVD player, a television or other video display device, a CD
`device is a standard
`player, a MP3 player, or any other device capable of transmitting said audio message.
`telephone, an IP telephone, a
`cellular phone, a PDA, a
`personal computer, a DVD
`player, a television or other
`video display device, a CD
`player, a MP3 player, or any
`other device capable of
`transmitting said audio
`message.
`
`For example, the Webley system worked over any type of phone or computer.
`
`See, e.g., Ex. 2034.
`
`39
`
`Parus Exhibit 2027, Page 39 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 5
`"5. The system of claim 1 wherein said speaker-independent speech recognition device is configured to analyze phonemes to recognize said speech
`commands."
`The Webley System includes the system of claim 1 wherein said speaker-independent speech recognition device is
`configured to analyze phonemes to recognize said speech commands.
`
`5. The system of claim 1
`wherein said speaker-
`independent speech
`recognition device is
`configured to analyze
`phonemes to recognize said
`speech commands.
`
`For example, as previously discussed, the Webley System used Nuance’s ASR for the speaker-independent speech
`recognition device.
`
`Ex. 2035.
`
`Further, Nuance’s ASR speech recognition was continuous and utilized Hidden Markov Models.
`
`40
`
`Parus Exhibit 2027, Page 40 of 51
`
`
`
`U.S. Patent No. 7,076,431: Claim 5
`"5. The system of claim 1 wherein said speaker-independent speech recognition device is configured to analyze phonemes to r