I 1111111111111111 11111 1111111111 111111111111111 IIIII IIIII IIIIII IIII IIII IIII
`US009769314B2
`
`c12) United States Patent
`Kurganov
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 9,769,314 B2
`*Sep.19,2017
`
`(54) PERSONAL VOICE-BASED INFORMATION
`RETRIEVAL SYSTEM
`
`(71) Applicant: Parus Holdings, Inc., Bannockburn, IL
`(US)
`
`(72)
`
`Inventor: Alexander Kurganov, Buffalo Grove,
`IL (US)
`
`(73) Assignee: Parus Holdings, Inc., Bannockburn, IL
`(US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`CA
`EP
`
`(58) Field of Classification Search
`CPC ... G06F 3/167; G06F 17/30861; Gl0L 17/24;
`Gl0L 15/06; Gl0L 15/26; Gl0L 15/08;
`(Continued)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`D174,465 S
`3,728,486 A
`
`4/1955 Paxton
`4/ 1973 Kraus
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`5/1994
`1329852
`9/1996
`0572544 Bl
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 15/193,517
`
`(22) Filed:
`
`Jun. 27, 2016
`
`(65)
`
`Prior Publication Data
`
`US 2016/0307583 Al
`
`Oct. 20, 2016
`
`Related U.S. Application Data
`
`(63) Continuation of application No. 12/787,801, filed on
`May 26, 2010, now Pat. No. 9,377,992, which is a
`(Continued)
`
`(51)
`
`Int. Cl.
`H04M 3/493
`G06F 3/16
`
`(2006.01)
`(2006.01)
`(Continued)
`
`(52) U.S. Cl.
`CPC .......... H04M 3/4938 (2013.01); G06F 3/167
`(2013.01); G06F 17/30769 (2013.01);
`(Continued)
`
`106 -z.
`
`"McGraw-Hill Dictionary of Scientific & Technical Terms 1101, 6th
`ed. 2003."
`
`(Continued)
`
`Primary Examiner - Lisa Hashem
`(74) Attorney, Agent, or Firm - Patent Law Works, LLP
`
`ABSTRACT
`(57)
`The present invention relates to a system for retrieving
`information from a network such as the Internet. A user
`creates a user-defined record in a database that identifies an
`information source, such as a web site, containing informa(cid:173)
`tion of interest to the user. This record identifies the location
`of the information source and also contains a recognition
`grammar based upon a speech command assigned by the
`user. Upon receiving the speech command from the user that
`is described within the recognition grammar, a network
`interface system accesses the information source and
`retrieves the information requested by the user.
`
`26 Claims, 5 Drawing Sheets
`
`PSTN
`
`306
`
`~ 306
`
`Petitioner Google Ex-1001, 0001
`
`

`

`US 9,769,314 B2
`Page 2
`
`Related U.S. Application Data
`
`continuation of application No. 11/771,773, filed on
`Jun. 29, 2007, now abandoned, which is a continu-
`ation of application No. 09/777,406, filed on Feb. 6,
`2001, now Pat. No. 7,516,190.
`
`(60) Provisional application No. 60/180,343, filed on Feb.
`4, 2000.
`
`4,776,016 A
`4,782,517 A
`4,792,968 A
`4,799,144 A
`4,809,321 A
`4,811,381 A
`4,837,798 A
`4,847,891 A
`4,850,012 A
`4,852,149 A
`4,852,170 A
`4,866,758 A
`4,873,719 A
`4,879,743 A
`4,893,333 A
`4,893,335 A
`4,903,289 A
`4,903,291 A
`4,905,273 A
`4,907,079 A
`4,918,722 A
`4,922,518 A
`4,922,520 A
`4,922,526 A
`4,926,462 A
`4,930,150 A
`4,933,966 A
`4,935,955 A
`4,935,958 A
`4,941,170 A
`4,942,598 A
`4,953,204 A
`4,955,047 A
`4,956,835 A
`4,959,854 A
`4,967,288 A
`4,969,184 A
`4,972,462 A
`4,974,254 A
`4,975,941 A
`4,985,913 A
`4,994,926 A
`4,996,704 A
`5,003,575 A
`5,003,577 A
`5,008,926 A
`5,020,095 A
`5,027,384 A
`5,029,196 A
`5,036,533 A
`5,054,054 A
`5,065,254 A
`5,086,385 A
`5,095,445 A
`5,099,509 A
`5,109,405 A
`5,128,984 A
`5,131,024 A
`5,133,004 A
`5,145,452 A
`5,146,452 A
`5,166,974 A
`5,179,585 A
`5,193,110 A
`5,195,086 A
`5,233,600 A
`5,243,643 A
`5,243,645 A
`5,249,219 A
`5,255,305 A
`5,263,084 A
`5,276,729 A
`5,287,199 A
`5,291,302 A
`5,291,479 A
`5,303,298 A
`5,307,399 A
`5,309,504 A
`5,325,421 A
`
`10/1988 Hansen
`11/1988 Bernardis et al.
`12/1988 Katz
`1/1989 Parruck et al.
`2/1989 Morganstein et al.
`3/1989 Woo et al.
`6/1989 Cohen et al.
`7/1989 Kotani
`7/1989 Mehta et al.
`7/1989 Zwick et al.
`7/1989 Bordeaux
`9/1989 Heinzelmann
`10/1989 Reese
`11/1989 Burke et al.
`1/1990 Baran et al.
`1/1990 Fuller et al.
`2/1990 Hashimoto
`2/1990 Tsurufuji et al.
`2/1990 Gordon et al.
`3/1990 Turner et al.
`4/1990 Duehren et al.
`5/1990 Gordon et al.
`5/1990 Bernard et al.
`5/1990 Morganstein et al.
`5/1990 Ladd et al.
`5/1990 Katz
`6/1990 Hird et al.
`6/1990 Neudorfer
`6/1990 Morganstein et al.
`7/1990 Herbst
`7/1990 Davis
`8/1990 Cuschleg, Jr. et al.
`9/1990 Morganstein et al.
`9/1990 Grover
`9/1990 Cave et al.
`10/1990 Mizutori et al.
`11/1990 Gordon et al.
`11/1990 Shibata
`11/1990 Perine et al.
`12/1990 Morganstein et al.
`1/1991 Shalom et al.
`2/1991 Gordon et al.
`2/1991 Brunson
`3/1991 Chamberlin et al.
`3/1991 Ertz et al.
`4/1991 Misholi
`5/1991 Morganstein et al.
`6/1991 Morganstein
`7/1991 Morganstein
`7/1991 Carter et al.
`10/1991 Pessia et al.
`11/1991 Hishida
`2/1992 Launey et al.
`3/1992 Sekiguchi
`3/1992 Morganstein et al.
`4/1992 Morganstein
`7/1992 Katz
`7/1992 Pugh et al.
`7/1992 Heileman, Jr. et al.
`9/1992 Chevalier
`9/1992 Pekarske
`11/1992 Morganstein et al.
`1/1993 MacMillan, Jr. et al.
`3/1993 Jones et al.
`3/1993 Baumgartner et al.
`8/1993 Pekarske
`9/1993 Sattar et al.
`9/1993 Bissell et al.
`9/1993 Morganstein et al.
`10/1993 Sattar
`11/1993 Chaput et al.
`1/1994 Higuchi et al.
`2/1994 Zoccolillo
`3/1994 Gordon et al.
`3/1994 Vaziri et al.
`4/1994 Morganstein et al.
`4/1994 Dai et al.
`5/1994 Morganstein
`6/1994 Hou et al.
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2013.01)
`(2013.01)
`(2006.01)
`(2006.01)
`(2013.01)
`(2013.01)
`(2006.01)
`
`(51)
`
`(58)
`
`Int. Cl.
`Gl0L 15126
`G06F 17130
`Gl0L 15108
`Gl0L 25154
`Gl0L 13/08
`Gl0L 15102
`Gl0L 15122
`Gl0L 17/24
`Gl0L 15/06
`H04L 29/08
`(52) U.S. Cl.
`G06F 17/30861 (2013.01); Gl0L 13/08
`CPC ........
`(2013.01); Gl0L 15102 (2013.01); Gl0L 15108
`(2013.01); Gl0L 15122 (2013.01); Gl0L 15126
`(2013.01); Gl0L 25154 (2013.01); H04L 67102
`(2013.01); Gl0L 15/06 (2013.01); Gl0L 17/24
`(2013.01); GJOL 2015/223 (2013.01); H04L
`29/0809 (2013.01); H04M 2201/39 (2013.01);
`H04M 2201/40 (2013.01); H04M 2201/405
`(2013.01); H04M 2207/40 (2013.01)
`Field of Classification Search
`CPC .............. Gl0L 25/54; H04M 2207/40; H04M
`2201/405; H04M 3/4938; H04L 29/0809;
`H04L 67/02
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,058,838 A
`4,100,377 A
`4,158,750 A
`4,313,035 A
`4,327,251 A
`4,340,783 A
`4,340,797 A
`4,340,800 A
`4,371,752 A
`4,481,574 A
`4,489,438 A
`4,500,751 A
`4,513,390 A
`4,523,055 A
`4,549,047 A
`4,584,434 A
`4,585,906 A
`4,596,900 A
`4,602,129 A
`4,635,253 A
`4,652,700 A
`4,696,028 A
`4,713,837 A
`4,747,127 A
`4,748,656 A
`4,755,932 A
`4,757,525 A
`4,761,807 A
`4,763,317 A
`4,769,719 A
`4,771,425 A
`
`11/1977 Crager et al.
`7/1978 Flanagan
`6/1979 Sakoe et al.
`1/1982 Jordan et al.
`4/1982 Fomenko et al.
`7/1982 Sugiyama et al.
`7/1982 Takano et al.
`7/1982 Ueda et al.
`2/1983 Matthews et al.
`11/1984 Defino et al.
`12/1984 Hughes
`2/1985 Darland et al.
`4/1985 Walter et al.
`6/1985 Hohl et al.
`10/1985 Brian et al.
`4/1986 Hashimoto
`4/1986 Matthews et al.
`6/1986 Jackson
`7/1986 Matthews et al.
`1/1987 Urui et al.
`3/1987 Matthews et al.
`9/1987 Morganstein et al.
`12/1987 Gordon
`5/1988 Hansen et al.
`5/1988 Gibbs et al.
`7/1988 Diedrich
`7/1988 Matthews et al.
`8/1988 Matthews et al.
`8/1988 Lehman et al.
`9/1988 Endo
`9/1988 Baran et al.
`
`Petitioner Google Ex-1001, 0002
`
`

`

`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,327,486 A
`5,327,529 A
`5,329,578 A
`5,333,266 A
`5,347,574 A
`5,355,403 A
`5,359,598 A
`5,365,524 A
`5,365,574 A
`5,375,161 A
`5,384,771 A
`5,404,231 A
`5,408,526 A
`5,414,754 A
`5,416,834 A
`5,426,421 A
`5,432,845 A
`5,436,963 A
`5,459,584 A
`5,463,684 A
`5,475,791 A
`5,479,487 A
`5,495,484 A
`5,497,373 A
`5,499,288 A
`5,515,427 A
`5,517,558 A
`5,526,353 A
`5,533,115 A
`5,537,461 A
`5,555,100 A
`5,559,611 A
`5,559,859 A
`5,566,236 A
`5,603,031 A
`5,608,786 A
`5,610,910 A
`5,610,970 A
`5,611,031 A
`5,630,079 A
`5,652,789 A
`5,657,376 A
`5,659,597 A
`5,666,401 A
`5,675,507 A
`5,675,811 A
`5,689,669 A
`5,692,187 A
`5,699,486 A
`5,712,903 A
`5,719,921 A
`5,721,908 A
`5,724,408 A
`5,737,395 A
`5,742,596 A
`5,742,905 A
`5,752,191 A
`5,758,322 A
`5,761,294 A
`5,764,639 A
`5,764,736 A
`5,764,910 A
`5,774,860 A
`5,787,298 A
`5,793,993 A
`5,794,205 A
`5,796,791 A
`5,799,063 A
`5,799,065 A
`5,809,282 A
`5,809,481 A
`5,812,796 A
`5,819,220 A
`5,819,306 A
`5,822,727 A
`
`7/1994 Wolff et al.
`7/1994 Fults et al.
`7/1994 Brennan et al.
`7/1994 Boaz et al.
`9/1994 Morganstein
`10/1994 Richardson, Jr. et al.
`10/1994 Steagall et al.
`11/1994 Hiller et al.
`11/1994 Hunt et al.
`12/1994 Fuller et al.
`1/1995 Isidoro et al.
`4/1995 Bloomfield
`4/1995 McFarland et al.
`5/1995 Pugh et al.
`5/1995 Bales et al.
`6/1995 Gray
`7/1995 Burd et al.
`7/1995 Fitzpatrick et al.
`10/1995 Gordon et al.
`10/1995 Morduch et al.
`12/1995 Shalk et al.
`12/1995 Hammond
`2/1996 Self et al.
`3/1996 Hulen et al.
`3/1996 Hunt et al.
`5/1996 Carlsen et al.
`5/1996 Schalk
`6/1996 Henley et al.
`7/1996 Hollenbach et al.
`7/1996 Bridges et al.
`9/1996 Bloomfield et al.
`9/1996 Bloomfield et al.
`9/1996 Dai et al.
`10/1996 MeLarnpy et al.
`2/1997 White et al.
`3/1997 Gordon
`3/1997 Focsaneanu et al.
`3/1997 Fuller et al.
`3/1997 Hertzfeld et al.
`5/1997 McLaughlin
`7/1997 Miner et al.
`8/1997 Espeut et al.
`8/1997 Bareis et al.
`9/1997 Morganstein et al.
`10/1997 Bobo, II
`10/1997 Broedner et al.
`11/1997 Lynch et al.
`11/1997 Goldman et al.
`12/1997 Tullis et al.
`1/1998 Bartholomew et al.
`2/1998 Vysotsky et al.
`2/1998 Lagarde et al.
`3/1998 Morganstein
`4/1998 Irribarren
`4/1998 Baratz et al.
`4/1998 Pepe et al.
`5/1998 Fuller et al.
`5/1998 Rongley
`6/1998 Shaffer et al.
`6/1998 Staples et al.
`6/1998 Shachar et al.
`6/1998 Shachar
`6/1998 Bayya et al.
`7/1998 Broedner et al.
`8/1998 Broedner et al.
`8/1998 Walters et al.
`8/1998 Polcyn
`8/1998 Krane
`8/1998 Junqua et al.
`9/1998 Cooper et al.
`9/1998 Baron et al.
`9/1998 Broedner et al.
`10/1998 Sarukkai et al.
`10/1998 Goldman et al.
`10/1998 Garberg et al.
`
`US 9,769,314 B2
`Page 3
`
`10/1998 Goldberg et al.
`5,823,879 A
`11/1998 Vysotsky et al.
`5,832,063 A
`5,832,440 A
`11/1998 Woodbridge
`5,835,570 A
`11/1998 Wattenbarger
`5,838,682 A
`11/1998 Dekelbaum et al.
`5,867,494 A
`2/1999 Krishnaswarny et al.
`5,867,495 A
`2/1999 Elliott et al.
`5,870,550 A
`2/1999 Wesinger, Jr. et al.
`5,873,080 A
`2/1999 Coden et al.
`3/1999 Foster et al.
`5,881,134 A
`3/1999 Watts et al.
`5,881,135 A
`5,884,032 A
`3/1999 Bateman et al.
`5,884,262 A
`3/1999 Wise et al.
`5,884,266 A
`3/1999 Dvorak
`5,890,123 A
`3/1999 Brown et al.
`5,905,476 A
`5/1999 McLaughlin et al.
`6/1999 Bentley et al.
`5,914,951 A
`6/1999 Uppaluru
`5,915,001 A
`6/1999 Dunn et al.
`5,917,817 A
`5,926,789 A
`7/1999 Barbara et al.
`5,940,598 A
`8/1999 Strauss et al.
`5,943,399 A
`8/1999 Bannister et al.
`5,946,389 A
`8/1999 Dold
`5,953,392 A * 9/1999 Rhie
`
`H04M 1/2478
`379/88.13
`
`5,974,124 A
`5,974,413 A
`5,991,292 A
`5,995,615 A
`5,999,525 A
`5,999,611 A
`5,999,965 A
`6,012,088 A
`6,014,437 A
`6,014,626 A
`6,018,710 A
`6,021,181 A
`6,021,190 A
`6,031,904 A
`6,038,305 A
`6,044,107 A
`6,047,053 A
`6,052,372 A
`6,067,516 A
`6,078,580 A
`6,081,518 A
`6,081,782 A
`6,091,808 A
`6,101,472 A
`6,104,803 A
`6,115,737 A
`6,115,742 A
`6,130,933 A
`6,131,095 A
`6,137,863 A
`6,144,991 A
`6,157,705 A
`6,161,128 A
`6,178,399 Bl
`6,185,535 Bl
`6,188,683 Bl
`6,195,357 Bl
`6,199,076 Bl
`6,201,814 Bl
`6,201,863 Bl
`6,208,638 Bl
`6,215,858 Bl
`6,230,132 Bl
`6,233,318 Bl
`6,243,373 Bl
`6,252,944 Bl
`6,269,336 Bl
`6,285,745 Bl
`6,327,572 Bl
`6,330,538 Bl
`6,343,529 Bl
`6,349,132 Bl
`6,353,661 Bl
`6,366,575 Bl
`
`10/1999 Schlueter et al.
`10/1999 Beauregard et al.
`11/1999 Focsaneau et al.
`11/1999 Miloslavsky
`12/1999 Krishnaswarny et al.
`12/1999 Tatchell et al.
`12/1999 Kelly
`1/2000 Li et al.
`1/2000 Acker et al.
`1/2000 Cohen
`1/2000 Wynblatt et al.
`2/2000 Miner et al.
`2/2000 Fuller et al.
`2/2000 An et al.
`3/2000 McAllister et al.
`3/2000 Gatherer et al.
`4/2000 Miner et al.
`4/2000 Gittins et al.
`5/2000 Levay et al.
`6/2000 Mandalia et al.
`6/2000 Bowman-Amuah
`6/2000 Rabin
`7/2000 Wood et al.
`8/2000 Giangarra et al.
`8/2000 Weser et al.
`9/2000 Ely et al.
`9/2000 Franklin et al.
`10/2000 Milsoslavsky
`10/2000 Low et al.
`10/2000 Brown et al.
`11/2000 England
`12/2000 Perrone
`12/2000 Smyk
`1/2001 Takebayashi et al.
`2/2001 Hedin et al.
`2/2001 Lang et al.
`2/2001 Polcyn
`3/2001 Logan et al.
`3/2001 Greenspan
`3/2001 Miloslavsky
`3/2001 Rieley et al.
`4/2001 Bartholomew et al.
`5/2001 Class et al.
`5/2001 Picard et al.
`6/2001 Turock
`6/2001 Hansen, II et al.
`7/2001 Ladd et al.
`9/2001 Bartholomew et al.
`12/2001 Morton et al.
`12/2001 Breen
`2/2002 Pool
`2/2002 Wesemann et al.
`3/2002 Bailey, III
`4/2002 Barkan et al.
`
`Petitioner Google Ex-1001, 0003
`
`

`

`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,366,578 Bl
`6,424,945 Bl
`6,430,282 Bl
`6,434,529 Bl
`6,445,694 Bl
`6,446,076 Bl
`6,456,699 Bl
`6,459,910 Bl
`6,477,240 Bl
`6,477,420 Bl
`6,490,627 Bl
`6,501,966 Bl
`6,505,163 Bl
`6,529,948 Bl
`6,532,444 Bl
`6,539,359 Bl
`6,546,393 Bl
`6,560,604 Bl
`6,584,439 Bl
`6,587,822 B2
`6,593,944 Bl
`6,594,348 Bl
`6,594,692 Bl
`6,606,611 Bl
`6,618,039 Bl
`6,618,726 Bl
`6,618,763 Bl
`6,636,831 Bl
`6,654,814 Bl
`6,658,662 Bl
`6,665,640 Bl
`6,687,341 Bl
`6,704,024 B2
`6,718,015 Bl
`6,721,705 B2
`6,724,868 B2
`6,732,142 Bl
`6,763,388 Bl
`6,771,732 B2
`6,771,743 Bl
`6,775,264 Bl
`6,785,266 B2
`6,807,257 Bl
`6,812,939 Bl
`6,823,370 Bl
`6,888,929 Bl
`6,922,733 Bl
`6,941,273 Bl
`6,964,012 Bl
`6,964,023 B2
`6,965,864 Bl
`6,996,609 B2
`6,999,804 B2
`7,003,463 Bl
`7,024,464 Bl
`7,050,977 Bl
`7,075,555 Bl
`7,076,431 B2
`7,089,307 B2
`7,145,898 Bl
`7,146,323 B2
`7,327,723 B2
`7,386,455 B2
`7,506,022 B2
`7,516,190 B2
`7,881,941 B2
`7,974,875 Bl
`8,098,600 B2
`8,131,267 B2
`8,131,555 Bl
`8,185,402 B2
`8,380,505 B2
`8,775,176 B2
`8,838,074 B2
`8,843,120 B2
`
`4/2002 Johnson
`7/2002 Sorsa
`8/2002 Bannister et al.
`8/2002 Walker et al.
`9/2002 Swartz
`9/2002 Burkey et al.
`9/2002 Burg
`10/2002 Houston
`11/2002 Lim et al.
`11/2002 Struble et al.
`12/2002 Kalra et al.
`12/2002 Bareis et al.
`1/2003 Zhang et al.
`3/2003 Bowman-Amuah
`3/2003 Weber
`3/2003 Ladd et al.
`4/2003 Khan
`5/2003 Fascenda
`6/2003 Geilhufe et al.
`7/2003 Brown et al.
`7/2003 Nicolas et al.
`7/2003 Bjurstrom et al.
`7/2003 Reisman
`8/2003 Khan
`9/2003 Grant et al.
`9/2003 Colbath et al.
`9/2003 Steinberg
`10/2003 Profit, Jr. et al.
`11/2003 Britton et al.
`12/2003 Nielsen
`12/2003 Bennett et al.
`2/2004 Koch et al.
`3/2004 Robotham et al.
`4/2004 Berstis
`4/2004 Kurganov et al.
`4/2004 Pradhan et al.
`5/2004 Bates et al.
`7/2004 Tsimelzon
`8/2004 Xiao et al.
`8/2004 Butler et al.
`8/2004 Kurganov
`8/2004 Swartz
`10/2004 Kurganov
`11/2004 Flores et al.
`11/2004 Kredo et al.
`5/2005 Saylor et al.
`7/2005 Kuiken et al.
`9/2005 Loghmani et al.
`11/2005 Zirngibl et al.
`11/2005 Maes et al.
`11/2005 Thrift et al.
`2/2006 Hickman et al.
`2/2006 Engstrom et al.
`2/2006 Maes et al.
`4/2006 Lusher et al.
`5/2006 Bennett
`7/2006 Flores
`7/2006 Kurganov et al.
`8/2006 Zintel et al.
`12/2006 Elliott
`12/2006 Guenther et al.
`2/2008 Kurganov
`6/2008 Kurganov
`3/2009 Wang et al.
`4/2009 Kurganov
`2/2011 Kurganov et al.
`7/2011 Quilici et al.
`1/2012 Kurganov
`3/2012 Lichorowic et al.
`3/2012 Carriere et al.
`5/2012 Kurganov et al.
`2/2013 Konig et al.
`7/2014 Gilbert et al.
`9/2014 Kurganov
`9/2014 Kurganov
`
`US 9,769,314 B2
`Page 4
`
`8,843,141 B2
`8,874,446 B2
`9,451,084 B2
`2001/0011302 Al
`2001/0032234 Al
`2001/0040885 Al
`2001/0048676 Al
`2002/0006126 Al
`2002/0059402 Al
`2002/0064149 Al
`2002/0087327 Al
`2002/0090114 Al
`2002/0104025 Al
`2003/0002635 Al
`2004/0160913 Al
`2004/0247094 Al
`2005/0025133 Al
`2005/0030179 Al
`2005/0074104 Al
`2005/0102147 Al
`2005/0278179 Al
`2006/0069926 Al
`2007/0136072 Al
`2007 /0206737 Al
`2007/0249406 Al
`2007/0263601 Al
`2007 /0286360 Al
`2008/0228494 Al
`2009/0286514 Al
`2010/0042413 Al *
`
`2010/0094635 Al *
`
`2011/0035220 Al*
`
`2011/0054898 Al
`2011/0082696 Al *
`
`2011/0091023 Al
`2011/0153324 Al*
`
`2012/0179464 Al
`2012/0253800 Al
`2013/0006638 Al
`2013/0041666 Al*
`
`2013/0191122 Al
`2013/0317823 Al
`2014/0039898 Al
`2014/0046660 Al
`2014/0111415 Al
`2014/0123010 Al
`2015/0134340 Al*
`
`2015/0185985 Al
`2015/0234636 Al
`2015/0334080 Al
`2015/0339745 Al
`2016/0057383 Al*
`
`9/2014 Kurganov
`10/2014 Carriere et al.
`9/2016 Kurganov et al.
`8/2001 Son
`10/2001 Summers et al.
`11/2001 Jonas et al.
`12/2001 Jimenez et al.
`1/2002 Johnson et al.
`5/2002 Belanger
`5/2002 Elliott et al.
`7/2002 Lee et al.
`7/2002 Rhoads et al.
`8/2002 Wrench
`1/2003 Koch et al.
`8/2004 Kubler et al.
`12/2004 Crockett
`2/2005 Swartz
`2/2005 Script et al.
`4/2005 Swartz
`5/2005 Ullrich et al.
`12/2005 Overend
`3/2006 Ginter et al.
`6/2007 Sampath
`9/2007 Hickman
`10/2007 Andreasson
`11/2007 Kurganov
`12/2007 Chu et al.
`9/2008 Cross
`11/2009 Lichorowic
`2/2010 Simpson ................. Gl0L 15/30
`704/270
`Bermudez
`Perez ................ G06F 17 /30861
`704/270.1
`2/2011 Opaluch ............... G lOL 15/265
`704/246
`
`4/2010
`
`3/2011 Phillips et al.
`4/2011 Johnston ........... G06F 17 /30026
`704/243
`
`4/2011 Kurganov et al.
`6/2011 Ballinger ................ Gl0L 15/30
`704/235
`
`7/2012 Newman
`10/2012 Goller
`1/2013 Lindahl
`2/2013 Bak ......................... Gl0L 15/26
`704/246
`
`7/2013 Mason
`11/2013 Mengibar
`2/2014 Reich
`2/2014 Kamdar
`4/2014 Gargi et al.
`5/2014 Goldstein
`5/2015 Blaisch ............... G06F 3/04842
`704/275
`
`7/2015 Kang et al.
`8/2015 Barnes, Jr.
`11/2015 Tamayo
`11/2015 Peter et al.
`2/2016 Patlan
`
`H04M 3/4938
`348/14.03
`G06Q 30/06
`725/59
`5/2016 Vogel . . . . . . . . . . . . . . . . G06F 17 /307 46
`704/9
`6/2016 Clark ...................... G06F 3/167
`704/270.1
`2016/0225369 Al *
`8/2016 Agrawal ............... G06F 3/0484
`2016/0239497 Al *
`8/2016 O'Donnell ........ G06F 17 /30867
`2016/0321266 Al* 11/2016 Philippov . .............. G06F 3/167
`2016/0328206 Al* 11/2016 Nakaoka ................... G06F 3/16
`2017/0116986 Al*
`4/2017 Weng ...................... Gl0L 15/22
`
`2016/0080811 Al*
`
`3/2016 Fukushima
`
`2016/0125881 Al*
`
`2016/0179752 Al*
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`GB
`GB
`
`0794650 A2
`2211698
`2240693 A
`
`9/1997
`7 /1989
`8/1991
`
`Petitioner Google Ex-1001, 0004
`
`

`

`US 9,769,314 B2
`Page 5
`
`(56)
`
`GB
`JP
`WO
`WO
`WO
`WO
`WO
`WO
`
`References Cited
`
`FOREIGN PATENT DOCUMENTS
`
`2317782 A
`1-258526
`91/07838
`91/18466
`9609710
`97/34401
`97/37481
`98/23058
`
`4/1998
`10/1989
`5/1991
`11/1991
`3/1996
`9/1997
`9/1997
`5/1998
`
`OTHER PUBLICATIONS
`
`Newton, Harry, Newtons Telecom Dictionary-The Official Glos(cid:173)
`sary of Telecommunications and Voice Processing Terms, Dec.
`1992, 6 pages.
`Paper No. 10, Denying Institution of Covered Business Method
`Patent Review CBM2015-00109 and CBM2015-00149, Nov. 9,
`2015, 19 pages.
`Paper No. 10, Denying Institution of Covered Business Method
`Patent Review CBM2015-00110 and CBM2015-00150, Nov. 9,
`2015, 20 pages.
`Paper No. 10, Denying Institution of Covered Business Method
`Patent Review CBM2015-00111 and CBM2015-00151, Nov. 9,
`2015, 19 pages.
`Paper No. 10, Denying Institution of Covered Business Method
`Patent Review CBM2015-00112 and CBM2015-00152, Nov. 9,
`2015, 18 pages.
`Putz, Steve, Interactive Information Services Using World-Wide
`Web Hypertext, First Int'! Conference on World-Wide Web (May
`25-27,1994), 10 pages.
`Memorandum Opinion and Order, Oct. 8, 2015, 27 pages.
`Update Subject Matter Eligibility, Jul. 2015, 33 pages.
`Wikipedia Definition of "Internet", available at http://en.wikipedia.
`org/wiki/Internet pp. 24-26.
`Opening Brief of Appellant Paws Holdings, Inc., submitted on Mar.
`8, 2016, to the United States Court of Appeal for the Federal Circuit,
`236 pages.
`Brief of Appellees, submitted on Jun. 20, 2016, to the United States
`Court of Appeals for the Federal Circuit, 53 pages.
`"A PABX that Listens and Talks", Speech Technology, Jan./Feb.
`1984, pp. 74-79.
`Amended Complaint, Parus Holdings. Inc. v. Web Telephony LLC
`& Robert Swartz, Case No. 06-cv-O 1146 (N.D. III.), Jul. 10, 2006,
`14 pages.
`AT&T, Press Release, "AT&T Customers Can Teach Systems to
`Listen and Respond to Voice", Jan. 17, 1995, pp. 1-2, Basking
`Ridge, NJ., available at www.lucent.com/press/O 195/950117.gbb.
`html (accessed Mar. 15, 2005).
`Bellcore Technology Licensing, "The Electronic Receptionist-A
`Knowledge-Based Approach to Personal Communications", 1994,
`pp. 1-8.
`Brachman et al., "Fragmentation in Store-and-Forward Message
`Transfer", IEEE Communications Magazine, vol. 26 (7), Jul. 1998,
`pp. 18-27.
`"Business Phone Systems for Advanced Offices", NTT Review, vol.
`2 (6), Nov. 1990, pp. 52-54.
`Cole et al., "An Architecture for a Mobile OSI Mail Access
`System", IEEE Journal on Selected Areas in Communications, vol.
`7 (2), Feb. 1989, pp. 249-256.
`"Data Communications Networks: Message Handling Systems",
`Fasciele, VIII. ?-Recommendations X.400-X.430, 38 pages, date
`unknown.
`DAX Systems, Inc., Press Release, "Speech Recognition Success in
`DAX's Grasp", Nov. 22, 1995, pp. 1-2, Pine Brook, NJ.
`Defendants Answer to the Amended Complaint and Demand for
`Jury Trial, Parus Holdings, Inc. v. Web Telephone LLC & Robert
`Swartz, Case No. 06-cv-01146 (N.D. III.), Aug. 10, 2006, 14 pages.
`Faxpak Store and Forward Facsimile Transmission Service, Elec(cid:173)
`trical Communication, vol. 54 (3), 1979, pp. 251-55.
`
`Garcia et al., "Issues in Multimedia Computer-Based Message
`Systems Design and Standardization", NATO ASI Series, vol. 1-6,
`1984, 18 pgs.
`"Globecom '85 IEEE Global Telecommunications Conference,"
`New Orleans, LA., Dec. 2-5, 1985, pp. 1295-1300.
`Hemphill et al., "Speech-Aware Multimedia," IEEE MultiMedia,
`Spring 1996, vol. 3, No. 1, pp. 74-78, IEEE. As indicated on the
`cover page of the journal, which is attached hereto as Attachment 4,
`the reference was received by Cornell University on Mar. 25, 1996.
`Hunt et al., "Long-Distance Remote Control to the Rescue", Chi(cid:173)
`cago Tribune, Jun. 15, 2002, Section 4, p. 15.
`"Introducing PIC SuperFax, First PC/Fax System to Run Under
`Windows", Pacific Image Communications, Pasadena, CA, Date
`Unknown, (received at COMDEX show, Nov. 3, 1987). 4 pgs.
`Kubala et al., "BYBLOS Speech Recognition Benchmark Results",
`Workshop on Speech &Natural Language, Feb. 19-22, 1991.Ac(cid:173)
`cording
`to
`the web
`site
`http:/ /portal.acm.org/citation.
`cfm?id-II2405.I 12415&coll ... , the reference was published in
`1991, Morgan Kaufman Publishers, San Franscisco, CA. The dis(cid:173)
`tribution date is not presently known.
`Ly, "Chatter: A Conversational Telephone Agent", submitted to
`Program in Media Arts & Sciences, MIT, 1993, pp. 1-130.
`Maeda, et al., "An Intelligent Customer-Controlled Switching Sys(cid:173)
`tem", IEEE Global Telecommunications Conference, Hollywood,
`Florida, Nov. 28-Dec. 1, 1988, pp. 1499-1503.
`Markowitz, J., "The Ultimate Computer Input Device May Be Right
`Under Your Nose", Byte, Dec. 1995, pp. 1-13, available atwww.
`byte.corn/art/9512/sec8/artl.htm (accessed Mar. 15, 2005).
`Marx et al., "Mail Call: Message Presentation and Navigation in a
`Nonvisual Environment," SIGCHI Conference on Human Factors
`in Computing Systems, Vancouver, B.C., Canada, Apr. 13-18, 1996.
`The web site http://www.usabilityviews.corn/uvOO 1673.html shows
`a date of Apr. 16, 1996. The distribution date is not presently known.
`Marx, M., "Toward Effective Conversational Messaging" (Thesis).
`As indicated on the cover page, the thesis was presented to the
`Departmental Committee on Graduate Students, Program in Media
`Arts and Sciences, School of Architecture and Planning, Massachu(cid:173)
`setts Institute of Technology on May 12, 1995. According to the web
`site
`http://www.thesis.mit.edu/Dienst/Repository/2.O/Body/0018.
`mit.theses/1995-314/rfc1807bib., the thesis was indexed on Mar.
`21, 2000.
`Oye, Phil, "Juggler", p. 1, availableathttp://www.philove.com/
`work/juggler/index.shtml (accessed on Dec. 8, 2006).
`Oye, Phil, "Juggler", p. 1, available athttp://www.philoye.com/
`work/juggler_2.shtml (accessed on Dec. 8, 2006).
`Perdue et al., "Conversant® 1 Voice System: Architecture and
`Applications",Jul. 17, 1986, AT&T Technical Journal, pp. 1-14.
`Plaintiff Parus Holdings, Inc. 's Supplemental Responses to Defen(cid:173)
`dant Web Telephone LLC's First Set of Interrogatories (Nos. 1-12),
`Parus Holdings, Inc. v. Web Telephony LLC Y Robert Swartz, Case
`No. 06-cv-01146 (N.D. III.), Oct. 31, 2006, 32 pages.
`Plaintiff Parus Holdings, Inc. 's Supplemental Responses to Defen(cid:173)
`dant Web Telephony LLC's Second Set of Interrogatories (Nos.
`13-17), Parus Holdings,Inc. v. Web Telephony LLC & Robert
`Swartz, Case No. 06-cv-01146 (N.D. III.), Oct. 31, 2006, 31 pages.
`Print outs of Internet web site, "Wildfire Communications, Inc.,",
`Nov. 5, 1997, including print outs of the following web pages:
`http://www.wildfire.com; http://www.wildfire.com/ consumerhome.
`html;http://www.wildfire.com/ 106 .html; http://www. wildfire.corn/
`carrierhome.html; http://www.wildfire.com/sfandb.html;
`http://
`www.wildfire.com/about.html; http://www.wildfire.com/abtmgmt.
`html; http://www. wildfire.corn/scoop.html; http://www. wildfire.
`corn/intel.html; and http://www.wildfire.com/msft.html.
`"Proceedings of the IFIP 10th World Computer Congress", Dublin,
`Ireland, Sep. 1-5, 1986.
`"PureSpeech Announces Juggler PC System for First Quarter of
`1997", HighBeam Research, Sep. 19, 1996, pp. 1-3, available at
`http://www.highbeam.com/ doc/ 1G1-186909545 .html ( accessed on
`Dec. 8, 2006).
`PureSpeech, "Meet the Voice of Juggler!", pp. 1-3, the date of Nov.
`18, 1996 is shown at the top of p. 1.
`"PureSpeech's Juggler", Teleconnect, Dec. 1996 issue, p. 36.
`
`Petitioner Google Ex-1001, 0005
`
`

`

`US 9,769,314 B2
`Page 6
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Ross, Randy, "Retrieve E-mail from a Telephone", Oct. 7, 1996, pp.
`1-2,
`available
`at
`http:/ /resna.org/ProfessOrg?Sigs?SIGSites/
`sigllarchive/juggler.htm (accessed on Dec. 8, 2006). Printout indi(cid:173)
`cates that the article was originally printed in PC world.
`Sartori, M., "Speech Recognition", Apr. 1995, pp. 1-9, Mercury
`Communications, available at www.gar.co.uk/technology_watch/
`speech.htrn (accessed Mar. 15, 2005).
`Schmandt et al., "A Conversational Telephone Messaging System",
`IEEE Transactions on Consumer Electronics, 1984, vol. CE-30, No.
`3, pp. xxi-xxiv.
`Schmandt et al., "Phone Slave: A Graphical Telecommunications
`Interface", Proceedings of the SID, 1985, vol. 26/1, pp. 79-82.
`"Secretarial Branch Exchange", IBM Technical Disclosure Bulletin,
`vol. 26 (5), Oct. 1983, pp. 2645-2647.
`Shimamura, et al., "Review of the Electrical Communication Labo(cid:173)
`ratories", vol. 418 (33), No. 1, Tokyo, Japan, 1985, pp. 31-39.
`"The VMX Systems Product Reference Manual: Product Descrip(cid:173)
`tion Volume", May 1994, vol. 1, release 7.1, VMX, Inc. (Octel
`Communications Corp.) San Jose, CA USA.
`"VMXworks Product Reference Manual: vol. 3 Programmer's
`Guide", Jul. 1994, vols. 3 & 4, Release 3.1, Octel Communications
`Corp., Milpitas, CA, USA.
`"Wildfire Communication, Inc.", Harvard Business School, Mar.
`21, 1996, Pub!. No. 9-396-305, pp. 1-22.
`"WordPerfect: New Telephony Features Boost Office", WordPerfect
`Office TechBrief, 1994, Info-World Publishing. Co., vol. 10, Issue
`2, pp. 2-3.
`Yang, C., "INET Phone-Telephone Services and Servers on the
`Internet", Apr. 1995, University of North Texas, pp. 1-6.
`
`Bellcore Technology Licensing, "The Electronic Receptionist-A
`Knowledge-Based Approach to Personal Communications," 1994,
`pp. 1-8.
`Examples: Abstract Ideas, 20 pages.
`IBM AIX DirectTalk/6000 Version 1 Release 6 Improves Your
`Voice Processing Services to Callers and Customers, Announce(cid:173)
`ment No. 295-489, Nov. 28, 1995, 27 pages.
`IBM Announcement Letter No. A95-893, retrieved on Mar. 9, 2015,
`10 pages.
`IBM, AIX DirectTalk/6000: General Information and Planning,
`Release 6, GC33-I 720-00, Dec. 1995, 162 pages.
`IBM, DirectTalkMail: Administration, Release 6, SC33-I 733-00,
`Feb. 1996, 274 pages.
`"McGraw-Hill Dictionary of Scientific & Technical Terms 1101, 6th
`ed. 2003," No copy is provided but please inform if a copy of this
`dictionary is required.
`Hemphill et al., "Surfing the Web by Voice," ACM Multimedia
`95-Electronic Proceedings, Nov. 5-9, 1995, 8 pages, San Fran(cid:173)
`cisco, CA.
`IBM, AIX DirectTalk/6000 Release 6: Speech Recognition with the
`BBN Hark Recognizer, SC33-l 734-00, Feb. 1996, 250 pages.
`Joint Appendix, submitted on Sep. 16, 2016, to the United States
`Court of Appeal for the Federal Circuit, 406 pages.
`Juggler by PureSpeech, p. 1, available at http://members.aol.com/
`compqandal/juggler.html (accessed on Dec. 8, 2006).
`Reply Brief of Appellant Parus Holdings, Inc., submitted on Sep. 6,
`2016, to the United States Court of Appeal for the Federal Circuit,
`40 pages.
`Judgment without Opinion for Parus Holdings Inc., v. Sallie Mae
`Bank, Navient Solutions Inc., PNC Bank, N.A., Suntrust Bank,
`Suntrust Mortgage Inc., 2016-1179, 2016-1180, 2016-1181, entered
`Feb. 27, 2017 (2 pages).
`
`* cited by examiner
`
`Petitioner Google Ex-1001, 0006
`
`

`

`U.S. Patent
`U.S. Patent
`
`Sep.19,2017
`Sep. 19, 2017
`
`Sheet 1 of 5
`Sheet 1 of 5
`
`US 9,769,314 B2
`US 9,769,314 B2
`
`GOL-Z-
`
`
`
`OMARIONANEELAEPEREEEECOEOOELEALLETEDEDELDAAREE
`
`Le
`8=
`
`ap
`i=
`
`ceicnaKRA
`
`
`
` copootoreonstiAi4/‘,oFi\ft"é4ipenngot,ipotenciescoreweneteangfoMyj{3ead‘.3;“4ik;f“$te3ftSBde
`HA6yeey4xoe.
`:ticoeLo‘i«t446at
`
`baeeereregeceverssecondenntbesgts¥ponstiiread,4i/onal
`aan[lemmeihRioteeater
`i~o:}“sagtOLdeee2:SeementintanhSeve
`
`ppoveneovoessnsssenensesoracovoncecsontnenenaboiticsvtnyifiéiWSLSASLae]atOMSMOEE2S}
`
`,5%4}
`
`pert.:4LS“ty5i
`
`t$
`
`i5
`
`Petitioner Google Ex-1001, 0007
`
`Petitioner Google Ex-1001, 0007
`
`
`
`

`

`U.S. Patent
`
`Sep. 19,2017
`
`Sheet 2 of 5
`
`US 9,769,314 B2
`
`l
`
`B
`I
`I I
`I ,---------. /THE TEMPERATURE IN CHICAGO --7 I I ,- 200
`i i t.r---·
`1.
`·,!
`'-· 204
`
`206 S' 'l ADVERTISEMENT
`I
`206 s ·1 ADVERTISEMENT
`
`i
`
`208 -.rtf UNK 1
`1 l ! L _ _ _ _ ____,
`
`2081L UNK1J
`
`1
`
`IS 7fJ) F
`jTHE HUMIDITY LEVEL lS 20%
`·
`tAND W!NOS ARE FROM THE
`·
`iNE AT 10MPH.
`I
`l
`
`l
`l
`l
`l
`l I
`, l1
`' ! !
`l l !
`. , l
`t.__ _ _ _ _ _ _ _ _ _ _ _ _ l I
`i
`l
`I
`I
`l
`I
`I l
`! l I
`i ! B
`
`FIG, 2
`
`Petitioner Google Ex-1001, 0008
`
`

`

`106 -z...
`
`l WEB SITE 1
`
`WEBSITE 2
`
`0
`
`0
`
`0
`
`Q
`
`WEBSITE N
`
`e •
`
`00
`•
`~
`~
`~
`
`~ = ~
`
`104
`
`-
`
`-
`
`-
`
`312 ~ ,
`
`FIREWALL
`
`,
`
`I
`
`302
`
`310
`
`WEB BROWSING
`SERVER
`
`WEB BROWSING
`SERVER
`
`TCP/IP
`
`FIREWALL
`
`304
`
`MEDIA
`SERVER
`
`MEDIA
`SERVER
`
`_ _ _ _ _ _ _ _ _ _
`
`-
`
`-
`
`-
`
`,..... -
`I
`I
`I
`I
`1
`I
`I
`I
`I
`I
`I
`300
`-----,-
`
`108
`
`308
`
`rJJ
`('D
`
`'? ....
`0 ....
`
`'"\,Ci
`N
`
`-....J
`
`('D
`('D
`
`~
`
`rJJ =(cid:173)
`.....
`0 ....
`
`Ul
`
`"4 - - - ·'10§1
`
`306
`
`FIG. 3
`
`306
`
`d r.,;_
`
`_."-0
`-....l
`0--,
`
`"-0 w
`"'""' ~ = N
`
`Petitioner Google Ex-1001, 0009
`
`

`

`U.S. Patent
`
`Sep.19,2017
`
`Sheet 4 of 5
`
`US 9,769,314 B2
`
`!!
`
`400
`'
`--------------------------.
`~--v ..... \_ -------------------
`,!_1 ·;~~-;~~;;~;,,i
`
`I
`..... J !
`1 ,
`1
`CONTENT
`I TIME STAMP I I
`EXTRACTiON AGENT j
`l
`I
`l--~~:~~iMAR I
`J I
`l
`1 f
`I
`COMMAND
`l
`I
`l
`----------~--~---------------... i _ _ _ _ _ _ _ _ _ .,.......!
`~
`~
`~
`402
`404
`406
`
`/
`
`I
`
`1
`
`URL
`
`!
`
`FIG, 4
`
`304
`I l-.
`l
`,-.J, ____ _
`l
`l
`
`' I
`
`----~--------~i
`!
`r-------·1500
`I
`SPEECH RECOGMT!ON
`ENG!NE
`'-----------------'
`, - - - - - - - - - - - - - - .
`i
`l --+-)
`r . J' , .... - ;;iv ..
`SPEECH SYNTHESIS
`ENGlNE
`
`rf\';
`
`I
`l
`............ ......,. ..... . - }
`
`!VR APPUCAT!ON
`
`r----- ,7...--- so4
`l
`!
`
`, l CALL p~~SSING SY~~~-L-r;:_ 506
`l __ ; ···•··
`!---+?..- 508
`TELEPHGNY AND VOICE
`I
`HARDWARE __ _I
`
`\
`
`MEDlA SERVER
`
`FIG. 5
`
`Petitioner Google Ex-1001, 0010
`
`

`

`U.S. Patent
`
`Sep.19,2017
`
`Sheet 5 of 5
`
`US 9,769,314 B2
`
`l-'1
`l
`r----~---·--·----·--·-----------···~····--·-.l..--._----
`!
`!
`~----·---------------······-·1
`I
`J
`t-··--·7"-2._ ... - 600
`i
`I
`l I
`CONTENT EX'TRACTlON
`I
`I
`L_,____________ --.,.,...;.1
`AGENT
`I
`i
`r-
`i ~--
`---
`-«~-·
`- - -~ r
`i
`f
`f ------r-·--.
`6 ('\"'
`I
`I ~-- 'UL
`!
`I
`l
`CONTENT FETCHER
`!
`j
`f
`i
`\....-----··- ·------·-·--·--·----~--""'--1
`I
`'
`!
`I
`,-----·-----~----·---------------•---.
`i
`i-----+--~
`-~04
`I ~-- ti
`f
`I
`f CONTENT DESCRIPTOR flLES I
`.
`i
`l
`I
`i
`J
`.,
`!
`l
`'
`j
`L ................. ..;,,..--=""'""~ ... - - -~ . , . , , , , . . -~~~ ... ----
`r
`!
`t
`l
`l
`!
`I
`~
`I
`I
`lu~--....,."