Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 1 of 31
`
`
`
`
`
`
` Exhibit 5
`
`
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 2 of 31
`I lllll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111
`US008904464Bl
`
`c12) United States Patent
`Cox
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,904,464 Bl
`*Dec. 2, 2014
`
`(54) METHOD FOR TAGGING AN ELECTRONIC
`MEDIA WORK TO PERFORM AN ACTION
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`(71) Applicant: Network-1 Security Solutions, Inc.,
`New York, NY (US)
`
`(72)
`
`Inventor:
`
`Ingemar J. Cox, London (GB)
`
`(73) Assignee: Network-1 Technologies, Inc., New
`York, NY (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 13/800,573
`
`(22) Filed:
`
`Mar. 13, 2013
`
`Related U.S. Application Data
`
`(63) Continuation of application No. 13/338,079, filed on
`Dec. 27, 2011, which is a continuation of application
`No. 11/977,202, filed on Oct. 23, 2007, now Pat. No.
`8,205,237, which is a continuation of application No.
`11/445,928, filed on Jun. 2, 2006, now Pat. No.
`8,010,988, which is a continuation of application No.
`09/950,972, filed on Sep. 13, 2001, now Pat. No.
`7,058,223.
`
`(60) Provisional application No. 60/232,618, filed on Sep.
`14, 2000.
`
`(51)
`
`(2011.01)
`(2012.01)
`
`Int. Cl.
`H04N7/173
`G06Q 30102
`(52) U.S. Cl.
`CPC .................................. G06Q 3010256 (2013.01)
`USPC ............ 725/115; 725/110; 725/114; 725/116
`( 58) Field of Classification Search
`None
`See application file for complete search history.
`
`WORK@t1
`
`3,919,479 A
`4,230,990 A
`4,450,531 A
`
`1111975 Moon et al.
`10/1980 Lert, Jr. et al.
`5/1984 Kenyon et al.
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`
`6/1998
`0849946 A2
`12/2007
`1 354 276 Bl
`(Continued)
`
`OTHER PUBLICATIONS
`
`Martin Ester et al., "A Density-Based Algoritlnn for Discovering
`Clusters in Large Spatial Databases with Noise," Proceedings of 2nd
`International Conference on Knowledge Discovery and Data Mining
`(KDD-96), 1996.
`
`(Continued)
`
`Primary Examiner - Cai Chen
`(74) Attorney, Agent, or Firm -Amster, Rothstein &
`Ebenstein LLP
`
`(57)
`
`ABSTRACT
`
`A computer-implemented method comprising the steps of
`receiving, by a computer system including at least one com(cid:173)
`puter, a media work; receiving, by the computer system, a tag
`associated with the media work having a media work identi(cid:173)
`fier; storing, by the computer system, the media work identi(cid:173)
`fier and the associated tag; obtaining, by the computer system
`from a user electronic device, a query related to the associated
`tag; correlating, by the computer system, the query with asso(cid:173)
`ciated information related to an action to be performed; and
`providing, from the computer system to the user electronic
`device, the associated information to be used in performing
`the action.
`
`34 Claims, 10 Drawing Sheets
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 3 of 31
`
`US 8,904,464 Bl
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6/1984 Heffron et al.
`4,454,594 A
`111985 Baranoff-Rossine
`4,495,526 A
`2/1985 Matthews
`4,499,601 A
`4/1985 Kohler et al.
`4,511,917 A
`10/1985 Greenberg
`4,547,804 A
`111987 N akatani et al.
`4,634,966 A
`111987 Greenberg
`4,639,779 A
`6/1987 Okajima
`4,677,455 A
`6/1987 Lert, Jr. et al.
`4,677,466 A
`7/1987 Matthews
`4,682,370 A
`9/1987 Kiervit et al.
`4,697,209 A
`4/1988 Thomas et al.
`4,739,398 A
`10/1988 Fujimoto
`4,776,017 A
`2/1989 Greenberg
`4,805,020 A
`6/1989 Price, III
`4,843,526 A
`6/1989 Kenyon et al.
`4,843,562 A
`4/1990 Schulze
`4,918,730 A
`5/1993 Kenyon
`5,210,820 A
`2/1994 Glick et al.
`5,283,819 A
`7/1995 Lamb et al.
`5,437,050 A
`8/1995 Palmer
`5,438,355 A
`1111995 Hull et al.
`5,465,353 A
`111996 Thomas et al.
`5,481,294 A
`4/1996 Ellis et al.
`5,504,518 A
`8/1996 Slade et al.
`5,550,735 A
`12/1996 O'Hagan et al.
`5,581,658 A
`111997 Lu et al.
`5,594,934 A
`3/1997 Schwartz
`5,607,356 A
`5/1997 Dougherty
`5,629,739 A
`5/1997 Stefil< et al.
`5,634,012 A
`6/1997 Stefil< et al.
`5,638,443 A
`1111997 Goldberg et al.
`5,692,213 A
`12/1997 Siefert
`5,701,452 A
`12/1997 Sasayama
`5,701,542 A
`5,706,364 A
`111998 Kopec et al.
`3/1998 Wissner
`5,724,605 A
`4/1998 Burrows
`5,745,900 A
`5/1998 Rhoads
`5,748,783 A
`6/1998 Rhoads
`5,768,426 A
`8/1998 Hendricks et al.
`5,798,785 A
`9/1998 Brodsky
`5,809,471 A
`10/1998 Throckmorton et al.
`5,818,441 A
`10/1998 Maa
`5,818,935 A
`10/1998 Rhoads
`5,822,436 A
`1111998 Rhoads
`5,832,119 A
`1111998 Zhang et al.
`5,832,182 A
`1111998 Rhoads
`5,841,978 A
`12/1998 Johnson
`5,850,490 A
`12/1998 Goldhaber et al.
`5,855,008 A
`111999 Rhoads
`5,862,260 A
`2/1999 Ghias et al.
`5,874,686 A
`4/1999 Logan et al.
`5,892,536 A
`5/1999 Broadwin et al.
`5,903,816 A
`5/1999 Palmer et al.
`5,905,865 A
`5/1999 Schwartz et al.
`5,905,988 A
`5/1999 Kelly et al.
`5,907,322 A
`6/1999 Blum et al.
`5,918,223 A
`7/1999 Kikinis
`5,929,849 A
`7/1999 Broadwin et al.
`5,929,850 A
`8/1999 Gerba et al.
`5,931,908 A
`8/1999 Kalluri et al.
`5,937,331 A
`9/1999 Nielsen
`5,953,415 A
`10/1999 Kunkel et al.
`5,961,603 A
`10/1999 Mitchell et al.
`5,963,966 A
`10/1999 Schaff a et al.
`5,973,685 A
`10/1999 DeLuca
`5,973,723 A
`1111999 Farber et al.
`5,978,791 A
`1111999 Yokoyama et al.
`5,983,171 A
`1111999 Hoffert et al.
`5,983,176 A
`12/1999 Iggulden
`5,999,689 A
`12/1999 Zdepski et al.
`6,006,256 A
`12/1999 Rangan et al.
`6,006,265 A
`6,009,410 A * 12/1999 LeMole et al. ............. 705/14.54
`6,011,758 A
`112000 Dockes et al.
`6,021,433 A
`212000 Payne et al.
`
`6,023,693 A
`6,026,439 A
`6,044,376 A
`6,044,402 A
`6,047,327 A
`6,052,693 A
`6,057,872 A *
`6,061,056 A
`6,067,369 A
`6,088,455 A
`6,088,707 A
`6,096,961 A
`6,098,106 A
`6,118,450 A
`6,119,124 A
`6,121,530 A
`6,154,737 A
`6,169,986 Bl
`6,173,406 Bl
`6,188,010 Bl
`6,195,693 Bl
`6,201,176 Bl
`6,215,483 Bl
`6,229,922 Bl
`6,233,682 Bl
`6,236,758 Bl
`6,240,409 Bl
`6,243,725 Bl
`6,247,133 Bl
`6,253,193 Bl
`6,263,348 Bl
`6,263,505 Bl
`6,269,275 Bl
`6,279,010 Bl
`6,285,407 Bl
`6,317,885 Bl
`6,326,982 Bl
`6,330,593 Bl
`6,345,256 Bl
`6,349,296 Bl
`6,360,215 Bl
`6,363,377 Bl
`6,374,225 Bl
`6,374,260 Bl
`6,381,601 Bl
`6,385,596 Bl
`6,400,407 Bl
`6,407,680 Bl
`6,408,128 Bl
`6,415,280 Bl
`6,415,438 Bl
`6,418,421 Bl
`6,438,556 Bl
`6,446,068 Bl
`6,449,226 Bl
`6,452,874 Bl
`6,453,252 Bl
`6,460,050 Bl
`6,460,180 Bl
`6,469,749 Bl
`6,473,804 Bl
`6,477,704 Bl
`6,490,279 Bl
`6,496,802 Bl
`6,496,857 Bl
`6,505,160 Bl
`6,542,869 Bl
`6,550,001 Bl
`6,550,011 Bl
`6,552,254 B2
`6,563,515 Bl
`6,564,379 Bl
`6,567,982 Bl
`6,571,392 Bl
`6,577,746 Bl
`6,591,245 Bl
`6,597,405 Bl
`6,598,228 B2
`6,604,242 Bl
`
`212000 Masuoka et al.
`212000 Chowdhury et al.
`3/2000 Kurtzman, II
`3/2000 Jacobson et al.
`412000 Tso et al.
`412000 Smith et al.
`512000 Candelore ....................... 725/23
`512000 Menard et al.
`512000 Kamei
`712000 Logan et al.
`712000 Bates et al.
`8/2000 Bruti et al.
`8/2000 Philyaw et al.
`912000 Proehl et al.
`912000 Broder et al.
`912000 Sonoda
`11/2000 Inaba et al.
`112001 Bowman et al.
`112001 Wang eta!.
`2/2001
`Iwamura
`2/2001 Berry et al.
`3/2001 Yourlo
`4/2001 Zigmond
`5/2001 Sasakawa et al.
`5/2001 Fritsch
`5/2001 Sodagar et al.
`5/2001 Aiken
`6/2001 Hempleman et al.
`6/2001 Palage et al.
`6/2001 Ginter et al.
`7/2001 Kathrow et al.
`7/2001 Walker et al.
`7/2001 Slade
`8/2001 Anderson
`9/2001 Yasuki et al.
`1112001 Fries
`12/2001 Wu et al.
`12/2001 Roberts et al.
`212002 Milsted et al.
`212002 Broder et al.
`3/2002 Judd et al.
`3/2002 Kravets et al.
`412002 Hejna, Jr.
`412002 Hoffert et al.
`412002 Fujiwara et al.
`512002 Wiser et al.
`612002 Zigmond et al.
`612002 Lai et al.
`612002 Abecassis
`712002 Farber et al.
`712002 Blackketter et al.
`712002 Hurtado et al.
`8/2002 Malik et al.
`912002 Kortge
`912002 Kumagai
`912002 Otsuka et al.
`912002 Laroche
`10/2002 Pace et al.
`10/2002 Park et al.
`10/2002 Dimitrova
`10/2002 Kaiser et al.
`1112002 Cremia
`12/2002 Chen et al.
`12/2002 Van Zoe st et al.
`12/2002 Dustin et al.
`112003 Levy et al.
`4/2003 Foote
`4/2003 Corwin eta!.
`4/2003 Sims, III
`4/2003 Hasegawa et al.
`5/2003 Reynolds et al.
`5/2003 Knudson et al.
`5/2003 Howe eta!.
`5/2003 Zigmond et al.
`6/2003 Evans et al.
`7/2003 Klug
`7/2003 Iggulden
`7/2003 Hejna, Jr.
`8/2003 Weinstein et al.
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 4 of 31
`
`US 8,904,464 Bl
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/2003 Van Zoe st et al.
`6,609,105 B2
`9/2003 Kaiser et al.
`6,615,408 Bl
`10/2003 Matthews, III et al.
`6,631,523 Bl
`10/2003 Hamzyet al.
`6,636,247 Bl
`1112003 Stern
`6,654,757 Bl
`12/2003 Pugh et al.
`6,658,423 Bl
`12/2003 Crow et al.
`6,665,661 Bl
`12/2003 Leak et al.
`6,668,378 B2
`112004 Bolle et al.
`6,675,174 Bl
`112004 Wang
`6,675,385 Bl
`212004 Gould et al.
`6,693,236 Bl
`212004 Zigmond et al.
`6,698,020 Bl
`7/2004 Herley
`6,766,523 B2
`6,774,926 Bl * 8/2004 Ellis et al. .................. 348/14.01
`8/2004 Zigmond et al.
`6,785,902 Bl
`6,810,388 Bl
`10/2004 Sato
`6,833,865 Bl
`12/2004 Fuller et al.
`6,834,308 Bl
`12/2004 Ikezoye et al.
`6,850,252 Bl
`212005 Hofiberg
`6,871,200 B2
`3/2005 MacQueen et al.
`3/2005 Morris
`6,871,231 B2
`6,873,982 Bl
`3/2005 Bates et al.
`6,912,571 Bl
`6/2005 Serena
`6,928,423 Bl
`8/2005 Yamanaka
`8/2005 Farber et al.
`6,928,442 B2
`6,931,451 Bl
`8/2005 Logan et al.
`6,937,766 Bl
`8/2005 Wilfetal.
`8/2005 Blackketter et al.
`6,938,270 B2
`6,941,275 Bl
`912005 Swierczek
`6,941,574 Bl
`912005 Broadwin et al.
`6,944,632 B2
`912005 Stern
`6,968,337 B2
`1112005 Wold
`6,970,886 Bl
`1112005 Conwell et al.
`6,978,419 Bl
`12/2005 Kantrowitz
`6,978,461 B2
`12/2005 Shapiro et al.
`6,983,371 Bl
`112006 Hurtado et al.
`112006 Wang et al.
`6,990,453 B2
`6,999,111 B2
`212006 Mcintyre et al.
`7,013,301 B2
`3/2006 Holm et al.
`7,020,635 B2
`3/2006 Hamilton et al.
`7,035,914 Bl
`412006 Payne et al.
`7,039,935 B2
`512006 Knudson et al.
`7,043,473 Bl
`512006 Rassool et al.
`612006 Cox
`7,058,223 B2
`7,065,709 B2
`612006 Ellis et al.
`7,092,953 Bl
`8/2006 Haynes
`7,096,486 Bl
`8/2006 Ukai eta!.
`7,103,906 Bl
`912006 Katz et al.
`7,106,904 B2
`912006 Shuma
`7,140,033 Bl
`1112006 Durden et al.
`7,146,631 Bl
`12/2006 Tanaka et al.
`7,152,236 Bl
`12/2006 Wugofski et al.
`7,155,449 B2
`12/2006 Pingel et al.
`112007 Wouters et al.
`7,158,929 B2
`112007 Zigmond
`7,165,266 B2
`112007 Kalker et al.
`7,168,083 B2
`7,171,016 Bl
`112007 Rhoads
`7,174,293 B2
`212007 Kenyon et al.
`7,181,756 Bl
`212007 Zigmond et al.
`7,184,100 Bl
`212007 Wilfetal.
`7,188,353 Bl
`3/2007 Crin on
`7,191,190 B2
`3/2007 Debique et al.
`5/2007 Bennington et al.
`7,225,455 B2
`7,237,253 Bl
`6/2007 Blackketter et al.
`7/2007 Ullman
`7,243,139 B2
`7/2007 Mcintyre et al.
`7,243,153 B2
`7/2007 Kawamoto
`7,251,475 B2
`7,254,829 Bl
`8/2007 Brown eta!.
`9/2007 Anderson et al.
`7,272,788 B2
`1112007 Conwell et al.
`7,302,574 B2
`12/2007 Blackketter et al.
`7,305,693 B2
`7,308,413 Bl
`12/2007 Tota et al.
`7,313,805 Bl
`12/2007 Rosin et al.
`7,334,250 B2
`2/2008 Blackketter et al.
`7,340,763 Bl
`3/2008 Harris
`
`7,346,472 Bl
`7,349,668 B2
`7,363,278 B2
`7,366,718 Bl
`7,366,787 B2
`7,369,677 B2
`7,370,017 Bl
`7,386,512 Bl
`7,404,200 Bl
`7,409,437 B2
`7,421,723 B2
`7,423,771 B2
`7,426,558 Bl
`7,444,353 Bl
`7,477,739 B2
`7,483,958 Bl
`7,487,527 B2
`7,493,643 B2
`7,500,007 B2
`7,506,352 B2
`7,523,312 B2
`7,523,478 B2
`7,529,659 B2
`7,562,012 Bl
`7,562,392 Bl
`7,565,327 B2
`7,587,728 B2
`7,595,914 B2
`7,606,883 Bl
`7,624,337 B2
`7,631,072 B2
`7,647,604 B2
`7,650,616 B2
`7,660,700 B2
`7,707,088 B2
`7,711,652 B2
`7,712,125 B2
`7,738,704 B2
`7,743,092 B2
`7,757,248 B2
`7,757,254 B2
`7,765,575 B2
`7,783,489 B2
`7,797,249 B2
`7,802,281 Bl
`7,818,768 B2
`7,840,975 B2
`7,849,226 B2
`7,853,664 Bl
`7,861,275 Bl
`7,870,088 Bl
`7,877,438 B2
`7,882,518 B2
`7,917,645 B2
`7,930,719 B2
`7,941,816 B2
`7,949,494 B2
`7,949,749 B2
`7,962,414 Bl
`7,996,565 B2
`8,001,569 B2
`8,006,264 B2
`8,006,314 B2
`8,065,615 B2
`8,082, 150 B2
`8,086,445 B2
`8,090,605 B2
`8,094,949 Bl
`8,108,886 Bl
`8,112,776 B2
`8,171,509 Bl
`8,171,510 B2
`8,185,923 B2
`8,214,175 B2
`RE43,578 E
`8,255,952 B2
`RE43,671 E
`8,272,011 B2
`8,296,792 B2
`
`3/2008 Moskowitz et al.
`3/2008 Ilan et al.
`4/2008 Schmelzer et al.
`4/2008 Pugh et al.
`4/2008 Salas et al.
`5/2008 Petrovic et al.
`5/2008 Lindeman et al.
`6/2008 Allibhoy et al.
`712008 Hailey et al.
`8/2008 Ullman eta!.
`9/2008 Harkness et al.
`9/2008 Ohata et al.
`9/2008 Allibhoy et al.
`10/2008 Chen et al.
`112009 Haitsma et al.
`112009 Elabbady et al.
`212009 Ellis et al.
`212009 Ellis
`3/2009 Ikezoye et al.
`3/2009 Blackketter et al.
`412009 Kalker et al.
`412009 Blackketter et al.
`512009 Wold
`712009 Wold et al.
`712009 Rhoads et al.
`712009 Schmelzer
`912009 Wheeler et al.
`912009 Raining
`10/2009 Allibhoy et al.
`1112009 Sull et al.
`12/2009 Allibhoy et al.
`1/2010 Ramaswamy
`1/2010 Lee
`2/2010 Moskowitz et al.
`4/2010 Schmelzer
`5/2010 Schmelzer
`5/2010 Herigstad et al.
`6/2010 Lienhart et al.
`6/2010 Wood
`712010 Harkness et al.
`712010 Shoff et al.
`712010 Zigmond
`8/2010 Kenyon et al.
`9/2010 Schmelzer et al.
`9/2010 Tani et al.
`10/2010 Blackketter et al.
`1112010 Matheny et al.
`12/2010 Zigmond et al.
`12/2010 Wang eta!.
`12/2010 Vellaikal et al.
`112011 Chen et al.
`112011 Schrempp et al.
`212011 Finseth et al.
`3/2011
`Ikezoye et al.
`4/2011 Ellis et al.
`5/2011 Harkness et al.
`5/2011 Moskowitz et al.
`5/2011 Allibhoy et al.
`612011 Allibhoy et al.
`8/2011 Allibhoy et al.
`8/2011 Marler et al.
`8/2011 Reynolds et al.
`8/2011 Wold
`1112011 Murray et al.
`12/2011 Wold
`12/2011 Wold et al.
`112012 Tota et al.
`112012 Rhoads
`112012 Murahashi et al.
`2/2012 Schein et al.
`5/2012 Girouard et al.
`5/2012 Kamen et al.
`5/2012 Slaney et al.
`7/2012 Moskowitz et al.
`8/2012 Sorensen
`8/2012 Boylan, III et al.
`9/2012 Sorensen
`9/2012 Yuen et al.
`10/2012 Sahota et al.
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 5 of 31
`
`US 8,904,464 Bl
`Page 4
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`10/2012 Allibhoy et al.
`8,301,758 B2
`12/2012 Tota et al.
`8,340,994 B2
`7/2013 Ellis et al.
`8,479,233 B2
`10/2013 Payne et al.
`8,572,279 B2
`12/2013 Payne et al.
`8,601,154 B2
`5/2001 Shoff et al.
`200110001160 Al
`6/2001 Pingel et al.
`200110003818 Al
`1112001 Ullman
`200110037376 Al
`1112001 Moore et al.
`200110047298 Al
`12/2001 Mowry
`200110049625 Al
`212002 Kenyon et al.
`2002/0023020 Al
`212002 Miller et al.
`2002/0026369 Al
`3/2002 Cox
`2002/0032698 Al
`3/2002 Ullman
`2002/0035600 Al
`3/2002 Ullman
`2002/0035601 Al
`2002/0035614 Al
`3/2002 Ullman
`3/2002 Ullman
`2002/0035615 Al
`2002/0038296 Al
`3/2002 Margolus et al.
`3/2002 Ullman et al.
`2002/0038383 Al
`412002 Ullman et al.
`2002/0042813 Al
`412002 Ullman et al.
`2002/0049832 Al
`2002/0056091 Al*
`512002 Bala et al . ....................... 725/34
`512002 Liwerant et al.
`2002/0056123 Al
`512002 Blackketter et al.
`2002/0056129 Al
`2002/0059610 Al*
`512002 Ellis ................................ 725/58
`612002 Pitman et al.
`2002/0082731 Al
`612002 Lowenstein et al.
`2002/0083005 Al
`712002 Peled et al.
`2002/0087885 Al
`712002 Stahl
`2002/0088336 Al
`712002 Pitman et al.
`2002/0099555 Al
`8/2002 Abato
`2002/0112002 Al
`8/2002 Logan
`2002/0120925 Al
`912002 Ward et al.
`2002/0133499 Al
`10/2002 Felts et al.
`200210150164 Al
`10/2002 Lawrence et al.
`2002/0156760 Al
`10/2002 Harrington
`200210156909 Al
`1112002 McCartney et al.
`200210178276 Al
`12/2002 Rhoads
`200210186887 Al
`12/2002 Ullman et al.
`200210188699 Al
`112003 Ullman et al.
`2003/0005151 Al
`212003 Williamson
`2003/0028489 Al
`212003 Schmelzer
`2003/0037010 Al
`3/2003 Abajian
`2003/0061490 Al
`4/2003 Ullman
`2003/0065719 Al
`5/2003 Ullman
`2003/0088674 Al
`5/2003 Logan et al.
`2003/0093790 Al
`5/2003 Lee et al.
`2003/0095660 Al
`5/2003 Moreno
`2003/0101144 Al
`5/2003 Ullman
`2003/0101232 Al
`6/2003 Kanchirayappa et al.
`2003/0106017 Al
`8/2003 Ellis et al.
`2003/0146940 Al
`9/2003 Ullman
`2003/0167300 Al
`2003/0182113 Al
`9/2003 Huang
`10/2003 Zhou et al.
`2003/0202660 Al
`12/2003 Ozick
`2003/0233930 Al
`112004 Donian et al.
`2004/0003398 Al
`112004 Van Vleck et al.
`200410010602 Al
`112004 Ellis et al.
`200410015608 Al
`212004 Cerrato
`2004/0025174 Al
`212004 Hidary
`2004/00307 59 Al
`8/2004 Schrempp et al.
`2004/0163106 Al
`912004 Pearlman et al.
`200410170335 Al
`2004/0199387 Al* 10/2004 Wang et al . ................... 704/243
`2004/0221118 Al
`1112004 Slater et al.
`2004/0236865 Al
`1112004 Ullman
`2004/0243540 Al
`12/2004 Moskowitz et al.
`2005/0015815 Al*
`112005 Shoff et al.
`................... 725/135
`2005/0044189 Al
`Ikezoye et al.
`212005
`2005/0080846 Al
`412005 McCleskey et al.
`2005/0097622 Al
`512005 Zigmond et al.
`2005/0102515 Al
`512005 Jaworski et al.
`2005/0154892 Al
`7/2005 Mihcaketal.
`2005/0160363 Al
`7/2005 Bhogal et al.
`2005/0193016 Al
`912005 Seet et al.
`2005/0213826 Al
`912005 Neogi
`
`2005/0246752 Al
`2005/0289065 Al
`2006/0031870 Al
`2006/0080356 Al
`2006/0085816 Al
`2006/0101069 Al
`2006/0110137 Al
`2006/0187358 Al
`2006/0195859 Al
`2006/0195860 Al
`2006/0206462 Al
`2006/0212927 Al
`2006/0271947 Al
`2007/0041667 Al
`2007/0071330 Al
`2007/0083510 Al
`2007/0101360 Al
`2007/0118375 Al
`2007/0124698 Al
`2007/0130580 Al
`2007/0180537 Al
`2007 /0203911 Al
`2007/0282472 Al
`2007/0288518 Al
`2007 /0294173 Al
`2008/0052783 Al
`2008/0091684 Al
`2008/0162478 Al
`2008/0250241 Al
`2009/0052784 Al
`2009/0328236 Al
`2010/0211969 Al
`2010/0290666 Al
`201110167449 Al
`201110173660 Al
`2012/0078871 Al
`2013/0086608 Al
`
`11/2005 Liwerant et al.
`12/2005 Weare
`212006 Jarman et al.
`412006 Burges et al.
`412006 Funk et al.
`512006 Bell et al.
`512006 Tsuda et al.
`8/2006 Lienhart et al.
`8/2006 Konig et al.
`8/2006 Eldering et al.
`912006 Barber
`912006 Riku et al.
`1112006 Lienhart et al.
`212007 Cox
`3/2007 Oostveen et al.
`4/2007 McArdle
`5/2007 Gutta et al.
`5/2007 Kenyon et al.
`5/2007 Majumder
`6/2007 Covell et al.
`8/2007 He et al.
`8/2007 Chiu
`12/2007 Seidman
`12/2007 Crigler et al.
`12/2007 Levy et al.
`2/2008 Levy
`4/2008 Ellis et al.
`712008 Pugh et al.
`10/2008 Ginter et al.
`212009 Covell et al.
`12/2009 Schmelzer
`8/2010 Schein et al.
`1112010 Rhoads
`7/2011 Klosterman et al.
`7/2011 Schein et al.
`3/2012 Pugh et al.
`4/2013 Slaney et al.
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`GB
`JP
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`
`1354276 Bl
`1 485 815 Bl
`2369203 A
`2003-242281
`94/06084 Al
`9841020 Al
`9904568 Al
`99/50778 Al
`W00122730 Al
`WO 02/11033 Al
`WO 02/103968 Al
`
`12/2007
`712009
`512002
`8/2003
`3/1994
`9/1998
`111999
`10/1999
`3/2001
`212002
`12/2002
`
`OTHER PUBLICATIONS
`
`Yossi Rubner et al., "Adaptive Color Image Embeddings for Database
`Navigation," Proceedings of the 1998 IEEE Asian Conference on
`Computer Vision.
`Roger Weber et al., "A Quantitative Analysis and Performance Study
`for Similarity-Search Methods in High-Dimensional Spaces," Pro(cid:173)
`ceedings of 24th VLDB Conference, 1998.
`P. Yianilos, "Data Structures and Algorithms for Nearest Neighbor
`Search in General Metric Spaces," Proceedings of the ACM-SIAM
`Symposium on Discrete algorithms, 1993, pp. 311.321.
`U.S. Appl. No. 60/222,023, filed Jul. 31, 2000; Avery Li-Chun Wang
`and Julius 0. Smith III, Inventors; Palo Alto, CA.
`Peter N. Yianlos, Excluded Middle Vantage Point Forests for Nearest
`Neighbor Search, Jul. 20, 1998, pp. 1-12.
`Peter N. Yianlos "Locally Lifting the Curse of Dimensionality for
`Nearest Neighbor Search" SODA 2000, pp. 361-370.
`L. Baum et al., "A Maximation Technique Occuring in the Statistical
`Analysis of Probabilistic Functions of Markov Chains," The Annals
`of Mathematical Statistics, vol. 41, No. 1, pp. 164-171 (1970).
`A. P. Dempster et al., "Maximum Likelihood from Incomplete Data
`via the $EM$ Algorithm," Journal of the Royal Statistical Society,
`Series B (Methodological), vol. 39, Issue 1, pp. 1-38 (1977).
`D. Reynolds et al., "Robust Text-Independent Speaker Identification
`Using Gaussian Mixture Speaker Models," IEEE Transactions on
`Speech and Audio Processing, vol. 3, No. 1, pp. 72-83 (Jan. 1995).
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 6 of 31
`
`US 8,904,464 Bl
`Page 5
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`D. Bouktache, "A fast Algorithm for the nearest neighbor classifier,"
`IEEE Transactions on Pattern Analysis and Machine Intelligence,
`Mar. 1997, pp. 277-282.
`Nene et al., "A simple algorithm for nearest neighbor search in high
`dimensions," IEEE Transactions on Pattern Analysis and Machine
`Intelligence, Sep. 1997, pp. 989-1003.
`Sunil Arya et al., "Approximate Nearest Neighbor Queries in Fixed
`Dimensions," Proceedings of the 4th annual ACM-SIAM Sympo(cid:173)
`sium on Discrete algorithms, 1993, pp. 271-280.
`K. Fukunaga et al., A branch and bound algorithm for computing
`k-nearest neighbors, IEEE Trans. Comput., C24:750-753, Jul. 1975.
`Charles D. Feustel et al., "The nearest neighbor problem in an
`abstract metric space," Pattern Recognition Letters, pp. 125-128,
`Dec. 1982.
`Dennis Shasha et al., "New Techniques for Best-Match Retrieval,"
`ACM Transactions on Information Systems, 8(2); 140{ 158, Apr.
`1990.
`J. Uhlmann, "Satisfying general proximity I similarity queries with
`metric trees", Information Processing Letters, 40 (4): 175{9, Nov.
`1991.
`Sergey Brin, "Near Neighbor Search in Large Metric Spaces," Pro(cid:173)
`ceedings of the 2lstVLDB Conference, Zurich, Switzerland, Sep.
`1995.
`Daniel P. Huttenlocher, et al., "Comparing Images Using the
`Hausdorff Distance," IEEE Transactions on Pattern Analysis and
`Machine Intelligence, vol. 15, No. 9, pp. 850-863, Sep. 1993.
`Thomas Seidl et al., "Optimal Multi-Step K-Nearest Neighbor
`Search," Proceedings of ACM SIGMOD International Conference of
`Management of Data, Jun. 1998, pp. 154-165.
`W. A. Burkhard et al., "Some Approaches to Best-Match File Search(cid:173)
`ing," Communications of the ACM, vol. 16, No. 4, Apr. 1973.
`Eyal Kushilevitz et al., "Efficient Search for Approximate Nearest
`Neighbor in High Dimensional Spaces," Proceedings of the 30th
`annual ACM Symposium on the Theory of computing, 1998, pp.
`457-474, vol. 30, No. 2.
`J. Nievergelt et al., "The Grid File: An Adaptable, Symmetric
`Multikey File Structure," ACM Transactions on Database Systems,
`vol. 9, No. 1, pp. 38-71 (Mar. 1984).
`Nevin Heintze, "Scalable Document Fingerprinting," Proc. USENIX
`Workshop on Electronic Commerce (1996).
`Erling Wold et al., "Content-Based Classification, Search, and
`Retrieval of Audio," IEEE Multimedia, vol. 3, Issue 3, pp. 27-63
`(1996).
`Bir Bhanu et al., "Learning Feature Relevance and Similarity Metrics
`in Image Databases," Proceedings of the IEEE Workshop on Content(cid:173)
`Based Access oflmage and Video Libraries, pp. 14-19 (1998).
`A. Del Bimbo et al., "Using Weighted Spatial Relationships in
`Retrieval by Visual Contents," Image Description and Retrieval, pp.
`161-192 (1998).
`P. Indyk et al "Approximate Nearest Neighbors: Towards Removing
`The Curse of Dimensionality," Proceeding of the Thirtieth Annual
`ACM Symposium on Theory of Computing, pp. 604-613 Jul. 21,
`1999.
`Marco La Cascia, "Combining Textual and Visual Cues for Content(cid:173)
`based Image Retrieval on the World Wide Web," Proceedings of the
`IEEE Workshop on Content-Based Access of Image and Video
`Libraries, pp. 24-29 ( 1998).
`Atsuo Yoshitaka et al., "A Survey on Content-Based Retrieval for
`Multimedia Databases," IEEE Transactions on Knowledge and Data
`Engineering, vol. 11, No. 1, pp. 81-93 (Jan./Feb. 1999).
`Steve Lawrence et al., "Digital Libraries and Automonous Citation
`Indexing," IEEE Computer, pp. 67-71 (Jun. 1999).
`Akisato Kimura et al., "Very Quick Audio Searching: Introducing
`Global Pruning to the Time-Series Active Search," IEEE Conf on
`Acoustics, Speech and Signal Processing, (ICASSP '01), vol. 3, pp.
`1429-1432, 2001.
`Edgar Chavez et al., "Searching in Metric Spaces," ACM Computing
`Surveys, vol. 33, No. 3, pp. 273-321 (Sep. 2001).
`
`Jaap Haitsma et al., "Robust Audio Hashing for Content Identifica(cid:173)
`tion," Workshop on Content Based Multimedia Indexing, Brescia,
`Italy (Sep. 19-21, 2001).
`Jaap Haitsma et al., "A Highly Robust Audio Fingerprinting System,"
`Journal of New Music Research, 1744-5027, vol. 32, Issue 2, pp.
`211-221 (2003).
`Saul Schleimer et al., "Winnowing: Local Algorithms for Document
`Fingerprinting," ACM SIGMOD, Jun. 9-12, 2003.
`Edward Chang et al., "Searching Near-Replicas oflmages via Clus(cid:173)
`tering," SPIE Symposium of Voice, Video and Data Communica(cid:173)
`tions, 1999.
`Edward Y. Chang et al., "RIME: A Replicated Image Detector for the
`World-Wide Web," SPIE, 1998.
`Hector Garcia-Molina et al., "Safeguarding and Charging for Infor(cid:173)
`mation on the Internet," Proceedings of ICDE, 1998.
`Sergey Brin et al., "Copy Detection Mechanisms for Digital Docu(cid:173)
`ments," Proceedings of ACM SIG-MOD, May 1995.
`Stefan Berchtold "The x-tree: An Index Structure for High-Dimen(cid:173)
`sional Data," Proceedings of the 22nd VLDB, Aug. 1996.
`Norio Katayama et al., "The SR-tree: An Index Structure for High(cid:173)
`Dimensional Nearest Neighbor Queries," Proceedings of ACM
`SIGMOD, May 1997.
`John T. Robinson, "The K-D-B-Tree: A Search Structure for Large
`Multidimensional Dynamic
`Indexes," Proceedings of ACM
`SIGMOD, Apr. 1981.
`Myron Flickner et al., "Query by Image and Video Content: The
`QBIC System," IEEE Computer 28(9), pp. 23-32, 1995.
`Amarnath Gupta et al., "Visual Information Retrieval," Communica(cid:173)
`tions of the ACM, vol. 40, No. 5, pp. 69-79, May 1997.
`John R. Smith et al., "VisualSEEk: A fully automated content-based
`image query system," ACM Multimedia Conference, 1996.
`David A. White et al., "Similarity Indexing: Algorithms and Perfor(cid:173)
`mance," Proc. SPIE, vol. 2670, San Diego, 1996.
`Norbert Beckmann et al., "The R*-tree: An Efficient and Robust
`Access Method for Points and Rectangles," Proceedings of ACM
`Sigmod, May 1990.
`A. Guttman, "R-Trees: A Dynamic Index Structure for Spatial
`Searching," Proceedings of ACM Sigmod, Jun. 1984.
`David A. White et al., "Similarity Indexing with the SS-tree*," Pro(cid:173)
`ceedings of the 12th ICDE, Feb. 1996.
`King Lin et al., "The TV-Tree: An Index Structure for High-Dimen(cid:173)
`sional Data,"VLDB, Journal 3, No. 4, 1994, pp. 517-542.
`Paolo Ciaccia et al., "M-tree: An Efficient Access Method for Simi(cid:173)
`larity Search in Metric Spaces," Proceedings of the 23rd VLDB, Aug.
`1997.
`Nick Roussopoulos et al., Nearest Neighbor Queries, Proceedings of
`ACM Sigmod, May 1995.
`C. Li et al., "An extensible hashing index for high-dimensional simi(cid:173)
`larity search," Stanford Techncial Report, Aug. 1998.
`Jon M. Kleinberg, "Two Algorithms for Nearest-Neighbor Search in
`High Dimensions," Proc 29th STOC, Feb. 7, 1997.
`Liu et al., "An Investigation of Practical Approximate Nearest Neigh(cid:173)
`bor Algorithms", Advances in Neural Information Processing Sys(cid:173)
`tems (NIPS) 2004.
`K. L. Clarkson, "Nearest-Neighbor Searching and Metric Space
`Demensions", Nearest-Neighbor Methods for Learning and Vision:
`Theory and Practice: Apr. 2005.
`Swaminathan et al., "Robust an Secure Image Hashing", IEEE Trans(cid:173)
`actions on Information Forensics and Security, Jun. 2006, pp. 215-
`230, vol. 1, No. 2.
`Burges et al., "Duplicate Detection and Audio Thumbnails with
`Audio Fingerprinting" [online]. 2004, [retrieved on Nov. 11, 2006].
`Retrieved on the internet: <URL: www.research.microsoft.com/
`-cburges/tech_reports/tr-2004-19.pdf>, 5 pages.
`Cano et al., "A Review of Algorithms for Audio Fingerprinting"
`[online]. 2002, [retrieved on Nov. 21, 2006], Retrieved from the
`Internet: <URL: www.iua.upl.es/mtg/publications/MMSP-2002-
`pcano.pdf>, 5 pages.
`Haitsama and Kalker, "A Highly Robus Audio Fingerprinting Sys(cid:173)
`tem" [ online]. 2002, [retrieved on Nov. 16, 2006]. Retrieved from the
`Internet: <url: www.ismir2002.ismir.net/proceedings/02-FP04-2.
`pdf>, 9 pages.
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 234-7 Filed 11/11/20 Page 7 of 31
`
`US 8,904,464 Bl
`Page 6
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Jacobs et al., "Fast Multiresolution Image Querying" [online]. 1995,
`[retrieved on Nov. 21, 2006]. Retrieved from the Internet: <URL:
`www.grail.cs.washington.edu/projects/query.pdf>, 10 pages.
`Ke et al., "Computer Vision for Music Identification" [online]. 2005,
`[retrieved on Nov. 21, 2006]. Retrieved from the Internet: <URL:
`www.cs.cmu.edu/-yke/musicretrieval/cvpr2005-rnr.pdf>, 8 pages.
`Shazam, Shazam Entertainment Brings Music Recognition to Win(cid:173)
`dows 5.U Powered Smartphones [retrieved on Nov. 16, 2006].
`Retrieved from the Internet. <URL: www.shazam.com/music/por(cid:173)
`tals/p/s/media-type/htrnl/user/anon/pages/default/template/pages/p/
`company_release30.htrnl>, 1 page.
`Stanford, "CS276 Information Retrieval and Web Mining" [online],
`2005, [retrieved on Nov. 16, 2006]. Retrieved from the Internet:
`<URL: www.stanford.edu/class/cs276/handouts/lecturel9.pdf>, 8
`pages.
`Stanford, "Data Mining: Associations" [online]. 2002, [retrieved on
`Nov. 16, 2006]. Retrieved from the Internet: <URL: www.stanford.
`edu/class/cs206/cs206-2.pdf>, 11 pages.
`Stollinz et al., Wavelets for Computer Graphics: A Primer, Part 1:
`[online], 1995, [retrieved on Nov. 21, 2006]. Retrieved from the
`internet: <URL: www.grail.cs.washington.edu/pub/stoll/waveletl.
`pdf>, 8 pages.
`Stollnitz et al., Wavelets for Computer Graphics: A Primer, Part 2:
`[online]. 1995, [retrieved on Nov. 21, 2006]. Retrieved from the
`Internet: <URL: www.grail.cs.washington.edu/pub/stoll/wavelet2.
`pdf>, 9 pages.
`Yang, "MACS: Music Audio Characteristic Sequence Indexing for
`Similarity Retrieval'', Oct. 21-24, 2001, New Paltz, New York.
`Viola and Jones, Robust Real-Time Object Detection, Int. J. Com(cid:173)
`puter Vision, 2002.
`Burges et al., "Using Audio Fingerprinting for Duplicate Detection
`and Thumbnail Generation," Mar. 2005, 4 pages.
`Lin et al., Input Data Representation for Self-Organizing Map in
`Software Classification, Knowledge Acquisition and Modeling,
`2009. KAM '09. Second International Symposium on vol. 2, Digital
`Object Identified: 10.11 09/KAM.2009.151 Publication Year: 2009,
`pp. 360-353.
`Baluja et al., "Content Fingerprinting Using Wavelets", 3rd European
`Conference on Visual Media Production, 2006, pp. 198-207.
`Cohen et al., "Finding Interesting Associations without Support
`Pruning", IEEE Transactions on Knowledge and Data Engineering,
`2001, pp. 64-78, vol. 13, Issue 1.
`Yang, Efficient Video Identification based on locality sensitive hash(cid:173)
`ing and triangle inequality, National University of Singapore, 2005,
`pp. 1-64.
`U.S. Appl. No. 60/304,647, filed Jul. 10, 2001.
`U.S. Appl. No. 60/281,881, filed Apr. 5, 2001.
`Metadata Mediation: Representation and Protocol, Tsuyoshi Sakata,
`Hiroyuki Tada, Tomohisa Ohtake, Digital Vision Laboratories, 7-3-
`37 Akasaka, Minato, Tokyo, Japan.
`U.S. Appl. No. 13/800,573, filed Mar. 13, 2013.
`U.S. Appl. No. 13/800,890, filed Mar. 13, 2013.
`U.S. Appl. No. 13/829,717, filed Mar. 14, 2013.
`U.S. Appl. No. 13/830,447, filed Mar. 14, 2013.
`U.S. Appl. No. 13/830,626, filed Mar. 14, 2013.
`U.S. Appl. No. 13/830,986, filed Mar. 14, 2013.
`U.S. Appl. No. 13/842,068, filed Mar. 15, 2013.
`U.S. Appl. No. 13/338,079, filed Dec. 27, 2011.
`U.S. Appl. No. 60/134,782, filed May 19, 1999.
`U.S. Appl. No. 60/193,948, filed Mar. 31, 2000.
`U.S. Appl. No. 60/195,535, filed Apr. 7, 2000.
`U.S. Appl. No. 60/206,384, filed May 23, 2000.
`U.S. Appl. No. 60/221,843, filed Jul. 28, 2000.
`Ardizzone, Edoardo et al., "Motion and Color-Based Video Indexing
`and Retrieval," Universita di palermo, Departimento di Ingegneria
`Elettrica, pp. 135-139, Viale delle Scienze, Palermo, Italy, IEEE
`1996.
`
`Deng, Yining et al., "Content-based Search of Video Using Color,
`Texture, and Motion," Dept. of Electrical and Computer Engineering,
`University of California, Santa Barbara, CA, pp. 534-537, IEEE
`1997.
`Fang, Min et al., "Computing Iceberg Queries Efficiently," Dept. of
`Computer Science, Stanford, CA, Paper No. 234, pp. 1-25.
`Flickner, Myron et al., "Query by Image and Video Content: The
`QBIC System," IBM Almaden Research Center, Sep. 1995, pp.
`23-32, IEEE 1995.
`Gargi, U et al., "Performance Characterization and Comparison of
`Video Indexing Algorithms," Dept. of Computer Science & Engi(cid:173)
`neering, The Pennsylvania State University, University Park, PA.
`Gionis,