Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 1 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 1 of 128
`JUDGE GARDEPHE
`
` Charles R. Macedo
`
`AMSTER, ROTHSTEIN & EBENSTEIN LLP
`90 Park Avenue
`New York, New York 10016
`Telephone: (212) 336-8074
`Facsimile: (212) 336-8001
`
`MarcA.Fenster (pro hac vice application to befiled)
`Brian D. Ledahl (pro hac vice application to be filed)
`Benjamin T. Wang(pro hacvice application to be filed)
`RUSS, AUGUST & KABAT
`12424 Wilshire Boulevard, 12" Floor
`Los Angeles, California 90025
`Telephone: (310) 826-7474
`Facsimile: (310) 826-6991
`
`Attorneys for Plaintiff
`Network-1 Technologies, Inc.
`
`
`
`UNITED STATES DISTRICT COURT
`SOUTHERN DISTRICT OF NEW YORK
`
`peneeeeeeX
`
`NETWORK-1 TECHNOLOGIES, INC.,
`
`Civil Action No.
`
`Plaintiff,
`
`V.
`
`JURY TRIAL DEMANDED
`
`GOOGLE,INC., and YOUTUBE, LLC,
`
`Defendants.
`
`weeeexX
`
`COMPLAINT FOR PATENT INFRINGEMENT
`
`Plaintiff Network-1 Technologies, Inc. (““Network-1”), by and through its counsel,
`
`for its complaint against Defendants Google,
`
`Inc.
`
`(“Google”) and YouTube, LLC
`
`(“YouTube”) (collectively, “Defendants”), alleges as follows:
`
`571839.2
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 2 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 2 of 128
`
`PARTIES
`
`1.
`
`Network-1 is a Delaware corporation with its principal place of businessat
`
`445 Park Avenue, Suite 1020, New York, New York 10022.
`
`2.
`
`Uponinformation and belief, Defendant Google is a Delaware corporation
`
`with business operations at manylocations, including 76 Ninth Avenue, New York, NY
`
`10011.
`
`3.
`
`Upon information and belief, Defendant YouTube is a Delaware limited
`
`liability company with business operations at many locations,
`
`including 76 Ninth
`
`Avenue, New York, NY, 10011. Upon information and belief, YouTube is a wholly-
`
`owned subsidiary of Google.
`
`JURISDICTION AND VENUE
`
`4,
`
`This action arises under the patent laws of the United States, Title 35 of
`
`the United States Code. This Court has original subject matter jurisdiction pursuant to 28
`
`ULS.C. §§ 1331 and 1338 (a).
`
`5.
`
`Upon information and belief, Defendants are subject
`
`to this Court’s
`
`specific and general personal jurisdiction pursuant to due process and/or the New York
`
`Long Arm Statute, due to having availed themselves of the rights and benefits of New
`
`York by engaging in activities,
`
`including:
`
`(1) conducting substantial business in this
`
`forum; (ii) maintaining a significant and continuous presence in this forum; and(iii)
`
`engaging in other persistent courses of conduct, and/or deriving substantial revenue from
`
`goods and services providedto individuals in New Yorkandin this Judicial District.
`
`6.
`
`Venueis proper in this district under 28 U.S.C. §§ 1391(b), 1391(c) and
`
`1400(b). Upon information and belief, Defendants have engagedin activities including:
`
`$71839.2
`
`2-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 3 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 3 of 128
`
`maintaining a significant and continuouspresencein this district, transacting business in
`
`this district, and purposefully directing their business activities,
`
`including infringing
`
`activities, to this district.
`
`FACTUAL BACKGROUND
`
`7.
`
`8.
`
`9.
`
`Network-1 holds a numberof patents invented by Dr. Ingemar J. Cox.
`
`Dr. Cox is a noted researcher in computer science fields.
`
`Dr. Cox received his Bachelor of Science from University College London
`
`and his PhD from Oxford University.
`
`10.
`
`Dr. Cox is Professor in the Department of Computer Science at University
`
`College London, where he is Head of the Future Media Group and served as Director of
`
`Research.
`
`11.+Dr. Coxis also a Professor in the Department of Computer Science at the
`
`University of Copenhagen.
`
`12.
`
`During the 1980s, Dr. Cox was a memberof the Technical Staff at AT&T
`
`Bell Labs.
`
`13.
`
`Dr. Cox is a Fellow ofthe Institute of Electrical and Electronics Engineers
`
`(“IEEE”),
`
`the Association for Computing Machinery (“ACM”), The Institution of
`
`Engineering and Technology, and The British Computer Society.
`
`14.
`
`Dr. Cox was the founding co-editor in chief of the IET Proceedings on
`
`Information Security. He is co-author of the book Digital Watermarking, and its second
`
`edition, Digital Watermarking and Steganography.
`
`15.
`
`Dr. Cox has authored more than 200 publications, and his work has been
`
`cited in scholarly writings more than 25,000 times.
`
`571839.2
`
`3-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 4 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 4 of 128
`
`16.|Among Dr. Cox’s many inventions are inventions relating to the use of
`
`extracted data from an audio and/or video work to obtain information about the work.
`
`17.
`
`Dr. Cox’s inventions have useful application to fields such as the analysis
`
`of audio or video files uploaded to an Internet site to determine if they match to known
`
`audio and/or video works that have been previously identified.
`
`18.
`
`Defendants have recognized Dr. Cox’s inventions, including by citing Dr.
`
`Cox’s patents as prior art
`
`in various patent applications pursued by Defendants,
`
`including, for example, in connection with Google’s Patent Applications, Serial Nos.
`
`11/097,089; 11/097,833; 12/660,146; 12/660,154; 12/723,613; 12/831,213; 12/894,059;
`
`12/898,653; 12/899,462; 12/902,081; 13/195,193; 13/253,632; and 13/400,551.
`
`19.
`
`Defendants operate the www.youtube.com and m.youtube.com websites
`
`(collectively and individually, “YouTubesite”).
`
`20.
`
`Upon information and belief, the YouTubesite allows users to upload
`
`media works, including video content from users’ client devices.
`
`21.|Upon information andbelief, after a media work is uploaded, Defendants’
`
`computer system extracts features from the uploaded media work.
`
`22.
`
`Upon information and belief, the extracted features are compared using
`
`Defendants’ computer system,
`
`including Defendants’ Content
`
`ID system, against
`
`extracted features of reference media works using neighbor search techniques, including,
`
`for example, a non-exhaustive, near neighbor search, and Defendants’ systems determine
`
`an action to perform in association with the uploaded media work,
`
`including, for
`
`example, to block, track, or monetize the uploaded media work.
`
`571839.2
`
`-4-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 5 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 5 of 128
`
`
`
`23.|Upon information and belief, the YouTube site is a highly successful
`
`element of Defendants’ business. Defendants’ Internet sites, primarily driven by the
`
`YouTubesite, rank as the top online video content property on the Internet. Defendants’
`
`ownStatistics indicate that more than 1 billion unique visitors visit YouTube each month,
`
`that viewers watch morethan 6 billion hours of video on YouTube each month, and that
`
`users upload 100 hours of video to YouTube every minute. Upon further information and
`
`belief, Defendants obtain significant revenues from YouTube. Some sources estimate
`
`that YouTube obtained advertising revenues of more than $5.6 billion for the year 2013.
`
`COUNT]
`
`Infringement of U.S. Patent No. 8,010,988
`
`24.
`
`Plaintiff Network-1 realleges and incorporates by reference paragraphs1-
`
`23 aboveasif fully set forth herein.
`
`25.
`
`Network-1 is the assignee of United States Patent No. 8,010,988 (“the
`
`°988 patent”) titled “Using Features Extracted From An Audio And/Or Video Work To
`
`Obtain Information About The Work.” The °988 patent was duly and legally issued by
`
`the United States Patent and Trademark Office on August 30, 2011. A copy ofthe °988
`
`patent is attached hereto as Exhibit A.
`
`26.|Upon information and belief, Defendants operate the YouTubesite.
`
`27.
`
`Upon information and belief, Defendants operate the Content ID system
`
`and utilize it in connection with the operation of the YouTubesite.
`
`28.
`
`Upon information and belief, Defendants have infringed, and continue to
`
`infringe, the °988 patent by, among other things, making, using, offering for sale, and/or
`
`571839,2
`
`-5-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 6 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 6 of 128
`
`selling unlicensed systems and products and/or services related thereto, covered by one or
`
`more claims of the ’988 patent. Such unlicensed systems and products and/or services
`
`include, by way of example and without limitation,
`
`the Content ID system and its
`
`implementation in connection with the YouTubesite. These activities are covered by one
`
`or more claimsof the 988 patent, including but not limited to claim 15.
`
`29.
`
`As a result of Defendants’
`
`infringement of the °988 patent, Plaintiff
`
`Network-1 has suffered monetary damages and is entitled to a money judgment in an
`
`amount adequate to compensate for Defendants’ infringement, but in no event less than a
`
`reasonable royalty for the use of the inventions made by Defendants, and interest and
`
`costs as fixed by the Court.
`
`COUNT I
`
`Infringement of U.S. Patent No. 8,205,237
`
`30.
`
`Plaintiff Network-1 realleges and incorporates by reference paragraphs1-
`
`29 aboveasif fully set forth herein.
`
`31.|Network-1 is the assignee of United States Patent No. 8,205,237 (“the
`
`°237 patent”) titled “Identifying Works, Using A Sub-Linear Time Search, Such As An
`
`Approximate Nearest Neighbor Search, For Initiating A Work-Based Action, Such As An
`
`Action On The Internet.” The ’237 patent was duly and legally issued by the United
`
`States Patent and Trademark Office on June 19, 2012. A copy of the °237 patent is
`
`attached hereto as Exhibit B.
`
`32.|Upon information and belief, Defendants operate the YouTubesite.
`
`33.
`
`Upon information and belief, Defendants operate the Content ID system
`
`and utilize it in connection with the operation of the YouTubesite.
`
`$71839.2
`
`-6-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 7 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 7 of 128
`
`34.|Upon information and belief, Defendants have infringed, and continue to
`
`infringe, the °237 patent by, among other things, making, using, offering for sale, and/or
`
`selling unlicensed systems and products and/or services related thereto, covered by one or
`
`more claims of the °237 patent. Such unlicensed systems and products and/or services
`
`include, by way of example and without
`
`limitation,
`
`the Content ID system and its
`
`implementation in connection with the YouTubesite. These activities are covered by one
`
`or more claimsof the ’237 patent, including but notlimited to claim 25.
`
`35.
`
`As a result of Defendants’
`
`infringement of the °237 patent, Plaintiff
`
`Network-1 has suffered monetary damagesandis entitled to a money judgment in an
`
`amount adequate to compensate for Defendants’ infringement, but in no eventless than a
`
`reasonable royalty for the use of the inventions made by Defendants, and interest and
`
`costs as fixed by the Court.
`
`COUNTIi
`
`Infringementof U.S. Patent No. 8,640,179
`
`36.
`
`Plaintiff Network-1 realleges and incorporates by reference paragraphs 1-
`
`35 aboveas if fully set forth herein.
`
`37.|Network-1 is the assignee of United States Patent No. 8,640,179 (“the
`
`°179 patent”) titled “Method For Using Extracted Features From An Electronic Work.”
`
`The °179 patent was duly and legally issued by the United States Patent and Trademark
`
`Office on January 28, 2014. A copy of the ’179 patent is attached hereto as Exhibit C.
`
`38.|Upon information and belief, Defendants operate the YouTubesite.
`
`39.|Upon information and belief, Defendants operate the Content ID system
`
`and utilize it in connection with the operation of the YouTubesite.
`
`$71839.2
`
`-7-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 8 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 8 of 128
`
`40.
`
`Upon information and belief, Defendants have infringed, and continue to
`
`infringe, the °179 patent by, among other things, making, using, offering for sale, and/or
`
`selling unlicensed systems and products and/orservices related thereto, covered by one or
`
`more claims of the 179 patent. Such unlicensed systems and products and/or services
`
`include, by way of example and without limitation,
`
`the Content ID system and its
`
`implementation in connection with the YouTubesite. These activities are covered by one
`
`or more claims of the ’179 patent, including but not limited to claim 1.
`
`41.
`
`As a result of Defendants’ infringement of the °179 patent, Plaintiff
`
`Network-1 has suffered monetary damages and is entitled to a money judgment in an
`
`amount adequate to compensate for Defendants’ infringement, but in no event less than a
`
`reasonable royalty for the use of the inventions made by Defendants, and interest and
`
`costs as fixed by the Court.
`
`COUNTIV
`
`Infringement of U.S. Patent No. 8,656,441
`
`42.
`
`Plaintiff Network-1 realleges and incorporates by reference paragraphs 1-
`
`41 aboveasif fully set forth herein.
`
`43,
`
`Network-1 is the assignee of United States Patent No. 8,656,441 (‘the
`
`°441 patent”) titled “System For Using Extracted Features From An Electronic Work.”
`
`The *441 patent was duly and legally issued by the United States Patent and Trademark
`
`Office on February 18, 2014. A copy of the ’441 patent is attached hereto as Exhibit D.
`
`44.
`
`Upon information and belief, Defendants operate the YouTubesite.
`
`45.|Upon information and belief, Defendants operate the Content ID system
`
`and utilize it in connection with the operation of the YouTubesite.
`
`571839.2
`
`-8-
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 9 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 9 of 128
`
`46.
`
`Upon information and belief, Defendants have infringed, and continue to
`
`infringe, the °441 patent by, among other things, making, using, offering for sale, and/or
`
`selling unlicensed systems and products and/or services related thereto, covered by one or
`
`more claims of the °441 patent. Such unlicensed systems and products and/or services
`
`include, by way of example and without limitation, the Content ID system and its
`
`implementation in connection with the YouTube site. These activities are covered by one
`
`or more claims of the °441 patent, including but not limited to claim 1.
`
`47.
`
`As a result of Defendants’
`
`infringement of the *441 patent, Plaintiff
`
`Network-1 has suffered monetary damages and is entitled to a money judgment in an
`
`amount adequate to compensate for Defendants’ infringement, but in no eventless than a
`
`reasonable royalty for the use of the inventions made by Defendants, and interest and
`
`costs as fixed by the Court.
`
`PRAYER FOR RELIEF
`
`WHEREFORE,Plaintiff Network-1 respectfully requests that the Court enter:
`
`1.
`
`A judgment
`
`in favor of Plaintiff Network-1 that Defendants have
`
`infringed, either literally and/or under the doctrine of equivalents, the °988 patent, the
`
`°237 patent, the ’179 patent, and the °441 patent;
`
`2.
`
`A judgment and order requiring Defendants to pay Plaintiff Network-1 its
`
`damages, costs, expenses, and pre-judgment and post-judgment
`
`interest as provided
`
`under 35 U.S.C. § 284 for Defendants’ infringement of the ’988 patent, the °237 patent,
`
`the ’179 patent, and the ’441 patent;
`
`3.
`
`A judgment and order for treble damages pursuant to 35 U.S.C. § 284; and
`
`571839.2
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 10 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 10 of 128
`
`4.
`
`Any and all other relief as the Court may deem appropriate and just under
`
`the circumstances.
`
`DEMAND FOR JURY TRIAL
`
`48.
`
`Plaintiff hereby requests a trial by jury.
`
`Respectfully submitted,
`
`Dated: April 4, 2014
`
`90 Park Avenue
`New York, New York 10016
`Tel.: (212) 336-8074
`Fax: (212) 336-8001
`
`Marc A. Fenster
`Brian D. Ledahl
`Benjamin T. Wang
`RUSS, AUGUST & KABAT
`12424 Wilshire Boulevard, 12™ Floor
`Los Angeles, California 90025
`Tel.: (310) 826-7474
`Fax: (310) 826-6991
`
`Attorneys for Plaintiff
`Network-1 Technologies, Inc.
`
`571839.2
`
`-10-
`
`
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 11 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 11 of 128
`
`EXHIBIT A
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 12 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 12 of 128
`
`(12)
`
`United States Patent
`Cox
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,010,988 B2
`Aug.30, 2011
`
`US008010988B2
`
`(54)
`
`USING FEATURES EXTRACTED FROM AN
`AUDIO AND/OR VIDEO WORK TO OBTAIN
`INFORMATION ABOUT THE WORK
`
`(76)
`
`Inventor:
`
`Ingemar J. Cox, London (GB)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer,the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 797 days.
`
`(21)
`
`Appl. No.: 11/445,928
`
`(22)
`
`Filed:
`
`Jun. 2, 2006
`
`Prior Publication Data
`
`US 2007/0041667 Al
`
`Feb. 22, 2007
`
`Related U.S. Application Data
`
`Continuation-in-part of application No. 09/950,972,
`filed on Sep. 13, 2001, now Pat. No. 7,058,223.
`
`4,677,455 A
`4,677,466 A
`4,682,370 A
`4,697,209 A
`4,739,398 A
`4,776,017 A
`4,805,020 A
`4,843,562 A
`4,918,730 A
`5,210,820 A
`5,283,819 A
`5,437,050 A
`5,481,294 A
`5,581,658 A
`5,594,934 A
`
`6/1987 Okajima
`‘6/1987 Lert, Jr. etal.
`7/1987 Matthews
`9/1987 Kiewit et al.
`4/1988 Thomas et al.
`10/1988 Fujimoto
`2/1989 Greenberg
`6/1989 Kenyonetal.
`4/1990 Schulze
`5/1993 Kenyon
`2/1994 Glick et al.
`7/1995 Lambetal.
`1/1996 ‘Thomas etal.
`12/1996 O’Hagan ctal.
`1/1997 Luetal.
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`Peter N. Yianilos, Excluded Middle Vantage Point Forest for Nearest
`Neighbor Search, Aug. 1, 1999, pp. 1-12.*
`
`(Continued)
`
`Provisional application No. 60/232,618, filed on Sep.
`14, 2000.
`
`Primary Examiner — Brian T Pendleton
`Assistant Examiner — Cai Chen
`
`Int. CL.
`(2011.01)
`HO4N 7/173
`US. CD cece seeccetcnetcneseesecenerecseeceeescaevesees 725/110
`Field of Classification Search .................... None
`See application file for complete search history.
`
`(74) Attorney, Agent, or Firm — Amster, Rothstein &
`Ebenstein LLP
`
`(57)
`
`ABSTRACT
`
`(65)
`
`(63)
`
`(60)
`
`(51)
`
`(52)
`(58)
`
`Information about anaudio or video file played on a deviceis
`provided by (a) extracting features from the audio or video
`file, (b) communicating the features to a database, and (c)
`receiving the information aboutthe audio or videofile from
`U.S. PATENT DOCUMENTS
`the database. The information might include a songtitle, an
`11/1975 Moonet al.
`album title, and/or a performer name. The information might
`3,919,479 A
`10/1980 Lert, Jr. et al.
`includeatitle of a video work, a director of the video work,
`4,230,990 A
`4,450,531 A
`5/1984 Kenyonetal.
`and/or names of performers in the video work. The informa-
`1/1985 Baranoff-Rossine
`4,495,526 A
`tion might be rendered on an outputofthe device. The infor-
`2/1985 Matthews
`4,499,601 A
`mation might be stored (e.g., persistently) locally on the
`4/1985 Kohler et al.
`4,511,917 A
`device.
`4,547,804 A
`10/1985 Greenberg
`1/1987 Nakatanietal.
`4,634,966 A
`4,639,779 A
`1/1987 Greenberg
`
`(56)
`
`References Cited
`
`52 Claims, 10 Drawing Sheets
`
` INFORMATION LOOKUP
`
`
`OPERATIONS)
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 13 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 13 of 128
`
`
`
`US 8,010,988 B2
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`5/1997
`11/1997
`12/1997
`12/1997
`3/1998
`4/1998
`8/1998
`12/1998
`6/1999
`9/1999
`12/1999
`1/2000
`2/2000
`3/2000
`4/2000
`5/2000
`7/2000
`7/2000
`9/2000
`9/2000
`1/2001
`1/2001
`5/2001
`6/2001
`6/2001
`/2001
`7/2001
`12/2001
`2/2002
`2/2002
`3/2002
`3/2002
`4/2002
`4/2002
`5/2002
`6/2002
`7/2002
`9/2002
`9/2002
`11/2002
`12/2002
`1/2003
`4/2003
`4/2003
`6/2003
`7/2003
`7/2003
`8/2003
`11/2003
`12/2003
`1/2004
`12/2004
`3/2005
`8/2005
`9/2005
`12/2005
`12/2005
`1/2006
`3/2006
`6/2006
`9/2006
`12/2006
`1/2007
`1/2007
`11/2007
`4/2008
`9/2008
`1/2009
`4/2009
`9/2009
`1/2010
`1/2010
`7/2010
`5/2001
`6/2001
`2/2002
`3/2002
`8/2002
`
`I
`Bl
`Bl
`BI
`Bl
`Bl
`Bl
`Bl
`Bl
`Bl
`Bl
`Bl
`BI
`Bl
`Bl
`BI*
`Bl
`Bl
`Bl
`Bl
`Bi
`Bl
`Bl
`Bl
`Bl
`
`Bl
`Bl
`Bl
`B2
`B2
`B2*
`B2
`B2
`B2
`B2
`B2
`Bl
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`Al*
`Al
`Al
`Al
`Al*
`
`Dougherty
`Godlberget al.
`Siefert
`Seifert
`Wissner
`Burrows
`Hendrickset al. 0... 725/46
`Johnson
`Blum etal.
`Nielsen
`Zdepskietal.
`Dockesetal.
`Chowdhury etal.
`Jacobsonetal.
`Smith et al.
`Menard etal.
`Logan etal.
`Batesetal.
`Proehl etal.
`Broderet al.
`Bowman
`Wang
`Aiken
`Hempleman etal.
`Palageei al.
`Ginteretal.
`Kathrowetal.
`Robertset al.
`Milsted etal.
`Broderet al.
`Judd etal.
`Kravets et al.
`Hejna,Jr.
`Fujiwaraetal.
`Wiseret al.
`Abecassis oo. ce cere 386/68
`Hurtadoetal.
`Kumagai
`Otsuka et al,
`Cremia
`Van Zoestet al.
`Levyetal.
`Corwin etal.
`Sims,III
`Evansetal.
`Klug
`Hejna,Jr.
`Van Zoestet al.
`Stem
`Crow etal.
`Bolleetal.
`Tkezoyeet al. ............. 709/231
`Bates etal.
`Logan et al. ween 709/231
`Swierezek
`Fleming,II]etal.
`Kantrowitz
`Wanget al.
`Holm etal.
`COOK ccceccseesceteteeeteeesets 382/190
`Shima
`Pingelet al.
`Woutersetal.
`Kalker et al.
`Conwelletal.
`Pugh et al.
`Harknessct al.
`Haitsmaetal.
`Kalkeretal.
`Wheeler etal.
`Ramaswamy
`Lee
`Harknessetal.
`Shoffet al.ee 725/51
`Pingeletal.
`Kenyonetal.
`Cox
`LOQAM ooeeescetesteeeneeesreeeees 725/9
`
`2002/0156760 Al
`10/2002 lawrenceetal.
`2003/0106017 Al
`6/2003 Kanchirayappaetal.
`, 345/811
`2003/0146940 A1*
`..........
`8/2003 Elliset al.
`
`2004/0199387 Al* 10/2004 Wang etal. 0.000... 704/243
`2005/0160363 Al
`7/2005 Bhogaletal.
`2006'0101069 Al
`5/2006 Bell etal.
`2006/0206462 Al
`9/2006 Barber
`2007/0041667 Al
`2/2007 Cox
`2007/0083510 Al
`4/2007 McArdle
`2007/0118375 Al
`5/2007 Kenyon etal.
`2008/0091684 Al
`4/2008 Ellis et al.
`2008/0250241 Al
`10/2008 Ginteret al.
`
`OTHER PUBLICATIONS
`
`Baum, L., et al., “A Maximation Technique Occurring in the Statis-
`tical Analysis of Probabilistic Functions of Markov Chains”, The
`Annals ofMathematical Statistics, vol.41, No. 1, pp. 164-171 (1970).
`Dempster, A.P., et al., “Maximum Likelihood from Incomplete Data
`via the $EM$ Algorithm”, Journal ofthe Royal Statistical Society,
`Series B (Methodological), vol. 39, Issue 1, pp. 1-38 (1977).
`Reynolds, D., et al., “Robust Text-Independent Speaker Identifica-
`tion Using Gaussian Mixture Speaker Models”, JEEE Transactions
`on SpeechandAudio Processing, vol.3, No. 1, pp. 72-83 (Jan. 1995).
`Nievergelt, J., et al, “The Grid File: As Adaptable, Symmetric
`Mullikey File Structure,” ACM Transactions on Database Systems,
`vol. 9, No. 1, pp. 38-71 (Mar. 1984).
`Heintze, N., “Scalable Document Fingerprinting,” Proc, USENIX
`Workshop on Electronic Commerce (1996).
`Wold, E., et at., “Content-Based Classification, Search, and Retrieval
`of Audio,” IEEE Multimedia, vol. 3, Issue 3, pp. 27-63 (1996).
`Bhanu,B., et al., “Learning Feature Relevance and Similarity Metrics
`in Image Databases”, Proceedings of the IEEE Workshop on Con-
`tent—Based Access ofImage and Video Libraries, pp. 14-19 (1998).
`Del Bimbo, A., et al
`, “Using Weighted Spatial Relationships in
`Retrieval by Visual Contents”, Image Description and Retrieval. pp.
`161-192 (1998).
`Indyk, P., and Motwani, R., “Approximate Nearest Neighbors:
`Towards Removing the Curse of Dimensionality,” Proceeding ofthe
`Thirtieth Annual ACM Symposium on Theory of Computing, pp.
`604-613 (1998).
`La Cascia, M., et al , “Combining Textual and Visual Cues for
`Content-based Image Retrieval on the World Wide Web”. Proceed-
`ings ofthe IEEE Workshop on Content-Based Access ofImage and
`Video Libraries, pp. 24-29 (1998).
`Yianilos, N. P., “Excluded Middle Vantage Point Forests for Nearest
`Neighbor
`Search,” DIMACS
`Implementation
`Challenge,
`ALENEX’99 (1999),
`Yoshitaka,A., et al., “A Survey on Content-Based Retrieval for Mul-
`timedia Databases”, IEEE Transactions on Knowledge and Data
`Engineering, vol. 11, No. 1, pp. 81-93 (Jan./Feb. 1999).
`Lawrence, S., et al., “Digital Libraries and Automonous Citation
`Indexing,” JEEE Computer, pp. 67-71 Gun. 1999).
`Yianilos, N. P., “Locally Lifting the Curse of Dimensionality for
`Nearest Neighbor Search,” Symposium on Discrete Algorithms, Pro-
`ceeding ofthe Eleventh Annual ACM-SIAM symposium on Discrete
`Algorithms, pp. 361-370 (2000).
`Kimura,A., et al., “Very Quick Audio Searching: Introducing Global
`Pruning to the Time-Series Active Search,” IEEE Conf. on Acoustics,
`Speech and Signal Processing, (ICASSP ’01), vol, 3, pp. 1429-1432
`(2001).
`Chavez, E., ct al., “Searching in Metric Spaces”, (Sep. 2001) ACM
`Computing Swveys, vo\. 33, No. 3. pp. 273-321 (Sep. 2001).
`Haitsma,J., et al., “Robust Audio Hashing for ContentIdentification,
`Int?” Workshop on ContentBasedMultimedia Indexing, Brescia. Italy
`(Sep. 19-21. 2001).
`Haitsma, J., and Walker, T., “A Highly Robust Audio Fingerprinting
`System,” Journal ofNew Music Research, 1744-5027, vol. 32, Issue
`2, pp. 211-221 (2003).
`Schleimer, Saul,et al., ““Winnowing: Local Algorithms for Document
`Fingerprinting ACM SIGMOD”(Jun. 9-12, 2003).
`“Scarching Near-Replicas of Images via Clustering” Edward Chang,
`Chen Ti, James Wang, Peter Mork, Gio Wiederhold Proc. SPIF.
`Symposium ofVoice, Video, and Data Communications, 1999.
`
`*
`
`AAAAAAAAAAAAAAAAAAAAB
`
`5,629,739
`5,692,213
`5,701,452
`5,701,542
`5,724,605
`5,745,900
`5,798,785
`5,850,490
`5,918,223
`5,953,415
`6,006,256
`6,011,758
`6,026,439
`6,044,402
`6,052,693
`6,061,056
`6,088,455
`6,088,707
`6,118,450
`6,119,124
`6,169,986
`6,173,406
`6,240,409
`6,243,725
`6,247,133
`6,253,193
`6,263,348
`6,330,593
`6,345,256
`6,349,296
`6,360,215
`6,363,377
`6,374,225
`6,381,601
`6,385,596
`6,408,128
`6,418,421
`6,449,226
`6,452,874
`6,477,704
`6,496,802
`6,505,160
`6,550,001
`6,550,011
`6,577,746
`6,591,245
`6,598,228
`6,609,105
`6,654,757
`6,665,661
`6,675,174
`6,834,308
`6,873,982
`6,931,451
`6,941,275
`6,973,461
`6,978,419
`6,990,453
`7,013,301
`7,058,223
`7,106,904
`7,155,449
`7,158,929
`7,168,083
`7,302,574
`7.366.718
`7,421,723
`7,477,739
`7,523,312
`7,587,728
`7,647,604
`7,650,616
`7,757,248
`2001/0001160
`200 1/0003818
`2002/0023020
`2002/0032698
`2002/0120925
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 14 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 14 of 128
`
`US 8,010,988 B2
`Page 3
`
`“Rime: A Replicated Image Detector for the World-Wide Web”
`Edward Y. Chang, James Ze Wang, Chen Li, and Gio Wiederhold,
`SPIE 1998.
`“Safeguarding and charging for information on the internet,” H.
`Garcia-Molina, S. Ketchpel, and N. Shivakumar, Proceedings of
`ICDE, 1998.
`“Copy deteclion mechanismsfor digital documents,” S. Brin and H.
`Garcia-Molina, Proceedings of ACM SIG-MOD,May 1995.
`“The x-tree: An index structure for high-dimensional data,” S.
`Berchtold, Proceedings of the 22nd VLDB,Aug. 1996.
`“The sr-tree: An index structure for high-dimensional nearest neigh-
`bor queries,” N. Katayama and S. Satoh, Proceedings of ACM
`SIGMOD,May 1997.
`“The k-d-b-tree: A search structure for large multidimensional
`dynamic indexes,” J. T. Robinson, Proceedings of ACM SIGMOD,
`Apr. 1981.
`“Query by image and video content: the QBIC system,” M.Flickner,
`H. Sawhney, W. Niblack, J. Ashley, Q. Huang, and et al, IEEE
`Computer 28(9), pp. 23{32, 1995.
`“Visual informationretrieval,” A. Gupta and R. Jain, Communica-
`tions of the ACM 40(5), pp. 69-79, 1997.
`“Visualseek: A fully automated content-based image query system,”
`J, R. Smith and S.-F. Chang, ACM Multimedia Conference, 1996.
`“Similarity indexing: Algorithms and performance,” D. A. White and
`R.Jain, Proc. SPIE vol. 2670, San Diego, 1996.
`“The r*-tree: an efficient and robust access method for points and
`rectangles,’ N. Beckmann, H.-P. Kriegel, R. Schneider, and B.
`Seeger, Proceedings ofACM Sigmod, May 1990.
`
`“R-trees: a dynamic index structure for spatial searching.” A. Gutt-
`man, Proceedings of ACM Sigmod, Jun. 1984.
`“Similarity indexing with the ss-trec,” D. A. White and R. Jain,
`Proceedings of the 12th ICDE, Feb. 1996.
`“The tv-tree: an index structure for high-dimensional data,’ K.-L.
`Lin, H. V. Jagadish, and C. Faloutsos, VLDB Journal 3 (4), 1994.
`“M-tree: An efficient access method for similarity search in metric
`spaces,” P. Ciaccia, M. Patella, and P. Zezula, Proceedings ofthe 23rd
`VLDB, Aug. 1997.
`“Nearest neighbor queries,” N. Roussopoulos, S. Kelley, and F.
`Vincent, Proceedings of ACM Sigmod , May 1995.
`“An extensible hashing index for high-dimensional similarity
`search.” C. Li, E. Chang, and J. Z. Wang, Stanford Technical
`Report , Aug. 1998. [NOT AVAILABLE].
`“Two algorithms for nearest-neighbor search in high dimensions”J.
`M.Kleinberg, Proc 29th STOC, 1997.
`“A Density-Based Algorithm for Discovering Clusters in Large Spa-
`lial Databases with Noise” Martin Ester, Hans-Peler Kriegel, Jérg
`Sander, Xiaowei Xu Proceedings of 2nd International Conference on
`Knowledge Discovery and Data Mining (KDD-96), 1996.
`“Adaptive Color Image Embeddings for Database Navigation”Yossi
`Rubner, Carlo Tomasi and Leonidas J. Guibas, Proceedings of the
`1998 IEEE Asian Conference on Computer Vision.
`A Quantitative Analysis and Performance Study for Similarity-
`Search Methods in High-Dimensional Spaces R. Weber, H-J Schek,
`S. Blott Proc., 24th VLDB Conf. 1998.
`
`* cited by examiner
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 15 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 15 of 128
`
`U.S. Patent
`
`Aug. 30, 2011
`
`Sheet 1 of 10
`
`US 8,010,988 B2
`
`WORK @t1
`
`WORK @t2
`
`
` FEATURE
`
`
`
`(VECTOR) EXTRACTION
`OPERATION(S)
`
`
`120
`
`
`
`
`FEATURE
`EXTRACTION
`
`OPERATION(S
`140
`
`FEATURE TO
`WORKID
`TAGGING
`OPERATION(S
`
`
`
`
`124
`
`DATABASE
`GENERATION
`OPERATION(S)
`
`INFORMATION
`
`150
`
`
` FEATURE
`
`
`
`(VECTOR) LOOKUP
`OPERATION(S)
`
`
`WORK-ASSOCIATED
`INFORMATION LOOKUP
`OPERATION(S)
`
`WID-ACTION
`
`DATABASE
`GENERATION
`OPERATION(S)
`
`
`WORK ID|ASSOCIATED INFORMATION (e.g., ACTION)
`
`
`OPERATION(S)
`
`ACTION
`INITIATION
`
`170
`
`
`
`100
`
`FIGURE1
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 16 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 16 of 128
`
`U.S. Patent
`
`Aug. 30, 2011
`
`Sheet 2 of 10
`
`US 8,010,988 B2
`
`SATELLITE, CABLE |aOR TERRESTRIAL
`
`TV BROADCAST
`USER COMPUTER,
`
`SET-TOP-BOX OR
`EQUIVALENT
`
`
`
`
`
`
`
`FEATURE
`230
`
`(VECTOR)
`
`EXTRACTION
`OPERATION(S
`
` FEATURE
`
`(VECTOR) LOOKUP
`OPERATION(S)
`
`
`[ MONITORINGCENTER
`|
`|
`120a/138al
`
`
`DATABASE
`
`GENERATION
`
`
`ASSOCIATED
`INFORMATION
`LOOKUP
`
`
`
`
`
`ACTION
`INITIATION
`OPERATION(S)
`
`
`
`
`210
`
`FIGURE2
`
`| | | | |
`
`| |
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 17 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 17 of 128
`
`U.S. Patent
`
`Aug.30, 2011
`
`Sheet3 of 10
`
`US 8,010,988 B2
`
`[ OT
`SATELLITE, CABLE
`OR TERRESTRIAL
`320
`TV BROADCAST
`
`
`
`]
`
`USER COMPUTER,
`SET-TOP-BOX OR
`EQUIVALENT
`
`
`
` FEATURE
`
`
`
`(VECTOR)
`EXTRACTION
`
`
`OPERATION(S
`
` DATABASE
`
` FEATURE
`
`
`(VECTOR) LOOKUP
`
`OPERATION(S)
`
`
`ACTION
`
`
`INITIATION
`OPERATION(S)
`
`
`
`
`
`
`DATABASE
`
`GENERATION
`
`
`WORK-ASSOCIATED
`
`OPERATION(S)
`INFORMATION LOOKUP
`
`
`
`
`OPERATION(S) FIGURE3
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 18 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 18 of 128
`
`U.S. Patent
`
`Aug. 30, 2011
`
`Sheet 4 of 10
`
`US 8,010,988 B2
`
`SATELLITE, CABLE
`|rr
`420
`OR TERRESTRIAL
`
`
`TV BROADCAST
`USER COMPUTER,
`SET-TOP-BOX OR
`EQUIVALENT
`
`140¢
`
`
`FEATURE
`
`ACTION
`
`(VECTOR)
`INITIATION
`
`
`
`EXTRACTION
`OPERATION(S)
`
`OPERATION(S
`
`ont”
`
`170c
`
`
`
`
`FEATURE
`WORK-ASSOCIATED
`INFORMATION LOOKUP
`
`
`
`(VECTOR) LOOKUP
`OPERATION(S)
`OPERATION(S)
`
`
`
`a
`
`
`
`DATABASE
`
`GENERATION
`
`
`
`<>
`<>
`
`
`
`OPERATION(S)
`
`
`
`WID
`WIDAT
`DATABASE
`DATABASE
`
`
`
`
` MONITORING CENTER
`
`110¢
`
`
`
`—Sse——- —C——-
`
`130¢
`
`FIGURE 4
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 19 of 128
`Case 1:14-cv-02396-PGG-SN Document2 Filed 04/04/14 Page 19 of 128
`
`U.S. Patent
`
`Aug. 30, 2011
`
`Sheet 5 of 10
`
`US 8,010,988 B2
`
`WORK (WITH
`: WORK
`REAL-TIME (CENTRALIZED) MONITORING}
`
`FEATURE
`EXTRA-WORK
`140d
`
`
`
`
`INFOMRATION)\} (VECTOR) EXTRACTION
`OPERATION(S)
`S EXTRA-WORK
`
`INFORMATION
`150d
`
`
`
`FEATURE
`(VECTOR) LOOKUP
`OPERATION(S)
`
`
`
`INFORMATION
`
`
`
`INFORMATION
`
`i
`
`RELATED TO WORK
`
`538 560
`INFORMATION
`
`
`Sew emer ew treet en wetted rater eee eas cen e ee eran Len mene Been eee Oe eee seen nee Ren esemeeaaes
`
`
`
`
`EXTRA-WORK INFORMATION
`AGGREGATION OPERATION(S)
`
`
`540
`
`QUERY
`
`
`
`
`
`
`DATABASE
`GENERATION
`)- 520
`
`OPERATION(S
`
`QwiD
`
`INFORMATION
`
`LOOKUP
`a 514
`ee
`
`OPERATION(S)
`EXTRA-WORK
`550 INFORMATION (VECTOR)|WORK ID|~~~ 512
`
`
`
`
`WORK-ASSOCIATED
`INFORMATION LOOKUP
`
`
`
`OPERATION(S)
`
`DATABASE
`GENERATION
`OPERATION(S)
`
`WIDAT
`
`WORKID|ASSOCIATED INFORMATION(e.g., ACTION
`
`ACTION
`INITIATION
`
` 570
`OPERATION(S)
`
`
`
`
`FIGURE 5
`
`

`

`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 20 of 128
`Case 1:14-cv-02396-PGG-SN Document 2 Filed 04/04/14 Page 20 of 128
`
`U.S. Patent
`
`Aug. 30, 2011
`
`Sheet 6 of 10
`
`US 8,010,988 B2
`
`|ET
`SATELLITE, CABLE
`520
`OR TERRESTRIAL
`
`
`TV BROADCAST
`USER COMPUTER,
`
`SET-TOP-BOX OR
`
`EQUIVALENT
`
`610
`
`
`
`570a
`
`
`ACTION
`
`INITIATION
`
`
`
`OPERATION(S)
`OPERATION(S)
`
`
`
`
`WORK-ASSOCIATED
`INFORMATION LOOKUP
`
`
`
`
`WID
`DATABASE
`
`
`
` §20a/5