Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 19 of 160 Page ID
` #:6135
`111111
`1111111111111111111111111111111111111111111111111111111111111
`US009286941B2
`
`c12) United States Patent
`Sandrew et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,286,941 B2
`*Mar. 15, 2016
`
`(54)
`
`IMAGE SEQUENCE ENHANCEMENT AND
`MOTION PICTURE PROJECT
`MANAGEMENT SYSTEM
`
`(58) Field of Classification Search
`None
`See application file for complete search history.
`
`(71) Applicant: LEGEND3D, Inc., Carlsbad, CA (US)
`
`(72)
`
`Inventors: Barry Sandrew, San Diego, CA (US);
`Tony Baldridge, San Diego, CA (US);
`Jared Sandrew, San Diego, CA (US);
`Anthony Lopez, San Diego, CA (US)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2,593,925 A
`2,799,722 A
`
`4/1952 Sheldon
`7/1957 Neugebauer
`(Continued)
`
`(73) Assignee: LEGEND3D, Inc., Carlsbad, CA (US)
`
`FOREIGN PATENT DOCUMENTS
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 14/709,300
`
`(22) Filed:
`
`May 11,2015
`
`(65)
`
`Prior Publication Data
`
`US 2015/0243324 AI
`
`Aug. 27, 2015
`
`Related U.S. Application Data
`
`(60)
`
`Continuation-in-part of application No. 13/366,899,
`filed on Feb. 6, 2012, now Pat. No. 9,031,383, which is
`a continuation-in-part of application No. 13/029,862,
`filed on Feb. 17, 2011, now Pat. No. 8,385,684, which
`
`(Continued)
`
`(51)
`
`(52)
`
`(2006.01)
`(2006.01)
`(2006.01)
`
`Int. Cl.
`H04N5193
`GllB 271031
`H04N 13102
`U.S. Cl.
`CPC ............ GllB 271031 (2013.01); H04N 131026
`(2013.01); H04N 1310257 (2013.01); H04N
`1310267 (2013.01)
`
`DE
`DE
`
`6/1986
`003444353
`12/1986
`003444353
`(Continued)
`OTHER PUBLICATIONS
`"Nintendo DSi Uses Camera Face Tracking to Create 3D Mirages",
`retrieved from www.Gizmodo.com on Mar. 18, 2013, 3 pages.
`(Continued)
`
`Primary Examiner- Heather Jones
`(74) Attorney, Agent, or Firm- Arc IP Law, PC; Joseph J.
`Mayo
`
`ABSTRACT
`(57)
`The system enables conversion of black and white images to
`color images and/or two-dimensional images into three-di(cid:173)
`mensional images based on adding color and/or depth to
`images using masks for regions in the images, as well as
`reshaping of masks to cover objects that have moved and
`changed shape as the objects move in a sequence of images.
`Also, includes motion picture project management system for
`reviewers, coordinators and artists. Artists utilize image
`analysis and image enhancement and computer graphics pro(cid:173)
`cessing for example to convert two-dimensional images into
`three-dimensional images or otherwise create or alter motion
`pictures. Enables the efficient management of projects related
`to motion pictures to enable enterprises to manage assets,
`control costs, predict budgets and profit margins, reduce
`archival storage and otherwise provide displays tailored to
`specific roles to increase worker efficiency.
`30 Claims, 103 Drawing Sheets
`(75 of 103 Drawing Sheet(s) Filed in Color)
`
`Background !
`I
`Mask
`... ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
`··"·,~:::~.,,_,. <----------L ___ ~0~~~~~~~---J
`
`" -<=---------~ M-Objects
`
`Isolated
`Background
`
`Exhibit A
`Page 001
`
`Prime Focus Ex 1031-1
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 20 of 160 Page ID
` #:6136
`
`US 9,286,941 B2
`Page 2
`
`Related U.S. Application Data
`
`is a continuation-in-part of application No. 12/976,
`970, filed on Dec. 22, 2010, now Pat. No. 8,401,336,
`which is a continuation-in-part of application No.
`12/913,614, filed on Oct. 27,2010, now Pat. No. 8,396,
`328, which is a continuation-in-part of application No.
`12/542,498, filed on Aug. 17, 2009, now Pat. No.
`7,907,793, which is a continuation-in-part of applica-
`tion No. 12/032,969, filed on Feb. 18, 2008, now Pat.
`No. 7,577,312, which is a continuation of application
`No. 11/324,815, filed on Jan. 4, 2006, now Pat. No.
`7,333,670, which is a division of application No.
`10/450,970, filed as application No. PCT/US02/14192
`on May 6, 2002, now Pat. No. 7,181,081.
`
`(60) Provisional application No. 60/288,929, filed on May
`4, 2001.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2,804,500 A
`2,874,212 A
`2,883,763 A
`2,974,190 A
`3,005,042 A
`3,258,528 A
`3,486,242 A
`3,551,589 A
`3,558,811 A
`3,560,644 A
`3,595,987 A
`3,603,962 A
`3,612,755 A
`3,617,626 A
`3,619,051 A
`3,621,127 A
`3,647,942 A
`3,673,317 A
`3,705,762 A
`3,706,841 A
`3,710,011 A
`3,731,995 A
`3,737,567 A
`3,742,125 A
`3,761,607 A
`3,769,458 A
`3,770,884 A
`3,770,885 A
`3,772,465 A
`3,784,736 A
`3,848,856 A
`3,851,955 A
`3,971,068 A
`3,972,067 A
`4,017,166 A
`4,021,841 A
`4,021,846 A
`4,054,904 A
`4,149,185 A
`4,168,885 A
`4,183,046 A
`4,183,633 A
`4,189,743 A
`4,189,744 A
`4,235,503 A
`4,258,385 A
`4,318,121 A
`4,329,710 A
`4,334,240 A
`4,436,369 A
`4,475,104 A
`4,544,247 A
`4,549,172 A
`
`8/1957 Giacoletto
`2/1959 Bechley
`4/1959 Schaper
`3/1961 Geiger
`10/1961 Horsley
`6/1966 Oppenheimer
`12/1969 Aronson
`12/1970 Moskovitz
`111971 Barton eta!.
`2/1971 Palmer eta!.
`7/1971 Vlahos
`9/1971 Lechner
`10/1971 Tadlock
`1111971 Bluth et al.
`1111971 Wright
`1111971 Hope
`3/1972 Siegel eta!.
`6/1972 Newell eta!.
`12/1972 Ladd eta!.
`12/1972 Novak
`111973 Altemus et a!.
`5/1973 Reiffel
`6/1973 Kratomi
`6/1973 Siegel
`9/1973 Hanseman
`10/1973 Driskell
`1111973 Curran eta!.
`1111973 Curran eta!.
`1111973 Vlahos eta!.
`111974 Novak
`1111974 Reeber eta!.
`12/1974 Kent et al.
`7/1976 Gerhardt et a!.
`7/1976 Peters
`4/1977 Kent et al.
`5/1977 Weinger
`5/1977 Roese
`10/1977 Saitoh eta!.
`4/1979 Weinger
`9/1979 Kent et al.
`111980 Dalke eta!.
`111980 Kent et al.
`2/1980 Schure eta!.
`2/1980 Stern
`1111980 Condon
`3/1981 Greenberg et al.
`3/1982 Taite eta!.
`5/1982 Taylor
`6/1982 Franklin
`3/1984 Bukowski
`10/1984 Shen
`10/1985 Ohno
`10/1985 Welk
`
`4,558,359 A
`4,563,703 A
`4,590,511 A
`4,600,919 A
`4,603,952 A
`4,606,625 A
`4,608,596 A
`4,617,592 A
`4,642,676 A
`4,645,459 A
`4,647,965 A
`4,694,329 A
`4,697,178 A
`4,700,181 A
`4,721,951 A
`4,723,159 A
`4,725,879 A
`4,755,870 A
`4,758,908 A
`4,760,390 A
`4,774,583 A
`4,794,382 A
`4,809,065 A
`4,827,255 A
`4,847,689 A
`4,862,256 A
`4,888,713 A
`4,903,131 A
`4,918,624 A
`4,925,294 A
`4,933,670 A
`4,952,051 A
`4,965,844 A
`4,984,072 A
`5,002,387 A
`5,038,161 A
`5,050,984 A
`5,055,939 A
`5,093,717 A
`5,177,474 A
`5,181,181 A
`5,185,852 A
`5,237,647 A
`5,243,460 A
`5,252,953 A
`5,262,856 A
`5,328,073 A
`5,341,462 A
`5,347,620 A
`5,363,476 A
`5,402,191 A
`5,428,721 A
`5,481,321 A
`5,495,576 A
`5,528,655 A
`5,534,915 A
`5,668,605 A
`5,673,081 A
`5,682,437 A
`5,684,715 A
`5,699,443 A
`5,699,444 A
`5,717,454 A
`5,729,471 A
`5,734,915 A
`5,739,844 A
`5,742,291 A
`5,748,199 A
`5,767,923 A
`5,777,666 A
`5,778,108 A
`5,784,175 A
`5,784,176 A
`5,808,664 A
`5,825,997 A
`5,835,163 A
`5,841,512 A
`5,867,169 A
`5,880,788 A
`
`12/1985 Kuperman et a!.
`111986 Taylor
`5/1986 Bocchi eta!.
`7/1986 Stern
`8/1986 Sybenga
`8/1986 Geshwind
`8/1986 Williams et a!.
`10/1986 MacDonald
`2/1987 Weinger
`2/1987 Graf et al.
`3/1987 Imsand
`9/1987 Belmares-Sarabia et a!.
`9/1987 Heckel
`10/1987 Maine et al.
`111988 Holler
`2/1988 Imsand
`2/1988 Eide et al.
`7/1988 Markle et al.
`7/1988 James
`7/1988 Maine et al.
`9/1988 Kellar eta!.
`12/1988 Lai eta!.
`2/1989 Harris et al.
`5/1989 Ishii
`7/1989 Yamamoto et a!.
`8/1989 Markle et al.
`12/1989 Falk
`2/1990 Lingemann et a!.
`4/1990 Moore eta!.
`5/1990 Geshwind et a!.
`6/1990 Wislock:i
`8/1990 Lovell eta!.
`10/1990 Oka eta!.
`111991 San drew
`3/1991 Baljet eta!.
`8/1991 Ki
`9/1991 Geshwind
`10/1991 Karamon et a!.
`3/1992 San drew
`111993 Kadota
`111993 Glynn
`2/1993 Mayer
`8/1993 Roberts et a!.
`9/1993 Kornberg
`10/1993 Sandrew et a!.
`1111993 Lippman et al.
`7/1994 Blanding et al.
`8/1994 Obata
`9/1994 Zimmer
`1111994 Kurashige et a!.
`3/1995 Dean eta!.
`6/1995 Sato et al.
`111996 Lipton
`2/1996 Ritchey
`6/1996 Umetani eta!.
`7/1996 San drew
`9/1997 N achshon et al.
`9/1997 Yamashita et al.
`10/1997 Okino eta!.
`1111997 Palmer
`12/1997 Murata et al.
`12/1997 Palm
`2/1998 Adolphi et al.
`3/1998 Jain eta!.
`3/1998 Roewer
`4/1998 Kuwano eta!.
`4/1998 Palm
`5/1998 Palm
`6/1998 Coleman
`7/1998 Tanase eta!.
`7/1998 Coleman
`7/1998 Lee
`7/1998 Narita
`9/1998 Yamashita et al.
`10/1998 Yamada et a!.
`1111998 Liou eta!.
`1111998 Goodhill
`2/1999 Prater
`3/1999 Bregler
`
`Exhibit A
`Page 002
`
`Prime Focus Ex 1031-2
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 21 of 160 Page ID
` #:6137
`
`US 9,286,941 B2
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,899,861 A
`5,907,364 A
`5,912,994 A
`5,920,360 A
`5,929,859 A
`5,940,528 A
`5,959,697 A
`5,973,700 A
`5,973,831 A
`5,982,350 A
`5,990,900 A
`5,990,903 A
`5,999,660 A
`6,005,582 A
`6,011,581 A
`6,014,473 A
`6,023,276 A
`6,025,882 A
`6,031,564 A
`6,049,628 A
`6,056,691 A
`6,067,125 A
`6,086,537 A
`6,088,006 A
`6,091,421 A
`6,102,865 A
`6,108,005 A
`6,118,584 A
`6,119,123 A
`6,132,376 A
`6,141,433 A
`6,157,747 A
`6,166,744 A
`6,173,328 B1
`6,184,937 B1
`6,198,484 B1
`6,201,900 B1
`6,208,348 B1
`6,211,941 B1
`6,215,516 B1
`6,222,948 B1
`6,226,015 B1
`6,228,030 B1
`6,263,101 B1
`6,271,859 B1
`6,314,211 B1
`6,329,963 B1
`6,337,709 B1
`6,360,027 B1
`6,363,170 B1
`6,364,835 B1
`6,373,970 B1
`6,390,980 B1
`6,405,366 B1
`6,414,678 B1
`6,416,477 B1
`6,426,750 B1
`6,429,867 B1
`6,445,816 B1
`6,456,340 B1
`6,466,205 B2
`6,474,970 B1
`6,477,267 B1
`6,492,986 B1
`6,496,598 B1
`6,509,926 B1
`6,515,659 B1
`6,535,233 B1
`6,553,184 B1
`6,590,573 B1
`6,606,166 B1
`6,611,268 B1
`6,650,339 B1
`6,662,357 B1
`6,665,798 B1
`
`5/1999 F riemel et a!.
`5/1999 F uruhata et a!.
`6/1999 Norton eta!.
`7/1999 Coleman
`7/1999 Meijers
`8/1999 Tanaka eta!.
`9/1999 Coleman
`10/1999 Taylor eta!.
`10/1999 Kleinberger et a!.
`1111999 Hekmatpour et a!.
`1111999 Seago
`1111999 Donovan
`12/1999 Zorin et al.
`12/1999 Gabriel et a!.
`112000 Swift eta!.
`112000 Hossack eta!.
`2/2000 Kawai et al.
`2/2000 Geshwind
`2/2000 Maetal.
`4/2000 Chen eta!.
`5/2000 Urbano eta!.
`5/2000 May
`7/2000 Urbano eta!.
`7/2000 Tabata
`7/2000 Terrasson
`8/2000 Hossack eta!.
`8/2000 Starks eta!.
`9/2000 Van Berkel et a!.
`9/2000 Elenbaas et a!.
`10/2000 Hossack eta!.
`10/2000 Moedetal.
`12/2000 Szelisk:i
`12/2000 Jaszlics eta!.
`112001 Sato
`2/2001 Williams et a!.
`3/2001 Kameyama
`3/2001 Hossack eta!.
`3/2001 Kaye
`4/2001 Erland
`4/2001 Maetal.
`4/2001 Hossack eta!.
`5/2001 Danneels et al.
`5/2001 Urbano eta!.
`7/2001 Klein et al.
`8/2001 Asente
`1112001 Kim eta!.
`12/2001 Chiabrera
`112002 Y amaashi et a!.
`3/2002 Hossack eta!.
`3/2002 Seitz eta!.
`4/2002 Hossack eta!.
`4/2002 Dong et al.
`5/2002 Peterson et a!.
`6/2002 Lorenz eta!.
`7/2002 Goddard et a!.
`7/2002 Jago
`7/2002 Hoppe
`8/2002 Deering
`9/2002 Pettigrew
`9/2002 Margulis
`10/2002 Simpson eta!.
`1112002 Caldoro
`1112002 Richards
`12/2002 Metaxas et a!.
`12/2002 Harman
`112003 Mills eta!.
`2/2003 Kaye eta!.
`3/2003 Smith
`4/2003 Ando et al.
`7/2003 Geshwind
`8/2003 Knoll
`8/2003 Szelisk:i eta!.
`1112003 Silva eta!.
`12/2003 Bowman-Amuah
`12/2003 McNally eta!.
`
`112004 Yamamoto
`6,677,944 B1
`2/2004 Ito et al.
`6,686,591 B2
`2/2004 Kaye
`6,686,926 B1
`3/2004 Aman eta!.
`6,707,487 B1
`4/2004 Randall
`6,727,938 B1
`5/2004 Petrovic et a!.
`6,737,957 B1
`6/2004 Wada et al.
`6,744,461 B1
`6,765,568 B2
`7/2004 Swift et al.
`9/2004 Matusik et al.
`6,791,542 B2
`9/2004 Jones eta!.
`6,798,406 B1
`6,813,602 B2
`1112004 Thyssen
`112005 Kouri eta!.
`6,847,737 B1
`2/2005 Hoflberg
`6,850,252 B1
`2/2005 Duquesnois
`6,853,383 B2
`6,859,523 B1
`2/2005 Jilk et al.
`7/2005 Cheiky eta!.
`6,919,892 B1
`1112005 Samaniego et a!.
`6,964,009 B2
`1112005 Lee eta!.
`6,965,379 B2
`12/2005 Miller
`6,973,434 B2
`112006 Han eta!.
`6,985,187 B2
`7,000,223 B1
`2/2006 Knutson et a!.
`2/2006 Hoflberg eta!.
`7,006,881 B1
`4/2006 Cheiky eta!.
`7,027,054 B1
`4/2006 Novaket a!.
`7,032,177 B2
`4/2006 Harman et al.
`7,035,451 B2
`7/2006 Connor eta!.
`7,079,075 B1
`8/2006 Petrovic et a!.
`7,098,910 B2
`7,102,633 B2
`9/2006 Kaye eta!.
`9/2006 Marcellini et a!.
`7,110,605 B2
`10/2006 Kaye eta!.
`7,116,323 B2
`10/2006 Kaye eta!.
`7,116,324 B2
`10/2006 Fischer et al.
`7,117,231 B2
`1112006 Hamburg
`7,136,075 B1
`7,181,081 B2 * 2/2007 San drew ....................... 382/254
`7,190,496 B2
`3/2007 Klug eta!.
`7,254,264 B2
`8/2007 Naske eta!.
`7,254,265 B2
`8/2007 Naske eta!.
`7,260,274 B2
`8/2007 Sawhney et al.
`7,272,265 B2
`9/2007 Kouri eta!.
`7,298,094 B2
`1112007 Yui
`7,308,139 B2
`12/2007 Wentland eta!.
`112008 Naske
`7,321,374 B2
`7,327,360 B2
`2/2008 Petrovic et a!.
`7,333,519 B2
`2/2008 Sullivan et a!.
`7,333,670 B2 * 2/2008 San drew ....................... 382/254
`7,343,082 B2
`3/2008 Cote eta!.
`7,461,002 B2
`12/2008 Crockett et a!.
`3/2009 Criminisi et a!.
`7,512,262 B2
`7,519,990 B1
`4/2009 Xie
`7,532,225 B2
`5/2009 Fukushima et a!.
`7,538,768 B2
`5/2009 Kiyokawa et a!.
`7,542,034 B2
`6/2009 Spooner et a!.
`7,558,420 B2
`7/2009 Era
`7,573,475 B2
`8/2009 Sullivan et a!.
`7,573,489 B2
`8/2009 Davidson et a!.
`7,576,332 B2
`8/2009 Britten
`7,577,312 B2
`8/2009 San drew
`7,610,155 B2
`10/2009 Timmis eta!.
`7,624,337 B2
`1112009 Sull eta!.
`7,630,533 B2
`12/2009 Ruth eta!.
`7,663,689 B2
`2/2010 Marks
`7,665,798 B2
`2/2010 Hsia et al.
`7,680,653 B2
`3/2010 Yeldener
`7,772,532 B2
`8/2010 Olsen eta!.
`7,852,461 B2
`12/2010 Yahav
`7,860,342 B2
`12/2010 Levien eta!.
`7,894,633 B1
`2/2011 Harman
`7,940,961 B2
`5/2011 Allen
`8,036,451 B2
`10/2011 Redert eta!.
`8,085,339 B2
`12/2011 Marks
`8,090,402 B1
`112012 Fuji saki
`8,194,102 B2
`6/2012 Cohen
`8,213,711 B2
`7/2012 Tam eta!.
`8,217,931 B2
`7/2012 Lowe et al.
`8,244,104 B2
`8/2012 Kashiwa
`8,320,634 B2
`1112012 Deutsch
`8,384,763 B2
`2/2013 Tam eta!.
`3/2013 Baldridge et a!.
`8,401,336 B2
`8,462,988 B2
`6/2013 Boon
`
`Exhibit A
`Page 003
`
`Prime Focus Ex 1031-3
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 22 of 160 Page ID
` #:6138
`
`US 9,286,941 B2
`Page 4
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8,488,868 B2
`8,526,704 B2
`8,543,573 B2
`8,634,072 B2
`8,670,651 B2
`8,698,798 B2
`8,907,968 B2
`8,922,628 B2
`200110025267 A1
`200110051913 A1
`2002/0001045 A1
`2002/0048395 A1
`2002/0049778 A1
`2002/0063780 A1
`2002/0075384 A1
`2003/0018608 A1
`2003/0046656 A1
`2003/0069777 A1
`2003/0093790 A1
`2003/0097423 A1
`2003/0154299 A1
`2003/0177024 A1
`2004/0004616 A1
`2004/0062439 A1
`2004/0130680 A1
`2004/0151471 A1
`2004/0181444 A1
`2004/0189796 A1
`2004/0258089 A1
`2005/0083421 A1
`2005/0088515 A1
`2005/0104878 A1
`2005/0146521 A1
`2005/0188297 A1
`2005/0207623 A1
`2005/0231501 A1
`2005/0231505 A1
`2005/0280643 A1
`2006/0028543 A1
`2006/0061583 A1
`2006/0083421 A1
`2006/0143059 A1
`2006/0159345 A1
`2006/0274905 A1
`2007/0052807 A1
`2007/0236514 A1
`2007/0238981 A1
`2007/0260634 A1
`2007/0279412 A1
`2007/0279415 A1
`2007/0286486 A1
`2007/0296721 A1
`2008/0002878 A1
`2008/0044155 A1
`2008/0079851 A1
`2008/0117233 A1
`2008/0147917 A1
`2008/0162577 A1
`2008/0181486 A1
`2008/0225040 A1
`2008/0225042 A1
`2008/0225045 A1
`2008/0225059 A1
`2008/0226123 A1
`2008/0226128 A1
`2008/0226160 A1
`2008/0226181 A1
`2008/0226194 A1
`2008/0227075 A1
`2008/0228449 A1
`2008/02467 59 A1
`2008/0246836 A1
`2008/0259073 A1
`2009/0002368 A1
`2009/0033741 A1
`
`7/2013 Tamet a!.
`9/2013 Dobbe
`9/2013 MacPherson
`112014 Trainer
`3/2014 Sakuragi et a!.
`4/2014 Murray eta!.
`12/2014 Tanaka eta!.
`12/2014 Bond
`9/2001 Janiszewski
`12/2001 Vashistha et a!.
`112002 Ranganath et a!.
`4/2002 Harman eta!.
`4/2002 Bell
`5/2002 Harman eta!.
`6/2002 Harman
`112003 Rice
`3/2003 Saxena
`4/2003 Or-Bach
`5/2003 Logan et al.
`5/2003 Ozawa eta!.
`8/2003 Hamilton
`9/2003 Tsuchida
`112004 Konyaet a!.
`4/2004 Cahill eta!.
`7/2004 Zhou eta!.
`8/2004 Ogikubo
`9/2004 San drew
`9/2004 Ho eta!.
`12/2004 Derechin et al.
`4/2005 Berezin et a!.
`4/2005 Geng
`5/2005 Kaye eta!.
`7/2005 Kaye eta!.
`8/2005 Knight eta!.
`9/2005 Liu eta!.
`10/2005 Nitawaki
`10/2005 Kaye eta!.
`12/2005 Chen
`2/2006 Sohn eta!.
`3/2006 Spooner et al.
`4/2006 Weiguo eta!.
`6/2006 San drew
`7/2006 Clary et al.
`12/2006 Lindahl et a!.
`3/2007 Zhou eta!.
`10/2007 Agusanto et a!.
`10/2007 Zhu eta!.
`1112007 Makela eta!.
`12/2007 Davidson et al.
`12/2007 Sullivan et a!.
`12/2007 Goldstein
`12/2007 Chang et al.
`112008 Meiyappan
`2/2008 Kuspa
`4/2008 Stanger et a!.
`5/2008 Mather eta!.
`6/2008 Lees et al.
`7/2008 Fukuda et al.
`7/2008 Spooner et al.
`9/2008 Simmons eta!.
`9/2008 Birtwistle et a!.
`9/2008 Birtwistle
`9/2008 Lowe et al.
`9/2008 Birtwistle et a!.
`9/2008 Birtwistle
`9/2008 Birtwistle et a!.
`9/2008 Birtwistle et a!.
`9/2008 Birtwistle et a!.
`9/2008 Poor et al.
`9/2008 Birtwistle et a!.
`10/2008 Summers
`10/2008 Lowe et al.
`10/2008 Lowe et al.
`112009 Vitikainen et a!.
`2/2009 Oh eta!.
`
`2009/0116732 A1
`2009/0219383 A1
`2009/0256903 A1
`2009/02907 58 A1
`2009/0303204 A1
`2010/0045666 A1
`2010/0166338 A1
`2010/0259610 A1
`201110050864 A1
`201110074784 A1
`201110164109 A1
`201110169827 A1
`201110169914 A1
`201110188773 A1
`201110227917 A1
`201110273531 A1
`2012/0032948 A1
`2012/0039525 A1
`2012/0087570 A1
`2012/0102435 A1
`2012/0188334 A1
`2012/0274626 A1
`2012/0281906 A1
`2012/0306849 A1
`2013/0051659 A1
`2013/0234934 A1
`2014/0130680 A1
`2014/0169767 A1
`
`5/2009 Zhou eta!.
`9/2009 Passmore
`10/2009 Spooner et a!.
`1112009 Ng-Thow-Hing et al.
`12/2009 Nasiri
`2/2010 Kommann
`7/2010 Lee
`10/2010 Petersen
`3/2011 Bond
`3/2011 Turner et al.
`7/2011 Balderinge et al.
`7/2011 Spooner et a!.
`7/2011 Lowe et al.
`8/2011 Wei eta!.
`9/2011 Lowe et al.
`1112011
`Ito et al.
`2/2012 Lowe et al.
`2/2012 Tian eta!.
`4/2012 Seo eta!.
`4/2012 Han eta!.
`7/2012 Fortin eta!.
`1112012 Hsieh
`1112012 Appia
`12/2012 Steen
`2/2013 Yamamoto
`9/2013 Champion et a!.
`5/2014 Fin eta!.
`6/2014 Goldberg
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`GB
`JP
`JP
`JP
`JP
`JP
`KR
`KR
`RU
`su
`su
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`wo
`
`0302454
`1187494
`1719079
`2487039 A
`60-52190
`2002123842
`2003046982
`2004-207985
`2004207985
`20120095059
`20130061289
`2376632
`1192168 A
`1192168 A
`9724000
`9912127
`9930280
`0079781
`0101348
`0213143
`2006078237
`20070148219
`2008075276
`2011029209
`2012016600
`2013084234
`
`2/1989
`4/2004
`1112006
`1112012
`3/1985
`4/2002
`2/2003
`7/2004
`7/2004
`8/2012
`1112013
`12/1998
`9/1982
`1111982
`7/1997
`3/1999
`6/1999
`12/2000
`1/2001
`2/2002
`7/2006
`12/2007
`6/2008
`9/2011
`2/2012
`6/2013
`
`OTHER PUBLICATIONS
`
`Noll, Computer-Generated Three-Dimensional Movies, Computers
`and Automation, vol. 14, No. 11 (Nov. 1965), pp. 20-23.
`Noll, Stereo graphic Projections by Digital Computer, Computers and
`Automation, vol. 14, No.5 (May 1965), pp. 32-34.
`Australian Office Action issued for 2002305387, dated Mar. 15,
`2007, 2 page.
`Canadian Office Action, Dec. 28,2011, Appl No. 2,446,150, 4 pages.
`Canadian Office Action, Oct. 8, 2010, App. No. 2,446,150, 6 pages.
`Canadian Office Action, Jun. 13,2011, App. No. 2,446,150, 4 pages.
`Daniel L. Symmes, Three-Dimensional Image, Microsoft Encarta
`Online Encyclopedia (hard copy printed May 28, 2008 and of record,
`now indicated by the website indicated on the document to be dis-
`continued: http:/ I encarta.msn.corn/text_7615 847 46_0/Three-Di-
`mensional_Image.htrn).
`Declaration of Barbara Frederiksen in Support of In-Three, Inc's
`Opposition to Plaintiff's Motion for Preliminary Injunction, Aug. 1,
`2005, !max Corporation et alv. In-Three, Inc., Case No. CV05 1795
`FMC (Mcx). (25 pages).
`
`Exhibit A
`Page 004
`
`Prime Focus Ex 1031-4
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 23 of 160 Page ID
` #:6139
`
`US 9,286,941 B2
`Page 5
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Declaration of John Marchioro, Exhibit C, 3 pages, Nov. 2, 2007.
`Declaration of Michael F. Chou, Exhibit B, 12 pages, Nov. 2, 2007.
`Declaration of Steven K. Feiner, Exhibit A, 10 pages, Nov. 2, 2007.
`Di Zhong, Shih-Fu Chang, "AMOS: An Active System for MPEG-4
`Video Object Segmentation," ICIP (2) 8: 647-651, Apr. 1998.
`E. N. Mortensen and W. A. Barrett, "Intelligent Scissors for Image
`Composition," Computer Graphics (SIGGRAPH '95), pp. 191-198,
`Los Angeles, CA, Aug. 1995.
`EPO Office Action issued for EP Appl. No. 02734203.9, dated Sep.
`12, 2006, 4 pages.
`EPO Office Action issuedforEP Appl. No. 02734203.9, dated Oct. 7,
`2010, 5 pages.
`Eric N. Mortensen, William A. Barrett, "Interactive segmentation
`with Intelligent Scissors," Graphical Models and Image Processing,
`v.60 n.5, p. 349-384, Sep. 2002.
`Exhibit 1 to Declaration of John Marchioro, Revised translation of
`portions of Japanese Patent Document No. 60-52190 to Hiromae, 3
`pages, Nov. 2, 2007.
`Gao et a!., Perceptual Motion Tracking from Image Sequences,
`IEEE, Jan. 2001, pp. 389-392.
`Grossman, "Look Ma, No Glasses", Games, Apr. 1992, pp. 12-14.
`Hanrahan et a!., "Direct WYSIWYG painting and texturing on 3D
`shapes", Computer Graphics, vol. 24, Issue 4, pp. 215-223. Aug.
`1990.
`Zhong, et al., "Interactive Tracker-A Semi-automatic Video Object
`Tracking and Segmentation System," Microsoft Research China,
`http://research.microsoft.com (Aug. 26, 2003).
`Indian Office Action issued for Appl. No. 49/DELNP/2005, dated
`Apr. 4, 2007, 9 pages.
`Interpolation (from Wikipedia encyclopedia, article pp. 1-6)
`retrieved from Internet URL: http:/ /en.wikipedia.org/wiki/Interpola(cid:173)
`tion on Jun. 5, 2008.
`IPER, Mar. 29, 2007, PCT/US2005/014348, 5 pages.
`IPER, Oct. 5, 2012, PCT/US2011/058182, 6 pages.
`International Search Report, Jun. 13, 2003, PCT/US02/14192, 4
`pages.
`PCT Search Report issued for PCT/US2011/058182, dated May 10,
`2012, 8 pages.
`PCT Search Report issued for PCT /US20 111067024, dated Aug. 22,
`2012, 10 pages.
`Izquierdo et al., Virtual 3D-View Generation from Stereoscopic
`Video Data, IEEE, Jan. 1998, pp. 1219-1224.
`Jul. 21, 2005, Partial Testimony, Expert: Samuel Zhou, Ph.D., 2005
`WL 3940225 (C.D.Cal.), 21 pages.
`Kaufman, D., "The Big Picture", Apr. 1998, http://www.xenotech.
`comApr.1998, pp.1-4.
`Lenny Lipton, "Foundations of the Stereo-Scopic Cinema, a Study in
`Depth" With and Appendix on 3D Television, 325 pages, May 1978.
`Lenny Lipton, Foundations of the Stereo-Scopic Cinema a Study in
`Depth, 1982, Van Nostrand Reinhold Company.
`Machine translation of JP Patent No. 2004-207985, dated Jul. 22,
`2008,34 pg.
`Michael Gleicher, "Image Snapping," SIGGRAPH: 183-190, Jun.
`1995.
`Murray et a!., Active Tracking, IEEE International Conference on
`Intelligent Robots and Systems, Sep. 1993, pp. 1021-1028.
`Ohm et al., An Object-Based System for Stereopscopic Viewpoint
`Synthesis, IEEE transaction on Circuits and Systems for Video Tech(cid:173)
`nology, vol. 7, No.5, Oct. 1997, pp. 801-811.
`Optical Reader (from Wikipedia encyclopedia, article p. 1) retrieved
`from Internet URL:http:/ /en.wikipedia.org/wiki/Optical_reader on
`Jun. 5, 2008.
`Selsis et a!., Automatic Tracking and 3D Localization of Moving
`Objects by Active Contour Models, Intelligent Vehicles 95 Sympo(cid:173)
`sium, Sep. 1995, pp. 96-100.
`Slinker eta!., "The Generation and Animation of Random Dot and
`Random Line Autostereograms", Journal of Imaging Science and
`Technology, vol. 36, No.3, pp. 260-267, May 1992.
`
`Nguyen et al., Tracking Nonparameterized Object Contours in Video,
`IEEE Transactions on Image Processing, vol. 11, No.9, Sep. 2002,
`pp. 1081-1091.
`U.S. District Court, C.D. California, !max Corporation and Three(cid:173)
`Dimensional Media Group, Ltd., v. In- Three, Inc., Partial Testimony,
`Expert: Samuel Zhou, Ph.D., No. CV 05-1795 FMC(Mcx), Jul. 19,
`2005, WL 3940223 (C.D.Cal.), 6 pages.
`U.S. District Court, C.D. California, !max v. In-Three, No. 05 CV
`1795, 2005, Partial Testimony, Expert: David Geshwind, WestLaw
`2005, WL 3940224 (C.D.Cal.), 8 pages.
`U.S. District Court, C.D. California, Western Division, !max Corpo(cid:173)
`ration, and Three-Dimensional Media Group, Ltd. v. In-Three, Inc.,
`No. CV05 1795 FMC (Mcx). Jul. 18, 2005. Declaration of Barbara
`Frederiksen in Support ofln-Three, Inc.'s Opposition to Plaintiffs'
`Motion for Preliminary Injunction, 200 5 WL 54 34 5 80 (C .D .Cal.), 13
`pages.
`U.S. Patent and Trademark Office, Before the Board of Patent
`Appeals and Interferences, Ex Parte Three-Dimensional Media
`Group, Ltd., Appeal 2009-004087, Reexamination Control No.
`90/007,578, U.S. Pat. No. 4,925,294, Decis200, 88 pages, Jul. 30,
`2010.
`Yasushi Mae, eta!., "Object Tracking in Cluttered Background Based
`on Optical Flow and Edges," Proc. 13th Int. Conf. on Pattern Recog(cid:173)
`nition, vol. 1, pp. 196-200, Apr. 1996.
`PCT ISR, Feb. 27, 2007, PCT/US2005/014348, 8 pages.
`PCT ISR, Sep. 11, 2007, PCT/US07/62515, 9 pages.
`PCT ISR, Nov. 14, 2007, PCT/US07/62515, 24 pages.
`PCT IPRP, Jul. 4, 2013, PCT/US2011/067024, 5 pages.
`Weber, et al., "Rigid Body Segmentation and Shape Description from
`Dense Optical Flow Under Weak Perspective," IEEE Transactions on
`Pattern Analysis and Machine Intelligence, vol. 19, No. 2, Feb.
`1997,pp. 139-143.
`IPER, May 10,2013, PCT/US2011/058182, 6 pages.
`European Office Action dated Jun. 26, 2013, received for EP Appl.
`No. 02734203.9 on Jul. 22,2013, 5 pages.
`PCT Search Report and Written Opinion, dated Aug. 22, 2013, for
`PCT Appl. No. PCT/US2013/035506, 7 pages.
`Interpolation (from Wikipedia encyclopedia, article pp. 1-6),
`retrieved from Internet URL:http://en.wikipedia.org/wiki/Interpola(cid:173)
`tion on Jun. 5, 2008.
`Optical Reader (from Wikipedia encyclopedia, article p. 1 ), retrieved
`from Internet URL:http://en.wikipedia.org/wiki/Optical_reader on
`Jun. 5, 2008.
`U.S. Patent and Trademark Office, Before the Board of Patent
`Appeals and Interferences, Ex Parte Three-Dimensional Media
`Group, Ltd., Appeal 2009-004087, Reexamination Control No.
`90/007,578, U.S. Pat. No. 4,925,294, Decision on Appeal, 88 pages,
`Jul. 30, 2010.
`International Search Report dated May 10, 2012, 8 pages.
`Machine translation of JP Patent No. 2004-207985, dated Jul. 22,
`2008, 34 pages.
`Nell et al., "Stereo graphic Projections by Digital Computer", Com(cid:173)
`puters and Automation for May 1965, pp. 32-34.
`Nell, "Computer-Generated Three-Dimensional Movies" Comput(cid:173)
`ers and Automation for Nov. 1965, pp. 20-23.
`U.S. Patent and Trademark Office, Before the Board of Patent
`Appeals and Interferences, Ex Parte Three-Dimensional Media
`Group, Ltd., Appeal 2009-004087, Reexamination Control No.
`90/007,578, U.S. Pat. No. 4,925,294, Decision on Appeal, 88 pages.
`International Search Report received fro PCT Application No. PCT/
`US2011/067024, dated Aug. 22, 2012, 10 pages.
`International Patentability Preliminary Report and Written Opinion I
`PCT/US2013/035506, dated Aug. 21,2014,6 pages.
`Zhang, et a!., "Stereoscopic Image Generation Based on Depth
`Images for 3D TV", IEEE Transactions on Broadcasting, vol. 51, No.
`2, pp. 191-199, Jun. 2005.
`Beraldi, et a!., "Motion and Depth from Optical Flow", Lab. Di
`Bioingegneria, Facolta' di Medicina, Universit' di Modena, Modena,
`Italy; pp. 205-208, 1989.
`Hendriks, et al. "Converting 2D to 3D: A Survey", Information and
`Communication Theory Group, Dec. 2005.
`
`Exhibit A
`Page 005
`
`Prime Focus Ex 1031-5
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 24 of 160 Page ID
` #:6140
`
`US 9,286,941 B2
`Page 6
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Tam eta!., "3D-TV Content Generation: 2D-to-3D Conversion",
`ICME 2006, p. 1868-1872.
`Harman eta!. "Rapid 2D to 3D Conversion", The Reporter, vol. 17,
`No. 1, Feb. 2002, 12 pages.
`Legend Films, "System and Method for Conversion of Sequences of
`Two-Dimensional Medical Images to Three-Dimensional Images"
`Sep. 12, 2013, 7 pages.
`International Search Report Issued for PCTIUS20131072208, dated
`Feb. 27, 2014, 6 pages.
`
`International Search Report and Written Opinion issued for PCTI
`US20131072447, dated Mar. 13, 2014,6 pages.
`International Preliminary Report on Patentability received in PCT I
`US20131072208 on Jun. 11, 2015, 5 pages.
`International Preliminary Report on Patentability received in PCT I
`US20131072447 on Jun. 11, 2015, 12 pages.
`McKenna "Interactive Viewpoint Control and Three-Dimensional
`Operations", Computer Graphics and Animation Group, The Media
`Laboratory, pp. 53-56, 1992.
`European Search Report Received in PCTUS2011067024 on Nov.
`28, 2014, 6 pages.
`* cited by examiner
`
`Exhibit A
`Page 006
`
`Prime Focus Ex 1031-6
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 25 of 160 Page ID
` #:6141
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 1 of 103
`
`US 9,286,941 B2
`
`·:0
`'\1 ' ""
`
`t
`
`Figure i
`
`Exhibit A
`Page 007
`
`Prime Focus Ex 1031-7
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 26 of 160 Page ID
` #:6142
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 2 of 103
`
`US 9,286,941 B2
`
`Figure 2
`
`Figure 4
`
`Background
`Mask
`
`Isolated
`Background
`
`Exhibit A
`Page 008
`
`Prime Focus Ex 1031-8
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 27 of 160 Page ID
` #:6143
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 3 of 103
`
`US 9,286,941 B2
`
`Figure SA
`
`Key
`frame
`lS -
`nly
`the o
`fi-ame
`fully
`ed
`mask
`with
`color
`lp
`lookt
`table
`s
`
`- s
`
`
`
`Frame
`number
`
`__.
`
`1
`
`7
`
`13
`
`19
`
`25
`
`31
`
`::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
`
`Floating
`Tool
`Bar
`
`2
`
`R
`
`14
`
`20
`
`26
`
`32
`
`1
`
`9
`
`15
`
`21
`
`27
`
`33
`
`4
`
`10
`
`16
`
`22
`
`28
`
`34
`
`s
`
`11
`
`17
`
`23
`
`29
`
`35
`
`()
`
`12
`
`1 R
`
`24
`
`30
`
`36
`
`-..
`
`-
`
`Figure 58
`
`Exhibit A
`Page 009
`
`Prime Focus Ex 1031-9
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 28 of 160 Page ID
` #:6144
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 4 of 103
`
`US 9,286,941 B2
`
`Figure 6A
`
`Floating child preview window overlaying sequential frames
`
`Controls fl.w previewing underlying images in real(cid:173)
`time motion or single frame stepping to assure
`ma,/g"mcnl a"d quality w"tml
`
`Tool
`Bar
`
`Frame
`numbers
`
`I
`
`j j
`
`I
`
`_i.L
`
`I _;_,
`
`I j
`
`4
`
`I j ) I j()
`
`I
`
`I
`
`Figure 68
`
`Exhibit A
`Page 010
`
`Prime Focus Ex 1031-10
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 29 of 160 Page ID
` #:6145
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 5 of 103
`
`US 9,286,941 B2
`
`Key frame
`masks or
`individual
`masks are
`automatically
`copied to
`subsequent
`frames (2
`through 36)
`
`Frame
`numbers
`
`1
`
`7
`
`13
`
`19
`
`25
`
`31
`
`2
`
`8
`
`14
`
`20
`
`26
`
`32
`
`3
`
`9
`
`15
`
`21
`
`27
`
`33
`
`4
`
`10
`
`16
`
`22
`
`28
`
`5
`
`11
`
`17
`
`23
`
`29
`
`34
`
`35
`
`6
`
`12
`
`18
`
`24
`
`30
`
`36
`
`Figure 7A
`
`Floating
`Tool
`Bar
`
`Figure 78
`
`Exhibit A
`Page 011
`
`Prime Focus Ex 1031-11
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 30 of 160 Page ID
` #:6146
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 6 of 103
`
`US 9,286,941 B2
`
`Figure 8
`
`Exhibit A
`Page 012
`
`Prime Focus Ex 1031-12
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 31 of 160 Page ID
` #:6147
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 7 of 103
`
`US 9,286,941 B2
`
`Figure 9A
`
`Figure 98
`
`Exhibit A
`Page 013
`
`Prime Focus Ex 1031-13
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 32 of 160 Page ID
` #:6148
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 8 of 103
`
`US 9,286,941 B2
`
`Figure 10A
`
`Reference Image
`
`Figure 108
`
`iPP.fP.•"'nce Box (xO yO)
`
`,~.,.,,:;...,!'!"'::•
`
`1
`
`S·~i~Hch Box (x, y)
`
`Figure 10C
`
`Figure 100
`
`Exhibit A
`Page 014
`
`Prime Focus Ex 1031-14
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 33 of 160 Page ID
` #:6149
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 9 of 103
`
`US 9,286,941 B2
`
`Search Image Gradient Descent
`
`Figure 118
`
`Search Box 1
`
`Search Box 2
`
`Figure 11A
`
`Figure 11C
`
`Exhibit A
`Page 015
`
`Prime Focus Ex 1031-15
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 34 of 160 Page ID
` #:6150
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet 10 of 103
`
`US 9,286,941 B2
`
`Figure 12
`
`Exhibit A
`Page 016
`
`Prime Focus Ex 1031-16
`Prime Focus v Legend3D
`IPR2016-01243
`
`

`

`Case 2:15-cv-02340-MWF-PLA Document 62-2 Filed 04/22/16 Page 35 of 160 Page ID
` #:6151
`
`U.S. Patent
`
`Mar.15,2016
`
`Sheet