`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`_____________________
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`_____________________
`LIGHTRICKS LTD.,
`Petitioner,
`
`
`v.
`
`
`PLOTAGRAPH, INC. and SASCHA CONNELLY,
`Patent Owner.
`_____________________
`Case IPR2023-00568
`U.S. Patent No. 11,182,641
`Filing Date: Feb. 26, 2020
`Issue Date: Nov. 23, 2021
`_____________________
`PETITION FOR INTER PARTES REVIEW OF
`U.S. PATENT NO. 11,182,641 UNDER 35 U.S.C. §312
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`
`
`TABLE OF CONTENTS
`INTRODUCTION .......................................................................................... 1
`I.
`II. MANDATORY NOTICES ............................................................................ 1
`A.
`Real Party-in-Interest (37 C.F.R. §42.8(b)(1)) ..................................... 1
`B.
`Related Matters (§42.8(b)(2)) .............................................................. 1
`C.
`Lead and Back-Up Counsel (§42.8(b)(3)) ........................................... 2
`D.
`Service Information (§42.8(b)(4)) ........................................................ 2
`III. REQUIREMENTS FOR IPR ......................................................................... 2
`A. Grounds For Standing (§42.104(a)) ..................................................... 2
`B.
`Identification of Challenge (§42.104(b)(1)-(2)) ................................... 2
`Claims for Which Review Is Requested: .................................... 2
`
`Grounds of Challenge ................................................................. 3
`
`IV. LEVEL OF ORDINARY SKILL IN THE ART ............................................ 5
`V.
`THE ’641 PATENT ........................................................................................ 6
`A.
`Prosecution History .............................................................................. 7
`B.
`Claim Construction............................................................................... 8
`VI. THE CHALLENGED CLAIMS ARE UNPATENTABLE UNDER 35
`U.S.C. §§102(A)(1) AND 103........................................................................ 8
`A. Ground 1: Claims 1-4, 8-15, and 19-20 Are Anticipated or
`Otherwise Rendered Obvious by AEM ................................................ 8
`Summary of AEM ....................................................................... 8
`
`a. Workspace and Panels ................................................... 10
`b.
`Compositions and Layers .............................................. 10
`c.
`Extracting a Single Frame from a Video ....................... 11
`d. Modifying Transparency of Certain Pixels ................... 12
`e.
`Puppet Effect ................................................................. 14
`f.
`Animating with the Puppet Effect ................................. 15
`Independent Claim 1 ................................................................. 17
`a.
`[1pre] .............................................................................. 17
`b.
`[1a] ................................................................................. 18
`- ii -
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`c.
`[1b] ................................................................................. 20
`d.
`[1c] ................................................................................. 26
`e.
`[1d] ................................................................................. 27
`f.
`[1e] ................................................................................. 28
`g.
`[1f] ................................................................................. 32
`Claim 2 ...................................................................................... 35
`Claim 3 ...................................................................................... 36
`Claim 4 ...................................................................................... 36
`Claim 8 ...................................................................................... 36
`Claim 9 ...................................................................................... 40
`a.
`[9a]-[9e] ......................................................................... 40
`Claim 10 .................................................................................... 43
`Claim 11 .................................................................................... 43
`Independent Claim 12 ............................................................... 46
`a.
`[12pre] ............................................................................ 46
`b.
`[12a] ............................................................................... 47
`c.
`[12b] ............................................................................... 47
`d.
`[12c] ............................................................................... 47
`e.
`[12d] ............................................................................... 47
`f.
`[12e] ............................................................................... 48
` Claim 13 .................................................................................... 48
`a.
`[13a]-[13b] ..................................................................... 48
` Claim 14 .................................................................................... 51
` Claim 15 .................................................................................... 52
`a.
`[15a]-[15b] ..................................................................... 52
`Independent Claim 19 ............................................................... 54
`a.
`[19pre] ............................................................................ 54
`b.
`[19a] ............................................................................... 54
`c.
`[19b] ............................................................................... 55
`d.
`[19c] ............................................................................... 55
`
`
`
`
`
`
`
`
`
`- iii -
`
`
`
`
`
`B.
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`e.
`[19d] ............................................................................... 55
`f.
`[19e] ............................................................................... 55
`g.
`[19f] ............................................................................... 55
` Claim 20 .................................................................................... 55
`Ground 2: IMU and Okabe Render Obvious Claims 1-4, 8-14,
`and 19-20 ............................................................................................ 55
`Summary of IMU ...................................................................... 55
`
`a.
`Applying Effects and Creating an Animation ............... 56
`b.
`Extracting a Single Frame of a GIF Animation ............ 59
`c. Modifying Transparency of Certain Pixels Using a
`Matte .............................................................................. 61
`Summary of Okabe ................................................................... 62
`The IMU-Okabe Combination .................................................. 63
`a. Motivation to Combine IMU with Okabe ..................... 63
`b.
`Resulting Combination .................................................. 67
`Independent Claim 1 ................................................................. 68
`a.
`[1pre] .............................................................................. 68
`b.
`[1a] ................................................................................. 69
`c.
`[1b] ................................................................................. 69
`d.
`[1c] ................................................................................. 72
`e.
`[1d] ................................................................................. 73
`f.
`[1e] ................................................................................. 74
`g.
`[1f] ................................................................................. 75
`Claim 2 ...................................................................................... 76
`Claim 3 ...................................................................................... 76
`Claim 4 ...................................................................................... 76
`Claim 8 ...................................................................................... 76
`Claim 9 ...................................................................................... 77
`a.
`[9a]-[9e] ......................................................................... 77
` Claim 10 .................................................................................... 79
` Claim 11 .................................................................................... 80
`- iv -
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Independent Claim 12 ............................................................... 81
`
`a.
`[12pre] ............................................................................ 81
`b.
`[12a] ............................................................................... 82
`c.
`[12b] ............................................................................... 82
`d.
`[12c] ............................................................................... 82
`e.
`[12d] ............................................................................... 83
`f.
`[12e] ............................................................................... 83
` Claim 13 .................................................................................... 83
`a.
`[13a]-[13b] ..................................................................... 83
` Claim 14 .................................................................................... 84
`Independent Claim 19 ............................................................... 84
`
`a.
`[19pre] ............................................................................ 84
`b.
`[19a] ............................................................................... 85
`c.
`[19b] ............................................................................... 85
`d.
`[19c] ............................................................................... 85
`e.
`[19d] ............................................................................... 85
`f.
`[19e] ............................................................................... 85
`g.
`[19f] ............................................................................... 85
` Claim 20 .................................................................................... 85
`Ground 3: IMU, Okabe, and Li Render Obvious Claims 13-15 ....... 86
`Summary of Li .......................................................................... 86
`
`The IMU-Okabe-Li Combination ............................................. 88
`
`a. Motivation to Combine the IMU-Okabe
`Combination with Li ...................................................... 88
`Resulting Combination .................................................. 90
`b.
`Claim 13 .................................................................................... 91
`a.
`[13a]-[13b] ..................................................................... 91
`Claim 14 .................................................................................... 91
`Claim 15 .................................................................................... 92
`a.
`[15a]-[15b] ..................................................................... 92
`
`C.
`
`
`
`
`
`
`
`
`
`
`- v -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`VII. DISCRETIONARY DENIAL IS UNWARRANTED ................................. 93
`VIII. CONCLUSION ............................................................................................. 93
`
`
`
`
`
`
`
`
`
`- vi -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`Shorthand
`Exhibit
`’641 Patent
`1001
`1002 Greenspun
`1003 AEM
`
`IMU-Home
`
`IMU-Masking
`
`Petitioner’s Exhibit List
`Description
`U.S. Patent No. 11,182,641
`Declaration of Philip Greenspun, Ph.D.
`Adobe® After Effects® Help and tutorials,
`Adobe (2013)
`Wayback Machine Capture dated Mar. 27, 2012
`of Anthony Thyssen, Examples of ImageMagick
`Usage (Version 6), ImageMagick (Mar. 15,
`2011), http://www.imagemagick.org/Usage/
`[https://web.archive.org/web/20120327064501/ht
`tp://www.imagemagick.org/Usage/]
`IMU-Distorting WayBack Machine Capture dated Mar. 29, 2012
`of Anthony Thyssen, ImageMagick v6 Examples -
`- Distorting Images, ImageMagick (Mar. 21,
`2012),
`http://www.imagemagick.org/Usage/distorts/
`[https://web.archive.org/web/20120329131929/ht
`tp://www.imagemagick.org/Usage/distorts/]
`Wayback Machine Capture dated Sept. 28, 2012
`of Anthony Thyssen, ImageMagick v6 Examples -
`- Masks, ImageMagick (Mar. 10, 2011),
`http://www.imagemagick.org/Usage/masking/
`[https://web.archive.org/web/20120928070642/ht
`tp://www.imagemagick.org/Usage/masking/]
`IMU-Animating Wayback Machine Capture dated Mar. 10, 2012
`of Anthony Thyssen, ImageMagick v6 Examples -
`- Animation Basics, ImageMagick (Feb. 8, 2011),
`http://www.imagemagick.org/Usage/anim_basics/
`[https://web.archive.org/web/20120310193613/ht
`tp://www.imagemagick.org/Usage/anim_basics/]
`IMU-Windows1 Wayback Machine Capture dated Apr. 5, 2012 of
`Anthony Thyssen, ImageMagick v6 Examples --
`Usage under Windows, ImageMagick (Mar. 21,
`
`1004
`
`1005
`
`1006
`
`1007
`
`1008
`
`
`1 IMU-Home, IMU-Warping, IMU-Distorting, IMU-Masking, IMU-Animating, and
`
`IMU-Windows are collectively referred to hereinafter as “IMU.”
`
`
`
`
`
`- vii -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`1009 Okabe
`
`1010
`
`Li
`
`1011
`
`’641 PH
`
`1012 Archive
`
`Lindahl
`1013
`1014 McNally
`1015
`Siddharth
`1016
`Brookhart
`1017
`Sakiyama
`1018
`Forbes
`
`1019
`1020
`1021
`
`Luo
`Tang
`
`
`1022
`
`
`
`1023 Hair
`1024 Nakagawa
`1025
`
`
`2012),
`http://www.imagemagick.org/Usage/windows/
`[https://web.archive.org/web/20120405151502/ht
`tp://www.imagemagick.org/Usage/windows/]
`Makato Okabe, et al., Creating Fluid Animation
`from a Single Image using Video Database, 30
`Computer Graphics Forum 1973 (2011)
`Yin Li, et al., Lazy Snapping, 23 ACM
`Transactions on Graphics 303 (2004)
`Excerpts of Prosecution history of U.S. Patent
`No. 11,182,641
`Declaration of Nathaniel E Frank-White of the
`Internet Archive
`U.S. Patent No. 9,466,127
`U.S. Patent No. 9,070,222
`U.S. Patent App. Pub. No. 2014/0087797
`U.S. Patent No. 9.400,942
`U.S. Patent No. 9,692,974
`Angus Graeme Forbes et al., Analyzing Intrinsic
`Motion Textures Created from Naturalistic Video
`Captures, 2014 International Conference on
`Information Visualization Theory and
`Applications 107 (2014)
`U.S. Patent No. 8,280,164
`U.S. Patent No. 8,913,847
`Notice of Docketing, Plotagraph, Inc. v.
`Lightricks, Ltd., No. 23-1048, Dkt. No. 1 (Fed.
`Cir. Oct. 17, 2022)
`Plaintiffs’ Opposed Motion for Leave to Serve
`Second Supplemental Disclosures Pursuant to
`PR. 3-1 and P.R. 3-2, Plotagraph, Inc. v.
`Lightricks Ltd., Civil Action No. 4:21-cv-03873,
`Dkt. No. 42 (S.D. Tex. May 21, 2022)
`U.S. Patent No. 6,014,491
`U.S. Patent No. 5,835,911
`WayBack Machine Capture dated Sept. 7, 2012
`of Downloads, Adobe (Sept. 7, 2012),
`http://www.adobe.com/downloads/ [https://web.
`
`
`
`
`
`- viii -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`1026
`
`
`
`archive.org/web/20120907130453/http://www.
`adobe.com/downloads/]
`WayBack Machine Capture dated Mar. 28, 2012
`of Download ImageMagick, ImageMagick (Mar.
`28, 2012), http://www.imagemagick.org/script/
`download.php [https://web.archive.org/web/
`20120328075001/http://www.imagemagick.org/
`script/download.php]
`
`
`
`
`
`- ix -
`
`
`
`
`
`CLAIM LISTING
`Limitation
`A computer system providing, to a client computing
`device, software for automating a shifting of pixels
`within a video file, the computer system comprising:
`
`one or more processors; and
`
`one or more computer-readable media having stored
`thereon executable instructions that are transmitted
`to the client computing device for execution by one
`or more client processors on the client computing
`device, the executable instructions comprising
`instructions that when executed by the one or more
`client processors configure the client computing
`device to perform at least the following:
`access, from memory, a digital image file, wherein
`the digital image file comprises information that
`corresponds to individual pixels within a frame of
`the digital image file;
`receive a first starting point through a user interface,
`wherein the first starting point is received through a
`user selection of a first beginning portion of a first
`image frame;
`receive a first ending point through the user
`interface, wherein the first ending point is received
`through a user selection of a first ending portion;
`create a first digital link between the first starting
`point and the first ending point, wherein the first
`digital link comprises:
`
` a
`
` first direction extending from the first starting point
`to the first ending point; and
`
` a
`
` first length between the first starting point and the
`first ending point;
`identify a first set of pixels that lie along the first
`digital link between the first starting point and the
`first ending point; and
`- x -
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`Claim Limitation No.
`
`[1pre]
`
`[1a]
`
`[1b]
`
`[1c]
`
`[1d]
`
`[1e]
`
`1
`
`
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Limitation
`Claim Limitation No.
`shift the first set of pixels in the first direction.
`[1f]
`The computer system of claim 1, wherein the first ending portion
`comprises a particular portion of the first image frame.
`The computer system of claim 1, wherein the digital image file
`comprises a video file and the first image frame comprises a first video
`frame of the video file.
`The computer system of claim 3, wherein the first ending portion
`comprises a particular portion of a second video frame within the video
`file.
`The computer system of claim 1, wherein shifting the first set of pixels
`comprises rendering in a loop the first set of pixels being shifted within
`the first image frame.
`The computer system of claim 1, wherein the
`executable instructions include instructions that are
`executable to configure the computer system to:
`
`receive a second starting point through the user
`interface, wherein the second starting point is
`received through a user selection of a second
`beginning portion of the first image frame;
`receive a second ending point through the user
`interface, wherein the second ending point is
`received through a user selection of a second ending
`portion;
`create a second digital link between the second
`starting point and the second ending point, wherein
`the second digital link comprises:
`
`2
`
`3
`
`4
`
`8
`
`9
`
`[9a]
`
`[9b]
`
`[9c]
`
`[9d]
`
`[9e]
`
` a
`
` second direction extending from the second
`starting point to the second ending point; and
`
` a
`
` second length between the second starting point
`and the second ending point;
`identify a second set of pixels that lie between the
`second starting point and the second ending point;
`and
`shift the second set of pixels in the second direction.
`
`
`
`
`
`- xi -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Limitation
`Claim Limitation No.
`The computer system of claim 9, wherein the first direction is different
`10
`from the second direction.
`The computer system of claim 9, wherein a magnitude of the shifting of
`the first set of pixels is proportionally related to the first length and the
`magnitude of the shifting of the second set of pixels is proportionally
`related to the second length.
`A computer program product comprising one or
`more non-transitory computer storage media having
`stored thereon computer-executable instructions that,
`when transmitted to a remote computer system for
`execution at a processor, cause the remote computer
`system to perform a method for automating a shifting
`of pixels within an image file, the method
`comprising:
`receiving a first indication of a first starting point
`through a user interface, wherein the first starting
`point is received through a user selection of a first
`portion of a first image frame;
`receiving, through the user interface, a first direction
`associated with the first starting point;
`creating a first digital link extending in the first
`direction from the first starting point;
`selecting a first set of pixels that are along the first
`digital link and extend in the first direction away
`from the first starting point; and
`shifting the first set of pixels, in the first image
`frame, in the first direction.
`The computer program product as recited in claim
`12, further comprising receiving an indication to
`generate a first mask over a second portion of the
`first image frame,
`wherein pixels under the first mask are prevented
`[13b]
`from shifting.
`The computer program product as recited in claim 13, further
`comprising computer-executable instructions that, when transmitted to
`the remote computer system for execution at the processor, cause the
`remote computer system to perform a method for automating the
`shifting of pixels within the image file, the method comprising
`
`[12pre]
`
`[12a]
`
`[12b]
`
`[12c]
`
`[12d]
`
`[12e]
`
`[13a]
`
`11
`
`12
`
`13
`
`14
`
`
`
`
`
`- xii -
`
`
`
`
`
`[15a]
`
`15
`
`[15b]
`
`[19pre]
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Limitation
`Claim Limitation No.
`receiving through a user interface a selection of the second portion of
`the first image frame around which the first mask should be generated.
`The computer program product of claim 14, further
`comprising computer-executable instructions that,
`when transmitted to the remote computer system for
`execution at the processor, cause the remote
`computer system to perform a method for
`automating the shifting of pixels within the image
`file, the method comprising:
`
`identifying one or more edges that form a first
`boundary around the second portion; and
`generating the first mask to cover area within the
`first boundary.
`A method for transmitting to a client computing
`device instructions for shifting pixels within a video
`file, comprising:
`
`transmitting computer executable instructions to a
`client computing device, the computer executable
`instructions configured to cause the client computing
`device to:
`access, from memory, a digital image file, wherein
`the digital image file comprises information that
`corresponds to individual pixels within a frame of
`the digital image file;
`receive a first starting point through a user interface,
`wherein the first starting point is received through a
`user selection of a first beginning portion of a first
`image frame;
`receive a first ending point through the user
`interface, wherein the first ending point is received
`through a user selection of a first ending portion;
`create a first digital link between the first starting
`point and the first ending point, wherein the first
`digital link comprises:
`
`
`[19a]
`
`19
`
`[19b]
`
`[19c]
`
`[19d]
`
`
`
`
`
`- xiii -
`
`
`
`
`
`Limitation
`a first direction extending from the first starting point
`to the first ending point; and
`
` a
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Claim Limitation No.
`
`[19e]
`
` first length between the first starting point and the
`first ending point;
`identify a first set of pixels that lie along the first
`digital link between the first starting point and the
`first ending point; and
`shift the first set of pixels in the first direction.
`[19f]
`The method of claim 19, wherein the digital image file comprises a
`video file and the first image frame comprises a frame of the video file.
`
`20
`
`
`
`
`
`- xiv -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`INTRODUCTION
`I.
`The ’641 Patent’s claims are directed to “automating a shifting of pixels
`
`within a video file.” Pixels are shifted according to user inputs, i.e., the user
`
`indicates starting and ending points in a video frame for a digital link and a set of
`
`pixels to be shifted, and the pixels are shifted in the digital link’s direction.
`
`However, the foregoing features were included in image editing programs
`
`prior to the ’641 Patent’s priority date, including Adobe After Effects CS6.
`
`Separately, the claimed inventions would have been obvious given the state of the
`
`art and other previously-available image editing programs, including ImageMagick
`
`Version 6 and features described in Okabe and Li. Therefore, claims 1-4, 8-15, and
`
`19-20 are unpatentable.
`
`II. MANDATORY NOTICES
`A. Real Party-in-Interest (37 C.F.R. §42.8(b)(1))
`The real party-in-interest is: Petitioner, Lightricks Ltd.
`
`B. Related Matters (§42.8(b)(2))
`Related matters are Plotagraph, Inc. v. Lightricks Ltd., Civil Action No. 4:21-
`
`cv-03873 (S.D. Tex. 2022) (the “Litigation”), the dismissal of which is on appeal in
`
`Plotagraph, Inc. v. Lightricks, Ltd., No. 23-1048 (Fed. Cir. 2022) (the “Appeal”).
`
`EX1021.
`
`
`
`
`
`
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`C. Lead and Back-Up Counsel (§42.8(b)(3))
`Lead Counsel
`Back-Up Counsel
`Robert Greeson, Reg. No. 52,966
`R. Ross Viguet, Reg. No. 42,203
`Lu Ling, Reg. No. 78,121
`
`
`D.
`
`Service Information (§42.8(b)(4))
`Lead Counsel
`Robert Greeson, Reg. No. 52,966
`Norton Rose Fulbright US LLP
`2200 Ross Ave, Suite 3600
`Dallas, Texas 75201
`214.855.7430 (telephone)
`robert.greeson@nortonrosefulbright.com
`
`Back-Up Counsel
`R. Ross Viguet, Reg. No. 42,203
`Norton Rose Fulbright US LLP
`2200 Ross Ave, Suite 3600
`Dallas, Texas 75201
`214.855.8185 (telephone)
`ross.viguet@nortonrosefulbright.com
`
`Lu Ling, Reg. No. 78,121
`Norton Rose Fulbright US LLP
`1301 McKinney, Suite 5100
`Houston, Texas 77010
`713.651.5327 (telephone)
`lu.ling@nortonrosefulbright.com
`
`
`Petitioner consents to electronic service.
`
`III. REQUIREMENTS FOR IPR
`A. Grounds For Standing (§42.104(a))
`Petitioner certifies that the ’641 Patent is available for inter partes review
`
`(“IPR”) and Petitioner is not barred or estopped from requesting IPR on the
`
`identified grounds.
`
`B.
`
`Identification of Challenge (§42.104(b)(1)-(2))
`Claims for Which Review Is Requested:
`
`Claims 1-4, 8-15, and 19-20 (the “Challenged Claims”).
`
`
`
`
`
`- 2 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Grounds of Challenge2
`
`Petitioner requests IPR of the Challenged Claims on the following grounds:
`
`Ground
`1
`
`2
`3
`
`Claims
`1-4, 8-15, and
`19-20
`1-4, 8-14, and
`19-20
`13-15
`
`§103
`§103
`
`Statutory Basis
`§§102(a)(1), 103 AEM
`IMU and Okabe
`
`Prior Art
`
`IMU, Okabe, and Li
`
`
`Supporting analysis is provided in the Declaration of Dr. Philip Greenspun.
`
`AEM is a user manual for Adobe After Effects CS6 (“AECS6”). See, e.g.,
`
`AEM, 3; Greenspun, ¶49. AEM is prior art because by September 7, 2012, it was
`
`downloadable by the interested public from Adobe’s website. Archive, ¶¶1-7 (¶¶5-
`
`6: explaining URL and attachment), pp. 97-99 (declarant-cited attachment at 07-
`
`September-2012 URL); Greenspun, ¶49 (testifying AEM, which he provided,
`
`matches copy at Archive, 99-699). Other references confirm the public availability
`
`of AECS6 and its user manual, AEM, before the earliest claimed priority date
`
`(“ECPD”). See, e.g., Lindahl, code (56); McNally, code (56).
`
`
`2 All grounds include a POSITA’s general knowledge at the time of the alleged
`
`invention, which is evidenced by the prior art, including that which is cited in support
`
`of, but not explicitly listed as part of, the grounds. Koninklijke Philips N.V. v. Google
`
`LLC, 948 F.3d 1330, 1337-38 (Fed. Cir. 2020).
`
`
`
`
`
`- 3 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`IMU contains Wayback Machine captures dated 2012 of
`
`the
`
`ImageMagick.com website, specifically the website’s section titled “Examples of
`
`ImageMagick Usage (Version 6),” which provides guidance and examples on how
`
`to use ImageMagick Version 6 (“IMV6”). See IMU-Home, 1; Greenspun, ¶50. The
`
`section’s homepage (IMU-Home) links to different subpages explaining how to use
`
`IMV6’s various effects and capabilities, including “Distorting Images” (IMU-
`
`Distorting), “Masking and Background Removal” (IMU-Masking), “Animation
`
`Basics” (IMU-Animating), and “Usage under Windows” (IMU-Windows).3 IMU-
`
`Home, 1-2; Greenspun, ¶50. Each of the above was publicly accessible on the
`
`ImageMagick.com website by September 28, 2012, establishing IMU’s prior art
`
`status. Archive, pp. 3-5, 9-10, 45-46, 65-66, 79-80; Greenspun, ¶50 (testifying IMU,
`
`which he provided, matches copy at Archive, 4-96, excluding declarant-provided
`
`cover pages). Other references confirm IMU’s pre-ECPD public availability. See,
`
`e.g., Siddharth, ¶¶120-22; Brookhart, 10:53-59.
`
`
`3 IMU is thus a single reference. Greenspun, ¶50 n.7. Separately, a POSITA would
`
`have also been motivated to consider the IMU webpages together to gain a more
`
`complete understanding of IMV6. Id.
`
`
`
`
`
`- 4 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`Okabe was published in Volume 30, Number 7 of Computer Graphics Forum
`
`in September 2011 and is therefore prior art. Okabe, 1; Greenspun, ¶51; see also,
`
`e.g., Sakiyama, code (56); Forbes, 3, 7.
`
`Li was published in Volume 23, Issue 3 of ACM Transactions on Graphics in
`
`August 2004 and is therefore prior art. Li, 1; Greenspun, ¶52; see also, e.g., Luo,
`
`code (56), 1:43-53; Tang, 1:21-24; Okabe, 7, 10.
`
`IV. LEVEL OF ORDINARY SKILL IN THE ART
`A POSITA as of the ECPD4 would have had at least a bachelor’s degree in
`
`computer science, electrical engineering, or a related field, and at least 1-2 years of
`
`experience in image processing and animation. Greenspun, ¶¶23-24. Less education
`
`could have been compensated with more experience, and vice versa. Id. A POSITA
`
`would have also been familiar with existing systems for image processing and
`
`animation and understood how to implement such systems. Id. The ’641 Patent and
`
`prior art discussed in Section VI evidence this level of ordinary skill.
`
`
`4 All Petition statements about the knowledge and skills of, and what would have
`
`been understood by, a POSITA are from this perspective as of this date. See
`
`Greenspun,
`
`¶¶27-29;
`
`see also
`
`id.,
`
`¶¶1-2
`
`(scope of work), 3-20
`
`(experience/qualifications), 21-29 (legal understanding and basis for opinions), 30-
`
`46 (technology background).
`
`
`
`
`
`- 5 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`V. THE ’641 PATENT
`The ’641 Patent is directed to “systems, methods, and computer-readable
`
`media that automate the shifting of pixels within a digital video file.” ’641 Patent,
`
`3:13-16; Greenspun, ¶47. A user provides a video file and selects a “starting point”
`
`on a video frame, as well as an “ending point” on the same or a different frame. ’641
`
`Patent, Abst., 6:33-54; Greenspun, ¶47. The system or user then creates a “digital
`
`link” between the starting and ending points and identifies a set of pixels that
`
`includes at least “a line of individual pixels extending from the starting point to the
`
`ending point” but may, “at another extreme,” include “a relatively wide swatch of
`
`pixels that are parallel to the link that extends between the starting point and the
`
`ending point.” ’641 Patent, 6:58-67, 7:22-36; Greenspun, ¶47. The set of pixels is
`
`then shifted in the link’s direction. ’641 Patent, 7:37-40; Greenspun, ¶47. Figure 9
`
`is representative:
`
`
`
`
`
`- 6 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`
`’641 Patent, Fig. 9 ;Greenspun, ¶47.
`
`
`
`Prosecution History
`A.
`During prosecution, the ’641 Patent faced no rejections on the basis of prior
`
`art. See ’641 PH, 97-103, 188-190, 208, 218. Applicant’s only amendments were
`
`of claims 12-18, which were solely to overcome a 35 U.S.C. §101 rejection for
`
`failing to recite “non-transitory computer storage media” and to address
`
`informalities. See id., 132-140, 98-99.
`
`
`
`
`
`- 7 -
`
`
`
`
`
`IPR2023-00568
`U.S. Patent No. 11,182,641
`B. Claim Construction
`For purposes of this IPR, all terms should be given their plain and ordinary
`
`meaning. Greenspun, ¶48.
`
`VI. THE CHALLENGED CLAIMS ARE UNPATENTABLE UNDER 35
`U.S.C. §§102(A)(1) AND 103
`A. Ground 1: Claims 1-4, 8-15, and 19-20 Are Anticipated or
`Otherwise Rendered Obvious by AEM
`Summary of AEM
`
`AEM is a user manual for AECS6—a software for performing a variety of
`
`animation tasks from, e.g., “animat[ing] a simple title” to “creat[ing] complex
`
`motion graphics, or composit[ing] realistic visual effects.” AEM, 25; Greenspun,
`
`¶53.
`
`AEM instructs to