Paper No. 1
`Filed: November 8, 2021
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`––––––––––––––––––
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`––––––––––––––––––
`
`APPLE INC.,
`Petitioner,
`
`v.
`
`MEMORYWEB, LLC,
`Patent Owner.
`
`––––––––––––––––––
`
`Case No. IPR2022-00032
`U.S. Patent No. 9,552,376
`
`––––––––––––––––––
`
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`TABLE OF CONTENTS
`
`INTRODUCTION ......................................................................................... 1
`I.
`II. COMPLIANCE WITH IPR REQUIREMENTS ....................................... 2
`A.
`Certification of Standing ....................................................................... 2
`B. Mandatory Notices ................................................................................ 2
`1.
`Real Party-in-Interest .................................................................. 2
`2.
`Related Proceedings .................................................................... 2
`3.
`Counsel and Service Information................................................ 3
`IDENTIFICATION OF CHALLENGED CLAIMS .................................. 4
`III.
`IV. TECHNICAL BACKGROUND ................................................................... 4
`A. Digital Photography and Metadata ........................................................ 4
`B. Metadata Standards ............................................................................... 5
`C.
`Photo Organizer Applications and Websites ......................................... 5
`D.
`Common Features of Photo Applications ............................................. 7
`THE ’376 PATENT ....................................................................................... 8
`A.
`Effective Filing Date and AIA Status ................................................... 8
`B.
`Person of Ordinary Skill in the Art ....................................................... 9
`C.
`Overview of the ’376 Patent .................................................................. 9
`D.
`Prosecution History ............................................................................. 12
`VI. CLAIM CONSTRUCTION ........................................................................ 13
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE ..................... 13
`A.
`Prior Art Overview .............................................................................. 13
`1.
`A3UM ....................................................................................... 13
`a.
`Prior Art Status ............................................................... 14
`b.
`Overview ......................................................................... 18
`Belitz ......................................................................................... 22
`Rasmussen ................................................................................. 25
`
`2.
`3.
`
`V.
`
`i
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`B.
`
`3.
`4.
`5.
`6.
`
`7.
`8.
`
`b.
`
`2.
`
`Claims 1-12 Are Obvious Over A3UM, Belitz, and Rasmussen ........ 26
`1.
`Obvious Combination of A3UM, Belitz, and Rasmussen ........ 26
`a.
`Belitz Suggests Modifying A3UM to Use Photo
`Thumbnails Instead of Pins in the A3UM Interactive
`Map ................................................................................. 27
`Rasmussen Suggests Modifying A3UM To Display
`Geographic Coordinates ................................................. 33
`Claim 1 ...................................................................................... 36
`a.
`Preamble and Storing Step ............................................. 36
`b. Map View and Interactive Map ...................................... 38
`c.
`First and Second User Selectable Thumbnail Images .... 41
`d.
`First and Second Count Value Images ........................... 45
`e.
`First and Second Location Views ................................... 47
`f.
`First and Second Map Images ........................................ 50
`Claim 2 ...................................................................................... 57
`Claim 3 ...................................................................................... 58
`Claim 4 ...................................................................................... 61
`Claim 5 ...................................................................................... 63
`a.
`Preamble and Storing Step ............................................. 63
`b.
`Displaying Step ............................................................... 63
`c.
`First User Selectable Element (“Person”) ...................... 63
`d.
`Second User Selectable Element (“Location”) .............. 64
`e.
`People View .................................................................... 64
`f.
`Location View ................................................................ 65
`Claim 6 ...................................................................................... 66
`Claim 7 ...................................................................................... 67
`a.
`Receiving Step ................................................................ 67
`b. Modifying Step ............................................................... 67
`c.
`Exporting Step ................................................................ 69
`ii
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`9.
`Claim 8 ...................................................................................... 69
`10. Claim 9 ...................................................................................... 70
`11. Claim 10 .................................................................................... 71
`12. Claim 11 .................................................................................... 71
`13. Claim 12 .................................................................................... 73
`a.
`Preamble ......................................................................... 73
`b.
`Storing Step .................................................................... 74
`c. Map View and Interactive Map ...................................... 75
`d.
`First and Second User Selectable Thumbnail Images .... 75
`e.
`First and Second Count Value Images ........................... 75
`f.
`First and Second Location Views ................................... 76
`g.
`First and Second Map Images ........................................ 76
`h.
`Slideshow View .............................................................. 77
`i.
`First Mini-Search Engine Tag (“Location”) ................... 78
`j.
`Second Mini-Search Engine Tag (“Person”) .................. 79
`VIII. THE BOARD SHOULD NOT EXERCISE ITS DISCRETION UNDER
`§ 314(a) or § 315(d) ...................................................................................... 80
`A.
`Section 314(a) ...................................................................................... 80
`1.
`Factor 1 (Possibility of Stay) is Neutral .................................... 80
`2.
`Factor 2 (Trial Date) Favors Institution .................................... 81
`3.
`Factor 3 (Investment in Parallel Proceedings) Favors
`Institution .................................................................................. 82
`Factor 4 (Overlapping Issues) Favors Institution ..................... 82
`Factor 5 (Overlapping Parties) is Outweighed by Other
`Factors ....................................................................................... 83
`Factor 6 (Strength of Petition and Other Considerations) Favors
`Institution .................................................................................. 83
`Section 325(d) ..................................................................................... 85
`B.
`IX. CONCLUSION ............................................................................................ 85
`
`4.
`5.
`
`6.
`
`iii
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`Exhibit List ............................................................................................................. 86
`Certificate of Compliance ...................................................................................... 90
`Certificate of Service .............................................................................................. 91
`
`
`
`
`
`
`iv
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`I.
`
`INTRODUCTION
`
`U.S. Patent No. 9,552,376
`
`Petitioner Apple Inc. (“Apple”) requests inter partes review of claims 1-12
`
`(“challenged claims”) of U.S. Patent No. 9,552,376 (“’376 patent”). The ’376
`
`patent claims digital photo management methods that use well-known user
`
`interface elements to select and display desired photos including (i) a “map view”
`
`showing the location where photos were taken or (ii) selectable tags overlaid on an
`
`image that link to related images.
`
`The prior art, however, described photo management systems with these
`
`interface elements before early 2011. Most notably, A3UM—not considered
`
`during examination—describes a photo management system that allows users to
`
`select and view digital photos at locations on an interactive map (“Places”) and has
`
`selectable tags that link to related images. In fact, the only potential distinctions
`
`between the ’376 patent claims and A3UM concern the style of markers used on
`
`the interactive map—A3UM uses pins, while the ’376 patent requires “thumbnail
`
`images”—or the location and style of the selectable tags and the display of
`
`geographic coordinates. Those distinctions cannot render the claims patentable, as
`
`Belitz teaches using thumbnail images on interactive maps to select and display
`
`photos and A3UM itself renders obvious overlaying and styling its tags as claimed.
`
`Likewise, Rasmussen teaches displaying geographic coordinate values, like those
`
`used to map the locations in A3UM, in the same way as claimed.
`
`1
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`Because the evidence demonstrates that the ’376 patent claims are obvious
`
`based on A3UM in view of Belitz and Rasmussen, the Board should institute inter
`
`partes review.
`
`II. COMPLIANCE WITH IPR REQUIREMENTS
`
`A. Certification of Standing
`
`Petitioner certifies that the ’376 patent is available for IPR. Petitioner is not
`
`barred or estopped from requesting an IPR on the challenged claims on the grounds
`
`identified below. Petitioner and its privies have not filed a civil action challenging
`
`the validity of any claim of the ’376 patent. This petition is timely filed within one
`
`year of service of MemoryWeb’s complaint alleging infringement of the ’376
`
`patent against Apple (EX1023; EX1024) and is filed more than 9 months from the
`
`issue date of the ’376 patent (see §V.A).
`
`B. Mandatory Notices
`
`1.
`
`Real Party-in-Interest
`
`Petitioner Apple Inc. is the real party-in-interest for this petition.
`
`2.
`
`Related Proceedings
`
`The ’376 patent is related to the following U.S. Patents: 9,098,531 (“’531
`
`patent,” EX1010); 10,423,658 (“’658 patent,” EX1012); 10,621,228 (“’228
`
`patent,” EX1013); 11,017,020 (“’020 patent,” EX1014); and 11,163,823.
`
`2
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`The ’376 patent is related to the following pending U.S. Patent Applications:
`
`17/381,047 and 17/459,933.
`
`The ’376 patent or related patents are at issue in the following cases:
`
`Patents
`’658
`’228
`’228
`
`’376, ’658,
`’228, ’020
`’658, ’228
`
`’658, ’228
`
`May 25, 2021
`
`May 17, 2021
`
`Apr. 26, 2021
`
`Filing Date
`Case
`Apple Inc. v. MemoryWeb, LLC, IPR2022-00033 Nov. 3, 2021
`Apple Inc. v. MemoryWeb, LLC, IPR2022-00031 Oct. 30, 2021
`Unified Patents, LLC v. MemoryWeb, LLC,
`Sep. 3, 2021
`IPR2021-01413
`MemoryWeb, LLC v. Apple, Inc., No. 6-21-cv-
`00531 (W.D. Tex.)
`MyHeritage (USA), Inc. et al. v. MemoryWeb,
`LLC, No. 1-21-cv-02666 (N.D. Il.) (dismissed)
`MemoryWeb, LLC v. Samsung Electronics Co.,
`Ltd. et al, No. 6-21-cv-00411 (W.D. Tex.)
`
`
`3.
`
`Counsel and Service Information
`
`Lead Counsel
`
`Backup Counsel
`
`Jeffrey P. Kushan
`Reg. No. 43,401
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`jkushan@sidley.com
`(202) 736-8914
`
`Samuel A. Dillon
`Reg. No. 65,197
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`samuel.dillon@sidley.com
`(202) 736-8298
`
`
`
`Kyle S. Smith
`Reg. No. 78,579
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`kyle.smith@sidley.com
`(202) 736-8327
`
`Petitioner consents to service via e-mail at the following address:
`
`
`
`SidleyAppleMemoryWebIPRs@sidley.com.
`
`3
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`III.
`
`IDENTIFICATION OF CHALLENGED CLAIMS
`
`Claims 1-12 are unpatentable as obvious under 35 U.S.C. § 103 (AIA or pre-
`
`AIA) based on A3UM (EX1005) in view of Belitz (EX1006) and Rasmussen
`
`(EX1025).
`
`Petitioner’s challenges are supported by the declaration and testimony of Dr.
`
`Loren Terveen (EX1003), an expert in graphical user interfaces with over 40 years
`
`of experience. See EX1003, ¶¶2-10; EX1004 (CV).
`
`IV. TECHNICAL BACKGROUND
`
`A. Digital Photography and Metadata
`
`Low-cost digital cameras and smartphones, coupled with key standards for
`
`digital images (e.g., JPEG image compression standard and Exchangeable Image
`
`File Format (“EXIF”) metadata standard) drove a rapid transformation away from
`
`print photography. EX1029, 59-62; EX1036 (EXIF). By 2010, digital
`
`photography had effectively replaced conventional film-based photography.
`
`EX1003, ¶56. Digital cameras’ ability to take and maintain unlimited photographs
`
`drove users to accumulate large numbers of digital photographs. See EX1029, 59.
`
`That created a demand for applications that could efficiently and intuitively
`
`retrieve desired images out of large collections. EX1029, 62.
`
`4
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`B. Metadata Standards
`
`Before 2010, several standards governing information related to digital
`
`images (metadata) had been established, including: (i) the EXIF format, (ii) the
`
`Information Interchange Model (“IIM”) (aka “IPTC”), and (iii) the Metadata
`
`Working Group Guidelines (“MWGG”). EX1036 (EXIF); 1037 (IPTC); EX1038
`
`(MWGG); EX1003, ¶59. “Metadata has become a powerful tool to organize and
`
`search through the growing libraries of image, audio and video content that users
`
`are producing and consuming.” EX1038, 6. Metadata plays a key role “in the
`
`consumer workflow,” with user-defined keywords and location information (where
`
`a photo was taken or the location of its subject) as two important types of metadata
`
`for digital files. EX1038, 16-18.
`
`C.
`
`Photo Organizer Applications and Websites
`
`Numerous photo organizer applications and websites existing before 2010
`
`allowed users to manage large collections of digital photographs, and easily
`
`retrieve photos and videos. E.g., EX1031, 1; EX1003, ¶60. Google Picasa, for
`
`example, included a People view where a user could easily select digital photos
`
`containing a given person, and a Places view where a user could view photos taken
`
`at or tagged with particular locations:
`
`5
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`
`
`
`
`EX1032, 1-2; EX1003, ¶60. Other applications with both people-oriented and map-
`
`oriented display capabilities included Apple’s iPhoto and Aperture products.
`
`EX1031, 4; EX1039, 1-3; EX1003, ¶61.
`
`Photo sharing websites were another outgrowth of the digital photography
`
`revolution, such as (by 2010) Flickr, Photobucket, Picasa, Shutterfly, Panoramio
`
`and Wikimedia Commons. EX1003, ¶62; EX1030, 1, 4. Many provided albums,
`
`image tagging, using thumbnails to select desired photos, and mapping locations
`
`where photos were taken. EX1030, 1, 3; EX1003, ¶¶62-63. For example, Picasa
`
`Web Albums allowed users to browse a map that displayed “thumbnails of a photo
`
`album’s pictures” at the locations where the photos were taken. EX1033, 1-2.
`
`Sites like Flickr let users filter by user or tags, allowing users to easily identify
`
`photographs. EX1033, 2; EX1003, ¶64.
`6
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`D. Common Features of Photo Applications
`
`Developers of photo applications, such as organizers and websites,
`
`constantly extended their products to incorporate functionality found in other
`
`products. EX1003, ¶65. By 2010, organizers commonly included: photo albums or
`
`collections, thumbnail previews, slideshow functionality, facial recognition, and
`
`metadata tagging. EX1031, 1-4; EX1003, ¶66. This enabled users to group, find
`
`and sort photographs using person or location metadata. EX1003, ¶66.
`
`By 2010, developers could easily incorporate and combine multiple
`
`functionalities and information sources using public APIs. EX1003, ¶67; e.g.,
`
`EX1035, 7. The Google Maps API (“GM-API”) enabled applications to display
`
`interactive maps that placed markers at specified locations using simple API calls,
`
`enabling retrieval and display of photos at those locations:
`
`EX1043; EX1040; EX1003, ¶67.
`
`
`
`7
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`Google illustrated these capabilities in two pre-2010 products: Picasa Web
`
`Albums and Panoramio, which used small images to represent photos’ locations on
`
`a map and could display associated information in response to user interaction:
`
`Picasa (2009)
`
`Panoramio (2010)
`
`
`
`EX1033, 2; EX1034, 1; EX1003, ¶68. Thus, by 2010, the technique of using
`
`thumbnail images on an interactive map to identify the location of photos and
`
`enable their retrieval was well-known and could be easily implemented into both
`
`application and web-based photo organizers. EX1003, ¶69.
`
`V. THE ’376 PATENT
`
`A. Effective Filing Date and AIA Status
`
`The earliest filing date claimed by the ’376 patent is June 9, 2011. EX1001,
`
`Face. Patent Owner has represented in related litigation that claims 1-2 are only
`
`entitled to a priority date of February 28, 2014. EX1027, 2. Under either date, the
`
`8
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`references at issue are prior art (§§VII.A.1.a, VII.A.2, VII.A.3) and would have
`
`rendered the challenged claims obvious before June 9, 2011 (EX1003, ¶¶39-40).
`
`B.
`
`Person of Ordinary Skill in the Art
`
`A person of ordinary skill in the art in 2011 (or 2014) would have had (1) at
`
`least a bachelor’s degree in computer science, computer engineering, or electrical
`
`engineering, and (2) at least one year of experience designing graphical user
`
`interfaces for applications such as photo management systems. EX1003, ¶¶41-43.
`
`C. Overview of the ’376 Patent
`
`The ’376 patent “relates generally to the management of digital files” such
`
`as photographs. EX1001, Face, 1:14-17, 1:54-60. It discloses a “web-based digital
`
`file storage system” for “storing and retrieving digital files, such as photos,” and
`
`for tagging, storing, and displaying those files. EX1001, 4:30-36. “[M]ultiple
`
`views from which a user can display his or her digital media files and their tagged
`
`attributes” are disclosed. EX1001, 5:54-6:3.
`
`Figures 5 and 41 are two examples of a “location view.” EX1001, 3:1-2, 4:1-
`
`2, 6:14-19. Both depict interactive maps with locations identified using markers.
`
`Figure 5 uses pins as markers while Figure 41 uses thumbnails with overlaid
`
`counts:
`
`9
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`EX1001, 29:26-42; Fig. 41; EX1003, ¶¶46-48.
`
`Selecting a thumbnail prompts display of a Single Location view (Figure
`
`34). EX1001, 24:3-23, 29:33-40.
`
`
`
`EX1001, Fig. 34; EX1003, ¶49.
`
`
`
`10
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`Another example is Figure 32, which illustrates a Multiple People
`
`Application View and a Single Person Profile Application View, the latter of
`
`which displays thumbnail images of the photos containing that person. EX1001,
`
`22:65-23:11.
`
`
`
`EX1001, Fig. 32; EX1003, ¶50.
`
`In one embodiment, digital tags are assigned to digital files and displayed as
`
`pill-shaped indicators overlaid on the file’s image. EX1001, 9:34-37. The
`
`indicators display information about a digital file, including the name of the tag
`
`(e.g., the name of the person or location associated with the digital file) and the
`
`number of files associated with that tag. EX1001, 20:28-34. Exemplary digital
`
`tags are illustrated in Figure 29:
`
`11
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`EX1001, Fig. 29. These tags serve as “mini search engines” that show the number
`
`of matching files and “if selected will take the user to the corresponding
`
`Application View to illustrate the linked search results” of that digital tag.
`
`
`
`EX1001, 20:20-27.
`
`D.
`
`Prosecution History
`
`The ’376 patent was allowed over certain prior art in response to an
`
`amendment that added the current “[first/second] location view” requirements,
`
`EX1002, 495-503, the Examiner concluding that “the prior art fails to teach or
`
`suggest systems such as those claimed … wherein each view includes each of the
`
`12
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`enumerated elements … in combination with all other intervening limitations of
`
`the claims,” EX1002, 516-517.
`
`VI. CLAIM CONSTRUCTION
`
`Claims are given their “ordinary and customary meaning” as understood by
`
`a skilled artisan and the prosecution history pertaining to the patent. 37 C.F.R.
`
`§ 42.100(b). Petitioner is unaware of any “prior claim construction determination”
`
`related to the ’376 patent. Because a skilled artisan would find the challenged
`
`claims unpatentable under any interpretation consistent with their plain and
`
`ordinary meaning in the context of the ’376 patent, the Board need not expressly
`
`construe the claims. See Vivid Techs., Inc. v. Am. Sci. & Eng.’g. Inc., 200 F.3d
`
`795, 803 (Fed. Cir. 1999).
`
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE
`
`A.
`
`Prior Art Overview
`
`1.
`
`A3UM
`
`The Aperture 3 User Manual (“A3UM”) describes certain features and
`
`interfaces of Apple’s Aperture 3 product, “a powerful and easy-to-use digital
`
`image management system that can track thousands of digital images ….”
`
`EX1005, 1-4.
`
`13
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`a.
`
`Prior Art Status
`
`Extensive evidence establishes that A3UM (EX1005) was a printed
`
`publication that was publicly disseminated in February 2010. As such, A3UM is
`
`prior art under § 102(b) (pre-AIA) and under § 102(a)(1) (AIA) (see §V.A).
`
`Matthew Birdsell is an Apple employee with personal knowledge of the
`
`publication and dissemination of the Aperture 3 User Manual in early 2010.
`
`EX1020, ¶¶2-4. As Mr. Birdsell explains, the Aperture 3 User Manual was
`
`published in early 2010 in two forms: (i) as an HTML file set and (ii) as a PDF file.
`
`EX1020, ¶9. Petitioner relies on the HTML file set form of the Aperture 3 User
`
`Manual (A3UM, EX1005) in this proceeding.
`
`Mr. Birdsell explains that, in February 2010, A3UM (the HTML file set) (i)
`
`was included on the installation DVD in retail packages of Aperture 3 that were
`
`sold and distributed within the United States in early 2010 and was copied to a
`
`computer’s local storage during installation of Aperture 3 (EX1020, ¶¶12-14), and
`
`(ii) was also published on the www.apple.com website (EX1020, ¶¶17-20).
`
`Apple offered for sale, sold, and distributed thousands of retail boxes
`
`containing the Aperture 3 installation DVD to users between February 2010 and
`
`June 9, 2010. EX1020, ¶7 (level of support indicative of hundreds of thousands of
`
`14
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`users); EX1021, 2 (showing “Buy Now” link for Aperture 3 in Feb. 2010)1;
`
`EX1044 (discussing use of a purchased copy in early 2010); EX1045 (same);
`
`EX1048 (announcing Aperture 3’s release on February 9, 2010). This number “far
`
`exceeds the number of disclosures recognized under the relevant dissemination law
`
`for printed publications.” Cisco Sys., Inc. v. Centripetal Networks, Inc., IPR2018-
`
`01436, Paper 40 at 23-31 (Jan. 23, 2020) (finding 586 sales sufficient); Mass. Inst.
`
`of Tech. v. AB Fortia, 774 F.2d 1104, 1109 (Fed. Cir. 1985) (six copies sufficient);
`
`In re Klopfenstein, 380 F.3d 1345, 1349 (Fed. Cir. 2004). Published reports of
`
`experiences using Aperture 3 before June 2010 also show that many individuals
`
`had installed Aperture 3—and thereby transferred A3UM—onto their computers
`
`before June 2010, which required use of the installer DVD supplied via the retail
`
`package of Aperture 3. E.g., EX1044; EX1045; EX1020, ¶7.
`
`Dr. Terveen inspected Aperture 3 retail boxes obtained from Apple and from
`
`two independent sources and confirmed that the installation DVD in each was the
`
`same as the version disseminated in February 2010 (i.e., v3.0). EX1003, ¶¶75
`
`
`1 The Internet Archive’s Wayback Machine archives snapshots of webpages on the
`
`date specified in the URL. EX1022 (Archive.org’s standard affidavit); EX1003,
`
`¶71; SDI Tech., Inc. v. Bose Corp., IPR2013-00465, Paper 40 at 13-16 (PTAB
`
`Nov. 7, 2014).
`
`15
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`(physical DVD), 76-85 (showing early 2010 metadata); EX1047. Dr. Terveen also
`
`confirmed that EX1005 is a true and correct copy of the HTML file set both on the
`
`Aperture 3 installation DVDs and as copied to computers during Aperture 3’s
`
`installation. EX1003, ¶¶73, 90 (in-application Help), 97 (underlying HTML files),
`
`98 (eBay-sourced DVD).
`
`A3UM was made accessible to users of Aperture 3 by selecting
`
`“Help>Aperture Help” from the menu while Aperture was running and clicking
`
`“Aperture 3: User Manual” on the page that appeared (EX1003, ¶¶86-90). This
`
`would retrieve the locally-stored A3UM HTML file set copied during installation.
`
`EX1003, ¶91-97. Contemporaneous Apple publications explain that A3UM is
`
`accessible through in-application help functionality. EX1051, 7 (discussing
`
`Aperture 3’s in-application “link to the user manual”), 159 (same); EX1003, ¶99.
`
`Skilled artisans could obtain A3UM from the Aperture 3 installation DVD or
`
`from computers onto which Aperture 3 had been installed. As Dr. Terveen
`
`demonstrates, using a 2010-era Mac, a skilled artisan can readily obtain the A3UM
`
`HTML file set from the Aperture 3 application bundle, which is in a compressed
`
`file (“Archive.pax.gz”) in the “Aperture.pkg” file on the installation DVD.
`
`EX1003, ¶¶80-82. That same A3UM HTML file set is copied to a specific
`
`location on the local storage of a user’s computer when Aperture 3 is installed.
`
`EX1003, ¶¶78-85, 91-97. EX1020, ¶14. A skilled artisan could access the content
`
`16
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`of A3UM by opening the A3UM HTML file set with a web browser, and would
`
`see the same content and interface when opening the HTML file sets obtained from
`
`the installer DVD or as placed on local storage during installation of Aperture 3.
`
`EX1003, ¶¶91-97.
`
`A3UM was also made publicly accessible via www.apple.com. EX1020,
`
`¶¶17-19; EX1003, ¶¶100-103. As Mr. Birdsell explains, once Aperture 3 was
`
`released, the A3UM HTML file set was loaded onto a publicly accessible website
`
`(http://documentation.apple.com/en/aperture/usermanual/) where it became
`
`accessible to any member of the public starting on the date of commercial sale of
`
`Aperture 3. EX1020, ¶¶9-11. Archived copies of Apple’s website from 2010: (i)
`
`include an embedded URL pointing to the HTML-based User Manual, and (ii)
`
`display the same table of contents entries as A3UM (EX1005), including sub-
`
`sections when manually selected; both show that A3UM was publicly accessible
`
`via the apple.com website before June of 2010. EX1003, ¶103; EX1021, 6.
`
`In 2010, a skilled artisan would have known to visit www.apple.com for
`
`information about Aperture 3 and could have readily located A3UM on the
`
`apple.com website. EX1003, ¶¶100-103. For example, a skilled artisan, exercising
`
`only reasonable diligence, could have located A3UM by following links on the
`
`apple.com web site. EX1003, ¶¶102-103; EX1021; EX1020, ¶¶18-19 (links
`
`leading to Aperture support page (www.apple.com/support/aperture) with URL to
`
`17
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`A3UM). EX1020, ¶18. Alternatively, that person could have located A3UM using
`
`the search feature within the apple.com web site or using well-known search
`
`engines. EX1003, ¶101. Through either approach, a skilled artisan could have
`
`easily located and retrieved A3UM in early 2010.
`
`b. Overview
`
`A3UM discloses a graphical user interface for viewing, managing, and
`
`editing digital files, e.g., photos and videos. E.g., EX1005, 5-44; EX1003, ¶¶105-
`
`106. The interface presents several panes, including (i) a “Viewer” displaying a
`
`selected digital image (EX1005, 51-53), (ii) an “Inspector” pane providing access
`
`to digital images in the user’s library as well as metadata in digital images
`
`(EX1005, 54-63); (iii) a “Browser” pane that “displays the thumbnail images
`
`contained in a folder, project or album” (EX1005, 47-50), and (iv) a toolbar
`
`(EX1005, 64-65):
`
`18
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`
`
`EX1005, 46.
`
`A3UM discloses several “views” that allow users to organize, retrieve and
`
`display sets of digital files. E.g., EX1005, 28-30; EX1003, ¶¶107-108. For
`
`example, selecting “Places” prompts the display of an interactive map (a Google
`
`Map) that shows pins at locations with photos. EX1005, 30, 81-83, 429-466
`
`(generally). Selecting a pin displays the photos in the “Browser” below the map:
`
`19
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`
`
`EX1005, 436-437.
`
`Similarly, selecting the “Faces” view displays snapshots of people in images
`
`in the library or in an item selected in the Library inspector that have been assigned
`
`names. EX1005, 28-29, 78-80, 417-428 (generally). Selecting a snapshot of an
`
`individual prompts display of thumbnails of digital files with that individual in the
`
`“Browser”:
`
`20
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`
`
`EX1005, 78-80.
`
`A3UM extensively uses device-captured or user-entered metadata linked to
`
`digital files to locate and display those files. EX1003, ¶109; see EX1005, 348-351
`
`(describing a Metadata Inspector providing access metadata, e.g., user-defined
`
`“keywords,” “GPS” location data and standardized metadata sets (e.g., “EXIF
`
`Info”, “IPTC Core”)).
`
`21
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`EX1005, 347
`
`EX1005, 350
`
`A3UM explains that users can add or modify metadata related to digital
`
`files. EX1003, ¶110; EX1005, 345 (keywords “are descriptive words assigned to
`
`image versions and saved as metadata.”), 421-422 (users can add names to
`
`computer-recognized faces); 443-446 (users can add location information to digital
`
`files). A3UM explains that the Places and Faces interfaces use metadata to select
`
`and display digital files. E.g., EX1005, 78-81, 344, 347-349, 435.
`
`2.
`
`Belitz
`
`U.S. Patent App. Pub. No. 2010/0058212 A1 to Belitz et al. (EX1006,
`
`“Belitz”) was published on March 4, 2010 and is prior art under 35 U.S.C. § 102(b)
`
`(pre-AIA) or §§ 102(a)(1)-(2) (AIA).
`
`22
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00032
`
`U.S. Patent No. 9,552,376
`
`Belitz discloses a user interface, usable on electronic devices, that includes
`
`an interactive map interface having locations marked with graphical objects
`
`representing where photographs were taken or locations with which photographs
`
`are associated. EX1006, ¶¶1-3, 6, 39, 50-51, 52; EX1003, ¶113. Figures 4a-4b
`
`provide examples of the map interface overlaid with graphical objects. EX1006,
`
`¶¶51-53, 55.
`
`EX1006, Figs. 4a-b.
`
`Selecting one of the graphical objects produces a popup window that
`
`displays representations of images represented by that graphical object:
`
`
`
`23
`PETITION FOR INTER PA