Paper No. 1
`Filed: November 3, 2021
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`––––––––––––––––––
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`––––––––––––––––––
`
`APPLE INC.,
`Petitioner,
`
`v.
`
`MEMORYWEB, LLC,
`Patent Owner.
`
`––––––––––––––––––
`
`Case No. IPR2022-00033
`U.S. Patent No. 10,423,658
`
`––––––––––––––––––
`
`PETITION FOR INTER PARTES REVIEW
`
`
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`TABLE OF CONTENTS
`
`INTRODUCTION ......................................................................................... 1
`I.
`II. COMPLIANCE WITH IPR REQUIREMENTS ....................................... 2
`A.
`Certification of Standing ....................................................................... 2
`B. Mandatory Notices ................................................................................ 2
`1.
`Real Party-in-Interest .................................................................. 2
`2.
`Related Proceedings .................................................................... 2
`3.
`Counsel and Service Information................................................ 3
`IDENTIFICATION OF CHALLENGED CLAIMS .................................. 3
`III.
`IV. TECHNICAL BACKGROUND ................................................................... 4
`A. Digital Photography and Metadata ........................................................ 4
`B. Metadata Standards ............................................................................... 4
`C.
`Photo Organizer Applications and Websites ......................................... 5
`D.
`Common Features of Photo Applications ............................................. 6
`THE ’658 PATENT ....................................................................................... 8
`A.
`Effective Filing Date and AIA Status ................................................... 8
`B.
`Person of Ordinary Skill in the Art ....................................................... 9
`C.
`Overview of the ’658 Patent .................................................................. 9
`D.
`Prosecution History ............................................................................. 11
`VI. CLAIM CONSTRUCTION ........................................................................ 12
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE ..................... 12
`A.
`Prior Art Overview .............................................................................. 12
`1.
`A3UM ....................................................................................... 12
`a.
`Prior Art Status ............................................................... 12
`b.
`Overview ......................................................................... 17
`Belitz ......................................................................................... 21
`Rasmussen ................................................................................. 23
`i
`PETITION FOR INTER PARTES REVIEW
`
`2.
`3.
`
`V.
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`B.
`
`C.
`
`
`
`2.
`
`Claims 1-2 and 5-15 Are Obvious Over A3UM and Belitz ................ 23
`1.
`Belitz Suggests Modifying A3UM to Use Photo Thumbnails
`Instead of Pins in the A3UM Interactive Map .......................... 24
`Claim 1 ...................................................................................... 30
`a.
`Preamble ......................................................................... 30
`b.
`Selectable Elements ........................................................ 36
`c. Map View and Interactive Map ...................................... 37
`d.
`First and Second Location Selectable Thumbnail
`Images ............................................................................. 40
`e.
`First and Second Count Values Images .......................... 44
`f.
`First and Second Location Views ................................... 47
`Claim 2 ...................................................................................... 50
`Claim 5 ...................................................................................... 51
`a.
`People View .................................................................... 51
`b.
`First and Second Person Selectable Thumbnail Images . 52
`c.
`First and Second Names ................................................. 58
`Claim 6 ...................................................................................... 60
`Claims 7 and 10 ......................................................................... 61
`Claims 8 and 11 ......................................................................... 62
`Claims 9 and 12 ......................................................................... 65
`Claim 13 .................................................................................... 66
`a.
`Album Selectable Element and Album View ................. 66
`b.
`First and Second Album Selectable Thumbnail Images 68
`c.
`First and Second Album Names ..................................... 71
`10. Claims 14 and 15....................................................................... 72
`Claims 3-4 Are Obvious Over A3UM, Belitz, and Rasmussen .......... 75
`1.
`“Displaying” the “Map Images” ............................................... 78
`2.
`“Indicating the Geographic Coordinates” ................................. 80
`ii
`PETITION FOR INTER PARTES REVIEW
`
`3.
`4.
`
`5.
`6.
`7.
`8.
`9.
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`4.
`5.
`
`VIII. THE BOARD SHOULD NOT EXERCISE ITS DISCRETION UNDER
`§ 314(a) or § 315(d) ...................................................................................... 84
`A.
`Section 314(a) ...................................................................................... 84
`1.
`Factor 1 (Possibility of Stay) is Neutral .................................... 85
`2.
`Factor 2 (Trial Date) Favors Institution .................................... 85
`3.
`Factor 3 (Investment in Parallel Proceedings) Favors
`Institution .................................................................................. 86
`Factor 4 (Overlapping Issues) Favors Institution ..................... 87
`Factor 5 (Overlapping Parties) is Outweighed by Other
`Factors ....................................................................................... 87
`Factor 6 (Strength of Petition and Other Considerations) Favors
`Institution .................................................................................. 88
`Section 325(d) ..................................................................................... 89
`B.
`IX. CONCLUSION ............................................................................................ 89
`Exhibit List ............................................................................................................. 91
`Certificate of Compliance ...................................................................................... 95
`Certificate of Service .............................................................................................. 96
`
`
`6.
`
`
`
`
`
`
`iii
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00033
`
`I.
`
`INTRODUCTION
`
`U.S. Patent No. 10,423,658
`
`Petitioner Apple Inc. (“Apple”) requests inter partes review of claims 1-15
`
`(“challenged claims”) of U.S. Patent No. 10,423,658 (“’658 patent”). The ’658
`
`patent claims digital photo management methods that use well-known user
`
`interface elements to select and display desired photos using a “map view”
`
`showing the location where photos were taken. The prior art, however, described
`
`photo management systems with these interface elements before early 2011. Most
`
`notably, A3UM—not considered during examination—describes a photo
`
`management system that allows users to select and view digital photos and videos
`
`using locations on an interactive map (“Places”). In fact, the only potential
`
`distinction between the ’658 patent claims and A3UM involves the style of
`
`markers used on the interactive map: A3UM uses pins, while the ’658 patent
`
`requires “thumbnail images.” That distinction cannot render the claims patentable:
`
`Belitz demonstrates that using thumbnail images on interactive maps to select and
`
`display photos was a conventional technique in analogous photo management
`
`systems.
`
`Because the evidence demonstrates that the ’658 patent claims are obvious
`
`based on A3UM in view of Belitz, the Board should institute inter partes review.
`
`1
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`II. COMPLIANCE WITH IPR REQUIREMENTS
`
`A. Certification of Standing
`
`Petitioner certifies that the ’658 patent is available for IPR. Petitioner is not
`
`barred or estopped from requesting an IPR on the challenged claims on the grounds
`
`identified below. Petitioner and its privies have not filed a civil action challenging
`
`the validity of any claim of the ’658 patent. This petition is timely filed within one
`
`year of service of MemoryWeb’s complaint alleging infringement of the ’658
`
`patent against Apple (EX1023; EX1024) and is filed more than 9 months from the
`
`issue date of the ’658 patent (see §V.A).
`
`B. Mandatory Notices
`
`1.
`
`Real Party-in-Interest
`
`Petitioner Apple Inc. is the real party-in-interest for this petition.
`
`2.
`
`Related Proceedings
`
`The ’658 patent is related to the following U.S. Patents: 9,098,531 (“’531
`
`patent,” EX1010); 9,552,376 (“’376 patent,” EX1011); 10,621,228 (“’228 patent,”
`
`EX1012); 11,017,020 (“’020 patent,” EX1014); and 11,163,823.
`
`The ’658 patent is related to the following pending U.S. Patent Applications:
`
`17/381,047 and 17/459,933.
`
`The ’658 patent or related patents are at issue in the following cases:
`
`2
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`Patents
`’228
`’228
`
`’376, ’658,
`’228, ’020
`’658, ’228
`
`’658, ’228
`
`May 25, 2021
`
`May 17, 2021
`
`Apr. 26, 2021
`
`Filing Date
`Case
`Apple Inc. v. MemoryWeb, LLC, IPR2022-00031 Oct. 30, 2021
`Unified Patents, LLC v. MemoryWeb, LLC,
`Sep. 3, 2021
`IPR2021-01413
`MemoryWeb, LLC v. Apple, Inc., No. 6-21-cv-
`00531 (W.D. Tex.)
`MyHeritage (USA), Inc. et al. v. MemoryWeb,
`LLC, No. 1-21-cv-02666 (N.D. Il.) (dismissed)
`MemoryWeb, LLC v. Samsung Electronics Co.,
`Ltd. et al, No. 6-21-cv-00411 (W.D. Tex.)
`
`
`3.
`
`Counsel and Service Information
`
`Lead Counsel
`
`Backup Counsel
`
`Jeffrey P. Kushan
`Reg. No. 43,401
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`jkushan@sidley.com
`(202) 736-8914
`
`Samuel A. Dillon
`Reg. No. 65,197
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`samuel.dillon@sidley.com
`(202) 736-8298
`
`
`
`Kyle S. Smith
`Reg. No. 78,579
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`kyle.smith@sidley.com
`(202) 736-8327
`
`Petitioner consents to service via e-mail at the following address:
`
`
`
`SidleyAppleMemoryWebIPRs@sidley.com.
`
`III.
`
`IDENTIFICATION OF CHALLENGED CLAIMS
`
`Ground 1: Claims 1-2 and 5-15 are unpatentable as obvious under 35
`
`U.S.C. § 103 (AIA or pre-AIA) based on A3UM (EX1005) in view of Belitz
`
`(EX1006).
`
`Ground 2: Claims 3-4 are unpatentable as obvious under 35 U.S.C. § 103
`
`(AIA or pre-AIA) based on A3UM in view of Belitz and Rasmussen (EX1025).
`
`3
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`Petitioner’s challenges are supported by the declaration and testimony of Dr.
`
`Loren Terveen (EX1003), an expert in graphical user interfaces with over 40 years
`
`of experience. See EX1003, ¶¶2-10; EX1004 (CV).
`
`IV. TECHNICAL BACKGROUND
`
`A. Digital Photography and Metadata
`
`Low-cost digital cameras and smartphones, coupled with key standards for
`
`digital images (e.g., JPEG image compression standard and Exchangeable Image
`
`File Format (EXIF) metadata standard) drove a rapid transformation away from
`
`print photography. EX1029, 59-62; EX1036 (EXIF). By 2010, digital
`
`photography had effectively replaced conventional film-based photography.
`
`EX1003, ¶¶56-58. The ability of digital cameras to take and maintain unlimited
`
`photographs for free drove users to accumulate large numbers of digital
`
`photographs. See EX1029, 59. That created a demand for applications that could
`
`efficiently and intuitively retrieve desired images out of large collections of digital
`
`photos. EX1029, 62.
`
`B. Metadata Standards
`
`Before 2010, several standards governing information related to digital
`
`images (metadata) had been established, including: (i) the Exchangeable Image
`
`File format (“EXIF”), (ii) the Information Interchange Model (“IIM”) (aka
`
`“IPTC”), and (iii) the Metadata Working Group Guidelines (“MWGG”). EX1036
`
`4
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`(EXIF); 1037 (IPTC); EX1038 (MWGG); EX1003, ¶59. “Metadata has become a
`
`powerful tool to organize and search through the growing libraries of image, audio
`
`and video content that users are producing and consuming.” EX1038, 6. Metadata
`
`plays a key role “in the consumer workflow,” with user-defined keywords and
`
`location information (where a photo was taken or the location of its subject) as two
`
`important types of metadata for digital files. EX1038, 16-18.
`
`C.
`
`Photo Organizer Applications and Websites
`
`Numerous photo organizer applications and websites existing before 2010
`
`allowed users to manage large collections of digital photographs, and easily
`
`retrieve photos and videos. E.g., EX1031, 1; EX1003, ¶60. Google Picasa, for
`
`example, included a People view where a user could easily select digital photos
`
`containing a given person, and a Places view where a user could view photos taken
`
`at or tagged with particular locations:
`
`
`
`5
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`
`
`EX1032, 1-2; EX1003, ¶60. Other applications with both people-oriented and map-
`
`oriented display capabilities included Apple’s iPhoto and Aperture products.
`
`EX1031, 4; EX1039, 1-3; EX1003, ¶61.
`
`Photo sharing websites were another outgrowth of the digital photography
`
`revolution, such as (by 2010) Flickr, Photobucket, Picasa, Shutterfly, Panoramio,
`
`and Wikimedia Commons. EX1003, ¶62; EX1030, 1-4; EX1043, 1. Many
`
`provided albums, image tagging, the use of thumbnails to select desired photos,
`
`and mapping of the locations where photos were taken. EX1030, 1-3; EX1003,
`
`¶¶62-63. For example, Picasa Web Albums allowed users to browse a map that
`
`displayed “thumbnails of a photo album’s pictures” at the locations where the
`
`photos were taken. EX1033, 1-2. Sites like Flickr let users filter by user or tags,
`
`allowing users to easily identify photographs. EX1033, 2; EX1003, ¶64.
`
`D. Common Features of Photo Applications
`
`Developers of photo applications such as organizers and websites were
`
`constantly extending their products to incorporate functionality found in other
`6
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`products. EX1003, ¶65. By 2010, organizers commonly included photo albums or
`
`collections, thumbnail previews, slideshow functionality, facial recognition, and
`
`metadata tagging. EX1031, 1-4; EX1003, ¶66. This enabled users to group, find,
`
`and sort photographs using person or location metadata. EX1003, ¶66.
`
`By 2010, developers could easily incorporate and combine multiple
`
`functionalities and information sources using public APIs. EX1003, ¶67; EX1035,
`
`7. The Google Maps API (“GM-API”) enabled applications to display interactive
`
`maps that placed markers at specified locations using simple API calls, enabling
`
`retrieval and display of photos at those locations:
`
`
`
`EX1043; EX1040; EX1003, ¶67.
`
`Google illustrated these capabilities in two pre-2010 products: Picasa Web
`
`Albums and Panoramio, which used small images to represent photos locations on
`
`a map and could display associated information in response to user interaction:
`
`7
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`Picasa (2009)
`
`Panoramio (2010)
`
`
`
`EX1033, 2; EX1034, 1; EX1003, ¶68.
`
`Thus, by 2010, the technique of using thumbnail images on an interactive
`
`map to identify the location of photos and enable their retrieval was well-known
`
`and could be easily implemented into both application and web-based photo
`
`organizers. EX1003, ¶69.
`
`V. THE ’658 PATENT
`
`A. Effective Filing Date and AIA Status
`
`The earliest filing date claimed by the ’658 patent is June 9, 2011. EX1001,
`
`Face. Patent Owner has represented in related litigation that claims 1-5 and 7-15
`
`are only entitled to a priority date of February 28, 2014. EX1027, 2. Under either
`
`date, the references at issue are prior art (§§VII.A.1.a, VII.A.2-3) and would have
`
`rendered the challenged claims obvious before June 9, 2011 (EX1003, ¶¶39-40).
`
`8
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`B.
`
`Person of Ordinary Skill in the Art
`
`A person of ordinary skill in the art in 2011 (or 2014) would have had (1) at
`
`least a bachelor’s degree in computer science, computer engineering, or electrical
`
`engineering, and (2) at least one year of experience designing graphical user
`
`interfaces for applications such as photo management systems. EX1003, ¶¶41-43.
`
`C. Overview of the ’658 Patent
`
`The ’658 patent “relates generally to the management of digital files” such
`
`as photographs. EX1001, Face, 1:16-19, 1:56-62. It discloses a “web-based digital
`
`file storage system” for “storing and retrieving digital files, such as photos,” and
`
`for tagging, sorting, and displaying those files. EX1001, 4:32-38. “[M]ultiple
`
`views from which a user can display his or her digital media files and their tagged
`
`attributes” are disclosed. EX1001, 5:54-6:3.
`
`Figures 5 and 41 are two examples of a “location view.” EX1001, 3:3-4, 4:3-
`
`4, 6:14-19. Both depict interactive maps with locations identified using markers.
`
`Figure 5 uses pins as markers while Figure 41 uses thumbnails with overlaid
`
`counts:
`
`
`
`9
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`EX1001, 29:25-41; Fig. 41; EX1003, ¶¶44-48.
`
`Selecting a thumbnail prompts display of a Single Location view (Figure
`
`34). EX1001, 24:1-21, 29:32-39.
`
`
`
`
`
`EX1001, Fig. 34; EX1003, ¶49.
`
`10
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`Figure 32 illustrates two related People Application Views. EX1001, 22:43-
`
`23:34. The Multiple People Application view displays multiple people represented
`
`by thumbnails including their face. EX1001, 22:59-23:11. Selecting a thumbnail
`
`invokes a Single person Profile Application View, which displays thumbnail
`
`images of photos containing that person. EX1001, 22:63-23:34.
`
`
`
`EX1001, Fig. 32; EX1003, ¶¶50-51.
`
`D.
`
`Prosecution History
`
`The Examiner concluded the ’658 patent claims were patentable over each
`
`of Hibino (EX1041) and Tanaka (EX1042) after the claims were amended to recite
`
`“displaying at least a portion of a plurality of (i) digital photographs, (ii) videos,
`
`or (iii) a combination of (i) and (ii)” and to refer to sets of “digital photographs
`
`and videos.” EX1002, 167-177.
`
`11
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`VI. CLAIM CONSTRUCTION
`
`Claims are given their “ordinary and customary meaning” as understood by
`
`a skilled artisan and the prosecution history pertaining to the patent. 37 C.F.R.
`
`§ 42.100(b). Petitioner is unaware of any “prior claim construction determination”
`
`related to the ’658 patent. Because a skilled artisan would find the challenged
`
`claims unpatentable under any interpretation consistent with their plain and
`
`ordinary meaning in the context of the ’658 patent, the Board need not expressly
`
`construe the claims. See Vivid Techs., Inc. v. Am. Sci. & Eng.’g. Inc., 200 F.3d
`
`795, 803 (Fed. Cir. 1999).
`
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE
`
`A.
`
`Prior Art Overview
`
`1.
`
`A3UM
`
`The Aperture 3 User Manual (“A3UM”) describes certain features and
`
`interfaces of Apple’s Aperture 3 product, “a powerful and easy-to-use digital
`
`image management system that can track thousands of digital images ….”
`
`EX1005, 1-4.
`
`a.
`
`Prior Art Status
`
`Extensive evidence establishes that A3UM (EX1005) was a printed
`
`publication that was publicly disseminated in February 2010. As such, A3UM is
`
`prior art under § 102(b) (pre-AIA) and under § 102(a)(1) (AIA) (see §V.A).
`
`12
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`Matthew Birdsell is an Apple employee with personal knowledge of the
`
`publication and dissemination of the Aperture 3 User Manual in early 2010.
`
`EX1020, ¶¶2-4. As Mr. Birdsell explains, the Aperture 3 User Manual was
`
`prepared using an XML-based authoring system and published in early 2010 in
`
`two forms: (i) as an HTML file set and (ii) as a PDF file. EX1020, ¶9. Petitioner
`
`relies on the HTML file set form of the Aperture 3 User Manual (A3UM, EX1005)
`
`in this proceeding.
`
`Mr. Birdsell explains that, in February 2010, A3UM (the HTML file set) (i)
`
`was included on the installation DVD in retail packages of Aperture 3 that were
`
`sold and distributed within the United States in early 2010 and was copied to local
`
`storage of a computer during installation of Aperture 3 (EX1020, ¶¶12-16), and (ii)
`
`was also published on the www.apple.com website (EX1020, ¶¶17-20).
`
`Apple offered for sale, sold, and distributed thousands of retail boxes
`
`containing the Aperture 3 installation DVD to users between February 2010 and
`
`June 9, 2010. EX1020, ¶7 (level of support indicative of hundreds of thousands of
`
`users); EX1021, 2 (showing “Buy Now” link for Aperture 3 in Feb. 2010)1;
`
`
`1 The Internet Archive’s Wayback Machine archives snapshots of webpages on the
`
`date specified in the URL. EX1022 (Archive.org’s standard affidavit); EX1003,
`
`13
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`EX1044 (discussing use of a purchased copy in early 2010); EX1045 (same);
`
`EX1048 (announcing Aperture 3’s release on February 9, 2010). This number “far
`
`exceeds the number of disclosures recognized under the relevant dissemination law
`
`for printed publications.” Cisco Sys., Inc. v. Centripetal Networks, Inc., IPR2018-
`
`01436, Paper 40 at 23-31 (Jan. 23, 2020) (finding 586 sales sufficient); Mass. Inst.
`
`of Tech. v. AB Fortia, 774 F.2d 1104, 1109 (Fed. Cir. 1985) (six copies sufficient);
`
`In re Klopfenstein, 380 F.3d 1345, 1349 (Fed. Cir. 2004). Published reports of
`
`experiences using Aperture 3 before June of 2010 also show that many individuals
`
`had installed Aperture 3—and thereby transferred A3UM—onto their computers
`
`before June 2010, which required use of the installer DVD supplied via the retail
`
`package of Aperture 3. E.g., EX1044; EX1045; EX1020, ¶7.
`
`Dr. Terveen inspected Aperture 3 retail boxes obtained from Apple and from
`
`two independent sources and confirmed that the installation DVD in each was the
`
`same as the version disseminated in February of 2010 (i.e., v3.0). EX1003, ¶¶75
`
`(physical DVD), 76-85 (showing early 2010 metadata); EX1047. Dr. Terveen also
`
`confirmed that EX1005 is a true and correct copy of the HTML file set both on the
`
`Aperture 3 installation DVDs and as copied to computers during Aperture 3’s
`
`
`¶71; SDI Tech., Inc. v. Bose Corp., IPR2013-00465, Paper 40 at 13-16 (PTAB
`
`Nov. 7, 2014).
`
`
`
`14
`PETITION FOR INTER PARTES REVIEW
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`installation. EX1003, ¶¶73, 90 (in-application Help), 97 (underlying HTML files),
`
`98 (eBay-sourced DVD).
`
`A3UM was made accessible to users of Aperture 3 by selecting
`
`“Help>Aperture Help” from the menu while Aperture was running and clicking
`
`“Aperture 3: User Manual” on the page that appeared (EX1003, ¶¶86-90). This
`
`would retrieve the locally-stored A3UM HTML file set copied during installation.
`
`EX1003, ¶91-97. Contemporaneous Apple publications explain that A3UM is
`
`accessible through in-application help functionality. EX1051, 7 (discussing
`
`Aperture 3’s in-application “link to the user manual”), 159 (same); EX1003, ¶99.
`
`Skilled artisans could obtain A3UM from the Aperture 3 installation DVD or
`
`from computers onto which Aperture 3 had been installed. As Dr. Terveen
`
`demonstrates, using a 2010-era Mac, a skilled artisan can readily obtain the A3UM
`
`HTML file set from the Aperture 3 application bundle, which is in a compressed
`
`file (“Archive.pax.gz”) in the “Aperture.pkg” file on the installation DVD.
`
`EX1003, ¶¶80-82. That same A3UM HTML file set is copied to a specific
`
`location on the local storage of a user’s computer when Aperture 3 is installed.
`
`EX1003 ¶¶. EX1003, ¶¶78-85, 91-97. EX1020, ¶14. A skilled artisan could access
`
`the content of A3UM by opening the A3UM HTML file set with a web browser,
`
`and would see the same content and interface when opening the HTML file sets
`
`15
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`obtained from the installer DVD or as placed on local storage during installation of
`
`Aperture 3. EX1003, ¶¶91-97.
`
`A3UM was also made publicly accessible via www.apple.com. EX1020,
`
`¶¶17-19; EX1003, ¶¶100-103. As Mr. Birdsell explains, once Aperture 3 was
`
`released, the A3UM HTML file set was loaded onto a publicly accessible website
`
`(http://documentation.apple.com/en/aperture/usermanual/) where it became
`
`accessible to any member of the public starting on the date of commercial sale of
`
`Aperture 3. EX1020, ¶¶9-11. Archived copies of Apple’s website from 2010: (i)
`
`include an embedded URL pointing to the HTML-based User Manual, and (ii)
`
`display the same table of contents entries as A3UM (EX1005), including sub-
`
`sections when manually selected; both show that A3UM was publicly accessible
`
`via the apple.com website before June of 2010. EX1003, ¶103; EX1021, 6.
`
`In 2010, a skilled artisan would have known to visit www.apple.com for
`
`information about Aperture 3 and could have readily located A3UM on the
`
`apple.com website. EX1003, ¶¶100-103. For example, a skilled artisan, exercising
`
`only reasonable diligence, could have located A3UM by following links on the
`
`apple.com web site. EX1003, ¶¶102-103; EX1021; EX1020, ¶¶18-19 (links
`
`leading to Aperture support page (www.apple.com/support/aperture) with URL to
`
`A3UM). EX1020, ¶18. Alternatively, that person could have located A3UM using
`
`the search feature within the apple.com web site or using well-known search
`16
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`engines. EX1003, ¶101. Through either approach, a skilled artisan could have
`
`easily located and retrieved A3UM in early 2010.
`
`b. Overview
`
`A3UM discloses a graphical user interface for viewing, managing, and
`
`editing digital files, e.g., photos and videos. E.g., EX1005, 5-44; EX1003, ¶¶105-
`
`106. The interface presents several panes, including (i) a “Viewer” displaying a
`
`selected digital image (EX1005, 51-53), (ii) an “Inspector” pane providing access
`
`to collections of digital images in the user’s library as well as metadata in digital
`
`images (EX1005, 54-63); (iii) a “Browser” pane that “displays the thumbnail
`
`images contained in a folder, project or album” (EX1005, 47-50), and (iv) a toolbar
`
`(EX1005, 64-65):
`
`EX1005, 46; EX1003, ¶107.
`
`17
`PETITION FOR INTER PARTES REVIEW
`
`
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`A3UM discloses several “views” that allow users to organize, retrieve and
`
`display sets of digital files. E.g., EX1005, 28-30; EX1003, ¶¶107-108. For
`
`example, selecting “Places” prompts the display of an interactive map (a Google
`
`Map) that shows pins at locations with photos. EX1005, 30, 81-83, 429-466
`
`(generally). Selecting a pin prompts display of the photos in the “Browser” below
`
`the map:
`
`
`
`EX1005, 436-437; EX1003, ¶107.
`
`Similarly, selecting the “Faces” view displays snapshots of people in images
`
`in the library or in an item selected in the Library inspector that have been assigned
`
`names. EX1005, 28-29, 78-80, 417-428 (generally). Selecting a snapshot of an
`
`18
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`individual prompts display of thumbnails of digital files with that individual in the
`
`“Browser”:
`
`
`
`EX1005, 78-80; EX1003, ¶108.
`
`A3UM makes extensive use of device-captured or user-entered metadata
`
`linked to digital files to locate and display those files. EX1003, ¶109; see EX1005,
`
`348-351 (describing a Metadata Inspector providing access to different categories
`
`of metadata, including user-defined “keywords.” “GPS” location data and
`
`standardized metadata sets (e.g., “EXIF Info”, “IPTC Core”).
`
`19
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`EX1005, 347
`
`EX1005, 350
`
`A3UM explains that users can add or modify metadata related to digital
`
`files. EX1003, ¶110; EX1005, 345 (keywords “are descriptive words assigned to
`
`image versions and saved as metadata.”), 421-422 (users can add names to
`
`computer-recognized faces); 443-446 (users can add location information by
`
`dropping photos on a map or by typing location names in search box and assigning
`
`found locations to digital files). A3UM explains that the Places and Faces
`
`interfaces use metadata to select and display digital files. E.g., EX1005, 78-81,
`
`344, 347-349, 435.
`
`20
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`2.
`
`Belitz
`
`U.S. Patent App. Pub. No. 2010/0058212 A1 to Belitz et al. (EX1006,
`
`“Belitz”) was published on March 4, 2010 and is prior art under 35 U.S.C. § 102(b)
`
`(pre-AIA) or §§ 102(a)(1)-(2) (AIA).
`
`Belitz discloses a user interface, usable on electronic devices, that includes
`
`an interactive map interface having locations marked with graphical objects
`
`representing where photographs were taken or locations with which photographs
`
`are associated. EX1006, ¶¶1-3, 6, 39, 50-51, 52; EX1003, ¶113. Figures 4a-4b
`
`provide examples of the map interface overlaid with graphical objects. EX1006,
`
`¶¶51-53, 55.
`
`EX1006, Figs. 4a-b; EX1003, ¶113.
`
`Selecting one of the graphical objects produces a popup window that
`
`displays representations of images represented by that graphical object:
`
`
`
`21
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`
`
`EX1006, ¶60, Fig. 4c; EX1003, ¶117.
`
`Belitz teaches that in an embodiment where all graphical objects are
`
`photographs, the photographs will be represented as thumbnails on its interactive
`
`map. EX1006, ¶62; EX1003, ¶113. In this embodiment, Belitz teaches that the
`
`graphical objects include numbers (in green) overlaid on the top right corner of the
`
`thumbnails (in orange) representing the number of photographs associated with
`
`that location. EX1006, ¶¶54-56, 59, 62.
`
`EX1006, Figs. 4a-4b (annotated and excerpted); EX1003, ¶¶114-116.
`22
`PETITION FOR INTER PARTES REVIEW
`
`
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`3.
`
`Rasmussen
`
`U.S. Patent No. 7,620,496 to Rasmussen (“Rasmussen,” EX1025) is prior art
`
`under 35 U.S.C. § 102(b) (pre-AIA) or §§ 102(a)(1)-(2) (AIA). Rasmussen
`
`discloses a digital mapping system based on Google Maps. It teaches, inter alia,
`
`display options available through the GM-API that support detailed location
`
`information, including the technique of displaying a map marker popup window
`
`(215) comprising “latitude/longitude and/or geocode information”:
`
`
`
`EX1025, 1:18-20, 10:25-29, Fig. 2; EX1003, ¶118.
`
`B. Claims 1-2 and 5-15 Are Obvious Over A3UM and Belitz
`
`A3UM discloses a photo organizer with an interface that can display a
`
`“Places” view comprising an interactive Google Map with multiple user-selectable
`
`23
`PETITION FOR INTER PARTES REVIEW
`
`
`
`

`

`IPR2022-00033
`
`U.S. Patent No. 10,423,658
`
`pins at different locations. E.g., EX1005, 28-30, 78-83, 417-420, 429-432. With
`
`the possible exception of “thumbnail image,” A3UM’s disclosure meets every
`
`limitation of the contested claims.
`
`The breadth of the claim term “thumbnail image” has been disputed in
`
`related proceedings. See EX1046, 168-169 (Patent Owner alleging “thumbnail
`
`image” encompasses an orange circle), 7-8 (¶¶25, 30). To the extent the pins used
`
`in A