Paper No. 1
`Filed: October 30, 2021
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`––––––––––––––––––
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`––––––––––––––––––
`
`APPLE INC.,
`Petitioner,
`
`v.
`
`MEMORYWEB, LLC,
`Patent Owner.
`
`––––––––––––––––––
`
`Case No. IPR2022-00031
`U.S. Patent No. 10,621,228
`
`––––––––––––––––––
`
`PETITION FOR INTER PARTES REVIEW
`
`
`
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`TABLE OF CONTENTS
`
`INTRODUCTION ......................................................................................... 1
`I.
`II. COMPLIANCE WITH IPR REQUIREMENTS ....................................... 2
`A.
`Certification of Standing ....................................................................... 2
`B. Mandatory Notices ................................................................................ 2
`1.
`Real Party-in-Interest .................................................................. 2
`2.
`Related Proceedings .................................................................... 2
`3.
`Counsel and Service Information................................................ 3
`IDENTIFICATION OF CHALLENGED CLAIMS .................................. 3
`III.
`IV. TECHNICAL BACKGROUND ................................................................... 4
`A. Digital Photography and Metadata ........................................................ 4
`B. Metadata Standards ............................................................................... 4
`C.
`Photo Organizer Applications and Websites ......................................... 5
`D.
`Common Features of Photo Applications ............................................. 7
`THE ’228 PATENT ....................................................................................... 9
`A.
`Effective Filing Date and AIA Status ................................................... 9
`B.
`Person of Ordinary Skill in the Art ....................................................... 9
`C.
`Overview of the ’228 Patent .................................................................. 9
`D.
`Prosecution History ............................................................................. 12
`VI. CLAIM CONSTRUCTION ........................................................................ 12
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE ..................... 13
`A.
`Prior Art Overview .............................................................................. 13
`1.
`A3UM ....................................................................................... 13
`a.
`Prior Art Status ............................................................... 13
`b.
`Overview ......................................................................... 17
`2.
`Belitz ......................................................................................... 22
`Claims 1-19 Are Obvious Over A3UM and Belitz ............................. 24
`
`V.
`
`B.
`
`i
`PETITION FOR INTER PARTES REVIEW
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`1.
`
`2.
`
`Belitz Suggests Modifying A3UM to Use Photo Thumbnails
`Instead of Pins in the A3UM Interactive Map .......................... 24
`Claim 1 ...................................................................................... 31
`a.
`Preamble and Map View ................................................ 31
`b.
`First and Second Location Selectable Thumbnail Images
` ........................................................................................ 35
`c.
`First and Second Location Views ................................... 39
`d.
`People View .................................................................... 44
`e.
`First and Second Person Selectable Thumbnail Images . 46
`f.
`First and Second Names ................................................. 53
`3.
`Claims 2 and 5 ........................................................................... 55
`4.
`Claims 3 and 6 ........................................................................... 58
`5.
`Claims 4 and 7 ........................................................................... 59
`6.
`Claims 8 and 9 ........................................................................... 60
`7.
`Claim 10 .................................................................................... 62
`8.
`Claim 11 .................................................................................... 64
`9.
`Claim 12 .................................................................................... 67
`10. Claim 13 .................................................................................... 68
`11. Claim 14 .................................................................................... 70
`12. Claim 15 .................................................................................... 72
`13. Claim 16 .................................................................................... 73
`14. Claim 17 .................................................................................... 76
`15. Claims 18 and 19....................................................................... 78
`VIII. THE BOARD SHOULD NOT EXERCISE ITS DISCRETION UNDER
`§ 314(a) or § 315(d) ...................................................................................... 79
`A.
`Section 314(a) ...................................................................................... 80
`1.
`Factor 1 (Possibility of Stay) is Neutral .................................... 80
`2.
`Factor 2 (Trial Date) Favors Institution .................................... 80
`
`ii
`PETITION FOR INTER PARTES REVIEW
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`3.
`
`4.
`5.
`
`Factor 3 (Investment in Parallel Proceedings) Favors Institution
` ................................................................................................... 82
`Factor 4 (Overlapping Issues) Favors Institution ..................... 82
`Factor 5 (Overlapping Parties) is Outweighed by Other Factors
` ................................................................................................... 83
`Factor 6 (Strength of Petition and Other Considerations) Favors
`Institution .................................................................................. 83
`Section 325(d) ..................................................................................... 85
`B.
`IX. CONCLUSION ............................................................................................ 85
`Exhibit List ............................................................................................................. 86
`Certificate of Compliance ...................................................................................... 90
`Certificate of Service .............................................................................................. 91
`
`
`6.
`
`
`
`
`
`iii
`PETITION FOR INTER PARTES REVIEW
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`I.
`
`INTRODUCTION
`
`U.S. Patent No. 10,621,228
`
`Petitioner Apple Inc. (“Apple”) requests inter partes review of claims 1-19
`
`(“challenged claims”) of U.S. Patent No. 10,621,228 (“’228 patent”). The ’228
`
`patent claims digital photo management methods that use two well-known user
`
`interface elements to select and display desired photos: (i) a “map view” showing
`
`the location where photos were taken and (ii) a “people view” that uses faces of
`
`people to select and display digital photos containing those people. Patent Owner
`
`MemoryWeb LLC secured allowance of the challenged claims over unrelated prior
`
`art by adding a “People view” requirement to its claims.
`
`The prior art, however, described photo management systems with both
`
`interface elements before early 2011. Most notably, A3UM—not considered
`
`during examination—describes a photo management system that allows users to
`
`select and view digital photos using locations on an interactive map (“Places”) and
`
`by individuals in digital images (“Faces”). The only potential distinction between
`
`the ’228 patent claims and A3UM involves the style of markers used on the
`
`interactive map: A3UM uses pins, while the ’228 patent requires “thumbnail
`
`images.” That distinction cannot render the claims patentable, as Belitz teaches
`
`using thumbnail images on interactive maps to select and display photos.
`
`Because the evidence demonstrates that the ’228 patent claims are obvious
`
`based on A3UM in view of Belitz, the Board should institute inter partes review.
`
`1
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`II. COMPLIANCE WITH IPR REQUIREMENTS
`A. Certification of Standing
`
`Petitioner certifies that the ’228 patent is available for IPR. Petitioner is not
`
`barred or estopped from requesting an IPR on the challenged claims on the grounds
`
`identified below. Petitioner and its privies have not filed a civil action challenging
`
`the validity of any claim of the ’228 patent. This petition is timely filed within one
`
`year of service of MemoryWeb’s complaint alleging infringement of the ’228
`
`patent against Apple (EX1023; EX1024) and is filed more than 9 months from the
`
`issue date of the ’228 patent (see §V.A).
`
`B. Mandatory Notices
`
`1.
`
`Real Party-in-Interest
`
`Petitioner Apple Inc. is the real party-in-interest for this petition.
`
`2.
`
`Related Proceedings
`
`The ’228 patent is related to the following U.S. Patents: 9,098,531 (“’531
`
`patent,” EX1010); 9,552,376 (“’376 patent,” EX1011); 10,423,658 (“’658 patent,”
`
`EX1012); and 11,017,020 (“’020 patent,” EX1014).
`
`The ’228 patent is related to the following pending U.S. Patent Applications:
`
`16/536,300; 17/381,047; and 17/459,933.
`
`The ’228 patent or related patents are or were at issue in the following cases:
`
`2
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`Filing Date
`Sep. 3, 2021
`
`Patents
`’228
`
`May 25, 2021
`
`May 17, 2021
`
`’376, ’658,
`’228, ’020
`’658, ’228
`
`Apr. 26, 2021
`
`’658, ’228
`
`Case
`Unified Patents, LLC v. MemoryWeb, LLC,
`IPR2021-01413
`MemoryWeb, LLC v. Apple, Inc., No. 6-21-cv-
`00531 (W.D. Tex.)
`MyHeritage (USA), Inc. et al. v. MemoryWeb,
`LLC, No. 1-21-cv-02666 (N.D. Il.) (dismissed)
`MemoryWeb, LLC v. Samsung Electronics Co.,
`Ltd. et al, No. 6-21-cv-00411 (W.D. Tex.)
`
`
`3.
`
`Counsel and Service Information
`
`Lead Counsel
`
`Backup Counsel
`
`Jeffrey P. Kushan
`Reg. No. 43,401
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`jkushan@sidley.com
`(202) 736-8914
`
`Samuel A. Dillon
`Reg. No. 65,197
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`samuel.dillon@sidley.com
`(202) 736-8298
`
`
`
`Kyle S. Smith
`Reg. No. 78,579
`SIDLEY AUSTIN LLP
`1501 K Street, N.W.
`Washington, D.C. 20005
`kyle.smith@sidley.com
`(202) 736-8327
`
`Petitioner consents to service via e-mail at the following address:
`
`
`
`SidleyAppleMemoryWebIPRs@sidley.com.
`
`III.
`
`IDENTIFICATION OF CHALLENGED CLAIMS
`
`Claims 1-19 are unpatentable as obvious under 35 U.S.C. § 103 (AIA or pre-
`
`AIA) based on A3UM (EX1005) in view of Belitz (EX1006).
`
`Petitioner’s challenges are supported by the declaration and testimony of Dr.
`
`Loren Terveen (EX1003), an expert in graphical user interfaces with over 40 years
`
`of experience. See EX1003, ¶¶2-10; EX1004 (CV).
`
`3
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`IV. TECHNICAL BACKGROUND
`A. Digital Photography and Metadata
`
`The advent of low-cost digital cameras and smartphones, coupled with the
`
`establishment of key standards for digital images (e.g., JPEG image compression
`
`standard and Exchangeable Image File Format (EXIF) metadata standard) drove a
`
`rapid transformation away from print photography at the end of the last century.
`
`EX1029, 59-62; EX1036 (EXIF). By 2010, digital photography had effectively
`
`replaced conventional film-based photography. EX1003, ¶¶55-56. The increased
`
`availability of digital cameras and the ability to take and maintain unlimited
`
`numbers of photographs for free drove users to accumulate large numbers of
`
`digital photographs. See EX1029, 59; EX1003, ¶57. That, in turn, created a
`
`market demand for digital photo management applications that could efficiently
`
`and intuitively retrieve desired images out of a large collection of digital photos.
`
`EX1029, 62.
`
`B. Metadata Standards
`
`Before 2010, several standards governing information related to digital
`
`images (metadata) had been established, including: (i) the Exchangeable Image
`
`File format (“EXIF”), (ii) the Information Interchange Model (“IIM”) (aka
`
`“IPTC”), and (iii) the Metadata Working Group Guidelines (“MWGG”). EX1036
`
`(EXIF); 1037 (IPTC); EX1038 (MWGG); EX1003, ¶58. “Metadata has become a
`
`4
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`powerful tool to organize and search through the growing libraries of image, audio
`
`and video content that users are producing and consuming.” EX1038, 6. Metadata
`
`plays a key role “in the consumer workflow,” with user-defined keywords and
`
`location information (where a photo was taken or the location of its subject) as two
`
`important types of metadata for digital files. EX1038, 16-18.
`
`C.
`
`Photo Organizer Applications and Websites
`
`Numerous photo organizer applications and websites existing before 2010
`
`allowed users to manage large collections of digital photographs, and easily
`
`retrieve digital images, including photos and videos. E.g., EX1031, 1; EX1003,
`
`¶59. One example was Google Picasa, which included both a People view, which
`
`allowed a user to easily select digital photos containing a given person, and a
`
`Places view, which allowed a user to view photos taken at or tagged with a
`
`particular location:
`
`
`
`5
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1032, 1-2; EX1003, ¶59. Other applications with both people-oriented and
`
`map-oriented display capabilities included Apple’s iPhoto and Aperture products.
`
`EX1031, 4; EX1039, 1-3; EX1003, ¶60.
`
`Photo sharing websites were another outgrowth of the digital photography
`
`revolution. EX1003, ¶61. By 2010, numerous such websites existed that allowed
`
`users to upload and share their digital photographs, including Flickr, Photobucket,
`
`Picasa, Shutterfly, Panoramio and Wikimedia Commons. EX1003, ¶61; e.g.,
`
`EX1030, 1, 4. Many adopted the common features of photo organizer
`
`applications, including albums, image tagging, use of thumbnails to select desired
`
`photos, and mapping of the locations where photos were taken. E.g., EX1030, 1,
`
`3; EX1043, 1; EX1003, ¶¶61-62. For example, Picasa Web Albums allowed users
`
`to browse a map that displayed “thumbnails of a photo album’s pictures” at the
`
`locations where the photos were taken. EX1033, 1-2. Sites like Flickr included
`
`powerful filtering functionality that let users filter by specific users or tags,
`
`allowing users to easily identify photographs. EX1033, 2; EX1003, ¶63.
`
`6
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`D. Common Features of Photo Applications
`
`Developers of photo applications such as organizers and websites were
`
`constantly extending their products to incorporate functionality found in other
`
`products. EX1003, ¶64. By 2010, common features of such organizers included:
`
`(i) the use of albums or collections to identify sets of photos, (ii) use of thumbnail
`
`previews of images to enable easier selection/display of desired photos, (iii)
`
`slideshow functionality, (iv) facial recognition and (v) the use of tags that enabled
`
`users to associate keywords and other information (metadata) with individual
`
`photos. E.g., EX1031, 1-4; EX1003, ¶65. The latter capability enabled users to
`
`group, find and sort photographs using the identity of individuals in the photos or
`
`location information linked to the photos. EX1003, ¶65.
`
`By 2010, developers could easily incorporate and combine multiple
`
`functionalities and information sources using application programming interfaces
`
`(APIs) of public data services. EX1003, ¶66; e.g., EX1035, 7. For example, the
`
`Google Maps API (“GM-API”) enabled photo collection applications and websites
`
`to display an interactive map that placed interactive map markers at specified
`
`locations using simple API calls enabling retrieval and display of photos at those
`
`locations:
`
`7
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1043; EX1040; EX1003, ¶66.
`
`Google illustrated these capabilities in two pre-2010 products: Picasa Web
`
`Albums and Panoramio. EX1033, 2; EX1034, 1. Each product used small images
`
`to represent photos locations on a map and could display associated information in
`
`response to user interaction:
`
`Picasa (2009)
`
`Panoramio (2010)
`
`
`
`EX1033, 2; EX1034, 1; EX1003, ¶67. By 2010, a skilled artisan thus could easily
`
`provide an interactive map in a website or application having locations marked
`
`8
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`with thumbnails of digital images, and to retrieve and display information linked to
`
`those marked locations. EX1003, ¶68.
`
`V. THE ’228 PATENT
`A. Effective Filing Date and AIA Status
`
`The earliest filing date claimed by the ’228 patent is June 9, 2011. EX1001,
`
`Face. Patent Owner has represented in related litigation that claims 1-9, 12, 14-15,
`
`and 17-19 are only entitled to a priority date of February 28, 2014. EX1027, 2.
`
`Under either date, the references at issue are prior art (§§VII.A.1.a, VII.A.2) and
`
`would have rendered the challenged claims obvious before June 9, 2011 (EX1003,
`
`¶¶39-40).
`
`B.
`
`Person of Ordinary Skill in the Art
`
`A person of ordinary skill in the art in the field of the ’228 patent in 2011 (or
`
`2014) would have had (1) at least a bachelor’s degree in computer science,
`
`computer engineering, or electrical engineering, and (2) at least one year of
`
`experience designing graphical user interfaces for applications such as photo
`
`management systems. EX1003, ¶¶41-43.
`
`C. Overview of the ’228 Patent
`
`The ’228 patent “relates generally to the management of digital files … such
`
`as digital photographs.” EX1001, Face, 1:21-24, 1:61-67; EX1003, ¶44. The ’228
`
`patent discloses a “web-based digital file storage system” including a “digital file
`
`9
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`repository for storing and retrieving digital files, such as photos, a digital tagging
`
`system configured to assign digital tags to the digital files, a sorting system, and a
`
`user interface.” EX1001, 4:36-42; EX1003, ¶45. “[M]ultiple views from which a
`
`user can display his or her digital media files and their tagged attributes” are
`
`disclosed. EX1001, 5:58-6:7; EX1003, ¶45.
`
`The ’228 Patent provides two illustrations of a “location view” in Figures 5
`
`and 41. EX1001, 3:7-8 (“FIG. 5 is a screenshot of a location view of one
`
`embodiment of the disclosed system.”), 4:7-8, 6:18-23. Both depict an interactive
`
`map with locations identified using map markers. In Figure 5, pins are used to
`
`denote the location of photos, while in Figure 41 thumbnails with overlaid counts
`
`are used:
`
`EX1001, 29:41-57; Fig. 41; EX1003, ¶¶46-48.
`
`
`
`10
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`The ’228 patent explains that selecting a thumbnail prompts display of a
`
`Single Location view (Figure 34). EX1001, 24:16-36, 29:48-55.
`
`
`
`EX1001, Fig. 34; EX1003, ¶49.
`
`Another example is Figure 32, which illustrates two related People
`
`Application Views. EX1001, 22:59-23:49. The Multiple People Application view
`
`displays multiple people represented by thumbnails including their face. EX1001,
`
`22:59-23:11. By selecting one of these thumbnails, the user invokes a Single
`
`person Profile Application View, which displays thumbnail images of the photos
`
`containing that person. EX1001, 23:12-49.
`
`11
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1001, Fig. 32; EX1003, ¶50.
`
`D.
`
`Prosecution History
`
`The Examiner concluded the ’228 patent claims were patentable over each
`
`of Hibino (EX1041) and Tanaka (EX1042) because the claims required both (i) a
`
`map view that allows locations to be selected and corresponding digital photos to
`
`be displayed and (ii) a people view that allows faces to be selected and
`
`corresponding digital photos to be displayed. EX1002, 361-363.
`
`VI. CLAIM CONSTRUCTION
`
`Claims are given their “ordinary and customary meaning … as understood
`
`by one of ordinary skill in the art and the prosecution history pertaining to the
`
`patent.” 37 C.F.R. § 42.100(b); 83 Fed. Reg. 51,340, 51,358-51,359 (Oct. 11,
`
`2018). Petitioner is unaware of any “prior claim construction determination”
`
`12
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`related to the ’228 patent. See 37 C.F.R. § 42.100(b). Because a skilled artisan
`
`would find the challenged claims unpatentable under any interpretation consistent
`
`with their plain and ordinary meaning in the context of the ’228 patent, the Board
`
`need not expressly construe the claims. See Vivid Techs., Inc. v. Am. Sci. &
`
`Eng.’g. Inc., 200 F.3d 795, 803 (Fed. Cir. 1999).
`
`VII. THE CHALLENGED CLAIMS ARE UNPATENTABLE
`A.
`
`Prior Art Overview
`1.
`
`A3UM
`a.
`
`Prior Art Status
`
`Extensive evidence establishes that A3UM (EX1005) was a printed
`
`publication that was publicly disseminated in February 2010. As such, A3UM is
`
`prior art under § 102(b) (pre-AIA) and under § 102(a)(1) (AIA) (see §V.A).
`
`Matthew Birdsell is an Apple employee with personal knowledge of the
`
`publication and dissemination of the Aperture 3 User Manual in early 2010.
`
`EX1020, ¶¶2-4. As Mr. Birdsell explains, the Aperture 3 User Manual was
`
`prepared using an XML-based authoring system and published in early 2010 in
`
`two forms: (i) as an HTML file set and (ii) as a PDF file. EX1020, ¶9. Petitioner
`
`relies on the HTML file set form of the Aperture 3 User Manual (A3UM, EX1005)
`
`in this proceeding.
`
`13
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`Mr. Birdsell explains that, in February 2010, A3UM (the HTML file set) (i)
`
`was included on the installation DVD in retail packages of Aperture 3 that were
`
`sold and distributed within the United States in early 2010 and was copied to local
`
`storage of a computer during installation of Aperture 3 (EX1020, ¶¶12-16), and (ii)
`
`was also published on the www.apple.com website (EX1020, ¶¶17-20).
`
`Apple offered for sale, sold, and distributed thousands of retail boxes
`
`containing the Aperture 3 installation DVD to users between February 2010 and
`
`June 9, 2010. EX1020, ¶7 (level of support indicative of hundreds of thousands of
`
`users); EX1021, 2 (showing “Buy Now” link for Aperture 3 in Feb. 2010)1;
`
`EX1044 (discussing use of a purchased copy in early 2010); EX1045 (same);
`
`EX1048 (announcing Aperture 3’s release on February 9, 2010). This number “far
`
`exceeds the number of disclosures recognized under the relevant dissemination law
`
`for printed publications.” Cisco Sys., Inc. v. Centripetal Networks, Inc., IPR2018-
`
`01436, Paper 40 at 23-31 (Jan. 23, 2020) (finding 586 sales sufficient); Mass. Inst.
`
`of Tech. v. AB Fortia, 774 F.2d 1104, 1109 (Fed. Cir. 1985) (six copies sufficient);
`
`
`1 The Internet Archive’s Wayback Machine archives snapshots of webpages on the
`
`date specified in the URL. EX1022 (Archive.org’s standard affidavit); EX1003,
`
`¶70; SDI Tech., Inc. v. Bose Corp., IPR2013-00465, Paper 40 at 13-16 (PTAB
`
`Nov. 7, 2014).
`
`14
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`In re Klopfenstein, 380 F.3d 1345, 1349 (Fed. Cir. 2004). Published reports of
`
`experiences using Aperture 3 before June of 2010 also show that many individuals
`
`had installed Aperture 3—and thereby transferred A3UM—onto their computers
`
`before June 2010, which required use of the installer DVD supplied via the retail
`
`package of Aperture 3. E.g., EX1044; EX1045; See also EX1020, ¶7.
`
`Dr. Terveen inspected Aperture 3 retail boxes obtained from Apple and from
`
`two independent sources and confirmed that the installation DVD in each was the
`
`same as the version disseminated in February of 2010 (i.e., v3.0). EX1003, ¶¶74
`
`(physical DVD), 75-84 (showing early 2010 metadata); EX1047. Dr. Terveen also
`
`confirmed that EX1005 is a true and correct copy of the HTML file set both on the
`
`Aperture 3 installation DVDs and as copied to computers during Aperture 3’s
`
`installation. EX1003, ¶¶73, 89 (in-application Help), 96 (underlying HTML files),
`
`97 (eBay-sourced DVD).
`
`A3UM was made accessible to users of Aperture 3 by selecting
`
`“Help>Aperture Help” from the menu while Aperture was running and clicking
`
`“Aperture 3: User Manual” on the page that appeared (EX1003, ¶¶85-89). This
`
`would retrieve the locally-stored A3UM HTML file set copied during installation.
`
`EX1003, ¶90-96. Contemporaneous Apple publications explain that A3UM is
`
`accessible through in-application help functionality. EX1051, 7 (discussing
`
`Aperture 3’s in-application “link to the user manual”), 159 (same); EX1003, ¶98.
`
`15
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`Skilled artisans could obtain A3UM from the Aperture 3 installation DVD or
`
`from computers onto which Aperture 3 had been installed. As Dr. Terveen
`
`demonstrates, using a 2010-era Mac, a skilled artisan can readily obtain the A3UM
`
`HTML file set from the Aperture 3 application bundle, which is in a compressed
`
`file (“Archive.pax.gz”) in the “Aperture.pkg” file on the installation DVD.
`
`EX1003, ¶¶79-81. That same A3UM HTML file set is copied to a specific
`
`location on the local storage of a user’s computer when Aperture 3 is installed.
`
`EX1003, ¶¶77-84, 90-96. EX1020, ¶14. A skilled artisan could access the content
`
`of A3UM by opening the A3UM HTML file set with a web browser, and would
`
`see the same content and interface when opening the HTML file sets obtained from
`
`the installer DVD or as placed on local storage during installation of Aperture 3.
`
`EX1003, ¶¶90-96.
`
`A3UM was also made publicly accessible via www.apple.com. EX1020,
`
`¶¶17-19; EX1003, ¶¶99-102. As Mr. Birdsell explains, once Aperture 3 was
`
`released, the A3UM HTML file set was loaded onto a publicly accessible website
`
`(http://documentation.apple.com/en/aperture/usermanual/) where it became
`
`accessible to any member of the public starting on the date of commercial sale of
`
`Aperture 3. EX1020, ¶¶9-11. Archived copies of Apple’s website from 2010: (i)
`
`include an embedded URL pointing to the HTML-based User Manual, and (ii)
`
`display the same table of contents entries as A3UM (EX1005), including sub-
`
`16
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`sections when manually selected; both show that A3UM was publicly accessible
`
`via the apple.com website before June of 2010. EX1003, ¶¶101-102; EX1021, 6.
`
`In 2010, a skilled artisan would have known to visit www.apple.com for
`
`information about Aperture 3 and could have readily located A3UM on the
`
`apple.com website. EX1003, ¶¶99-102. For example, a skilled artisan, exercising
`
`only reasonable diligence, could have located A3UM by following links on the
`
`apple.com web site. EX1003, ¶¶101-102; EX1021; EX1020, ¶¶18-19 (links
`
`leading to Aperture support page (www.apple.com/support/aperture) with URL to
`
`A3UM). EX1020, ¶18. Alternatively, that person could have located A3UM using
`
`the search feature within the apple.com web site or using well-known search
`
`engines. EX1003, ¶100. Through either approach, a skilled artisan could have
`
`easily located and retrieved A3UM in early 2010.
`
`b. Overview
`
`A3UM discloses a graphical user interface for viewing, managing, and
`
`editing digital files, e.g., photos and videos. E.g., EX1005, 5-44; EX1003, ¶¶104-
`
`105. The interface presents several panes, including (i) a “Viewer” displaying a
`
`selected digital image (EX1005, 51-53), (ii) an “Inspector” pane providing access
`
`to collections of digital images in the user’s library as well as metadata in digital
`
`images (EX1005, 54-63); (iii) a “Browser” pane that “displays the thumbnail
`
`17
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`images contained in a folder, project or album” (EX1005, 47-50), and (iv) a toolbar
`
`(EX1005, 64-65):
`
`
`
`EX1005, 46; EX1003, ¶¶105-106
`
`A3UM discloses several “views” that allow users to organize, retrieve and
`
`display sets of digital files. E.g., EX1005, 28-30; EX1003, ¶¶106-107. For
`
`example, selecting “Places” prompts the display of an interactive map (a Google
`
`Map) that shows pins at locations with photos. EX1005, 30, 81-83, 429-466
`
`(generally). Selecting a pin prompts display of the photos in the “Browser” below
`
`the map:
`
`18
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1005, 436-437; EX1003, ¶106.
`
`Similarly, selecting the “Faces” view displays snapshots of people in images
`
`in the library or in an item selected in the Library inspector that have been assigned
`
`names. EX1005, 28-29, 78-80, 417-428 (generally). Selecting a snapshot of an
`
`individual prompts display of thumbnails of digital files with that individual in the
`
`“Browser”:
`
`19
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1005, 78-80; EX1003, ¶107.
`
`A3UM makes extensive use of device-captured or user-entered metadata
`
`linked to digital files to locate and display those files. EX1003, ¶108; see EX1005,
`
`348-351 (describing a Metadata Inspector providing access to different categories
`
`of metadata, including user-defined “keywords.” “GPS” location data and
`
`standardized metadata sets (e.g., “EXIF Info”, “IPTC Core”).
`
`20
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`EX1005, 347
`
`EX1005, 350
`
`A3UM explains that users can add or modify metadata related to digital
`
`files. EX1003, ¶109; EX1005, 345 (keywords “are descriptive words assigned to
`
`image versions and saved as metadata.”), 421-422 (users can add names to
`
`computer-recognized faces); 443-446 (users can add location information by
`
`dropping photos on a map or by typing location names in search box and assigning
`
`found locations to digital files). A3UM explains that the Places and Faces
`
`interfaces use metadata to select and display digital files. E.g., EX1005, 78-81,
`
`344, 347-349, 435; EX1003, ¶109.
`
`21
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`2.
`
`Belitz
`
`U.S. Patent App. Pub. No. 2010/0058212 A1 to Belitz et al. (EX1006,
`
`“Belitz”) was published on March 4, 2010 and is prior art under 35 U.S.C. § 102(b)
`
`(pre-AIA) or §§ 102(a)(1)-(2) (AIA).
`
`Belitz discloses a user interface, usable on electronic devices, that includes
`
`an interactive map interface having locations marked with graphical objects
`
`representing where photographs were taken or locations with which photographs
`
`are associated. EX1006, ¶¶1-3, 6, 39, 50-51, 52; EX1003, ¶112. Figures 4a-4b
`
`provide examples of the map interface overlaid with graphical objects. EX1006,
`
`¶¶51-53, 55.
`
`EX1006, Figs. 4a-b.
`
`Selecting one of the graphical objects produces a popup window that
`
`displays representations of images represented by that graphical object:
`
`
`
`22
`
`MemoryWeb Ex. 2007
`Samsung v. MemoryWeb – IPR2022-00222
`
`

`

`IPR2022-00031
`
`U.S. Patent No. 10,621,228
`
`
`
`EX1006, ¶60, Fig. 4c; EX1003, ¶116.
`
`Belitz teaches that in an embodiment where all graphical objects are
`
`photographs, the photographs will be repres