IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`Christopher J. Desmond, et al.
`In re Patent of:
`10,423,658 Attorney Docket No.: 39843-0116IP1
`U.S. Patent No.:
`September 24, 2019
`
`Issue Date:
`Appl. Serial No.: 15/375,927
`
`Filing Date:
`December 12, 2016
`
`Title:
`METHOD AND APPARATUS FOR MANAGING DIGITAL
`FILES
`
`
`
`Mail Stop Patent Board
`Patent Trial and Appeal Board
`U.S. Patent and Trademark Office
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`
`PETITION FOR INTER PARTES REVIEW OF UNITED STATES PATENT
`NO. 10,423,658 PURSUANT TO 35 U.S.C. §§ 311–319, 37 C.F.R. § 42
`
`
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`TABLE OF CONTENTS
`
`I. 
`
`II. 
`
`REQUIREMENTS FOR IPR ........................................................................ 11 
`A.  Grounds for Standing .............................................................................. 11 
`B.  Challenge and Relief Requested ............................................................. 11 
`C.  Claim Construction ................................................................................. 11 
`D.  Level of Ordinary Skill ........................................................................... 12 
`SUMMARY OF THE ’658 PATENT ........................................................... 12 
`A.  Brief Description ..................................................................................... 12 
`B.  Prosecution History ................................................................................. 15 
`C.  Priority Date ............................................................................................ 16 
`III.  Application of Prior Art ................................................................................. 17 
`A.  Claims 1-15 are rendered obvious by Okamura and Belitz .................... 17 
`1.  Okamura ........................................................................................ 17 
`2. 
`Belitz .............................................................................................. 19 
`3. 
`Combination of Okamura and Belitz ............................................ 21 
`4. 
`Face and Event Clusters in Okamura’s Second Embodiment ...... 31 
`5.  Analysis ......................................................................................... 34 
`IV.  DISCRETION SHOULD NOT PRECLUDE INSTITUTION ...................103 
`1. 
`Factor 1: Either Party May Request Stay ....................................107 
`2. 
`Factor 2: Proximity of the Trial Date ..........................................107 
`3. 
`Factor 3: Petitioner’s Diligence and Investment in IPR Outweighs
`the Parties’ Minimal Investment in Litigation ............................107 
`Factor 4: The Petition’s Grounds Are Materially Different From
`Any That Might Be Raised in Litigation .....................................107 
`Factor 5: Institution Would Promote Judicial Efficiency ...........108 
`5. 
`Factor 6: The Merits Strongly Favor Institution .........................108 
`6. 
`V. 
`FEES ............................................................................................................108 
`VI.  MANDATORY NOTICES UNDER 37 C.F.R § 42.8(a)(1) .......................108 
`A.  Real Party-In-Interest Under 37 C.F.R. § 42.8(b)(1) ............................108 
`B.  Related Matters Under 37 C.F.R. § 42.8(b)(2) .....................................109 
`C.  Lead And Back-Up Counsel Under 37 C.F.R. § 42.8(b)(3) .................109 
`D.  Service Information ..............................................................................109 
`
`4. 
`
`
`
`
`
`
`1
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`EXHIBITS
`
`SAMSUNG-1001 U.S. Patent No. 10,423,658 to Christopher J. Desmond, et al.
`(“the ’658 patent”)
`
`SAMSUNG-1002 Excerpts from the Prosecution History of the ’658 Patent (“the
`Prosecution History”)
`
`SAMSUNG-1003 Declaration of Dr. Philip Greenspun
`
`SAMSUNG-1004 Curriculum Vitae of Dr. Philip Greenspun
`
`SAMSUNG-1005 U.S. Patent App. Pub. No. 2011/0122153 A1 (“Okamura”)
`
`SAMSUNG-1006 U.S. Patent App. Pub. No. 2010/0058212 A1 (“Belitz”)
`
`SAMSUNG-1007 U.S. Patent App. Pub. No. 2006/0206264 A1 (“Rasmussen”)
`
`SAMSUNG 1008-SAMSUNG 1019 RESERVED
`
`SAMSUNG-1020 Tim Grey, Adobe Photoshop Lightroom Workflow: The Digital
`Photographer's Guide (2007)
`
`
`SAMSUNG-1021 U.S. Patent App. Pub. No. 2011/0074811 A1 (“Hanson”)
`
`SAMSUNG-1022 Stephen Shankland, “What’s the best Web site for geotagged
`photos?,” CNET (Mar. 18, 2009), available at
`https://www.cnet.com/tech/computing/whats-the-best-web-site-
`for-geotagged-photos/
`
`
`SAMSUNG-1023 Panoramio, “Embedding a Panoramio map into your web page”
`(Archive.org: Mar. 28, 2010), available at
`https://web.archive.org/web/20100328215828/http://www.pano
`ramio.com/help/embedding
`
`
`SAMSUNG-1024 Shu-Wai Chow, PHP Web 2.0 Mashup Projects, Packt
`Publishing (2007)
`
`
`
`
`2
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`SAMSUNG-1025 Complaint for Declaratory Judgment, MyHeritage (USA), Inc.
`et al. v. MemoryWeb, LLC, Case No. 1:21-cv-02666, Dkt. 1
`(N.D. Ill. May 17, 2021)
`
`
`SAMSUNG-1026 U.S. Patent App. Pub. No. 2009/0113350 A1 (“Hibino”)
`
`SAMSUNG-1027 U.S. Patent App. Pub. No. 2006/0165380 A1 (“Tanaka”)
`
`SAMSUNG-1028 Complaint for Infringement, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411 (W.D. Tex.)
`
`
`SAMSUNG-1029 Plaintiff MemoryWeb, LLC’s First Supplemental Initial
`Infringement Contentions, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411-ADA (W.D. Tex. Nov. 24, 2021)
`
`
`SAMSUNG-1030 Agreed Scheduling Order, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411-ADA (W.D. Tex. Nov. 23, 2021)
`
`
`SAMSUNG-1031 U.S. Patent No. 6,215,523 (“Anderson”)
`
`SAMSUNG-1032 U.S. Patent App. Pub. No. 2008/0133526 (“Haitani”)
`
`SAMSUNG-1033 U.S. Patent App. Pub. No. 2008/0306921 (“Rothmuller”)
`
`SAMSUNG-1034 U.S. Patent App. Pub. No. 2013/0198602 (“Kokemohr”)
`
`SAMSUNG-1035 U.S. Patent App. Pub. No. 2013/0326338 (“Secord”)
`
`SAMSUNG-1036 U.S. Patent App. Pub. No. 2007/0016575 (“Hurst-Hiller”)
`
`SAMSUNG-1037 Stipulation Letter
`
`SAMSUNG-1038 U.S. Patent App. Pub. No. 2008/0276279 (“Gossweiler”)
`
`SAMSUNG-1039 U.S. Patent App. Pub. No. 2008/0263103 (“McGregor”)
`
`SAMSUNG-1040 U.S. Patent App. Pub. No. 2006/0080342 (“Takaki”)
`
`3
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`SAMSUNG-1041 U.S. Patent App. Pub. No. 2009/0210793 (“Yee”)
`
`SAMSUNG-1042 Woody Leonhard, Windows Vista All-in-One Desk Reference
`for Dummies (2007)
`
`
`SAMSUNG-1043 Andy Rathbone, Windows Vista for Dummies (2007)
`
`
`
`4
`
`

`

`
`
`Claim 1
`[1pre]
`
`[1a]
`
`[1b]
`
`[1c]
`
`[1d]
`
`[1e]
`
`[1f]
`
`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`LISTING OF CHALLENGED CLAIMS
`
`A computer-implemented method of displaying at least a portion of a
`plurality of (i) digital photographs, (ii) videos, or (iii) a combination
`of (i) and (ii), each of the digital photographs and videos being asso-
`ciated with a geotag indicative of geographic coordinates where the
`respective digital photograph or video was taken, the method com-
`prising:
`
`displaying an application view on a video display device including
`displaying a plurality of selectable elements, the plurality of se-
`lectable elements including a location selectable element;
`
`responsive to a click or tap of the location selectable element, dis-
`playing a map view on a video display device, the displaying the
`map view including displaying:
`
`a representation of an interactive map;
`
`a first location selectable thumbnail image at a first location on the
`interactive map, the first location being associated with the geo-
`graphic coordinates of a first geotag, a first set of digital photographs
`and videos including all of the digital photographs and videos associ-
`ated with the first geotag;
`
`a first count value image partially overlapping the first location se-
`lectable thumbnail image, the first count value image including a
`first number that corresponds to the number of digital photographs
`and videos in the first set of digital photographs and videos;
`
`a second location selectable thumbnail image at a second location on
`the interactive map, the second location being associated with the ge-
`ographic coordinates of a second geotag, a second set of digital pho-
`tographs and videos including all of the digital photographs and vid-
`eos associated with the second geotag; and
`
`[1g]
`
`a second count value image partially overlapping the second location
`selectable thumbnail image, the second count value image including
`
`5
`
`

`

`[1h]
`
`[1i]
`
`Claim 2
`[2]
`
`Claim 3
`[3]
`
`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`a second number that corresponds to the number of digital photo-
`graphs and videos in the second set of digital photographs and vid-
`eos;
`
`responsive to a click or tap of the first location selectable thumbnail
`image, displaying a first location view on the video display device,
`the displaying the first location view including displaying (i) a first
`location name associated with the first geotag and (ii) a scaled rep-
`lica of each of the digital photographs and videos in the first set of
`digital photographs and videos, the displayed scaled replicas of each
`of the digital photographs and videos in the first set of digital photo-
`graphs and videos not being overlaid on the interactive map; and
`
`responsive to a click or tap of the second location selectable thumb-
`nail image, displaying a second location view on the video display
`device, the displaying the second location view including displaying
`(i) a second location name corresponding to the second geotag and
`(ii) a scaled replica of each of the digital photographs and videos in
`the second set of digital photographs and videos, the displayed scaled
`replicas of each of the digital photographs and videos in the second
`set of digital photographs and videos not being overlaid on the inter-
`active map.
`
`The computer-implemented method of claim 1, wherein the first lo-
`cation selectable thumbnail image includes a scaled representation of
`at least one of the digital photographs in the first set of digital photo-
`graphs, and wherein the second location selectable thumbnail image
`includes a scaled representation of at least one of the digital photo-
`graphs in the second set of digital photographs.
`
`The computer-implemented method of claim 1, further comprising
`responsive to a click or tap of a first one of the displayed scaled rep-
`licas in the first location view, displaying a first digital photograph
`associated with the first scaled replica in the first location view and a
`first map image indicating the geographic coordinates of the first ge-
`otag.
`
`6
`
`

`

`Claim 4
`[4]
`
`Claim 5
`[5pre]
`
`[5a]
`
`[5b]
`
`[5c]
`
`[5d]
`
`Claim 6
`[6]
`
`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`The computer-implemented method of claim 3, further comprising
`responsive to a click or tap of a first one of the displayed scaled rep-
`licas in the second location view, displaying a first digital photo-
`graph associated with the first scaled replica in the second location
`view and a second map image indicating the geographic coordinates
`of the second geotag.
`
`The computer-implemented method of claim 1, wherein the plurality
`of selectable elements further includes a people selectable element,
`the method further comprising responsive to a click or tap of the peo-
`ple selectable element, displaying a people view, the displaying the
`people view including displaying:
`
`a first person selectable thumbnail image including an image of a
`face of a first person, a third set of digital photographs and videos in-
`cluding digital photographs and videos associated with the first per-
`son;
`
`a name associated with the first person, the name associated with the
`first person being displayed adjacent to the first person selectable
`thumbnail image;
`
`a second person selectable thumbnail image including an image of a
`face of a second person, a fourth set of digital photographs and vid-
`eos including digital photographs and videos associated with the sec-
`ond person; and
`
`a name associated with the second person, the name associated with
`the second person being displayed adjacent to the second person se-
`lectable thumbnail image.
`
`The computer-implemented method of claim 5, wherein the display-
`ing the people view further includes displaying the first person se-
`lectable thumbnail image and the second person selectable thumbnail
`
`7
`
`

`

`Claim 7
`[7]
`
`Claim 8
`[8]
`
`Claim 9
`[9]
`
`Claim 10
`[10]
`
`Claim 11
`[11]
`
`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`image in an alphabetical order based on the names associated with
`first person and the second person.
`
`The computer-implemented method of claim 5, further comprising
`responsive to a click or tap of the first person selectable thumbnail
`image, displaying a first person view, the displaying the first person
`view including displaying (i) the name associated with the first per-
`son and (ii) a scaled replica of each of the digital photographs and
`videos in the third set of digital photographs.
`
`The computer-implemented method of claim 7, wherein the display-
`ing the first person view further includes displaying a first-person-lo-
`cation selectable element.
`
`The computer-implemented method of claim 8, further comprising
`responsive to a click or tap of the first-person-location selectable ele-
`ment, displaying a representation of all locations having a digital
`photograph or video associated with the first person.
`
`The computer-implemented method of claim 7, further comprising
`responsive to a click or tap of the second person selectable thumbnail
`image, displaying a second person view, the displaying the second
`person view including displaying (i) the name associated with the
`second person and (ii) a scaled replica of each of the digital photo-
`graphs and videos in the fourth set of digital photographs.
`
`The computer-implemented method of claim 10, wherein the dis-
`playing the second person view further includes displaying a second-
`person-location selectable element.
`
`
`8
`
`

`

`Claim 12
`[12]
`
`Claim 13
`[13pre]
`
`[13a]
`
`[13b]
`
`[13c]
`
`[13d]
`
`Claim 14
`[14]
`
`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`The computer-implemented method of claim 11, further comprising
`responsive to a click or tap of the second-person-location selectable
`element, displaying a representation of all locations having a digital
`photograph or video associated with the second person.
`
`The computer-implemented method of claim 1, wherein the plurality
`of selectable elements further includes an album selectable element,
`the method further comprising responsive to a click or tap of the al-
`bum selectable element, displaying an album view, the displaying the
`album view including displaying:
`
`a first album selectable thumbnail image including a scaled represen-
`tation of at least one digital photograph in a third set of digital photo-
`graphs and videos that includes all of the digital photographs and
`videos associated with a first album tag;
`
`a first album name associated with the first album, the first album
`name being displayed adjacent to the first album selectable thumb-
`nail image;
`
`a second album selectable thumbnail image including a scaled repre-
`sentation of at least one digital photograph in a fourth set of digital
`photographs and videos that includes all of the digital photographs
`and videos associated with a second album tag; and
`
`a second album name associated with the second album, the second
`album name being displayed adjacent to the second album selectable
`thumbnail image.
`
`The computer-implemented method of claim 13, further comprising
`responsive to a click or tap of the first album selectable thumbnail
`image, displaying a first album view, the displaying the first album
`view including displaying (i) the first album name associated with
`the first album and (ii) a scaled replica of each of the digital photo-
`graphs and videos in the third set of digital photographs and videos.
`
`9
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`The computer-implemented method of claim 14, further comprising
`responsive to a click or tap of the second album selectable thumbnail
`image, displaying a second album view, the displaying the second al-
`bum view including displaying (i) the second album name associated
`with the second album and (ii) a scaled replica of each of the digital
`photographs and videos in the fourth set of digital photographs and
`videos.
`
`
`
`Claim 15
`[15]
`
`
`
`
`
`
`
`
`10
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`Samsung Electronics Co., Ltd. (“Petitioner”) petitions for inter partes
`
`review of claims 1-15 (“Challenged Claims”) of U.S. Patent No. 10,423,658 (“’658
`
`patent”).
`
`I.
`
`REQUIREMENTS FOR IPR
`A. Grounds for Standing
`Samsung certifies that the ’658 patent is available for IPR. This petition is
`
`being filed within one year of service of a complaint against Samsung.
`
`SAMSUNG-1028. Samsung is not barred or estopped from requesting review of
`
`the Challenged Claims on the below-identified grounds.
`
`B. Challenge and Relief Requested
`Samsung requests IPR on the grounds in the table below.
`
`Ground
`1
`2
`3
`4
`5
`
`
`
`Claims
`
`1-15
`3-4
`6-12
`8-9, 11-12
`8-9, 11-12
`
`Basis
`§103: Okamura, Belitz
`§103: Okamura, Belitz, Rasmussen
`§103: Okamura, Belitz, Gossweiler
`§103: Okamura, Belitz, Yee
`§103: Okamura, Belitz, Gossweiler, Yee
`
`C. Claim Construction
`Because the evidence and the prior art’s description of the claimed elements
`
`are similar to the ’658 patent specification, no formal claim constructions are
`
`11
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`necessary in this proceeding.1
`
`D. Level of Ordinary Skill
`A person of ordinary skill (“POSITA”) relating to the subject matter of the
`
`’658 patent would have had (1) a bachelor’s degree in computer science, computer
`
`engineering, electrical engineering, or a related field, and (2) at least one year of
`
`experience designing graphical user interfaces for applications such as photo
`
`organization systems. SAMSUNG-1003, [27]-[28]. Additional graduate education
`
`could substitute for professional experience, or significant experience in the field
`
`could substitute for formal education. Id.
`
`II.
`
`SUMMARY OF THE ’658 PATENT
`A. Brief Description
`The ’658 patent describes “map” and “people” views. SAMSUNG-1001,
`
`22:43-62, 24:1-39, 29:25-48, FIGS. 32, 34, 41. The ’658 patent’s map view
`
`(shown in FIG. 41) displays a map with thumbnail images. SAMSUNG-1001,
`
`29:33-41.
`
`
`1 Petitioner is not conceding that each claim satisfies all statutory requirements, such
`
`as §§ 101 and 112, nor is Petitioner waiving any arguments concerning claim scope
`
`or grounds that can only be raised in district court.
`
`12
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`SAMSUNG-1001, FIG. 41
`
`
`
`
`
`When the user selects a thumbnail, the user interface displays a location
`
`view (shown in FIG. 34). SAMSUNG-1001, 6:16.
`
`13
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`SAMSUNG-1001, FIG. 34
`
`
`
`
`
`As shown in FIG. 32, the ’658 patent provides a people view (upper) that
`
`displays “person selectable” thumbnail images and, upon selection, the user
`
`interface displays a single person view (lower). SAMSUNG-1001, 22:52-23:10;
`
`SAMSUNG-1003, [47]-[55].
`
`
`
`
`
`14
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`SAMSUNG-1001, FIG. 32
`
`
`
`
`
`B.
`Prosecution History
`The ’658 patent was allowed without a rejection on the merits and the
`
`Examiner provided only a cursory discussion of how the allowed claims were
`
`patentable. SAMSUNG-1002, 24-30, 36-37. Okamura and Belitz were not
`
`considered during prosecution and demonstrate that the Challenged Claims were
`
`well-known. SAMSUNG-1003, [56].
`
`
`
`
`15
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`C.
`Priority Date
`MemoryWeb’s earliest priority claim is June 9, 2011. SAMSUNG-1001,
`
`Cover. MemoryWeb has identified a priority date of February 28, 2014.
`
`SAMSUNG-1029, 2. The references pre-date June 9, 2011 and are prior art (under
`
`Pre-AIA 102(a), (b), (e) or AIA 102(a)(1), (a)(2)) regardless of whether the ’658
`
`patent is entitled to its earliest claimed priority. The level of skill would have been
`
`similar and the analysis applies equally whether June 9, 2011 or February 28, 2014
`
`is used.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Reference
`Okamura
`Belitz
`Rasmussen
`Gossweiler
`Yee
`
`Filing Date
`10/20/2010
`08/28/2008
`07/12/2005
`03/31/2008
`02/14/2008
`
`Publication Date
`05/26/2011
`03/04/2010
`09/14/2006
`11/06/2008
`08/20/2009
`
`16
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`III. Application of Prior Art2
`A. Claims 1-15 are rendered obvious by Okamura and Belitz
`1. Okamura3
`Okamura discloses a user interface for “managing contents such as image
`
`files” based on locations and people associated with the content. SAMSUNG-
`
`1005, Abstract, [0091], [0110], [0313], FIGS. 21, 41.
`
`As shown in FIG. 41 (below), Okamura discloses “a map view screen” that
`
`displays location-based clusters in an overlaid manner on an interactive map,
`
`where the user can select a cluster to view thumbnail images belonging to the
`
`cluster (as well as the number of digital files associated with the cluster), change
`
`the scale of the map (e.g., by adjusting the scale changing bar 781), and switch to a
`
`different screen (including a face-based index screen as described below).
`
`SAMSUNG-1005, [0215], [0354]-[0359], [0430]-[0431], FIG. 41; SAMSUNG-
`
`1003, [77]-[78]. As illustrated in FIG. 50, selecting a location-based cluster causes
`
`the user interface to display “contents belonging to the corresponding cluster” that
`
`are not overlaid on the interactive map. SAMSUNG-1005, [0439]-[0444].
`
`
`2 Dr. Greenspun provides a technology background at SAMSUNG-1003, [57]-[76].
`
`3 Descriptions of the references and combinations thereof are incorporated into
`
`each mapping that includes citations to these references. All emphasis is added
`
`unless otherwise indicated.
`
`17
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`
`
`SAMSUNG-1005, FIG. 41 (left), FIG. 50 (right)
`
`In addition to its map view, Okamura discloses a people view for content
`
`that includes an index screen displaying “index images generated on the basis of
`
`face information.” SAMSUNG-1005, [0234]. The index screen includes an
`
`“image representing a face cluster, for example, a thumbnail image of each of [the]
`
`faces included in contents belonging to the face cluster” and “the pieces of
`
`information 433 related to the thumbnail image 432.” SAMSUNG-1005, [0246]-
`
`[0247], see also [0099], [0110], [0139], [0234], [0248]-[0260], [0267], FIG. 21;
`
`SAMSUNG-1003, [79]. As illustrated in FIGS. 21 and 24 (below), selecting a
`
`face-based thumbnail image causes the user interface to display “contents included
`
`in the face cluster.” SAMSUNG-1005, [0261].
`
`18
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`
`
`SAMSUNG-1005, FIG. 21 (left), FIG. 24 (right)
`
`2.
`Belitz
`Belitz describes a “user interface…configured to display a map and to
`
`display at least one marked location on said map.” SAMSUNG-1006, Abstract,
`
`[0001]-[0006], [0039], [0050]-[0052]. Belitz’s user interface displays map 409
`
`(see FIG. 4 below) with thumbnail images at various locations. Id. Map 409
`
`“display[s] all or a selected number of photographs stored in a device.”
`
`SAMSUNG-1006, [0016]. Belitz’s map 409 is interactive including features of
`
`“zooming in” and user operations, such as “placing a cursor above [a graphical
`
`object] and clicking it.” SAMSUNG-1006, [0054]-[0056], [0060]; SAMSUNG-
`
`1003, [80].
`
`
`
`19
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`SAMSUNG-1006, FIGS. 4a-c
`
`
`
`Each thumbnail (e.g., thumbnails 410a-d in FIG. 4b) is associated with a
`
`location, and “examples of associations are photographs that have been taken at
`
`those coordinates.” SAMSUNG-1006, [0052], [0062]. Belitz displays a count
`
`value partially overlapping the right corner of each thumbnail image (e.g., “6” for
`
`thumbnail 410 in FIG. 4a). SAMSUNG-1006, [0052].
`
`20
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`Responsive to selection of a thumbnail, Belitz’s user interface displays
`
`visual representations associated with the selected thumbnail on a pop-up window
`
`413. SAMSUNG-1006, [0057], [0060], [0062]; SAMSUNG-1003, [81]-[83]. The
`
`user “can easily scroll back and forth among these associated images and preview
`
`them in the popup window 413.” Id.
`
`3.
`Combination of Okamura and Belitz
`A POSITA would have found it obvious to combine Okamura and Belitz
`
`(“Okamura-Belitz”). Both references (as well as the ’658 patent) come from the
`
`same field of endeavor: “managing and using digital files such as photographs.”
`
`SAMSUNG-1001, 1:16-20; SAMSUNG-1005, [0002], [0091]; SAMSUNG-1006,
`
`[0001], [0062]. Further, Okamura and Belitz address the same problem (also
`
`purportedly solved by the ’658 patent): allowing “people to organize, view,
`
`preserve and share” their digital photographs. SAMSUNG-1001, 1:56-62;
`
`SAMSUNG-1005, [0007]-[0013]; SAMSUNG-1006, [0002]-[0005]. Okamura
`
`and Belitz also describe analogous techniques—both describe use of an interactive
`
`map with user-selectable markers (clusters or thumbnail images) specifying the
`
`locations of photos and/or videos, and use of those markers to retrieve the digital
`
`photos and/or videos linked to those locations. SAMSUNG-1005, Abstract,
`
`[0091], [0110], [0313], FIGS. 18-21, FIG. 41; SAMSUNG-1006, [0039], [0050]-
`
`[0055], [0062]. With this background, a POSITA would have readily turned to
`
`21
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`Belitz when reviewing Okamura and would have found it obvious to incorporate
`
`features of Belitz in Okamura. SAMSUNG-1003, [84].
`
`As Dr. Greenspun explains, a POSITA would have combined Okamura and
`
`Belitz in two, alternative ways. SAMSUNG-1003, [85]. First, a POSITA would
`
`have found it obvious to replace the location-based clusters used in Okamura’s
`
`map view (shown in FIG. 41) with the thumbnail images used in Belitz’s map
`
`view. Id. With this replacement, Okamura’s map view would function as
`
`described in Okamura, except that it would display, on the map view, thumbnail
`
`images as described by Belitz, instead of Okamura’s location-based clusters. Id.
`
`Second, as an alternative way of viewing the combination of Okamura and Belitz,
`
`a POSITA would have found it obvious to replace Okamura’s map-related views
`
`(e.g., cluster map view shown in FIG. 18 or map view shown in FIG. 41) with
`
`Belitz’s map view. Id. In this alternative, when a user provides input to display a
`
`map-related view in Okamura, the combined system would display Belitz’s map
`
`view, instead of Okamura’s. Id.
`
`First Way of Combining Okamura and Belitz
`
`As discussed in Section III.A.1, Okamura discloses a map view (shown in
`
`FIG. 41) that displays location-based clusters over an interactive map. Although
`
`Okamura describes its clusters as “thumbnail” images of a portion of a map
`
`(SAMSUNG-1005, [0135], [0221]-[0223], [0229]-[0231]), to the extent that the
`
`22
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`location-based clusters in Okamura’s map view are not “thumbnail image[s]” as
`
`claimed, a POSITA would have been motivated to combine Okamura and Belitz
`
`such that Okamura’s map view displays selectable thumbnail images as disclosed
`
`in Belitz to obtain additional benefits. SAMSUNG-1003, [86]. Below, Okamura’s
`
`FIG. 41 has been modified to provide an example of replacing Okamura’s location-
`
`based clusters with Belitz’s thumbnail images:
`
`SAMSUNG-1006, FIGS. 4a-b (top); SAMSUNG-1005, FIG. 41 (bottom)
`
`
`
`23
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`Organizing digital files using location selectable thumbnails would achieve
`
`Okamura’s objective of “managing contents.” SAMSUNG-1005, [0091]. As
`
`discussed in Belitz, the combination enhances a user’s experience of “discern[ing]
`
`between the various objects” by providing “a good view of what location is
`
`associated with what.” SAMSUNG-1006, [0002]. This teaching by Belitz is
`
`consistent with Okamura’s objective, which is also to improve the user experience:
`
`“each of contents belonging to each cluster can be also easily grasped by the user.”
`
`SAMSUNG-1005, [0215]. Okamura and Belitz also describe analogous methods
`
`of displaying an interactive map with user-selectable elements (e.g., Belitz’s
`
`thumbnail images and Okamura’s clusters) and retrieving digital files (e.g., photos
`
`and videos) associated with a given location. SAMSUNG-1003, [87].
`
`A POSITA would have understood that Belitz’s thumbnail images displayed
`
`on the interactive map are functionally equivalent to Okamura's location-based
`
`clusters ((1) both Belitz’s thumbnail images and Okamura’s clusters are associated
`
`with a given location, (2) both are displayed on the interactive map, and (3) both
`
`are dynamically generated/modified based on user interaction including zooming
`
`in/out on the map) and could be used as an alternative to the clusters on Okamura’s
`
`map view screen. SAMSUNG-1003, [88]. It would have been obvious to a
`
`POSITA to incorporate Belitz’s thumbnail images (including a count indicator) to
`
`24
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`provide added functionality that allows a user to preview pictures associated with a
`
`given location. SAMSUNG-1006, [0004].
`
`A POSITA would have been motivated to make this modification because
`
`Belitz teaches that “it would be useful to be able to present a user with an overview
`
`of associated images to special locations which enables [the] user to clearly see the
`
`associations.” SAMSUNG-1006, [0004], [0015]. A POSITA also would have
`
`considered Belitz’s thumbnail technique to be a known and predictable alternative
`
`to Okamura’s clusters, and that using thumbnails could appeal to certain users,
`
`thereby improving usability. SAMSUNG-1003, [89]. For example, a POSITA
`
`would have known, before 2010, that certain users preferred interactive maps that
`
`used thumbnails to identify the locations of photos. Id.
`
`Indeed, contemporaneous evidence shows that a POSITA would have
`
`understood that selectable graphical clusters would have been obvious to replace
`
`with “smaller versions of the captured images (e.g., thumbnail images).”
`
`SAMSUNG-1021, [0030]. The well-known nature of using location selectable
`
`thumbnails and a POSITA’s understanding of location selectable thumbnails as an
`
`obvious option for presenting digital files is further demonstrated by multiple
`
`applications (e.g., Picasa, Panoramio) that displayed thumbnail images on a map.
`
`SAMSUNG-1022; SAMSUNG-1023; SAMSUNG-1024, 239, 243; SAMSUNG-
`
`1003, [90].
`
`25
`
`

`

`Attorney Docket No. 39843-0116IP1
`IPR of U.S. Patent No. 10,423,658
`
`
`
`
`
`SAMSUNG-1022 (left); SAMSUNG-1023 (right)
`
`Second Way of Combining Okamura and Belitz
`
`Alternatively, a POSITA would have found it obvious to substitute
`
`Okamura’s map-related views with Belitz’s interactive map for the same reasons
`
`described above including the user’s increased awareness of digital files associated
`
`with various locations. SAMSUNG-1005, [0354]-[0356], [0430], FIG. 49;
`
`SAMSUNG-1006, [0051]-[0053], [0055], [0062], FIG. 4. For example, when a
`
`user selects the “PLACE” tab 413 shown in Okamura’s FIG. 18, Okamura’s cluster
`
`map display area 414 would be replaced with Belitz’s geographic map view.
`
`SAMSUNG-1003, [91]. A POSITA would have been motivated to combine
`
`Okamura and Belitz in this manner because the combination enhances how
`
`Okamura displays content associated with various locations by using Belitz’s
`
`