`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`
`
`
`
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SAMSUNG ELECTRONICS CO., LTD,
`Petitioner,
`
`v.
`
`MEMORYWEB, LLC,
`Patent Owner.
`
`
`
`
`
`
`
`
`
`
`
`
`Case IPR2022-00222
`Patent 10,621,228
`
`
`
`
`
`
`
`
`
`
`
`
`
`PETITIONER’S REPLY TO PATENT OWNER’S RESPONSE
`
`
`
`
`
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`
`TABLE OF CONTENTS
`
`
`
`I. INTRODUCTION .................................................................................................. 1
`
`II. CLAIM CONSTRUCTION .................................................................................. 2
`
`III. GROUND 1 RENDERS OBVIOUS THE CHALLENGED CLAIMS ............ 10
`
`VIII. SAMSUNG IS NOT AN RPI IN A RELATED PROCEEDING .................. 24
`
`VIII. CONCLUSION ............................................................................................... 25
`
`
`
`
`
`
`
`i
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`UPDATED EXHIBIT LIST
`
`
`SAMSUNG-1001 U.S. Patent No. 10,621,228 to Christopher J. Desmond, et al.
`(“the ’228 patent”)
`
`SAMSUNG-1002 Excerpts from the Prosecution History of the ’228 Patent (“the
`Prosecution History”)
`
`SAMSUNG-1003 Declaration of Dr. Philip Greenspun
`
`SAMSUNG-1004 Curriculum Vitae of Dr. Philip Greenspun
`
`SAMSUNG-1005 U.S. Patent App. Pub. No. 2011/0122153 A1 (“Okamura”)
`
`SAMSUNG-1006 U.S. Patent App. Pub. No. 2010/0058212 A1 (“Belitz”)
`
`SAMSUNG 1007-SAMSUNG 1019 RESERVED
`
`SAMSUNG-1020 Tim Grey, Adobe Photoshop Lightroom Workflow: The Digital
`Photographer's Guide (2007)
`
`
`SAMSUNG-1021 U.S. Patent App. Pub. No. 2011/0074811 A1 (“Hanson”)
`
`SAMSUNG-1022 Stephen Shankland, “What’s the best Web site for geotagged
`photos?,” CNET (Mar. 18, 2009), available at
`https://www.cnet.com/tech/computing/whats-the-best-web-site-
`for-geotagged-photos/
`
`
`SAMSUNG-1023 Panoramio, “Embedding a Panoramio map into your web page”
`(Archive.org: Mar. 28, 2010), available at
`https://web.archive.org/web/20100328215828/http://www.pano
`ramio.com:80/help/embedding
`
`
`SAMSUNG-1024 Shu-Wai Chow, PHP Web 2.0 Mashup Projects, Packt
`Publishing (2007)
`
`
`
`
`ii
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`SAMSUNG-1025 Complaint for Declaratory Judgment, MyHeritage (USA), Inc.
`et al. v. MemoryWeb, LLC, Case No. 1:21-cv-02666, Dkt. 1
`(N.D. Ill. May 17, 2021)
`
`
`SAMSUNG-1026 U.S. Patent App. Pub. No. 2009/0113350 A1 (“Hibino”)
`
`SAMSUNG-1027 U.S. Patent App. Pub. No. 2006/0165380 A1 (“Tanaka”)
`
`SAMSUNG-1028 Complaint for Infringement, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411 (W.D. Tex.)
`
`
`SAMSUNG-1029 Plaintiff MemoryWeb, LLC’s First Supplemental Initial
`Infringement Contentions, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411-ADA (W.D. Tex. Nov. 24, 2021)
`
`
`SAMSUNG-1030 Agreed Scheduling Order, MemoryWeb, LLC v. Samsung
`Electronics Co., Ltd. and Samsung Electronics America, Inc.,
`Case No. 21-cv-411-ADA (W.D. Tex. Nov. 23, 2021)
`
`
`SAMSUNG-1031 U.S. Patent No. 6,215,523 (“Anderson”)
`
`SAMSUNG-1032 U.S. Patent App. Pub. No. 2008/0133526 (“Haitani”)
`
`SAMSUNG-1033 U.S. Patent App. Pub. No. 2008/0306921 (“Rothmuller”)
`
`SAMSUNG-1034 U.S. Patent App. Pub. No. 2013/0198602 (“Kokemohr”)
`
`SAMSUNG-1035 U.S. Patent App. Pub. No. 2013/0326338 (“Secord”)
`
`SAMSUNG-1036 U.S. Patent App. Pub. No. 2007/0016575 (“Hurst-Hiller”)
`
`SAMSUNG-1037 Stipulation Letter
`
`SAMSUNG-1038 Email from Board Authorizing Petitioner’s Reply
`
`SAMSUNG-1039 RESERVED
`
`
`iii
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`SAMSUNG-1040 Transcript of the deposition of Dr. Glenn Reinman dated
`November 16, 2022
`
`
`SAMSUNG-1041 Second Declaration of Dr. Philip Greenspun
`
`SAMSUNG-1042 Adam C. Engst, Visual Quickstart Guide iPhoto ’09 (2009)
`(“Engst”)
`
`
`SAMSUNG-1043 U.S. Patent App. Pub. No. 2009/0196510 (“Gokturk”)
`
`
`
`
`
`
`
`iv
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`
`I. INTRODUCTION
`Samsung Electronics Co., Ltd. (“Petitioner” or “Samsung”) submits this
`
`Reply to Patent Owner’s Response (“POR”) to the Petition for inter partes review
`
`(“IPR”) of U.S. Patent No. 10,621,228 (the ’228 patent”) filed by MemoryWeb,
`
`LLC (“Patent Owner” or “MemoryWeb”).
`
`The POR arguments fail when longstanding legal principles are properly
`
`applied to the factual record developed in this proceeding. The Board should reject
`
`the POR arguments as they are inconsistent with, mischaracterize, and, at times,
`
`ignore the teachings of the cited art, the arguments presented in the Petition, and
`
`the evidence of record. In particular, MemoryWeb’s overly narrow and
`
`unsupported constructions for the terms “responsive to [an] input” and “the people
`
`view including: … a first name … [and] … a second name” are inconsistent with
`
`the specification of the ’228 patent and the understanding of a POSITA.
`
`Furthermore, Patent Owner ignores and/or mischaracterizes the teachings of
`
`Okamura and Belitz to hastily push through their flawed rationale against the
`
`combination.
`
`In its Institution Decision, the Board found that Petitioner established a
`
`reasonable likelihood that claims 1-19 (“the Challenged Claims”) of the ’228
`
`patent are unpatentable. As explained herein, the POR arguments fail to rebut the
`
`positions advanced in the Petition. See also SAMSUNG-1041, [1]-[37]. Thus, the
`
`1
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`Board’s original reasoning and conclusions from its Institution Decision still hold.
`
`Accordingly, the Board should issue a Final Written Decision finding the
`
`Challenged Claims unpatentable.
`
`II. CLAIM CONSTRUCTION
`In the Institution Decision (Paper 12), the Board agreed with Petitioner in
`
`noting that “no claim terms requires express construction...” for purposes of
`
`institution. Institution Decision, 18.
`
`Yet Patent Owner, while on one hand alleging that they likewise “do[] not
`
`believe claim construction is required because the plain and ordinary meanings of
`
`relevant terms are clear,” focuses the vast majority of its POR arguments on a
`
`handful of improperly narrow constructions that are contradicted by the testimony
`
`of both experts as well as the ’228 patent itself.
`
`First, with respect to claim elements [1g] and [1i], Patent Owner contends
`
`that the phrase “responsive to” requires the second event to occur “‘automatically’
`
`in relation to a first event without ‘requiring further user interaction.’” POR, 11.
`
`For support, Patent Owner points to FIG. 32 of the ’228 patent (reproduced below)
`
`and contends that pressing “People” (1401) displays the People Application View
`
`without the need for “any further ‘user interaction.’” Id., 13.
`
`
`
`2
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`
`
`
`SAMSUNG-1001, FIG. 32 (annotated)
`
`However, as Dr. Greenspun explained during his deposition, a POSITA
`
`would have recognized that the term “responsive to” merely requires the second
`
`event to happen “subsequent to” the first event based on a combination of user
`
`interaction and software implementation. EX-2002, 42:21-44:22, 51:9-52:13; see
`
`also SAMSUNG-1041, [3]-[8].
`
`Indeed, even in the above-mentioned Patent Owner example from the ’228
`
`patent, the people view that is ultimately shown to the user entails not only the
`
`initial pressing of “People” (1401) (shown in red above), but further the additional
`
`selection of a desired display order via a drop-down list (1402) (shown in purple
`
`above). See SAMSUNG-1001, FIG. 32, 22:59-67; SAMSUNG-1041, [5]. In other
`
`words, contrary to Patent Owner’s assertions, even the ’228 patent itself
`
`contemplates having intermediate user actions between the first event (i.e.,
`
`“cause”) and the second event (i.e., “effect”). SAMSUNG-1041, [6].
`
`3
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`When asked during deposition about the possibility of having this
`
`intermediate drop-down selection, Patent Owner’s expert Dr. Reinman
`
`acknowledged that it would be “possible.” SAMSUNG-1040, 30:19-32:3; 26:23-
`
`27:17; 52:3-23; 55:6-56:1. People view displays that are shown as a direct result
`
`of the drop-down selection are nevertheless “responsive to” and would not have
`
`occurred apart from the initial pressing of “People” (1401). SAMSUNG-1041, [6].
`
`In short, being “responsive to” the first event does not require the second event to
`
`always occur “automatically” without “further user interaction,” as Patent Owner
`
`contends, and the ’228 patent provides no reason to add these words into the
`
`claims. POR, 11; SAMSUNG-1041, [7]-[8].
`
`Second, with respect to claim elements [1g], [1i], and [1k], Patent Owner
`
`again attempts to read limitations into the claims, contending that “the people view
`
`including: ... a first name ... [and] ... a second name” requires the simultaneous
`
`display of both the “first name” and the “second name.” POR, 14. In so doing,
`
`Patent Owner has failed to provide any credible reason to dispel the construction
`
`set forth in the Institution Decision, namely that the claim does not require
`
`“simultaneous display of the first and second names” and instead simply requires
`
`that “the first name be displayed at some unspecified time and that the second
`
`name be displayed at some unspecified time.” Institution Decision, 28.
`
`4
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`That is, Patent Owner rehashes the same argument it made in the POPR,
`
`again without any credible evidence.1 When asked during deposition why he
`
`thought the claim required simultaneous display of both names, Dr. Reinman
`
`repeatedly stated that “it is implied.” SAMSUNG-1040, 65:12-19; see also id.,
`
`66:2-67:2. But he could not point to a single instance in the specification or the
`
`figures of the ’228 patent to support this alleged implication.
`
`The only specification support cited by Patent Owner for this overly narrow
`
`interpretation appears to be the ’228 patent’s FIG. 32 and its accompanying
`
`description. See POR, 17. Although the example provided in FIG. 32 seems to
`
`show both a first name and a second name at the same time, nothing in the ’228
`
`patent requires both names to be together visible to the user at all times.
`
`SAMSUNG-1041, [9]-[10]. In fact, when asked during deposition whether FIG.
`
`32 would still correspond to the display of both names if one of the names
`
`happened to be momentarily hidden from view, which could happen for various
`
`
`
` Patent Owner contends in the POR that Dr. Greenspun somehow agreed with
`
`
`
` 1
`
`their construction regarding the requirement for simultaneous display. See POR,
`
`16. This is simply not true; none of the cited portions from Dr. Greenspun’s
`
`testimony mentions anything about the simultaneous display of the two names.
`
`See id.
`
`5
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`reasons under real-life conditions, Dr. Reinman could not give an answer and
`
`instead deflected by saying that it is “not something [he] formed an opinion on[.]”
`
`SAMSUNG-1040, 57:24-58:14; SAMSUNG-1041, [10].
`
`As Dr. Greenspun clarifies, “[t]here is nothing in the claim language of the
`
`’228 patent to suggest that the first name and the second name must both be
`
`simultaneously visible to the user at all times.” As the Board pointed out, the
`
`claim merely requires that the first name be displayed at some unspecified time and
`
`that the second name also be displayed at some unspecified time.” SAMSUNG-
`
`1041, [11].
`
`Third, with respect to claim 18, Patent Owner appears to contend, similar to
`
`the “responsive to” discussion above, that “responsive to an input” requires the
`
`direct and automatic display of “the first name” and “a representation of each
`
`digital file...” with no other additional user input being permitted. POR, 18;
`
`SAMSUNG-1041, [13]. For reasons similar to those discussed above, there is
`
`nothing in the ’228 patent or in the testimony of Dr. Reinman to suggest that being
`
`“responsive to an input” means that all subsequent events that are enabled by said
`
`input must always occur automatically and without further user interaction.
`
`SAMSUNG-1041, [13].
`
`Additionally, in contravention to Patent Owner’s narrow interpretations
`
`above, the claim language at issue merely recites displaying a “view” (e.g.,
`
`6
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`“people view,” “first person view”) responsive to an input. The claim language
`
`does not state that everything associated with the view is displayed responsive to
`
`the input – it states that the view is displayed responsive to the input and that the
`
`view includes various pieces of information. To illustrate, FIG. 32 of the ’228
`
`patent shows an example of a “people view” where certain photos are shown.
`
`However, the interface includes an “Items Per Page” button that controls how
`
`many of the available photos are shown at one time to a user. SAMSUNG-1041,
`
`[12].
`
`
`
`SAMSUNG-1001, FIG. 32 (annotated)
`
`In other words, although there may be other photos that are part of the
`
`“people view” of FIG. 32, such photos are not displayed simultaneously with all
`
`other photos and are not visible until the user clicks on additional buttons. Id.,
`
`FIG. 32, 22:59-23:11 (“The first People Application View (1400) is used to
`
`display all the people that were created within the user’s Application.”). In fact,
`
`7
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`the ’228 patent describes several different mechanisms for limiting the display of
`
`a view to only a portion of the information described as being included in the
`
`view. See SAMSUNG-1001, 6:24-26, FIG. 6 (showing arrows that display
`
`additional thumbnails of people included in the people view); 6:58-65, FIG. 13
`
`(showing +,- controls that display/hide names of people included in the people
`
`view; also showing a scroll bar at the side to control the portion of the view that is
`
`displayed). Yet Patent Owner seems to be arguing that everything associated with
`
`the people view must be shown at all times without additional user interaction
`
`beyond the initial input. Such a narrow view is improper, as it is misaligned with
`
`both the claim language and the specification. Renishaw P.L.C. v. Marposs
`
`Societa’ Per Azioni, 158 F.3d 1243, 1250 (Fed. Cir. 1998) (“The construction that
`
`stays true to the claim language and most naturally aligns with the patent’s
`
`description of the invention will be, in the end, the correct construction.”).
`
`Claim 18 and Patent Owner’s arguments for a narrow construction of it
`
`reinforce these points. Specifically, claim 18 recites, “responsive to an input that
`
`is indicative of a selection of the first person selectable thumbnail image, causing
`
`a first person view to be displayed on the interface, the first person view including
`
`(i) the first name and (ii) a representation of each digital file in the third set of
`
`digital files” (emphasis added). Because the claimed first person view includes a
`
`representation of “each” file, Patent Owner’s theory would require all files
`
`8
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`associated with the selected person to be displayed both simultaneously and
`
`responsive to the input. But the ability to display all files in this manner is
`
`obviously based on the number of files associated with the person, as screen real
`
`estate is not infinite. And, as discussed above, the ’228 patent clearly and
`
`purposefully limited the amount of information displayed in the initial display of a
`
`selected view and included controls to enable display of additional information.
`
`This remains true for the first person view, which, as shown in FIG. 32 below,
`
`contemplated multiple pages of associated files and provided controls for the user
`
`to select the number of “Items Per Page.”
`
`SAMSUNG-1001, FIG. 32 (annotated)
`
`
`
`If Patent Owner’s constructions were correct, claim 18 would cover what is
`
`shown in FIG. 32 only when the number of files associated with the selected
`
`person fits on one page, but not when the number of files spans multiple pages.
`
`
`
`9
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`But that is not what FIG. 32 shows or the ’228 patent describes. And it would be
`
`illogical for the claims to be interpreted in a manner that changes based on the
`
`number of files (or people) or the particular configuration of the display used to
`
`present a view. For these reasons, Patent Owner’s constructions are inconsistent
`
`with how a POSITA would have read the ’228 patent, and should be rejected.
`
`III. GROUND 1 RENDERS OBVIOUS THE CHALLENGED CLAIMS
`As shown in the Petition and as further clarified below in response to Patent
`
`Owner’s arguments in the POR, claims 1-19 are rendered obvious by Okamura in
`
`view of Belitz. SAMSUNG-1041, [14].
`
`
`
`A. Okamura-Belitz discloses “responsive to a second input...causing a
`people view to be displayed...the people view including:...a first name”
`
`Based on the overly narrow interpretation of “responsive to,” Patent Owner
`
`argues that claim limitations [1g] and [1i] are not satisfied by the Okamura-Belitz
`
`combination. See supra Section II. Specifically, Patent Owner contends that the
`
`limitations are not met because an additional mouse hovering action is needed. See
`
`POR, 21. Patent Owner does not appear to dispute that Okamura discloses display
`
`of a people view in response to an input or that Okamura’s people view includes
`
`the names of the people; rather, Patent Owner appears to advance an unsupported
`
`contention that the claim language requires more.
`
`10
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`Yet, for the reasons discussed above, “responsive to” should not be so
`
`narrowly construed in this instance. And as detailed in the Petition, the Okamura-
`
`Belitz combination renders obvious “responsive to a second input...causing a
`
`people view to be displayed...the people view including:...a first name.” See
`
`Petition, 46-53; SAMSUNG-1005, FIG. 21; SAMSUNG-1003, [133]-[143]. In
`
`particular, the use of mouse hovering to obtain “‘pieces of information’ a user
`
`might otherwise have to click to get” is a well-known strategy commonly
`
`employed to provide the user with the desired result without unnecessarily
`
`cluttering the screen with excessive content. SAMSUNG-1003, [77]; SAMSUNG-
`
`1041, [15].
`
`Moreover, as Dr. Greenspun previously explained, “[d]isplaying the name
`
`adjacent to the thumbnail image would have been obvious, and a POSITA would
`
`have been motivated to do so for allowing the user to avoid confusion on which
`
`face index belongs to whom.” SAMSUNG-1003, [143]; Petition, 52-53. As Dr.
`
`Greenspun further clarified, whether to show captions all the time or only just part
`
`of the time is simply a matter of “design choice and maybe a function of user
`
`preference.” EX-2022, 132:6-12; SAMSUNG-1041, [16]; SAMSUNG-1042, 75,
`
`Fig. 4.2 (displaying names adjacent to thumbnails was well-known); SAMSUNG-
`
`1043, FIG. 8 (same). Dr. Reinman does not seem to disagree and has not provided
`
`an opinion to the contrary. See SAMSUNG-1040, 96:9-21 (“I did not perform
`
`11
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`additional analysis to try and reengineer or improve Okamura in some way. That
`
`analysis, I was not asked, nor did I perform.”); see also id., 57:24-59:1.
`
`While Patent Owner suggests that such a design change would “conflict with
`
`the objective of Okamura’s uncongested index screens,” a POSITA “is also a
`
`person of ordinary creativity, not an automaton” and would have been more than
`
`capable of designing a system that is not overly congested. KSR Int’l Co. v.
`
`Teleflex Inc., 550 U.S. 398, 421 (2007); SAMSUNG-1041, [16]. Rather than
`
`presenting evidence to the contrary, Patent Owner’s expert simply explained that
`
`he “did not perform additional analysis to try and reengineer or improve Okamura
`
`in some way.” SAMSUNG-1040, 96:9-21.
`
`An alternative design of Okamura, even if it were to slightly increase the
`
`congestion level, would not automatically undermine a reason to modify it because
`
`obviousness “does not require that the motivation be the best option, only that it be
`
`a suitable option from which the prior art did not teach away.” PAR Pharm., Inc.
`
`v. TWI Pharms., Inc., 773 F.3d 1186, 1197–98 (emphasis omitted) (Fed. Cir. 2014)
`
`(citing Galderma Labs., L.P. v. Tolmar, Inc., 737 F.3d 731, 738 (Fed. Cir. 2013)).
`
`In this case, a POSITA would have been fully capable of weighing potential
`
`benefits associated with levels of congestion, for instance recognizing that the user
`
`may further “avoid confusion.” See Winner Int’l Royalty Corp. v. Wang, 202 F.3d
`
`1340, 1349 n.8 (Fed. Cir. 2000) (“The fact that the motivating benefit comes at the
`
`12
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`expense of another benefit...should not nullify its use as a basis to modify the
`
`disclosure of one reference with the teachings of another.”); In re Urbanski, 809
`
`F.3d 1237, 1244 (Fed. Cir. 2016); Medichem, S.A. v. Rolabo, S.L., 437 F.3d 1157,
`
`1165 (Fed. Cir. 2006) (holding that “[a] given course of action often has
`
`simultaneous advantages and disadvantages, and this does not necessarily obviate
`
`motivation to combine.”); SAMSUNG-1003, [143]; SAMSUNG-1041, [16].
`
`B. Okamura-Belitz discloses “the people view including:...a first
`name...[and]...a second name”
`
`Based on the overly narrow interpretation of limitations [1g], [1i], and [1k]
`
`as requiring the simultaneous display of both the “first name” and the “second
`
`name,” Patent Owner argues that these limitations are not met because such
`
`simultaneous display is not provided by the Okamura-Belitz combination. See
`
`supra Section II.
`
`However, for reasons discussed above and as confirmed by the Board in the
`
`Institution Decision, such simultaneous display is not required by the claims. See
`
`Institution Decision, 28. Based on the proper understanding of the ’228 patent’s
`
`claim language, and as explained in detail in the Petition, the Okamura-Belitz
`
`combination renders obvious displaying the “first name” and the “second name” in
`
`the claimed manner. See Petition, 52-53, 54-55; SAMSUNG-1003, [143]-[145];
`
`SAMSUNG-1005, FIG. 21; SAMSUNG-1041, [17].
`
`13
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`Moreover, as Dr. Greenspun previously explained, it “would have been
`
`obvious,” in the Okamura-Belitz combination, to “display the name adjacent to the
`
`first person electable thumbnail image” without additional mouse hovering because
`
`a POSITA would have recognized that doing so can help “allow[] the user to avoid
`
`confusion on which face index belongs to whom.” SAMSUNG-1003, [143]-[144];
`
`Petition, 52-53. As Dr. Greenspun clarified, whether to show all the names all the
`
`time or only just part of the time is simply a matter of “design choice and may be a
`
`function of user preference.” EX-2022, 132:6-12; SAMSUNG-1041, [18];
`
`SAMSUNG-1042, 75, Fig. 4.2 (displaying names adjacent to thumbnails was well-
`
`known); SAMSUNG-1043, FIG. 8 (same). Dr. Reinman has not provided an
`
`opinion to the contrary. See SAMSUNG-1040, 96:9-21 (“I did not perform
`
`additional analysis to try and reengineer or improve Okamura in some way. That
`
`analysis, I was not asked, nor did I perform.”); see also id., 57:24-59:1. Rather,
`
`Dr. Reinman acknowledged that making minor adjustments to help reduce clutter
`
`could be a matter of design choice. See SAMSUNG-1040, 99:3-100:18 (“[F]or
`
`any design, there are certain choices that the designers get to make....”).
`
`Moreover, as explained above, an alternative design of Okamura that may
`
`slightly increase its congestion level does not automatically undermine a reason to
`
`modify it because a POSITA would have nevertheless been able to weigh potential
`
`benefits associated with levels of congestion, for instance recognizing doing so
`
`14
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`could allow the user to further “avoid confusion.” SAMSUNG-1003, [143];
`
`SAMSUNG-1041, [19].
`
`C. Okamura-Belitz discloses “a [first/second] location selectable thumbnail
`image at a [first/second] location on the interactive map”
`
`As laid out in detail in the Petition and throughout the original declaration of
`
`Dr. Greenspun, a POSITA would have been motivated to modify Okamura in view
`
`of Belitz to provide location selectable thumbnail images at corresponding
`
`locations on the interactive map in the manner claimed. Petition, 11-25, 32-37;
`
`SAMSUNG-1003, [86]-[101], [113]-[121].
`
`In the POR, Patent Owner erroneously points to various alleged failings of
`
`the combination. As further clarified below, Patent Owner’s arguments are
`
`without merit.
`
`1. Petitioner’s first combination renders this feature obvious
`
`Regarding the proposed “first combination,” Patent Owner contends that a
`
`POSITA would not have been motivated to modify Okamura with Belitz because
`
`“none of Belitz’s thumbnails...convey geographical information....” POR, 34.
`
`Even if that were the case, a notion with which Petitioner strongly disagrees for
`
`reasons further discussed below, a POSITA would have been motivated to
`
`combine Okamura and Belitz to obtain “additional benefits.” SAMSUNG-1003,
`
`[88]-[92]; Petition. 12-17. For instance, in furtherance of Okamura’s stated
`
`15
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`objective of better managing digital contents, the proposed combination “enhances
`
`a user experience of ‘discern[ing] between the various objects’ by providing ‘a
`
`good view of what location is associated with what.’” SAMSUNG-1003, [89]
`
`(citing SAMSUING-1005, [0091], SAMSUNG-1006, [0002]).
`
`Even if the benefits obtained by incorporating Belitz’s thumbnails into
`
`Okamura were to come at the expense of some other benefit offered by Okamura, a
`
`POSITA pursuing the combination would have nevertheless been capable of
`
`weighing potential benefits associated with each, for instance recognizing that the
`
`benefits of viewing location-specific thumbnail images may be achieved in one
`
`instance and those of viewing location-specific cluster maps may be achieved in
`
`another. See Winner Int’l Royalty Corp. v. Wang, 202 F.3d 1340, 1349 n.8 (Fed.
`
`Cir. 2000) (“The fact that the motivating benefit comes at the expense of another
`
`benefit...should not nullify its use as a basis to modify the disclosure of one
`
`reference with the teachings of another.”); SAMSUNG-1041, [20]-[22].
`
`Moreover, contrary to Patent Owner’s assertions, Belitz’s thumbnails and
`
`Okamura’s cluster maps are functionally equivalent in the sense that both convey
`
`geographical information. SAMSUNG-1041, [23]. In fact, Dr. Reinman does not
`
`disagree. For instance, Dr. Reinman testified that “[Belitz] shows the association
`
`of at least some pictures with the geographic location on the map depending on
`
`how many thumbnails it’s currently presenting....” SAMSUNG-1040, 107:10-22.
`
`16
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`He further acknowledged that replacing cluster maps with thumbnails would not
`
`result in the loss of “all geographic context.” Id., 114:8-15.
`
`Patent Owner further argues that the proposed combination of Okamura and
`
`Belitz “carries the same noted disadvantages as the ‘related art’ references
`
`(Fujiwara and Takakura)” mentioned in Okamura. POR, 35-36. However, in both
`
`Fujiwara and Takakura, it can be difficult to grasp the geographical
`
`correspondence between digital files because their thumbnails are not placed
`
`directly on the map. SAMSUNG-1041, [24] (citing EX-2002, FIG. 12; EX-2020,
`
`FIG. 1). In contrast, it is not difficult to grasp the geographical correspondence
`
`between digital files in Belitz because, for example, a user looking at Belitz’s FIG.
`
`4b can easily understand which location the thumbnail 410b is associated with and
`
`which location the thumbnail 410c is associated with. SAMSUNG-1041, [24]
`
`(citing SAMSUNG-1006, FIGS. 4a-4b). Thus, the alleged problems with Fujiwara
`
`and Takakura that “may make it difficult to grasp the geographical
`
`correspondence” of their images are not manifested in the same manner in Belitz.
`
`SAMSUNG-1041, [24].
`
`Patent Owner also argues that the Okamura-Belitz combination somehow
`
`violates Belitz’s stated objectives of reducing overlap because, in the proposed
`
`combination, “at least some of graphical objects from Belitz overlaps on the map”
`
`17
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`and, as support, provides a cropped reproduction of an illustration originally
`
`provided by Dr. Greenspun:
`
`
`
`POR, 42
`
`
`
`However, a portion of Dr. Greenspun’s illustration that was not shown by
`
`Patent Owner clearly shows that the combination can be achieved without any
`
`overlap:
`
`
`
`SAMSUNG-1003, [88] (partial); SAMSUNG-1041, [25]-[26].
`
`
`
`18
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`Patent Owner further attempts to undermine the Okamura-Belitz
`
`combination by pointing to various other alleged defects in the motivation to
`
`combine. See POR, 43-52. None have merit.
`
`For instance, while Patent Owner contends that “Belitz’s thumbnails reduce
`
`the ability to provide a view of ‘what location is associated with what,’” they
`
`ignore the careful explanation previously provided by Dr. Greenspun. POR, 43-46.
`
`Indeed, Dr. Greenspun explained in his first declaration that incorporating the
`
`thumbnails of Belitz into Okamura would have resulted in the “added functionality
`
`that allows a user to preview pictures associated with a given location” and do so
`
`in a manner that allows the user to more “clearly see the associations.”
`
`SAMSUNG-1003, [90]-[91]. Thus, instead of having to click on individual
`
`clusters as in Okamura to ascertain which pictures are associated with which
`
`locations, Belitz provides a way for Okamura to provide such information all at
`
`once for multiple locations on the map. SAMSUNG-1041, [27].
`
`Relatedly, Patent Owner further contends that “Okamura already allows a
`
`user to ‘preview pictures.’” POR, 46. But as noted above, the incorporation of
`
`Belitz’s thumbnails allows the user to quickly associate multiple preview pictures
`
`with multiple locations on the map without having to individually navigate through
`
`each of the clusters. SAMSUNG-1041, [28]. Thus, the combination of Okamura
`
`and Belitz helps improve user experience and overall content awareness by
`
`19
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`providing the user with a preview of the digital files associated with multiple
`
`corresponding locations. Id. In short, instead of changing the “hallmark aspects of
`
`either of these references” as Patent Owner contends, the proposed combination of
`
`Okamura and Belitz provides a known and predictable alternative to displaying and
`
`managing digital content in a manner that can help improve user experience.
`
`SAMSUNG-1003, [89]; SAMSUNG-1041, [28].
`
`Lastly with regard to the “first combination,” Patent Owner’s assertion that
`
`Petitioner has “failed to demonstrate that the first combination (based on
`
`Okamura’s second embodiment) would have been used with Okamura’s FACE
`
`index screen 410” similarly falls flat. POR, 50. Dr. Greenspun previously
`
`explained in great detail how, inter alia, “Okamura discloses or renders obvious
`
`that the second input of displaying the face-based index screen is subsequent to the
`
`first input of displaying a map view screen.” SAMSUNG-1003, [133]-[138]. To
`
`the extent Okamura does not explicitly disclose this transition, a POSITA certainly
`
`would have found it to be obvious. Id., [138]; SAMSUNG-1041, [29].
`
`
`
`2. Petitioner’s second combination renders this feature obvious
`
`Regarding the Petitioner’s first alternative combination (“second
`
`combination”), Patent Owner contends that incorporating Belitz into Okamura in
`
`the manner proposed would not be desirable to a POSITA because “much of the
`
`20
`
`
`
`Proceeding No. IPR2022-00222
`Attorney Docket No: 39843-0117IP1
`information s