`U.S. Patent 10,621,228
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`UNIFIED PATENTS, LLC
`Petitioner
`
`v.
`
`MEMORYWEB, LLC
`Patent Owner
`
`
`
`Case no. IPR2021-01413
`Patent 10,621,228
`
`
`
`
`PETITIONER’S AUTHORIZED SUR-SUR REPLY TO PATENT
`OWNER’S SUR-REPLY1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1 The Board authorized this sur-sur reply in its October 27, 2022 email. See EX1040.
`
`
`
`
`
`
`
`I.
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`PATENT OWNER’S SUR-REPLY (PAPER 35), PAGE 7: LINES 9-11
`
`Regarding limitations [1n], [1p],2 and claim 5, Patent Owner (“PO”) argues
`
`“[i]ncluding the first name and second name at separate times would [] conflict with
`
`the ‘responsive’ relationship between the ‘second input’ and ‘causing’ the display of
`
`the ‘people view’” and quotes Dr. Bederson’s second deposition (EX2046) at 72:21-
`
`73:9 as support, stating “Dr. Bederson agreed ‘claim limitation [1n] and [1p]
`
`are…two elements of a whole claim including a people view, which has to be
`
`displayed and responsive to a second input.’” Patent Owner’s Sur-Reply (“POSR”)
`
`(Paper 35), 7:4-6, 7:9-11. But the inferences PO draws from Dr. Bederson’s
`
`testimony take it out of context.3
`
`
`2 Limitations [1n] and 1[p] recite the people view including: . . . (ii) a first name
`
`associated with the first person, the first name being displayed adjacent to the first
`
`person selectable thumbnail image [and]. . . (iv) a second name associated with the
`
`second person, the second name being displayed adjacent to the second person
`
`selectable thumbnail image. EX1001, claim 1; Petition (Paper 2), 55, 60. Claim
`
`language is italicized herein.
`
`3 The quote from Dr. Bederson’s testimony is based on questioning regarding Exhibit
`
`2044, which was introduced in this proceeding for the first-time during Dr.
`
`
`
`
`
`
`
`
`1
`
`
`
`That claim limitations [1n] and [1p] are two “elements of a whole claim” does
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`
`
`not require that the first name and second name must be displayed simultaneously,
`
`as PO suggests. Under the plain meaning of the claims, the people view that includes
`
`the first name and second name of limitations [1n] and [1p] is displayed responsive
`
`to a second input regardless of whether the first name and second name are displayed
`
`simultaneously or at different times. EX1001, claim 1; EX2046, 68:4-24, 73:3-9,
`
`73:15-24, 74:10-18, 75:8-22, 78:2-11, 78:23-79:11. The first name and second name
`
`are displayed in response to the second input because they are displayed as part of
`
`the people view, as a result of the people view being selected by the second input,
`
`and the Petition explains how the prior art shows this. EX1001, claim 1; Petition,
`
`47-52, 55-57, 60-61. Specifically, the Petition explains that when Okamura’s FACE
`
`tab 412 is depressed (responsive to a second input), face cluster display area 431
`
`showing thumbnail images of faces included in contents is displayed (causing a
`
`
`Bederson’s second deposition and appears to have been created by PO. EX2046,
`
`70:5-16. Dr. Bederson testified multiple times that he had not seen this exhibit
`
`before, was not familiar with it, and that the exhibit lacked context in relation to the
`
`Challenged Claims. Id., 72:9-12, 73:10-14, 73:23-24, 75:5-7, 75:19-22, 77:14-25,
`
`190:3-12.
`
`
`
`
`
`
`
`2
`
`
`
`
`people view to be displayed), where face cluster display area 431 (the people view)
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`includes information 433 having a first person’s name (first name) displayed for the
`
`first person’s thumbnail image and information 433 having a second person’s name
`
`(second name) displayed for the second person’s thumbnail image. Id.
`
`Dr. Bederson explained how the first name and second name of the people
`
`view would be displayed consistent with the proper plain meaning interpretation
`
`during his second deposition, in relation to the various “views” shown by Exhibit
`
`2044; specifically, when asked whether “View No. 2 could be encompassed by
`
`limitations [1n] and [1p],” he stated “View No. 2 is not complete…I would guess
`
`probably a better answer would be to say that you see View 2 and View 3 together
`
`worked in a similar way to Okamura[], perhaps they could be…part of a teaching of
`
`claim limitations 1[n] and 1[p].” EX2046, 75:1-19. Dr. Bederson further explained
`
`“to the extent that view 2 and view 3 represent a system that works in a comparable
`
`way to Okamura, then, it perhaps could read on limitations [1n] and [1p].” EX2046,
`
`78:7-10. Thus, Dr. Bederson explained the plain meaning encompasses displaying
`
`what is shown in view 2 and view 3 of Exhibit 2044 at different times in the people
`
`view. Id.; EX2044.
`
`
`
`
`
`
`
`3
`
`
`
`
`II.
`
`POSR (PAPER 35), PAGE 7: FOOTNOTE 2
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`PO further argues “[c]laim 1 recites a (i) a single ‘second input’ and (ii)
`
`‘causing’ the display of the ‘people view’ (that includes a first name and second
`
`name) ‘responsive to’ that same ‘second input.’” POSR, 7. As a footnote to this
`
`sentence (footnote 2), PO states “Dr. Bederson refused to identify a POSITA’s
`
`understanding of ‘causing,’” citing to his deposition transcript at 58:4-59:6 and
`
`61:15-64:3. POSR, Footnote 2.4 Notably, PO never objected to Dr. Bederson’s
`
`testimony as being non-responsive. EX2046, 58:4-59:6, 61:15-64:3. Regardless, PO
`
`mischaracterizes Dr. Bederson’s testimony. During Dr. Bederson’s second
`
`deposition, PO questioned Dr. Bederson about the meaning of causing in view of
`
`Exhibit 2043, which appears to be dictionary definitions of “cause.”5 EX2046,
`
`61:15-64:3; EX2043. In response, Dr. Bederson did not simply “refuse” to identify
`
`a POSITA understanding of the term. Instead, Dr. Bederson confirmed that he did
`
`not have “any particular cause for concern” when reviewing the definitions in light
`
`of the Petition and the prior art. Id., 63:11-64:3. The Petition explained how
`
`
`4 The POSR improperly raises the interpretation of causing for the first time.
`
`5 Dr. Bederson testified that he had not seen Exhibit 2043 before his second
`
`deposition and was not familiar with it. EX2046, 61:18-21, 63:11-64:3, 190:3-12.
`
`
`
`
`
`
`
`4
`
`
`
`
`Okamura discloses or at least renders obvious causing a people view to be displayed
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`as recited in claim 1, showing that when Okamura’s FACE tab 412 is depressed
`
`(responsive to a second input), face cluster display area 431 showing a thumbnail
`
`image of each of the faces included in contents is displayed (causing a people view
`
`to be displayed). See, e.g., Petition, 47-52. Nothing in Exhibit 2043 contradicts this
`
`showing; if anything, it tends to emphasize how broad the term causing is,
`
`encompassing, for example, events that simply “bring about” some result even if not
`
`the direct effect. See, e.g., EX2043, 2, 5.
`
`
`Dated: November 4, 2022
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Respectfully Submitted,
`
`/Ellyar Y. Barazesh/
`Ellyar Y. Barazesh
`Reg. No. 74,096
`
`
`
`
`
`
`
`5
`
`
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`Exhibit
`
`1001
`
`1002
`
`1003
`
`1004
`
`1005
`
`1006
`
`1007
`
`1008
`
`1009
`
`EXHIBIT LIST
`
`Description
`
`U.S. Patent 10,621,228 (the “’228 patent”)
`
`
`Declaration of Dr. Bederson
`
`File History of U.S. Patent 10,621,228
`
`U.S. Patent Application Publication 2011/0122153 (“Okamura”)
`
`U.S. Patent 6,714,215 (“Flora”)
`
`U.S. Patent Application Publication 2011/0163971 (“Wagner”)
`
`U.S. Patent Application Publication 2010/0172551 (“Gilley”)
`
`File History of Flora (“Flora application”)
`
`Hyunmo Kang, Benjamin B. Bederson, and Bongwon Suh, Capture,
`
`Annotate, Browse, Find, Share: Novel Interfaces for Personal Photo
`
`Management, International Journal of Human-Computer Interaction,
`
`23(3), 315-337 (2007)
`
`Florida Center for Instructional Technology, iPhoto 09 Basics,
`
`1010
`
`retrieved from https://etc.usf.edu/te_mac/movies/pdf/iphoto09.pdf
`
`1011
`
`(2010)
`
`Amended Complaint, MemoryWeb, LLC v. Apple, Inc., 6:21-cv-
`
`00531- ADA (W.D.Tex.)
`
`
`
`
`
`
`
`
`
`
`
`
`
`Exhibit
`
`1012
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`Description
`
`Complaint, MemoryWeb, LLC v. Samsung Electronics Co., Ltd. and
`
`Samsung Electronics America, Inc., 6:21-cv-00411-ADA (W.D.Tex.)
`
`Excerpts from Designing the User Interface, Strategies for Effective
`
`1013
`
`Human-Computer Interaction by Ben Shneiderman and Catherine
`
`Plaisant, 5th Edition (2010)
`
`Benjamin B. Bederson, PhotoMesa: A Zoomable Image Browser
`
`Using Quantum Treemaps and Bubblemaps, Proceedings of the 14th
`
`1014
`
`Annual ACM Symposium on User Interface Software and Technology
`
`(UIST ’01), 71–80, Association for Computing Machinery, New York,
`
`NY, USA, (2001)
`
`Bongwon Suh, Haibin Ling, Benjamin B. Bederson, and David W.
`
`Jacobs, Automatic Thumbnail Cropping and its Effectiveness,
`
`1015
`
`Proceedings of the 16th Annual ACM symposium on User Interface
`
`Software and Technology (UIST '03), 95–104, Association for
`
`Computing Machinery, New York, NY, USA, (2003)
`
`Ben Shneiderman, Benjamin B. Bederson, and Steven M. Drucker,
`
`1016
`
`Find that photo! Interface strategies to annotate, browse, and share,
`
`Commun. ACM 49, 4 (April 2006), 69–71.
`
`
`
`
`
`
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`
`
`Exhibit
`
`1017
`
`1018
`
`Declaration of Keven Jakel
`
`Docket Reports
`
`Description
`
`NASA, Space Station Assembly, Baikonur Cosmodrome, retrieved
`
`from
`
`http://www.nasa.gov/mission_pages/station/structure/elements/baikon
`
`ur.html
`
`Authorization Email from the Board for Petitioner’s Reply
`
`Blog Post regarding Petition Filing
`
`REDACTED Supplemental Declaration of Keven Jakel
`
`CONFIDENTIAL Supplemental Declaration of Keven Jakel
`
`CONFIDENTIAL Apple Membership Agreement
`
`CONFIDENTIAL Samsung Membership Agreement
`
`Newsletter regarding Petition Filing
`
`Email list summary for Newsletter
`
`News Update regarding Petition Filing
`
`CONFIDENTIAL Email list for News Update
`
`REDACTED version of Patent Owner Response
`
`REDACTED Transcript of Kevin Jakel Deposition
`
`
`
`1019
`
`1020
`
`1021
`
`1022
`
`1023
`
`1024
`
`1025
`
`1026
`
`1027
`
`1028
`
`1029
`
`1030
`
`1031
`
`
`
`
`
`
`
`Exhibit
`
`Description
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`Joint Claim Construction Statement, MemoryWeb, LLC v. Samsung
`
`1032
`
`Electronics Co., Ltd (a Korean Company) and Samsung Electronics
`
`America, Inc., 6:21-cv-00411-ADA (W.D.Tex)
`
`1033
`
`U.S. Patent 6,259,819 (“Andrew”)
`
`Transcript of the Deposition of Glenn Reinman, Ph.D. dated August
`
`18, 2022
`
`Definition of the Cambridge English Dictionary
`
`Definition of the Dictionary.com Dictionary
`
`U.S. Patent Applicant Publication 2008/0126958 (“Louie”)
`
`Reply Declaration of Dr. Bederson
`
`REDACTED version of Patent Owner’s Sur-Reply
`
`Authorization Email from the Board for Petitioner’s Sur-Sur Reply
`
`
`
`
`
`1034
`
`1035
`
`1036
`
`1037
`
`1038
`
`1039
`
`1040
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2021-01413
`U.S. Patent 10,621,228
`
`CERTIFICATE OF SERVICE
`
`The undersigned certifies that the foregoing PETITIONER’S SUR-SUR
`
`REPLY TO PATENT OWNER’S SUR-REPLY and EXHIBIT 1040 was served
`
`on November 4, 2022, via e-mail, as agreed to by counsel, upon the following
`
`counsel of record for Patent Owner:
`
`Jennifer Hayes
`Nixon Peabody LLP
`300 South Grand Avenue, Suite 4100
`Los Angeles, CA 90071-3151
`jenhayes@nixonpeabody.com
`
`George Dandalides
`Nixon Peabody LLP
`70 West Madison, Suite 5200
`Chicago, IL 60602-4224
`gdandalides@nixonpeabody.com
`
`Matthew A. Werber
`Nixon Peabody LLP
`70 West Madison, Suite 5200
`Chicago, IL 60602-4224
`mwerber@nixonpeabody.com
`
`
`
`/Ashley F. Cheung/
`Ashley F. Cheung
`Paralegal
`Unified Patents, LLC
`
`
`
`Dated: November 4, 2022
`
`
`
`
`
`
`
`
`
`
`
`