DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`MemoryWeb Ex. 2047
`Unified Patents v. MemoryWeb – IPR2021-01413
`
`

`

`'228 Patent Overview —
`Methods of Organizing and Displaying
`Digital Files that Allow Preservation of
`
`Memory Details
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`
` {VO 0iUSO 1062 122882
`
`Facebook, Flickr. Shutterfly and countless other
` ia) United States Patent
`
`(10) Patent Nox
`US 10,621,228 B2
`Desmond et al. *Apr. 14, 2020 (45) Date of Patent:
`
`
`social media and specialty digital files sites allow users to
`
`
`z
`METHOD AND APPAILATUS FOR
`(Se
`Heferences (ined
`MASAGING DIGITAL FILES
`post and share images to a community with a frequency and
`U8. PATIENT DOCUMENTS:
`
`
`COP) Apphinit! MOMTE Hobitiings. 100, cilew bili.
`"
`
`IMT Euan5404514 A54629104 FL DIPack
`
`iL JUS
`ease that continues to feed the fire of the digital revolution.
`
`
`*
`+
`e+
`Christ
`(Couninwert!
`(72)
`lovers:
`.
`Desenueel Cle
`Elly
`However, they don’t allow muchorganization ofdigital tags,
`“eenStBe
`rote wartuan
`
`
`Chica. tl. (418)
`tnagstiny Hh Wale
`d :
`en i
`f di
`it: | fil 7 ad th
`7 hi lit rt
`rt tl
`
`
`(9) Ate SN MagsCi
`i
`ynamic viewing of
`digital
`files, and
`the ability to export
`the
`+
`'
`toe
`1
`(1S),
`.
`“a
`“Uy
`F
`:
`F
`:
`Yt tesataPoatetera
`CEE PUREE LON
`digital files with new digital tags.
`
`pitent iy erended or adpisted violet 35
`utenteae aL Malate Aeneanior Personal Digival
`WSC, 1S) hyA cluyns
`Phot Libraies: Lowering Darfiens while Resisiag inventives.” Tech.
`This patent
`le sulyeot 1.0 kermiingt this
`Rear HeLaa, D1 taryland. rue | 1H pages)
`labia,
`Ex. 1001, 1:50-56
`Apnh Mi 16ST2RH
`.
`(21)
`Peivwery Eavaminee — lac Time
`
`(22) Filed, (74) Annem Jump or Pen—Niven Pesliody LLPSay. 20, BT
`
`What is needed to complement the widespread availabil-
`astm
`en
`0 aintA)28
`ity ofdigitalfiles is amediumthat allows people to organize,
`Acompolerimptements) method ofaeimcining digital lags
`i
`will digital files comprises atvring plourfity afdipital filer
`Koluied U8, Appltestion Duty
`view, preserve and share these files with all the memory
`having embasidec] ehencin ermal daua aod rovetackata inelind-
`(43) Conginuatlon alapplicalow Mo, (936500 tba on
`TOR Ms; recerring, via.
`Am tier interince dewice of
`4 client
`Aus 8, 2019which i cominumion of.applkanog
`device, 0 firs tau Inbel cenisintqg alphancmeric text creak
`Continned
`details captured. connected and vivified via an interactive
`ond inpuiiad bynnser oPUnecTient device: nudfyiaw stew
`sealahi
`a controller device, a selec first ine of the tags ofHe
`Tmetackiua ina first oF the digital Ges; to Twclode tbe first typ
`euwry
`interface, Such a solution would allowdigital files, including
`Whel; receiving, vin Ihe rserimerigoe device aramailier ser
`rey
`inlerlnce device, an insiroction ip search beall oP the eligieal
`(Catia)
`Files heving at Teast the firs ing libel= responsive a receiviens
`documents, photos, videos and audio,totell a full story now,
`the instruction, automatically searalang for all ifthe digital
`=
`=
`(2) WS Ch
`"vaieodisplay device assoczaled will Ue client device, a first
`SN,
`i
`F
`i
`.
`one. a pueden nee en Files Ineview at lenst fhe firs tag label: and displaying, ane
`(Sh) Pleld of Clavsificatinn Seureh
`
`16907(30/001COKE 8048 OIA0NY—Jadacinc atthes fat hw label and tor general ions to come.
`1 Claims, 36 Drawing Sheets
`CRC GIR HUSHnG: CHL6MMIT: CARE 1
`Sey ygpllcation Mile for comple: senely hairy
`MA be
`Nesetener
`
`es
`
`th toe tt
`Geer 16rer
`cada feat
`
`iad (ioe =
`
`(Comriemed | Ex. 1001, 1:50-56
`
`
`As described in detail below, the various embodiments
`provide much-needed platforms that save a user significant
`time, provide significant information with minimal screen
`space, and provide an appealing and customizable interface
`that will enhance the user experience.
`
`Ex. 1001, 1:60-67
`Ex. 1001, 1:60-67
`
`
`
`
`
`Ex.1001, cover
`Ex.1001, cover
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMO NSIRA TIVE EXHIBIT- NOTEVIDENCE
`
`Ex. 1001, 2:55-59
`Fx. 1001, 2:55-59
`
`ID, 3-4; Pet., 11
`I, 3-4; Pet., 11
`
`

`

`Map View
`
`Ex. 1001, FIG. 41
`
`Location View
`
`People View
`
`Person View
`
`Ex. 1001, FIG. 7
`
`Ex. 1001, FIG. 34
`
`Ex. 1001, FIG. 32
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 1-4
`
`

`

`'228 Patent Overview — the “map view” including |
`clammlaiicieleSS
`
`
`
`selecting the map.
`
`
`In this view, individual or groups of
`Digital Piles are illustrated as photo thumbnails (see indi-
`087
`0875)) on the map and the user can select
`the thumbnail to:see all the Digital Files with the same
`location (as seen FIG. 34 (indicator 1630)) or the user can
`use the interactive map and narrow the map view byeither
`using the zoom in/zoomout bar (0876) on the left or simply
`
`
`Ex. 1001, 29:48-55
`Fx. 1001, 29:48-55
`
`Ex. 1001, FIG. 41
`Fx. 1001, HG. 41
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSIRATIVE EXHIBIT- NOTEVIDENCE
`
`POR, 1-2
`“POR, 1-2
`
`

`

`
`
`
`
` Wingicy Factc
` | tre
`
`FIG, 34
` Multiple Location Application View——
`
`In the second Locations Application View within FIG, 34.
`a single location (1630) is illustrated. The individual loca-
`tion name is displayed at
`the top of the page (1632).
`Thumbnails of each Digital File within the specific collec-
`tions are illustrated.
`
`Ex. 1001, 24:37-41
`Ex. 1001, 24:37-41
`
`451 N. Ciark st
`hitagn Winns, tanita ytates
`
`:
`= r
`[--S bo
`
`Le
`
`“Gy ee a
`~ =
`
`ren
`
`Ex. 1001, FIG. 34
`Fx. 1001, HG. 34
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMO NSIRATIVE EXHIBIT- NO TEVIDENC E
`
`POR, 3
`POR, 3
`
`

`

`
`
`
`
`items Per Pope: EI|50|[200|
`
`
`
`ra
`
` In FIG. 32, both of the People Application Views are
`illustrated. The first People Application View (1400) 1s used
`Se
`to displayall the peoplethat were created within the user’s
`Application. This view can be seen byselecting “People”
`(1401) from any of the Application Views within the Appli-
`cation. The people can be listed in various sort orders though
`ey
`7
`T°
`1.
`%
`ee
`s
`laete
`;
`rp
`7
`1 a
`ae
`a drop-down (1402) such as: Newest
`to Oldest (added).
`Oldest to Newest (added), Alphabetical (A-7). Alphabetical
`(Z-A), etc. Additional sorts are contemplated such as age
`sort. For each person, a thumbnail oftheir face along with
`their nameis depicted. In this figure, Jon Smith (1403) and
`JC Jon Smith (1404) along with some other people are
`illustrated.
`
`:
`
`°
`
`Me
`*’
`
`4 Jan Smith
`
`1ace
`\
`
`ihaley
`Jecksan Seilth
`
`Ex. 1001, FIG. 32
`Ex. 1001, HG. 32
`
`Ex. 1001, 22:59-23:4
`Fx. 1001, 22:59-23:4
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSIRATIVE EXHIBIT- NOTEVIDENCE
`
`POR, 3-4
`POR,3-4
`
`

`

`Gilellaam@rolaiidulonela DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Construction
`
`e@rreltan
`
`“RESPONSIVE TO”
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`
`
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`Ex. 1001, 35:33-39
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1001, FIG. 41
`
`POR, 26-28
`POSR, 2-5
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`Ex. 1001, 23:34-35
`
`Ex. 1001, 29:41-56
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1001, FIG. 41
`
`POR, 26-28
`POSR, 2-5
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`American Calcar, Inc. v. American Honda Motor Co., Inc.,
`651 F.3d 1318, 1339-1340 (Fed. Cir. 2011)
`
`Microsoft Corp. v. FG SRC, LLC,
`860 F. App'x 708, 714 (Fed. Cir. 2021)
`
`Fujitsu Ltd. v. Belkin Int'l, Inc.,
`2012 U.S. Dist. LEXIS 142102, at *88
`(N.D. Cal. Sep. 28, 2012)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 26-28
`POSR, 2-5
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`Dr. Bederson
`
`Ex. 2046, 49:13-50:11
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POSR, 4-5
`
`

`

`Construction
`
`e@rreltan
`
`PEOPLE VIEW
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`
`
`
`

`

`the people view must include both a first name and a second name… displayed adjacent to the
`person selectable thumbnail images
`
`Ex. 1001, FIG. 32
`
`Ex. 1001, 22:59-23:4
`
`Ex. 1001, 35:63-36:11
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 28-29
`POSR 5-8
`
`

`

`the people view must include both a first name and a second name… displayed adjacent to the
`person selectable thumbnail images
`
`Ex. 2044
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR 28-29
`POSR 5-8
`POSSR 3
`
`

`

`Construction
`
`e@rreltan
`
`THE INDICATION FEATURE(S)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`
`
`
`

`

`The map view displayed in response to the first input must include a first thumbnail image on the
`interactive map and also include an indication feature that is connected to that first thumbnail
`image on that interactive map
`
`Ex. 1001, FIG. 41
`(excerpted)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1001, 35:33-39
`
`Ex. 1001, 36:12-16
`
`Ex. 1001, 36:17-19
`
`POR, 30-31
`
`

`

`the map view must include both “a first indication feature” and “a second indication feature” in the
`same view
`
`Ex. 1001, 36:12-16
`
`Ex. 1001, 36:23-27
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1001, FIG. 41
`
`POR, 32
`
`

`

`Petitioner Has Not Carried Its Burden DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Dr. Bederson, First Deposition
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2035, 81:3-16
`
`POR, 33-34
`POSR, n. 3
`
`

`

`Obviousness over Okamura & Flora DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`Ground 1:
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Limitation [1d]: “the map view
`including. .
`. [first/second] location
`
`selectable Thumbnail image |s]”
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Okamura
`
`Flora
`
`Okamura + Flora
`
`Ex. 1004, Fig. 18
`
`Ex. 1005, Fig. 3
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2038, ¶104
`
`POR, 37-38
`POSR, 10-13
`
`

`

`
` mup
`
`
`image associated withMfclicked marker ts displayed on the
`
`POSR, 10-13 DEMO NSIRATIVE EXHIBIT- NO TEVIDENC E
`
`For example, there has been proposed an inlorma-
`[0005]
`tion processing apparatus which arranges thumbnail icons of
`images side bysidein timeseries and displays the thumbnail
`icons in afilm window, displays position icons indicating the
`shooting locations of these images in a map window, and
`displays these icons in association with each other (see,
`for
`example. Japanese Unexamined Patent ApplLcaserPrnttica-
`tion No.
`2001-1) 60058 (PIG.
`12)). This information process-
`ing apparatus is configured such that, for example, when a
`click operation on a thumbnail icon is performed bythe user.
`a position icon indicating the shooting location of an image
`corresponding to the clicked thumbnail icon ts displayed at
`the center of the map window,
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 39-40
`POR, 39-40
`POSR, 10-13
`
`{0006} Also, there has been proposed an information pro-
`cessing system whicharranges thumbnail images sidebyside
`in limeseries anddisplays the thumbnail images on an image
`list display section, displays markers at positions on a map
`corresponding to the shooting locations of these images, and
`displays these images and markers in association with cach
`other (see, for example, Japanese Unexamined Patent Appli
`cation Publication No. 2007-323544 (FIG, 7)).
`Inthis infor-
`mation processing system, whge“a click operation on a
`marker displayed on the mafvis performed by the user, an
`
`ae Pop
`
`as 4 pop-up
`
`Ex. 1004, ¶ [0005]
`Ex. 1004, { [0005]
`
`Ex. 1004, ¶ [0006]
`Ex. 1004, { [0006]
`
`

`

`
`the images taken in lokyo and its vicinity.
`
`
`
`is supposed that images taken
`Also, for example, it
`[0009]
`bya person living in Tokyoinclude relatively many images of
`‘Tokyo andits vicinity (for example, Shinagawa ward, Seta-
`gaya ward, and Saitamacity), and relatively few images of
`other regions (for example, United States or United Kingdom
`visited by the personona trip). According!y, when displaying
`the correspondenc ¢ Detween Linages taken 1p
`lokvo and its
`vicinity and images taken
`in other regions. and their gener
`ited positions, for example, it is necessary to display the map
`itascale sullicently large to show the countnes of the world
`In this case, marks indicating the generated positions ofthe
`images taken in Tokyo andits vicinity (for example. Shina-
`guwaward, Setaguya ward. and Saitamacity) are displayedat
`substantially the sameposition on the map, which may make
`it difficult to grasp the geographical correspondence between
`
`
`
`
`Ex. 1004, ¶ [0009]
`Fx. 1004, ¥ [0009]
`
`POR, 39-40
`POR, 39-40
`POSR, 10-13
`POSR, 10-13
`
`Ex. 1004, ¶ [0010]
`Ex. 1004, { [0010]
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`
`
`Lowever,in therelated art descnbed above, images
`[0008]
`representing contents, and marks indicating the generated
`positions of these contents are displayed relatively far apart
`from each other, which supposedly makes it difficult to intu
`gcourmphical correspondence between indi-
`itively graspthe
`|
`ECOL]
`vidual contents
`
`Ex. 1004, ¶ [0008]
`Fx. 1004, { [0008]
`
`
` display
`
`{0010} On the other hand, for example, when the mapts
`displayed at a scale sufficiently small to show regions tn the
`vicinity of Tokyo, marks indicating the generated positions of
`the images taken in Tokyo andits vicinity (for example,
`Shinagawa ward, Setagayva ward, and Saitamacity) are dis-
`playedin suitable placement on the map. Therefore, the gen-
`erated positions of the images taken in Tokyoandils vicinity
`can be grasped.
`Llowever,
`in this case,
`it
`is not possible to
`the generated positions of
`images taken tn other
`regions (lor example,
`the United States or United Kingdom)
`nm
`the m ip.
`| wk! ip it difficult
`to grusp he genenite 1 nwsi-
`
`nons of individual images
`
`

`

`Dr. Bederson
`
`Dr. Bederson
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2035, 65:6-25
`
`Ex. 2035, 68:21-69:16
`
`POR, 47
`
`

`

`Okamura
`
`Dr. Bederson
`
`Ex. 2046, 145:15-22
`
`Ex. 1004, Fig. 18 (annotated)
`
`Ex. 1004, ¶ [0215]
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 39-41
`POSR, 10-13
`
`

`

`Prof. Reinman
`
`Prof. Reinman
`
`Prof. Reinman
`
`Ex. 2038, ¶ 111 (citing Ex. 1004, Fig. 18)
`
`Ex. 2038, ¶112 (citing Ex. 1004, Fig. 18)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2038, ¶ ¶113-114
`
`POR, 41-42
`POSR, 10-13
`
`

`

`Fujiwara
`
`Flora
`
`Takakura
`
`Ex. 2005, Fig. 12
`
`Ex. 1005, Fig. 3 (annotated)
`
`Ex. 2040, Figs. 7 (partial, annotated)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 39-40
`POSR, 10-13
`
`

`

`different locations simultaneously regardless of how geographically far apart those
` locations are. See e.g. EX 1004, 0009 (“whendisplaying the correspondence between
`
`baal)
`
` pre-determined penad
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`Ex. 2038, ¶130-133
`Fx. 2038, 7130-133
`
`Ex. 1005, FIG. 2 (annotated)
`Ex. 1005, HG. 2 (annotated)
`
`POR, 43-45
`POR, 43-45
`POSR, 10-13
`POSR, 10-13
`
`Okamura and Flora are different
`
`|
`
`.
`—
`In this embodiment, media items, typically
`lrepresented by ions 42 (of “thumbnail” versions), are
`displayed when a position indicator, shown as cursor 44,
`moved proximate fo certain locations
`on
`an electronic
`geo
`graphic
`map
`46, These icons 42 notify the user that media
`items are associated with predetermined coordinates of
`“locations” on the map thal are proximate to the position of
`the cursor 44. The
`icons 42 further provide the user with a
`visual object to select with the “click” of a mouse bulton (o1
`another conventional mechanism) to obtain direet access fo
`the content of the associated media items. All map locations
`are not necessanly associated with media
`items,
`For
`example, if
`the user moves the cursor 44 to a new location
`jon the electronic map, the icons 42 displayed proximate io
`the
`old
`location will cventually disappear
`or
`fade aller
`a
`L
`lume
`
`
`Ex. 1005, 6:5-19
`Fx. 1005, 6:5-19
`
`130. Okamura also emphasizes the importance of showing content from
`
`images taken in Tokyo andits vicinity and images taken in other regions, and their
`
`generated positions”). However,
`
`in Flora,
`
`the user needs to move the cursor 44
`
`“proximate to certain locations on an electronic geographic map 46” to cause the
`
`icons to appear, and the icons disappear within a certain time after the cursor is
`
`moved awayfrom a location. EX1005, 6:5-19.
`
`132.
`
`If the user wanted to knowwhether or not there is content associated
`
`with other locations (e.g., the areas annotated in blue and green), the user would need
`
`to move the cursor in those areas. EX1005, 6:5-19. Further, previously-displayed
`
`icons maydisappear after a certain period oftime, such that the user would need to
`
`remember that
`
`there were icons one location to understand the correspondence
`
`between the various content associated with each icon that may appear on the map.
`
`EX1004, 0011
`
`133. Petitioner does not attempt to address the location “thumbnail image”
`
`limitation with reference to anydisclosure other than Flora’s icons. Because of these
`
`deficiencies regarding combining Flora, | disagree that this limitation would have
`
`been obvious based on combining Okamurawith Flora.
`
`
`

`

`Institution Decision
`
`Prof. Reinman
`
`ID, 55
`
`Ex. 2038, ¶116
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 43-45
`POSR, 10-13
`
`

`

`Prof. Reinman
`
`EX2038, ¶111, 117
`
`POR, 44-45
`POSR, 13-14
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`121.
`
`In FIG. 35, Okamura illustrates an example where a map 760 is
`
`displayed at a scale showing Tokyo and Kyoto with cluster maps displayed.
`
`
`
`
`
`EX1004, 0324. For these clusters, the “center positions are located within relatively
`
`narrow ranges in Tokyo and Kyoto” and thus “the generated cluster maps are
`
`displayed in an overlaid manner.” /d. The scale of the map 760 makes “it difficult
`
`to grasp individual cluster maps in regions where the cluster maps are densely
`
`concentrated.” /d.,0325. Okamurastresses the necessity of having the cluster maps
`
`be “somewhat large for the user to recognize these cluster maps” and discredits
`
`making the cluster maps smaller because this makes them “hard to see, making it
`
`difficult to grasp the details of the cluster maps.” /d.
`
`Inthe case when thescale of the background mapis
`{0325]
`set relatively largein this way, it
`is supposed that the cluster
`maps overlap each other, making it difficult to grasp incdi-
`vidual cluster maps in regions where the cluster maps are
`densely concentrated. Accordingly,
`lor example,
`it
`is also
`conceivable to display tndividual cluster maps in a smaller
`size. However, it is necessary for cluster maps to be somewhat
`large for the user to recognize these cluster maps. Uhat
`ts, uf
`cluster maps are reduced in size, itis supposed that the clustes
`nuips become wrd to
`see, making it dilficull
`to grasp the
`details of the cluster maps
`
`
`
`
`
`
`
`
`
`
`
`
`
`Ex. 1004, [0325]
`Fx. 1004, [0325]
`
`Ex. 1004, Fig. 35
`Ex. 1004, Fig. 35
`
`Ex. 2038, ¶121
`Ex. 2038, 121
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSIRATIVE EXHIBIT- NOTEVIDENCE
`
`POR, 44-45
`POR,44-45
`POSR, 13-14
`POSR, 13-14
`
`

`

`
`
`second embodiment is not merely to replace the index screen 410 with cluster maps
`
`
`
`{0326} Accordingly, the second embodimentofthe present
`
`127. Aacording to Okami, byplacing cluster maps on the map in the way
`nvention
`is directed to optimal placement
`of
`individual
`clus
`ps
`er
`on
`a map which makes it possibleto avoid overlap
`ping of cluster maps in regions where the cluster maps are
`densely concentrated, without changingthe sive of the cluste
`maps. When placing the cluster maps in this way, the place-
`ment is performed in accordance with the following place-
`ment critena (1)
`to (3)
`
`shown in FIG. 41, “the geographical correspondence between contents can be
`
`intuitively grasped.” EX1004, FIG. 41,0358. A hallmark of the second embodiment
`
`is displaying the cluster maps(e.g., cluster map groups 771 and 772 and cluster map
`
`784 shown in FIG. 41) on a map.
`
`Ex. 1004, ¶ [0326]
`Fx. 1004, ¥ [0326]
`
`a cluster map is a map related to a
`In this regard,
`| [0331]
`| location wherecontents belonging to
`the corresponding clus-
`ter are generated.
`[herefore, even when latitudes and longs
`| tudes on a background mapdo not completely match latitudes
`}and longitudes on cluster maps,
`it
`is possible to grasp the
`geographical relationship between individual cluster maps
`\s desenbed above,
`although 1f
`is not necessary to match
`latitudes and longitudes on a background mapwith latitudes
`| and longitudes on cluster maps,
`if the cluster maps are spaced
`it may becomeno longer possible to recognize
`whereon the background mapthecluster maps correspond to
`in the first place. Accordingly,
`it
`is
`important
`rians while
`sil
`ALLOW De
`Me ey phical Cor Pon
`cc I
`i ' ct el 17
`
` | too far apart,
`
`
`
`Ex. 1004, Fig. 41
`Ex. 1004, Fig. 41
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`Ex. 1004, [0331]
`Ex. 1004, [0331]
`
`128. There is no connection between the map viewscreen 780 in FIG. 41
`
`and anyofthe screens in the first embodiment. The FACES and EVENTS tabs
`
`shown in FIGS. 18-21 ofthe first embodiment are not present in FIG. 41 ofthe
`
`second embodiment, whichsuggests that the map view screen 780 in FIG. 41 of the
`
`in FIG. 18 ofthe first embodiment.
`
`Ex. 2038, ¶¶ 127-128
`Ex. 2038, 7] 127-128
`
`POR, 46-47
`POR, 46-47
`POSR, 14-16
`POSR, 14-16
`
`

`

`
`
`FIG, 27A
`
`
`
`
`
`FIG. 27B
`
`
`“8
`|
`
`|
`LOCATION
`[ANDVICINITY—
`
`
`||YUKIGAYAOTSUKA S
`||AND VICINI
`STATION,106 photos |[
`IRONNTORATar419°aS
`iO
`
`356photos|
`
`OTASTATION
`\A
`_ 14 photos |
`33 photos
`|ANDVICINITY
`A
`24 photos
`TOKYO OO LAND
`547 photos
`‘
`
`| ANDVICINITY
`
`Y7 \
`‘3 rv
`i]A
`.= . v
`NARITAAIRPORT
`AND VICINITY _
`EeVICINITYMA\7photos v|
`id / /
`ANDVICINITY ete tA KS;
`| KIRYUGAOKAZOO
`
`AND VICINITY
`JOMOSANZAN PANORAMA
`[HIGHWAYAND VICINITY
`
`
`
`<—
`7 Pholos | \/
`
`
`
`487
`
`—
`
`Ex. 1004, Fig. 27A
`Ex. 1004, Fig. 27A
`
`Ex. 1004, Fig. 27B
`Ex. 1004, Kg. 27B
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMO NSTRATIVE EXHIBIT -
`NOTEVIDENCE
`
`POSR, 14-16
`POSR, 14-16
`
`

`

`Institution Decision
`
`Petitioner’s Reply
`
`Paper 15, 55
`
`Reply, 4
`
`Ex. 2038, ¶ 113
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2038, ¶ 114
`
`POR, 47-49
`POSR 13-14
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`Flora
`
`Pet., 14
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1005, Fig. 3
`
`POR, 54
`POSR, 17-18
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`
`Dr. Bederson
`
`Flora
`
`Ex. 1005, 6:67-7:8
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2035, 71:4-25
`
`POR, 52-54
`POSR, 17-18
`
`

`

`the map view displayed in response to the first input must include first and second thumbnail
`images on the interactive map
`Prof. Reinman
`
`Dr. Bederson
`
`Ex. 2038, ¶ 141
`
`Ex. 2038, ¶ 142
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2046, 175:11-20
`
`POR, 52-54
`POSR, 17-18
`
`

`

`Limitations [1g] and [1j]: “a first location name
`associated with the Tirst location” and “a second
`location name associated with the second
`
`location” DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`42
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`when the mouse Is placed over a cluster
`
`There is no motivation to combine Okamura with Flora —
`FIG. 19 of Okamura only showsinformation (418)
`
`For example, when the mouse ts placed over a clus-
`[0240]
`ter map 417 by a user operation on
`the index screen 410
`shown in FIG.
`18, as shown in FIG. 19, the color of thecluster
`map 417 is changed, and pieces
`of information 418 related to
`the cluster map 417 are displayed. For example. the entire
`cluster map 417 is changed to a conspicuous color (lor
`example, grey) and displayed. As the pieces of information
`418 related to the cluster map417, for example, the numberof
`contents “28" belonging to a cluster corresponding to the
`cluster map 417, and the cluster tle “ML.
`Fuji” of
`thecluster
`are displayed. Also, as the pieces of information 418 related to
`the cluster map 417, for example, information on the latitude
`and longitudeof the center position of the cluster correspond-
`ing to the cluster map 417, “Lat. 35°21'N, Long. 138°43'F”, is
`displayed.
`
`any
`a2
`‘
`eeeel
`|
`EVENT
`FACE
`
`
`
`PLACE
`
`10
`___ ng
`|
`|
`
`PLACE
`
`—_
`ot
`rr
`co
`= | re ——™ 7
`SS
`==>)
`(ee) Cee (iS
`os d
`=
`0
`
`‘
`\
`
`. 4%
`= - oo
`ma)
`:
`mt
`) =~
`Sey
`z |
`A
`Oe thes 7
`2BME-FUji
`
`;a
`
`Fw) —w&
`
`s
`aes
`=
`for &&
`1
`gi
`\ea
`Breck 7%.
`\
`sae
`Aker (lf
`.
`\ Ve aM \ = }
`\
`‘ (tineme '
`\
`re. .
`Sf
`» Se ‘
`ans
`FeatsHoma!
`ai]
`D> er knrn—m«a
`Cer \
`| ae r
`\
`/ a
`| * \
`(ss
`By)
`(a)
`hm)|
`uN
`\
`\/'=
`as
`\ ‘
`{ a
`=
`b
`—_
`<
`
`—
`
`,
`
`|
`
`r
`\
`41g
`
`t
`as
`
`Ex. 1004, FIG. 18
`Fx. 1004, HG. 18
`
`Ex. 1004, FIG. 19
`Fx. 1004, HG. 19
`
`Ex. 1004, ¶ [0240]
`Fx. 1004, { [0240]
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`POR, 59-62
`POR, 59-62
`
`

`

`There is no motivation to combine Okamura with Flora —
`when a clusteris selected the information (418) is not
`included on the content playback screen
`
`
`
`OoDe
`eve &
`
`Ex. 1004, FIG. 18
`Fx. 1004, HG. 18
`
`Ex. 1004, FIG. 22
`Fx. 1004, HG. 22
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`POR, 60-62
`POR, 60-62
`
`

`

`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Pet., 35
`
`Ex. 1005, FIG. 3 (excerpted)
`
`POR, 54-57
`POSR, 18-19
`
`

`

`Pet., 4
`
`Pet., 3
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 58-59
`
`

`

`the people view must include both a first name and a second name
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`the people view must include both a first name and a second name
`
`Dr. Reinman
`
`Ex. 2038, ¶¶ 145-147
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1004, ¶ [0247]
`
`POR, 63-64
`POSR, 20
`
`

`

`the people view must include both a first name and a second name
`
`Dr. Bederson
`
`Ex. 2035, 89:20-90:5
`
`Ex. 2035, 90:20-24
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 63-64
`POSR, 20
`
`

`

`Limitation [1c]: “the map view including:
`
`(I) an interactive map - DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`
`
`FIG. 18 _
`
`alleged map view
`4’
`4
`1}
`an?
`av
`2
`
`¢ a
`== x"
`
`L__ ea
`|
`on [ae]
`
`FIG, 15B
`
`263
`
`4
`
`'
`
`A
`Pad
`ey o—"
`ue f8
`f "(
`264
`
`
`
`Ex. 1004, Fig. 18 (annotated)
`Fx. 1004, Fig. 18 (annotated)
`
`Ex. 1004, Fig. 15B
`Ex. 1004, Fig. 15B
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`POR, 34-36
`POR, 34-36
`POSR, 9-10
`PO SR, 9-10
`
`

`

`Prof. Reinman
`
`Okamura
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2038, ¶¶ 64, 97
`
`Ex. 1004, Fig. 18 (annotated)
`
`POR, 34-36
`POSR, 9-10
`
`

`

`The map view displayed in response to the first input must include a first thumbnail image on the
`interactive map and also include an indication feature that is connected to that first thumbnail
`image on that interactive map
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`The map view displayed in response to the first input must include a first thumbnail image on the
`interactive map and also include an indication feature that is connected to that first thumbnail
`image on that interactive map
`
`Ex. 2038, ¶ 156
`
`Ex. 2038, ¶ 157
`
`Ex. 2038, ¶ 158
`
`Ex. 1004, ¶ [0240]
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 64-66
`
`

`

`The map view displayed in response to the first input must include a first thumbnail image on the
`interactive map and also include an indication feature that is connected to that first thumbnail
`image on that interactive map
`
`Dr. Bederson
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 2035, 102:1-6, 10-15
`
`POR, 64-66
`
`

`

`The map view displayed in response to the first input must include a first thumbnail image on the
`interactive map and also include an indication feature that is connected to that first thumbnail
`image on that interactive map
`
`Dr. Bederson
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Reply, 21
`
`Ex. 2046, 48:20-49:11
`
`POSR, 20-21
`
`

`

`the map view must include both “a first indication feature” and “a second indication feature” in
`the same view
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`the map view must include both “a first indication feature” and “a second indication feature” in the
`same view
`
`Ex. 2038, ¶ 161
`
`Ex. 2038, ¶ 162
`
`Ex. 2038, ¶ 163
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1004, ¶ [0240]
`
`POR, 66-68
`
`

`

`the map view must include both “a first indication feature” and “a second indication feature” in the
`same view
`
`Ex. 2035, 102:10-15
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POSR, 22
`
`

`

`Grounds 2-4:
`Obviousness over Okamura, Flora, Wagner
`
`and/or Gilley DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Okamura
`
`Wagner
`
`Ex. 2038, ¶ 172
`
`Ex. 1001, Fig. 19
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`Ex. 1006, Fig. 5V
`
`POR, 68-72
`
`

`

`Improper Reply DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

` [1c]: new obviousness argument that Okamura’s cluster map matrix forms a map. Reply, 3
`(citing Ex. 1038, ¶¶ 32-37 which itself cites new dictionary definitions of map).
` [1d]: newly relies on Okamura’s scalable maps (e.g. Figs. 27A-27B, Fig. 41). Reply, 5-9, n. 5
`(citing Ex. 1038, ¶¶ 53-57)
` [1g] and [1j]: newly relies on Flora’s discussion of a location’s “entire description” in
`relation to the claimed first/second location name. Reply, 18 (citing Ex. 1038, ¶ 65,
`quoting Ex. 1005, 7:45-51)
` [1b], [1d] and [1e]: newly relies on a modification of how Flora displays icons 58, 59 on its
`geographic map 46. Reply, 17-18 (citing Ex. 1038, ¶ 64)
` Claim 3: new modification of how Okamura displays “information 418” (first indication
`feature). Reply, 21 (citing Ex. 1038, ¶ 72)
` Claim 5: new modification of Okamura to display two pieces of “information 418”
`(first/second indication features) in the same view. Reply, 21-22 (citing Ex. 1038, ¶¶ 73-74)
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POSR, 1-2
`
`

`

`Unified’s Motion to Exclude Should
`
`Be Denied
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`Edwards Lifesciences Corporation v. Cardiovalve Ltd., 2022 WL 2812478, IPR2021-00383, Paper 60, 87 (2022)
`
`Ascend Performance Operations LLC v. Samsung SDI Co., IPR2020-00349, Paper 53, 12 (2021)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`MTE Opp., 4
`
`

`

`Ex. 2046, 52:7-25, 59:7-20, 79:18-80:2
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`MTE Opp., 2-6
`
`

`

`Estoopel
`
`Real-party in Interest DEMONSTRATIVE EXHIBIT- NO TEVIDENC E
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`

`

`35 U.S.C. §312(a)(2)
`
`37 C.F.R. §42.8
`
`Cal. Inst. of Tech. v. Broadcom Ltd.,
`25 F.4th 976, 991 (Fed. Cir. 2022)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 15, POSR, 27
`
`

`

`Petition
`IPR2021-01413
`IPR2022-00031
`IPR2022-00222
`
`Party
`Unified
`Apple
`Samsung
`
`Claims
`1-7
`1-19
`1-19
`
`Grounds
`103(a)
`103(a)
`103(a)
`
`References
`Okamura, Flora, Wagner & Gilley
`Aperture, Belitz
`Okamura, Belitz
`
`35 U.S.C. §315(e)(1)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 24
`POSR, 24-25
`
`

`

`Applications in Internet Time, LLC v. RPX Corp.,
`897 F.3d 1336, 1346, 1349, 1351 (Fed. Cir. 2018)
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`
`POR, 18-19
`POSR, 24-25
`
`

`

`
`
`Samsung and Apple are real parties in interest
`
`THE PROBLEM
`
`THE SOLUTION
`
`Bha=) Pk JOIN A MICRO-POOL
`
`HOME | SITEMAP | CONTACTUS
`
`
`8
`©) UnifiedPatents
` faleeeet) esCGHRMemlee
`Large Company Members. Small Company Members
`
`P= letag th
`
`lets.eae)
`
`BENEFITS FOR LARGE COMPANY MEMBERS
`
`Unified Patents’
`Micro-Pool strategy
`is designed to protect
`the investments that
`companies are
`making in key technologies that
`are vulnerable to NPEliability
`
`“We provide a comprehensive
`solution of offense and defense to
`protect our member's most important
`technologyinvestments."
`- Kevin Jakel, CEO
`
`For a modest subscription fee, large companies can join a Micro-Poo! and receive significant benefits:
`
`» Large companies with diverse exposure to NPErisk can subscribe and payfor only those Micro-Pools that
`protect their most important technologies
`
`» Technology specific deterrent strategy leverages modest subscription fees to create significant impact
`
`» Micro-Pools deliver technology specific licenses to problematic patents
`
`» Micro-Pools use ex-parte reexamination and inter partes review procedures at the United States Patent
`Office to protect technologies from attack by invalid or dubious patents
`
`® Micro-Pools uniquely incentivize startups and small company participation as part of an overall defensive
`strategy
`
`» Small company participation acts as an early warning system for superior defense for all members in a
`Micro-Pool
`
`» Improved indemnification with vendors and suppliers through their participation in relevant Micro-Pools
`
`» Greater freedom to operate and accessto intellectual property in the protected technology
`
`» Complete business alignment between Unified Patents and its Micro-Pool members
`
`DEMONSTRATIVE EXHIBIT - NOT EVIDENCE
`DEMO NSIRATIVE EXHIBIT- NO TEVIDENC E
`
`Ex. 2015
`Fx. 2015
`
`POR, 20
`
`

`

`Samsung and Apple are real parties in interest
`
`
`On September