`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`NIANTIC, INC.,
`Petitioner
`
`v.
`
`NANT HOLDINGS IP, LLC, and
`NANTWORKS, LLC
`Patent Owners
`
`U.S. Patent No. 10,664,518
`Title: Wide Area Augmented Reality Location-Based
`Services
`
`DECLARATION OF DR. MICHAEL ZYDA
`
`
`Niantic's Exhibit No. 1002
`Page 001
`
`

`

`Table of Contents
`
`
`I.
`
`V.
`
`Page
`INTRODUCTION AND QUALIFICATIONS .............................................. 1 
`A. Qualifications and Experience ............................................................. 1 
`1.
`Curriculum Vitae ........................................................................ 4 
`B. Materials Considered ............................................................................ 5 
`PERSON OF ORDINARY SKILL IN THE ART (“POSITA”) .................... 9 
`II.
`III. LEGAL PRINCIPLES USED IN THE ANALYSIS ................................... 11 
`A.
`Prior Art .............................................................................................. 11 
`B.
`Claim Construction ............................................................................ 12 
`C.
`Legal Standards for Obviousness ....................................................... 14 
`D.
`Reasonable Expectation of Success ................................................... 19 
`IV. RELEVANT TECHNOLOGY BACKGROUND ....................................... 19 
`A.
`Introduction to Augmented Reality .................................................... 19 
`B. History of Augmented Reality ........................................................... 22 
`C.
`Location-Based Tracking in AR Systems .......................................... 26 
`D. Object Recognition in AR Systems .................................................... 32 
`E.
`Augmented Reality Gaming ............................................................... 35 
`THE ’518 PATENT ...................................................................................... 40 
`A. Overview of the Specification ............................................................ 40 
`B. Overview of the Challenged Claims .................................................. 44 
`C. Agreed Claim Terms .......................................................................... 44 
`D. Disputed Claim Terms ....................................................................... 45 
`VI. APPLICATION OF THE PRIOR ART TO THE CHALLENGED
`CLAIMS OF THE ’518 PATENT ............................................................... 46 
`A.
`Brief Description and Summary of the Prior Art ............................... 47 
`1.
`Altman – U.S. Pat. App. Pub. No. 2008/0132251 [Ex.
`1003] ........................................................................................ 47 
`Langseth – U.S. Pat. Pub. No. 2013/0178257 (Ex. 1006) ....... 49 
`
`2.
`
`
`
`
`
`-i-
`
`
`
`Niantic's Exhibit No. 1002
`Page 002
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`3.
`
`c.
`
`d.
`e.
`
`f.
`
`CaveLie – U.S. Pat. App. Pub. No. 2013/0124563 [Ex.
`1004] ........................................................................................ 53 
`Gelfand – U.S. Pat. Pub. No. 2008/0268876 [Ex. 1005] ......... 56 
`4.
`Sterkel – U.S. Pat. No. 8,762,047 [Ex. 1007] .......................... 59 
`5.
`B. Ground 1: Obviousness of Claims 1-9, 11-14, 18-20, 23-32,
`and 34-36 Over Altman in View of Langseth .................................... 63 
`1.
`Independent claim 1 ................................................................. 63 
`a.
`Preamble ........................................................................ 63 
`b. Manner, Rationale, and Motivation to Combine
`Altman with Langseth ................................................... 80 
`“at least one sensor, including a location sensor;”
`(1[a]) .............................................................................. 85 
`“a display;” (1[b]) .......................................................... 89 
`“a non-transitory computer readable memory
`storing software instructions; and” (1[c]) ...................... 91 
`“at least one processor coupled with the non-
`transitory computer readable memory, the at least
`one sensor, and the display; and, upon execution of
`the software instructions, is configurable to:”
`(1[d]) .............................................................................. 95 
`“obtain sensor data from the at least one sensor
`wherein the sensor data includes a device location
`obtained from the location sensor;” (1[d][i])................. 98 
`“obtain an area of interest via an area database
`based on at least the device location within the
`sensor data;” (1[d][ii]) ................................................... 99 
`“access an area tile map of the area of interest, the
`area tile map represented by a set of tile subareas
`that includes one or more tessellated tiles from a
`tessellated tile map;” (1[d][iii]) ................................... 116 
`
`g.
`
`h.
`
`i.
`
`-ii-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 003
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`j.
`
`k.
`
`l.
`
`“identify a tile subarea from the set of tile subareas
`based at least in part on the device location relative
`to one or more locations of tile subareas from the
`set of tile subareas, wherein the identified tile
`subarea covers at least a portion of the area of
`interest, and wherein one or more tessellated tiles
`within the identified tile subarea are associated
`with one or more AR content objects;” (1[d][iv]) ....... 126 
`“populate the non-transitory computer readable
`memory with at least one of the one or more AR
`content objects associated with the one or more
`tessellated tiles corresponding with the identified
`tile subarea; and” (1[d][v]) .......................................... 141 
`“render the at least one of the one or more AR
`content objects that is associated with the
`identified tile subarea on the display based on a
`view of interest.” (1[d][vi]) ......................................... 149 
`Claim 2: “The device of claim 1, wherein the location
`sensor comprises at least one of the following location
`sensors: a global positioning system (GPS) sensor, an
`image sensor, and a wireless sensor.” .................................... 153 
`Claim 3: “The device of claim 1, wherein the device
`location includes at least one of the following: a global
`positioning system (GPS) location, a wireless signal
`location, a depth of field location, and an image-based
`simultaneous location and mapping (SLAM) location.” ....... 153 
`Claim 4: “The device of claim 1, wherein the at least one
`sensor further includes one or more of the following: a
`camera, an accelerometer, and a gyroscope.” ........................ 154 
`Claim 5: “The device of claim 1, wherein the sensor data
`further includes at least one of device position data and
`device orientation data.” ........................................................ 157 
`
`-iii-
`
`
`
`
`
`
`
`
`
`2.
`
`3.
`
`4.
`
`5.
`
`Niantic's Exhibit No. 1002
`Page 004
`
`

`

`7.
`
`8.
`
`9.
`
`Table of Contents
`(continued)
`
`Page
`
`6.
`
`Claim 6: “The device of claim 5, wherein the at least one
`of the one or more AR content objects is rendered based
`on the view of interest, wherein the view of interest is
`derived from at least one of the device position data and
`the device orientation data.” .................................................. 159 
`Claim 7: “The device of claim 1, wherein the at least one
`of the one or more AR content objects is rendered on the
`display as an overlay of an image related to the real-
`world.” .................................................................................... 161 
`Claim 8: “The device of claim 1, wherein the area of
`interest comprises one of the following: a landmark, user-
`defined boundaries, state-defined boundaries, natural
`boundaries, a city, a country, a business, a shopping
`center, a warehouse, a stadium, a wilderness area, a road,
`a garden, a zoo, an amusement park, a beach and a
`building.” ................................................................................ 165 
`Claim 9: “The device of claim 1, wherein the area of
`interest comprises a restaurant.” ............................................ 167 
`10. Claim 11: “The device of claim 1, wherein the area of
`interest comprises an outdoor setting.” .................................. 170 
`11. Claim 12: “The device of claim 1, wherein the device
`communicatively couples with the area database over a
`network.” ................................................................................ 171 
`12. Claim 13: “The device of claim 1, wherein the at least
`one of the one or more AR content objects is obtained
`from an AR content database.” .............................................. 172 
`13. Claim 14: “The device of claim 13, wherein the device is
`communicatively coupled with the AR content database
`over a network.” ..................................................................... 174 
`14. Claim 18: “The device of claim 1, wherein the at least
`one of the one or more AR content objects comprises a
`game object.” ......................................................................... 176 
`
`-iv-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 005
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`15. Claim 19: “The device of claim 18, wherein the at least
`one of the one or more AR content objects comprises an
`interactive game experience.” ................................................ 181 
`16. Claim 20: “The device of claim 1, wherein the at least
`one of the one or more AR content objects comprises at
`least one of the following: a virtual object, a digital
`image, a digital video, audio data, an application, a script,
`a promotion, an advertisement, a graphic, a sprite, and an
`animation.” ............................................................................. 182 
`17. Claim 23: “The device of claim 1, wherein the non-
`transitory computer readable memory, the at least one
`processor, the at least one sensor, and the display
`comprise at least one of the following: a smart phone,
`augmented reality goggles, a watch, a tablet, a drone, a
`vehicle, a wearable augmented reality device, and a
`robot.”..................................................................................... 184 
`18. Claim 24: “The device of claim 1, wherein the at least
`one of the one or more AR content objects is determined
`based on the device’s movement relative to the area of
`interest or the identified tile subarea.” ................................... 185 
`19. Claim 25: “The device of claim 24, wherein the at least
`one of the one or more AR content objects is auto-
`populated in the non-transitory computer readable
`memory and rendered based on the movement relative to
`the area of interest or the identified tile subarea.” ................. 188 
`20. Claim 26: “The device of claim 1, wherein the identified
`tile subarea or the at least one of the one or more AR
`content objects is identified based on time.” ......................... 190 
`21. Claim 27: “The device of claim 1, wherein a
`modification of the at least one of the one or more AR
`content objects by a first user is viewable by a subset of
`users.” ..................................................................................... 191 
`
`-v-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 006
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`22. Claim 28: “The device of claim 1, wherein a virtual item
`is made available to a user when the user executes a
`navigation event with respect to the area of interest or the
`identified tile subarea.” .......................................................... 196 
`23. Claim 29: “The device of claim 28, wherein the
`navigation event comprises at least one of the following:
`the user being located in the area of interest at any time,
`the user being located in the area of interest for a
`predetermined minimum amount of time, the user being
`located in the area of interest at a predetermined time, or
`the user being located in the area of interest and
`capturing an image viewable from the area of interest.” ....... 197 
`24. Claim 30: “The device of claim 1, wherein a virtual item
`is provided to a first user and a second user when the first
`user and the second user execute a navigation event with
`respect to the area of interest or the identified tile
`subarea.” ................................................................................. 198 
`25. Claim 31: “The device of claim 30, wherein the
`navigation event comprises the first user and the second
`user each performing at least one of the following: being
`located in the area of interest at any time, being located
`in the area of interest for a predetermined minimum
`amount of time, being located in the area of interest at a
`predetermined time, or being located in the area of
`interest and capturing an image viewable from the area of
`interest.” ................................................................................. 202 
`26. Claim 32: “The device of claim 1, wherein the at least
`one processor, upon execution of the software
`instructions, is further configurable to obtain the area tile
`map of the area of interest.” ................................................... 202 
`Independent claim 34 ............................................................. 204 
`a.
`Preamble ...................................................................... 204 
`
`27.
`
`-vi-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 007
`
`

`

`b.
`
`c.
`
`d.
`
`e.
`
`f.
`
`g.
`
`Table of Contents
`(continued)
`
`Page
`
`“obtaining sensor data from at least one sensor, the
`at least one sensor including a location sensor,
`wherein the sensor data includes a device location
`of the computing device obtained from the location
`sensor;” (34[a]) ............................................................ 205 
`“obtaining an area of interest via an area database
`based on at least the device location within the
`sensor data;” (34[b]) .................................................... 206 
`“accessing an area tile map of the area of interest,
`the area tile map represented by a set of tile
`subareas that includes one or more tessellated tiles
`from a tessellated tile map;” (34[c]) ............................ 206 
`“identifying a tile subarea from the set of tile
`subareas based at least in part on the device
`location relative to one or more locations of tile
`subareas from the set of tile subareas, wherein the
`identified tile subarea covers at least a portion of
`the area of interest, and wherein one or more
`tessellated tiles within the identified tile subarea
`are associated with one or more AR content
`objects;” (34[d]) ........................................................... 207 
`“populating a non-transitory computer readable
`memory of the computing device with at least one
`of the one or more AR content objects associated
`with the one or more tessellated tiles
`corresponding with the identified tile subarea; and”
`(34[e]) .......................................................................... 208 
`“rendering the at least one of the one or more AR
`content objects that is associated with the
`identified tile subarea on a display of the
`computing device based on a view of interest.”
`(34[f]) ........................................................................... 209 
`
`-vii-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 008
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`2.
`
`28. Claim 35: “The method of claim 34, wherein the
`location sensor comprises at least one of the following
`location sensors: a global positioning system (GPS)
`sensor, an image sensor, and a wireless sensor.” ................... 209 
`29. Claim 36: “The method of claim 34, wherein the device
`location includes at least one of the following: a global
`positioning system (GPS) location, a wireless signal
`location, a depth of field location, and an image-based
`simultaneous location and mapping (SLAM) location.” ....... 210 
`C. Ground 2: Obviousness of Claims 1-9, 11-14, 18-20, 23-32,
`and 34-36 Over Altman and Langseth in View of CaveLie ............ 210 
`1.
`“access an area tile map of the area of interest, the area
`tile map represented by a set of tile subareas that includes
`one or more tessellated tiles from a tessellated tile map;”
`(Claim 1[d][iii]; see also Claim 34[c]) .................................. 211 
`“identify a tile subarea from the set of tile subareas based
`at least in part on the device location relative to one or
`more locations of tile subareas from the set of tile
`subareas, wherein the identified tile subarea covers at
`least a portion of the area of interest, and wherein one or
`more tessellated tiles within the identified tile subarea are
`associated with one or more AR content objects;” (Claim
`1[d][iv]; see also Claim 34[d]) .............................................. 213 
`“populate the non-transitory computer readable memory
`with at least one of the one or more AR content objects
`associated with the one or more tessellated tiles
`corresponding with the identified tile subarea; and”
`(Claim 1[d][v]; see also Claim 34[e]) .................................... 220 
`“render the at least one of the one or more AR content
`objects that is associated with the identified tile subarea
`on the display based on a view of interest.” (Claim
`1[d][vi]; see also Claim 34[f]) ............................................... 221 
`
`3.
`
`4.
`
`-viii-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 009
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`5.
`
`3.
`
`4.
`
`Claim 23: “The device of claim 1, wherein the non-
`transitory computer readable memory, the at least one
`processor, the at least one sensor, and the display
`comprise at least one of the following: a smart phone,
`augmented reality goggles, a watch, a tablet, a drone, a
`vehicle, a wearable augmented reality device, and a
`robot.”..................................................................................... 222 
`6. Manner, Rationale, and Motivation to Combine Altman
`and Langseth with CaveLie ................................................... 223 
`D. Ground 3: Obviousness of Claims 1-9, 11-20, 23-32, and 34-36
`Over Altman in View of Langseth, CaveLie, and Gelfand .............. 229 
`1.
`Claim 15: “The device of claim 1, wherein the at least
`one of the one or more AR content objects is rendered
`relative to a recognized object.”............................................. 229 
`2. Manner, Rationale, and Motivation to Combine Altman,
`Langseth, CaveLie, and Gelfand ............................................ 232 
`Claim 16: “The device of claim 15, wherein the
`recognized object represents an attachment point for the
`at least one of the one or more AR content objects.” ............ 239 
`Claim 17: “The device of claim 16, wherein the
`attachment point includes at least one of the following: a
`billboard, a wall, a floor, a plant, a sign, a logo, a
`landmark, a building, and a car.” ........................................... 245 
`Ground 4: Single Reference Obviousness of Claims 1-8, 11-14,
`18-20, 23-24, 26-32, and 34-36 Over Sterkel .................................. 246 
`1.
`Independent claim 1 ............................................................... 246 
`a.
`Preamble ...................................................................... 246 
`b.
`“at least one sensor, including a location sensor;”
`(1[a]) ............................................................................ 253 
`“a display;” (1[b]) ........................................................ 255 
`“a non-transitory computer readable memory
`storing software instructions; and” (1[c]) .................... 257 
`-ix-
`
`
`E.
`
`c.
`d.
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 010
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`“at least one processor coupled with the non-
`transitory computer readable memory, the at least
`one sensor, and the display; and, upon execution of
`the software instructions, is configurable to:”
`(1[d]) ............................................................................ 260 
`“obtain sensor data from the at least one sensor
`wherein the sensor data includes a device location
`obtained from the location sensor;” (1[d][i])............... 264 
`“obtain an area of interest via an area database
`based on at least the device location within the
`sensor data;” (1[d][ii]) ................................................. 265 
`“access an area tile map of the area of interest, the
`area tile map represented by a set of tile subareas
`that includes one or more tessellated tiles from a
`tessellated tile map;” (1[d][iii]) ................................... 273 
`“identify a tile subarea from the set of tile subareas
`based at least in part on the device location relative
`to one or more locations of tile subareas from the
`set of tile subareas, wherein the identified tile
`subarea covers at least a portion of the area of
`interest, and wherein one or more tessellated tiles
`within the identified tile subarea are associated
`with one or more AR content objects;” (1[d][iv]) ....... 281 
`“populate the non-transitory computer readable
`memory with at least one of the one or more AR
`content objects associated with the one or more
`tessellated tiles corresponding with the identified
`tile subarea; and” (1[d][v]) .......................................... 294 
`“render the at least one of the one or more AR
`content objects that is associated with the
`identified tile subarea on the display based on a
`view of interest.” (1[d][vi]) ......................................... 298 
`
`e.
`
`f.
`
`g.
`
`h.
`
`i.
`
`j.
`
`k.
`
`-x-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 011
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`Claim 2: “The device of claim 1, wherein the location
`sensor comprises at least one of the following location
`sensors: a global positioning system (GPS) sensor, an
`image sensor, and a wireless sensor.” .................................... 302 
`Claim 3: “The device of claim 1, wherein the device
`location includes at least one of the following: a global
`positioning system (GPS) location, a wireless signal
`location, a depth of field location, and an image-based
`simultaneous location and mapping (SLAM) location.” ....... 304 
`Claim 4: “The device of claim 1, wherein the at least one
`sensor further includes one or more of the following: a
`camera, an accelerometer, and a gyroscope.” ........................ 305 
`Claim 5: “The device of claim 1, wherein the sensor data
`further includes at least one of device position data and
`device orientation data.” ........................................................ 308 
`Claim 6: “The device of claim 5, wherein the at least one
`of the one or more AR content objects is rendered based
`on the view of interest, wherein the view of interest is
`derived from at least one of the device position data and
`the device orientation data.” .................................................. 309 
`Claim 7: “The device of claim 1, wherein the at least one
`of the one or more AR content objects is rendered on the
`display as an overlay of an image related to the real-
`world.” .................................................................................... 310 
`Claim 8: “The device of claim 1, wherein the area of
`interest comprises one of the following: a landmark, user-
`defined boundaries, state-defined boundaries, natural
`boundaries, a city, a country, a business, a shopping
`center, a warehouse, a stadium, a wilderness area, a road,
`a garden, a zoo, an amusement park, a beach and a
`building.” ................................................................................ 314 
`Claim 11: “The device of claim 1, wherein the area of
`interest comprises an outdoor setting.” .................................. 315 
`
`-xi-
`
`
`
`2.
`
`3.
`
`4.
`
`5.
`
`6.
`
`7.
`
`8.
`
`9.
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 012
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`10. Claim 12: “The device of claim 1, wherein the device
`communicatively couples with the area database over a
`network.” ................................................................................ 317 
`11. Claim 13: “The device of claim 1, wherein the at least
`one of the one or more AR content objects is obtained
`from an AR content database.” .............................................. 318 
`12. Claim 14: “The device of claim 13, wherein the device is
`communicatively coupled with the AR content database
`over a network.” ..................................................................... 319 
`13. Claim 18: “The device of claim 1, wherein the at least
`one of the one or more AR content objects comprises a
`game object.” ......................................................................... 320 
`14. Claim 19: “The device of claim 18, wherein the at least
`one of the one or more AR content objects comprises an
`interactive game experience.” ................................................ 321 
`15. Claim 20: “The device of claim 1, wherein the at least
`one of the one or more AR content objects comprises at
`least one of the following: a virtual object, a digital
`image, a digital video, audio data, an application, a script,
`a promotion, an advertisement, a graphic, a sprite, and an
`animation.” ............................................................................. 321 
`16. Claim 23: “The device of claim 1, wherein the non-
`transitory computer readable memory, the at least one
`processor, the at least one sensor, and the display
`comprise at least one of the following: a smart phone,
`augmented reality goggles, a watch, a tablet, a drone, a
`vehicle, a wearable augmented reality device, and a
`robot.”..................................................................................... 322 
`17. Claim 24: “The device of claim 1, wherein the at least
`one of the one or more AR content objects is determined
`based on the device’s movement relative to the area of
`interest or the identified tile subarea.” ................................... 323 
`
`-xii-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 013
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`18. Claim 26: “The device of claim 1, wherein the identified
`tile subarea or the at least one of the one or more AR
`content objects is identified based on time.” ......................... 325 
`19. Claim 27: “The device of claim 1, wherein a
`modification of the at least one of the one or more AR
`content objects by a first user is viewable by a subset of
`users.” ..................................................................................... 328 
`20. Claim 28: “The device of claim 1, wherein a virtual item
`is made available to a user when the user executes a
`navigation event with respect to the area of interest or the
`identified tile subarea.” .......................................................... 329 
`21. Claim 29: “The device of claim 28, wherein the
`navigation event comprises at least one of the following:
`the user being located in the area of interest at any time,
`the user being located in the area of interest for a
`predetermined minimum amount of time, the user being
`located in the area of interest at a predetermined time, or
`the user being located in the area of interest and
`capturing an image viewable from the area of interest.” ....... 330 
`22. Claim 30: “The device of claim 1, wherein a virtual item
`is provided to a first user and a second user when the first
`user and the second user execute a navigation event with
`respect to the area of interest or the identified tile
`subarea.” ................................................................................. 330 
`23. Claim 31: “The device of claim 30, wherein the
`navigation event comprises the first user and the second
`user each performing at least one of the following: being
`located in the area of interest at any time, being located
`in the area of interest for a predetermined minimum
`amount of time, being located in the area of interest at a
`predetermined time, or being located in the area of
`interest and capturing an image viewable from the area of
`interest.” ................................................................................. 333 
`
`-xiii-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 014
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`25.
`
`c.
`
`d.
`
`24. Claim 32: “The device of claim 1, wherein the at least
`one processor, upon execution of the software
`instructions, is further configurable to obtain the area tile
`map of the area of interest.” ................................................... 334 
`Independent claim 34 ............................................................. 335 
`a.
`Preamble ...................................................................... 335 
`b.
`“obtaining sensor data from at least one sensor, the
`at least one sensor including a location sensor,
`wherein the sensor data includes a device location
`of the computing device obtained from the location
`sensor;” (34[a]) ............................................................ 336 
`“obtaining an area of interest via an area database
`based on at least the device location within the
`sensor data;” (34[b]) .................................................... 337 
`“accessing an area tile map of the area of interest,
`the area tile map represented by a set of tile
`subareas that includes one or more tessellated tiles
`from a tessellated tile map;” (34[c]) ............................ 337 
`“identifying a tile subarea from the set of tile
`subareas based at least in part on the device
`location relative to one or more locations of tile
`subareas from the set of tile subareas, wherein the
`identified tile subarea covers at least a portion of
`the area of interest, and wherein one or more
`tessellated tiles within the identified tile subarea
`are associated with one or more AR content
`objects;” (34[d]) ........................................................... 338 
`“populating a non-transitory computer readable
`memory of the computing device with at least one
`of the one or more AR content objects associated
`with the one or more tessellated tiles
`corresponding with the identified tile subarea; and”
`(34[e]) .......................................................................... 339 
`
`e.
`
`f.
`
`-xiv-
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1002
`Page 015
`
`

`

`Table of Contents
`(continued)
`
`Page
`
`
`
`g.
`
`“rendering the at least one of the one or more AR
`content objects that is associated with the
`identified tile subarea on a display of the
`computing device based on a view of interest.”
`(34[f]) ........................................................................... 340 
`26. Claim 35: “The method of claim 34, wherein the
`location sensor comprises at least one of the following
`location sensors: a global positioning system (GPS)
`sensor, an image sensor, and a wireless sensor.” ................... 340 
`27. Claim 36: “The method of claim 34, wherein the device
`location includes at least one of the following: a global
`positioning system (GPS) location, a wireless signal
`location, a depth of field location, and an image-based
`simultaneous location and mapping (SLAM) location.” ....... 341 
`VII. CONCLUSION ........................................................................................... 341 
`
`
`
`
`
`-xv-
`
`
`
`Niantic's Exhibit No. 1002
`Page 016
`
`

`

`Declaration of Dr. Michael Zyda in Support of
`Petition for Inter Partes Review of
`U.S. Patent No. 10,664,518
`
`
`I, Michael Zyda, declare as follows:
`
`I.
`
`INTRODUCTION AND QUALIFICATIONS
`A. Qualifications and Experience
`1.
`I began my career in Computer Graphics in 1973 as part of an
`
`undergraduate research group, the Senses Bureau, at the University of California,
`
`San Diego. I received a BA in Bioengineering from the University of California,
`
`San Diego in La Jolla in 1976, an MS in Computer and Information Science from
`
`the University of Massachusetts, Amherst in 1978 and a D.Sc. in Computer Science
`
`from Washington University, St. Louis, Missouri in 1984. I am an ACM Fellow, an
`
`IEEE Fellow, an IEEE Virtual Reality Technical Achievement Award winner, a
`
`Senior Member of the National Academy of Inventors, and a National Associate of
`
`the National Academies.
`
`2.
`
`I am currently a Professor of Engineering Practice in the USC
`
`Department of Computer Science. At USC, I founded the Computer Science Games
`
`Program and the year-long advanced game projects course that forms the core of
`
`USC Games and took that program from no program to the #