Worlds
`
`Virtual
`
`Niantic's Exhibit No. 1008
`Page 001
`
`

`

`
`
`
`
`Spatial Augmented Reality
`
`   
`

  
`
`Niantic's Exhibit No. 1008
`
`Page 002
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 002
`
`

`

`
`
`
`
`Spatial Augmented Reality
`
`Merging Real and Virtual Worlds
`
`Oliver Bimber
`
`Bauhaus—University, Weimar
`
`Ramesh Raskar
`Mitsubishi Electric Research Laboratory,
`Cambridge, MA
`
`   
`

  
` 

 

  
`
`
`  


` 
`
`  
`    !  
`"
` 
`#$
`  
`
`A K Peters
`
`Wellesley, Massachusetts
`
`Niantic's Exhibit No. 1008
`
`Page 003
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 003
`
`

`

` ÿ 
`
`ÿ

ÿ ÿ
`ÿÿÿ  ÿÿÿ
`ÿ ÿ ÿ!"#$%#!%
`&ÿ%'ÿ( ÿ
`ÿ

ÿ ÿÿ
` ÿ ÿÿÿ)ÿ*ÿ
`ÿ

ÿ ÿÿÿ+*)ÿ(
`ÿ
`)ÿÿ,
`ÿ-..ÿ/)ÿ
`0ÿ12ÿ%3'%3
`+
`ÿÿÿ)($32ÿ4#"$3$!4"$!4!$!ÿ5ÿ$ÿ 1 6
`7ÿ(ÿÿ*)ÿ(ÿ*)ÿ7ÿÿ7,7
` ÿ,ÿ.ÿ $
`(
`ÿ**ÿ7/ÿ(ÿ)ÿÿ(
`7ÿ
`(
`ÿÿÿ*)ÿ(ÿ7ÿ7ÿÿ(
`7ÿ
`ÿ)ÿ(
` ÿ*ÿ7ÿ/
` ÿ*ÿ
`
`ÿ)
`ÿÿ7ÿ8ÿ*ÿ7ÿ.ÿ7ÿ
`7ÿÿ(
`7ÿ7/ÿ)ÿÿÿ7ÿ ,7ÿ7
`ÿ*ÿ
`
`ÿ)
`ÿÿÿ
`7ÿ(
`ÿÿ
`,9ÿÿ ,7ÿ7
`ÿ*ÿ)ÿÿ(
`7ÿÿ7ÿ*)ÿ7ÿÿ
`(ÿ(.ÿ+*ÿ ÿ ,7ÿ)
`ÿ7ÿÿ(ÿ
`,ÿ
`ÿÿÿ
`ÿÿÿÿ
`ÿ) ÿ* ÿÿ ÿ*ÿ.
`:;ÿÿ)ÿÿ-..ÿ ,7ÿ ÿÿÿ*ÿ7ÿ(ÿ) ÿ(ÿÿÿ
`)ÿÿ
`9ÿÿ ÿ*)ÿ( ÿ ÿ
`ÿ)7
`ÿÿ7ÿ)ÿÿÿÿ
`7*ÿ/ÿ
`,ÿ7 ,ÿ)*
`),ÿÿ,ÿÿÿ ÿ*)ÿ
`,ÿÿ/
`ÿ )ÿ7ÿÿ)ÿ*)ÿ7ÿ(
`7.
`
` ÿ)ÿÿ7 ÿÿÿ)
`ÿ
`
`
` ÿ*)ÿ7ÿÿ
`ÿÿ.
` ,7.)ÿ572<<. ,7.)<6ÿÿÿ7ÿ ,7ÿ
`ÿÿ+.ÿ
`56ÿ%%%ÿ ÿ1/ÿ1/ÿ=>ÿ34%ÿ4#"$#'$"!.ÿÿÿÿ$*$*ÿ,9$
`ÿ7ÿ/ÿ
`ÿÿ,ÿ*ÿÿ/ ÿ*ÿ.ÿ ÿ,9ÿ7ÿ7/ÿ(ÿ
`,ÿÿ7 ÿ
`ÿ( ÿ7ÿÿÿÿ )ÿ*ÿ )ÿ7ÿ(ÿ,.
`?@ABCDA@EÿGHIJKCLÿ ÿÿÿ)ÿ) ÿ(ÿ)ÿÿ,ÿ)ÿÿ
`ÿÿ
` ÿ*ÿ*ÿÿ;
`ÿ7ÿÿÿ*,.
`MJNJIÿIOCÿ?APQH@ÿRÿS@ATKJNÿUCVÿNJICÿAI
`OIIWLXXYYYZIAPQH@ATB[@ATKJNZKHD
`ATBÿIOCÿ\]\ÿ^@CNNÿUCVÿNJICÿAI
`OIIWLXXYYYZK@KW@CNNZKHD
`
`Niantic's Exhibit No. 1008
`Page 004
`
`

`

`
`
`
`
`To Mel
`
`—O. B.
`
`   
` 
`


`
`To my parents
`—R. R.
`
`Niantic's Exhibit No. 1008
`
`Page 005
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 005
`
`

`

`
`
`
`
`Contents
`
`Preface
`
`1 A Brief Introduction to Augmented Reality
`1.1 What is Augmented Reality .................
`
`1.2 Today’s Challenges .......................
`
`1.3 Spatial Augmented Reality ..................
`1.4 Outline of the Book ......................
`
`Fundamentals: From Photons to Pixels
`
`2.1 Light in a Nutshell .......................
`
`2.2 Geometric Optics .......................
`
`2.3 Visual Depth Perception ....................
`
`2.4 Rendering Pipelines ......................
`
`2.5 Summary and Discussion ...................
`
`   
`

`
`
`      
` 
`
` !"#$%&%'(%)*
`+,-'*. /))%&#% 0
`123)!"#$%&%'(%)*4
`05")&%-6%7--89
`:; 
` 
`<;= 


`>
`+?#&@" %))0
`++A%-$%BC53C 4
`+1D ")E%3F%BC%3-&1G
`+0(%&'%B&#F3%)&% 00
`+H2"$$B*&'E C" -&II
`> 
` J K
`
`L
`1M%'N!C%'E 3)* 4+
`1+M&'NM%)'E 3)* 4O
`1123)E 3)* 91
`102"$$B*&'E C" -&OG
`PQ R   K
`S>
`0A%-$%BCT-'%)O1
`0+(%&'%B&#UB$%V-B8O9
`01/)WB-&A-) G0
`00E 3)*X&YB-&$%& &'!33)C-& G9
`0H2"$$B*&'E C" -&G9
`Z
`
`xi
`
`ooxippH—A
`
`13
`
`14
`
`17
`
`30
`
`44
`
`66
`
`71
`
`72
`
`79
`
`83
`
`90
`
`93
`
`93
`
`98
`
`104
`
`108
`
`108
`
`3 Augmented Reality Displays
`3.1 Head-Attached Displays ....................
`
`3.2 Hand-Held Displays ......................
`
`3.3 Spatial Displays .........................
`
`3.4 Summary and Discussion ...................
`
`Geometric Projection Concepts
`4.1 Geometric Model ........................
`
`4.2 Rendering Framework .....................
`4.3 Calibration Goals ........................
`
`4.4 Display Environments and Applications ...........
`
`4.5 Summary and Discussion ...................
`
`vii
`
`Niantic's Exhibit No. 1008
`
`Page 006
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 006
`
`

`

`
`
`
`
` 
` 
`
`
`




`
` !"#$%&$
`'() * !"#$%&'+
`,!)-./0)!12.!%3 0. $#0&4. 5# 6'7
`89:5!#/;:!2.5"#$%&$,,
`3:<# 0# 61=-./0$8'
`+>:<<!& 5"#$/:$$#) 8?
`@A
`

BB 
`
`CD
`+E! $%!. 0>/!.. $F
`+'G#!!)!4.<;)<=# .!$'
`+, !G#!!)!4.<;)<=# .!$'
`+8>/!.. E! $H)!<0#)  5;:!2.5>/!.. $+,
`+G)2# 6;)<%) . 0$++
`++G:0#* .4.<;)<=# .!$++
`+?;:!2.5G#!!)!4.<;)<=# .!$?8
`+I>:<<!& 5"#$/:$$#) 'F+
`J
`
`KLM NMON


`PQ
`?3<6.*4$.53:<# 0#) R;S 6# 6>:!H/.T%%.! /.'8
`?';!.0# 6;) $#$0. 01//:$#) ''F
`?,;!.0# 6;) $#$0. 03:<# 0#) ''?
`?8T:6<. 0# 61%0#/U))6!<$'88
`?T:6<. 0# 6V0 5E.W0:!.5>:!H/.$'
`?+T:6<. 0# 6X.)<.0!#/&() *E!#2#E.W0:!.5>:!H/.$'+?
`??>:<<!& 5"#$/:$$#) '?+
`YZ[\O]
`PJD
`I>S5.!^<%$'IF
`I'4.# 6ES.!.'I+
`I,#^<%$RG)=#.!)-./0)!$'II
`I8ES._W0. 5.5`#!0:E=.'7
`IES.`#!0:>S)a/$.'7?
`I+ES.U))>00#) ,F'
`I?T:6<. 0.5# 0# 6$,FI
`II><!0!)-./0)!$,8
`I7>:<<!& 5"#$/:$$#) ,'F
`DbcNN
`
`QP
`7"#$%&$,'
`7'>:%%)!0# 6_.<. 0$,'+
`7,>:<<!& 5"#$/:$$#) ,'7
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 007
`
`

`

`
`
`
`
`Contents
`
`ix
`
`331
`A Calibration of a Projector (or a Camera)
`. 331
`A.1 Source code for Calibration of a Projector (or a camera) .
`A.2 Quadric Image Transfer .................... 334
`
`
`   
`
`
`

` 
`  
`
`
`
` !"#$%&#'%(!#)*'+##,#-..
`/0# %1,#23#(4!..5
`678 9:;<
`  
` 8 
` 
`=>?@8 AB
`CD(#$EF(%'%(4..G
`C/)*'%(H('%(4..G
`C.3#(4!,#'%(H('%(4..I
`C5 %'%(#$H('%(4.5J
`6

K
`8L=
`M
`
`B OpenGL’s Transformation Pipeline Partially Re-lmplemented 337
`B.1 General Definitions ....................... 337
`
`B.2 Projection Functions ...................... 337
`B.3 Transformation Functions ................... 338
`
`B.4 Additional Functions ...................... 340
`
`Bibliography
`
`343
`
`Niantic's Exhibit No. 1008
`
`Page 008
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 008
`
`

`

`
`
`
`
`  
`
`
`


`


`  




`
`


`    
` 
`
`


` 
`
`
`
`
`

 


`


` 
` 
` 
` !"#


`
` 


`  
` 
`


`

$#

 #

$
`# 
`  
`
`
`  


`
`
` 
`
`%
`
`
`

!"


`# 
`
` #


`   
`




`$
`# 
` 
`


`
` #
`# 

#

!
`&#'
` (
`

  
`
`

` #


`
`
` 
`
`
`
`
`
`0123124567 6819:;22<
`)   *+,-- ./!
`,  # 
`  =
`$ $
` 
`
`$
`=
`
` 
`#$> 
`

 
`?
`
`

# !/$ 




`# 
` 
`>$@A
`

$ 
`

# 

!
`& 

  #
`
`>

#
`   
`
` 
`


`
`


`


`
`

`!+ *
` B-C  
`$
`
`
`


`$ 

$ $
` 
` 


`
`
`  
`
`?
`
`
`
`
`


`


`
`

`!
`D

 # ?



? 

 (
`
`
`$ $
` 
`
`
`$ E
`$
` 
`


`
`$ 
`
`
`

` 
` 

`F9
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 009
`
`

`

`
`
`
`
` 
` 
`
`












`
`"#$%&&'($)
`

 !!!  
`*+ 

, !

!+
`

 -.



 / 0-



1 /2 

+3
`

!

  

4 

+

 

`5 *  6,7!

89:
`;

, 6!

    0!
`+*<=!+ 

>+6
`?

*+! 

@++
`



 



A

+ * 

3
`  

+



,+

 


`+ *+ !

B7 

+3
`



!!

*@8!!@3
` *!

! 7

96?+




`8



CDEF 2

CDDD6;

, 1G3
`

6?+9 

!

!

H037
`7! 

!I.*!

` !



!+ 

!



` 

 
`*!0

0,! 8 =

A0*
` 0 !

 
` *,

3
`"JK$LMNOPK&Q
`A

 

0
`* 



 0!

,

A!
`





 

 

+ 9!


`

04 ?

9A 

6

?

R6 

`H

R6<

AG

6 B

H6S>

6

T

6
`* 7

+A68 8R

+6G 

7 +6 

.06
`*?6

 S

+6* H6;!=

6U
`<R06G 

1 06>

1+6H0377!693GG

6
`8>!

6 8@68G 6.0>

6
`* 9!6

,
`6V9

+6

W

7
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0010
`
`

`

`
`  
`
`





`
` 
`
`


`
`


`
`

 
`!
`
`"# 

$"%&' "() 
`()"**"% +",
`


`",
`
`%


`"
`&
`
`%
`
`"+
` -".
`)(
`

"/0
`.
`"(!
`!"1

#
`2"/ 3"4$5

"/
`

%
`"
`.
`%

"1,)
`6
`%
`

 
`  
`

`
` 
`
`
` '

`. 7
` )
`"/ ' 4

`8
`
`
`!'
` "9
`
`."#

.
`

`)"#

,
`2"1

:$


` "
`9
`/ ",
`!
`".

;
`2 "8
`<
`

`"; = 2"
`/  (
`)"(
`%"$0
`3 
`01
`
`& "9 >
`!64?@".7'"4.
`"7
` )0
`A1

1
`

*

"*
`)$ "&
`
`

"*
`+

` "
`$0
`1
`
`08
`
`1
`& "/
`

4?@"
`.
`*
`2",<
`

2
`",
` 
`$  
`
` 0"4
`
`76
`
`
`
`3 04

` B4

`

4
`
` C3444D"
`
`= 01/
`)C=1/D"4

`
`"/3+#
` "
`%
`
`

".


`

#'

 0
` 
`
`'

  
`0
`
`


` '6
`/) + <
`

`=


`(

 #
`
` 0
`
`

 
`
`
` 0 '

 
`
`
`))
`
` 6
`-


`.'
`
`
`
`=

EFFG
`8
` 8 
`1'
`"/==

EFFG
`
`
`
`
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0011
`
`

`

`
`
`
`
` 
`


`
`
` 
`


`
` !"#$%&'()*!+!, !"#-%&./01234532647
`3489:5323:;<5:=162=1629.92.>?53@56:.:.A5B.:56:89.34
`:A.:0A31<14@3.27;62533:CA/:13.>D389.:65<9.1=59423:8
`65<:@.5<.113:A6.>E121=:A.F16:.56'A1GB6'<2:8:19.7
`341F7:A7.A<=A587G1638.;<5@.>HG'5;;<05:137.;0I05<:635:B
`8.;<5@5;;6150A.;5B:AG5@:1G568.JC/<:@'A4A6K030@'538
`3G5;;<05:13.=1659423:865<:@3253@313721/<5;;<05:13
`81253.>H1B<5;;6150A.A5B:5359423:865<:@/@138:6587
`:135<@7G16316A5387A<88.;<5@.'35/<343G5;;<05:13565.=16
`29.92.'89:5323:'6.560A'389.:6@'538:A56:012293:@>LA.
`/118.09...MN)*!+!,!"#E-%&5;;6150A.:A5:C;<1:
`<5641;:05<<23:.538B817;61O0:16.'5.G<<5.3:650:B63867
`345<416:A2.'05</65:13:0A3P9.'5388.;<5@C52;<.>D:;61B8.5
`012;6A3.B1B6BGG:A8:5<825:A25:0.P95:13.538=16297
`<5.'018=65423:.'5382;<23:5:133.:690:13.:A5:35/<3:6.:8
`6586.:165<Q.;5:5<-%8.;<5@./@:A2.<B.>
`LA.0A5;:6G<<4B5/6=5384365<3:61890:133:159423:8
`65<:@538:.09663:6.560A0A5<<34.>D:5<.119:<3.:A625334
`0A5;:6.1=:A/11>
`RSRTU
`V 
`


`
`LA:62.W!"538X"Y!MNX!A5B/012B6@;1;9<5619:.8
`:A6.560A012293:@G:A3:A<5.::G18058.>E030I0:1321B.'
`.90A5.Z[!\'A5B31:13<@/6194A::A.0130;::1:A;9/<0'/9:
`R
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0012
`
`

`

`
`
`
`
` 
`

 

 






`
` !"#$%%""&&!$'&%$$'%()$
`#&$*+$,!"$$$%&($$$")"-.$'
`$#$"&-$''$$"/"&-!$%0)%$#(%#1&$&
`%,%%#$23456789:234;:<9:5*=%$!%&$!%/
`!"/%)/-$"/&/$"*/%"$%#.'"&-!$%
`(!%"$ !"$-%#!"#$&!*>574?49@AB#"C
`-%..',$&$--!%D&-*E$!)&.$#-"
`,$B#"C.%F#$#'/&$,$$""G"$*
`H($!)&$#%$'$IE$",%%$!%$'/
`%,%&#G$#"G"$,%!)&$#%$'D$
`J*)*/KLMN/LLMOP*H&#GEQ-"",RQS$%%)!
`$$EQ&%)%""-$#RQ-"",EQ*
`T#$($$&C,%&#G$%/.!$%$%$$
`$%#%$--F$%(*U,"$$$"$%$$
`$%#$RQ/EQ$%%&$$"&-$'!--%#S
`
`$#$-'#&$%*Q$%$&&%)-%$
`"&-$''$$"(%#/EQ$$&-$$&.#'$$"!--&$
`$$%%&$J%$#,$%%&$P*
`U#$,!#&$-%.&V%%&$&!"&%
`#W"!$$"$%$"&-$''$$"*X)!%L*L(&
`D&-,!)&$#%$'--"$*
`E$$#-%!'/!)&$#%$'&$$)%$'$$"0
`,%&$$$%%&$*T$$$$&$&#/(!#
`UR"%-')"%$&/%%#-')&!"/$.
`EQ#-'I+$,!(!#'1.!$('$IY.!'/$%
`&%$$*U!)&$#,%&$$&!"$%)%
`C$$%%&$*UC&$'-$%$.$(
`$!)&$$#$%%&$*T"$C49Z3[547\
`53;:*Q]0^]A-$-%_"$,`%"a>574b74[(!#.
`--!%""G"$D&-,%!)&$#%$'*H&$")0
`"--%"$$&&")%-"0C-$-%_"$/C$
`B#"C/#D$$#'*c!$")/$$""&-&$$
`(>574b74[$%&B'(#!*
`H&'$$=H!$%#$.#$$%$",!#$
`,%$!%$'LNde/#"%.)($-(!#.$
`6853<759f3[g87hKLi]OV
`U!$&$#-'(!#/,"!%/.%&($("
`$"&-!$%""$%$D$",&$$%*E"%#0
`-'#!"%&(!#.)#!)$$*B#0
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0013
`
`

`

`
`
`
`
`   
`

  
`
`
`
`
`
` ! !"#$%&'()*+$',-'.'&/-0%%&/-/(,1234'+&11'15$*1-4'5
`.+(,15,6+4-'.6+*.'.'10,-4'-/7,*+$',-/,+8/'(()-4'
`.'&',8/.(,$',-9,*+$',-/,+-4'.'&',8/.(,$',-(%-/&&02:;<
`=>?@AB=CDEFGH?@IEJKLMD?MHN?O?HLHPQRSNTUVWXBYCDEFGH?@IEJZL;EM[LY@EM
`T\\WP]^_=MD?^:MH?GJ=D?@[GEFO`aML_?G@LHIEJb=MDc?@H?Gdee\XBDC=M^B^C
`OGEHEHIO?@L;Of?;?MH?^YIHc?g=Gc=F@<aML_?G@LHIh?L;=Gi
`jklmnompqrstnoumkjvrwxxyzxkqn{tjxu|uou}~runr{kqqt
`nompqrstnoumkjvrwxxyzxkqn{t€rrq‚ovrppwxpwort
`pwx}wryyou}~mkjvrnompqrsjxkqnqotwrqqs{tvt‚xuntwqrun
`ouxzvojvƒqojtzrq„tn
`…xzt†tw~tjvuojrq†owkrqwtrqosnompqrsmxqkoxumztwtpwxpxmtnykjv
`
`trwqotw‡uvtqrtˆ‰Š‹m~€xwoumrujt~rsxku}joutyrx}wrpvtwurytn
`Œxw…toqo}ou†tutnvtŽ‘’“”“moykqrxw~zvojvzrmrxut•ptwmxu
`ntyxkuovrjxy{outn–—yx†otm~mtwtxmxkun~ytjvruojrq†o{wroxum~
`€ru•{qxzurow~runrwxyrm˜twtxmjxpst†tunrtm{rj„xˆ™–šzvtu
`›vrwqtm‚vtrmxutou†tutnvtœŽ’Ž‘‘žŸ ŸŽ¡Ž’
`¢vtuzvsnon˜kvtwqrun£mmk}}tmoxumqrsvt€xkunroxu€xw†owkrq
`wtrqos¤‡ujxuwrmxt¥omou}msmtym~vtmwtmmtnvrvtkmtwx€mkjvru
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0014
`
`

`

`
`
`
`
` 
`

 

 






`
` !"#$$#%&'("")&%)&#%%*
`+""#")# %#,"-&,%'#%%./01234567802
`9:;<=1>?@ABCDEFGHI("'"(#"$&"#,.%&!*@
`",J)&&&#&# ''#$%&"#("&#
`$#""'# &J.%&.&K',&#L18M520N1>86O0;
`?PQ+C%#$R'%"&##I%#!*S%#%I"
`'"%'%&#%'" ##%%#&#&" ##%#,
`"&T"*+"%&'#&&'&.&#%#,"&%)&#%%
`%".& "'#)&!*
`+"%&&&&,&&#)&&)!DUIVH%W$
`DGIEXGH#,.%&! &#R'%'")%*Y'#%E*Z.)
`$&,#)&)(#,#!T'"%''"%.,#&.%&!*S
` \] ^_`a_
`$!#%"'# #,"$##[#'"'"%.%.&*
`b%#% &)#!I'#&&'%'#%%&.&#%$(%!%J
`"'.%#%?!"&J%#%.& "'%C%
`"&%)&#%%#%#,"# #&%[,#&.%
`&!*c#&d I#'")",#&#)%.&&e&"!
`#'#%%#!&%"&T ##%("%"%)&#%%*
`+""8N1Lf:7g%N0g:;8N18:57 &#$#%#,"#,%J
`%'"%.%bQ&&'"#!*+" &'I,I%&#$
`&'[%.#,"#$&)&I("&%)&#$R'("%"
`%)&#%%I'&',#&'#%)%'%.bQ '#%*S%.%&I('%
`h&%$(%568;:203:7%:7;:2035688N1Lf:7g,$#&'[J
`
`%.("%.#$'##&%!"#$'")*+"-&! I
`#J%I&,&#!" !-d%#&("%"%)&#%J
`%"&'[&#%#)%.&.*+"'#%! I%J#I
`%#&"&'"##)%.&.*+"%#&&$#
`
`&%"& ##%&)#-d#%&%"%)&#%J
`%*i!"(#&'[%.! & #!#',!'&J
`$ &#'"#%!j$"!&(#'&$#"&&'[%.
`'"%##.(*
`b,&k0LM17:L1=%0=0L8N5k1g708:L8N1Lf:7gI5<8:L1=8N1Lf:7g$'
`)&! # &*W":7lN1N02##%'%'")"." &'#%%
`"."&'[%. Ik1Nf0N3O1;028N1Lf:7gI%.'#%)%#%'&I
`& &%#(J'## #%*+&'[%.##%"#%#&e&&-'
`&[&I'k1Nf0N=0;;8N1Lf:7gI&%"#'"%.%.I%
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0015
`
`

`

`
`
`
`
`
`  
`

 
`
` !"##"""$
`!%!&'"(&()*+,!# !#
` &-"./#0"1
`
`$.$0!%# %&213"!% +
`!/""$!!/%$4"!/
`/+$%5!%"6789:7;8<=>=8?=?@AB<>CD)EFG*
`0+!/"$/! @BH8<I8JC<$:IIC7CH8DK
`C>CH<&L!"/%$. !%M(NOP0"$
`#$$!$&
`Q$ R=<J7:B>CIS?878@B00"!$0! #
`"$!%&L$/"!%$1"$$!%
`$$!%!%#LT!$%&2+/%
`!!".#!)&&!$U!$#/+$U,$#"*!
`)&&!$!"$"0!!/%*
`$"1#)&&+$V*!&W#
`$0!"3"0!%#2-X"
`D89=7CYZ:JJ7=I:>=8?<&W!!0!#IC77
`JS8?C<$;CH<8?:7[=@=>:7Y<<=<>:?><)FXL*+/!+%
`$!%!##""&\$$!!LT
`!3"0!%&\<J:>=:7R=<J7:BI8?]@^H:>=8?<
`"4&
`W$0!#"$!%HC:7K>=DCHC?RCH=?@&
`GLT!%"!/+
`!!#$!$$!%1
`!&L"!!"!$0!0_
`!/"+%0/!$1
`"0+!$/"!&`!!LT!!!%
` 3"&Q"#0$# $$!%
`!JS8>8KHC:7=<>=IHC:7K>=DCHC?RCH=?@+"!$03"1
`&E!0_/#$$/"!3"!%+"!$
`/0$!/+%&'
`%/#!!+8II7^<=8?<S:R8aKI:<>=?@$
`=?>CHKHCbCI>=8?0/'"(&($&
`T!1!10!@789:7=77^D=?:>=8?3""
`%1H:R=8<=>B0"$#/#1
`3"$&Q"#/!#$
`/0"$/$!<B<>CD7:@$"!D=<HC@=<>H:>=8?
`##"&W/S:HRa:HC:IIC7CH:>=8?#$%5
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0016
`
`

`

`
`
`
`
` 
`

 

 






`
` !"#$"%&'#()*+,(-.!&/0%10$-0.#"123
`456789:;:65<;=6>?6@AB7A;;9C@?D6;9;;8AEFB85AG48AGBB8?HA@@AE9F4
`:867B?5;IJ8?AF4A9F47656<94=;89HBAHB8?:A=7GB?5456789:;:A==GF9BK
`H5A=B8?A@<LMNOPQRSTUVRWNRONWURXYUYNZURN[BAYWVXW\]]\^ZNYUYNZURN[
`;B5AF4@K9F_G?F:?;B8?5?F<?59F4:676C9@9B9?;AH`a677@9:6B9AF;Ibc6=d
`7@?;AH:AF;9;B?FB5?F<?59F4B?:8F9eG?;HA56G4=?FB?<5?6@9BK86f?C??F
`<9;:G;;?<9F<9g?5?FB;:9?FB9h:7GC@9:6B9AF;6F<9FB8?:AG5;?AH;?f?56@
`:AFH?5?F:?BGBA596@;ijklDjkmI
`n94G5?jIo9@@G;B56B?;;A=?4?F?56@CG9@<9F4C@A:>;HA56G4=?FB?<5?6@9BKI
``;E?:6F;??DB8?75?f9AG;@K<9;:G;;?<:86@@?F4?;pB56:>9F46F<5?49;B56d
`B9AFD<9;7@6KB?:8FA@A4K6F<5?F<?59F4q5?75?;?FBHGF<6=?FB6@:A=7AF?FB;I
`rFBA7AHB89;C6;?@?f?@D=A5?6<f6F:?<=A<G@?;:6FC?HAGF<sURTNW\STUVR
`ONtUSN[6F<TNSuRUvQN[DYWN[NRT\TUVRD6F<\QTuVWURXIwHE?B6>?6:A=765d
`6B9f?@AA>6Bf95BG6@5?6@9BK6469FDE?:6F;??B86BB8?C6;?B?:8FA@A4KAH
`BA<6Kx;ya9;=G:8=A5?=6BG5?IwF:AFB56;BBAyaE8?5?6@654?7A5B9AF
`AH5?;?65:89;FAEC?9F4;89HB?<BAB8?;?:AF<@6K?5DB8?`a:A==GF9BK
`;B9@@86;BAB6:>@?;GC;B6FB96@75AC@?=;AFB8?C6;?@?f?@I
`w<?6;6F<?65@K9=7@?=?FB6B9AF;AH75?;?FB6B9AFB?:8F9eG?;D6GB8A5d
`9F4BAA@;D6F<9FB?56:B9AF<?f9:?;zB?:8F9eG?;HA5`a677@9:6B9AF;65?{G;B
`?=?549F4I|A=?AHB8?=65?<?59f?<H5A=B8??c9;B9F4:AGFB?5765B;9F5?d
`@6B?<65?6;;G:86;f95BG6@5?6@9BKD=G@B9=?<96DA5<949B6@;BA5KB?@@9F4IrB8d
`?5;65?F?E6F<6<67B?<=A5?BAB8?75AC@?=<A=69FAH6G4=?FB?<5?6@9BKI
`}AE?f?5D9B9;K?BBAA?65@KBA;7AB=6BG5?<:AF:?7B;6F<789@A;A789?;6B
`B89;@?f?@IJ8?B895<@6K?5DB8?\YYZUS\TUVRD9;hF6@@KB8?9FB?5H6:?BAB8?G;?5I~;d
`9F46G4=?FB?<5?6@9BKDAG5Af?56@@4A6@9;BA9=7@?=?FB677@9:6B9AF;B86B65?
`BAA@;E89:86@@AEG;BA;A@f?75AC@?=;=A5??g?:B9f?@KIAF;?eG?FB@KD6G4d
`=?FB?<5?6@9BK9;FA=A5?B86F68G=6Fd:A=7GB?59FB?5H6:?E89:886;B8?
`7AB?FB96@BAC?=A5??€:9?FBHA5;A=?677@9:6B9AF;B86FAB8?5;I`@B8AG48
`=6FK9<?6;HA57A;;9C@?677@9:6B9AF;AHB89;9FB?5H6:??c9;BDFAB=6FK86f?
`6:BG6@@KC?:A=?677@9:6C@?BA<6KIrF?5?6;AFHA5B89;9;B8?9==6BG5?
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0017
`
`

`

`
`
`
`
`
`  
`

 
` ! "!!#$%#&"''!(
`)!"!''&")) !"&!* (+!&(%
`)) !"$,!"" $('&"#'! !&
`!!!%'  !&&%"-! $!'
`(.'!!')) !") %&
`+!&/0123456154763058/9#$:;<=>?"#@' !&)
`(!,)A!!'!,."#""#.&)!",!
`B ""'"#!,"" "#)!,".!!"' "C%
`D"$%%'(! '!%!)!('&%!,!.
`  
`

 
`* (%#&"'
`E!!!,(%"'%#&"'"!,)
`F,&!,!!, "''(!)&"$!.($'!"!
`,!!.& "!!# )"&!-";GGH$I50J6K2L0MN
`O4/6P/Q550QMP/K566MPL/IR4S/ &)!)%T"!,&!.U
`V"!."WXYZ:[=>\&%U''$&&()!] !"!!&^%
`
`!_&)!,/67LNL7765/L`6.UV"'UV')
`!L7765/L`6 "' "') /I42L4RPL/IR4S/-"#"$)
`')' ') "!!#,!&%"'"#"!
`"(!"&"a!&)'!'U!!'U '')$)
`')!*&"'("#"'!(()!&'
`!(%C%9#$!%!"$b'U!,U(.$,! %$ ?$ " %
`9#$ V"#$#"#$ ?$"'%&", !9#$ %&!&"$
` ?$%&'!"!"U&!)) !"
`E(% !&&%"!"'&(.,!&'U
`&!%"'')"'!.')')E!'$#(!,
`)')&V%)"&'GHc!,de')f'U
`&!%"'')$!.($'!&""'),!%#&"'
`E!",!&#"!"#,! %!,&!Fe
`)) !"\C%"#&!')
`d'!U!%#"'!) U!%#'U&!%"'')(
`"'!"!%)% "!!#,!%#&"')) !"
`,!&!,!f!.($%*,!&( "!!# 
`"'#!"!& '. V. )("&,!&"#%'* (
`"&")) !"-""U)%)! !"_$fgh%'"
`&""!"U&!Fe)) !"E* B " !,)U
`) !""''!"! %"!.&!_)"'!"'!!
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0018
`
`

`

`
`
`
`
` 
`

 

 






`
` !"#$%%&#' () *&%*#*((+#
`,-. /#+(*01- 2' (!03% +(2
`4 ((('#*'2$%%*#(/2&( /) 2$4
` 5+ ' (  $' (.6!
`7%#&4'( )#$3' (++( *  *#+(($
` 5+ ( +(2*8/% *''8* ($%/
`( 2&#2#)'$) %(( 2!9)(++*##):
`%/( 2'2  (234#3#( +(23
`'( /  (++( * !94 +(2+ /;+( (/
`+ ((23( /+ *((&%*# '*' &3
`+*&#(/&4(() +<*!=#%&4*((
`# *#(/ *()  >?@AB@C@DEFGHAGIJG@CBAKLM.6N!"2 3
`% &M.6 +(2'()**#(/ *(/ *
`(   $*) (.62!-%#* *
`) (' ( 2$+<* *#(/2&+(*+%&/+# *
`#4&##'* '(  ;+(  /M.623
` % )  &*#(' &%%& %2&#
`*% 2!,(((#)(+$) %() $
`#3*# +(2+ (+<* **'*((24!
`O'( )#(/)(% $%/( 2##+ (
`2 (  (%**$%($* 2++( *  !=#'2&
` PQ



R S
`M.6'23*#.6*+  )&'%*+(2!
`=# ':+) %)2 +(  ($*#3
` T%$+ (%/( 22 '(# 3
`( U%*#2# #4!=#  %++
`'2#VWW ((% 2***$/!
`.$(2 /$%  + *& * ) /&++*3
` )/2&4 *%*) (' (.6 +(2+
`+ (%/( 2++*##)* /$# 
`(   !O+3$3#3**+& ('%#4
`$4 +( &*%$++( *   
`%*#%%&% &*#& % (!O4
`+((('4 +(2*# T%%$) %(( 2%/
`( 2 %(# : /'%#( )++*#$.6!
`X+ (/($.6 *# /#()($* *2'3
`4() %() !=# ':* '*# T%$
`
`
`
`
`
`Niantic's Exhibit No. 1008
`Page 0019
`
`

`

`
`
`
`
`1.4. Outline of the Book
`
`9
`
`the optical combination of virtual and real environments using mirror beam
`
`combiners,
`
`transparent screens, and holograms.
`
`It presents projector-
`
`based augmentation of geometrically complex and textured display sur-
`
`faces, which along with optical combiners achieve consistent illumination
`
`and occlusion effects. We present many spatial display examples, such as
`
`Shader Lamps, Virtual Showcases, Extended Virtual Tables, interactive
`
`holograms, apparent motion, Augmented Paintings, and Smart Projectors.
`
`Finally, we discuss the current problems, future possibilities, and en-
`
`abling technologies of spatial augmented reality.
`
`Chapter 2 lays the foundation for the topics discussed in this book. It
`
`starts with a discussion on light. The atomic view on light will give some
`
`hints on how it is generated—knowing about its properties allows us to
`
`
`  
`


`
` !" "#
`"$"""$!#"%&""'(
`"! ##)*!* !!")" (
`"$+#+""" 
`! ","%-")"!")*"$" "
`.!/"$0 .+""$1*!!0 2"$
`#"$$3 #!4#"$!.4'"%
`5)$+!" "" "$  """$!(
`##"" #!)%
`67)" !"!" ""!"8%&
`""+!" ""#%2+#+#"
`"+"#!98+# ""+" "
`:+" #"%
`5#+"$#+#
`"!%2"";!"#+""$
`" ""!""$+8%2"+!"+#"
`!) !#! #)""#""
`(!""%5 $"*!
`"  ! ) )<";!"
`
`"#! !)!")=""*"")"
`"$! )+)"!"" !
`%2!8!)+#>"
`#"""!")%2""""!
`"$"+""";""! ""
`!")"$+!" ""!""+%-+ "+
`#""!""!")" !%?"
`!#"$" ""!;*! (
`!#"!@ "8 (""!#$ "!
`#!#"+!"!%
`6A"";"  #!)!")"!(
`!$!(!$!"!")"%&#"*" 
`!")""""!!" """!(
`#"!!"!#"%B!")"$!"( #!
`"( #!( !!")"$!!( !'"(
`"!;"*!(!!")"%5!(!!"(
`)"$"!#""""$"$!(!'"$!
`""( #" !%5)$"3B!"(
`)""!%5"*" !"("!!"( #
`!")"$""( #!")"$!'("!"
`
`realize how it travels through space.
`
`From electromagnetic waves, a more geometric view on light can be
`
`abstracted. This is beneficial for describing how simple optical elements,
`
`such as mirrors and lenses, work. This chapter will de