`(ORIGINAL)
`
`
`
`
`
`i
`
`Petition for Inter Partes Review of
`U.S. Pat. No. 7,477,284
`IPR2013‐00327
`EXHIBIT
`Sony‐
`
`
`
`VR élfiffii Vol.2, No.1
`
`ISSN 1343-0572
`
`- VRSJ Research Report -
`EIZIS/\‘-5‘-=\v)l«'J7"} 7"1'5J“'L%‘i3f%$E*.§
`
`SIG-Cyberspace
`fifi%$fi%%
`
`199751511)? 27 E!
`
`B$N—%%wU7U?4$%
`
`ii
`
`
`
`VCR 97-11
`
`Spline La>4£i,*.§/Aw -E$i$)< $4 7;:-y-
`
`$133333, Eric Young-Sang Shim, §Wf§T1:,
`
`'f7E1EV'3§3. EWKKE (gfigfi)
`
`VCR 97-12
`
`$HEflE|171§7b= e<7)n"/ =2 :72 7 Ix>rEf320>:=:)&:
`
`Hut $75, ifimii, fi7+<E9§$U, %’Ilr'»%-€61}?
`
`(773%)
`
`VCR 97-13
`
`£3-1:'7'=7r 2:» CG M351 o:E1:‘cHa*7‘:H9&1§1r7 yr — 7 2 2»-
`
`NEEIEE, EHWJ,
`
`4rP»’a'?—5'iE (NIT)
`
`VCR 97-14
`
`4Ii?'E.§F-efi o::,*ab7z>fi$0>EJf’E</>§iE$‘22*2
`
`2!-<EEl¥9"rjLE|3. 7!<Hr%fi%,
`
`iciiliéiéi,
`
`7.<EEI%‘2é:,
`
`lEJH3%’§—, VAT-IE (ifiic)
`
`VCR 97-15
`
`3 >k7T:4Ii?E§FiaEJo::sn‘z>'l%fi7 »r : ya)i.%:«’2§‘zb:F%§Tz)1fi%a‘
`
`#:5‘EZ\ ‘?%3K1EY=‘vZ (NIT)
`
`iii
`
`
`
`fIi.*§.%f$ffi£}h’Eéé vcR97~11
`(1997. 11.27)
`
`fimmiwfimflfi-—EE$xf47N—&——
`
`Efififi Eric Young-Sang Shim '§'F"H§'C iiflilffifi
`
`i'§W'll9\$
`
`Eififlwfififififififimfifi
`
`aka.*ybv—7&fiLrfifioa~¥fl=:a:#—vay&fiz6fim£fir&a
`
`aE$x?47A~a%fl%Lt.EE$xf47A—yu.Lamufioafiwmmfifi.
`
`¥$§m¢&fi.fiE$,afififififlmfifiéfizrxb.flEmm%fiLtE&o:—f
`
`fi—om&HWTw%W\:hB®fi$TW&&#€L,%FKx6fi%Efi5:&fifi%T
`
`baazofifiafiu,%ufifiLtfifififififi®§&y7+¢:7smme&mw<fi§L
`
`t.smme&fiwa:am;D,9fimfifi§fi%%&wo%$%mfln5:aflflfire
`ta$firm,EE$xf47N—aWw%—E2mfim%§kow1.%®fifi&fi&6o
`
`A virtual park on top of Spline — Bicycle Media Park -
`
`Katsuhide Takahashi, Eric Young-Sang Shim,
`
`Nobuhito Miyauchi, Toshiaki Saeki, Hisao Fukuoka
`
`Information Technology R&D Center
`Mitsubishi Electric Corporation
`
`We have developed Bicycle Media Park (BMP) which enables multi-user interaction in distrib-
`
`uted virtual environment (DVE). BMP has 1.6 km square terrain and provides several amuse-
`
`ment facilities. Users of BMP explore the park, visit aquarium, space walk building, ferris wheel
`
`and bicycle stadium by riding bike. Geographically distributed users can come across, talk each
`
`other, and share their experience in the park. BMP is implemented on top of Spline, a software
`
`platform for building DVEs. Spline makes it easy and flexible to provide DVE applications. This
`
`paper describes design and implementation of facilities in BMP with Spline.
`
`
`
`
`
`E1*E®¢Efi?E6fi
`
`0$E§W¢Rfi
`
`@2KfiffiK.E%W%t§%®§fiiD
`
`BEw$$§EflEfioTM6.flfi%fi§
`
`¥fimBEkEE&¢bKE6$E$$$fi
`
`fii%%btD\$$§M&EDE6:&fi
`
`T%6a
`
`
`
`
`
`E2$$§fiWfifi®Wfl
`
`OEEE
`
`R4&H\%U%@flEk%6&Efi%K#
`
`:K%D\m3k#tEET6aEET6fi
`
`fimB«fiEW®fié&EfiT:kfiT%6o
`
`m3fi*E?5k\”4§flEfiWK#3#
`
`B%D5o@3fi\fiE$K§UflbfiN4
`
`xmfi®%§towT‘%®fi&EfiN6o
`
`2. E!z':fiJ‘5"»f 7I<—0
`
`$%Tfl.EE$X?47N~&®fl¥k&
`
`fiWKEEéhkmfifi®#—Ezm§Ko
`u\'Cifi«\“6.,
`
`znfli
`
`3&ifiE%fi<%fiLtLwmm
`
`fi®&fi&\Efiw:—fflaE$flAwh
`
`?N42&fiwTfifif5v27A?b6°
`
`£fiuflwmEaEfl%mbmD‘flfimm
`
`U1EE$EAmfi?fi4xmNV»®Eé
`
`fifimfbo
`
`1—fu.EE$K%ot§®7N5wfi
`A/( i <‘_'§‘E5ZE‘?‘5)k L/C/J.>I*Jl:fi.b:?L, Hz!
`
`éotn~ffiim%E&mw<%%&%L
`
`U:&fiT%6ofiEW®%fitfl\%®%
`
`%\m®m%\m&ifiTém®t&U%%
`
`$&®§%.fi%m&V+f#7VF%®%
`Egfifiiénrwéo
`
`&EKm,m&fi$$E§m¢$fi&mo
`
`tfiE§#—E2fifi\fiE$%EE$fi&
`
`%&wot£mfl%—H2mflfiEEénT
`wa
`
`zz£flWwm&&#—Ex
`
`Omfifi
`
`£EWKfiEéntEkmETm.E1K%
`
`T%&E&®EfiT5fi&fiET6:kfif
`
`? Q‘
`$60
`
`‘B 5-*‘{5‘0J/</{7z75E}|5?i’)'Cb‘.7.>!li<?'id.'C‘
`
`
`
`
`
`E3fi§$EE6N47
`oafififififi
`
`—&W&4mmAv&0fim%&%?»K
`
`¢fiLkmfi?b6oN%&fitv1E=~
`
`Z®V—XfiT3\@K54LF547WV
`‘—;§"(J\ Eu‘
`i;V—vaVKI6UfivbEE$k@V
`_
`~x~bfizzac. fififilmcii. znaoasfi
`
`£0) 1/-7<k’_§1J!H‘.7a7‘r_?i>®l‘/ }~ 9 3‘-U 7’
`fifiE$h£D\:wIU7Kfi4&fiA6
`
`:km;Uv—xflEfi%Kfi%éh6°E
`
`MiUfiyFEE$&®v~x@%%%®fi
`
`%Fb6o
`
`3.Sp|ine
`
`Spline ii‘ DVE 1§%§fiV7 }‘ 7:271‘
`
`%U\fifi§W®fifi%%fiT6fifififi¥
`
`?W\%fifi%7WW®fi%%fi5fi%E\
`
`SplineAPI 73:Efi*é'3'6 779 /7‘-1‘/a .‘/ifi
`
`E73>Bfi6.,DVE77U’7*“.‘/a?/7"El77
`
`AH\77U7—VaVi%E®LflK%§
`
`éihé (1215).,
`
`<;\_Z1Z::E;_:>
`- -
`- - - - - - - <-_‘:-------------—---
`
`--Spline API
`
`7D"J‘r—“/a‘/iiflfi
`
`<:iL
`
`‘::>
`
`fl$£¥»
`&a£¥»mmm
`SDI inerlqfifiimili
`
`%”M=7
`
`@3233
`
`—‘fiWm%F§r*"
`9.. 7
`IP7’r:1xI~:1))Lz@-‘J0
`
`[25 Spline UNIFE
`
`.0p°"|N/°Ft“'°"k
`
`Spline TF1‘ CUDJZ 5 7‘.£fifi*Z73J>Bfi3Z6?§§C
`
`®7I:1"cZZ73>T'o~’)0) Spline '12“/‘>.=.13/E
`fififba
`
`
`
`aLfififi$%?»
`
`Spline fifi‘F'C*|'fi1~'1z ‘y “/a ‘/ltfiflfl L
`Tw6%77U7—vay7ntxm,%E
`
`%K~o®fifi%?W&#fiLTw6°%7
`
`uf2fl:®fifi%?W#B%fi%fifib\
`
`EE%mi5:&K;oT\fifi§fiWTm
`
`fiE#fi&fi5°§<®fifififififivx?
`
`.Mupum?m\fifi%7wfi§¢§m#—
`
`/*lCJ:o’C’§‘fiE¥i}'LZ)7)§\ Spline ‘Eli. 7M7
`—?EU74\%&&fififiKEEL\%7
`
`utXfiKfifi¥¥»mEfl&%fiT6fifi
`
`flfifi%?w%fifiLTw6°
`
`%7ntxK%wT\%n?h®fifi¥?
`
`/Vkliibffibhfziili. féfifiv/1/9”?
`
`
`
`E4DfiVFEfi$&®U—X
`
`
`
`
`
`77U#—vayi%Eu\77U#—v
`
`aVflEfifi%?»~w7&tx%fi5tb
`
`0) API 7X77 U %E§‘E'3‘Z>., % Spline 7
`utXfi\:®AH%fiwTE$Kfifi%?
`
`wWKfit&t7v:7%&£mL,E7u
`
`“‘zZz)§fW7§¥E1%’D7d'7"‘/“xi H:$61‘L/TE
`
`E&fi5:kflf%6.it\%#7Vx7
`
`F®fi€$%fl®7utXK%LT$fiT6
`:kBfi%vb6o
`
`Spline Pi. 3W7T:{Bi3§§§l75W0)2l‘7“/"::7
`
`F®§fiE§fiT6tbK‘:o®fi&&fi
`
`fiLTw6°~om.%79=7bmmEE
`
`fiéxifbfimvbéoflfimfiwafifi
`
`%$w~®EEm,fl®fifi%7w~kEfi
`
`éfllao wt) 5-001, 7<.b.-—-7~=E--“/53/2'.‘
`
`@£&%T$6°ZA—X%—VaV?H\
`
`#7v;aLw&%k%fimfl§f5irm
`
`fim&%ET6°:nBwfi$m,fl®fifi
`
`%$WK%§éh,%®&®}vt—VfiE
`
`€#bfK.%n%h®fifi%?wW®t7
`
`V:&%%,%Eént&%umoffiB#
`
`tmm2mzmmeamé&5:amv%
`
`6. it. %).‘—.i’&i1§%'7‘:f£:B%0){&%£':T:k’_
`
`L'C1'9§’J$-H."J’5l‘)‘?.'>::Ei73’C‘%6.
`
`¢#—Exm:E
`
`n—ffikAx&&#mL.fiEEflA
`
`wh?N42~oAmh&fiw.EmK
`
`3fifififi%fi&§%T6u
`
`@)$fi§EWRfi7nt2
`
`EmWfi®§§fi\wT.$&,$$fi
`
`fi‘d:&4’I5J5JZL. $E&Cfi=3€'£i—;?_Z>o
`
`@)mEfi7ut2
`
`mHwwm&¢mL.Efiét6o
`
`M)fiE$7nt2
`
`fiE$fifi%¢mL‘fiE$®m:kE
`
`Efi%EEé&\N49&fiE$®m:
`
`Kfifiéfibo
`
`w)EEfifiE%7utx
`fi&%&#mL,%Ev—xK%H6N
`4¢$ufiybaE$%flflT6.
`
`%n%n®7nt2w¥fifi£fiK%L<.
`
`m$a#—ex2am+ammmmsn%3
`
`v\%&m&fiwmfifimfi&§E?5:&
`
`fi?36aBL\fifi&Emb&wfi%Ku.
`
`7ut2&flflL&wEw?fim.it.E
`
`E$x?47N—aK,fifim$t#—E2
`
`&§fiT6fi%KH\fi$%§Eb\?~E
`
`2&E##67ut2&£m?6:tr¥fi
`T365
`
`4.2. XL-X=E—’/3 ‘J
`
`*fifiT®fi\$fi§WW&fiW®$E$
`
`EEExf47N—7W®$fi%%¢fi
`
`fiE$mm:tEfifin‘—E®m%%flD
`
`m,*mfi.fii$\EE$fiHfi®¢m$
`
`fiTaChB®fi%fl‘%mw®XA—2%
`
`®%§&%®fifiKowrfi&6.
`
`
`
`—vaVfl%&fiwt@E£fi£Lf%fi$
`h'C1nZ>.,
`
`Oflawafikfifi
`
`ofiwfifi
`
`@8K\ZA—Z%—VaV%flHLkfi
`
`®Efi£fiEfifa£E®¢bKEv:7»
`
`$$§fi¢RfiTm\1omEEk3ow
`
`?~9&fittwEfi%7V:7%(fi2i
`
`a&&%n%nmau%ne&amsfia
`
`7v:ar)&¢mu\%n&fi1x7v:
`
`fifiKEE&¢bKLT3o®$E&£Eé
`
`7bwfikLr$iT6a$BK,%wfi1
`
`E6o$E®&EH\E6K%fl5KfiE
`
`?7V:§F®¥kLTfiT7Vx7FE$
`
`®¢7V:9F&3owfiE%7V:&F®
`
`Ef6o%®:omfi%EE$E6:kt;
`
`fi%7V:7FKf5:&K;oT¥fiLT
`
`D\2E®£fiE§fl§&D%w.fit79
`
`w6o¥?b6%Efifi§wMEmB&E®
`
`xabmfifitfififiméfibtrwa.
`
`EE¥&EUflhtmEKEET6°fiE%
`
`79xabfiEE?5:tv3ow$Et7
`
`Vxahkafififififiiahé.
`
`fifi¢®X79:7b
`maeu
`
`
`
`fiE¢D#79:Db
`
`flemgwafiafifi
`
`oafifiomraafifi
`
`E7K.fiE$®XA—X%—VaVDfl
`
`fiéfifufififiwfififififififlvflfifi
`
`L.EE$®#3fifi%EDkE%KEET
`
`aofififikmrwfifififififitmfb:
`
`a?.%%®flEfi®m3®fiK%Efimu
`m%2fiorwa°
`
`
`
`E7fiEi®EE
`
`nzwflfifl
`m1w@£m a
`
`fi1T79I7F
`
`a22r:r~;1a r~
`
` fi1mnH
`
`3 $17917 roam
`
`EowfifiKOwT‘2A—Z%—VaV
`
`®Efi$w%%Lt°—E£fl&fiDfiffi
`
`v:7b&fiom%&%§f6fi%t
`
`Ul\X.L\*-‘X-'E‘—“.‘/5 ‘/>5:FfiInE> : H14: 0 .
`
`m¥K%£?6:afiT%6oEt.ZA—
`
`x%—yay®flfi&L1\fi%§®mfiB
`
`$WBfl5eZA—Z%—VaVTfi\fi#
`
`®¢7Vx7h®fifi%Ek%&T,$fif
`
`6f7V:7%®flEE%fi,fifi%f»m
`
`Tffiéntwmgvhéo
`
`Lafilfifitfififiwfifl
`
`N47®fiEEwm:~®§%&fifi%V
`
`~xH.N4&®flE%fi&N47#5®m
`
`fifififimxorifibrwaa
`
`0fiE$wm:~®%%
`
`fiE$7utxmwv9@mE&E§u
`
`fiE$®§D§KEnfi,fifi%&H%7m
`
`6515760 fiE$7“u-tzxli, i-fl'E>7b=:“
`
`%§Rb\N47&m3®t79;7F®¥
`
`kLT$Ef6°N4&fim$&£KEEf
`
`6oN47%¥&Lf$ELtm3fi—EL
`
`
`
`fiET6:kk$D,%h%h7UtZ®fi
`
`2fi%#$h6M®R47K§<®mE%fl
`
`flTKED.V—2flfifiéh6°Et\E
`
`muuwnfitamwa
`
`E$fiEfi7ut2fl\%V—X®$T%E
`
`it.fiEfl$®¢K€$n6Tb65$
`
`k/*»f9Z’LU1=17.l'?~y I~EE$7b§/<‘/&J:é'flZ
`
`&%m&W$twot#~Ex&£fiT6%
`
`uwm%KfifiL1w6m%fi?6oV—X
`
`éKfi.$BK§<®flflfi%¥TED.7
`
`%%fif6tbKfibn6:®:owm%
`
`N5MK#~BxE§Hékbfl£EEmT
`
`B\N49&Uufiv%EE$®mE%fiK
`
`6:kfi\#fi$MTb6ofififi$®%E
`
`xvfifibrmbn
`
`®fifimB\%—E2&fi#T6M(flfi)
`
`8BB®flfi®#~ExKowTb‘flE
`
`me&m3naw(7na)uwLr.v—
`
`%fi&fi€%®$fi%fi&#¢tLf‘N4
`
`exm&m%mmmm&mm$&¢&m$&
`
`77utxkfi$E%ET67utxfl%%
`
`&%i6MEfi&0\%&waErb6o
`
`fiWT6:amBD%fi3hTw6°N%&
`
`LE®fiE%fiiz1‘fifi7N5®flm
`
`wr%§&mau\mfi&2#—a2wm7
`
`&vEE$fiHfiV—x«®§m:—f4V
`
`utxKfl%ETmEkfi€%wfiE§*%
`
`&—7:—2o¢mEfiL<‘7N5®fi~
`
`?T5:.2:7‘iD"C‘2bZ>.,
`
`:a)iaEa:. Spline am;
`
`m&fifi®fi%a#—e2fl&mfi®9fi&
`
`EEfi&fiE%fi§fi%&mw6:&K;
`
`fl5Zm&fi5:t&¥ELTw6.
`
`U‘J—W$m§@#~ExfiEEK&%T
`
`3%
`
`aitb
`
`$fi?u‘EE$x?47N—7®fi¥&
`
`%®¢®#~E%fi$T%6$fifi\$fi§
`
`WWfifi\fiE$&EE$fiH%%flfib\
`
`Spline LC01/"ClZ:‘L7B’\’T'_., 3 BIC,
`
`2’_7}’LBOD
`
`0)%§‘3"9"5‘*}‘—t“5<iJ3\ Spline >2}:-E1/‘T1: 3:
`RZJ: '9 %§(lC§7K§E'?’5 Z 8 2531‘? 5 I <1: 7277‘
`
`L, Spline iJ‘§%fi§’§‘6Z-bu‘-‘?<‘fI-‘—‘.‘/El 3/.
`fifi%®$fi\mE%fi®3omfi%&mm
`
`$%ifl
`
`mfififlwfifi§M&mmT5VRMLmmvx7Az
`FUJITSU.48.,2,1997 #5 3 B.
`
`[2]S. Ichinose et al. "lnterspaoe: N'l'I‘s Cyberspace
`Communication Platform”, N'I'l‘ R.EVIEW,VoL9,
`No.3, May, 1997.
`of
`society. Pmca.
`211. Virtual
`[3]Honda, Y.
`et
`VRML’95,San Diego. USA. Dec. ACM press 1995
`pp.109-116.
`
`[4] http://www.merl.com/projects/spline."
`mam M“9&fiEfifi§fiy7k¢;7
`&mHEiifl&fiAw7$2H
`
`[6HE§ {$4/‘—‘f‘~\*lV }~ I/-— F“/at 7:Sp1i.ne ¢7)*FL‘FH3“/
`x7xgvR%%fimmmm%%%1@vywvv
`A, 1997 ‘#5 7 H.
`
`
`
`{fi.‘E1%‘|3Ffi4'1)i§'«;% VCR97~12
`(1997. 11.27)
`
`¥HE§5Ei&Z')*B03/i/7‘<’7<"J"1/1?l‘E&f73$fil?.
`
`mflfifi Kflfii fi$Efl Efififi
`
`WlfiIi%fi%&fl%H%NfiNER%W%fi
`
`1ii$§?’C‘ti\
`
`1 é?r7)1:‘?'7t7J x amaflfit-6‘ WEEK-7 l/2‘1‘El:Hi\nZ:7'i7E0)/</ avmfiriflrsflzt. :5
`
`iwfifié t:#9‘I.T3L,f:¥fi§’$:$lJFfi*a*Z>: t 0:: D \
`
`:L—+2“‘r7>1=E#»i7:‘I‘«flt:£El:7*:/<’/ 57F!J7f$‘z0>X%1/7I'ifi<%i9E
`
`a:owr$E%‘:.=1“Z>o 2$i$2"£’C*L:.L k'?'7r7J)¢ —7&Ewb:EL'C%’:mrlil?&étK ?%ehz»iEfi'I§I1%Fafio)>r7"%
`
`4 mv7:v—H|Jfii Lfitiax ‘J 9 H;fM%a)+;7J D H5 Ltfi§’e.*&fivu 7J=_Err>/u ~77'1§if%%$15J‘z<r7ac, % LT,
`
`E?'2‘ 71 X 7<7){Li:‘7>*%/<’/ 5<'EfiP~Jb:?H:E Lrmz»h‘§4wi’c‘¢>£E9:EL:ia‘fiE*fZ>¥,fi.%..'&FFJv=T\ E750“!
`
`7=7Ef%‘E’.%Ii!E*J’Z»{fi_Ea52‘9*¢<7)€fiIJ1tDL:$|J)¥1“9‘6o
`
`Generation of Panoramic Stereo Images from Movie using Single Video Camera
`
`Yasuhiro Kawakita, Yoshitaka Hamaguchi, Akitoshi Tsukamoto, Toshihiko Miyazaki
`
`Kansai Laboratory Research & Development Group
`
`OKI Electric Industry Co., Ltd.
`
`Crystal Tower 2-27 Shiromi 1-Chome, Chuo-ku, Osaka 540, Japan
`
`This paper presents a technique to create panoramic stereo images easily and to display objects normally in
`
`the panoramic stereo images. Significant points of the technique are that we use only one video camera and
`
`use depth information on rendering. To create panoramic stereo images, this technique cuts and connects
`
`vertical slit images with optical flow between recording original images. Moreover,
`
`to display objects
`
`rearranged normal position, this technique controls an mixing angle of left and right panoramic images.
`
`1.
`
`$113601:
`
`fi$\%§&N~XKLfififl§W%¥$Efi§fifi%§hTw6mmoN/77E@%%
`
`m—or&bmm‘wofimgfifin/av@%®%%\fi%flfi&¢bt¢5$e@5fim
`
`wfifielfimn/avwfifieimtactfirébot:5fi\:mN/fivmfiimmz
`
`<u‘fiatfififieflfitrwx7%EE§sé%§fi&&°:wflmu.wx5mEfifiE
`
`§K$DtEEE®XUvtfiE%B#Bb%%L,%®fi%%O$EZU7}fE%E@Dfl
`
`L‘Mkfiétffi/?7E@%$&?5tbf$%o§BK.fl#®N/77EfiH€fifiE
`
`Efltztfiféétwwt2ki®¥fi®%fim£fi3ntflfiéflwtwfififéD,fl
`
`%fitw5firu%%#&5o
`
`.
`
`$ficu\fi%fi®fimfi¢&<‘mommxrvrmfifitn/avwfiriflratbm
`
`$E&fi%?5ofi&®$&dmhk®x?VjlU&%oif\lfi®E?*wX§%mWfi
`
`fififiéflfio%entE&®7v—Afi®r7?4ww7u—&mw,t7?4hw7n—m
`
`_7_
`
`
`
`
`
`E1 H?2wx5u;éfi%fiE
`
`a #7?4t»7n—0&w
`
`fiELtE?t%@#5++7%+U>7Efiw\%%n57v—Amfi@mxmmmmmu
`
`fiLT\%®7V—AE@t®%7?4fiw7U—%$bMEZiflhWE®H\k®7D—
`
`AE§&®?V7V—P77%>fKl6i7?4Ww7U—®&$fi%T\Vv%V7%t6
`
`?V7v—}®%fi§fiK£Hé7U—N7}W®fi§§E\fi§fiEfifik?%fifi®EéT
`
`§LTw6o&£\?V7V—F7v+V7®fi$fiEfi,fififiwfléfiflfliwflfifififi
`
`%6:k#6fifiW®&&Lto%®tb\fiflfifikufififlflfififfififinfwéoit.
`
`#774flW7U*®fifififiEL&w%fifi‘?V7V—}7v+V7K£wf.%1fifi®
`
`vv+77fi%®Et%2fifi©7v%77%§®Et®§fi\*EEfliK&6&#ot$fi
`E®%fiv&5o
`
`?
`
`
`“l,!:Hm
` H“
`
`1!.
`Hlllllll
`III
`|l|
`
`
`*,wwwmmm eI§IWHIIIIIIIIIHillllllll
`
`WM 3'MW“ 3;HHIJHIIIIIIIN
`
`
`
`
`
`2 7T7°“7‘*f7’J11/7‘3"—7>1fiti‘J¥‘éz’§1'%2:X')“/
`
`l~l7EIf%
`
`1')“/I~E1%
`
`m zUvbiflmWUwb
`
`§fiT5§T®7V—A@@E®i7?4fiW7U—WEi5t\%®7U—N7F»®k§
`
`é%flfiLrxUvbfi%m%L‘EB.EEfi%n?n®xUv+E@&7v~AE@#6w
`
`0353:,
`
`.::.“C‘,
`
`-7—y7°!/— F77+>7’7b?E’7-l:)l«$1fi_0)7~7-7-V7’'$3fi’) : J; 2:\1=§;*;§fiE
`
`fififim®Afb&tw5flm#5.7u—~7bwmkéééxuvbwfi&LrflmT§5o
`
`if‘EB.EEm%n€nmxUvbmfiéwbmififiéfimiao®3t£wr,EE
`
`®fix§wfiEfi\NI77Efi&Z?Vifi?6%®EE®E®fiEKfi%T5,Eftfix
`
`5®@fi$&%LmxHummfifi&2wm\Eftwxamfififiézmngatéb
`Lsinfi =e
`
`mfi%fi&%o flaw‘1s0Jwmxe=awmnb?ét.a=1amm9t&é°—fi.E
`
`_4lD\EE¢%lDXUvFfiEiT®fi%Ex@mm\74VFfi®fiEw@kw‘fi¥fi
`HQ? fovx(deg)c‘:'§‘6 2:‘
`
`w/2:x =tan(fovx/2):tan6
`
`2:73:60 WJ7Uf\ w=320(pixe1)‘ B = 10.2(deg)\ fovx=31(deg)2:T%c‘:\ x= 104(pixel)c‘:‘3?
`
`i5ofioT\@@®¢®fifilUfifiWK1M@uwfihtt:6#B7U—N7%wwk§
`
`éKfi%T5fi®@fi&@UELT\XUv%E@€$fiT6o
`
`._,..~
`
`wxawfifififi
`
`E3EE¥&tEEfi®fi%
`
`E4EEfi&xUv+fiE@%%
`
`%K\WD$TZU7%Efi®fi&&fiT%o7U—N7bwU\XU7b®wD$LfiEK
`
`£H%fi§fi®fi®fifiHfi&éhTwéofi#fiZUvFfiK7U—N7}w®k§é®fifi
`
`E&flmLtofifiE%fl%?%:td\%®7U—N7}»®fi%5KH$LtfiEKfiE?
`
`%%Wfi\XUvbW®§<®fifi&£bT£D\%®%¢KEELTN/ivfifiiififé
`
`Ct&§%T6o%OT\%K§ELtZUvFfiEK£Héfifi&7u—N7FWwE@M®)
`
`ffifiW®fifi#finrw5§wmfiLr§fiR&tD.%B§<fiméntEE%®xUv
`
`FfiswtRE?éo§%%KwU$éh%ZUv%E@m‘E%®Efi%fi%®EfitLT\
`
`7EE}5H7)»"%% W/2+x ®{ilE75‘BWaEa SW‘ 7EE}5§03f%/ET w/2—x—sw 0){§£1’§7§“'9fIlE sw 01‘) '7 I‘
`
`_9_.
`
`
`
`
`
`5 I. I//\*-—5’ d=~)1«<7)/U 5-\77LIj{§
`
`a lfituzttmutzivta
`
`utwimffientifimnxavwfiéfimzivififat.+fififi&fi%Lt@fi
`
`®%%uu‘mEfl%EE#ufifi#5x%v¢fififi%v&éfi.wfiwfififiufiasnr
`
`wé$mv\wxa#efi%%ivwE%fifi%<§wL1w5;5&$mw%%um\EH0
`
`N/57E@E§$T6fiE%%%T6%§#$éoC®Mflfi%§&E$fi\flT®HKfi%
`
`fééoEfiflc)&¢b&T6HEILtfiwx5%EEL.Efi®§&a%7v17bA.B
`
`%fi%Ltfi¥%HMwKfiTo:®%\#7vl7+Au.N/avmfiwwcfivnmfi
`
`EH‘%n?nEEm\EEfitLTfifiéh%oWfiK%7V17bBILAW/77EfiW
`
`®EiMJFFLEfi§h6o&:6fi.CDN/77E@€%®iiX?V%fi75t\Hfi
`
`$fi%fi#6%wLtfi§fiT$6#B\%771¢FAP%7V17+Bfi,fififiKEE
`
`§ht£®%fi%LtEfi%fi%LT‘flEfiKfiELTw5§®kLTifi§h%o%®tb\
`
`#7V17Ffi:EKEi%&E®fi%fiECD\Efifixfvifififééwo
`
`
`
`E6fifi%fi%fi®fi%®
`
`
`
`mL®:t#6\%7§17b2k¢%7V;7%]®Eflt$ttfi%fi%flfiLT\N/
`
`7vEfi&§%?6mE&fimufiEL‘ifién5$7v;7+#Em&flEuEi5;5%
`Eiafiifihéo
`
`Esmufiiifiu.4CODtzEOF&\2au~fié&5t‘Ewwaxcwmfifiu‘
`
`6<F<6%&éo9iD¥fi%fi#6$flLtfi%fi6KfiL\i7V17b®flEfifi<
`
`&6Konffi%fiufi%<&D‘i7v17bA%%7V17+Bufi%fiW\VTE&w
`
`nfl&5&wo%of\EE®N/77Efi&%n?h®fififiE%¢bKfiEfiofltuo"
`
`£HEE§€fEEE%b%5:&KiD\i7V17%Aitu%7§:7%B%E%Kx
`
`?VifiT5CkfiW%K&6a$%Tfi\C®fi§fi%flX§#6fi%T6fi§%iT®fifl
`
`(%fi&K§6wtfi§T®%Ct#B\fifi§fi%fi&W$o
`
`E7Kfifi%fi%fiEmUTEE®N/fi7EfiE@EL§fiLtWE%ToEmmuswf,
`
`wxfifimfiG(:®m£&N/avfifiwfifififitws)#6fi%®tb@EE%%btt
`
`?%t.EEfi®N/fivflfiffi,i7§17FAd§fifiE#6flEKLT6fiUEMW
`
`Elbflfifiénfwéa—fi.EE%®N/ivfififu.17V17bzAfi£$fiE#6fi
`
`IEO: L'C0f3H7E{R|J(1§£E‘i C)b:%a5§'2é<:rLrwz»., %L'C\ 7£E}$J0>2~"/avtlflfiin ¥E,I.‘—i&4=»IL~
`
`Kfiflflbuw,Eamon/fivmfié.fifi%¢buEfi%EbuwEE§%rz?v¢
`
`%E*J'6:tc:Jt V). %E€ri‘é:rLTw2:>7r7*~‘/"17
`
`I~ Aifi‘IEiE*.c1i::’Eib:EEE‘<WLTE.:‘cZ.»o
`
`
`
`EBH
`
`Efim
`
`Q7 flfi%m§fitflmLtEE®N/avfifiwflfi
`
`kn.t7V17bifwEfi&fifi3fi§fitw%%E%foEsmuswf.Efiflfia
`
`71'7"‘/‘Lt 7 F A ETVDEEEE AO=a\ Ifilfiiiifi C’O=L. 3}ZTT§'{’:a'§;§bCfi1'Z»fi1‘T§-¥E§fi].éC’OA=
`6‘%7§17bAKfi?éfifi§fi%fi4HCA=V&T%t\
`
`®fi%#%%o:n%§%T%t
`
`a= Lsinfi’/sin( 0’— 0)
`
`tan0’=sin6 /(cosfl —L/a)
`
`
`
`%m§fi&§EL.N/?7E®tHm6H%o1o%®fi%EKfiL‘fi$Ltfifi§fi%fi
`
`EWWLT\N]57E@®fiE$b€flWEfiokX?V%fiE%HLt%%\EELTW%
`
`7&7“): 7 }~fJ“:EbCE.:‘<.»?a C. t C: < \ fifi%!§7b*‘lE'$‘b:fi‘IE§nTInZa tv>’)¥«‘‘:i5'E€'?%=f:°
`
`& at»
`
`$fiTfi\N}37E@€1?V1fiT5tb®N/§7E@®£flfH\Sl$N/77E
`
`fi®§fifiEKowfflNto$$EKl6&.fi%fi®flmfl¢&<\fi%&fi%%fi%€f
`
`Kfi%@®%éN/37Efi®$&tX?vififiW%Fé5o¢Eu‘w<O#®fififiWK
`
`fiLf£%un/3vE@&x%uxfiL\%®fififim®N%%#E%KEi&15u%E&
`
`fioTHW75fifi3fi§fiEfiWLto%LT\@%hfifi§W&flfi§fi%fi#B\fififi
`
`%EfiwT£T®fififiWKfi?afifi§fi%flEfifiL‘N/fivflfiufimdfitoL#L\
`
`i7?4fiW7U~®fimf%6n67U—N7%w®k§ét%X7#6#7V17bifm
`
`fi$tw§%\inn‘$&LtEEmN/avwfiwfiwéflfliactf,mfiéfififio
`
`Eflmflfifi%f%6£%i5n6oé6K\fi%fi#%®2?v%fifiHf&<.m$§fiE
`
`fiwafiaonx7vE®®x%v¢fi%%&m%%tLT$HBnao
`
`iiifl
`
`[HWm%:\%m%%\EfifififlF%fi%Efi%K§5<%§?—7tCG%?W&fl%L
`
`tfiE$%o$fiJ3%iE@:y77vyx96%i%mpm43amw%.
`
`[2]Leonard McMillan and Gray Bishop rP1enoptic Mode1ing:An Image-Based Rendering
`
`System] SIGGRAPH95, pp.35-46, 1995
`
`‘
`
`[3] Hiroshi Ishiguro, Masashi Yamamoto, and Saburo Tsuji |’Omni-Directional Stereo] IEEE
`
`Trans.PAMI, Vol.14, No.2, pp.257-262, Feb 1992.
`
`[4]itEEI$ Ffiifir7J2\"/ -7 VJ %¥'l§$fiiE4§$%E£ V0174, No.4, pp.354-359, Apr 1991
`
`
`
`Uiffififltfifltfifi VCR97-13
`(1997.
`11.
`27)
`
`%"§5t°7""7fA’ri'CG§FaE]iCE11‘£‘c‘< t“7‘:H5H%'7 vr — 7 JUL-
`
`EH mun we —fiE*
`rkfiui Em‘:
`*NTTfififiEfi%m
`
`$EE?imm§EKEM§fi6:kK;DE?%fit~7x»—%$5K$fiL,ifiefi
`
`flatU7»?4A$m®mMm&@t#Efi%Kw#Wfic&%:tEfifiaLt%&©»—7x
`
`»—&%fiLt.fiiiifibtfifiififitefiut5fix~7xw~&,E$§#E<fiE%
`&ifi§E%fi%L¢tmU7»;4Ammmmfiuxaa»—¢x»—&fiEm%%Kfie#%:
`hf,IUfi%%&fifififi91?A&fi%?6:t#T§tJm§EK¥§E?i%Efi§%fi
`fimtatbo/—Fnx%?w&%$L,$&én5§Ev+U¢®fifi&%®%kfifi®fiE.
`
`75iZ)“ENiB‘J7§t%%7‘I‘?3EL:oIn’CE§B7O=b: Lt.
`
`A Visual Walkthrough System Placing
`Real World Video on CG Space
`
`Tamio Kihara*, Go Nishjmura*, Kazuaki Nakal<ura*
`*NTT Information and Communication Systems Laboratories
`
`Newly developed visual presentation system provides visual walkthrough to
`users that coupled real world's video with 3D—CG. The system has an authoring
`subsystem to make the walkthrough-path and its video-linkage on a CG space and
`has a player provides the presentation can switch the video-walkthrough and the
`realtime 3D-CG walkthrough. We proposed an architecture of the software and a
`structure of space scenarios.
`
`1.
`
`IIUBOLZ
`
`fifi
`
`:nict,;ge?i%®&i¢tLtfi
`fififi%fi5tbK,E?#®M4N—x?4
`
`7fifieE%Lr%twu.E?¢mfitE?
`¢%fit®%E%,E?%&&&%mm®x?
`
`(2)%EE?#MfitU7»94A$m®w-
`
`ccwat ybtifiifififiazwiaéfi $12
`
`r&b:a&fi&tLtmfifi%fifi&E%u
`
`:n&%§Ltfifl%&vx%A&fi%Ltw
`4]
`
`47’t0)l3§fi'$:%Ef;T1Tfi€b:l,f:V),
`
`l:'7“’fl’WHi
`
`$ficu%t,:ovx%AK£wr&@v
`
`1-axwéeifiragfitaa
`(1)/—FNx%?wK;5§fi9+Ui®%
`
`E (
`
`2)§Ev+U¢m%kfifi
`
`Kowf%®fifi%%B#KL,EWW&¥§
`fiEKowffl&%.
`
`oEm%®tom5on4n—U>7mfi%fi
`
`fiW%tT%:t&fifitTavx%A&fi¥
`Lfét.
`
`%rD?£, ?.:tL6b:1Jl17l'C,
`(1) %"$1£—?>rB9&f%;=5:cG§F£e:E1fiéez.»:
`tKi5E?#fi1—7Xw—®§%&$fifl
`
`
`
`®%@K%fiLr£<.fi$fiKu,flim§
`
`%fiK3wTEfi@Efi%%fi?%&,%wfi
`fiKfioTEfi&wLuEfiLt$EE?#@
`
`%%fifi$én%;5u#a.:nu;b,&
`t#§fifi%K%%&$flLt%%&fiC;5
`&%®%%##%@fiE?#¢x—7z»—f
`$5
`
`fi%fi$%$ELtE?#u,fifl§fi§#
`
`f&é.E?%¢t—7xw—u,fi%k$g
`
`K%®%fi~fio1fi4&$%&Efi%#éE
`
`fi%1—WK5i%CtfiT$5.fi%Lt%
`
`%L#fi$f%&waw5%fifi§w$E$é
`
`%é5fi,%$E¥t#fimfifi§w%#§@
`Emfiuflfivééw
`
`2.2 smcemfitwmé
`
`—fiv,U7w94A$mmmcGuxa¢
`
`¢—7x»—a@®fimu~&flL1§rwa
`
`%®fifibm%%K£$LT3b,Em&§m
`
`(1)E?#fix—azw—%$fiL,$mo4
`V777vaVfi%%fifi.
`
`(2)E?#¢¢~7xw~tmMm¢x—7x
`)v—r7)iE4R*JJ§7b*FIEE.
`
`(3)§fiw§%o$fiE%&E;—w—fi&fi
`‘J .
`
`§$Wnu,%%&&t:5fi§%Lrw5
`l5K§§fiTEfifiM?%%E?#¢*—7
`
`x»—%@&&fiT6.:nufi%5nt%%
`
`&fifi#5:z#v§amavéa.%$E?
`¢#&w%mu,mcGu;5v»—¢x»—
`
`R@&&#L.E$&§mfifl#v%a.oi
`
`U,%5E?%Kl%§fitwCGKl6§fi
`
`&&WfiK$fififi<fi¥L,%§E?%
`
`flfi#fiETéfi%Hflu,U7w74A$&
`mMMm%@fifi%T5:atfa.
`
`1—WKHLTu,W—®¢4VF¢WT,
`%§E?itfiHm0R%&E§®fifiT§fi
`
`m§fi§5;5u1b(m1L ¥§E?#ofi
`
`1. l:“?‘7ffl9&1% (ZE) &:CGfl5H% (E) OWJEE
`
`
`
`%mmm§fi~£$T5t&
`é%wm(m§fi#6%EE?
`
`1ofi%«fiA¢%t§u,§
`WE%tE;—(fitE)2—
`
`fi§%6.oiD.%EE?#
`
`ofi%&fifiLt%%o$fit,
`3DCG§EK£U%fifi#fiE
`
`tfifiénaxétia
`
`2.3 77u—¥
`
`#—#U>7v—»
`
`yr.-I->+-)2
`
`3DCG¥i‘Il«
`E???)-7 |~
`
`k§®%tEv,%$H?#
`
`(2)E?%fivb774»
`
`o&fi&jW%mm§EnvyEy7L,E¥
`fi$%$%KfifiT%fi%fifibhTw%.%
`
`hBKNLT,$>x?Afd,&<iTéE
`
`?#wx7u;Ufi%Lt%%fifiw&fiu,
`fi%&mI%%f,%miiE?#x+U—A
`tLTfi$LTfifiT677n—+%tot
`
`:nu;buTmflfifi$a
`
`(1)%§E?%ofi%fimE
`
`%EE?%&@%WfiWLtE?#w7b0
`
`774W¥.—&®fi§7—wfW&T%.
`(3)§Ev+U%774»
`
`$V2?AEfi®fifififi#6&5774M
`
`i—#UVVW—»u,:®774w®&&$
`&L,MH£%?»774»PE?iWvF7
`74»Kfi¥%mi&w_
`
`%%&mh%E£fiLrE?tfi%T5:t
`
`4. $73!:-?'>ra>cG§Fa‘l/\0)fi11
`
`tL,7v—Afi®fifi9fifi?fiEfifi¥®
`?—7fl§%fib&w.§Em®¢flE?it
`
`‘xiimvdufflw.
`
`(2)$%&%—%U>7w$fi
`
`%EE?%KfiT%fi§®fi§flE$fi$¥
`tc0>’C‘/W F‘) ‘/7‘z‘P‘§E;.
`$F‘1EI‘J>:ci‘I1%’?-5i7)*“7:c
`<1$t—#uy7fiH%.
`
`H)Iv§flm&fi&&%?
`
`$5E?i&§iE<7vEV7Lt0
`
`L&mtb,m4wE?%%fiwWfi%LTTV
`
`§fl%&fiM&%T.A%f¥oTwtD.$
`wmamfimorwraw.
`
`3.9Z?Afifi
`
`9x?Afim&fl2ufi?.€¢tLTu,
`
`%@E1—Wufifi?%7v—rt,#—#U
`Vfv—»t,:V%Vv#5m5.:y%>
`
`vu,mTw774Ȣammzna
`H)3Dco%?»774»
`
`(m§E%fifiLtwCG0%?»774m
`
`"fl@fi¥7*WTWET%.%mmwmmfi
`i’C’$:H3ln7*.:.
`
`4.1 E?1¢1—7z»—®¥fi
`
`E?i¢:—7xw—%%fiT5tbnm
`(1)%&%&fi%LtE?1wv+@£%m$
`fifi
`
`(2) 5}flm::swTf£5S*:'9‘z>$ifi¢7> l:'7‘=2*7v ~y
`#%h?hE®fiWKbt6#
`
`1~
`
`&%E?5%¥fib%.ki0€?¢wv+fl
`
`fiwEROfi%&fio#,1—W#5®%%#
`
`Ftivfijawotéfivfibnatvnm
`§fiM$fi%K%®x5&i$Efi&H5Tn
`
`E3./—Fmx%?»
`
`
`
`4.
`
`2
`
`/— |~'1\'Z-'E7'-’J|z
`
`/—FE&%sfi%&fi%Ta.:wfi%u
`
`¢vx%Avu,$Ee?¢mm§fiuim
`
`£otW%—7Zw—Rfi®E?ifi7bfi%
`
`§%%tbK,%%%fiT%7§17}T$%
`
`fiHHBh%.E@®E?tfivF%WELT
`
`Nxt,fiH&fi?%7Vx7%Tb%/~F
`am§EmKEET6:tTE?%¢t—7x
`
`fiO.$9X?A?fiAfi§EKfiH6NZ®
`
`&%0Efim&E%®%Eufib&w.m%®
`
`»~wfi%&E%L,:nKE?iwv+&fi
`
`/—F0$%%mfi#5:ar,%%%¢®E
`
`gHHt.:wfifi%/—Fnx%?wtw£
`(max :nB®/—FNx%?»tfi%fifi
`
`%w£&%m%.
`/—FtMxu,%—#UV7%Ku,w-
`
`m,§E9+U#tLT¥fiéh&
`<m$E&%wiififi®tb®fimtLTfl
`
`m#%.fi#u,Lfiw6Etfi%v$EtL
`(mi
`
`CG®i79;7P%®%®f§U,E?%fit
`
`—9xw—wfi%@fifi&EflL%<L,fi%
`
`fi%Eb5@n&Io(H6L 7D—VTfi#
`7"/H7 1~ t L,'cc:.*§’.’.%té:I'L>&\/=.
`.::M:J: V).
`
`(1)%EE?¢fi%fi®fiflK&w,¥ELn
`/—F&EE#&.
`
`$fiM&m%E%§k%fEfi%vfi%&t—
`fivvifiififiét
`
`(2)/—F%tn2ERET%.
`
`(3)/—FtNxnHmT5E?twv+&fi
`
`4.3 £E9fU#®fiE
`
`fififib
`
`§mv+Utm
`
`&w5%—%UVV$Mf§E9+U#&$fi
`
`(1 ) / ~ F2:/\"Z0)3D-CG-'E'7')lzt Lrawvr
`
`#5(H4L
`
`xbvfifi
`
`
`
`
`
`
`
`/ — I~“/\";<0)#§¥
`
`(2)%Nx®1>bUwK%®W%0/—F®
`
`Efiiiz.
`
`aaem
`
`(3)§/—Ft%NxoLy+UWtfifiHH
`enta?twv+w774»z
`
`n;o1§$%uufi&én5.
`
`:numi1,fl%fifivfifififl$,n4
`N—UV7fifi%fitfi5%%m%®UV7fi
`
`fl%§€inA
`
`%fifi$fiuu,:m§m9+U#&iu%
`
`&%k
`
`(5)EfiL1&fi®E?iww+&fi$?5.
`
`oiD,§mv+Ut&%%fifiT5:an
`
`:of,EE%KE?%¢t—7xw—wtb
`oE?¢wvrwmEw%%$w+5:t#v
`35
`
`i—#UV7fiKfi5©u,/—FtNx%
`
`<m%fitEEL,%h?h®#7V1fiFKE
`?%flv+%fifiHH5£HT$6.EF%fi
`
`v+fim£fifi%&%fimKEfl#é%¥u&
`
`(1)E?#¢t~7Z»—04V7779aV
`
`U‘.
`
`/— F/\';<«“:-7’M:J: I9, %0)E$‘:!.=<7)E1$
`
`(fifififi)
`(2)E?#¢»—7z»—twcG¢»—7x
`
`fi%t,ER®tbwfiWfi%m<m§EKE
`fiT%:kf%ET§t.
`
`»—w%fiw§fi®§EE%tE;—®—fi
`
`tfifi.
`
`5.§fi9fU1®fik¥fi
`
`E¥1¢x—7z»—w4>a579
`
`5.
`
`1
`
`SD
`
`5.2 §EE?#&mcem7Uv7
`
`1—Wo%fiKxor,E?#0x—ax»
`—twcG¢»—¢xw—wEfiw§#?5A
`
`:wfi,§E$%&E;—m—fi&fi5.:m
`w%&m@o7Uv7tW&
`
`(1)E§m—&fiE
`
`E?#¢¢—7x»—fu,uT®$m%fi
`bit
`
`(1)§%NxtfififiUBhtE?#fivb@
`
`Efiwxafifihfifififléfiorfifié
`
`nt:a&mfitL,fiww$E&mw5.
`%EE?twE$¢mm§fi«&H%t§
`
`fi$fi%b5t%o%%/—F?1BmiA
`(2) %t7)/—-l~'¢‘:fi£E0)-J71‘)! l~‘)'l%fi7b‘—§C
`
`£<m§fi#5¥EE?#®fiH~fiA#5t
`
`§Kfi§oH;—&—fié%%tbn,nxw
`
`#6/—F&21&$L,:n%fi§tLrfi
`
`Eé®w$%flfiT6.Wim,E?%wvh
`
`fiféflzéfié.
`
`(3)%m/—F&¢btLtfifi®v#xbU
`
`fifim6fiant%n?n®fi®@fifi%fiT
`
`fifi%&74:>u;or,1—Wnuxw%
`méfif.
`
`®fi$¢K€7v—Afi®%%#fifiLtfifi
`
`'mm§EK£mT5t%u,nxofifi®o%
`oa:a@$%u&H5(E6L<m§E#6
`
`fikttmfimnxwfifioonmtcafio
`
`t%€,E?#fiv}®£7b—A&O%%i
`
`(4)%®/~Fwoflm?%fiwE?%wv+
`
`f£AE7v—A&wt:a#5E?¢&E$
`
`
`
`fi¢a:trnxK£Av$5;5u?%.:
`
`J: V)iE[\/W3’)
`/\';<«\(7)EEE’E’E%+§L,
`02: ii,
`®NZKEfl%K£l§fi5:k%T%E.N
`
`xo£fifimu£5wufiT5;5&fi%&M
`
`bEA?6.é5nxm£wrEtBW§®£
`
`fi&@%E$?5mu,nxKfiALtt§®
`NxKH?aflEu;o<%E#%.
`
`(4)§§fi®t%§
`
`/~FW®E?%fiv%u,Efi¥Efi&E
`
`®fiw%§E?if&6fi,%%§fi$fl%#
`
`5.oiU,/—Ffib5k§é%fi:,fi%
`
`$EK%EEén5#,§§fi®k%é$E%
`ofi&E#6%io<<%.§fiv+U%u£
`
`wr,:@/—F®k§é($&)&/—Ffi
`K$Ev%5;5KLt.fi%u?7»»b@
`
`&%o./—Fwfiv@§EE%&E;—m~
`
`fifi&Eb6tbK,:®/—F¥fi&%gL
`
`f:§tH%fi‘aTlz>Z>.
`
`6. $5bU(C
`
`;§z?¢&@mm§Euzm5&a:zu
`
`xbE?%¢x—7xw—t§%t;fiL,$
`
`EE?t%fi&U7»y4A$momH£%&
`
`tfiEfimuw§Wfiv$5:a&fifitLt
`
`%@fi%fifia,:n&¥%Ltfiflfiflv1
`
`%A®fi%uowrm&t.fit,/—Fnx
`£?»u;5§fi>+U%mfifit%@fikfl
`
`fi®fiE,&wEW%&%§fiEuow<%e
`
`V
`7N: L7‘;
`$vx%Au:nm,$3e?1&¢btL
`t§E%fi%fi%&&$fiT5:t§Wfif%
`
`5.fiL<fl%o%r&§mw$E¢,%—v
`
`/\'}'(Wl:'7'"7J'7)-7 I‘
`
`571;;-giggyiftfl
`
`CG§l'§i)‘-‘2iE)\
`
`E8.NzA£A
`
`K:5mD%b&fiotb,fi%uumELT
`
`&W§EE%E3%tD.MHm§fiK£WT
`ufi%mufiEL&w§ov;abtL
`
`ffiET%:t6W%?é5.fi%$W,lU
`7$W%w%EE?#fifi®fifl§®5éfifi
`
`%m&fi£n,fi%flwfifl$Wvz?AkL
`*cififfiL'cw<¥ET*&7..».
`
`%%Ifl
`
`FEE‘
`[1] ifiEEIfi9E.7i<}EEfi,/J\%5)i.4Z"nEfifiJ.
`fififi®tb®E?#A4N—%?»@fi$J,
`
`Eéfifi, DE95-35. pp.65-72, July 1995.
`n]$E§%$EEw¥E#%%w%%¢%
`¥,FE?#M4N—X?47®fi%$W>1?
`
`A fTakeMeJ «o)m3fi3J Jfifiwfifl, 96~DPS,
`pp55-60. May 1996.
`
`[3]*EEfi#Efi%§fifi%¢%¥JE?
`%v¢—7xw—tN—++wU7U?4&fl
`
`%é%t7»%X?47-7b€V?~9a7
`
`“/1-TA] .'|‘§#fi}ffi.97-DPS-8o,pp163, Jan
`1991
`
`H]WE—E#E%%$EEfiJ%EE?%
`tVR%fi%Lt%fifi#—7xw—vxfAJ
`
`%55Ifi1'lEfl&2LE¥%$l§1i<%, 3-44s,sep 1997.
`
`
`
`4bi.*Ea§‘Iifla‘43J¥§‘€% VCR97-14
`(1997. 11.27)
`
`iliilffifilaai L: is H 6 E%0)§iJf’E0)2%iE$‘}£
`
`2i.<EEl¥fiJ'LEl5 7k1'\‘lr’-=‘:i35I-
`
`iC‘}Rli_é‘7a‘ iCEE§‘}é:‘ l?h’lB3.i§- 1l‘£"F‘}n“al
`
`Efi%fifi$flI$%
`
`E-mail: honda@myo.inst.keio.ac.jp
`
`$ficu,AE®mfiK%EL,fl%fifitfifi§m®¥+v7%flb6$&&fi%#5.fifi%EKswr
`/VN—Nwfifi%fi§L,fiE§fiT®%fl&lDfi%&t®tLT%Eé%%tbK,§¢®xyNm7
`
`N5'i:§;;<)§b (*‘/°17v7"v)’i’i%$EtL’C3‘$f:*tl', 2‘?//\‘fi:li€)E€)‘.é';'\n:!E:L:’7‘~°xa‘/, Auras.-L:Ir—
`vay%$®bUfiwE#&%fiLt.3&ifiE§EtLT,fia#:nicm%&fi&or§tfima74
`xvnwmmemw,i74XW:iz:&—va>u%mL;vx%Aefi¥Lt.iffifiofifiéifié
`aa—$EtLrFE¥JKEEL,E¥?N4x&mwtfiEE$&%fiLt.it,flE@®v1z++
`afiemmiacauxb.fi$®1~W0fi%efifi%fiE§fiLo7n9ufimLt
`
`A Way to Represent the Actual Action in Virtual Space
`
`Shinkuro Honda, Takaaki Kimura, Takaharu Ohsawa,
`
`Kenji Ohta, Ken-ichi Okada, Yutaka Matsushita
`Faculty of Science and Technology, Keio University
`
`E-mail: honda@myo.inst.keio.ac.jp
`
`In this paper, we pay attention to the human action and describe a way to solve the gap problem between
`the real world and the virtual space. We try to support high quality communication among the members and
`
`provide triggers for informal communication by letting the avator have gestures for the member’s information
`in a virtual space. We use a virtual oflice system “Valentine” for 3D virtual space which we have built before,
`and have built a communication system for oflice work. First of all, we pay attention to a handshake and
`realize “virtual handshake device” for the way to make users feel virtual action. Secondly, by applying the
`
`spotting recognition of gestures from time-varying image, the avator reflects user‘s state and action.
`
`1
`
`Li um:
`
`/x“—*/+)1«:t‘/t:“;L—5'0)E5iEl|:*?, 7'57 4-17
`ififihwfituxn,3%i:yea—77774v
`7 ZKJ: o'Ci’Elv3Zéhf:i£i?*E.?§“;Fé3’«i’$'J}i§ l,f:7’7" ‘)
`7—vayfi§<mfiLTwa.mct,:s1:
`7—va7%i%L,%E%K%htA#%fiE%K
`mébfif, iLi3‘§.E‘J§C3E:L:7‘»f€’i§;‘i"éL'C1‘T<.‘§il§
`
`Mifitmarisn, ?£E’$:i4§lFTwZ»[1][8]. can
`em.7natWwna1—fom§EfiLrfiE§
`
`l’E5Jl'C‘”3i3fl’i’i?’i<5‘i%T‘i57->.
`—fi,Eo§w:a$v—vay&$fl?5um
`ABEKNE J: (Efi¥T7.>f:3f)0)fi'§72<II E :L—‘l’f—“/ a
`V#%§T$%.3E1:#—7aVufiE$Efl%
`fi&?57ntxcbD,§&én5%fiKu1$c
`§fi1*§62\“~A‘;v1§%t, iii ma, ~‘/*1;<—Hv
`
`
`
`&aVfl,§$%K?4X7V—K§fi§n%$+5
`
`77K;6%btbTfibn,/>N~nwfififi
`kWLTw5.fiE§E&mwt?7U#—vayK
`
`swf%iT&5t,fi&vu%%vHAEfitwo
`7’:'I%$S':L;t t’€)7’7"‘)#—~‘/a
`‘/1*M£1~’?TZ>:. 3:7)?
`
`InterSpace[9] 7) I ’) CC§JEf¥%}fi\r‘7': §) 67)
`’C“§ 7.2.
`THifi,E®fl§&E®%fi$%Bn5#,7N
`aflAEELm%%LTw&wtbK,§¢WflW.
`¥¥,%fltwot%fiub#b§5w.itfiEfi
`
`&fifiL&uwfiiE,an%%nu,§%,E®fl
`§ti7I97fJ=l‘o7:c\«=fl*, 7’1<5'€)if37)“AFafib:;}2'§‘b:iE_v=f;
`bK.%¢WflW,¥¥,flfitwotfififififiL
`PTw.:nBu7N7%EfifiAKfix574XL
`
`714), Community Place[2] 0)7]'37"' »f 7' 7 ‘J 3 ‘/§"§='(“
`i%‘é‘fL'C\nZ>iJ§, £E1ii’C*ci7zwIi$L:%¢))\fF?E
`?$6mtw5:kE%fl?5tbfiHumw&n
`Tw6twof§fi§Tu&w.
`
`%:T$fi?u,fiE§EK5wT/>n—nw
`
`fifiEfiEL,fiE§m?ofifl%lDfi%&%t
`LT%@é%5tbu,%4mx>no7nyu§fi
`
`b(71x++)%fifltLffit¢,x>nmmE
`0Ew3EJ:#—9aV,&U3E;:#—9aV
`%$mbUfi®fififiE&fi$#A
`
`2
`
`151571‘ 7 1' Z Valentine
`
`fi&u:nif,E$mfi%mtb@fiE#74x
`
`?X?A@fi%Efi&oT%tMM.§%Bfi%E
`Ltvx%Av&6Vmmmmu,flE%KfifiLt
`1~W&$v+7—7LKfifl%ufi¥Lti742
`
`K$%é€,%Cf@®x>N®§Efi-fifiéfig
`L,3E1:#—9a7%i§T6vZ?AT$b
`
`cf, Eéflflvmfcb, ?E¥’&'§‘6c‘;lno7’::ki.7*’:‘i:'5x'E*;
`2)>of.:.
`if:7’/\‘57l:B§L”Ci>,
`ftEf7)4bi?*.§.§fifi“/Z
`?AtfifiKAE®fiw#I&&%f&ot.E1K
`Valentine 031%/-2.33121 E’/'T<'§'.
`
`
`
`1: Vale11ti11e 0%?
`
`3
`
`1E?'3i§F:fi£: EH 5 ifiiwibffifi
`
`E
`
`:nifm&r3t;5u,fiE§Eusw1,%
`flfi?fi&bn1w5;5&:i;:7—vay%i
`
`$§‘§‘Z.»f:am:&i, %1L+3?~«7>1%$Si(1R%, ME) WU) 523
`A%h%1—W—KEfiT6:tW%¥T%6.:fl
`
`ivofifivu,fiEvay7gfiE>a—w—A,fi
`ENvFtwot§®Kfi§§h%lfl;fiE§fi
`K%&fi017v17+,$%&%fi#5,oibfi
`E§EK%fi$tfit;5&fi%&5i5:tr,:
`E::7~&ay&i%Li5t¢5%A#HtAE
`
`
`
`’C‘§)o7’.:.
`
`3.1.2
`
`‘T5/\"fZ
`
`—fiyEEm®fi%FmwBnrwa7nyuxy
`N#E:%WwTw5mt%T&%,3:wxyn
`
`&%%?6&flL#%tLTw&w.%:Tfi¢u,
`ffiidzfiifiifij t f3F§§§1%$&J a>:oa>1%fi’.~*:7n'5v
`
`&fiLT%#T6:tfi,1—WE®E®Em:s;
`:7—9ay&$fiL;5t%&A
`
`3J Mfififi
`
`3JJ E?
`
`&e@aifi¥Em¢?fimufihfi&iffim
`
`fiH5®fi,§M(mmmv&5.mA®vN»r
`bAfi$¢tLr6,fi$m<E6n,fié§fi&E
`%¢%F&5.Afl®fi§®¢v§flfiflm¢bn
`$5©u&$r55.:nufi§§#o§ggflm
`&%Mfi§fi&a.&#fé.E%m&§fl&L1.
`
`fifiw-Efi%&#%tLTmm6hTw5ML
`
`%74xmr%¢Em#fi&bn5%%u,Ew
`x5&%%#%%ir&a.E&W<flWu,Lfl#
`B%l$T'\0>l)3fii L“?’lioGi"E¥§l7‘Z> twofcc 2:7b='I
`
`r,ET#5BL«mfi¢tL1u$$b%i5n
`&w.itfi¥u,%§&Ewtbu«Efiu§io
`t%u&$&Lr§bsntb.mHmoAtofi@
`
`’$:i>’§ab7.> fcabmffii é hf; V)
`f: 017.».
`
`, Kéilfiiiéiflfiblfibéh
`
`$fiTuJE$Jtw5fiWKEELf#iTA
`a.:®flW%fi§»74xL?fi&5%u,wi&
`77xfx:;—®¢#BFE¥E?6J&w5fi7
`y%%WLT,Efi%K7Nifii%E$é€tkL
`
`T%,fl%®1—f—ufi$<m&wtbKfi¥
`E LTK/‘Z>%l?E3: tn-3 ¢)0)7)§!?_,.5§L‘L62fL7§c\z\. oi D,
`fifl§ELm7Nytafia%®mW#~fiLrw
`&wtbK%@flW<m6$flfi%6n&w®
`F55
`
`E$u,%®A®EEE&#E%%Kflh%5:t
`KioT£EW®%fi§E#b6&E%fi&5tbK
`E¥&&%&%tLrma.$Afli®%fim%Km
`z,%®E$&Erw5A¢utorb§%wé6$
`mfba.w2m,E§fim3v§fiWi#fi$%1
`a:&m,@®mb%§ntor6k%§%fi$5.
`
`%:f,E2ufiT;5&fi$&?N4x%&mw
`a:t?fiEm&E¥%I%$J§&I5t%it
`7’/\°’fXli, Ha.nd¥'I$<‘: Face ‘§l$b.’.fi'7.I‘2"L7.>. Hand
`
`?N4Zflfi¥®$%fifiLt%T&U,E$®%K
`%n&Ea.mmHufi¥®7NaL$%&mLm
`T?4x7V%fbD,fiEi74xm—%<fi
`¥§n5.Hmd%uutyv#mDHHT&b,E
`
`¥<w6#E5flxE$®%é&%flT&:tfl
`&%6.E$&¢5t,fifi§fiW®7N7f$%§
`L$f.3Ew®¥fl%Lméhtt:affifl§fi
`LTmE¥#mjT6.?N4x&fiLT§:A®x
`VNfiEEw®7N7%EE¥%§bTCk
`
`fiw¥5.:®:au;D.E$ELt$Afliu&
`
`$m%m&fi5:tfiv§,itEboAEb%®fi
`¥%,E$iLTw57N5%E5:tK:D%%?
`§6.E3t,fiEt74xWT7N7fli#E$%
`L’C\nZ»‘I/——‘x’£'7T<*i'.
`
`¥#0)f'JRi€0')5F
`
`I21 2: 1E¥7"/~*/rz
`
`E¥?n4xm%fi%uTE$W6.
`
`. 15i2tf§.§b{’E(7n°5vo)flf’E) tfi%0>fi1’E7)>*—¥5<<rz.
`
`>.FfituufiE$Lt:tfib%Jtw5x5
`m,fimwmm&#u%w&m§&5za:t
`7b*ifl5E7.>
`
`-¥%%T®%&tLrw&fl&%tTWflfiB
`55
`
`&L3
`
`ik
`
`&$?nXxu,vu:yvfl&mot$w%flu
`MfitV#%flb£Afi$®&fiw5.MEt7##
`
`
`
`
`
`In
`E3:fi§®%%
`
`B®fi$<w6#w&m#tw5fififi,fiE%
`
`741vx?AfifiWf67—7x%~9aV@m
`OmK%Bh,7N9®fiWKEm§n6.:t?N
`
`41KmEflty#§Eb£&,Ewfi&®fi?E¥
`?N4x&Eota#,tw5fififi$5—fimfim
`fiKbafi¥?N4xKfi%énEhuE&éna
`oiD,E$?N4x&fiLTfi$flE®fiEwflT
`E$ELTw5®#tw5:t6%m?%&
`
`3.2
`
`'a‘E'§§§1‘§$li(§x12E*))
`
`5§.7Uif7)fiI-§7l‘7 41 (Valentine) Ki'o‘\«\‘(, 5'F:L’.ifl
`&t#§%fifi®fiEKowT%iT&6.fi&®
`
`wmmmevu§xvNm%Efifiu,vw+#+x
`}§flfi§k®jyfl®mEw%Km@T%mEfi§
`nrm5tbu;fiAE&,%Enomr§1—w—
`m%%T%5.
`
`it,§fi.Ewfl%uom<u,fi#xVN®fi
`tL1mwenrw5fimEm%%u:nBm%fl
`fififif%&wfi2A®x>N#EE%W§$at
`
`%%KflE@E%##$—bénTwé®T,%@%
`aumbcnewfifiufifiéna
`
`fiflKowTfl$$EWfiT6E¥?N41%fi
`wfiET6:tfiT§6.%¢MfiW,§¥,flfi
`b:o\n'C&.1fiI£'c‘5iabi |91§fi7)<€i:rLrw>:cwi2*
`
`7n9mfi§KEm&#t€nm,:nemfifi&E
`ET6:tHW%T&&
`
`%:v$fl%vu,#§%fifi®¢ffi&EvuE
`
`fiéhTw&w#,%fiWfiT$65t#iEh&
`%¢mfiW,§%,wb@aAm®r%fibJJfl
`§JtW56®KfiK%EL,:nB®fifi%7N
`7&#LTEET5:tu;oT,fifii741Tw
`J2 V)f§‘73E‘«‘-'3 3:L—‘—#-“/.=J ‘/$5,, 3 E 3.37’-
`va>®%o#H®&m&aA5.
`
`$11 ifififi
`
`/VN—NWfifi@fifitLT,:nB®fifiu
`
`E%m&:t#$W6ha.oib,1—Wfiafi?
`afiE%0fi§&¥fiAfi#%oru$E%K&oT
`
`Li5.1~Wfi$Efié&flt6:t&<,:hB
`®fifiEE§T5fi@KH,3VEi—7L#BEfi
`WK1—#®fié-§%EfiflL7N7KE%Téfi
`
`E#%§€&oT<%.Ch%%fiT%tbK,fii
`
`
`
`7#em%@%E@mEféfi&,&wfi4fi?Tu
`%§Lt$¢§0%flWEEmwt.fiL,1-ft
`lcTdAE®®EtLTMKEfi®fifi&fiLt
`
`vntw5%€6%iE,754Nv—®fiE§%§
`T5%¥fi&5®v1—fiK;5$fllfl6#$—
`%fa
`
`:hivK@@%fi®fi§fi,wx5#Bm@@%
`%§L,AE®7;x%r%$&fi&otfi%fi§<
`flfiénrwa.:nem¢vgfi4u@@mgmfi
`KEfiJMBfifi%Ltz£v?4V7a%$&
`&mwt.:®$Em%&&uTufi?.
`
`oE&%E%®%%¢fifi%@KW®EwKuN
`x+fé6
`
`o§xx++®fl%®§flKnnx%T55
`
`.U7»9{AKv;1%+%%flT§6
`
`ow&Wk§&91x%vm%%&fiEKLTw6
`
`$?1?AfM,3i1:7—va7®ifi®tb
`
`K1—¥®fifi(%fib)m%m&flmT5tbm
`1—f®fi%£kK$6fi&®U7wa4Afi#%
`
`Et&a<<5.it,v;x+vmM%JW&%fi
`B%1—WK;oT%&6tbK,:nE®Eflku
`Nxbféa:w%$¥E%flmT5:tm;€fir
`é5t%i5nA
`
`W¥%w§¢EKowTu,¥—£—P-7&2
`
`ofi%$%¥0fi§#6&fiLm,§¢Lrwafi
`U577ZLTw6fiT7N7®ifi%Efi$€A
`
`1—Ww&E®ifiuow1u,E#m¢74xv
`AMuE®;5&fiW.¥¥&t5©#,it%h
`
`%EfE0uw6AuE®;5&m§é§nb0m
`tw5:a&%§#5%Efi#&6.
`_
`C®tbKfikH7NF®flWt$fi%@fi%®
`fl%Ha®¢#6fiE#74xKfimf§%5&uT
`KfiTmfi%&EfiLn
`
`ofibwofwb
`
`. wave» I/C\n7.>
`
`ofiwfmg
`
`o%oTW5
`
`0 Oi‘57§c\/‘
`
`0 ?§HEL‘Cv\7.>
`
`o Wo’C\1‘7.:
`
`it,AE®%fibuAEmfi%fiHT&<,Am
`wfiW&fif%%%$5.$%0AE@$fiififl§
`
`EL@7N&Kfi%T5:tb,:s;:#—vay
`&H%u£b5tbc§§&E$t&or<5.B#
`®i74z@miT1—fWm5flWkLTuuT©
`émfifiiena
`
`o¥fi§T6
`
`ofiffif
`
`oBD3%T%
`
`o$&fi6
`
`:hBO€TOfiE,fiW%%Kfi&t2owE
`§#ea%v§5#u$fl?$5.:nuv1x++
`
`%%u,wfiWfl#mk§&v;2%+&mfitLr
`-80,it#%KwfiotV1x++®%Ww$§T
`
`@zm=e1*a57.>.*%~?&:;t::rLe0)1i<?i%,§Jf£Er7)r’av::
`2;:¢évayufifi&so&7y7—bu;or
`
`§fiL,fiumU,E%fi#E<,%%$flEWAE
`wfifiafiEma%&a&a¥%v&a.
`
`4
`
`i&:w
`
`$fi%vu,fiE§Eusmr/>n—n»fi#
`&fiEL,fiE%fi?mfifi%;Dfi%&%tLT
`%flé%atbK,%¢wxvNm7N7K§fib
`(71x%v)§fifitLTfit&,xyNEmE®
`gw:s;:y~9ay,fiU:s;;y—9ay%
`$®bUfiwfifl&¥fiLt.3%ifiE§fitL
`‘r,fi4#:n:vm%2fi&arstwm%74x
`Valentine ’5:FHl/*, 7l‘7 4X|7<]:l E :L1’7'~“/3 ‘/P1
`
`%mLt9z%A%fi%Lt.iffimmfi¢&$
`mé&5—$E&LrfE$JuEEL,E$?N4
`x&mwtfiEE$&%fiLt.it,fiE§®v1
`x%¥§%&mm#5:tK:D,E%®1—¥®fi
`fi%fifi&fiE§ELo7myufimLt.:m:t
`u;D,fi%fi#&fiE§mm¥+v7&flba:t
`
`&%&t.¢fivZ?A0%§s%m%fi&oTw<
`Ffiféa
`
`
`
`Vol. 6, No. 2-3, pp. 227-250, 1997.
`
`[3] S.Honda, H.Tomioka, T.Kimura, T.Ohsawa,
`K.Okada and Y.Matsushita. A Virtual Office
`
`Environment Based on a Shared Room Realizing -
`Awareness Space and Transmitting Awareness
`Information. In Proceedings of the ACM Sympo-
`sium on User Interface Software and Technology,
`pp. 199~207, Oct. 1997.
`
`[4]
`
`‘)—~J1~—-7’1:r:<+2v/. L<‘é0)J:l:¥>'E)'Cfl: 9':
`x —r 11 ~03 E1 mun. j<i%,<fiE§)E, 1988.
`
`ivy I~ '7~7c::sh‘7.»§fiV)
`4*11‘T.
`IEJE3,
`[5] #1:,
`Eli’? ER? in 7*:fi¥¥*5 0)iz‘:5¥. ‘|“§fi9&EL’$%‘?a%)’E§§,
`Vol. 36, No. 8, pp. 2037-2045, 1995.
`
`iEfi%i£E#$=fii’&H31n7’:
`EH.
`IE1#, Wit.
`[6] EH,
`E&A%K;571z+r®$~fiE@#B®1
`
`£v?4y7%%.§¥fififiE$%%I%JM.
`J80-D-II, No. 6, pp. 15634570, 1997.
`
`[7] $33, EH61, 7|<1=9‘, E183, HT. E%£Ji¥%‘<7>fi571\
`m®fi%&£fiLtfiE7o17$x-7o;7
`ix1~—xK§d<fiEt74xfifi.fifiM
`
`31%;»-‘%.%)‘c¥:f, Vol. 33, No. 7, 1997.
`
`[8] $53‘ WEE. El-’fiilf.‘§t’Lf:iE?l§.ii§<‘ People Space
`WEPUQ/§%?iifi/