as) United States
`a2) Patent Application Publication co) Pub. No.: US 2011/0122153 Al
`(43) Pub. Date: May26, 2011
`
`OKAMURA et al.
`
`US 20110122153A1
`
`(54)
`
`INFORMATION PROCESSING APPARATUS,
`INFORMATION PROCESSING METHOD,
`AND PROGRAM
`
`(76)
`
`Inventors:
`
`Yuki OKAMURA,Saitama(JP);
`Daisuke Mochizuki, Chiba (JP);
`Akiko Terayama, Tokyo (JP);
`Takuro Noda, Tokyo(JP); Eijiro
`Mori, Tokyo (JP); Takuo Ikeda,
`Tokyo (JP)
`
`(21) Appl. No.:
`
`12/908,779
`
`(22)
`
`Filed:
`
`Oct. 20, 2010
`
`(30)
`
`Foreign Application Priority Data
`
`Nov. 26, 2009
`
`(IP) voeeeeceeteeseeneees P2009-268661
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`G09G 5/00
`(52) US. CMe coecccccssssssssssssssssveeseesessessssssssnsnsenses 345/629
`(57)
`ABSTRACT
`
`An information processing apparatus includesa transformed-
`coordinate calculating section that calculates transformed
`coordinates for each of a plurality of superimposed images
`associated with coordinates in a background image, by trans-
`forming coordinates of other superimposed images with
`respect to one superimposed image as a reference image in
`such a way that coordinate intervals within a predetermined
`area with respect to the reference image become denser with
`increasing distance from the reference image toward the
`boundary, a coordinate setting section that sets coordinates of
`the reference imageonthe basis of a mean value obtained by
`calculating a mean of the calculated coordinates of the other
`superimposed images with respect to the reference image,
`and a display control section that displays the background
`imageandthe plurality of superimposed images on a display
`section in such a waythat the reference imageis placed at the
`
`set coordinates in the background image.
`
`Sea Paradise
`
`SAMSUNG 1005
`
`SAMSUNG 1005
`
`1
`
`

`

`Patent Application Publication May 26,2011 Sheet 1 of 66
`
`US 2011/0122153 Al
`
`FIG. 1
`
`ATTRIBUTE
`INFORMATION
`ACQUIRING
`SECTION
`
`TREE
`GENERATING
`SECTION
`
`HIERARCHY
`DETERMINING
`SECTION
`
`TREE
`RESTRUCTURING
`SECTION
`
`SECTION
`
`ADDRESS
`INFORMATION
`STORING
`SECTION
`
`CONTENT
`STORING
`SECTION
`
`CLUSTER
`INFORMATION
`GENERATING
`SECTION
`
`0
`SECTION
`
`DISPLAY
`CONTROL
`SECTION
`
`CONDITION
`SETTING
`SECTION
`
`OPERATION
`ACCEPTING
`SECTION
`
`DISPLAY
`
`2
`
`

`

`Patent Application Publication May 26,2011 Sheet 2 of 66
`
`US 2011/0122153 Al
`
`FIG. 2A
`
`211
`
`ATTACHED
`INFORMATION
`
`IMAGE
`INFORMATION
`
`(EXTREAAREA
`
`ATTRIBUTE
`INFORMATION
`GPS
`INFORMATION
`DATE AND TIME
`OF SHOOTING
`UPDATE
`PICTURE SIZE
`COLOR SPACE
`INFORMATION
`MAKER NAME
`
`MAKER NOTE
`
`213
`
`214
`
`3
`
`

`

`Patent Application Publication May 26,2011 Sheet 3 of 66
`
`US 2011/0122153 Al
`
`FIG. 3
`
`230
`
`231
`
`POSITIONAL
`INFORMATION
`
`232
`
`
`
`ADDRESS INFORMATION
`
`
`
`LATITUDE: OO* OC’
`TOKYO-PREFECTURE SHINAGAWA-WARD
`
`LONGITUDE: OO" OO’
`KITASHINAGAWA 3-CHOME
`
`
`
`
`
`OO CITY SHINAGAWA LATITUDE: OO OO’
`
`
`TOKYO-PREFECTURE SHINAGAWA-WARD
`KITASHINAGAWA 3-CHOME
`LONGITUDE: OO” OO’
`
`
`
`
`LATITUDE: 00° OO’
`TOKYO-PREFECTURE SHINAGAWA-WARD
`LONGITUDE: OO* OO’
`OSAKI 1-CHOME OO CITY OSAKI WT
`
`
`
`
`
`
`
`LATITUDE: 00° OO’
`TOKYO-PREFECTURE SHINAGAWA-WARD
`LONGITUDE: OO* OO’
`OSAKI 1-CHOME GOTENYAMA OO TOWER
`
`
`
`
`
`
`
`LATITUDE: OO" OO’
`TOKYO-PREFECTURE SHINAGAWA-WARD
`| LONGITUDE: 00° 00!
`OSAKI 1-CHOME OO COMPANY
`
`
`
`
`
`
`TOKYO-PREFECTURE SHINAGAWA-WARD
`LATITUDE: O00" OO
`LONGITUDE: 00° CO
`OME
`OSAKI 1-CH
`
`
`
`
`OO COMPANY TECHNICAL CENTER
`
`
`
`4
`
`

`

`Patent Application Publication May 26,2011 Sheet 4 of 66
`
`US 2011/0122153 Al
`
`251
`
`FIG. 4
`252
`
`253
`
`254
`
`
`
`
`~|1
`
`6 |;TOKYO-PREFECTURE:
`
`
`
`
`
`[18|TOKVO-PREFECTURE/:SHINAGAWA-WARD:|!OSAKI-CHOME:[SSCS
`[19FTOKYO-PREFECTURE||SHINAGAWAWARD|!OSAKIVCHOME:[|SSCd
`[20|TOKYO-PREFECTURE!|SHINAGAWA-WARD:|jOSAKI-CHOME:[SSCS
`COOCITYOSAKIWT258
`
`
`
`
`
`
`\ PREFECTURE|MUNICIPALITY BUILDINGNAMEETC.
`
`|4|ITOKYO-PREFECTURE||SHINAGAWA-WARD!|KITASHINAGAWASCHOME]
`
` |3TOKYO-PREFECTURE|[SHINAGAWA-WARD)| KITASHINAGANAS-CHOME| OOCITYSHNAGAWA_
`|2|'TOKYO-PREFECTURE|;SHINAGAWA-WARD!|KITASHINAGAWASCHOME[
`
`|4|TOKYO-PREFECTURE||SHINAGAWA-WARD!|KITASHINAGAWASCHOME[
`
`[5[TOKYO-PREFECTURE|SHNAGAWAWARD] —(OSAMTCHOME:|_COOCIYOSMIIWT258
`
`
`
`|6|TOKYO-PREFECTURE!!SHINAGAWA-WARD:|—OSAKIV-CHOME![COCIYOSAKI
`
`
`|8|ITOKYO-PREFECTURE!|SHINAGAWA-WARD:|!OSAKITCHOME![GOTENYAMAOOTOWER_
`
`
`|9 |:TOKYO-PREFECTURE!| SHINAGAWA-WARD!|OSAKIV-CHOME? |‘OOCITYOSAKIWT|
`
`|10TOKYO-PREFECTURE!|SHINAGAWAWARD]—OSAKI-CHOME!|!OOCITYOSAKIWT~258|
`[11 TOKYO-PREFECTURE!|SHINAGAWAWARD!||OSAKIVCHOME:||QOCTYOSAKIWT!_|
`
`
`14|ITOKYO-PREFECTURE!;SHINAGAWA-WARD!|—:OSAKI(-CHOME!—_|
`(
`
`
`
`
`
`
`
`
`'TOKYO-PREFECTURE!|SHINAGAWA-WARD:
`
`‘TOKYO-PREFECTURE}
`
`CO COMPANY TECHNICAL CENTER
`OO COMPANY TECHNICAL CENTER
`
`
`
`|28|'TOKYO-PREFECTURE||SHINAGAWA-WARD!||OSAKIT-CHOME;[OOCOMPANYTECHNICALCENTER|
`
`
`|29FTOKYO-PREFECTURE'|;SHINAGAWA-WARD;||OSAKI/-CHONE!_
`|30 |'TOKYO-PREFECTURE!|: SHINAGAWA-WARD:|
`
`|34 ['TOKYO-PREFECTURE!
`
`|33|TOKYO-PREFECTURE||SHINAGAWA-WARD:|—OSAKIY-CHOME!—_|
`
`
`
`
`
`woneeSerene Qa
`255
`256
`257
`
`5
`
`

`

`YALSNTD
`
`3YNLOAsdaYd
`
`INVSO
`
`May 26
`
`, 2011 Sheet 5 of 66
`
`US 2011/0122153 Al
`
`Patent Application Publication AWOHO-|
`YaLSnNto FILL
`“VMVOVNIHS00OO:3GNLILY
` QYVM00CO:30NLISNOT
`
`3LSM9}NOILISOd¥ALSN19
`
`
`3zisNOLLVWYO-NI
`
`(NOLLISOdYSLN3O)
`
`NOILLVOISILNAGI
`NOILVWYOSNI
`
`6
`
`
`
`

`

`Patent Application Publication May 26,2011 Sheet 6 of 66
`
`US 2011/0122153 Al
`
`
`
`FIG. 6C
`
`316
`
`315
`
`FIG. 6D
`
`318
`
`7
`
`

`

`Patent Application Publication May 26,2011 Sheet 7 of 66
`
`US 2011/0122153 Al
`
`FIG. 7
`
`OPO®OO®D®@O®®O®@A®®O®O®
`VV/”*—ANyJ4ND
`
`oOoea-S
`
`aoco —
`
`oocNO
`
`Gecoi
`
`8
`
`

`

`Patent Application Publication May 26,2011 Sheet 8 of 66
`
`US 2011/0122153 Al
`
`benivetapesnenaccnnensenonesie
`
`mengrecneeenenenennnnepennncnnnnnnnennnenaennnsonnnennnsneetenanennennnnnnenenatonsnensncnenncnnesabeanenennecnnnnndbedunccnnnnns
`
`FIG. 8 [a SS
`
`9
`
`

`

`Patent Application Publication May 26,2011 Sheet 9 of 66
`
`US 2011/0122153 Al
`
`FIG. 9
`
`a
`
`Oe
`
`oATRROES80Seewewnnsennnenansannesneeree:
`
`ooeeerewes
`eucracennersanss--o-snsenernestneem
`
`St
`
`eeeanenee™
`
`Peennceess|
`
`386
`
`387
`
`388
`
`389
`
`10
`
`

`

`Patent Application Publication May 26,2011 Sheet 10 of 66
`
`US 2011/0122153 Al
`
`FIG. 10
`
`8
`" et
`
`*
`
`—_
`
`351
`
`847
`
`cad
`
`*
`
`349
`
`348
`et
`|
`8 344|345|
`
`346
`
`OO OOOO OOOO OE yy te be Ne Ne tg ty Ne tle.‘tho a the tds
`
`381, id1
`
`382,id2
`
`383,id3
`
`384, id4
`
`385, id5
`
`11
`
`

`

`Patent Application Publication May 26,2011 Sheet 11 of 66
`
`US 2011/0122153 Al
`
`FIG. 11A
`
`FIG. 11D
`
`NUMBER OF
`CONTENTS
`
`NUMBER OF
`
`CONTENTS
`
`idi
`
`id2
`
`id3
`
`id4
`
`idd
`
`EVENT
`
`id1
`
`id2
`
`id3
`
`id4
`
`idd
`
`EVENT
`
`FIG. 11B
`
`FIG. 11E
`
`NUMBER OF
`CONTENTS
`
`NUMBER OF
`CONTENTS
`
`6+
`6
`5 t-
`5
`Oh 4+
`3
`3
`otecnannnnseesecnenssnsneseqenmnsasansencnsccesenaseenensenesased
`2
`2
`neentannscanacecesensncnnned
`
`weeteancenasessennncsnaneneseerancensees
`
`ennantaneravene
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5
`
`EVENT
`ID
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5
`
`EVENT
`ID
`
`FIG. 11C
`
`FIG. 11F
`
`6
`6 tttttnnnnennntnneneennnnnecesnennennnnenneeseermnensumnenensennent
`5
`5
`wsceeeennensasensewesennennnnstesnsensaceneteseseecesencsesesncsceee
`wenacteneeeessaseesesseentnnsnansenanese
`4
`4
`ne
`3
`anneantraesenenone
`3
`
`
`
`2 eccecccnetencned—Lesccrerecccneceneeesensacseoseseeenensenenees 2 pen]
`1
`1+
`
`
`NUMBER OF
`CONTENTS
`
`
`
`idi
`
`id2
`
`id3
`
`id4
`
`idd
`
`EVENT
`
`NUMBER OF
`CONTENTS
`
`aa
`
`
`
`qemennnesetesneseerenecene
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5
`
`EVENT
`
`12
`
`

`

`Patent Application Publication May 26,2011 Sheet 12 of 66
`
`US 2011/0122153 Al
`
`FIG. 12A
`
`NUMBEROF
`CONTENTS
`
`NUMBER OF
`
`CONTENTS
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5 EVENT
`1D
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5 EVENT
`1D
`
`FIG. 12B
`
`NUMBEROF
`CONTENTS
`
`NUMBEROF
`
`CONTENTS
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5 EVENT
`
`id1
`
`id2
`
`id3
`
`id4
`
`id5 EVENT
`
`13
`
`13
`
`

`

`Patent Application Publication May 26,2011 Sheet 13 of 66
`
`US 2011/0122153 Al
`
`FIG. 13A
`
`
`
`Jt RESTRUCTURINGOFTREE
`
`FIG. 13B
`
`
`
`14
`
`

`

`Patent Application Publication May 26,2011 Sheet 14 of 66
`
`US 2011/0122153 Al
`
`FIG. 14
`
`171
`
`CLUSTER DIAMETER(km)
`
`
`
`172
`
`MAP SCALE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`15
`
`

`

`| ‘
`
`‘
`< caper
`Ce ee
`Beco :
`
`e
`
`J
`
`y
`
`ge :
`
`&
`
`;
`
`‘(Ff
`
`y
`
`tf VA
`ff
`’
`
`(f
`
`iy
`
`4
`
`OO
`
`NS XEoo
`
`i:
`
`ry
`
`1
`
`|
`
`|
`|
`
`Y
`
`16
`
`

`

`Patent Application Publication May 26,2011 Sheet 16 of 66
`
`US 2011/0122153 Al
`
`FIG. 16A
`
`17
`
`

`

`Patent Application Publication May 26,2011 Sheet 17 of 66
`
`US 2011/0122153 Al
`
`401
`
`INDEX SCREEN
`
`7 M
`
`ODE
`SWITCHING
`
`MODE
`SWITCHING
`
`402
`
`SCREEN
`
`CONTENT PLAYBACK
`
`18
`
`

`

`Patent Application Publication
`
`May 26, 2011 Sheet 18 of 66
`
`US 2011/0122153 Al
`
`acauiyey
`
`iF
`
`19
`
`19
`
`

`

`Patent Application Publication
`
`May 26, 2011 Sheet 19 of 66
`
`US 2011/0122153 Al
`
`
`
`
`
`5,er,g€)Guo‘N12Se127
`
`
`
`JOVI1dOVSINSAF
`
`REO
`
`OLYEbyCLVLLY
`
`6bSls
`
`20
`
`20
`
`
`
`

`

`420
`
`412413
`
`411
`
`Patent Application Publication May 26,2011 Sheet 20 of 66
`
`US 2011/0122153 Al
`
`02.03-01.04.2004
`
`FIG.20
`
`21
`
`21
`
`

`

`Patent Application Publication May 26,2011 Sheet 21 of 66
`
`US 2011/0122153 Al
`
` — N O
`
`o
`LL
`
`22
`
`22
`
`

`

`Patent Application Publication May 26,2011 Sheet 22 of 66
`
`US 2011/0122153 Al
`
`FIG. 22
`
`
`
`442
`
`441
`
`443
`
`23
`
`23
`
`

`

`Patent Application Publication May 26,2011 Sheet 23 of 66
`
`US 2011/0122153 Al
`
`FIG. 23
`
`24
`
`24
`
`

`

`Patent Application Publication May 26,2011 Sheet 24 of 66
`
`US 2011/0122153 Al
`
`FIG. 24
`
`
`
`
`
`
`
`
`25
`
`25
`
`

`

`Patent Application Publication May 26,2011 Sheet 25 of 66
`
`US 2011/0122153 Al
`
`FIG. 25
`
`26
`
`26
`
`

`

`Patent Application Publication May 26,2011 Sheet 26 of 66
`
`US 2011/0122153 Al
`
`FIG. 26
`
`27
`
`27
`
`

`

`Patent Application Publication May 26,2011 Sheet 27 of 66
`
`US 2011/0122153 Al
`
`FIG. 27A
`
`480
`
`LOCATION
`
`106 photos
`
`ue
`33 photos
`
`547 photos
`
`YUKIGAYAOTSUKA STATION
`ANDVICINITY
`DOWNTOWN:
`WALK
`OTA STATION
`ANDVICINITY
`TOKYO OO LAND
`ANDVICINITY
`NARITAAIRPORT
`
`ANDVICINITY
`
`KIRYUGAOKA ZOO
`ANDVICINITY
`JOMOSANZAN PANORAMA
`
`HIGHWAYAND VICINITY_7 Photos iV|
`
`8photos ses yy
`
`/
`
`y
`
`28 photos
`
` LOCATION
`
`YUKIGAYAOTSUKA STATION
`AND VICINITY
`106 photos
`
`‘DOWNTOWN,
`
`WALK
`
`
`
`9 - 09/08/2007 14 photos|A|
`- 09/01/2008
`24photos |
`
`
`
`
`
`
`— 09/02/2009
`18 photos IV
`
`
`
`
`KIRYUGAOKA ZOO
`ANDVICINITY
`28 photos
`i
`
`HIGHWAYANDVICINITY 7 Photos V7|
`JOMOSANZAN PANORAMA
`
`
`
`\
`
`"i
`
`487
`
`28
`
`28
`
`

`

`Patent Application Publication May 26,2011 Sheet 28 of 66
`
`US 2011/0122153 Al
`
`FIG. 28
`
`START
`
`$901
`
`
`
`
`
`HAS INSTRUCTING
`
`OPERATION FOR GENERATING
`
`CLUSTER INFORMATION BEEN
`
`PERFORMED?
`
`YES
`ACQUIRE ATTRIBUTE INFORMATION
`OF CONTENTS
`
`$902
`
`TREE GENERATION PROCESS
`
`EVENT CLUSTER GENERATION
`PROCESS
`
`$910
`
`S903
`
`HIERARCHY DETERMINATION PROCESS |
`
`TREE RESTRUCTURING PROCESS
`
`$970
`
`S990
`
`GENERATE CLUSTER MAPS
`CORRESPONDING TO
`GENERATED CLUSTERS
`
`STORE GENERATED
`CLUSTER INFORMATION
`
`155904
`
`$905
`
`29
`
`29
`
`

`

`Patent Application Publication May 26,2011 Sheet 29 of 66
`
`US 2011/0122153 Al
`
`FIG. 29
`
`gaa
`oO
`
`HIERARCHY DETERMINATION PROCESS
`
`SET EVENTID'S WITH RESPECT TO
`INDIVIDUAL CONTENTS
`
`CALCULATE FREQUENCYDISTRIBUTION
`OF EVENT ID'S WITH RESPECT TO
`EACH OF NODES
`
`sort
`
`|s9972
`
`CALCULATE LINKAGE SCORES OF
`EACH PARENT NODEON BASIS OF
`FREQUENCYDISTRIBUTION OF CHILD NODES
`
`S973
`
`
`
`$974
`
`EXCLUDE
`
`
`SELECT ONE NODE BEGINNING WITH
`NODESAT UPPER LEVELS, AND
`SET THIS NODE AS TARGET NODE
`
`
`
` LINKAGE SCORE S
`< LINKAGETHRESHOLD
`
`
`NO
`3977
`
`TARGET NODE||DETERMINE TARGET NODEAS EXTRACTION NODE,
`AND EXCLUDE TARGET NOD
`OM NODES
`
`TO BE SELECTED}|ITS CHILD NODES FROM NODESTO BE SELECTED
`
`
` DOES ANOTHER
`
`EXIST?
`
`
`$975
`
`S978
`
`NODE TO BE SELECTED
`
`NO
`
`S979
`
`GENERATE TREE FORMEDBY EXTRACTION NODES
`
`RETURN
`
`30
`
`

`

`Patent Application Publication May 26,2011 Sheet 30 of 66
`
`US 2011/0122153 Al
`
`FIG. 30
`
`$990
`
`
`
`IS NUMBER OF
`
`YES
`CHILD NODES BELONGING TO
`
`TARGET NODE EQUAL TO OR
`SMALLER THAN 1?
`
` EXTRACT PAIR WITH SMALLEST
`
`
`CLUSTER-TO-CLUSTER DISTANCE
`FROM AMONG PAIRS OF CHILD NODES
`BELONGING TO TARGET NODE
`
`TREE RESTRUCTURING PROCESS
`
`
`
`
`
`
`
` DOES EXTRACTED
`PAIR SATISFY CONSTRAINT?
`
`MERGE THAT PAIR
`
`INTO SINGLE NODE
`
`
`
`RETURN
`
`31
`
`31
`
`

`

`Patent Application Publication May 26,2011 Sheet 31 of 66
`
`US 2011/0122153 Al
`
`FIG. 31
`
`31001
`
`
`PLAYBACK NSTRUCTING OPERATION
`NTENT
`
`
`BEEN PERFORMED?
` $1002
`YES
`
`DISPLAY INDEX SCREEN OF CLUSTER MAPS
`
`
`SWITCH INDEX SCREEN|-S1004
`SWITCHINGOPERATION
`S
`GOP
`
`NO
`
`HAS S
`
`OPERATIONOFINDEXSCREEN BEEN
`81008
`
`HAS SCROLL OPERATION
`BEEN PERFORMED?
`
`SWITCH INDEX RENnACCORDANCE
`
`$1006
`
`WITH SCROLL OPERATION
`
` $1003
`
`
`
`$1007
`
`
`HAS SELECTING
`OPERATION OF INDEX IMAGE BEEN
`
`
`ee
`
`DISPLAYINFORMATION RELATEDTOCLUSTER
`
`$1008
`
`CORRESPONDING TO THAT INDEX IMAGE
`
`
`
`
`
`
`
`|| CONTENTPLAYBACKsCeEN|CONTENTPLAYBACKSCREENDISPLAYPROCESS||
`
`
`HAS DETERMINING OPERATION
`BEEN PERFORMED?
`
`$1009
`
`$1020
`
`$1010
`
`HAS CONTENT
`PLAYBACK ENDING OPERATION BEEN
`PERFORMED?
`
`YES
`
`32
`
`32
`
`

`

`Patent Application Publication May 26,2011 Sheet 32 of 66
`
`US 2011/0122153 Al
`
`FIG. 32
`
`$1020
`eC
`
`CONTENTPLAYBACK SCREENDISPLAY PROCESS
`
`$1021
`
`HAS OPERATIONAL
`INPUT BEEN MADE?
`
`$1023
`
`$1022~ATTACH FACE BOXES
`
`
`ARE CONTENT
`TO FACES
`
`
`INFORMATION AND
`
`
`OPERATION ASSISTANCE
`
`
`DISPLAY CONTENT
`INFORMATION
`INFORMATION AND
`DISPLAYED?
`
`OPERATION ASSISTANCE
`INFORMATION
`
`PREDETERMINED
`$1024
`TIME PERIOD?
`
`
` HAS DISPLAY
` YES
`
`SWITCHING OPERATION
`TO INDEX SCREEN BEEN
`
`PERFORMED?
` DISPLAY NEXT CONTENT
`
`
`HAS NO
`
`
`OPERATIONAL
`
`INPUT BEEN MADE WITHIN
`PREDETERMINED
`
`
`RETURN
`
`
`TIME PERIOD?
`
`
`NO
`
`
`ERASE FACE BOXES
`
`ERASE CONTENTINFORMATION AND
`OPERATION ASSISTANCE INFORMATION
`
`
`
`
`PLAYBACK
`SCREEN FOREVENT
`CLUSTER?
`
`NO
`
`$1032
`
`DISPLAY EVENT ICONS
`
`$1033,
`
`PLAYBACK
`SCREEN FOR POSITION
`CLUSTER?
`
`NO
`
`$1034
`
`DISPLAY POSITION ICONS
`
`33
`
`33
`
`

`

`Patent Application Publication May 26,2011 Sheet 33 of 66
`
`US 2011/0122153 Al
`
`FIG. 33
`
`(1)
`$1035
` HAS SELECTING
`
`
`OPERATION ON FACE BEEN
`PERFORMED?
`
`
`
`YES
`
`DISPLAY INFORMATION ON
`
`FACE CLUSTER RELATED TO THAT FACE
`
`
`
`DISPLAY IMAGE OF VICINITY OF
`
`THAT FACE IN MAGNIFIED FORM
`
`$1036
`
`$1037
`
`$1038
`
`
`
`
`$1039
`
`HAS DETERMINING
`OPERATION BEEN
`PERFORMED?
`YES
`
`
`DISPLAY PLAYBACK SCREEN FOR
`
`FACE CLUSTER RELATED TO DETERMINED FACE
`
`HAS SELECTING
`OPERATION ON
`EVENT ICON BEEN
`PERFORMED?
`
`
`
`
`
` HAS SELECTING
`
`OPERATION ON POSITION ICON
`BEEN PERFORMED?
`
`
`
`
`YES
`
`
`DISPLAY INFORMATION
`
`
`RELATED TO POSITION CLUSTER
`
`
`CHANGE EVENT ICON TO EVENT’S
`
`REPRESENTATIVE IMAGE AND
`
`
` CHANGEPOSITION ICON
`DATE AND TIME INFORMATION
`TO CLUSTER MAP
`
`
`
`
`
`HAS DETERMINING
`HAS DETERMINING
`OPERATION BEEN
`OPERATION BEEN
`
`
`
`PERFORMED?
`PERFORMED?
`
`
`
`
`DISPLAY PLAYBACK SCREEN
`FOR DETERMINED EVENT CLUSTER
`
`DETERMINED POSITION CLUSTER
`
`DISPLAY PLAYBACK SCREEN FOR
`
`34
`
`34
`
`

`

`Patent Application Publication May 26,2011 Sheet 34 of 66
`
`US 2011/0122153 Al
`
`FIG. 34
`
`600
`
`
`
`
`BACKGROUND
`MAP
`MAP
`
`INFORMATION
`GENERATING
`
`
`SECTION
`SECTION
`
`
`
`
`
`
`
`BACKGROUND
`CLUSTER
`CONTENT
`MAP
`INFORMATION
`STORING
`
`
`
`
`INFORMATION
`STORING
`SECTION
`
`
`
`
`STORING SECTION
`SECTION
`
`
`
`
`
`
`
`
`MAGNIFICATION/
`
`DISPLAY
`COORDINATE
`
`
`SHRINKAGE
`
`CONTROL
`CALCULATING
`
`PROCESSING
`SECTION
`SECTION
` SECTION
`
`
`
`
`SECTION
`
`
`
`
`
`
`
`
`NON-LINEAR
`RELOCATION
`
`ZOOM
`PROCESSING
`
`
`PROCESSING
`
`SECTION
`
`DISPLAY
`SECTION
`
` OPERATION
`
`
`ACCEPTING
`
`
`SECTION
`
`
`35
`
`35
`
`

`

`Patent Application Publication May 26,2011 Sheet 35 of 66
`
`US 2011/0122153 Al
`
`
`
`
`
`
`
`
`
`
`
`reuse
`
`
`760 vl TTYTiTitgy
`
`
`
`
`pat|EEL|or||te|
`
`ATpT
`
`
`
`
`FIG.35
`||ANAPAnRIDD
`
`
`
`
`taJ
`
`
`
`
`
`36
`
`‘ash
`
`Ais
`N]
`
`a|||C
`
`I||a|||||a||I||a
`
`36
`
`

`

`Patent Application Publication May 26,2011 Sheet 36 of 66
`
`US 2011/0122153 Al
`
`FIG. 36
`
`763
`
`||
`
`
`
`LT
`
`:
`
`a
`
`Sano
`
`Saku
`
`i
`Takasaki
`
`Ota
`
`LOE Ghichibu-S
`
`ps
`
`Saitama
`
`Sagamihara
`
`_oKamisu _|
`}
`Kashiwa+Narita#aton
`
`Kofu
`[ Hachioji
`(ta
`:
`
`9
`Tokyo
`Sanmu
`Cyoshi
`Mokodoa
`Yokotck
`Ruse | Kimitsu-
`
`Mobara
`Tumi >
`Kamogawa+
`
`Ho
`
`
`
`
`
`a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Utsunomiy
`Hitachi
`
`
`
`
`Hitachiomiya
`|
`
`
`
`Maebashi- Kiryu
`Mito
`
`
`
`
`
`
`
`
`
`
`
`
`Fujinomiya—Gotenba,
`[”Odawara _
`ei
`Nurazu f
`Shizuoka}
`
`uji
`
`a
`
`Minamiboso
`
`Shimoda
`
`]
`
`
`
`T
`
`
`
`37
`
`37
`
`

`

`Patent Application Publication May 26, 2011 Sheet 37 of 66
`
`US 2011/0122153 Al
`
`FIG. 37
`
`Utsunomiy:
`
`‘Hitachi
`
`Hitachiomiya
`
`Mito
`
`Maebashi-Kiryu
`
`Takasaki!
`
`Ota
`
`Sano
`
`Chichibu
`
`Tsukuba
`
`765
`
`Saitama
`
`Katori
`8
`ta
`
`Nari
`
`Kashiwa
`N
`764
`
`Kamisu
`|
`
`Cyoshi
`
`Hachioji
`
`Sanmul
`Tokyo
`o
`f
`SagamiharaYWYokohama
`°o
`Mobara
`
`Kimitsu 763
`
`Fujinomiya iGotenbasOdawara
`3 Fuji
`Numazu Ito
`
`Shizuoka
`
`Shimoda
`
`Yokosuka~“©
`Oo
`
`|
`
`Izumi
`
`Minamibo
`
`Kamogawa
`
`38
`
`38
`
`

`

`Patent Application Publication
`
`May 26, 2011 Sheet 38 of 66
`
`US 2011/0122153 Al
`
`38
`
`FIG
`
`PoPiob¢oremrrrBrrrgnaed
`
`39
`
`39
`
`

`

`Patent Application Publication
`
`May26, 2011 Sheet 39 of 66
`
`US 2011/0122153 Al
`
`FIG
`
`. 39
`
`oeenedrenseebneneed
`
`iodo
`
`iogi
`
`
`
`snsfeenrieeebenenfreebaad
`
`iawPoi?
`
`tadececbetedodacccinobosade
`PoPoPPoPPEPoE¢
`
`40
`
`40
`
`

`

`
`
`
`
`
`
`
`CHaVetT
`CTPy|AnLA|
`
`
`
`
`|i CH
`
`
`
`
`TH.HH UIz=
`JHaaHHJYTerotHHHPEEEEE
`
`
`aeHNYt
`
`
`7a
`Clsoe=Ts———>
`
`
`
`‘A
`
`
`Sig4 Y
`|HyA,[Ai}|
`F,Yt
`
`
`
`
`COTcoo-]
`CCl4
`|dlTH
`ie
`HH|PEEHt+]HeCH
`
`
`
` AHHEHrooan
`
`
`
` /\—s
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication May 26, 2011 Sheet 40 of 66
`
`US 2011/0122153 Al
`
`
`
`2 ee
`Pe
`PptTPCr
`Lp-TLLreereeN
`IO SS
`
`
`
`
`
`770 ve
`
`FIG.40
`
`
`
`
`
`
`[|
`Lt|
`
`
`
`
`A
`
`
`
`|
`
`ee eeeCET
`Py
`j
`||
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`\ToTTl
`
`
`
`
`
`
`
`
`
`
`Iih
`
`
`
`
`A1
`
`41
`
`

`

`Patent Application Publication May 26,2011 Sheet 41 of 66
`
`US 2011/0122153 Al
`
`780
`
`©Fukushima
`
`oCc
`9ws
`z
`
`—
`
`Utsunomiya °
`Maebashi
`
`((aKanazawaeQ/
`
`FIG.41
`
`42
`
`42
`
`

`

`Patent Application Publication May 26,2011 Sheet 42 of 66
`
`US 2011/0122153 Al
`
`FIG. 42
`
`
`
`733
`
`43
`
`43
`
`

`

`Patent Application Publication May 26,2011 Sheet 43 of 66
`
`US 2011/0122153 Al
`
`FIG. 43A
`
`CW1
`
`DW1
`
`
`
`DW1
`
`
`
`44
`
`

`

`FIG. 44A
`
`45
`
`

`

`Patent Application Publication May 26,2011 Sheet 45 of 66
`
`US 2011/0122153 Al
`
`FIG. 45
`
`
`
`46
`
`46
`
`

`

`USByYese,
`
`os
`
`eAusebity
`
`LT
`
`Patent Application Publication
`
`May 26, 2011 Sheet 46 of 66
`
`US 2011/0122153 Al
`
`
`
`Bua]irepoy
`
`97SIs
`
`47
`
`47
`
`

`

`Patent Application Publication May 26,2011 Sheet 47 of 66
`
`US 2011/0122153 Al
`
`455 4
`
`PUBASHETanaane
`SO
`
`rinin
`
`8
`
`48
`
`

`

`Patent Application Publication May 26,2011 Sheet 48 of 66
`
`US 2011/0122153 Al
`
`FIG. 48A
`
`49
`
`49
`
`

`

`Patent Application Publication
`
`May 26, 2011 Sheet 49 of 66
`
`US 2011/0122153 Al
`
`918
`
`AW1d
`
`MalA
`
`N3aYOS
`ONITISONVO
`
`NOILWaadO
`
`
`
`ONININYSLAG
`
`NOLLVuadO
`
`OROSTTINSINOO6rOld
`
`ONS!INSINGO,
`S18cL8
`
`vl8LL
`
`YSLIVOSYALLVOS
`N3aY4OSN3aYxOS
`
`MalMaik”|(NOUWALLOY]
`
`N33uOSNa3aYOS
`
`NalAMalA
`dvd¥W
`
`NOLIVuadoiONITTSONYDONIHOLIMS
`ONLOGTas|300W\/
`
`
`NOILLWY3dOONISNVHOSGNLIONOT/SCNLILVT
`
`
`NOILVuadOONIDNVHO31VOS
`
`''1''v'''1'''''1'''''1'''‘''''''v1'''''''v'1'''''''I''''i'''11''''v11I''''
`
`18
`
`NOILVuadO
`ONIHOLIMS
`
`JCON
`
`50
`
`50
`
`
`
`
`
`

`

`Patent Application Publication May 26,2011 Sheet 50 of 66
`
`US 2011/0122153 Al
`
`FIG. 50
`
`
`
`893
`
`ollIC
`
`eee
`
`>896
`
`=
`
`51
`
`51
`
`

`

`Patent Application Publication May 26,2011 Sheet 51 of 66
`
`US 2011/0122153 Al
`
`FIG. 51
`
`START
`
`
`
`
`
`ACQUIRE
`CLUSTER INFORMATION
`
`GENERATE
`CLUSTER WIDE-AREA MAP
`ON BASIS OF ACQUIRED
`CLUSTER INFORMATION
`
`
`
`
`
`
`
`HAS GENERATION OF
`CLUSTER WIDE-AREA MAP
`
`
`BEEN FINISHED FOR
`
`EVERY CLUSTER?
`
`
`
`52
`
`52
`
`

`

`Patent Application Publication May 26,2011 Sheet 52 of 66
`
`US 2011/0122153 Al
`
`FIG. 52
`e HASCONTENTPLAYBACK
`
`INSTRUCTING OPERATION BEEN
`PERFORMED?
`
`DISPLAY MAP VIEW SCREEN
`
`|MAPVIEWPROCESS[|
`
`
`
`DISPLAY PLAY VIEW SCREEN
`
`PLAY VIEW PROCESS
`
`S1117
`
`IS OPERATION MODE
`SWITCHING?
`
`
`
`
`
`
`
`
`NO
`
`HAS CANCELLING
`OPERATION OF PLAY
`
` VIEW SCREEN BEEN
`
`PERFORMED?
`
`
`IS OPERATION
`DETERMINING OPERATION
`
`ON CLUSTER MAP?
` DISPLAY SCREEN DISPLAYED
`
`
`
` IS MAP
`
`VIEW SCREEN
`DISPLAYED?
`
`
`
`AT IMMEDIATELY PREVIOUS
`DETERMINING OPERATION
`
`53
`
`53
`
`

`

`Patent Application Publication May 26,2011 Sheet 53 of 66
`
`US 2011/0122153 Al
`
`“_~
`MAP VIEW PROCESS
`
`$1134
`
`GENERATE BACKGROUNDMAPON BASIS OF PIECES OF CLUSTER INFORMATION
`
`
`
`CALCULATE COORDINATES OF CLUSTER MAPS
`CORRESPONDING TO GENERATED BACKGROUND MAP
`
`NON-LINEAR ZOOM PROCESS
`
`$1132
`
`|
`
`$1150
`
`$1133
`
`DISPLAY CLUSTER MAPSIN OVERLAID MANNER ON BACKGROUND MAP
`
`
`
`
`
`
`HAS MOVE/
`SCALE-CHANGE
`
`
`OPERATION ON MAP BEEN
`
`PERFORMED?
`
`
`GENERATE BACKGROUND MAP
`
`INACCORDANCE WITH
`
`
`OPERATION PERFORMED
`
`
`
` HAS SELECTING
`
`OPERATION ON CLUSTER MAP
`
`BEEN PERFORMED?
`
`
`
` HAS DESELECTING
`
`OPERATION ON CLUSTER MAP
`
`
`BEEN PERFORMED?
`
` 51140
`NO
`
`HAS DETERMINING
`
`YES
`
`OPERATION ON CLUSTER MAP
`
`
`BEEN PERFORMED?
`
`NO
`S1141
`
`HAS MODE
`SWITCHING OPERATION BEEN
`PERFORMED?
`
`DELETE CONTENT
`LISTING DISPLAY AREA
`
`
`
`
`
`YES
`
`RETURN
`
`54
`
`54
`
`

`

`
`CALCULATE TRANSFORMED COORDINATESPE}
`WITH RESPECT TO CLUSTER MAP j EXIST
`
`IN TRANSFORMATION TARGET AREA
`
`
`$1154
`
`
`
`Patent Application Publication May 26,2011 Sheet 54 of 66
`
`US 2011/0122153 Al
`
`FIG. 54
`
`$1150
`yr
`
`NON-LINEAR ZOOM PROCESS
`
`SELECT ONE CLUSTER MAP AND
`
`SET THIS CLUSTER MAP AS CLUSTER MAPi
`
`SET CENTER POSITION OF CLUSTER MAP i AS FOCUS
`
`sits1
`
`$1152
`
`$1153
`
`
`HAS CALCULATION OF
`
`TRANSFORMED COORDINATES BEEN
`
`FINISHED WITH RESPECT TO EVERY CLUSTER MAP
`
`EXISTING IN TRANSFORMATION
`
`
`TARGET AREA?
`
`
`SELECT ONE CLUSTER MAP AND
`
`
`SET THIS CLUSTER MAP AS CLUSTER MAPi
`
`
`CALCULATE MEAN OF
`
`
`CALCULATED TRANSFORMED COORDINATESPEjj
`
`
`SET COORDINATES OF CLUSTER MAPi
`ON BASIS OF CALCULATED MEANOFPEjj
`
`EVERY CLUSTER MAP?
`
`YES
`
`$1155
`
`$1156
`
`$1157
`
`HAS SETTING OF
`COORDINATES BEEN FINISHED FOR
`
`$1158
`
`YES
`
`RETURN
`
`55
`
`55
`
`

`

`Patent Application Publication May 26,2011 Sheet 55 of 66
`
`US 2011/0122153 Al
`
`FIG. 55 51160
`
`“~
`
`SCATTER VIEW PROCESS
`
`CALCULATE COORDINATES OF
`CLUSTER MAPSON BASIS OF
`PIECES OF CLUSTER INFORMATION
`
`$1161
`
`$1150
`||__NON-LINEAR ZOOM PROCESS__|
`FORCE-DIRECTED
`S170
`RELOCATION PROCESS
`
`MAGNIFICATION/SHRINKAGE PROCESS
`
`DISPLAY CLUSTER MAPS
`
`$1162
`
`$1163
`
`
`
`OPERATION ON CLUSTER MAP
`HAS SELECTING
`
`
`
`BEEN PERFORMED?
`
`
`
`
`
`HAS DESELECTING
`
`OPERATION ON CLUSTER MAP
`
`
`BEEN PERFORMED?
`
`
`ERASE CONTENT
`
`
` LISTING DISPLAY AREA
`
`
`HAS DETERMINING
`YES
`
`OPERATION ON CLUSTER MAP
`
`
`BEEN PERFORMED?
`
`
`
` HAS MODE
`
`SWITCHING OBERATION BEEN
`PERFORMED
`
`
`YES
`
`RETURN
`
`56
`
`56
`
`

`

`Patent Application Publication May 26,2011 Sheet 56 of 66
`
`US 2011/0122153 Al
`
`FIG. 56
`
`$1170
`eo
`
`FORCE-DIRECTED RELOCATION PROCESS
`
`SELECT ONE CLUSTER MAP AND
`SET THIS CLUSTER MAP AS CLUSTERMAPi
`
`S171
`
`CALCULATE REPULSIVE FORCE VECTORSF;
`EXERTED ON CLUSTER MAPi FROM CLUSTER MAPSj
`
`S172
`
`
`
`$1175
`
`SUBSTITUTE REPULSIVE FORCE
`VECTORFj BY K(F:/IFil)
`
`$1176
`
`
`
`
`
`CALCULATE MEAN OF REPULSIVE FORCE VECTORSF,|s9!178
`AS REPULSIVE FORCE VECTORF; ON CLUSTER MAP7.
`a
`
`
`
`
`
`
`
`stt77
`
`$1178
`
`CLUSTERNAPBEEN
`
`SELECT ONE CLUSTER MAP AND
`SET THIS CLUSTER MAP AS CLUSTERMAPi
`
`ADD REPULSIVE FORCE VECTORF; TO
`CALCULATED COORDINATES OF CLUSTER MAPi
`
`$1179
`
`CLUSTERMAPBEEN
`ae=
`$1180
`
` IS |Fil < th11
`WITH RESPECT TO EVERY
`
`REPULSIVE FORCE
`VECTORFj?
`
`YES
`RETURN
`
`57
`
`57
`
`

`

`Patent Application Publication
`
`May 26, 2011 Sheet 57 of 66
`
`US 2011/0122153 Al
`
`~---4L_
`|
`
`.ay|||
`
`4 i a|
`
`TTTEII
`
`FIG. 57A
`
`t
`
`tI
`
`1||
`
`t
`I
`~4-~--4----4--b 4 ----4-
`
`'|
`
`|!i
`
`iiiIi-d----4----4--~-4----_I
`
`+----+----4+----
`
`Aarne te t-te
`
`II''—j----4----4---4gegee
`
`
` leseteteeteeteseerieacheSetteteton'foll|IxI
`
`
`
`—--—-+-—~—--
`
`|+
`
`|
`
`-
`
`1
`
`1|1
`
`Os
`6,
`
`4----4
`|
`I
`tttteneedlenn
`ae
`x
`
`II
`
`||
`
`II|I
`
`|
`
`—-4--+-+-
`I
`
`|
`~4----4----4-
`
`|I|
`
`FIG. 57B
`
`58
`
` 1~d4----4d----4---4gegeI1I|I\|!1!|!|{1{!|11!|tt|!!t!!t~---+t--A----4----4---4pee!1Gote:
`
`58
`
`
`

`

`Patent Application Publication May 26,2011 Sheet 58 of 66
`
`US 2011/0122153 Al
`
`FIG. 58A
`
`501
`
`a
`
`504
`
`o
`
`502
`
`503
`
`
`
`IS b
`ISc
`BOeNOS! INCLUDED|INCLUDED|CASE
`
`_INn?|INn?|
`
`|false|false false pO
`
`
`
`
`
`59
`
`59
`
`

`

`Patent Application Publication May 26,2011 Sheet 59 of 66
`
`US 2011/0122153 Al
`
`FIG. 59A
`CASE 0
`
`FIG. 59B
`CASE1
`
`@)
`
`FIG. 59C
`CASE 2
`
`b
`
`()
`
`FIG. 59E
`CASE4
`250
`
`250
`
`@)
`
`FIG. 59G
`CASE 6
`
`ol
`
`FIG. 59D
`CASE 3
`
`undefined
`
`FIG. 59F
`CASE 5
`
`FIG. 59H
`CASE 7
`
`y
`
`60
`
`

`

`Patent Application Publication May 26,2011 Sheet 60 of 66
`
`US 2011/0122153 Al
`
`FIG. 60A
`
`SET a—>mAND END
`
`FIG. 60B
`
`RADIUSOFbIS0 =)
`
`@)
`
`<b
`OTHER
`CASES [) anBANDCONTINUE
`
`FIG. 60C
`
`RADIUSOF¢180
`
`@)
`
`SETa<c
`OTHER
`CASES C=) AND CONTINUE
`
`61
`
`

`

`Patent Application Publication May 26,2011 Sheet 61 of 66
`
`US 2011/0122153 Al
`
`FIG. 61A
`
`ROOT NODE
`
`FIG. 61B
`
`/coor \
`
`b12
`
`521Y a ‘. \ b
`
`b11
`
`62
`
`62
`
`

`

`Patent Application Publication May 26,2011 Sheet 62 of 66
`
`US 2011/0122153 Al
`
`FIG. 62
`
`oTART
`
`63
`
`63
`
`

`

`Patent Application Publication May 26,2011 Sheet 63 of 66
`
`US 2011/0122153 Al
`
`FIG.63
`
`gan
`yr
`
`INITIAL GROUPING PROCESS
`
`$921
`
`$922
`
`CALCULATEd (head (S), ni)
`
`$924
`
`$925
`
`d(head(S), ni) < th20?
`
`ADD ni TO SET S
`
`NO
`
`
`
`TREE GENERATION
`
`PROCESS WITH RESPECT TO
`CONTENTSINCLUDEDIN SET S
`
`$940
`
`
`
`HOLD RESULTS OF
`TREE GENERATION PROCESS
`
`su27
`
`a ee
`
`
`
`
`
`
`5928
`
`5929
`
`USE HELD RESULTS OF
`TREE GENERATION PROCESS
`AS NODESTO BE PROCESSED
`
`$931
`
`64
`
`

`

`Patent Application Publication May 26,2011 Sheet 64 of 66
`
`US 2011/0122153 Al
`
`FIG. 64
`
`$940
`tv
`
`TREE GENERATION PROCESS
`
`
`
`
`
`HAS PROCESSING OF
`
`
`NODES TO BE PROCESSED
`
`
`BEEN FINISHED?
`
`
`
`
`(RETURN)
`
`65
`
`

`

`Patent Application Publication May 26,2011 Sheet 65 of 66
`
`US 2011/0122153 Al
`
`FIG. 65—sgs0
`“~\
`
`
`
`NODE INSERTION PROCESS
`
`
`
`
`b=left(a), c=right(a), AND n
`
`RELATIONSHIP BETWEEN
`
`
`
`
` THAT
`
`RELATIONSHIP
`
`CORRESPOND TO
`CASE 4 OR 7?
`
`
`
`
`odttéRENERATION
`(eh,Rt)Tato. right(c), n}
`RESPECT TO
`
`
`
`
` GENERATE
`NEW NODE m
`SET RESULTS OF
`
`
`left(m)=b,right(m)=n,
`TREE GENERATION PROCESS
`
`left(a)=m)
`WITH RESPECT TO ROOT NODEa
`
`
`
`
`CALCULATE DISTANCES
`
`d(b, n), d(c, n), AND d(b,c)
`
`ORIS RADIUSOF c
` ISc
`
`
`
`UAL TO 0?
`
`GENERATE
`NEW NODE m
`
`
`(left(m)=c, right(m)=n,
`GENERATE NEW NODE m
`
`
`
`
`left(a)=m)
`(left(m)=a, right(m)=n, a=m)
`
`
`
`66
`
`66
`
`

`

`Patent Application Publication May 26,2011 Sheet 66 of 66
`
`US 2011/0122153 Al
`
`FIG. 66
`
`$980
`bO
`
`TREE UPDATING PROCESS AFTER NODEINSERTION
`
`SET S={a}, Sb={}, and p=a
`
`$981
`
`$982
`
`9
`
`IS p ROOT NODE?
`NO
`
`YES
`
`s989
`TREE GENERATION PROCESS
`WITH RESPECT TO ELEMENTSIN S
`
`Sb = {brother(p)}
`
`$983
`
`RETURN
`
`
`DO head(Sb)
`NO
`AND a COINCIDE WITH
`
`EACH OTHER?
`
`
`
`
`S986
`
`$984
`
`S=S+head (Sb),
`
`
`Sb = Sb — head (Sb)
`
`
`
`
`
`tmp =head (Sb),
`Sb=Sb- {tmp},
`Sb= {left (tmp), right(tmp)}+ (Sb)
`
`
`p=parent(p)
`
`YES
`
`$988
`
`67
`
`67
`
`

`

`US 2011/0122153 Al
`
`May 26, 2011
`
`INFORMATION PROCESSING APPARATUS,
`INFORMATION PROCESSING METHOD,
`AND PROGRAM
`
`BACKGROUND OF THE INVENTION
`
`[0008] However, in the related art described above, images
`representing contents, and marks indicating the generated
`positions of these contents are displayed relatively far apart
`from each other, which supposedly makes it difficult to intu-
`itively grasp the geographical correspondence between indi-
`vidual contents.
`
`1. Field of the Invention
`[0001]
`[0009] Also, for example,it is supposed that images taken
`by a personliving in Tokyoincluderelatively many images of
`[0002] The present invention relates to an information pro-
`Tokyo andits vicinity (for example, Shinagawa ward, Seta-
`cessing apparatus, in particular, an information processing
`gaya ward, and Saitamacity), and relatively few images of
`apparatus which displays contents such as image files, an
`other regions (for example, United States or United Kingdom
`information processing method, and a program for causing a
`
`computer to execute the information processing method. visited by the person onatrip). Accordingly, when displaying
`the correspondence between images taken in Tokyo andits
`[0003]
`2. Description of the Related Art
`vicinity and images taken in other regions, and their gener-
`[0004]
`In recent years, there has been a proliferation of
`ated positions, for example,it is necessary to display the map
`image capturing apparatuses such as a digital still camera and
`at a scale sufficiently large to show the countries ofthe world.
`a digital video camera (for example, an integrated camera-
`In this case, marks indicating the generated positions of the
`recorder) which capture a subject such as a landscape or a
`images taken in Tokyo andits vicinity (for example, Shina-
`person to generate an image, and record the generated image
`gawa ward, Setagaya ward, and Saitamacity)are displayed at
`as an image file (content). Also, there are image capturing
`substantially the same position on the map, which may make
`apparatuses which can record a generated image in associa-
`it difficult to grasp the geographical correspondence between
`tion with positional information on the position where the
`the images taken in Tokyo andits vicinity.
`image is captured. There have been proposed information
`[0010] On the other hand, for example, when the map is
`processing apparatuses with which, whendisplaying contents
`displayed at a scale sufficiently small to show regions in the
`generated in this way, the generated positions of the contents
`vicinity of Tokyo, marks indicating the generated positions of
`identified by their positional information are displayed in
`association with the contents.
`the images taken in Tokyo andits vicinity (for example,
`Shinagawa ward, Setagaya ward, and Saitamacity) are dis-
`played in suitable placement on the map. Therefore, the gen-
`erated positions of the images taken in Tokyo andits vicinity
`can be grasped. However, in this case, it is not possible to
`display the generated positions of images taken in other
`regions (for example, the United States or United Kingdom)
`on the map, makingit difficult to grasp the generated posi-
`tions of individual images.
`[0011] Accordingly, when displaying images representing
`contents associated with positions on a map,it is important to
`beable to easily grasp the correspondence betweena plurality
`of contents on the map, and each individual content.
`[0012]
`It is thus desirable to be able to easily grasp, when
`displaying superimposed imagesassociated with positions in
`a background image, the correspondence betweena plurality
`of superimposed images in the background image, and each
`individual superimposed image.
`[0013] According to an embodimentof the present inven-
`tion, there are provided an information processing apparatus,
`an information processing method, and a program for causing
`acomputer to execute the information processing method, the
`information processing apparatus including: a transformed-
`coordinate calculating section that calculates transformed
`coordinates for each of a plurality of superimposed images
`associated with coordinates in a background image,by taking
`one superimposed image of the plurality of superimposed
`imagesas a reference image, and transforming coordinates of
`other superimposed images on the basis of corresponding
`coordinates of the reference image in the background image,
`distances in the background image from the reference image
`to the other superimposed images, and a distance in the back-
`ground image from the reference image to a boundary within
`a predetermined area with respect to the reference image, the
`coordinates of the other superimposed images being trans-
`formed in such a way that coordinate intervals within the
`predetermined area becomedenser with increasing distance
`from the reference image toward the boundary within the
`predetermined area; a coordinate setting section that sets
`
`For example, there has been proposed an informa-
`[0005]
`tion processing apparatus which arranges thumbnail icons of
`imagesside byside in timeseries and displays the thumbnail
`icons in a film window,displays position icons indicating the
`shooting locations of these images in a map window,and
`displays these icons in association with each other (see, for
`example, Japanese Unexamined Patent Application Publica-
`tion No. 2001-160058 (FIG. 12)). This information process-
`ing apparatus is configured such that, for example, when a
`click operation on a thumbnail icon is performedbythe user,
`a position icon indicating the shooting location of an image
`corresponding to the clicked thumbnail icon is displayed at
`the center of the map window.
`[0006] Also, there has been proposed an information pro-
`cessing system which arranges thumbnail imagesside by side
`in time series and displays the thumbnail images on an image
`list display section, displays markers at positions on a map
`corresponding to the shooting locations of these images, and
`displays these images and markers in association with each
`other (see, for example, Japanese Unexamined Patent Appli-
`cation Publication No. 2007-323544 (FIG.7)). In this infor-
`mation processing system, when a click operation on a
`marker displayed on the map is performed by the user, an
`imageassociated with the clicked markeris displayed on the
`map as a pop-up.
`
`SUMMARYOF THE INVEN