(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2011/0074811 A1
`Hanson et al.
`(43) Pub. Date:
`Mar. 31, 2011
`
`US 20110074811A1
`
`(54) MAPLAYOUT FOR PRINT PRODUCTION
`
`(52) U.S. Cl. ......................................... 345/629; 715/810
`
`(75) Inventors:
`
`Eric Hanson, Emeryville, CA (US);
`Nikhil Bhatt, Cupertino, CA (US)
`
`(73) Assignee:
`
`Apple Inc.
`
`(21) Appl. No.:
`1-1.
`(22) Filed:
`
`12/567,475
`
`Sep. 25, 2009
`Publication Classificati
`ublication Classification
`
`(51) Int. Cl.
`G09G 5/00
`G06F 3/048
`
`(2006.01)
`(2006.01)
`
`
`
`ABSTRACT
`(57)
`A computing device includes a memory configured to store
`digital images. The computing device also includes a proces
`Sor configured to execute instructions to perform a method
`that includes receiving a collection of digital images in which
`one or more of the digital images has an associated location.
`The method also includes displaying a digital map that is
`defined by a geographic area that includes the associated
`locations of the digital images. The method further includes
`annotating the digital map to include one or more identifiers.
`One or more of the identifiers represents a group of the asso
`ciated locations as determined from a scale associated with
`the digital map.
`
`Petitioner Apple Inc. - Ex. 1028, p. 1
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 1 of 8
`
`US 2011/0074811 A1
`
`
`
`
`
`s
`
`Petitioner Apple Inc. - Ex. 1028, p. 2
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 2 of 8
`
`US 2011/0074811 A1
`
`
`
`J3OnpOJ,
`
`deW
`
`Petitioner Apple Inc. - Ex. 1028, p. 3
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 3 of 8
`
`US 2011/0074811 A1
`
`
`
`3S
`O
`O
`CN
`al
`CD
`O
`s
`
`.u. Sor
`s
`n
`O
`w
`.C. k
`H
`
`S
`
`$y
`
`Ys
`
`Petitioner Apple Inc. - Ex. 1028, p. 4
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 4 of 8
`
`US 2011/0074811 A1
`
`
`
`Z
`0
`
`Petitioner Apple Inc. - Ex. 1028, p. 5
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 5 of 8
`
`US 2011/0074811 A1
`
`
`
`909
`
`faqenuo?oganow
`
`Petitioner Apple Inc. - Ex. 1028, p. 6
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 6 of 8
`
`US 2011/0074811 A1
`
`
`
`009
`
`
`
`029
`
`Petitioner Apple Inc. - Ex. 1028, p. 7
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 7 of 8
`
`US 2011/0074811 A1
`
`00/ º
`
`
`
`90/
`
`
`
`Petitioner Apple Inc. - Ex. 1028, p. 8
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 8 of 8
`
`US 2011/0074811 A1
`
`
`
`
`
`to
`
`
`
`
`
`
`
`
`
`
`
`
`
`g
`
`Petitioner Apple Inc. - Ex. 1028, p. 9
`
`

`

`US 2011/0074811 A1
`
`Mar. 31, 2011
`
`MAPLAYOUT FOR PRINT PRODUCTION
`
`BACKGROUND
`0001. The disclosure related to a system for preparing and
`adjusting digital maps for laying out print products (e.g.,
`books) for documenting e.g., travels and captured images.
`0002. In the ever expanding fields of personal computing
`and electronic devices, more and more features and function
`ality are being incorporated into portable devices. For
`example, cellular telephones and personal digital assistants
`(PDAs) may include cameras (for gathering images and
`Video) while still providing traditional capabilities (e.g., tele
`communications, storing personal information Such as calen
`dars, etc.). Due to their robust processing and computational
`resources, such devices may collect a significant amount of
`digital imagery (e.g., digital photographs and video). Along
`with storing such digital information, organizing and present
`ing the imagery can be a challenge.
`
`SUMMARY
`0003 Disclosed herein are systems and methods for pre
`paring digital maps that indicate the locations associated with
`digital images. Locations may be associated with images
`based on various reasons, for example, a location may be
`where an associated image was captured. Position informa
`tion (e.g., global position system (GPS) information) may
`also used to associate images and locations. By using location
`information associated with the images, interactions with a
`user, or other techniques, digital maps may be produced that
`identify each image associated location. Further, using data
`that is Substantially resolution independent, the maps may be
`scaled to appropriately resolve each location. Once finalized
`by the user, the digital maps and the corresponding digital
`images may be prepared for printed productions or other
`types of layouts.
`0004. In some implementations, a method includes receiv
`ing a collection of digital images in which one or more of the
`digital images has an associated location. The method also
`includes displaying a digital map that is defined by a geo
`graphic area that includes the associated locations of the
`digital images. The method further includes annotating the
`digital map to include one or more identifiers. One or more of
`the identifiers represents a group of the associated locations
`as determined from a scale associated with the digital map.
`0005. In other implementations, a computing device
`includes a memory configured to store digital images. The
`computing device also includes a processor configured to
`execute instructions to perform a method that includes receiv
`ing a collection of digital images in which one or more of the
`digital images has an associated location. The method also
`includes displaying a digital map that is defined by a geo
`graphic area that includes the associated locations of the
`digital images. The method further includes annotating the
`digital map to include one or more identifiers. One or more of
`the identifiers represents a group of the associated locations
`as determined from a scale associated with the digital map.
`0006. In other implementations, one or more computer
`readable media store instructions that are executable by a
`processing device, and upon Such execution cause the pro
`cessing device to perform operations that include receiving a
`collection of digital images, wherein one or more of the
`digital images has an associated location. Execution of the
`instructions also cause the processing device to perform
`
`operations that include displaying a digital map that is defined
`by a geographic area that includes the associated locations of
`the one or more digital images. Execution of the instructions
`also cause the processing device to perform operations that
`include annotating the digital map to include one or more
`identifiers, wherein at least one of the identifiers represents a
`group of the associated locations as determined from a scale
`associated with the digital map.
`0007. These and other aspects and features and various
`combinations of them may be expressed as methods, appara
`tus, Systems, means for performing functions, program prod
`ucts, and in other ways.
`0008. Other features and advantages will be apparent from
`the description.
`
`DESCRIPTION OF DRAWINGS
`0009 FIG. 1 illustrates a series of images associated with
`a traveled path.
`0010 FIG. 2 illustrates a system for producing a digital
`map associated with images.
`0011
`FIG. 3 illustrates a modifiable digital map associ
`ated with images.
`0012 FIG. 4 illustrates scaling a digital map.
`0013 FIGS. 5 and 6 illustrate graphical user interfaces.
`0014 FIG. 7 is a flow chart that represents operations of a
`map producer.
`0015 FIG. 8 represents a computer system and related
`components.
`0016. Like reference symbols in the various drawings
`indicate like elements.
`
`DETAILED DESCRIPTION
`(0017 Referring to FIG. 1, an illustration 100 shows a
`series of exemplary scenes that may be experienced by an
`individual while traveling along apath. By carryingaportable
`computing device Such as a digital camera, a cellular tele
`phone, a personal digital assistant (PDA) or other similar
`device capable of collecting image, digital photographs or
`other types of digital images may be captured while progress
`ing along the path. Along with the captured images, other
`types of information may collected Such as time and position
`information. For example, global positioning system (GPS)
`technology, wireless fidelity (Wi-Fi) or other types of wire
`less technology may be used in conjunction with the portable
`computing device to track the movement of the individual. In
`one arrangement, a cell phone 102 incorporates a GPS
`receiver and computational resources (e.g., processor,
`memory, etc.) for processing and storing coordinates (e.g.,
`latitude and longitude coordinates) that represent that global
`position of the portable mobile device. As such, data is col
`lected and preserved on the portable mobile device that rep
`resents the location of the device as each image is captured.
`Similarly, an internal clock or a received timing signal (e.g.,
`satellite based) may be used to provide the time and date that
`each image was captured. In some arrangements, such time
`and position data is embedded into the appropriate digital
`image for later retrieval and use. For example, such time and
`position information may be represented with metadata, or
`other type of information structure, which is associated with
`each captured image. While position information may be
`associated with a digital image based upon the capture loca
`tion of the image, other situations may create an association
`between position information and a digital image. For
`
`Petitioner Apple Inc. - Ex. 1028, p. 10
`
`

`

`US 2011/0074811 A1
`
`Mar. 31, 2011
`
`example, position information may be assigned to a digital
`image (e.g., by user interactions with a computing device) at
`a time after the image was captured. A Software application
`may be used to produce and assign position information to
`images. In some instances the position information associ
`ated with a digital image may not reflect the precise capture
`location of an image but may represent the general area where
`the image was captured. Similarly, other information Such as
`time and date may be associated with a digital image after the
`image has been captured (e.g., by a software application).
`0018. In this particular illustration, the individual carrying
`cell phone 102 progresses along path 104 and captures
`images (with an incorporated camera) at various points of
`interest. While this example describes individual images
`(e.g., photographs) being collected, other types of imagery
`(e.g., video) may also be collected with cellphone 102. In this
`example, the individual is located in Paris, France and path
`104 passes the individual through a series of landmarks such
`as the Jardins Des Tuileries gardens (represented by flowers
`106), which may provide various rural scenes of the local
`nature. Stopping along the way, images of the garden may be
`collected using the camera functionality of cell phone 102.
`Along with collecting the images, additional information
`may be collected. For example, many portable computing
`devices like cell phone 102 include an internal clock that
`provides the time (and date) at each instance an image is
`captured. As such, data representing the time (e.g., month,
`day, hour, minute, second) that the image is captured is also
`collected and grouped with the image data (e.g., inserted into
`metadata). Other types of collected data may include param
`eters associated with the cell phone (e.g., serial and model
`number), collection parameters (e.g., image resolution) and
`other similar information.
`0019. As the individual continues to travel (and carry cell
`phone 102), position data is collected along with additional
`images captured. For example, at approximately the midpoint
`of the traveled path 104, the individual may pass by another
`landmark such as the Arc De Triomphe 108. Similarly, the
`individual may pause and capture one or more images of this
`Paris landmark along with collecting time and position infor
`mation. Continuing on, the individual may conclude the trip
`by stopping at another landmark, the location of the Eiffel
`Tower 110 (in this particular example). Similar to the other
`locations visited, images may be captured of this landmark
`along with related information (e.g., position of the capture
`location, day and time when image capture occurred). As
`mentioned, this associated information (e.g., location infor
`mation, day and time, etc.) may be assigned to the digital
`images at a later time.
`0020. In this arrangement, at the conclusion of the travel,
`significant amounts of information may be stored in cell
`phone 102. For example, along with captured images 112,
`associated location information, and day and time stamps
`may also be stored in memory onboard cell phone 102. As
`such, information may reside on cell phone 102 that repre
`sents sights experienced along the traveled path 104 and
`information that represents the location of the sights. Often to
`review the events of a trip, an individual cycles through the
`captured images and possibly adjusts the image sequence to
`correlate with the order that sights were visited. However, by
`capturing a significant number of images and traveling in a
`Somewhat meandering manner, the correlation between the
`path traveled and the captured images can become confused.
`AS Such, the individual may be unable recall the sequence that
`
`the images were captured and the path traveled. For Such
`situations, the individual may be unable to fully explain (to
`another) the path traveled or even be unable to retrace the
`traveled path (e.g., for returning to the starting point) since the
`collected images may be of little or no help. However, by
`using the associated position, time and date information (that
`correspond to each image), the captured images and locations
`visited can be correlated. Further, by combining the images,
`the position and time information, and a digital representation
`of a map, a graphical presentation may be produced that
`allows the locations of the images to be quickly identified
`along with the traveled path. Further, the combined informa
`tion may be presented in various forms and mediums, for
`example, a graphical representation of the map and the iden
`tified image locations may be presented on a computer dis
`play. In another example, the information may be incorpo
`rated into various print products (e.g., hard or soft bound
`books) that may be purchased by the individual who origi
`nally captured the images.
`0021
`Referring to FIG. 2, a computer system is presented
`for processing the captured images and associated informa
`tion to generate print product layouts. One or more techniques
`may be used to provide captured images 112 to a computer
`system 200 (e.g., a server). For example, hard-wire connec
`tions (e.g., USB) or wireless connections with cellphone 102
`may be implemented to transfer the data (e.g., image content,
`position data, time and date stamps, etc.). Various networking
`techniques and systems may also be used for data transfer. For
`example, captured images 112 may be directly uploaded to
`computer system 200 from another computing device (e.g.,
`the individual's personal computer, cellphone 102, etc.) or by
`way of one or more networks (e.g., local area networks, wide
`are networks, the Internet, etc.). Once provided, computer
`system 200 may store the transferred data at one or more
`storage devices such as storage device 202 (e.g., memory, a
`hard drive, CD-ROM, etc.).
`0022. To produce a graphical representation Such as a
`digital map, computer system 200 also accesses data that
`represents locations that may be included in a map. In this
`arrangement, map data 204 is stored in storage device 202,
`which may also store the received images (e.g., images 112)
`along with position and time information. However, in some
`arrangements this information may distributed among mul
`tiple storage devices or preserved by other data storing tech
`niques (e.g., storing the information at other locations via one
`or more networks).
`0023. In this arrangement, map data 204 allows graphical
`map representations to be produced that are resolution inde
`pendent. For example, global maps (e.g., maps that include
`representations of multiple countries) and national maps
`(e.g., maps that include regions of a nation) may be produced.
`Continuing down in Scale, maps may also be produced at the
`state, county and city level. Scaling even further down, Street
`level and neighborhood maps could be produced that resolve
`individual properties (e.g., building, homes, businesses, etc.).
`One or more techniques may be implemented to produce
`maps of Such relatively large and Small scales. For example,
`map data 204 may represent a collection of polygons that
`represent the shapes of each feature on the planet. Such a
`collection may include hundreds of thousands or even mil
`lions of polygons to represent the individual shapes. Used
`individually or in combination, the polygons can produce
`large scale shapes (e.g., the geographical shape of France)
`and represent Small features (e.g., Small islands, river bends,
`
`Petitioner Apple Inc. - Ex. 1028, p. 11
`
`

`

`US 2011/0074811 A1
`
`Mar. 31, 2011
`
`lakes, etc.). Since polygons are used to represent the shapes,
`various mathematical operations may be executed for Scaling
`and combining the polygons to produce a map of appropriate
`resolution.
`0024. To process the information associated with the
`images 112 (e.g., image content, associated position informa
`tion and time, etc.) and map data 204, computer system 200
`executes a map producer 206. Along with one or more soft
`ware components (e.g., functions, processes, etc.), hardware
`components (e.g., circuitry, processors, etc.) may be used
`individually or in concert with the software to provide the
`functionality of map producer 206. Various operations may
`be executed for map production, for example, map producer
`206 may access information associated with the captured
`images (e.g., position and time) to determine the associated
`location with respect to the map data 204. Operations may
`also be executed on map data 204, for example, map producer
`206 may accordingly select the polygons needed to present
`the locations associated with images 112. By selecting only
`the polygons needed to represent the locations of the images,
`map producer 206 filters unneeded polygons and thereby
`conserves computations resources (e.g., processing time and
`memory space) of computer system 200. Further, by selecting
`needed polygons in a relatively efficient manner, map pro
`ducer 206 may quickly identify polygons needed to increase
`the scale of a map and appropriately execute operations to
`process the polygons to produce the larger scale (e.g., provide
`Zoom out capabilities).
`0025. While collected images 112 may provide position
`information, which can be used by map producer 206 to
`determine the needed scale. Such information may also be
`provided from other sources. For example, user interactions
`with map producer 206 may also provide location informa
`tion. In one arrangement, map producer 206 may receive user
`interactions from a graphical user interface (GUI) that is
`accessed by the individual that provided the images 112. The
`individual may type the term, e.g., “France' into a GUI to
`alert map producer 206 to the general location that the images
`were captured. Since all of the images were captured in Paris,
`the user may insert more focused terms e.g., “Paris, France'
`into the GUI to provide the general location that the images
`were captured. To assist the user, auto-sensing techniques
`may be implemented for easily recognizing locations such as
`Paris. Assistance may also be provided by one or more graphi
`cal techniques, for example, the user may be provided a series
`of menus for selecting the general location associated with
`the images (e.g., the capture location). By using a selection
`tool (such as a mouse driven pointer), a user may manipulate
`(e.g., Zoom in and Zoom out) presented graphics to identify an
`appropriate region for a digital map. For example, by select
`ing a graphical representation for France, the map producer
`206 may Zoom in to display the individual regions and cities
`of France. Since the polygons used to provide the displayed
`digital map (of France) can be quickly accessed, map pro
`ducer 206 can relatively quickly produce a digital map of a
`region of interest (at Substantially any scale). Further, by
`allowing the user to interact with displayed digital maps,
`dynamic Zooming in and out of the maps is provided.
`0026. In this particular arrangement, a digital map 208 is
`generated by map producer 206 and represents the general
`region that images 112 are associated (e.g., Paris, France). To
`indicate these associated locations, digital map 208 is anno
`tated with a graphical pin 210. The geographical position of
`graphical pin 210 may have been provided by the position
`
`information associated with the images 112. The location of
`graphical pin 210 may also be provided from user interac
`tions. For example, through a GUI, a user may have selected
`the general location of Paris, France by translating across a
`representation of a digital map of the globe and by usingZoom
`in and out capabilities provided by map producer 206.
`0027. Once associated with digital map 208 (as repre
`sented by graphical pin 210), the images and the position data
`may be incorporated into one or more graphical representa
`tion that implement various types of medium. For example,
`map producer 206 may represent the images and information
`in a project 212 that catalogs other travels of the user. In one
`arrangement, project 212 may contain information associated
`with various global or European travels of the user and digital
`map 208 and images 112 may be inserted as one chapter (e.g.,
`“A trip to Paris, France') in the project. Project 212 may
`provide many uses for the stored images and information, for
`example, the material may be viewed, edited and used to
`produce print products. For example, boundbooks (e.g., hard
`bound, soft bound, wire bound, etc.) books may be produced
`from the information included in project 212. Other types of
`operations that use project 212 may also be executed by map
`producer 206, for example, the content of the project may be
`combined with content from one or more other projects.
`0028 Referring to FIG. 3, while generating digital map
`208, map producer 206 may execute operations directed to
`both the content to be included in the map and the presenta
`tion of the map. For example, once provided the position
`information (of the images) map producer 206 may determine
`the approximate center of the digital map. Further, from the
`distribution of the image position information, map producer
`206 may determine an appropriate scale for the map. As
`illustrated in FIG. 4, in one arrangement, a maximum scale
`may be selected such that all of the position information is
`resolved on a single map. Centering and Scaling of a digital
`map may also be initiated by other types of information. For
`example, information provided by a GUI (e.g., user enters the
`phrase “Paris, France') may be used to determine the map
`center. Further, by providing information that identifies mul
`tiple locations, map producer 206 may determine an appro
`priate scale for the map. Along with initially determining map
`parameters such as center and scale, map producer 206 may
`also adjust the parameters, for example, when additional
`information is provided. In one arrangement, upon being
`provided one or more additional images (with corresponding
`position information), map producer 206 may use the newly
`provided information to adjust a previously produced digital
`map. For example, to appropriately represent the image cap
`ture location on the map, map producer 206 may re-scale the
`map. Similarly, based upon the location provided by the
`image capture position information, map producer 206 may
`shift the center of the map. To provide Such adjustments, map
`producer 206 may use various mathematical operations such
`as interpolation and estimation. Once appropriately adjusted,
`map producer 206 may initiate the rending of the adjusted
`map along with other operations (e.g., storing the adjusted
`map).
`0029 Map producer 206 may provide other operations for
`producing and adjusting digital maps such as digital map 208.
`For example, graphical properties of digital map 208 may be
`adjusted. Properties of presented text (e.g., font, size, color,
`style, etc.) may be adjusted by map producer 206 as directed
`through user interactions or by predefined preferences. Pre
`sented colors and textures of portions of digital map 208 may
`
`Petitioner Apple Inc. - Ex. 1028, p. 12
`
`

`

`US 2011/0074811 A1
`
`Mar. 31, 2011
`
`also be adjusted through user interactions with map producer
`206. For example, a GUI may be provided that allows a user
`to control the style of a map to be rendered (e.g., fill colors,
`adjust shading, texture, gradient, etc.). Some of the adjustable
`map portions include the content of the map (e.g., presented
`color of an individual country or state, etc.), presentation
`graphics (e.g., the color of a border that frames the map) and
`other data associated with the map. One or more stylistic
`effects may also be applied to various map portions by map
`producer 206 based upon the content of the map. For
`example, particular styles may be applied to particular map
`regions (e.g., one set of style settings may be applied to the
`European region of a map while another set of styles are
`applied to the Asian region of the map). Application of dif
`ferent styles may also depend upon information associated
`with the user. For example, one or more styles may be applied
`to regions (e.g., defined by geography, geo-political geogra
`phy, etc.) visited by the user. Such styles associated with a
`map may be implemented by utilizing one or more tech
`niques. For example, the styles and style adjustments may be
`represented in one or more extensible markup language
`(XML) layers. Map producer 206 may also allow various
`graphics to be added to a digital map (e.g., as directed by a
`user). For example, textual information (e.g., map title, labels
`for points of interest, notes for describing the map, favorite
`locations, etc.) Such as label300 and graphics (e.g., a graphi
`cal representation of a compass) may be added in an editable
`form. Map content may also be adjusted by map producer
`206. For example, a menu (or other type of graphical tool)
`may be presented Such that a user may select types of content
`that may be included or removed from a map. In one arrange
`ment, a series of radio buttons may be provided for toggling
`presented content such as contours (e.g., elevation contours),
`bodies of water (e.g., rivers, lakes, inland waters), transpor
`tation information (e.g., graphical representations of Streets,
`highways, airports), landmarks (e.g., natural occurring and
`constructed), etc. In some arrangements, map producer 206
`may form an association between a digital map and one or
`more file or documents. For example, an itinerary or other
`document associated with a trip may be associated with a
`digital map. By combining the information, along with View
`ing the images from a trip, a user can trace their travels with
`the itinerary information.
`0030 Referring to FIG. 4, a series of three digital maps
`400(a), (b) and (c) are shown that illustrate the Scaling capa
`bility of map producer 206. From the position information
`(e.g., geographical coordinates) associated with the images,
`map producer 206 may identify the approximate center of a
`digital map. In this particular arrangement, all of the sites
`associated with the images are located in Paris, France. As
`Such, map producer 206 uses one or more techniques (e.g.,
`estimation) to determine the geographical center of the asso
`ciated image location. In this particular example, a center
`location falls geographically between the locations of the
`Jardins Des Tuileries, the Arc De Triomphe and the Eiffel
`Tower. With the center location (and corresponding coordi
`nates) identified, map producer 206 may execute operations
`on the appropriate polygons of map data 204 produce a digital
`map that is centered on this location. Further, map producer
`206 manipulates the appropriate polygons to magnify the
`center location (e.g., Zoom in) until each of the associated
`image locations is resolved. For illustration, map producer
`206 Zooms in from a representation of Europe, shown by
`digital map 400(a), to a representation that resolves indi
`
`vidual regions of France, shown by digital map 400(b). While
`map producer 206 Zooms from digital map 400(a) to map
`400(b), the center location (Paris) is retained. To resolve the
`associated locations, map producer 206 continues to manipu
`late the appropriate polygons (e.g., estimate and interpolate).
`While still centered on equivalent coordinates used to center
`maps 400(a) and (b), digital map 400(c) illustrates three
`graphical pins 402, 404 and 406 that corresponding identify
`the locations of the Jardins Des Tuileries, the Arc De Tri
`omphe and the Eiffel Tower. While rather simplistic graphics
`are used for the graphical pins 402,404, 406, in Some arrange
`ments other types of graphics may be implemented. For
`example, various types of graphic icons may be used to assist
`viewing by forming a quick association between the map and
`the locations. A small icon of a flower could be used in place
`of graphical pin 402 and correspondingly an icon of an arch
`could be used in place of graphical pin 404 and an icon of a
`tower could replace graphical pin 406. Other types of graph
`ics may also be used to represent the capture locations, for
`example, Smaller versions of the captured images (e.g.,
`thumbnail images) or textual information (e.g., initials such
`as “ET for Eiffel Tower) may be implemented with or with
`out graphical information.
`0031 Similar to larger scale maps, map producer 206 also
`allows aspects of digital maps such as map 400(c) to be
`adjusted. For example, map features (e.g., Streets, landmarks,
`rural areas, marine areas, etc.) may be represented with vari
`ous adjustable colors, textures and other types of graphics.
`Along with the positions of the image capture locations, other
`information may also be represented on digital map 400(c).
`For example, by processing the time and date information
`associated with the images, map producer 206 may determine
`the sequence that the locations associated with the images
`(e.g., the capture locations) were visited. In this illustration,
`photographs were first captured at the Jardins Des Tuileries,
`then at the Arc DeTriomphe, and lastly at the Eiffel Tower. As
`Such, map producer 206 may identify the visit sequence for
`these landmarks and graphically represent the sequence. For
`example, one graphical line 408 is included with digital map
`400(c) to indicate the distance and direction traveled from the
`Jardins Des Tuileries (represented by graphical pin 402) to the
`Arc De Triomphe (represented by graphical pin 404). Simi
`larly, map producer 206 also includes a graphical line 410 to
`represent the distance and direction traveled from the Arc De
`Triomphe (represented by graphical pin 404) to the Eiffel
`Tower (represented by graphical pin 406). Other information
`and types of information may also be represented on digital
`map 400(c). Graphical icons may be placed upon the map by
`a user, for example, icons (e.g., a knife and fork, a bed, etc.)
`may be positioned at particular locations to represent loca
`tions visited (e.g., restaurants, hotels, etc.), for example,
`where images were not captured. As such, various types of
`graphical markers may be directly added by a user to a map
`(e.g., selecting one or more locations with a pointing device
`such as a mouse). Referring to FIG. 5, a GUI 500 is shown that
`illustrates various types of graphical information that may be
`presented. For example, based upon the location of a graphi
`cal pointer (e.g., as controlled by a mouse) an identifier 502 is
`added directly to digital map 504 to represent geographic
`location of Paris, France. A menu 506 allows a user to control
`the presentation of particular graphics. For example, a title
`associated with digital map 504, text associated with identi
`fier 502, text associated with a region of digital map 504, a
`graphical compass, texture and shadow graphics, and other
`
`Petitioner Apple Inc. - Ex. 1028, p. 13
`
`

`

`US 2011/0074811 A1
`
`Mar. 31, 2011
`
`types of graphics may be represented. For example, textual
`labels and blocks may also be added by a user to provide
`context and fu