(12) United States Patent
`Flora et al.
`
`USOO6714215B1
`(10) Patent No.:
`US 6,714,215 B1
`(45) Date of Patent:
`Mar. 30, 2004
`
`(75)
`
`(73)
`
`ASSignee:
`
`Notice:
`
`(54) SYSTEM AND METHOD FOR DISPLAYING
`MEDIA INTERACTIVELY ON A WIDEO
`
`DISPLAY DEVICE
`William T. Flora, Seattle, WA (US);
`Inventors:
`Robert Edward Parkin, Redmond, WA
`(US); Christopher R. Fox, Seattle, WA
`(US); Gregory R. Slayden, Kirkland,
`WA (US)
`Microsoft Corporation, Redmond, WA
`(US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`Appl. No.: 09/574,375
`Filed:
`May 19, 2000
`Int. Cl................................................... G06F 3/14
`U.S. Cl. ....................... 345/716; 345/859; 34.5/862;
`345/838; 715/501.1
`Field of Search ................................. 345/856, 854,
`345/716–718, 859–862, 835, 839, 838,
`711, 764, 968,808, 809, 730; 715/501.1,
`500.1; 340/990,995; 707/104.1
`References Cited
`U.S. PATENT DOCUMENTS
`5,708.845 A
`1/1998 Wistendahl et al. ..... 715/500.1
`6,175,840 B1 *
`1/2001 Chen et al. .............. 715/501.1
`6,229,524 B1 *
`5/2001 Chernock et al. ....... 345/719 X
`6,229,541 B1 *
`5/2001 Kamen et al. .............. 345/719
`
`(21)
`(22)
`(51)
`(52)
`(58)
`
`(56)
`
`:
`
`
`
`38
`
`8
`:
`a:
`
`- - - - - - - - - - - 345/730
`
`6,362,840 B1 * 3/2002 Burg et al. ................. 345/835
`2001/0033296 A1 10/2001 Fullerton et al.
`OTHER PUBLICATIONS
`PC Globe version 5.0 User's Guide, PC Globe, Inc., pp. 1-2,
`4, 10-11, 22-23, 1992.*
`* cited by examiner
`Primary Examiner Raymond J. Bayerl
`(74) Attorney, Agent, or Firm King & Spalding LLP
`(57)
`ABSTRACT
`A graphical user interface (GUI) allows a user to directly
`acceSS items of Visual and/or audio media by passing a
`cursor over points on an electronic map. Indicators in the
`form of icons representing media items can be displayed and
`can be accessed through a media Viewer. A determination is
`made whether a position indicator or pointer, Such as a
`cursor, is located proximate to a GUI location that is
`asSociated with Supplemental content in the form of a media
`item. If So, an indicator is presented to advise the user that
`Supplemental content is indeed asSociated with that location
`on the interface. For example, a media icon representing one
`or more media items can be displayed on the output device
`proximate to the location of the input device indicator. This
`indicator Serves as a prompt or cue for the user to Select the
`indicator if the user desires to review the Supplemental
`content. A determination is made whether the media icon has
`been selected in response to an input signal issued by an
`input device. If So, the Selected media item, typically video
`and/or audio information, is presented to the user via the
`output device.
`19 Claims, 6 Drawing Sheets
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 1 of 15
`
`

`

`U.S. Patent
`
`Mar.30, 2004
`
`Sheet 1 of 6
`
`US 6,714,215 B1
`
`
`
`1aze,yWWHDOudEWVEDOUd |=
`
`
`NoLvorddvNouWvonddy|24E
`
`
`wooer
`
`lé
`
`O00
`
`YOLINOW
`
`VadWOO)
`
`YAYOMLIN
`
`el
`
`VauVSIM;
`
`MYOMLIN
`WIdas
`
`JOVIYSLNI
`SOVAYSLNI
`1uOd
`
`SN@W3LSAS
`
`SIOGYVH
`
`SANG
`
`SOVIYNSLNI
`
`cE
`
`WYLNAD
`
`SNISSSOONd
`
`
`
`(Mdd)LINN
`
`
`
`dVSINOY.LO314
`
`ZéNOILWOMddV
`
`9EONVesdO
`~.W3iSAS
`
`9(OY)
`
`UNIFIED PATENTS EXHIBIT 1005
`UNIFIED PATENTS EXHIBIT 1005
`Page 2 of 15
`Page 2 of 15
`
`
`
`
`
`
`
`
`

`

`Patent
`
`Mar. 30, 2004
`
`Sheet 2 of 6
`
`US 6,714,215 B1
`
`
`
`52
`51 -
`
`SO
`
`53
`
`O
`
`MS
`
`A8
`
`4.
`
`al
`
`FIG. 2
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 3 of 15
`
`

`

`U.S. Patent
`
`Mar. 30, 2004
`
`Sheet 3 of 6
`
`US 6,714,215 B1
`
`: :
`
`8.
`
`
`
`it. 3
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 4 of 15
`
`

`

`U.S. Patent
`
`START
`
`Mar. 30, 2004
`74
`Execute
`Application
`
`
`
`Sheet 4 of 6
`No
`y 76
`Filter Media
`
`US 6,714,215 B1
`
`No
`
`Yes
`
`
`
`
`
`No
`
`proximate to
`locations with
`media?
`
`Yes
`Media icon
`Window(s) appear
`on map
`
`FIG. 4
`
`86
`Multiple
`media at this
`location?
`
`88
`Cycle media
`in icon
`window
`
`Yeso
`
`NO
`
`O
`
`90
`
`Yes 92
`Media viewer
`appears
`
`
`
`
`
`
`
`Play audio
`media?
`
`Display other
`media icons
`
`
`
`Play audio
`media
`
`Yes V 102
`Exit software
`
`y 104
`Expanded visual
`media opens
`
`END
`
`
`
`Exit software?
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 5 of 15
`
`

`

`U.S. Patent
`
`151
`START
`
`Sheet 5 of 6
`Mar. 30, 2004
`FIG. 5A
`
`152
`User moves Cursor
`over map
`
`US 6,714,215 B1
`
`-
`
`154
`Check media
`locations list
`
`156
`Check media IDs
`list
`
`
`
`edia to be
`retrieved?
`
`No
`
`Pause for 250
`Sec
`
`
`
`Yes
`162
`Assess category
`— status for each ke
`media location
`
`
`
`
`
`164
`Retrieve all
`Category 4. items (Yes
`sequentially
`
`ny categos
`4 items?
`
`166
`------,
`Retrieve one item
`No-r-?—D for each category
`1 location
`
`No
`
`167
`Update India IDs
`st
`v 168
`Update media
`locations list
`---
`170
`a
`Notify interface
`thread that new
`media item
`retrieved
`
`
`
`18O
`locations in
`category 3?
`
`
`
`182
`Yes Pause for
`250 msec
`
`
`
`
`
`
`
`Does eac
`category 1
`location have item
`retrieved?
`
`Yes
`172
`Retrieve One
`media items for
`One category 2
`location
`
`.
`
`174
`Update media IDs
`list
`176
`. Y.,
`. .
`Update media
`locations list
`178
`— Notify interface
`thread that new
`media item
`retrieved
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 6 of 15
`
`

`

`Sheet 6 of 6
`
`US 6,714,215 B1
`
`Yes
`122
`Create Smaller
`Cursor block
`126
`Wait until user
`rowes cursor
`again
`
`No
`
`
`
`
`
`
`
`U.S. Patent
`
`116
`START
`
`120 y No
`Create 1"
`Cursor block
`
`
`
`
`
`
`
`Mar. 30, 2004
`FIG.
`
`117
`User moves CurSOr
`Over map
`
`18
`CPU slow?
`
`Any locations
`within Cursor block
`with media?
`
`previously entere
`on media locations
`
`130
`v
`Create and/or
`update media
`locations list
`v
`132
`ASSess media
`types at location(s)
`
`Yes
`136
`Update media
`OS list
`
`lcon N38
`windows near
`cursor
`ocation2
`
`
`
`
`
`...151
`...
`Display media -
`items in icon
`window through
`Cycling
`------
`Yes
`
`
`
`
`
`
`
`media item per
`icon window?
`
`NO
`
`150
`Display media
`item in icon
`Window
`
`146
`Update icon
`windows media
`list
`
`144
`Receive retrieved
`items info from
`retrieval thread
`
`Yes
`
`Create icon
`windows
`
`142
`... with
`ASSOciate
`------> icon windows
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 7 of 15
`
`

`

`US 6,714,215 B1
`1
`SYSTEMAND METHOD FOR DISPLAYING
`MEDIA INTERACTIVELY ON A WIDEO
`DISPLAY DEVICE
`
`TECHNICAL FIELD
`The present invention relates to interactive electronic
`maps. More specifically, the invention relates to an interac
`tive map that allows users to display different items of Visual
`and/or audio media corresponding to a location on the
`geographic map.
`BACKGROUND OF THE INVENTION
`AS computer technology has advanced, atlases have been
`published in electronic form. These electronic atlases make
`it possible to include vast amounts of information on a few
`compact discs (or CD-ROMs). This information includes
`electronic maps and items of Visual and/or audio media.
`Although the advent of electronic atlases has made Such
`media more accessible and the relationship between elec
`tronic maps and Such media more direct and interconnected,
`the prior art did not provide users with an efficient mecha
`nism for easily locating and associating Such media with
`electronic maps.
`To allow users to more easily associate Such media with
`electronic maps, one prior art electronic atlas provided a
`limited level of association between Visual and/or audio
`media and electronic maps. For example, prior art atlases
`have displayed representations of certain types of Visual
`media directly on the face of an electronic map. This allowed
`a user to View the media on a pre-determined location upon
`the face of the map. Although this atlas was useful, the
`media content and map were not interactive and Supported
`the use of limited quantity, Variety and types of media.
`In another prior art atlas, media icons were displayed
`upon the face of an electronic map when the user passed a
`input device position indicator, Such as a cursor, over
`locations on the map with which a media item or items had
`been associated or linked. The user could then access a
`full-size or complete version of the media item by Selecting
`the location, typically by using an input device to issuing an
`input signal, and opening a separate window, Such as a
`dialog box. Selecting the item via the dialog box presented
`to the user accesses the desired media item. Although Such
`electronic maps were interactive, these prior maps allowed
`a user only to See media representations from an exact
`location, e.g., within a few pixels of the cursor, at the same
`time. Moreover, the prior electronic maps only allowed the
`user to access the full-size or complete media item indirectly
`by Selecting the media item from within a dialog box or
`other tabular form. In addition, Such electronic maps did not
`provide the user with any ability to filter or restrict the type
`of Visual and/or audio media that the user could locate by
`interacting with the electronic map.
`Consequently, there is a need in the art for an electronic
`atlas that provides a direct interface to visual and/or audio
`media through an interactive electronic map. Moreover,
`there is a need for an electronic map that provides a user with
`direct access to large amounts of media at the same (or a
`very short) time period and over a larger area of an electronic
`map. As a result of Such increased access to media, there is
`a corresponding need for the ability to filter or restrict the
`type of media that a user can locate by interacting with an
`electronic map. Also, as a result of Such increased media
`access, there is a corresponding need for retrieving and
`displaying Such media in an efficient manner.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`SUMMARY OF THE INVENTION
`The present invention Solves the aforementioned prob
`lems existing in the prior art by providing an interactive
`interface between a user and graphical user interface for
`presenting electronic content, Such as a geographical map.
`For example, the present invention can Support the presen
`tation of a Scalable interactive geographic map having
`Selectable content associated with map locations. The map
`can be scaled from a global view down to view of individual
`cities and towns. At any point along this Scale, the user can
`interact with the map and be presented with media associ
`ated with locations on the map. The present invention can be
`utilized with a variety of graphical content presented in an
`electronic format, including road maps, photographs, or
`other types of graphical user interfaces.
`The present invention Supports the presentation of media
`items interactively via an output device, Such as a video
`display device for a computer. The present invention allows
`a user to interact with a geographic map to facilitate access
`to content associated with locations of the electronic map,
`including items of Visual and/or audio media. For example,
`a user can use an input device, Such as a mouse, to pass a
`position indicator presented in the conventional form of a
`cursor over an electronic geographic map. In the alternative,
`the user can use one or more keyboard commands to move
`the position indicator to a Selected location on the electronic
`map. If the cursor passes within a pre-Selected distance of a
`predetermined point on the map that is associated with at
`least one media item, the user can be presented each media
`icon representing available media items at that location. The
`user can then pass the cursor over a displayed media icon
`and directly access the media item by Selecting the media
`icon with a "click” of a mouse button. In this manner, the
`user can access an expanded version of a Selected visual
`media item, play and replay a Selected audio media item, and
`Select hyperlinks associated with related content.
`A user can interact directly with the geographic map to
`acceSS media items, Such as graphic and text-based visual
`media and audio media without the necessity to access the
`media through the indirect use of a dialog box or other
`device. This interaction allows a user to Select a location on
`the geographic map and to be presented with media items
`that are associated with the Specific, chosen location and
`those items associated with locations within a predetermined
`distance thereof. Further, the present invention allows a user
`to customize the interactive nature of the invention by
`filtering and/or restricting the type and categories of media
`with which the user will be presented during their interaction
`with the map. Due to limits in computing power of machines
`used by particular users, the present invention can present
`media in an efficient manner that provides a user with the
`perception that the invention is responding quickly to the
`user's inputs. For example, the amount of media available
`for presentation at a chosen location on the map can be
`restricted when a user's computer has a slower processing
`Speed. This restriction is performed in a manner that is not
`perceived by the user and, ultimately, provides the user with
`the perception that the invention is responding quickly to the
`user's inputs.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a block diagram of a personal computer that
`provides an exemplary operating environment for the
`present invention.
`FIG. 2 is an exemplary display Screen of a Software
`program that illustrates the display of a media icon in
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 8 of 15
`
`

`

`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`US 6,714,215 B1
`3
`4
`Although the preferred embodiment will be generally
`response to a Selection of a location on an electronic
`geographic map.
`described in the context of a program and an operating
`System running on a personal computer, those skilled in the
`FIG. 3 is an exemplary display Screen of a Software
`art will recognize that the present invention also can be
`program that illustrates the display of a full-size image of an
`implemented in conjunction with other program modules for
`item of Visual media in direct response to a user clicking on
`other types of computers. Furthermore, those skilled in the
`a visual media icon on an electronic geographic map.
`art will recognize that the present invention may be imple
`FIG. 4 is a logic flow diagram illustrating an exemplary
`mented in a Stand-alone or in a distributed computing
`proceSS for displaying media items interactively upon a
`environment. In a distributed computing environment, pro
`Video display device.
`gram modules may be physically located in different local
`FIG. 5A is a logic flow diagram illustrating an exemplary
`and remote memory Storage devices. Execution of the pro
`proceSS for identifying and retrieving media items into a
`gram modules may occur locally in a Stand-alone manner or
`computer for the purpose of displaying Such items on a video
`remotely in a client/server manner. Examples of Such dis
`display device.
`tributed computing environments include local area net
`Works of an office, enterprise-wide computer networks and
`FIG. 5B is a logic flow diagram illustrating an exemplary
`the global Internet.
`proceSS for identifying and retrieving media items into a
`computer for the purpose of displaying Such items on a video
`In addition, it should be understood that the programs,
`display device.
`processes, methods, etc., described herein are not related or
`limited to any particular computer or apparatus, nor are they
`related or limited to any particular communication network
`DETAILED DESCRIPTION OF THE
`architecture. Rather, various types of general-purpose
`EXEMPLARY EMBODIMENTS
`machines may be used with program modules constructed in
`The present invention Supports the presentation of media
`accordance with the teachings described herein. Similarly, it
`items interactively via an output device, Such as a video
`may prove advantageous to construct a specialized apparatus
`display device for a computer. The present invention allows
`to perform the computer-Supported processes described
`a user to interact with a graphical user interface ("GUI”),
`herein by way of dedicated computer Systems in a specific
`Such as a geographic map, to facilitate access to content
`network architecture with hardwired logic or programs
`asSociated with locations of the electronic map, including
`Stored in nonvolatile memory, Such as read-only memory.
`items of Visual and/or audio media. For example, a user can
`Referring now to the drawings, in which like numerals
`use an input device, Such as a mouse, to pass a position
`represent like elements throughout the Several figures,
`indicator presented in the conventional form of a cursor over
`aspects of the present invention and the preferred operating
`an electronic geographic map. In the alternative, the user can
`use one or more keyboard commands to move the position
`environment will be described. FIG. 1 illustrates various
`aspects of the preferred computing environment in which the
`indicator to a Selected location on the electronic map. If the
`present invention is designed to operate. Those skilled in the
`cursor passes within a pre-Selected distance of a predeter
`art will appreciate that FIG. 1 and the associated discussion
`mined point on the map that is associated with at least one
`are intended to provide a brief, general description of the
`media item, the user can be presented each media icon
`preferred computer hardware and program modules, and that
`representing available media items at that location. The user
`additional information is readily available in the appropriate
`can then pass the cursor over a displayed media icon and
`programming manuals, user's guides, and Similar publica
`directly access the media item by Selecting the media icon
`tions. FIG. 1 illustrates a conventional personal computer 10
`with a “click” of a mouse button. In one exemplary
`Suitable for Supporting the operation of an exemplary
`embodiment, the media items are presented through the use
`embodiment of the present invention. As shown in FIG. 1,
`of a window frame on a video display device in the form of
`the personal computer 10 operates in a networked environ
`a media Viewer. Using the media viewer, the user can acceSS
`ment with logical connections to a remote computer 11. The
`an expanded version of a Selected Visual media item, play
`logical connections between the personal computer 10 and
`and replay a Selected audio media item, and Select hyper
`the remote computer 11 are represented by a local area
`links associated with related content.
`network (LAN)12 and a wide area network (WAN) 13. In
`The present invention also can Support the creation of a
`this client/server configuration, the remote computer 11 may
`perception by the user that a processor operating at a
`function as a file Server or computer Server.
`relatively slow processing Speed is fully responsive to
`The personal computer 10 includes a central processing
`commands to present desired electronic content. For one
`unit (CPU) 14, such as “PENTIUM microprocessor manu
`exemplary embodiment, a threshold boundary is positioned
`factured by Intel Corporation of Santa Clara, Calif. The
`proximate to and Surrounds each electronic map location. In
`personal computer also includes System memory 15
`the event that the cursor crosses this threshold boundary, an
`(including read-only memory (ROM) 16 and random access
`icon representing content for a media item is presented to the
`memory (RAM) 17), which is connected to the CPU 14 by
`user. The distance Separating the threshold boundary from
`a system bus 18. The preferred computer 10 utilizes a BIOS
`the electronic map location can be reduced when a deter
`mination is made that the computer operates at a relatively
`19, which is stored in ROM 16. Those skilled in the art will
`recognize that the BIOS 19 are a set of basic routines that
`Slow processing Speed. This reduction is the threshold
`helps to transfer information between elements within the
`distance to the electronic map location Supports the presen
`personal computer 10. Those skilled in the art will also
`tation of an icon representing a media item only when the
`appreciate that the present invention may be implemented on
`cursor is placed on or adjacent to that location. In addition,
`computers having other architectures, Such as computers
`two Sets of Software instructions can operate through multi
`that do not use a BIOS, and those that utilize other types of
`tasking to Structure the identification and retrieval of media
`microprocessors.
`items. This multi-tasking thread architecture can create the
`perception by a user that media items are available shortly
`Within the personal computer 10, a local hard disk drive
`after the user places the cursor proximate to an electronic
`20 is connected to the system bus 18 via a hard disk drive
`map location having associated media items.
`interface 21. A floppy disk drive 22, which is used to read or
`
`55
`
`60
`
`65
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 9 of 15
`
`

`

`1O
`
`15
`
`25
`
`35
`
`US 6,714,215 B1
`6
`S
`Although this embodiment utilizes a Scalable geographic
`write a floppy disk 23, is connected to the system bus 18 via
`map, those skilled in the art will recognize that the present
`a floppy disk drive interface 24. A DVD/CD-ROM drive 25,
`which is used to read a DVD or CD-ROM disk 26, is
`invention can be utilized with other electronic forms of
`graphical content, Such as road maps, animation,
`connected to the system bus 18 via a DVD/CD-ROM
`photographs, etc. In this embodiment, media items, typically
`interface 27. A user enters commands and information into
`represented by icons 42 (or “thumbnail” versions), are
`the personal computer 10 by using input devices, Such as a
`displayed when a position indicator, shown as cursor 44, is
`keyboard 28 and/or pointing device, Such as a mouse 29,
`moved proximate to certain locations on an electronic geo
`which are connected to the system bus 18 via a serial port
`graphic map 46. These icons 42 notify the user that media
`interface 30. Other types of pointing devices (not shown in
`items are associated with predetermined coordinates or
`FIG. 1) include track pads, track balls, pens, head trackers,
`“locations' on the map that are proximate to the position of
`data gloves and other devices Suitable for positioning a
`the cursor 44. The icons 42 further provide the user with a
`cursor on a computer monitor 31. The monitor 31 or other
`visual object to select with the “click” of a mouse button (or
`kind of display device is connected to the system bus 18 via
`another conventional mechanism) to obtain direct access to
`a Video adapter 32.
`the content of the associated media items. All map locations
`The remote computer 11 in this networked environment is
`are not necessarily associated with media items. For
`connected to a remote memory Storage device 33. This
`example, if the user moves the cursor 44 to a new location
`on the electronic map, the icons 42 displayed proximate to
`remote memory Storage device 33 is typically a large capac
`the old location will eventually disappear or fade after a
`ity device such as a hard disk drive, DVD/CD-ROM drive,
`pre-determined period of time. If content is associated with
`magneto-optical drive or the like. The personal computer 10
`the new location, however, new icons will appear proximate
`is connected to the remote computer 11 by a network
`to the new cursor position.
`interface 34, which is used to communicate over the local
`The exemplary geographic map 46 of the globe is Scalable
`area network 12.
`and can show fine levels of geography, Such as individual
`As shown in FIG. 1, the personal computer 10 is also
`cities and towns. The user may interact with a displayed
`connected to the remote computer 11 by a modem 35, which
`icons 42 to gain access to further information regarding the
`is used to communicate over the wide area network 13, Such
`Subject of the displayed icon. For example, the user can
`as the global Internet. The modem 35 is connected to the
`quickly See what media items, if any, are available at a
`system bus 18 via the serial port interface 30. The modem 35
`chosen location by moving the cursor over an area of the
`also can be connected to the public Switched telephone
`map 46 proximate to that location. For visual media, the user
`network (PSTN) or community antenna television (CATV)
`is presented with icons 42 or “thumbnail' versions of the
`network. Although illustrated in FIG. 1 as external to the
`available media items associated with one or more locations
`personal computer 10, those of ordinary skill in the art will
`proximate to the position of the cursor 44. In addition, as the
`quickly recognize that the modem 35 may also be internal to
`geographic map is Scaled upwards or downwards, the num
`the personal computer 11, thus communicating directly via
`ber of locations (that are associated with media items) are
`the system bus 18. It is important to note that connection to
`reduced or increased respectively. Thus, the user will be
`the remote computer 11 via both the local area network 12
`presented with a larger number of media items when the map
`and the wide area network 13 is not required, but merely
`46 is scaled to show finer detail and will be presented with
`illustrates alternative methods of providing a communica
`a Smaller number of media items when the map 46 is Scaled
`tion path between the personal computer 10 and the remote
`to show a lower level of detail. This prevents the map 46
`computer 11.
`from becoming visually cluttered or crowded and thereby
`40
`Although other internal components of the personal com
`confusing the user during interaction with the map 46.
`puter 10 are not shown, those of ordinary skill in the art will
`The exemplary embodiment of FIG. 2 can allow a user to
`appreciate that Such components and the interconnection
`restrict the media to be presented to different types and
`between them are well known. Accordingly, additional
`categories of media through the use of a media menu 50 with
`details concerning the internal construction of the personal
`the listed media categories 53. Representative media cat
`computer 10 need not be disclosed in connection with the
`egories include images relating to people, places,
`present invention.
`landscapes, agriculture and industry and animals, audio
`Those skilled in the art will understand that program
`media relating to national anthems and music of the World;
`modules Such as an operating System 36 and application
`and Visual media representing national flags. It will be
`programs, Such as an interactive electronic map application
`appreciated that the present invention can be extended to
`37, are provided to the personal computer 10 via computer
`include any and all types of Visual and/or audio media. To
`readable media. In the preferred computer, the computer
`exercise this option, the user chooses the desired media
`category or categories by using an input device, Such as a
`readable media include the local or remote memory Storage
`mouse, to Select an icon 52 and thereby open the media
`devices, which may include the local hard disk drive 20,
`menu 50. Thereafter, the user may use an input device to
`floppy disk 23, DVD/CD-ROM 26, RAM 17, ROM 16, and
`choose the particular category or categories of media to be
`the remote memory storage device 33. In the preferred
`retrieved when interacting with the geographic map 46.
`personal computer 10, the local hard disk drive 20 is used to
`Store data and programs, including the interactive electronic
`In FIG. 2, a user has restricted the categories of media to
`map 37. During user operation of the preferred computer 10,
`“images” by Selecting this category on the media menu 50.
`data and programs can be retrieved from the local hard disk
`The user has also used an input device, Such as a mouse, to
`drive 20 and are stored in local memory, such as RAM 17.
`find locations associated with images by placing the cursor
`44 over a position on the geographic map 40. In response to
`Turning now to FIGS. 2-5B, an exemplary embodiment
`the user input, media icons 42 representing all images
`of the present invention is described via the conventional
`asSociated with locations proximate to the cursor are dis
`Software illustration tools of representative display Screens
`played to the user.
`and logical flow chart diagrams. FIG. 2 is a display Screen
`showing the graphical user interface (GUI) component 40 of
`FIG. 3 is a display screen showing the GUI 40 of an
`an exemplary embodiment of the present invention.
`alternative exemplary embodiment of the present invention.
`
`55
`
`45
`
`50
`
`60
`
`65
`
`UNIFIED PATENTS EXHIBIT 1005
`Page 10 of 15
`
`

`

`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`US 6,714,215 B1
`8
`7
`diagram. In this embodiment, the user Selects the electronic
`In this view, a user has restricted the type of media to be
`presented to all "images” by Selecting that category from the
`map program for operation. The user may then Select
`media categories 53 listed on the media menu 50. The user
`whether or not to filter retrievable media items in step 76.
`has also passed the cursor 56 over the map to a position that
`The user then chooses whether to move a position indicator
`is proximate to locations associated with imageS. In
`or pointer, Such as a cursor, over the electronic map by use
`response to this user input, the user is presented with icons
`of an input device in Step 78. A determination is made as to
`58 representing images (the restricted media category) asso
`whether the cursor has been moved proximate to locations
`ciated with the locations proximate to the cursor 56.
`on the map that are associated with media items in Step 82.
`If the cursor is moved to a point that is associated with
`In the exemplary embodiment shown in FIG. 3, there are
`media, media icon windows appear on the map in Step 84.
`multiple visual media items associated with the locations
`proximate to the cursor 56 that have associated media items.
`If no media items are associated with the cursor location, the
`Only a single icon 59 can be presented for each specific
`user can continue moving the cursor until it contacts Such a
`location in a reduced-pixel or “thumbnail” format due to the
`location in step 78. In step 86, a determination is made as to
`limited Size of the geographic map 46. In order for the user
`whether there are multiple media items associated with the
`to be presented with all icons for available media, icons
`locations proximate to the cursor. If So, the icons of the
`representing the pertinent media items at the same location
`various media items are cycled in step 88. After the icons
`on the geographic map are consecutively displayed to the
`have been displayed and/or cycled, the user may choose to
`user. This process of Scrolling among the available icons at
`click on a displayed icon 90. Otherwise, the user may
`an electronic map location is referred to as “cycling.” Thus,
`continue to move the cursor acroSS the electronic map in Step
`an icon representing each additional media item that is
`82 or elect to exit the computer-implemented proceSS in Step
`available for the locations proximate to the cursor 56 will
`114.
`cycle in the same icon window 60 as the initially displayed
`If the user selects a displayed icon in step 90, the media
`icon 59.
`viewer 92 is opened and presented to the user. The user then
`As shown in FIG. 3, the user has moved the cursor 56 So
`has several options from within the media viewer 92. The
`as to contact one of the presented icons 59. The user has
`user can elect to review any additional media associated
`further selected the icon 59 by way of user input, such as a
`with the directly accessed media by executing available
`mouse click, So as to be given direct access to a full-size
`hyperlinkS in Step 94 and thereafter exits the process in Step
`display of one of the media items 62 represented by the icon
`102. The user also can elect to display an expanded version
`59. To provide such access, an additional window (or media
`viewer) 64 is opened and displays the full-size image of the
`of the media item, if one is available, in steps 96 and 104.
`media item 62 therein. In this embodiment, the location
`The user can elect to Scroll the other media items contained
`within the media viewer in step 98 and to display such media
`asSociated with the media item 62 is also associated with
`additional media items. Upon selection of the icon 59, one
`items within the media viewer in step 106. The user can elect
`of the media items 62 represented by the icon i