as) United States
`a2) Patent Application Publication 0) Pub. No.: US 2003/0164827 Al
`
`(43) Pub. Date: Sep. 4, 2003
`Gottesmanet al.
`
`US 20030164827A1
`
`(54) SYSTEM AND METHOD FOR DISPLAYING
`SEARCH RESULTS IN A
`THREE-DIMENSIONAL VIRTUAL
`ENVIRONMENT
`
`(76)
`
`Inventors: Asaf Gottesman, Kfar Shmaryaho(IL);
`Udi Bobrovsky, Kiryat Netafim (IL)
`
`Correspondence Address:
`Eitan, Pearl, Latzer & Cohen Zedek, LLP.
`Suite 1001
`10 Rockefeller Plaza
`
`New York, NY 10020 (US)
`
`(21) Appl. No.:
`
`10/356,739
`
`(22)
`
`Filed:
`
`Feb. 3, 2003
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 09/859,376,
`filed on May 18, 2001.
`
`Publication Classification
`
`(SL) Ute C07 casccccssssssssstenssnssssssttntsnsstn GO6T 15/00
`(52) US. Ch.
`cecesesssssssssstsnsisesnstnstvasnennstnssvesse 345/419
`
`(57)
`
`ABSTRACT
`
`A system and method for presenting search and/or data
`query results within a virtual three-dimensional environ-
`ment. A data container containing a parameter representing
`at least a portion of the content derived from a database
`search result may be rendered within the environment,
`thereby producing a two dimensional prospective view from
`a view point within the environment. The viewpoint may be
`moved along a selected or predefined path and the data
`container’s parameters may be updated in relation to the
`position of the viewpoint.
`
`
`
`800—_|
`
`—
`900-_
`
`RECEIVE SEARCH PARAMETERS
`—
`QUERY DATABASE(S) WITH
`
`SEARCH PARAMETERS
`
`|
`
`+ ASSOCIATED FUNCTIONS
`
`
`1400
`
`EXECUTE
`ASSOCIATED
`FUNCTION
`
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 1
`
`aM
`
`AP DATABASE SEARCH RESULTS
`TO OBJECT ON DATA CONTAINER
`| + ASSOCIATED DISPLAY PARAMETERS
`
`1000
`
`_
`
`| CHECK FOR INTERACTION FROM USER
`
`
`
`
`
`1100 ~_1
`PROJECT OBJECT + ASSOCIATED
`
`FUNCTION INTO DISPLAY AREA,
`USING ASSOCIATED DISPLAY PARAMETERS|
`1900
`
`1200
`
`
`
`UPDATE OBJECT
`PARAMETERS +
`FUNCTION BASED
`
`
`ON NEW POSITION
`
`
`
`
`REASSIGN POSITION
`INTERACTION
`
`BASED ON DISPLAY
`2
`PARAMETERS
`
`
`
`
`
`CHECK IF NEW
`POSITION IS WITHIN
`
`
`DISPLAY BORDERS
`
`DROP THE
`
`
` BORDERS
`OBJECT
`
`
`9
`
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 1
`
`

`

`Patent Application Publication
`
`Sep. 4,2003 Sheet 1 of 7
`
`US 2003/0164827 Al
`
`aie]
`>
`
`© _
`
`— [
`
`>
`
`ie!
`®)
`
`wol,2
`
`wo
`“+
`mm)3
`D) a.
`lox=
`<=
`5-3
`al
`52
`15 |G
`o|sla
`Mjic |S
`o| = |S
`B|2 1®@ol
`©
`D
`Ole
`lo |T
`Cju
`Lye
`Oo
`ai |g
`4
`
`x
`—_
`C5
`—
`—ry
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 2
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 2
`
`

`

`sD
`
`Images WebPages
`
`ca o
`
`“Backy>¥@BA(@
`
`Ol|=
`oO; 2
`o|>cS
`oye10
`chu
`Li
`
`@
`Cy]iL
`
`Patent Application Publication
`
`Sep. 4,2003 Sheet 2 of 7
`
`US 2003/0164827 Al
`
`FIG.1B
`
`O; ao
`ol
`nyo
`+|2
`Dao
`oO}
`Oo
`cli
`lla
`S|2
`CFS
`u| ©>
`Os
`Uupiee
`
`text-
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 3
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 3
`
`

`

`Patent Application Publication
`
`_—
`
`eeoySegNKS
`
`Sep. 4, 2003 Sheet 3 of 7
`
`JTOl
`
`US 2003/0164827 Al
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 4
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 4
`
`
`

`

`Patent Application Publication
`
`Sep. 4,2003 Sheet 4 of 7
`
`US 2003/0164827 Al
`
`eae
`
`~
`
`~
`
`Sy
`
`~~
`
`~
`
`\
`
`\
`
`\
`
`oT
`
`7
`
`oo
`
`“
`
`a
`
`Yo
`
`7
`
`/
`
`/
`
`/
`
`A
`
`/
`
`/
`
`/
`
`/
`/
`
`I
`|
`;
`
`\
`
`\
`
`\
`
`\
`
`©}
`|
`|
`Y
`~\
`\
`\
`|
`\
`aT @)
`‘ \ |
`co
`’
`N
`/ ©
`,
`|
`©
`\
`|
`\
`\
`I a \
`en ee
`|
`|
`&
`}
`|
`|
`\
`I
`/
`\
`jog |
`|
`\
`/
`/
`/
`/
`
`\
`
`\
`
`\
`
`\
`
`\
`
`\
`
`\
`
`y
`
`“7
`
`NX
`
`se
`
`4
`
`-“
`
`/
`
`/
`
`mn
`AQ
`5
`C5
`~~
`a
`
`/
`
`/
`
`/
`
`/
`
`f
`
`4
`
`a
`
`4
`
`a“
`
`/
`
`/
`
`/
`
`7
`
`N
`
`\
`
`“N
`
`“XN
`
`N
`
`~
`
`‘\
`
`~
`
`sn
`
`~e
`
`~~ _—
`-—
`
`7
`
`a
`
`oe
`
`<C
`
`Q
`C5i
`Foy
`
`b
`
`| > ------=
`
`oO
`
`<J
`
`<1
`
`(Id gb<€=-
`<q
`<
`
`.
`
`O 00 OO ] | | | | | | | | | | ! 1 | |
`
`co
`
`N
`N
`
`@
`“I
`
`NN
`
`220B
`
`220B
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 5
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 5
`
`

`

`Patent Application Publication
`
`Sep. 4,2003 Sheet 5 of 7
`
`US 2003/0164827 Al
`
`1.
`
`2.
`
`SIZE
`INITIAL POSITION —
`
`. _ CONTAINER
`
`. ASSOCIATED FUNCTION (e.g. Link to URL)
`
`_ ASSOCIATED MESSAGE OR PICTURE
`
`3 4
`
`5.
`
`OPACITY
`
`6.
`
`COLOR
`
`7.
`
`TEXTURE
`
`. SPEED
`
`8 9
`
`FIG.3
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 6
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 6
`
`

`

`Patent Application Publication
`
`008/NINAAVdsiG
`LINN<<OAW1dSIdNOIL
`SNOILONYLSNIAVIdSIdOry
`
`YILNdWoo/yasnSINdNI
`WOM4LONIWNYSLXS
`
`
`ANIONSHOYVSS
`
`
`O87(s)asvaviva
`
`00v
`
`JINGOW
`
`ONdOddMAIA
`
`FING
`
`ONINSGNAY
`
`OZY
`
`YaLaWvavd
`
`
`
`AINGOWJALVvddN
`
`40/1V001
`
`YMOMLAN
`
`Sep. 4, 2003 Sheet 6 of 7
`
`US 2003/0164827 A1
`
`Vola
`
`JINGON
`
`OlY
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 7
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 7
`
`
`
`
`

`

`Patent Application Publication
`
`Sep. 4,2003 Sheet 7 of 7
`
`US 2003/0164827 Al
`
`800
`
`RECEIVE SEARCH PARAMETERS
`
`900
`
`QUERY DATABASE(S) WITH
`SEARCH PARAMETERS
`
`1000
`
`1100
`
`1900
`
`weN@<~
`
`INTERACTION
`
`1600
`
`YES
`
`1300
`
`|-
`
`1400
`
`
`
`MAP DATABASE SEARCH RESULTS
`TO OBJECT ON DATA CONTAINER
`+ ASSOCIATED DISPLAY PARAMETERS.
`
`
`+ ASSOCIATED FUNCTIONS
`
`
`PROJECT OBJECT + ASSOCIATED
`FUNCTION INTO DISPLAY AREA,
`USING ASSOCIATED DISPLAY PARAMETERS
`
`
`
`
`PARAMETERS ~|J
`
`
`UPDATE OBJECT
`PARAMETERS +
`FUNCTION BASED
`ON NEW POSITION
`
`
`
`REASSIGN POSITION
`BASED ON DISPLAY
`
`
`
`
`
`POSITION IS WITHIN
`DISPLAY BORDERS
`
`EXECUTE
`
`FUNCTION
`
`1700
`
`1800
`
`
`
`BORDERS
`?
`
`NO
`
`DROP THE
`OBJECT
`
`FIG.O
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 8
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 8
`
`

`

`US 2003/0164827 Al
`
`Sep. 4, 2003
`
`SYSTEM AND METHODFOR DISPLAYING
`SEARCH RESULTSIN A THREE-DIMENSIONAL
`VIRTUAL ENVIRONMENT
`
`RELATED PATENT APPLICATIONS
`
`[0001] This application is a continuation-in-part of U.S.
`patent application Ser. No. 09/859,376, filed May 18, 2001,
`the entire specification of which is herein incorporated by
`reference.
`
`FIELD OF THE INVENTION
`
`[0002] The present invention relates to the field of virtual
`presentation systems. More specifically, the present inven-
`tion relates to the presentation of content located or identi-
`fied with the use of a search engine or other data querying
`tool.
`
`BACKGROUND OF THE INVENTION
`
`[0003] Few will argue that the Internet has revolutionized
`the means and the formats by which human beings commu-
`nicate today. Specifically, a series of Internet software appli-
`cations have brought color, site, sound, and some would
`even say life to content published on the Internet, collec-
`tively referred to as the World Wide Web. The World Wide
`Webstarted with a relatively simple interactive search and
`presentation application called MOSAIC—the world’s first
`web browser. MOSAIC was developed by academics in
`order to facilitate the sharing of research data located on
`computer systems at universities around the world. Soon
`after its development, however, wide spread commercial-
`ization of MOSAIC began.
`
`[0004] Since MOSAIC’s introduction, numerous other
`web browsers and related software applications have been
`developed. Whereas MOSIACpresented static content in a
`two dimensional format, more recent World Wide software
`applications, such as Flash™ and Real Player™, are capable
`of accessing and presenting dynamic content such as stream-
`ing audio/video, and various combinations of other multi-
`media, including “active containers” which are described
`detail in Applicants’ previous co-pending application, U.S.
`patent application Ser. No. 09/859,376, which is incorpo-
`rated herein by reference. Certain applications have
`attempted to simulate three-dimensional environments over
`the Internet. For example, the web site “www.worlds.com”
`allows a visitor to download a software application, com-
`monly referred to as a plug-in, which works in conjunction
`with the visitor’s web browser to simulate a three dimen-
`sional environmenton the visitors screen. The parameters of
`the environment (walls, floor, and other containers within
`the 3-D space) are produced by the site’s computer system,
`and several visitors to the site may share and interact within
`a common environment.
`
`[0005] Visitors to web sites providing three-dimensional
`environments, such as “www.worlds.com”, are usually
`assigned a virtual
`representative or agent, commonly
`referred to as an avatar. The visitor’s view of the environ-
`ment is from the perspective of the avatar, and the visitor
`navigates the three dimensional environment by directing
`their avatar to move within the virtual 3-D space. The
`visitor’s view of the environment changesin relation to the
`avatar’s change in perspective. Thus,in order for a visitor to
`change their view of the environment, they must direct their
`avatar to move.
`
`[0006] However, web sites providing three-dimensional
`environments today only display content that is predefined
`by the web site operators and users. Thus, the scope of the
`content
`that
`is displayed in web sites providing three-
`dimensional environments is quite limited.
`
`[0007] A search engine is a well know term used to
`describe a set of programsthat include:
`
`[0008] A spider (also called a “crawler” or a “bot”) that
`goes to pages, or representative pages on websites that want
`to be searchable, and reads them, using hypertext links on
`each page, to discover and read a site’s other pages;
`
`[0009] A program that creates a huge index (sometimes
`called a “catalog”) from the pages that have been read, and
`arespective program that receives search requests, compares
`such requests to the entries in the index, and returns results
`to the user.
`
`[0010] An alternative to using a spider or an index is to
`explore a structured directory of topics. A number of web
`sites offer both the search engine and directory approaches
`to finding information.
`
`[0011] Search engines such as Google, Yahoo (which uses
`Google), AltaVista, and Lycos index the content of a portion
`of the World Wide Web and provide search results in a
`format that can run for pages—and which may consequently
`overwhelm a user. Furthermore, present day search engines
`provide or present search results in a static two-dimensional
`format, requiring the user to manually scan the search
`results.
`
`SUMMARYOF THE INVENTION
`
`[0012] According to some embodiments of the present
`invention, a virtual three-dimensional environment may be
`generated using data produced as a result of either a search
`engine or database query. As part of the present invention, a
`system and a method of presenting content may present
`search or query results in a three-dimensional prospective
`view or format. Each search result may be represented by an
`object within the environment, wherein each object may be
`a data container.
`
`[0013] A data container may contain one or more param-
`eters, where each of the parameters may be correlated with
`one or more portions of data or content derived from a
`search result (hereinafter comprising both search engine
`results and results from other database queries). A data
`container may be rendered in a virtual three-dimensional
`environment such that
`the appearance of the container
`within the environmentis correlated to the search result with
`which it is associated, or which it represents, such that a
`viewer may derive insight or information about a specific
`search result by viewing its associated data container.
`
`[0014] A user of the present invention may view one or
`more data containers from the perspective viewpoint of a
`virtual agent or avatar traveling along a path through the
`three-dimensional environment. The data container’s param-
`eters may be updated as a function of the agent’s position
`within the environment and the database search result. The
`
`container’s position may also change to create the percep-
`tion that the container is either traveling towards or away
`from the viewer’s agent. A container may either have
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 9
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 9
`
`

`

`US 2003/0164827 Al
`
`Sep. 4, 2003
`
`persistence, such as a portion of the environment’s back-
`ground, or may be transient, moving in and out of the
`environment.
`
`appropriate, reference numerals may be repeated among the
`figures to indicate corresponding or analogous elements.
`
`[0015] One or moreof a container’s parameters may be an
`associated function, such that when a user interacts with the
`container, the associated function or functions are initiated
`or executed. One associated function may be the download-
`ing (e.g. via a hyperlink) or accessing of data related to the
`search result associated with the specific data container. A
`user may interact with a container through a variety of input
`methods. A container’s associated function, just as any other
`container parameter, may also be updated and changed as a
`function of time and as a function of the agent’s position
`within the environment.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0016] The subject matter regarded as the invention is
`particularly pointed out and distinctly claimed in the con-
`cluding portion of the specification. The invention, however,
`both as to organization and method of operation, together
`with containers, features, and advantages thereof, may best
`be understood by reference to the following detailed descrip-
`tion when read with the accompanying drawings in which:
`
`[0017] FIG. 1A is a diagram showing a computer screen
`with one possible virtual
`three-dimensional environment
`produced in accordance with some embodiments of the
`present invention;
`
`[0018] FIG. 1B is a diagram showing a computer screen
`with one possible input screen for a search engine or
`database query according some embodiments of the present
`invention;
`
`[0019] FIG.1C is a conceptual diagram showinga virtual
`agent
`traveling through a virtual environment
`in which
`search engine results are presented as objects in a prospec-
`tive three-dimensional format according to some embodi-
`ments of the present invention;
`
`[0020] FIG. 2A is a diagram showing an example of
`display parameters of a data container changing as a func-
`tion of a virtual agent’s position relative to the container;
`
`[0021] FIG. 2B is a diagram showing an example of the
`points at which display parameters of a data container may
`change as a virtual agent travels along a predefined path
`within a virtual environment;
`
`list of
`[0022] FIG. 3 is a diagram showing a partial
`parameters that a data container may contain, according to
`some embodiments of the present invention;
`
`[0023] FIG. 4 is a diagram showing an example of a
`system for implementing a search and presentation accord-
`ing to some embodiments of the present invention; and
`
`[0024] FIG. 5 is a flow diagram showing the steps of a
`method of performing a search and producing a presentation
`of search results according to some processes of the present
`invention.
`
`It will be appreciated that for simplicity andclarity
`[0025]
`of illustration, elements shown in the figures have not
`necessarily been drawn to scale. For example, the dimen-
`sions of some of the elements may be exaggerated relative
`to other elements for clarity. Further, where considered
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`In the following detailed description, numerous
`[0026]
`specific details are set forth in order to provide a thorough
`understanding of the present invention. However,it will be
`understood by those skilled in the art
`that
`the present
`invention maybe practiced without these specific details. In
`other instances, well-known methods, procedures, compo-
`nents and circuits have not been described in detail so as not
`
`to obscure the present invention.
`
`[0027] Unless specifically stated otherwise, as apparent
`from the following discussions,
`it
`is appreciated that
`throughoutthe specification discussionsutilizing terms such
`as “processing”, “computing”, “calculating”, “determining”,
`orthe like, refer to the action and/or processes of a computer
`or computing system, or similar electronic computing
`device, that manipulate and/or transform data represented as
`physical, such as electronic, quantities within the computing
`system’s registers and/or memoriesinto other data similarly
`represented as physical quantities within the computing
`system’s memories, registers or other such information
`storage, transmission or display devices.
`
`[0028] Embodiments of the present invention may include
`apparatuses for performing the operations herein. This appa-
`ratus may be specially constructed for the desired purposes,
`or it may comprise a general purpose computer selectively
`activated or reconfigured by a computer program stored in
`the computer. Such a computer program may bestored in a
`computer readable storage medium, such as, but
`is not
`limited to, any type of disk including floppy disks, optical
`disks, CD-ROMs, magnetic-optical disks, read-only memo-
`ries (ROMs), random access memories (RAMs)electrically
`programmable read-only memories (EPROMs),electrically
`erasable
`and
`programmable
`read
`only memories
`(EEPROMs), magnetic or optical cards, or any other type of
`media suitable for storing electronic instructions, and
`capable of being coupled to a computer system bus.
`
`[0029] The processes and displays presented herein are not
`inherently related to any particular computer or other appa-
`ratus. Various general purpose systems may be used with
`programsin accordance with the teachings herein, or it may
`prove convenient to construct a more specialized apparatus
`to perform the desired method. The desired structure for a
`variety of these systems will appear from the description
`below.In addition, embodiments of the present invention are
`not described with reference to any particular programming
`language. It will be appreciated that a variety of program-
`ming languages may be used to implementthe teachings of
`the inventions as described herein.
`
`[0030] According to some embodiments of the present
`invention, a virtual three-dimensional environment may be
`generated using data produced as a result of either a search
`engine or database query, hereinafter also referred to as
`“search engine results” and/or “data query results”, which
`are interchangeable. As part of the present
`invention, a
`system and a method of presenting content may present
`search or query results (hereinafter referred to as “search
`results”) in a three-dimensional prospective view or format.
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 10
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 10
`
`

`

`US 2003/0164827 Al
`
`Sep. 4, 2003
`
`Each search result may be represented by an object within
`the environment, wherein each object may be a data con-
`tainer.
`
`[0031] A data container may contain one or more param-
`eters, where each of the one or more parameters may be
`correlated with one or more portions of data or content
`derived from a search result. A data container may be
`rendered in a virtual three-dimensional environment such
`
`that the appearance of the container within the environment
`is correlated to the search result with which it is associated,
`or whichit represents, such that a viewer may derive at least
`someinsight or information about a specific search result by
`viewing its associated data container.
`
`[0032] A user of the present invention may view one or
`more data containers from the perspective viewpoint of a
`virtual agent or avatar traveling along a path through the
`three-dimensional environment. The data container’s param-
`eters may be updated as a function of the agent’s position
`within the environment and the database search result. The
`container’s position may also change to create the percep-
`tion that the container is either traveling towards or away
`from the viewer’s agent. A container may either have
`persistence, such as a portion of the environment’s back-
`ground, or may be transient, moving in and out of the
`environment.
`
`[0033] One or moreof a container’s parameters may be an
`associated function, such that when a user interacts with the
`container, the associated function or functions are initiated
`or executed. One associated function may be the download-
`ing (e.g. via a hyperlink) or accessing of data related to the
`search result associated with the specific data container. A
`user may interact with a container through a variety of input
`methods. A container’s associated function, just as any other
`container parameter, may also be updated and changed as a
`function of time and as a function of the agent’s position
`within the environment.
`
`[0034] As part of the present invention, a three-dimen-
`sional environment, which may include a data container,
`may be rendered by a rendering module. A data container
`may possess no inherent or immutable visible characteris-
`tics, but rather may contain one or more parameters repre-
`senting at least some portion of content of search or query
`results to be presented. The data container, along with its
`parameters, may be rendered in a virtual or prospective
`three-dimensional environment and assigned a position
`within the environment. Each of one or more data containers
`may also contain one or more display parameters that may
`include such characteristics as position, size, shape, color,
`texture, surface appearance or covering, and movement. A
`container may havea fixed position or may movein and out
`of the environment. A container may have an associated
`message or picture that is mapped onto the surface of the
`container. In the event a search or query is performed on an
`image data base(s),
`the results of the search, which are
`images, may be mapped onto the surface of one or more
`containers within the environment.
`
`[0035] The viewer’s view of the environment may be
`producedby a view production module, which may produce
`a view from the perspective of a virtual agent traveling
`through the environment. As the virtual agent
`travels
`through the environment, the viewer’s perspective of the
`environment and of containers contained therein may
`
`change accordingly. Furthermore, display parameters and
`parameters with associated functions of one or more of the
`data containers within the environment may change or be
`updated by a parameter update module. The update module
`may update the parameters and/or associated functions in
`relation to a change in the viewer’s perspective or as a
`function of the virtual agent’s position in the environment or
`as a function of time. That is, associated functions and
`display parameters such as shape, color or mapped images/
`pictures, of one or more of the containers, may changeas the
`virtual agent’s position in the environment changes and as a
`function of time. A container’s associated functions and
`display parameters may be updated with pre-selected param-
`eters stored on a database, or may change according to input
`received over a distributed data network. A parameter of a
`container may be updated with the results of a database or
`Internet search or query.
`
`[0036] Turning now to FIG. 1C,there is shown a diagram
`depicting a computer screen according to some embodiment
`of the present invention where search engine results may be
`presented as objects in a virtual three-dimensional environ-
`ment 200. Since a computer screen is inherently two-
`dimensional, the virtual three-dimensional environment may
`be rendered in a
`two-dimensional perspective format
`intended to produce a three-dimensional effect. In some
`embodiments of the present invention, the two dimensional
`environment may be rendered continuously from a moving
`vantage point so as to create the impression of movement
`within the environment. As part of the present invention the
`perspective view may change in accordance with the view-
`point or position of a virtual agent 100 (FIG. 1C) passing
`through the virtual environment 200. Thus, the data con-
`tainers 220 may appearasif they are either moving towards
`or away from a viewer watching the screen of FIG. 1A.
`
`[0037] The objects in the environment 200 may be data
`containers, 220A and 220B etc., having one or more param-
`eters including display parameters and associated functions.
`A data container’s parameters may contain at least portions
`of information relating to a result of a search or query. An
`associated function of a data container may bea link back to
`the source of a given searchresult (e.g. link back to a URL
`found as a result of an internet search engine query).
`
`[0038] FIG. 1B shows an example of an input screen for
`a search engine or database query according to some
`embodiments of the present invention. A viewer may enter
`search parameters through a text area or field 105. FIG. 1B
`shows an input screen which is formed within a web
`browser. However, one of ordinary skill in the art should
`understand that such an input screen may also be a stand-
`alone computer application or a plug-in within a variety of
`host computer applications, not just within a browser.
`
`[0039] Search terms entered into an input screen, such as
`the one shownin FIG. 1B, may be used as search parameters
`of a search or query of one or more databases. The search
`parameters may be used to query one or more remote or
`local database(s), or may be passed along to one or more
`search engines which may then perform a search or query for
`content correlated to the search terms or parameters. In the
`event that the search or query finds records or other data
`correlated to the search terms or parameters, the results may
`be transmitted to a user’s computer into which the search
`terms were entered, or to another computer device selected
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 11
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 11
`
`

`

`US 2003/0164827 Al
`
`Sep. 4, 2003
`
`by the user. Results of the search or query may then be
`associated or placed within data containers 220 and dis-
`played in a virtual
`three-dimensional environment 200
`according to the present invention.
`
`[0040] Turning now to FIG.1C,there is shown a concep-
`tual diagram of a possible virtual three-dimensional envi-
`ronment 200 produced in accordance with some embodi-
`ments of the present
`invention. The three-dimensional
`environment 200 may be populated with one or more data
`containers 220, each of which may contain one or more
`parameters representative of at
`least some portion of a
`search result. A viewer may see the environment 200, along
`with the data containers 220 therein as a two-dimensional
`perspective view from the viewpoint of a virtual agent 100.
`Each data container 220 may contain portionsofa result of
`a search or a query of a database. For example, a container
`may contain data representative of an image retrieved from
`an image database, a link or URL to a web server where an
`image is stored, a description of a search result, etc. The
`virtual agent 100 may follow a predefined path 120 within
`the environment, which may take the agent around and/or
`through data containers 220 in the environment 200. As the
`virtual agent 100 travels through the environment 200, the
`viewer’s perspective view may change along with the
`agent’s 100 position and viewpoint within the environment.
`A rendering or view production module, according to some
`embodiments of the present invention, may render two-
`dimensional perspective Views of the environment 200 as
`the virtual agent 100 passes through the virtual environment
`200.
`
`[0041] Turning now to FIG.2A,there is showna series of
`diagrams depicting the approach of a virtual agent towards
`a data container 220B. In FIG. 2Aa, the agent is a certain
`distance from the container 220B and the container’s display
`parameters may cause the data container 220B to appear, for
`example, as a star shaped polygon having star shapes on its
`surface. In FIG. 2Ab,the virtual agent’s position is closer to
`the data container 220B and display parameters may be
`changed or updated by a parameter update module in order
`to make the data container 220B appear, for example, as a
`star shaped polygon having circle shapes on its surface. In
`FIG. 2Ac, the virtual agent’s position is even closer to the
`data container 220B and the display parameters may be
`updated once more such that
`the data container 220B
`appears as a circle with triangle shapes on its surface. FIG.
`2Ad showsthe virtual agent at yet another position and the
`data container’s display parameters again updated to cause
`the container to be rendered as a rotating circle.
`
`[0042] Turning now to FIG.2B, there is shown a diagram
`depicting a virtual agent traveling a path around a data
`container 220C. The path is shown by a dashed line, and
`points along the path where a parameter of the data container
`220C may be updated are marked by a number within a
`circle. At each of the marked points, a parameter update
`module may update one or more of the data container’s
`220B parameters. A container’s parameter may be updated
`with another portion of a single search result or may be
`updated with a portion of data from a second searchresult.
`
`[0043] Turning now to FIG. 3, there is shown a block
`diagram depicting a data container 220 and various param-
`eters that it may contain. The data container mayinitially be
`in the form of a generic data array or structure (like a
`
`template for data storage according to a particular format)
`that may be located within a database. Such a container may
`contain fields for receiving data according to various rel-
`evant categories or parameters. A typical data container may
`have one or more parameters including size, initial position,
`at least one associated function (suchas a link to a URL) and
`oneora series of display parameters (such asposition, size,
`shape, color, texture, opacity, speed, mapped pictures/im-
`ages or other messages, and movementetc.). An associated
`function may be executed or initiated when a viewer inter-
`acts with the data container 220 to which the function is
`
`associated. Interaction with a data container may occur
`through the use of a mouse pointer, a keyboard, or any other
`input device. For example, when a viewerclicks with his or
`her mouse on a container shown within FIG. 1C, a link to
`a search result associated with the container may be
`executed and the search result may be downloaded to the
`viewer’s computer. An associated function may also be
`executed whenthe virtual agent 100 reaches a specific point
`along the predefined path. An example of an associated
`function is a hypertext link or URL.
`[0044] A data container 220 may be rendered within the
`environment
`in accordance with its display parameters.
`Display parameters may define such characteristics as posi-
`tion, size, shape, color, texture, mapped pictures/images or
`other messages, and movement etc. Movement parameters
`may include direction, speed, direction of rotation, and
`rotational velocity etc. A data container 220 may have a
`fixed position or may move within the environment. A data
`container 220 having no display parameters may appear
`transparent within the environment.
`
`[0045] As the virtual agent 100 travels along the path 120,
`one or more of the containers’ associated functions and
`
`display parameters may be updated. For example, while the
`virtual agentis at point 220a (FIG. 1C), data container 220C
`may havethe shape ofa triangle and be covered bya first bit
`map. As the virtual agent approaches point 2205,the display
`parameters of data container 220C may be updated such that
`data container 220C is re-rendered as a square covered by a
`second bitmap. The new or updated parameters may be
`associated with either the same or with a different search
`result.
`
`[0046] Turning now to FIG.4, there is shown a system
`according some embodiments of the present invention for
`displaying database or
`Internet search/query results as
`objects in a virtual three-dimensional environment. As part
`of the embodiment shownin FIG.4, a display engine 400
`may receive the data comprising a data container 220 from
`a storage unit 300. Storage unit 300 mayeither reside on the
`same computer as the display engine 400 or may be con-
`nected to the display engine 400 through a network connec-
`tion. The display engine 400 may include a search engine
`module 410, a rendering module 420, a view production
`module 440, and a display parameter update module 460.
`[0047] The search engine module 410 mayreceive one or
`moresearch inputs or terms from a user and maytransfer the
`search terms or parametersto at least one database 300, with
`a request for the database to conduct a search or query ofits
`records for possible and/or probable matches to the search
`term(s). The one or more databases 300 may either be a
`database associate with the user’s computer or may be a
`search engine residing on one or moreservers, either on the
`Internet or over another distributed network.
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 12
`
`SPACETIME3D
`EXHIBIT 2006 - PAGE 12
`
`

`

`US 2003/0164827 Al
`
`Sep. 4, 2003
`
`[0048] Upon receiving results from the one or more data-
`bases 300, the search engine module may provide the results
`to a parameter update module 460 which mayassignat least
`someportion of each searchresult to a generic data container
`220. That is, the parameter update module 460 mayassign
`or match at least some portion of each search result as at
`least one parameter (e.g. display parameter or associated
`function) to one or more data containers 220. These data
`containers are subsequently rendered in a virtual environ-
`ment according to some embodiments of the present inven-
`tion. For example, if the search results are an orderedlist of
`files, where each file contains an i