as) United States
`a2) Patent Application Publication (10) Pub. No.: US 2004/0109031 Al
`(43) Pub. Date: Jun. 10, 2004
`
`Deaton et al.
`
`US 20040109031A1
`
`(54) METHOD AND SYSTEM FOR
`AUTOMATICALLY CREATING AND
`DISPLAYING A CUSTOMIZABLE
`THREE-DIMENSIONAL GRAPHICAL USER
`INTERFACE 3D GUD FOR A COMPUTER
`SYSTEM
`
`(76)
`
`Inventors: Kenneth Deaton, Toronto (CA); Steven
`A. Gedeon, Toronto (CA)
`
`Correspondence Address:
`GREGORY SCOTT SMITH
`GREGORYSMITH & ASSOCIATES
`3900 NEWPARK MALL ROAD
`SUITE 317
`
`NEWARD,CA 94560 (US)
`
`(21) Appl. No.:
`
`10/145,567
`
`(22)
`
`Filed:
`
`May13, 2002
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/290,291, filed on May
`1, 2001.
`
`Publication Classification
`
`(SL) Ute C07 cacsccsssssssssssnssessesnstsntsnstsevee G09G 5/00
`(52) US. Ch.
`cecesesssssssssstsnsissnstnstvntnesnstnsevesse 345/848
`
`(57)
`
`ABSTRACT
`
`The present invention is a new 3D graphical user interface
`(3D GUDtechnology that seamlessly integrates personal
`computer (PC) desktop, web portal, and data visualization
`functions in an intuitive 3D environment. This new para-
`digm in human computer interfaces provides seamless and
`intuitive access to a computer’s operating systems, applica-
`tions, and files as well as the Internet and on-line web portal
`functions. The invention automatically scans a computer
`user’s hard drive and dynamically creates a customized 3D
`environment that allows intuitive access to all the user’s
`computer functionality. In a preferred embodiment of the
`invention, the 3D GUIinstalls as the active desktop on a PC,
`replacing the user’s “wallpaper” with the 3D GUI. In this
`embodiment, the calculator program is accessed by clicking
`on the calculator on the desk, word processing documents
`look like actual paper documents,
`the weather outside is
`based on today’s weather forecast, and the radio accesses an
`Internet radio station.
`
`oo BogeskSbenecqencmate
`
`Sine
`
`1
`
`APPLE 1033
`
`APPLE 1033
`
`1
`
`

`

`Patent Application Publication
`
`Jun. 10,2004 Sheet 1 of 5
`
`US 2004/0109031 Al
`
`
`
`FIG 1
`Prior Art 2D Desktop
`
`2
`
`

`

`Patent Application Publication
`
`Jun. 10,2004 Sheet 2 of 5
`
`US 2004/0109031 Al
`
`
`
`FIG 2
`
`3
`
`

`

`Patent Application Publication
`
`Jun. 10,2004 Sheet 3 of 5
`
`US 2004/0109031 Al
`
`ZOWA Plane SMES SERSIs eo?
`
`FIG 3
`
`4
`
`

`

`Patent Application Publication
`
`Jun. 10,2004 Sheet 4 of 5
`
`US 2004/0109031 Al
`
`
`
`
`
`
`
`
`FIG 4
`
`ae
`
`aeatya
`
`\
`‘
`
`5
`
`

`

`Patent Application Publication
`
`Jun. 10,2004 Sheet 5 of 5
`
`US 2004/0109031 Al
`
`d
`Sahara grees
`Aaa
`AeASTAT ehbat EeEee oe tbat stat, Boot naaaaee
`BR
`3
`€.
`b:
`8
`—
`oe
`.
`.
`2
`_
`:
`SEERENE SEAES EPRS ae (eSeee
`i
`noe
`oF
`Py
`oth
`i:
`a
`=
`:
`HORESEOE PERESORE?A SERRESPORESORE, GASRRREE) SABES SHAVENARG: EERE“SR
`é
`HeelckesG! GHGSERASERSBeySSss
`OY Ye
`ay
`Aa
`BR
`en SE
`~ VM VES
`f
`
`8%
`i
`ESRD Eis ReAS AHEgeet
`
`
` - a wRSORBET 2 ER VRR SHERERERTSAER ASCE Y TSEC a$ seenibiant, Suover-ueiesbadhon’sGeneracue= eo
`
`
`
`
`¢
`&
`
`
`
`r g
`
`¢=
`
`
`
`.
`«
`3
`4
`
`
`~
`.
`TF PY
`FREES Pare
`pete
`5
`*
`eee
`St
`oc
`aon
`.
`Fs
`oea Ee
`winapi: BE mn a fs, amacereler mente dae eae oF vee 0 .
`i
`:
`z
`
`é
`:
`:
`
`:
`
`&= é
`
`:
`:
`:
`:é
`
`:
`
`= i
`
`=z
`
`z
`5x
`:
`i
`
`6
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`METHOD AND SYSTEM FOR AUTOMATICALLY
`CREATING AND DISPLAYING A CUSTOMIZABLE
`THREE-DIMENSIONAL GRAPHICAL USER
`INTERFACE 3D GUI) FOR A COMPUTER
`SYSTEM
`
`CROSS REFERENCE TO OTHER
`APPLICATIONS
`
`[0001] This application claims the benefit of U.S. Provi-
`sional Patent Application, serial No. 60/290,291, filed May
`11, 2001.
`
`COMPUTER PROGRAM LISTING
`
`[0002] This application is filed with a computer program
`listing on CD-ROM,whichis hereby incorporated by ref-
`erence. The contents of the CD-ROM include:
`
`File Name
`
`File Size
`
`Date
`
`Description
`
`3DNA__Desktop__
`ATI_050012.exe
`3DNA_Hub_
`ATI_010005.exe
`3DNA_
`Desktop_Demo.avi
`
`21 MB
`
`45 MB
`
`3/5/02
`
`4/15/02
`
`145 MB
`
`5/7/02
`
`3DNA ATI Branded
`3DNA Desktop
`3DNA ATI Branded
`Hub World
`3DNA
`Demonstration
`Movie
`
`[0003]
`
`1. Field of the Invention
`
`[0004] The present invention relates generally to the appli-
`cation of 3D to Graphical User Interfaces (3D GUD. It takes
`advantage of a numberof technologies to improve the GUI
`including:
`
`automatically scanning the user’s computer system
`[0005]
`and using the information to create a customized 3D repre-
`sentationofall the information; procedural generation of 3D
`geometry, textures, and 3D scenes; dynamic reconfiguration
`of 3D content; improved organization and viewing of infor-
`mation; a 3D net architecture; and enhanced data visualiza-
`tions. The technology makes it simpler for the average
`computer user to create and use 3D environments with
`which they can interface to their computers and their infor-
`mation, as well as other people and information over the
`Internet.
`
`[0006] The immediate application of this GUI invention is
`for personal computers (PCs), but there is additional appli-
`cation to game consoles, set-top computing platforms,
`mobile devices, virtual reality (VR) devices, and other
`computing platforms.
`
`[0007]
`
`2. Backgroundof the Invention
`
`[0008] Over 80% of personal computers (PCs) are already
`capable of supporting 3D computer graphics and nearly all
`of the over 120 million new desktop computers shipped in
`
`2000 were equipped with 3D graphics chipsets. In addition,
`there are over 100 million game consoles (such as the
`Nintendo, Gamecube and Xbox) capable of generating and
`displaying 3D scenes on a standard televisionset.
`
`[0009] PC and video games represent the most common
`application of 3D technology. However, computer aided
`design (CAD), medical imaging, animation, and video pro-
`duction (using commercial software applications such as
`Discreet’s 3ds and Alias/Wavefront’s Maya) represent alter-
`native common applications of 3D technology.
`
`illustrations of a 3D GUI for
`[0010] Perhaps the best
`controlling a computer come from fictional examples in
`Hollywood movies such as Jurassic Park, Disclosure, Lawn-
`mower Man, and Johnny Mnemonic. However,to date, there
`have been no successful commercial examples of using 3D
`for the graphical user interface (3D GUI)that the user uses
`to interact with their computer. Since the introduction of the
`Macintosh 2D desktop in 1984,
`there have been few
`attempts or patents that improve uponthis paradigm or take
`advantage of the pervasive 3D hardware technology now
`primarily used to play games. The major companies such as
`Microsoft, Sony, Xerox, IBM, and SGI have contributed to
`the patent literature with niche applications, but none of
`these solve the basic technical problemsthat limit the ability
`to use 3D for the GUI. There have also been a number of
`
`small startup firms claiming to have created a 3D desktop
`(including: Clockwise Technologies, EiDoxis, and Pentad
`Resources) but
`these are simplistic examples of a non-
`commercially-viable 3D GUI and suffer from the following
`technical problemsthat are overcome by the present inven-
`tion:
`
`1) 3D scenes are huge, thus 3D files cannot
`[0011]
`easily be transferred over the Internet. The only
`solution is to use low-resolution images that look
`poor.
`
`2) 3D scenes are static, thus a 3D desktop
`[0012]
`created for one user cannot be used for another since
`each user will have different applications,files, fold-
`ers, shortcuts, images and songlists.
`
`to
`3) 3D scenes are complex and difficult
`[0013]
`thus the average person cannot create or
`create,
`modify one withoutlots of training and an expensive
`software package. Since the average user will want
`their 3D desktop to be personalized to their tastes,
`this represents a large barrier to the pervasive use of
`a 3D desktop.
`
`[0014] Even though 3D hardware is relatively pervasive,
`these technical limitations have prevented the pervasive use
`of a 3D GUIthat runs on these hardware systems. Examples
`of previous attempts to create a 3D graphical user interface
`and related technologies are described in the following US.
`patents, the specifications of which are hereby incorporated
`by reference.
`
`Patent
`
`Issued
`
`5,528,735
`
`June 1996
`
`Inventor(s)
`
` Applicant(s)
`
`Title
`
`Strasnick,
`Tesler
`
`Silicon
`Graphics Inc.
`
`Method and apparatus for displaying
`data within a three-dimensional
`information landscape
`
`7
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`Patent
`
`Issued
`
`Inventor(s)
`
` Applicant(s)
`
`Title
`
`-continued
`
`5,786,820
`
`July 1998
`
`Robertson
`
`Xerox Corp.
`
`5,880,733 March 1999
`
`Horvitz,
`Sonntag,
`Markley
`
`Microsoft
`Corp.
`
`5,956,038
`
`September 1999
`
`Rekimoto
`
`Sony Corp.
`
`6,085,256
`
`July 2000
`
`6,111,581 August 2000
`
`6,121,971
`
`September 2000
`
`6,175,842
`
`January 2001
`
`
`
`
`
`Kitano,
`Honda,
`Takeuchi
`
`Berry,
`Isensee,
`Roberts
`
`Berry,
`Isensee,
`Roberts,
`Bardon
`
`Kirk,
`Selfridge
`
`Sony Corp.
`
`IBM Corp.
`
`IBM Corp.
`
`AT&T Corp
`
`Method and apparatus for increasing
`the displayed detail of a tree structure
`Display system and method for
`displaying windowsof an operating
`system to provide a three-dimensional
`workspace for a computer system
`Three-dimensional virtual reality
`space sharing method and system, an
`information recording medium and
`method, an information transmission
`medium and method, an information
`processing method, a client terminal,
`and a shared server
`terminal
`Cyber space system for providing a
`virtual reality space formed of three
`dimensional pictures from a server to
`a user via a service provider
`Method and system for classifying
`user objects in a three-dimensional
`(3D) environment on a display in a
`computer system
`Method and system for providing
`visual hierarchy of task groups and
`related viewpoints of
`a tree
`dimensional environment in a display
`of a computer system
`System and method for providing
`dynamic three-dimensional multi-user
`virtual spaces in synchrony with
`hypertext browsing
`Apparatus and method forinteracting
`with a simulated 3D interface to an
`operating system operative to control
`computerre:sources
`
`
`6,230,116 May 2001
`
`Ronen,
`Amihai
`
`Clockwise
`Technologies
`
`SUMMARYOF THE INVENTION
`
`[0015] The present invention allows computer users to
`create and use a customizable 3D GUI for complete access
`to their computer’s operating system, applications, andfiles
`as well as the Internet and on-line web portal functions.
`
`[0016] The software application automatically creates a
`3D environment customized to the users preferences, auto-
`matically creates the interface to the user’s computer with
`content representative icons, allows simple customization by
`the end user, and provides tools for the user to interact with
`the computer. The invention enhances the user experience
`with a 3D GUIthat seamlessly integrates personal desktop,
`web portal, and data visualization functions in an interactive
`and compelling 3D environment.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0017] FIG. 1 illustrates a prior art 2D GUI using a
`“desktop” metaphor, as exemplified by the Macintosh oper-
`ating system from Apple Computer, Inc. and the Windows
`operating system from Microsoft Corp.
`
`[0018] FIG. 2 illustrates how the use of a 3D GUI can
`increase the effective display area on a computer monitor.
`
`[0020] FIG. 4 illustrates how the user can view dozens of
`browser windowsin a single glance, dynamically reconfig-
`ure content according to specifications, and seamlessly re-
`enter the 2D Windows metaphor as desired by simply
`clicking on any icon.
`
`[0021] FIG. 5 illustrates the concept of “procedural gen-
`eration” of textures, scenes, and GUIinterfaces.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENT
`
`[0022] A typical configuration for a personal computer
`system includesa processing unit, a display, a keyboard, and
`a mouse. The processing unit executes a computer program
`called the “operating system” (O/S) which allowsthe opera-
`tion of the computer system to be controlled either directly
`by the user or by other computer programscalled “applica-
`tions.” A user operates the computer system by entering
`commands using the keyboard and mouse; in response, the
`processing unit executes the commands and presents feed-
`back to the user via the display. The portion of the operating
`system that accepts the user commands and presents feed-
`back to the user is called the “user interface”.
`
`FIG.3 illustrates how the 3D Desktop can be made
`[0019]
`to look like an office where software applications and
`operating system functions are represented as realistic 3D
`icons. Web pages, documents, and other 2D windows and
`icons can be deployed in the 3D space to improve access to
`large quantities of information.
`
`[0023] Various schemes for implementing the user inter-
`face are generally categorized by the manner in which the
`user interacts with the system. For example, in a typical
`“commandline user interface” such as DOS(by Microsoft),
`the user inputs text from a keyboard;
`in response,
`the
`computer system returns text messages to the display. How-
`
`8
`
`8
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`ever, in a Graphical User Interface (GUI) such as Windows
`(by Microsoft) the user can interact with the computer
`system by manipulating graphical objects on the display
`screen using the keyboard and/or the mouse and/or other
`peripheral devices.
`
`[0024] The typical 2D GUI is normally described as a
`“desktop” metaphor. The “desktop”is the background (also
`called “wallpaper” if an image of somesort is used as the
`background) and superimposed onto the desktop are a
`number of “icons” and/or rectangular graphical objects
`called “windows”. Users can interact with the computer
`either by working within the window application(e.g. using
`a word processing application or drawing application inside
`the window) or by launching new applications by clicking or
`double-clicking on icons. Another interface to the computer
`is achieved through the “task bar” typically located to the
`bottom of the screen in Microsoft Windowsorthe top of the
`screen in a Macintosh operating system.
`
`[0025] The 2D GUI that computer users have become
`accustomed to since the introduction of the Macintosh in
`1984 and later, Microsoft’s Windows,
`is known as the
`“desktop” metaphorand is depicted in FIG. 1. This example
`of a 2D Desktop showsshortcut icons on the left, a couple
`of application “windows”, and a Task Barat the bottom. This
`metaphor has an inherent limitation. The typical monitor
`simply does not have the screen area to adequately display,
`access, and organize the many different applications, files,
`and sources of data in our wired lives. This is why users
`often require many overlapping windows, and important
`functions may be buried under layers of menus and multiple
`mouseclicks.
`
`[0026] The “3D Desktop” or 3D GUI invention signifi-
`cantly increases the “real estate” of the monitor and allows
`improved productivity, access to information, user customi-
`zation, and a superior look and feel. A simple illustration of
`how 3D can increase the effective display area on a com-
`puter monitor is shown in FIG.2. Multiple 2D Desktopsare
`viewable in a 3D scene, illustrating the ability for a 3D
`Desktop to increase screen “real estate”. As can be seen, the
`user can simply “take a virtual step back” from their normal
`2D desktop and see a numberof additional 2D desktopsthat
`reside in the 3D space. They can “step forward”to limit their
`actions to the standard desktop, or “step back” to increase
`the amountofreal estate.
`
`icons on the left or can click on the Task Bar at the bottom
`of the screen. An example of seamless integration of live
`Internet content can be seen by the message “Adding a New
`Dimension to Digital Life” streamed off of the Internet in a
`stock ticker style display.
`
`[0028] Users continue to interact with the computer by
`clicking on icons or windows, but these icons and windows
`are no longer constrained to the static “real estate” of the 2D
`desktop and can be deployed in a 3D space instead. Navi-
`gation throughout the 3D space takes place with the mouse
`and keyboard in much the same way that most PC gamesare
`played (e.g. the arrow key moves you forward and back,left
`and right... ).
`
`[0029] The 3D Desktop application replaces the static
`“wallpaper” with a custom 3D environment that includes
`customized 2D and 3D icons throughout the 3D environ-
`ment to create a 3D GUI. The user can continue to click on
`the standard shortcuts or the standard task bar, but now has
`the alternative to interact with their computer by navigating
`in the 3D GUIand clicking on icons in the 3D GUI.
`
`[0030] As can be seen, the 3DNA 3D GUIsolvesthe three
`major technical problems articulated in the Background
`section of this patent: the 3D space is composed of proce-
`durally generated graphic textures to reduce file size and
`increase resolution (note the shadows andreflections as an
`indication of the quality of the graphics);
`the user can
`customize every image, every shortcut, and website as well
`as the colors ofthe walls (additional authoring tool upgrades
`allow the ability to change the geometry or create Art Deco,
`Gothic and other looks and feel), the entire 3D scene can be
`procedurally generated, and the icons deployed about the
`space can be automatically arranged. The 3DNA program
`will scan the computer’s hard drive, determine what appli-
`cations and documents are available, and then procedurally
`generate a personalized 3D desktop with appropriate icons.
`In one of the preferred embodiments,there are a variety of
`different rooms and/or bays, specially designed to group
`related applications and data together as well as provide
`sophisticated improvements in productivity and content
`organization. As can be seen in FIG.4, the user can view
`dozens of browser windowsin a single glance, dynamically
`reconfigure content according to specifications, and seam-
`lessly re-enter the 2D Windows metaphor as desired by
`simply clicking on any icon. Many websites can be seen at
`a single glance in the 3D Desktop’s “browser bay”. Each
`What You See Is What You Get or WYSIWYGIcon is a
`screen capture of the actual website. Clicking on any of the
`WYSIWYGIcons launches the corresponding web site. (In
`this example, the traditional 2D Desktop shortcut icons on
`the left have been turned off in the program.)
`
`In its simplest form, one of the goals of the present
`[0027]
`3D Desktop inventionis to achieve the intuitive organization
`and ease of access that we enjoy in the real world by
`simulating a complete work environment in a 3D virtual
`space. For example, as shownin FIG.3, the 3D Desktop can
`actually look like an office where software applications and
`operating system functions are represented as realistic 3D
`icons (instead of the normal icons used in the standard 2D
`GUI). Web pages, documents, and other 2D windows and
`icons can be deployed in the 3D space to improve access to
`large quantities of information. This example of a 3D
`Desktop showsrepresentational access to Operating System
`features such as files accessed via the filing cabinet icons,
`the calculator program accessed via the calculator on the
`desk, shortcuts accessed via traditional shortcut icons shown
`[0032] The concept of “procedural generation”of textures,
`scenes, and GUIinterfaces can be understood with reference
`in the 3D space, and Outlook email management software
`
`accessed via the iconofa letter and pen. As can also be seen, to FIG. 5. As can be seen,atraditional image of a 3D block
`the user can still click on the traditional 2D Desktop shortcut
`of marble is composed of the 6 polygons that create the
`
`[0031] Seamless integration of desktop and online func-
`tions means that the weather website information can be
`
`today’s news can be
`represented by the scene outside,
`streamed onto the desktop in a stock ticker, and surfing the
`Web is as easy as stepping from one room on your 3D
`desktop into another room accessed over the Internet. The
`user can access 3D stores, 3D chat rooms with avatars, and
`explore immersive 3D worlds accessed over the Internet.
`
`9
`
`9
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`block and bit-mapped textures that are “painted” on the
`surface. Each bit-mapped texture can be 100 to 500k in size
`and will becomealiased (blocky) when viewed up close.
`However, by using “procedural generation” of the textures,
`the user can simply change 2 values using the slider control
`and generate all forms of marble without ever being aliased.
`Thus, rather than sending several hundred bytes of data, the
`user can transmit simply 2 numbers (plus the cube com-
`mand) to send the image of a 3D block of marble. The
`textures can be “painted” onto any surface such as a cube,
`sphere, or walls, floors .. . Using this same analogy, the
`present invention can procedurally generate, not only tex-
`tures (e.g. marble, wood, sky, carpets, roads .. . ), but also
`the underlying geometry (rooms, columns, walls, beaches,
`terrain, trees... ), as well as the entire 3D GUI(the scene,
`icons, content, and links to the users applications).
`
`[0033] As can be seen, the 3DNAinvention includes the
`following features:
`
`[0034] Acustomizable 3D virtual scene (e.g. a room,
`building, beach, or world).
`
`[0035] The ability to automatically create the
`scene(e.g. if there are morefiles on the user’s hard
`drive, the room will be larger)
`
`[0036] The ability to dynamically alter the scene
`(e.g. the user can alter the color of the walls, the
`style of the architecture, or move objects).
`
`[0037] The ability to seamlessly integrate content
`from the Internet (e.g. the weather outside can be
`generated based on the actual weather, a stock
`ticker can be integrated into the scene based on
`actual stock info...)
`
`[0038] The ability to create high quality images
`due to the use of procedural generation of graphics
`and scenes.
`
`[0039] The ability to navigate in the scene and inter-
`act with the objects in it.
`alter the navi-
`0040]
`The ability
`to dynamically
`y
`y
`y
`gation characteristics (e.g. to change your walking
`speed, fly, teleportation locations .
`.
`. )
`
`[0041] The ability for multiple users to interact
`with the scene and objects at once.
`
`[0042] The ability to interface with the computer,
`operating system, Internet, files, or underlying data
`through the icons in 3D space.
`
`[0043] The ability to automatically scan the user’s
`hard drive and create an icon for each program,
`shortcut, file, favorite website .. .
`
`[0044] The ability for the user to change the icon
`(e.g. to use a different 3D model of a calculator,
`change the image used to depict the underlying
`application orfile... )
`
`[0046] The ability for multiple users to interact
`with the scene and objects at once.
`
`Whatis claimedis a:
`
`1. Acustomizable 3-dimensional graphical user interface
`(3D GUI) for a computer, including:
`
`a. customizable 3D space containing scenes (e.g. rooms,
`sky, worlds), objects and icons;
`
`b. means to navigate throughout the 3D space to view,
`manipulate, and click on the scene elements, objects,
`and/or icons;
`
`c. means for the user to interface with the computer,
`operating system, Internet, files, or underlying data
`through the icons in 3D space.
`2. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`the 3D scene is automatically created based on certain
`criteria such as user preferences, the number and type
`of files currently on the user’s system, the numberof
`images on the user’s hard drive, or the number of
`browser favorite bookmarks in the user’s system.
`3. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`the 3D scene can be dynamically altered based on certain
`user-defined criteria such as selecting the desired color
`scheme or type of architecture desired (e.g. Art Deco,
`Victorian, Gothic, Egyptian... ).
`4. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`the 3D scene seamlessly integrates content from the
`Internet (e.g.
`the weather outside can be generated
`based on the actual weather, a stock ticker can be
`integrated into the scene based on actual stock info, and
`ads can be placed into the scene off of the Internet .
`.
`
`5. Acustomizable 3D GUI according to claim 1, wherein:
`
`the 3D scene is created using procedural generation of
`graphics and scenes.
`6. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`meansfor multiple users to navigate and interact with the
`scene and objects at the same time.
`7. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`icons as they
`the icons consist of standard shortcut
`currently look on a 2D desktop and/or 3D models
`and/or customized icons.
`8. Acustomizable 3D GUI according to claim 1, wherein:
`
`the icons actually look like the underlying file or website
`(e.g. the icon will be a screen captured image of the
`website or file), referred to as What You See Is What
`You Get Icons (WYSIWYGIcons).
`9. Acustomizable 3D GUIaccording to claim 1, wherein:
`
`the icons and linkedfiles or websites are pulled off of the
`Internet.
`
`[0045] The ability to automatically create a con-
`tent-representative icon (a What You See Is What
`the 3D GUIis platform independent and can be used on
`You Get or WYSIWYGIcon) of the underlying
`a PC, game console, set-top box, wireless device,
`file (e.g. the word processing document actually
`mobile device, or virtual reality device.
`looks like the document, the website icon looks
`like the actual website, the image icon looks like
`11. A customizable 3D GUI according to claim 1,
`wherein:
`the actual image ...)
`
`10. A customizable 3D GUI according to claim 1,
`wherein:
`
`10
`
`10
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`the 3D GUI is configured to be used for e-commerce,
`on-line shopping, stock market, financial, real estate, or
`factory floor automation industries.
`12. An automatically created customizable 3-dimensional
`graphical user interface (3D GUI) for a computer, including:
`
`a. customizable 3D space containing scenes (rooms, sky,
`worlds), objects and/or icons that are automatically
`generated;
`
`b. the 3D GUI application can scan the user’s hard drive
`to find each program,shortcut, favorite website, folder,
`and file and the application can automatically create a
`3D scene and place an icon for each such program,
`shortcut, website, folder and file into the 3D scene;
`
`c. means to navigate throughout the 3D space to view,
`manipulate, and click on the scene elements, objects,
`and/or icons;
`
`d. means for the user to interface with the computer,
`operating system, Internet, files, or underlying data
`through the icons in 3D space.
`13. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D scene is automatically created based on certain
`criteria such as user preferences, the number and type
`of files currently on the user’s system, the numberof
`images on the user’s hard drive, or the number of
`browser favorite bookmarks in the user’s system.
`14. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D scene can be dynamically altered based on certain
`user-defined criteria such as selecting the desired color
`scheme or type of architecture desired (e.g. Art Deco,
`Victorian, Gothic, Egyptian .. . ).
`15. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D scene seamlessly integrates content from the
`Internet (e.g.
`the weather outside can be generated
`based on the actual weather, a stock ticker can be
`integrated into the scene based on actual stock info, and
`ads can be placed into the scene off of the Internet .
`.
`
`16. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D scene is created using procedural generation of
`graphics and scenes.
`17. An automatically created customizable 3D GUI
`according to claim 12, including:
`
`means for multiple users to navigate and interact with the
`scene and objects at the same time.
`18. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the icons can consist of standard shortcut icons as they
`currently look on the 2D desktop and/or 3D models
`and/or customized icons.
`19. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the icons actually look like the underlying file or website
`(e.g. the icon will be a screen captured image of the
`website or file), referred to as What You See Is What
`You Get Icons (WYSIWYGIcons).
`
`20. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the icons and linkedfiles or websites are pulled off of the
`Internet.
`
`21. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D GUIis platform independent and can be used on
`a PC, game console, set-top box, wireless device,
`mobile device, or virtual reality device.
`22. An automatically created customizable 3D GUI
`according to claim 12, wherein:
`
`the 3D GUI is configured to be used for e-commerce,
`on-line shopping, stock market, financial, real estate, or
`factory floor automation industries.
`23. An automatically created customizable 3-dimensional
`graphical user interface (3D GUI) for a computer using
`procedurally generated graphical information, including:
`
`a. customizable 3D space containing scenes (rooms, sky,
`worlds), objects and/or icons that are automatically
`generated;
`b. means to scan the user’s hard drive to find each
`
`program, shortcut, favorite website, folder, and file and
`the application and to automatically create a 3D scene
`and place an icon for each such program, shortcut,
`website, folder and file into the 3D scene;
`
`c. means to navigate throughout the 3D space to view,
`manipulate, and click on the scene elements, objects,
`and/or icons;
`
`d. means for the user to interface with the computer,
`operating system, Internet, files, or underlying data
`through the icons in 3D space;
`
`e. means for procedurally generating graphical informa-
`tion including an application program containing algo-
`rithms that allow some and/or all of the 3D scenes
`and/or objects and/or icons to be procedurally gener-
`ated or modified based on transmission of a smaller
`“seed” file and/or user preferences.
`24. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, wherein:
`
`the 3D scene seamlessly integrates content from the
`Internet (e.g.
`the weather outside can be generated
`based on the actual weather, a stock ticker can be
`integrated into the scene based on actual stock info, and
`ads can be placed into the scene off of the Internet .
`.
`
`25. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, including:
`
`meansfor multiple users to navigate and interact with the
`scene and objects at the same time.
`26. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, wherein:
`
`the icons actually look like the underlying file or website
`(e.g. the icon will be a screen captured image of the
`website or file), referred to as What You See Is What
`You Get Icons (WYSIWYGIcons).
`27. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, wherein:
`
`11
`
`11
`
`

`

`US 2004/0109031 Al
`
`Jun. 10, 2004
`
`the icons and linked file or website are pulled off of the
`Internet.
`
`29. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, wherein:
`
`28. An automatically created and procedurally generated
`customizable 3D GUI according to claim 23, wherein:
`
`the 3D GUIis platform independent and can be used on
`a PC, game con sole, set-top box, wireless device,
`mobile device, or virtual reality device.
`
`the 3D GUI is configured to be used for e-commerce,
`on-line shopping, stock market, financial, real estate, or
`factory floor automation industries.
`*
`*
`*
`*
`*
`
`12
`
`12
`
`