as) United States
`a2) Patent Application Publication (10) Pub. No.: US 2003/0142136 Al
`(43) Pub. Date: Jul. 31, 2003
`
`Carteret al.
`
`US 20030142136A1
`
`(54) THREE DIMENSIONAL GRAPHICAL USER
`INTERFACE
`
`(52) US. Che
`
`cosccossssssssnssensetntntseessnsstsseves 345/782
`
`(76)
`
`Inventors: Braxton Page Carter, San Diego, CA
`(US); Christiann Grace Moore, San
`Diego, CA (US)
`
`(57)
`
`ABSTRACT
`
`Correspondence Address:
`ARTER & HADDEN, LLP
`1100 HUNTINGTON BUILDING
`925 EUCLID AVENUE
`CLEVELAND, OH 44115-1475 (US)
`
`(21) Appl. No.:
`
`10/293,173
`
`(22) Filed:
`
`Nov. 13, 2002
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/333,401, filed on Nov.
`26, 2001.
`
`Publication Classification
`
`Asystem and methodfor displaying a desktop workspace of
`greater effective area than that of the display screen using
`Non-uniform Rational B-Splines (NURBS) surface planes
`employing real-time texture mapping. A 3D Desktop GUI
`based on NURBSallows a user to Manageshortcut icons,
`files, hard disks in a three-dimensional world having a
`plurality of objects provides enhanced navigational capa-
`bilities. In addition, the 3D Desktop allows the user to seek
`to an object or
`location in the NURB world, navigate
`throughout the world using cursor inputs and select an object
`to follow links associated with that object. When an object
`is selected from the NURB surface, a 3D file cabinet is
`displayed showing the contents associated with the object.
`Selecting a document from within the 3D filing cabinet
`displays the document in a preview page whichalso enables
`a user to launch the native application for the document.
`
`,
`;
`
`AXIS |
`3e
`
`“7
`
`(51) UntC07 oc ccecsssntestnnsetnnteneee G09G 5/00 PLANE 3
`
`1
`
`APPLE 1018
`APPLE 1018
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 1 of 25
`
`US 2003/0142136 Al
`
`(om)
`_h
`[J
`(J Desktop
`30 DIGITA File Edit View Favorites Tools
`mescto
`
`Help
`
`Ts
`
`DESKTOP. .
`
`
`(Gf Desktop
`—
`
`
`
`J Address: sae:
`
`30 DIGITA
`[ster
`x
`r
`of
`
`
`
`
`(J Local Disk:{C:)
`
`Fite Edit View Favorites Tools
`
`i
`Desktop
`Select an iten!
`!
`
`.m
`
`o
`My Computer
`
`Places
`
`Address: |] Local Qisk:(C:)
`
`Help Hy Network
`
`Nome
`
`o L
`
`
`
`ocal Disk
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Norton
`Protecte..
`
`ES
`INTERNET
`EXPLORER
`—
`|
`PS
`
`
`ig
`im
`
`CF ddsmax3__] les
`J 33dsmax3__! 1=
`=
`
`[=] Local Oisk:(C: )
`
`File Edit View favorites Tools: —
`
`
`
`=
`<Sbock
`& > &
`fy
`1S
`A Capacity: 27.9 68 Address:
`|(J Local Oisk:{C:)
`IS
`
`
`[Folders
`
`[BY Oesk top
`ao My Documents
`Ll), My Computer
`&{=3 We Floppy (As)
`
`b-3 lip 250 (0:)
`=Compact Disc (€:)
`&+-{(7H Control Panel
`+
`(+43 My Network Places
`comarcoass—
`+--9 Norton Protected Recycle Bin
`
`-S Internet Explorer
`!
`-{>)
`30 DIGITAL DESKIOP CUBE
`=i
`-£2)
`30 DIGITAL DESKTOP ne
`[sorTSO AGaiamaneComputer!
`
`10-4
`Fig.
`]A (PRIOR ART)
`
`Xi
`i
`i
`t
`
`i
`
`I l I1 I
`
`cD
`
`Mode
`
`A
`Prok
`Unins
`in
`p
`
`mee
`
`Select an item to
`description
`
`C1 Used: 19.2]
`C Free: 8.68
`
`
`
`-ED local Disk (Cs)
`
`
`
`
`S object(s)
`
`2
`
`Microsoft
`Out look
`
` i
`
`Adobe
`Acrobat 5.0
`a
`Arm Utilities
`
`14
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 2 of 25
`
`US 2003/0142136 Al
`
` Gol}.
`
`|
`
`I
`
`My Oocunents
`EA, Hy Computer
`ae My Network Places
`€}
`Norton Protected Recycle Bin
`}—_____
`Ito view its description. CG Internet Explorer
`
`le
`
`SizeA [type[Modifieda|
`
`File Folder
`
`2/24/2001 10:40Am
`
`File Fotder
`
`2/24/2001 10:40Am
`
`; Help
`
`
`
`{
`
`a
`
`item to
`
`view it
`
`3.1/2 Inch Floppy Disk
`Local Disk
`Removable Disk
`Compact Disc
`System Folder
`
`
`asMATCHTOFIC.IA
`Network and Dial-up Connection
`
`(P4 I/e Floppy (As)
`ED Local Disk {Cs}
`eS lip 250 (0:)
`My Computer
`Ed Compact Disc {Es}
`its descriptio (FH) Control Panel
`view
`to
`Select
`an
`item
`ription. &
`||Qisplays the files and folders on your
`j
`
`
`1|{Computer id
`
`See also:
`
`My Documents
`My Network Places
`
`(newomernae KDOM A&B FB i031
`1
`Fig.
`IB (PRIOR ART)
`Lp
`
`TH
`
`3
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 3 of 25
`
`US 2003/0142136 Al
`
`AXIS |
`3¢
`
`
`
`4
`
`

`

`Patent Application Publication
`
`US 2003/0142136 Al
`
`Jul. 31,2003 Sheet 4 of 25
`
`vo
`
`Plane 5
`28
`
`5
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 5 of 25
`
`US 2003/0142136 Al
`
`e|
`
`Plane |
`
`20
`
`Fig. 3A
`
`6
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003 Sheet 6 of 25
`
`Patent Application Publication
`
`Fig. 3B
`
`7
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 7 of 25
`
`US 2003/0142136 Al
`
`el
`
`PLANE 4
`
`PLANE 2
`
`8
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003 Sheet 8 of 25
`
`Patent Application Publication
`
`8 F
`
`ig. JA
`
`9
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 9 of 25
`
`US 2003/0142136 Al
`
`2]
`
`10
`10
`
`

`

`
`
`Fig. OA
`
`11
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003 Sheet 11 of 25
`
`Patent Application Publication
`
`12
`12
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 12 of 25
`
`US 2003/0142136 Al
`
`el
`
`CranommomIA
`
`tiedere?tie
`
`weetetenee
`
`tfii?
`
`LudOWoe
`
`bevybawCee
`
`13
`13
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 13 of 25
`
`US 2003/0142136 Al
`
`TNTTTN
`
`TNETTTEN
`
`TVtTTTATNTTF\oT\‘\
`
`14
`14
`
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 14 of 25
`
`US 2003/0142136 Al
`
`15
`15
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 15 of 25
`
`US 2003/0142136 Al
`
`
`
`
`3ddd_demo,,,
`
`Prev
`INSTALL
`
`
` be Mode|CHECK
`Groove LD|2| Conference
` Fig.8
` AutoCad
`2002
`VoloViewExpress_oproewildfire ZS AcrobatReader5.0
`
`
`
` MyDocuments
`
`MyComputer
`
`RecycleBin
`
`InternetExplorer a)Lé]Internet
`
`NetworkPlaces
`
`My
`
`16
`16
`
`;
`<
`<
`ws
`:
`°
`wu
`vo
`ou
`a
`—
`13
`ee
`[7)22
`=2
`5=
`g
`ce
`=
`= CO) “wg
`= ©
`_.
`eae S S
`
`(US oe”Esa8s (8s (bss | 2 sl eg
`
`—
`—w
`Mois} >
`(J < wu
`x] Ke =
`[=] us
`[a] us a
`nS
`c
`sa
`EG
`igs
`we
`=
`o
`Ss
`g3
`-
`“
`oO
`
`%
`
`°
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 16 of 25
`
`US 2003/0142136 Al
`
`aaa(GPELEIALIAIITL
`77TLAJASSSShSSSSSS
`
`Fig
`
`9
`
`17
`17
`
`
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 17 of 25
`
`US 2003/0142136 Al
`
`18
`18
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 18 of 25
`
`US 2003/0142136 Al
`
`
`PLANE 3
`
`PLANE 4
`104
`102
`
`
`19
`19
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003 Sheet 19 of 25
`
`Patent Application Publication
`
`20
`20
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 20 of 25
`
`US 2003/0142136 Al
`
`21
`21
`
`

`

`Patent Application Publication
`
`Jul. 31,2003 Sheet 21 of 25
`
`US 2003/0142136 Al
`
`22
`22
`
`

`

`Patent Application Publication
`
`fax)
`
`AutoCad 200c
`
`Jul. 31,2003 Sheet 22 of 25
`
`Conference
`
`US 2003/0142136 Al
`
`Ss
`
`23
`23
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003 Sheet 23 of 25
`
`Patent Application Publication
`
`24
`24
`
`

`

`Patent Applipplication Public
`
`Jul. 31, 2003 Sheet 24 of 25
`
`136 Al
`
`MRSS sasy
`
`
`
`
`
`on SPASSERSES
`SRSSSSSEE
`BATS
`GRSSSR
`:
`ReSEN a
`avast
`P
`a
`
`Me
`“so LETS2h
`MEEESSS
`z EIRENE
`<
`ant
`= MOS Sz323
`noe 44 TpTITITS
`= $21REESE .
`= i, rn TETTTISSS
`HERE EASY
`z
`SSsst a* ys2t
`>
`
`= BACAR SStiis3e
`5 Ree 5
`= BeeEERE :
`5 aEe :
`= RaeeERS =
`.
`tSAS zee
`aS
`ass = ae
`x
`:
`:
`iERS3
`ats
`: BASES :Ree x
`x eR *
`nta tesSS
`AaRS
`Sess
`RRAS %
`tift
`ik eS—
`x NAAR *
`; Ree :
`akathTINS ~~
`ey ASSASSEL
`=
`it
`reS= to
`fon
`-. eeEN x
`‘ SSSSS-.
`xea x
`:
`SS Soe
`*BaaCRS 1
`= SS.
`
`=RSSRSS
`|
`
`MeA, SESSESSSE
`a =
`te
`!
`:'ly
`ss
`
`Le
`
`
`
`'
`i
`iH
`li
`i
`u
`;
`
`Te
`anoe
`2. ORaak,
`Sov,
`
`RearRUNES<
`
`aat
`
`=REE:ms
`EheesBSSSSESSE <
`SRSsLES v
`
`oeRSE
`=
`SASSER
`¥
`cm,
`SARSESE ~
`SonSESS SE
`at)
`SSSSgS8
`3
`=
`
`Sa, SENS x
`Se ANWs
`“oe
`RES v 3%
`® RR *
`x
`eaSRSSSS if
`x
`SARSEES
`<i
`”
`we. RARERee
`*
`Se BARSESSAS
`*
`x AEA *
`x a *
`= Be x
`NNO “
`: Ae cl
`* PERI %
`eaEEN *
`Sgn RaeCS “
`= BRea *
`* RES Son
`Eg BAUR 3
`B RaeS i
`x pa =
`Kos: SRSERESSES
`™
`A
`SRaaRSEES
`= RCRA =
`x
`SPRRRS
`«
`*
`BARREESEES
`=
`nox ORRRESASEE
`“
`a,
`~< Sees bof
`x Sa =
`x
`POSS S833
`=
`»
`SeaSESE x
`*
`eaSESEES
`me
`: ASSES
`:
`SeaSSE of
`= DAS =
`®
`SPATSESE
`oe
`i
`aRAES -
`= PES ve
`=
`RRSERE
`vs
`*
`RRSESSESTA
`“
`n
`SRSERRESE
`*
`A BRR 5
`Fs
`SORESAEEES
`=
`aoe RE: :
`5g RASSSS *
`Se2t SEES
`=
`~ SSESLESESE
`3
`EESSEE =
`SESS z
`SEQSEEZZ =
`: SEZ *
`SS 3ES5222523"
`~ S3555225227"
`25237222"
`Tuer=
`py 22°
`
`S K
`
`
`
`25
`25
`
`

`

`Patent Application Publication
`
`Jul. 31, 2003 Sheet 25 of 25
`
`US 2003/0142136 Al
`
`bli OL
`
`ayigSEY]YLIMpazo!o0ssouo!109!)ddoaySayouND]4asnayNIjd0BuiyoajasAg
`a20/P0/11:Ppat!p31507
`
`
`P21094)9|N3d0|30p*a)dwoxama!aasd\ma!naud\pe\siuawnsopAu\:9:IUDN
`
`
`
`
`
`
`MODUIMMATAQIG341ULYIIMWO4y1X31SMOYsa)dwoxasiuyy
`
`‘uaal2SMalAaJdjuauND0payyJoa]dwoxaudSs!SIU
`
`Zl‘bi
`
`1002/92/11
`
`'$31Ly¥39d08d
`
`26
`26
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003
`
`THREE DIMENSIONAL GRAPHICAL USER
`INTERFACE
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application claims the benefit of U.S. Provi-
`sional Application No. 60/333,401, filed Nov. 26, 2001.
`
`REFERENCE TO COMPUTER PROGRAM
`LISTING APPENDIX
`
` [0003] A portion of the disclosure of this patent document
`
`Incorporated herein by reference is a Computer
`[0002]
`Program Listing Appendix. The Computer Program Listing
`Appendix is included on two copies of a compact disc in
`accordance with 37 CFR1.96(c)(2), 37 CFR 1.52(e), and
`MPEP 608.05. Each compact disc is labeled as follow:
`Inventors Braxton, Carter, and Christiann Moore; Title of
`Invention: Three Dimensional Graphical User Interface;
`Attorney Docket no. 76380/25135; created Nov. 13, 2002;
`he first copy is labeled “Copy 1” and the second copy is
`labeled “Copy 2”. Each compact disc includes a single file
`having a filename of “3ddd_nurbs.cpp”, which was created
`on Nov. 13, 2002 at 6:31 AM andhasa file size of 35,308
`bytes.
`
`COPYRIGHT NOTICE
`
`contains material which is subject to copyright protection.
`The copyright owner has no objection to the facsimile
`reproduction by anyone of the patent documentorthe patent
`disclosure, as it appears in the Patent and Trademark Office
`patent files or records, but otherwise reserves all copyrights
`whatsoever.
`
`BACKGROUND OFTHE INVENTION
`
`‘Ihe present invention relates generally to graphical
`[0004]
`user interfaces (“GUI”) for computer systems, and more
`particularly to computer system GUIs that permit a uscr to
`utilize a workspace having a greater effective area than that
`permitted by the two dimensional display area of a display
`screen.
`
`In atypical computer system, a user interacts with
`[0005]
`the system via various input devices, such as a keyboard and
`mouse, and various output devices, usually comprising a
`video display terminal having a screen for displaying images
`and text.
`In operation,
`the computer system executes a
`computer program called the operating system,
`(“OS”)
`whichallowsthe user, as well as other programs, to control
`the computer system. An OSincludes a user interface (“UI”)
`which allows a user to communicate with and control the
`Os.
`
`[0006] The various schemes for implementing UIs are
`categorized by the manner in which the user interacts with
`the system. For example, a character user interface (ChUD,
`such as DOS, controls an OS through text commands input
`by a user, generally via a keyboard. In response, the OS
`returns text messages to be displayed on a screen or video
`display terminal. However,
`in a GUI, such as Microsoft
`Windows XP and Macintosh OS X,a user suitably interacts
`with the system by manipulating graphical objects on a
`display screen. The display of a typical GUI comprises at
`least one window, whichis a framed user workspacethat can
`be manipulated independently of the portion of the display
`
`27
`27
`
`screen outside the frame. Windows generally contain
`objects, or icons, which represent various commands,appli-
`cations, andthe like. While a typical GUI display comprises
`two-dimensional objects such as the above-described win-
`dows and icons, a number of uscr interfaccs have been
`developed that employ three-dimensional constructs.
`
`[0007] Whenthe user opensor executes a icon in a typical
`GUI(e.g., in Windows XP, by double-clicking the mouse
`button while the cursor is positioned on the icon),
`the
`command represented by the icon is executed. Generally, an
`icon represents an application, which is launched when the
`command is executed. As a user adds more applications to
`the desktop more icons are required. At some point, the
`number of icons exceeds the available display space. In
`response, a numberof strategies for increasing display space
`have been implemented.
`
`[0008] One suchstrategyis to utilize scrollable windows.
`Horizontal and/or vertical scroll bars are provided to scroll
`the workspace past the window,thereby enabling the user to
`look at different portions of the workspace. Another such
`strategy is to provide multiple windows, each containing a
`portion of the total set of icons. The user suitably views
`different icons by sclecting different windows. But because
`the windows must eventually overlap due to limited display
`space, a user can see only a portion of the total set of icons
`at any given time.
`
`[0009] The drawbackto the prior art schemesis that icons
`are organized in two-dimensional windows, whether or not
`the two-dimensional windows. It would therefore be pref-
`erable if a user were able to view and manipulate icons as
`one would in three-dimensional space so that a user is
`capable of viewing a larger numberoficons simultaneously.
`
`SUMMARY OF THE INVENTION
`
`[0010] The present invention enables a computer system
`having a GUI to display three dimensional objects with
`icons mapped thereto. In the preferred embodiment,
`the
`three dimensional objects for displaying icons are Non-
`uniform Rational B-Splines (“‘NURBS”) surfaces. The tex-
`ture mapped NURBSsurface planes are then displayed at
`respective orientations to form a NURBScubeorother three
`dimensional abjects, which thereby appears to be comprised
`of a numberof faces, cach of which has a window. Thus,
`depending on the orientation of the object, a user can view
`one or more windows simultaneously.
`
`[0011] One aspect of the present invention is a graphical
`user interface system for simultaneously displaying a plu-
`rality of windows, comprising a plurality of Non-uniform
`Rational B-Splines surface planes, each surface plane hav-
`ing a window texture mapped thereon; and display means
`for displaying said surface planes at respective orientations.
`The Non-uniform Rational B-Splines surface planes may
`form a polyhedron such as a cube. Using input means for
`receiving user input causes the display means to display
`more than one of said surfaces simultaneously.
`
`the system further
`In the preferred embodiment,
`[0012]
`compriseseither an icon, an applet, or a combination thereof
`mapped to a one of the plurality of surface planes. When
`either an icon or appletis selected,a plurality of objects are
`displayed in a 3D File cabinet. The 3D File cabinet further
`comprises a representation of a document, wherein selection
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003
`
`of the representation causes the documentto be displayed in
`a preview window. The preview window further comprises
`means for launching an application associated with said
`document.
`
`[0013] Another aspect of the present invention is a com-
`puter-readable medium of instructions, comprising means
`for creating a plurality of Non-uniform Rational B-Splines
`surface planes, each surface plane having a windowtexture
`mapped thereon; and means for displaying said surface
`planes at respective orientations. Additional
`instructions
`may be
`implemented for
`the Non-uniform Rational
`B-Splines surface planes to form a polyhedron. The instruc-
`tions may further comprising means for receiving user input,
`causing more than one of surfaces to be displayed simulta-
`neously, or means for rotating the a Non-uniform Rational
`B-Splines surface planes in response to a user input. In a
`preferred embodiment of this aspect, The instructions fur-
`ther comprise means for displaying a plurality of objects in
`a 3D File cabinctthat is displayed when an objcctis sclected
`from one of the surface planes, the object maybe either an
`icon or an applet. When a documentis selected from the 3D
`File cabinet, means for displaying a representation of a
`document displays the documentin a preview window. The
`preview window having meansfor launching an application
`associated with said document.
`
`‘Yet another aspect of the present invention is a
`[0014]
`method for displaying icons on a graphical user interface
`comprising the steps of texture mapping a plurality of
`windowsto a plurality of Non-uniform Rational B-Splines
`surface planes; and displaying said surface planesat respec-
`ive orientations. The method may further comprise orien-
`ating the Non-uniform Rational B-Splines surface planes to
`form a polyhedron, such as a cube. The method may further
`include receiving user input and respondingto the user input
`by displaying more than one of the surfaces simultaneously.
`
`the
`In the preferred embodiment of the method,
`[0015]
`method further comprises either an icon, applet, or combi-
`nations thereof to the surface planes. Uponselection of the
`icon or applet, a 3D file cabinet displaying a plurality of
`documentsis displayed on the screen. Uponselection of one
`of the documents, a representation of a document is dis-
`played in a preview window.An application associated with
`he document is launched by selecting an icon from the
`preview window.
`
`
`
`[0016] Still other objects of the present invention will
`becomereadily apparent to those skilled innthis art from the
`following description wherein there is shown and described
`a preferred embodimentof this invention, simply by way of
`illustration of one of the best modes best suited for to carry
`out the invention. As it will be realized, the invention is
`capable of other different embodiments and its several
`details are capable of modifications in various obvious
`aspects all without from the invention. Accordingly,
`the
`drawing and descriptions will be regarded asillustrative in
`oature and not as restrictive.
`
`DESCRIPTION OF THE FIGURES
`
`[0017] FIG. 1 is an example of a typical prior art GUT;
`
`[0018] FIG. 2 is an exemplary GUI organization structure
`according to the present invention;
`
`[0019] FIGS. 3A and 3B partial views of a three-dimen-
`sional display of the type utilized in the present invention;
`
`28
`28
`
`[0020] FIG. 4 depicts a NURBScube; and
`
`[0021] FIGS. 5A and 5B depict one view of a three-
`dimensional GUI of the present invention according to a
`preferred embodiment;
`
`FIGS. 6A-6D depict additional views of a three-
`[0022]
`dimensional GUI of the present invention according to a
`preferred embodiment;
`
`[0023] FIG. 7 depicts an exemplary view of a three
`dimensional (3D)filing cabinet;
`
`[0024] FIG. 8 is an exemplary view of the 3D filing
`cabinet superimposed on a cube surface;
`
`[0025] FIG. 9 is an example of the 3D filing cabinet with
`a large number of documents stored therein;
`
`[0026] FIGS. 10 and 10cillustrate an example of the 3D
`filing cabinet with a plurality of plancs illustrating how the
`documents may be dragged outside of the filing cabinet;
`
`[0027] FIG. 11 is an example of the 3D filing cabinet
`wherein the filing cabinet draweris larger than the frame of
`the filing cabinet;
`
`[0028] FIG. 12 is an example of the 3D filing cabinet with
`more than one draweris open;
`
`{0029] FIG. 13is an illustration showing an example of a
`filing cabinet with a lockable drawer option;
`
`[0030] FIG. 14 is an example of the 3D filing cabinet
`illustrating a document being removed from the drawer;
`
`[0031] FIG. 15 isa top view of a 3D filing cabinet wherein
`the documents may be extended from the cabinct along the
`positive and negative x axis and the positive and negative y
`axis;
`
`[0032] FIG. 16 is an isometric view of the 3D filing
`cabinet showing documents extending from the cabinet
`along the x, y and z axis; and
`
`[0033] FIG. 17 is an example of a documentdisplayed in
`a preview window.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`[0034] The preferred embodimentof the invention is dis-
`cussed in detail below. While specific steps, configurations
`and arrangements are discussed,it should be understood that
`this is donefor illustrative purposes only. A person skilled in
`the relevant art will recognize that other steps, configura-
`tions and arrangements can be used without departing from
`the spirit and scope of the invention.
`
`[0035] Turning now to FIG.1, a typical prior art GUIis
`displayed. A display screen is filled with a background 10
`(otherwise known as a desktop 10). Superimposed on desk-
`top 10 are a numberof rectangular graphical objects referred
`to as windows 12. A window 12 is a framed user workspace
`which can be manipulated independently of that portion of
`the display screen outside the frame. For example, a window
`in a word processing application suitably contains the text of
`a document the user is editing, or a window in a drawing
`application suitably contains the figure the user is drawing.
`A window belonging to a computer OS suitably contains
`icons 14. Superimposed on desktop 10 are a number of
`windows 12, each containing a numberof icons 14. Typi-
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003
`
`[0044] where t_i are the knots forming a knot vector
`
`U={t_0, t_l,..., t_m}.
`
`the user
`cally, each icon 14 represents a command that
`suitably executes by double-clicking on icon 14 using a
`mouse button. In the preferred embodiment, each icon 14
`represents an application, which is launched by executing
`[0045] Turning now to FIGS. 2A and 2B, a NURBScube
`the commandrepresented by the icon. With the prior art GUI
`of the type utilized in the present invention is displayed. The
`as shownin FIG.1, the user experiencesdifficulty locating
`NURBScube 21 suitably occupiesafirst plane 20 generally
`icons 14 and therefore experiencesdifficulty executing com-
`parallel to second plane 22, and third plane 24 generally
`mands because many icons 14 are not
`readily visible
`parallel to forth plane 26, wherein both the third plane 24
`because the windows 12 overlap. Evenif all of the icons 14
`and forth plane 26 are generally orthogonalto first plane 20
`were transferred to a single window,there are simply more
`and second plane 22. The cube 21 also occupiesa fifth plane
`icons than can be displayed simultaneously in the available
`28 generally parallel to sixth plane 30 whereinthe fifth plane
`space on the display. It would therefore be preferable if there
`28 and sixth plane 30 are generally orthogonalto first plane
`existed a method for viewing all icons 14 simultaneously.
`20, second plane 22, third plane 24 and forth plane 26.
`
`[0036] Accordingly, the present invention seeks to provide
`a three-dimensional space for the placementof icons 14 such
`that more icons 14 are viewable simultaneously than would
`be possible utilizing a desktop having overlapping windows.
`One method of creating a three-dimensional space for the
`placement of icons 14 is utilize Non-uniform Rational
`B-Splines (“NURBS”). NURBSare tools that can be used
`for the representation and design of geometry. In the pres-
`ently preferred embodiment, NURBSare utilized to design
`a
`three-dimensional desktop. Advantages
`to utilizing
`NURBSasopposedto alternative techniquesare as follows:
`NURBSoffer one common mathematical form for both,
`standard analytical shapes (e.g. conics) and free form
`shapes; NURBSprovide the flexibility to design a large
`variety of shapes; NURBScan be evaluated reasonably fast
`by numerically stable and accurate algorithms; NURBSare
`invariant underaffine as well as perspective transformations;
`and NURBSare generalizations of non-rational B-splines
`and non-rational and rational Bezicr curves and surfaces.
`
`[0037] Onc advantage NURBShave, is a flexibility in
`defining parametric shapes. NURBS-shapes are not only
`defined by control points, but also by weights associated
`with each control point. ANURBScurve C(u), for example,
`is a vector-valued piecewise rational polynomial function,
`and is suitably defined as:
`
`Cw) =
`
`sum(i = 0, n){w_ix P_ix N_i, k(w)}
`sum(Zi = 0, n){w_ix N_i, kw}
`
`(1)
`
`[0038] where
`
`[0039] w_i: weights
`
`[0040]
`
`P_i: control points (vector)
`
`[0041] N_i,k: normalized B-spline basis functions of
`degree k
`
`[0042] Thesc B-splines are suitably defined recursivelyas:
`
`[0046] The cube 21 suitably has six sides, each of which
`has an inside or interior face and an outside or exterior facc.
`
`First side 34 resides in first plane 20, second side 36 resides
`in second plane 22, third side 38 resides in third plane 24,
`forth side 40 resides in forth plane 26,fifth side 42 resides
`in fifth plane 28, and sixth side 44 residesin sixth plane 30.
`Thesix sides are suitably the same shape andsize or varying
`in sizes. According to a presently preferred embodimentof
`the present invention, up to twelve workspacesare suitably
`displayed simultancously, onc on cach face (inside and
`outside) of each of six sides of rotating cube 21. The
`workspaces are preferably translucent such that all twelve
`workspacesare visible to a user simultaneously. In addition,
`the three-dimensional cube is suitably rotatable about at
`least one axis, and preferably about three axes.
`
`[0047] Turning nowto FIGS. 3A and 3B,partial cubes 21
`are displayed to illustrate how positions are located in the
`cube.
`
`[0048] Turning next to FIG.4, anotherpartial cube 21 for
`texture mapping is shown. In a presently preferred embodi-
`ment of the present invention, windowsor desktop surfaces
`are applied to the faces (interior or exterior) of the cube by
`a process known as “texture mapping,” which is the appli-
`cation of an image to the surface of a displayed object.
`Therefore, when the cube rotates, the texture mapping is
`suitably executed in real time such that the texture mapping
`rotates with the cube.
`
`[0049] Turning now to FIGS. 5A and 5B, a texture
`mapped cube 21is displayed. Each side of the cube 21 has
`a unique surface display, or texture map. From the angle
`shown in FIG. 5A and with an opaque texture mappedside,
`three displays are visible simultaneously.It is also within the
`scope of the present invention to provide translucent sides
`such that all 6, or 12 if both faces are utilized, displays are
`visibly accessible to a user.
`In the presently preferred
`embodiment, the translucency of the cube 21 permits the
`
`titk+l—-u Nitlk-l
`“u-ti Nik-l
`Nikw <
`
`_i, = yee" i,k— +Tee1etiel* Lit], k-I(w)
`
`and
`[0043]
`/1, if t_i<=u<t_i+]
`N_i,0@)=<0
`\0, else
`
`user to view a greater numberof cube faces(i.¢., windows)
`simultaneously. When all six windowsare translucent, the
`user can see all of the icons at once. Icons on faces of the
`
`cube which are seen through other faces suitably appear
`
`29
`29
`
`

`

`US 2003/0142136 Al
`
`Jul. 31, 2003
`
`this inversion allows the
`i.e. mirrored;
`laterally inverted,
`user to more easily perceive the orientation of the cube.
`Preferably, when a userselects a window,it becomes opaque
`so that it is more easily viewable.
`[0050] Turning now to FIGS. 6A through 6D, various
`views of a NURBcube 21 of a preferred embodimentof the
`present invention are displayed. Preferably,
`the cube 21
`suitably rotates aboutat least one axis in anyoneof atleast
`three modes:
`(1) constantly rotation, (2) user controlled
`rotation or (3) both. In the presently preferred embodiment,
`the cube 21 has a default rotation pattern such that each face
`of the cube is displayed as normalto the user’s line of sight
`once during each rotation cycle. Both the rotation speed and
`rotation patter are suitably controlled by the user.
`
`In the presently preferred embodiment, the three
`[0051]
`dimensional cube suitable works in conjunction with the
`GUI software. Therefore, the cube suitably interacts with
`programs and operating systems including but not limited to
`Microsoft Windows OSs, Linux OSs, Mactintosh OSs, an
`Unix OSs. In addition,
`the cube suitably functions with
`software such as Java 3D, Open GL, Active X or the like. In
`the presently preferred embodiment, the cube 21 is formed
`by a user such that the user selects which icons or windows
`to display on eachside of the cube. The selectionis suitably
`accomplished through drop-down menusor the like. When
`a user selects to form a cube, the GUI suitably causes the
`desktop to shrink away from the user to reveal a cube. The
`user then suitably selects default images and/or windows
`such that the images are displayed on the faces of the cube
`whenit is first formed. In essence, each side of the cube
`suitably acts like the desktop of a computer. Once one or
`more windows is mapped onto the cube, the user suitably
`selects a window. In response, the selected window then
`becomes opaque. If the user wishes to edit a window,the
`user suitably removes a window from the cube and edits it
`as one would a standard, two-dimensional window. Once
`edited, the window is suitably re-applied to the cube.
`[0052] The user suitably selects any viewpoint from which
`to display the cube, including viewpoints from inside of the
`cube. As a result, the cube is scalable. The user also suitably
`controls both the rotation and oricntation of the cube. The
`
`user suitably selects to view the cube at any face of any side
`and at any axis. There are no restrictions on the cube display
`other than those created by the limit on sides in a three-
`dimensional object.
`[0053] One exemplary view of the cube is an axis view in
`which one axis orthogonal to each side of the cube, are
`displayed. Control points are also suitably provided at
`regular intervals along the axes to enable the user to grab and
`drag the cube to achieve a desire orientation. Because the
`cube works in conjunction with current OSs, a user has an
`option to return to a standard desktop at any time by
`resetting or turning the cube off. In such instances, the cube
`disappears,
`the desktop rises to fill
`the screen, and any
`windows that were mapped to the cube reappear on the
`desktop.
`In addition, the present invention is limited to the
`[0054]
`shape of a cube, nor is it limited to displaying only one
`geometrical shape. In another embodiment of the present
`invention, a user suitably elects to have more than one cube
`displayed simultaneously, permitting an even greater num-
`ber of windowsto be displayed. Each cube maytherefore be
`minimized so that it is represented by a small, cube icon.
`Preferably, the icon spins.
`
`[0055] Referring now to FIG. 7, there is shown a three
`dimensional (3D) file cabinet 70 as contemplated by the
`present invention. A user may associate a plurality of docu-
`ments, programs, applets, or other objects to an icon or
`applet and store them in the 3D File cabinct 70. Like a
`typical office filing cabinet, the 3D file cabinet comprises a
`frame 71 and a drawer 78. The 3D file cabinet 70 is
`displayed whenthe user selects either an icon or applet from
`the desktop or cube 21 that has documents, programs, or
`objects associated. The 3D File cabinet 70 functions as a
`sub-menu. The 3D File cabinet 70 opens a drawer 78, within
`the drawer is are documents 72, 74 and 76. The documents
`have tabs 72a, 74a and 76a for displaying data about
`documents 72, 74 and respectively, allowing a user to easily
`determine the contents of each document. FIG. 8 showsthe
`3D File cabinet 70 superimposed overa planer surface. The
`location of the 3D File cabinet 70, whether covering a
`surface of cube 21, or located clsewhere on the display is
`unimportant.
`
`[0056] Referring now to FIG.9, there is shownthe 3Dfile
`cabinet 70 with a large number of documents 90 extending
`beyond the length of the drawer 78. As those skilled in the
`art can readily appreciate, as the 3D file cabinet 70 is virtual
`as opposed to being a truly physical filing cabinet, more
`documents 90 may be placed in the drawer 78 than would
`normally be physically realizable. Similarly, the drawer 78
`can actually be larger than the frame 70 as shown in FIG.11.
`Scroll bars (not shown) or other means maybe usedto scroll
`through the documents 90.
`
`there is
`[0057] Referring now to FIGS. 10 and 10a,
`shownthe virtual filing cabinet with a plurality of planes
`102, 104, 106, 108 and 110. Each plane 102, 104, 106, 108
`and 110 maybe used to store a document and by using input
`means such as a mouse, the planes may be moved outside of
`the 3D File cabinet 70 by standard dragging techniques to
`view additional details which maybe stored on the docu-
`ment.
`
`[0058] Referring now to FIG. 12, there is shown a 3D
`filing cabinet 70 with three open drawers 78, 120 and 122.
`It should be notedthat all of these drawers, 78, 120 and 122
`are longer than the cabinet 70. This arrangement may be
`convenient when more than one type of documentorclass
`of documents are linked to a particular icon or applet. For
`example, reports may be stored in the cabinet 70 by month
`wherein each of the drawers 78, 120 and 122 represent a
`different month’s report. As another example, Microsoft
`Word style sheets, documents, and add-ins maybe stored in
`the drawers 78, 120 and 122 respectively.
`
`[0059] Referring now to FIG. 13, there is shown a 3D
`filing cabinet 70 with a lock 130. A user maylock one of the
`drawers 78, 120, 122 by selecting the key icon 130 and
`dragging it to one of the drawers 78, 120, 122. The process
`would further include prompting the user for a password.
`Access to the protected drawer thereafter would require the
`password. Thus the 3D filing cabinet 70