(12) United States Patent
`(12) United States Patent
`Chiu et al.
`Chiu et al.
`
`ofIRM11111 1111111111111110111111
`1111111111111111111111111111111
`USOO6181336B1
`US 6,181,336 B1
`(10) Patent No.:
`US 6,181,336 B1
`(to) Patent No.: (cid:9)
`(45) Date of Patent:
`*Jan. 30, 2001
`(45) Date of Patent: (cid:9)
`*Jan. 30, 2001
`
`(54) DATABASE-INDEPENDENT, SCALABLE,
`(54) DATABASE-INDEPENDENT, SCALABLE,
`OBJECTORIENTED ARCHITECTURE AND
`OBJECT-ORIENTED ARCHITECTURE AND
`API FOR MANAGING DIGITAL
`ESENASDIGITAL
`MULTIMEDIA ASSETS
`
`(75) Inventors: Sheng-Yang Chiu, Palo Alto; Sathis N.
`(75) Inventors: Sheng-Yang Chiu, Palo Alto; Sathis N.
`Menon, Sunnyvale; Jeffrey D. Hollar,
`Menon Snys sty D. Hollar,
`Livermore, all of CA (US)
`IVermore, all O
`(US)
`(73) Assignee: Silicon Graphics, Inc., Mountain View,
`(73) ASSignee: synsraphs Inc., Mountain View,
`CA (US)
`
`c:
`- - -
`(*) Notice:
`( * ) Notice: (cid:9)
`
`This patent issued on a continued pros-
`This patent issued on a continued pros-
`ecution application filed under 37 CFR
`ecutIOn application filed under 37 CFR
`1.53(d), and is subject to th y ny
`1.53(d), and is subject to the twenty year
`patent term provisions of 35 U.S.C.
`past m proVISIons o
`a a- -
`154(a)(2).
`(a)(2).
`Under 35 U.S.C. 154(b), the term of this
`Under 35 U.S.C. 154(b), the term of this
`patent shall be extended for 0 days.
`patent shall be extended for 0 days.
`
`(56)
`(56) (cid:9)
`
`(21) Appl. No.: 08/644,686
`(21) Appl. No.: 08/644,686
`(22) Filed:
`May 31, 1996
`May 31, 1996
`(22) Filed: (cid:9)
`(51) Int. Cl." ....................................................... Gost 100
` GO6T 1/00
`(51) Int. Cl.' (cid:9)
` 345/329
`(52) U.S. Cl. (cid:9)
`(52) U.S. Cl. .............................................................. 345/329
`(58) Field of Search ...
`... 345/329-332,
`(58) Field of Search (cid:9)
` 345/329-332,
`345/352, 353, 355-357
`345/352, 353, 355-357
`s
`s
`References Cited
`References Cited
`U.S. PATENT DOCUMENTS
`U.S. PATENT DOCUMENTS
`2/1992 Davis et al. ......................... 395/100
` 395/100
`2/1992 Davis et al. (cid:9)
`OTHER PUBLICATIONS
`OTHER PUBLICATIONS
`Colton, M., “Multimedia Asset Management White Paper,”
`Colton, M., "Multimedia Asset Management White Paper,"
`About Informix White Papers, Informix, actual publication
`About Informix White Papers, Informix, actual publication
`date unknown, estimated 1992-1993.
`date unknown, estimated 1992-1993.
`
`5,091,849
`5,091,849 (cid:9)
`
`Aronson “HTML3 Manual of Style” pp. 112-123, 1995.*
`Aronson "HTML3 Manual of Style" pp. 112-123, 1995.*
`
`* cited by examiner
`* cited by examiner
`
`Primary Examiner Almis R. Jankus
`Primary Examiner (cid:9) Almis R. Jankus
`(74) Attorney, Agent, or Firm-Sterne, Kessler, Goldstein
`(74) Attorney, Agent, or Firm—Sterne, Kessler, Goldstein
`& Fox, p.l.l.c.
`& Fox, p.l.l.c.
`ABSTRACT
`(57)
`ABSTRACT
`(57) (cid:9)
`A System is described for providing an integrated, efficient
`A system is described for providing an integrated, efficient
`y
`p
`9.
`9.
`and consistent production environment for the Shared devel
`and consistent production environment for the shared devel-
`opment of multimedia productions. Examples of multimedia
`opment of multimedia productions. Examples of multimedia
`productions include feature animation films, computerized
`productions include feature animation films, computerized
`animation films, interactive Video games, interactive
`animation films, interactive video games, interactive
`movies, and other types of entertainment and/or educational
`movies, and other types of entertainment and/or educational
`multimedia works. The development of such multimedia
`multimedia works. The development of such multimedia
`products typically involve heterogenous and diverse forms
`products typically involve heterogenous and diverse forms
`of multimedia data. Further, the production tools and equip
`of multimedia data. Further, the production tools and equip-
`ment that are used to create and edit such diverse multimedia
`ment that are used to create and edit Such diverse multimedia
`data are in and of themselves diverse and often incompatible
`data are in and of themselves diverse and often incompatible
`with each other. The incompatibility between such devel
`with each other. The incompatibility between such devel-
`opment tools can be seen in terms of their methods of
`opment tools can be seen in terms of their methods of
`operation, operating environments, and the types and/or
`operation, operating environments, and the types and/or
`formats of data on which thev operate upon. Disclosed
`formats of data on which they operate upon. Disclosed
`n (ney operate upon.
`herein, is a complete solution that provides a consistent and
`herein, is a complete Solution that provides a consistent and
`integrated multimedia production environment in the form
`integrated multimedia production environment in the form
`of common utilities, methods and Services. The COO
`of common utilities, methods and services. The common
`utilities, methods and Services disclosed herein, are used to
`utilities, methods and services disclosed herein, are used to
`integrate the diverse world of multimedia productions. By
`integrate the diverse world of multimedia productions. By
`using the common utilities, methods and services provided,
`using the common utilities, methods and Services provided,
`diverse multimedia production tools can access, Store, and
`diverse multimedia production tools can access, store, and
`share data in a multiple user production environment in a
`share data in a multiple user production environment in a
`consistent, Safe, efficient and predictable fashion.
`consistent, safe, efficient and predictable fashion.
`
`19 Claims, 11 Drawing Sheets
`19 Claims, 11 Drawing Sheets
`
`718 (cid:9)
`
`g
`
`714
`
`716
`
`Browse
`Query Browse
`Query
`
`Catal
`Checkini CFR Placer
`Catalog Checkin/ CFR Placer
`99 Checkout
`Checkout & CDA
`
`720 (cid:9)
`
`722
`
`p r
`
`724
`
`p
`
`Content Creation
`Content Creation
`Tools
`Tools
`
`728
`
`p
`
`Production
`Production
`Mgmt
`Mgmt
`
`AMS clients
`AMS clients
`
`Repository
`Repository
`
`s 702
`702
`
`The Vault
`The Vault
`
`• • •
`
`704 - 1
`704 --'-'
`
`Repository
`Repository
`
`730
`730
`
`Metadata Server
`Metadata Server
`
`Content Servers
`Content Servers
`
`Metadata Server
`Metadata Server
`
`Content Servers
`Content Servers
`
`
`
`
`
`706
`706
`
`5
`708
`708
`
`1
`710
`710
`
`712
`712
`
`Page 1 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`U.S. Patent
`Waled *S11
`
`Jan. 30, 2001
`
`Sheet 1 of 11
`II JO 1 lamIS
`
`HI 9££`-18r9 Sa US 6,181,336 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`102a (cid:9)
`
`102b (cid:9)
`
`102n
`
`Asset Management
`Tool
`
`• • •
`
`Asset Management
`Tool
`
`Asset Managment
`Tool
`
`queuuôeue N ?assy
`|OOL
`
`104
`
`106
`
`I
`
`StudioLib
`Object Oriented Library - Data objects ,
`user interface services, utilities, etc.
`
`108a
`
`(cid:9)
`
`Vault
`Repository
`
`109a
`
`Asset Storage
`APIs
`
`108b
`
`(cid:9)
`
`Vault
`Repository
`109b Asset Storage
`APIs
`
`Vault API
`
`Asset services (checkin/checkout),
`system administration, Asset version
`managment, CFR support, repository
`support etc.
`108n — (cid:9)
`
`
`
`Vault
`Repository
`109n --, Asset Storage
`APIs
`
`110b
`
`110n
`
`Asset Storage
`Server
`
`Asset Storage
`Server
`
`Asset Storage
`Server
`
`FIG. 1
`
`Page 2 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 2 of 11
`Sheet 2 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`dataflow
`
`Silicon Graphics
`Silicon Graphics
`
`movieplayer
`- - - - - - -
`
`208 (cid:9)
`206
`-- 208
`206 (cid:9)
`Irs'
`I
`- - - - ;
`
`204
`2O2
`202
`204 (cid:9)
`5 (cid:9) Silicon Graphics Silicon Graphics or Mac
`Silicon Graphics - 5. Silicon Graphics Rsicon Gaphics at Me
`Silicon Graphics
`
`-
`
`-
`
`CDA
`
`k
`
`230
`
`Silicon Graphics
`Silicon Graphics
`
`CDS
`
`232
`
`(se
`
`file system
`
`I
`
`Edit System
`212
`
`
`
`210 (cid:9)
`
`ti (cid:9)
`file system
` 214
`
`V
`I
`Checkin/Checkout
`
`
`
`100
`100
`
`file system
`
`
`
`Animation
`
`222
`
`
`
`218
`218
`
`216
`
`ti (cid:9)
`file system
`
`220
`
`224
`
`Storyboard/Layout
`Checkin/Checkout
`
`
`
`Checkin/Checkout
`Checkin/C eckout
`
`226
`
`
`
`
`
`AMS
`AMS
`
`FIG. 2
`FIG. 2
`
`Page 3 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 3 of 11
`Sheet 3 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`
`
`frame(1)
`
`frame|2)
`
`O
`
`frame(5040
`
`300
`
`FIG. 3
`FIG. 3
`
`Page 4 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 4 of 11
`Sheet 4 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`2
`
`p
`
`416 418
`
`1 (cid:9)
`
`Ed c
`2 9 412
`
`410
`
`
`
`
`
`408 (cid:9)
`
`rotund butcher
`rotund_butcher
`404 ,y--
`
`scene1
`
`• •
`
`3
`
`402
`
`413 (cid:9)
`
`414 (cid:9)
`
`416
`
`FIG. 4
`FIG. 4
`
`Page 5 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 5 of 11
`Sheet 5 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`
`
`storyreel.31 sequence (71 scene (52) / frame (10) / background-r'
`storyreel.3 / sequence [7] / scene [52] / frame [10] / background' 502
`
`storyreel.3
`
`sequence (7) . .
`
`scene (52)
`
`frame 10
`
`.
`
`.
`. background . .
`. . background . .
`
`-1-1,-,-- 520
`1
`
`506
`
`508
`
`510
`
`512
`
`514
`
`516
`
`518
`
`FIG. 5
`FIG. 5
`
`Page 6 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 6 of 11
`Sheet 6 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`
`
`FIG. 6
`FIG. 6
`
`Page 7 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 7 of 11
`Sheet 7 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`714.
`714
`
`716
`716
`
`718
`718
`
`720
`720 (cid:9)
`
`722
`722
`
`724
`724
`
`C
`
`5
`5 (cid:9)
`5
`Checkin? CFR Placer
`Checkin/ CFR Placer
`Query Browse Catalog Checkout
`Catalog
`Browse
`Query
`Checkout & CDA
`
`5
`
`S
`Content Creation
`Tools
`
`• • •
`
`
`
`728
`728
`S
`Production
`Production AMS clients
`AMS clients
`Mgmt
`Mgmt
`
`
`
`
`
`
`
`Repository
`
`/
`
`Metadata Server
`Metadata Server
`
`5
`706
`706
`
`730
`''-'--- 730
`
`\
`
`Metadata Server
`Metadata Server
`
`Content Servers
`Content Servers
`
`S
`710
`
`S
`712
`712
`
`The Vault
`
`"--'"--- 702
`
`704 --"---
`
`Repository
`
`• • •
`
`Content Servers
`Content Servers
`
`rr
`
`5
`708
`708
`
`FIG. 7
`FIG. 7
`
`Page 8 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 8 of 11
`Sheet 8 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`movieplayer
`movieplayer
`
`.„,-,„-- 822
`Open
`Open
`
`804
`804
`
`808
`808 data stream
`data stream
`() ) (
`) (
`) () ) N
`
`826
`Play
`
`Close
`
`810
`
`Open
`ii.
`
`C D
`
`S
`
`
`
`Placer
`
`Usage info
`Usage Info
`
`CDA
`CDA
`
`802 (cid:9)
`2
`
`806
`806
`
`**`••••••----
`
`(containe)
`
`iz!nfig Info
`s
`
`Ei 8
`818
`
`820
`
`820
`
`Reserve
`Reserve
`
`4
`
`GetLocation
`GetLocation
`
`Connection Manager
`Connection Manager
`
`Update
`Update
`
`824
`.,-,..-- 824
`
`2
`812
`
`The Vault
`The Vault
`
`106
`,-...- 106
`
`
`
`828
`
`•-•
`file system
`file system
`(data)
`(data)
`...._ (cid:9)
`.....
`Content Server
`Content Server
`
`7O'8
`708
`
`FIG. 8
`FIG. 8
`
`Page 9 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001
`
`Sheet 9 of 11
`Sheet 9 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`Video Editor 1
`Video Editor 1
`
`
`
`Video Editor 2
`Video Editor 2
`
`- 902 Rai
`
`City
`
`910
`
`908
`
`— 108
`
`-- 904
`
`-- 906
`-
`
`Sequence
`Sequence
`
`Vault
`
`FIG. 9
`FIG. 9
`
`Page 10 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 (cid:9)
`
`Sheet 10 of 11
`Sheet 10 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`(statD-102
`
`1002
`
`Start
`
`•
`
`Design asset types
`
`r1004
`
`Use StudioLib to define
`Use StudioLib to define
`asset types
`asset types
`
`1006
`1006
`
`•
`Provide cataloging function for
`Provide cataloging function for (cid:9)
`filling-in values of each metadata
`filling-in values of each metadata
`field when assets are Created or
`field when assets are created or
`checked-in
`checked-in
`
`1008
`1008
`
`Provide support code and function
`Provide support code and function
`Calls to the checkin and checkout
`calls to the checkin and checkout (cid:9)
`Services as required
`services as required
`
`010
`010
`
`
`
`
`
`Provide support code and function
`Provide support code and function
`calls to other services (browse,
`calls to other services (browse,
`querry, etc.), as required
`querry, etc.), as required
`
`•
`Build program and link with progam
`Build program and link with progam
`resources of the present invention
`resources of the present invention
`
`1012
`1012
`
`1014
`1014
`
`Gend D 1016
`
`End)
`
`1016
`
`FIG. 10
`FIG. 10
`
`Page 11 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`U.S. Patent
`Waled *S11
`
`Jan. 30, 2001
`
`O
`O
`
`O
`
`1106a
`String Metadata Table
`
`e90 || || ?
`
`108a
`(cid:9) Ob ID
`
`108
`
`(cid:9),bb -ID
`
`0
`
`|| || ||
`
`108
`
`1112
`
`)0b-ID
`
`1116
`
`—1118
`
`(1106b
`Char Metadata Table
`
`1105
`
`Bool
`
`Long
`
`* • • • - - - -
`- - - - - - - - - - -
`-},
`
`
`
`
`
`
`
`1103
`
`„ /
`ZOI I
`(isri
`?uedoid)
`eigel?essy|(
`
`V
`
`1102
`
`|-
`
`1104a
`
`1104b
`
`Asset Table (Property List)
`
`Object-ID
`
`String
`
`Integer
`
`Object-ID
`
`Char
`
`String
`
`Sheet 11 of 11
`II JO II lamIS
`
`US 6,181,336 B1
`HI 9££`-18r9 Sa
`
`1104n -
`
`Object-ID
`
`Float
`
`Blob
`
`Struct
`
`0
`Ob ID
`
`Ob-ID
`
`Ob-ID
`
`Integer Metadata Table
`
`1106n
`
`Ob-ID
`
`Ob-ID
`
`Ob-ID
`
`FIG. 11
`
`Page 12 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`1
`1
`DATABASE-INDEPENDENT, SCALABLE,
`DATABASE-INDEPENDENT, SCALABLE,
`OBJECTORIENTED ARCHITECTURE AND
`OBJECT-ORIENTED ARCHITECTURE AND
`API FOR MANAGING DIGITAL
`API FOR MANAGING DIGITAL
`MULTIMEDIA ASSETS
`MULTIMEDIA ASSETS
`
`BACKGROUND OF THE INVENTION
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`1. Field of the Invention
`The present invention relates generally to management
`The present invention relates generally to management
`and processing of multimedia works and more particularly
`and processing of multimedia works and more particularly
`to providing a uniform and consistent environment for the
`to providing a uniform and consistent environment for the
`orderly development and archival of diverse multimedia
`orderly development and archival of diverse multimedia
`WorkS.
`works.
`2. Related Art
`2. Related Art
`The authoring of multimedia works can be a very
`The authoring of multimedia works can be a very
`expensive, time consuming and complicated process. Such
`expensive, time consuming and complicated process. Such
`projects can involve huge production teams, enormous
`projects can involve huge production teams, enormous
`budgets, and the resources of entire production Studios for
`budgets, and the resources of entire production studios for
`Significant amounts of time. Such multimedia works not
`significant amounts of time. Such multimedia works not
`only include computerized feature films Such as those pro
`only include computerized feature films such as those pro-
`duced by major Hollywood studios and the like, but they can
`duced by major Hollywood studios and the like, but they can
`also include interactive movies, Video games and other
`also include interactive movies, video games and other
`entertainment and educational type content that can run on
`entertainment and educational type content that can run on
`personal computers, dedicated game consoles, kiosk
`personal computers, dedicated game consoles, kiosk
`machines and the like. It is becoming more common that the
`machines and the like. It is becoming more common that the
`production of Such multimedia titles consume monetary
`production of such multimedia titles consume monetary
`budgets and other resources not unlike those commonly
`budgets and other resources not unlike those commonly
`asSociated with major Hollywood feature film productions.
`associated with major Hollywood feature film productions.
`Multimedia data, Such as collections of digital animations
`Multimedia data, such as collections of digital animations
`come in a variety of heterogeneous formats and Structures.
`come in a variety of heterogeneous formats and structures.
`Typically, during the creation of a multimedia project, many
`Typically, during the creation of a multimedia project, many
`different tools and application programs are used to create,
`different tools and application programs are used to create,
`edit, and otherwise process various types of multimedia
`edit, and otherwise process various types of multimedia
`data. In general each of the application programs, Such as
`data. In general each of the application programs, such as
`multimedia content authoring tools, operate on particular
`multimedia content authoring tools, operate on particular
`types and/or formats of data. Such types and formats of data
`types and/or formats of data. Such types and formats of data
`are typically not compatible with all the various application
`are typically not compatible with all the various application
`programs used in the production process.
`programs used in the production process.
`Additionally, each tool generally requires its own unique
`Additionally, each tool generally requires its own unique
`file Structures, hierarchies, and naming conventions, etc., to
`file structures, hierarchies, and naming conventions, etc., to
`manage, Store and retrieve data. Each tool may also use
`manage, store and retrieve data. Each tool may also use
`different methods to catalog, Search, and preview data.
`different methods to catalog, search, and preview data.
`Likewise, each tool may use a different method (or no
`Likewise, each tool may use a different method (or no
`method at all), to track different versions of multimedia data.
`method at all), to track different versions of multimedia data.
`In addition, many tools operate on different computer plat
`In addition, many tools operate on different computer plat-
`forms and environments that are not compatible with each
`forms and environments that are not compatible with each
`other. In a typical shared development process, Such incon
`other. In a typical shared development process, such incon-
`Sistencies make it difficult to coordinate and share resources
`sistencies make it difficult to coordinate and share resources
`among various members of the development team. In
`among various members of the development team. In
`addition, Such inconsistencies make it difficult to catalog and
`addition, such inconsistencies make it difficult to catalog and
`archive data in an efficient, Safe, and consistent manner.
`archive data in an efficient, safe, and consistent manner.
`Problems arising from Such inconsistencies can be very
`Problems arising from such inconsistencies can be very
`costly.
`costly.
`
`5
`
`10
`
`15
`15
`
`20
`
`25
`25
`
`30
`
`35
`35
`
`40
`40
`
`45
`45
`
`50
`50
`
`55
`55
`
`SUMMARY OF THE INVENTION
`SUMMARY OF THE INVENTION
`The present invention is directed toward a System and
`The present invention is directed toward a system and
`method for providing a consistent and efficient production
`method for providing a consistent and efficient production
`environment for the development of various types of mul
`environment for the development of various types of mul-
`timedia works and for the orderly archiving of the multi
`timedia works and for the orderly archiving of the multi- 60
`60
`media works to facilitate their re-use in later projects.
`media works to facilitate their re-use in later projects.
`Examples of multimedia works can include feature anima
`Examples of multimedia works can include feature anima-
`tion films, computer animation films, video games, interac
`tion films, computer animation films, video games, interac-
`tive movies, news clips, educational multimedia products,
`tive movies, news clips, educational multimedia products,
`corporate multimedia productions, multimedia Sales cata
`corporate multimedia productions, multimedia sales cata- 65
`65
`logs and the like. The present invention assists artists,
`logs and the like. The present invention assists artists,
`computer programmers, production managers, editors,
`computer programmers, production managers, editors,
`
`US 6,181,336 B1
`US 6,181,336 B1
`
`2
`2
`directors, and producers in tracking and managing all mul
`directors, and producers in tracking and managing all mul-
`timedia data created and used during the process of multi
`timedia data created and used during the process of multi-
`media productions and in finding and re-using assets from
`media productions and in finding and re-using assets from
`previous productions.
`previous productions.
`Multimedia data, as the term is used herein, includes any
`Multimedia data, as the term is used herein, includes any
`and all types of data used to produce any and all types of
`and all types of data used to produce any and all types of
`multimedia works. Each instance of multimedia data need
`multimedia works. Each instance of multimedia data need
`not comprise multiple data components or different types of
`not comprise multiple data components or different types of
`media. Indeed multimedia data can comprise data of a Single
`media. Indeed multimedia data can comprise data of a single
`media type. For example, a JPEG data file is an industry
`media type. For example, a JPEG data file is an industry
`Standard for a compressed data format that comprises a
`standard for a compressed data format that comprises a
`Single Still Video image. Even though a JPEG file comprises
`single still video image. Even though a JPEG file comprises
`a single media type, it is considered to be multimedia data
`a single media type, it is considered to be multimedia data
`because it can be used as part of a multimedia production.
`because it can be used as part of a multimedia production.
`Likewise, a multimedia authoring tool that can be used to
`Likewise, a multimedia authoring tool that can be used to
`create JPEG files may be referred to herein as a multimedia
`create JPEG files may be referred to herein as a multimedia
`tool. Multimedia data can also comprise multiple types of
`tool. Multimedia data can also comprise multiple types of
`media. For example, an MPEG data file is an industry
`media. For example, an MPEG data file is an industry
`Standard for a compressed data format that comprises full
`standard for a compressed data format that comprises full-
`motion video as well as audio data components. Thus, an
`motion video as well as audio data components. Thus, an
`MPEG data file is another example of multimedia data.
`MPEG data file is another example of multimedia data.
`The present invention provides an integrated platform for
`The present invention provides an integrated platform for
`a variety of diverse computerized utilities and application
`a variety of diverse computerized utilities and application
`programs that operate on and/or create various types of
`programs that operate on and/or create various types of
`multimedia data. Such computerized utilities and application
`multimedia data. Such computerized utilities and application
`programs can include Video film editors, painting programs,
`programs can include video film editors, painting programs,
`three-dimensional modeling utilities, animation tools, and
`three-dimensional modeling utilities, animation tools, and
`other multimedia data tools, running on a variety of com
`other multimedia data tools, running on a variety of com-
`puter Systems and platforms.
`puter systems and platforms.
`The present invention provides a means for bringing
`The present invention provides a means for bringing
`compatibility and uniformity to diverse multimedia produc
`compatibility and uniformity to diverse multimedia produc-
`tion environments. AS Stated, a multimedia production envi
`tion environments. As stated, a multimedia production envi-
`ronment typically comprises a plurality of diverse types of
`ronment typically comprises a plurality of diverse types of
`production tools. The present invention accomplishes com
`production tools. The present invention accomplishes com-
`patibility and uniformity among Such diverse multimedia
`patibility and uniformity among such diverse multimedia
`production tools by providing them with common program
`production tools by providing them with common program
`resources. The common program resources include a plu
`resources. The common program resources include a plu-
`rality of utilities and Services related to the management,
`rality of utilities and services related to the management,
`organization and Storage of multimedia data. Such program
`organization and storage of multimedia data. Such program
`resources are used to facilitate the creation of a consistent
`resources are used to facilitate the creation of a consistent
`and uniform multimedia production environment.
`and uniform multimedia production environment.
`The program resources provided by the present invention
`The program resources provided by the present invention
`also include a plurality of user interface components. Such
`also include a plurality of user interface components. Such
`user interface components provided by the present invention
`user interface components provided by the present invention
`can include dialog boxes, Scrollable list boxes, data entry
`can include dialog boxes, scrollable list boxes, data entry
`tables, data browsing facilities and the like. By using a
`tables, data browsing facilities and the like. By using a
`common Set of user interface components, diverse multime
`common set of user interface components, diverse multime-
`dia production tools can achieve a common overall look and
`dia production tools can achieve a common overall look and
`feel and thereby create a more consistent and uniform
`feel and thereby create a more consistent and uniform
`production environment from the user's perspective.
`production environment from the user's perspective.
`Also provided is a means for modifying and/or adding
`Also provided is a means for modifying and/or adding
`extensions to the plurality of utilities and Services provided
`extensions to the plurality of utilities and services provided
`by the present invention. This feature allows production
`by the present invention. This feature allows production
`Studios to quickly adapt to the rapidly changing environment
`studios to quickly adapt to the rapidly changing environment
`of multimedia data and multimedia production tools.
`of multimedia data and multimedia production tools.
`Further, the present invention provides Services and utili
`Further, the present invention provides services and utili-
`ties for indexing, Storing, retrieving, Searching, and gener
`ties for indexing, storing, retrieving, searching, and gener-
`ally managing and manipulating all of the multimedia data
`ally managing and manipulating all of the multimedia data
`created or used during the production process. The present
`created or used during the production process. The present
`invention provides for implementation of these features
`invention provides for implementation of these features
`through the use of one or more data base management
`through the use of one or more data base management
`systems (DBMSs). Typically, DBMSs that are supported by
`systems (DBMSs). Typically, DBMSs that are supported by
`the present invention are of the commercial-off-the Self
`the present invention are of the commercial-off-the self
`variety. This feature facilitates the use of presently existing
`variety. This feature facilitates the use of presently existing
`and/or readily available DBMSs. However, support for
`and/or readily available DBMSs. However, support for
`additional DBMSs can easily be added. Likewise, the ser
`additional DBMSs can easily be added. Likewise, the ser-
`
`Page 13 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`3
`3
`vices and utilities provided by the present invention, which
`vices and utilities provided by the present invention, which
`interact with the Supported DBMSs, can easily be modified
`interact with the supported DBMSs, can easily be modified
`and/or extended. Thus, a production Studio Simply attaches,
`and/or extended. Thus, a production studio simply attaches,
`in a plug-and-play (PNP) fashion, one or more supported
`in a 'plug-and-play' (PNP) fashion, one or more supported
`DBMS(s), and the file management features of the present
`DBMS(s), and the file management features of the present
`are automatically implemented.
`are automatically implemented.
`All multimedia data created and used during the produc
`All multimedia data created and used during the produc-
`tion process are organized by the present invention into data
`tion process are organized by the present invention into data
`objects that are referred to herein as assets. An asset is a
`objects that are referred to herein as `assets'. An asset is a
`data object that is defined by the present invention in a
`data object that is defined by the present invention in a
`particular manner. Each asset comprises two components,
`particular manner. Each asset comprises two components,
`namely, a contents component and a metadata component.
`namely, a contents component and a metadata component.
`The metadata component comprises information about an
`The metadata component comprises information about an
`asset, Such as its storage location, creation date, creator(s),
`asset, such as its storage location, creation date, creator(s),
`etc. The contents component comprises the actual multime
`etc. The contents component comprises the actual multime-
`dia data, which is typically a digital representation of, for
`dia data, which is typically a digital representation of, for
`example, a visual and/or audio data object. For example, an
`example, a visual and/or audio data object. For example, an
`asset representing a JPEG type image file as described
`asset representing a JPEG type image file as described
`above, comprises a metadata component and a contents
`above, comprises a metadata component and a contents
`component. The contents component is the JPEG file itself,
`component. The contents component is the JPEG file itself,
`which is a digital representation of a still Video image. The
`which is a digital representation of a still video image. The
`creator's name, the date of creation, and the fact that the file
`creator's name, the date of creation, and the fact that the file
`is a 240x320 JPEG image are examples of the types of
`is a 240 x320 JPEG image are examples of the types of
`information comprising the metadata component of an asset.
`information comprising the metadata component of an asset.
`All multimedia data is managed by the present invention
`All multimedia data is managed by the present invention
`in the form of assets. ASSets are logically Stored by the
`in the form of assets. Assets are logically stored by the
`present invention in a location that is referred to herein as the
`present invention in a location that is referred to herein as the
`asset bank or 'Vault. AS Stated, the actual implementation
``asset bank' or 'Vault'. As stated, the actual implementation
`of the asset bank or Vault is via one or more Supported
`of the asset bank or Vault is via one or more supported
`DBMS(s) and associated file systems.
`DBMS(s) and associated file systems.
`In addition, the present invention provides a means for
`In addition, the present invention provides a means for
`managing and controlling Separate and distinct versions of
`managing and controlling separate and distinct versions of
`assets that are developed during the production process.
`assets that are developed during the production process.
`Further, a means for logically relating versions of different
`Further, a means for logically relating versions of different
`assets to each other is provided. Accordingly, any asset
`assets to each other is provided. Accordingly, any asset
`version Stored in the Vault can refer to any other asset
`version stored in the Vault can refer to any other asset
`versions stored in the Vault that is in some way related.
`versions stored in the Vault that is in some way related.
`The contents component of asset data objects include for
`The contents component of asset data objects include for
`example, Scanned-in line drawings, drawings that are inked
`example, scanned-in line drawings, drawings that are inked
`and painted, backgrounds, inspirational artwork, color
`and painted, backgrounds, inspirational artwork, color
`models, 3D models, X-sheets, and production spreadsheets.
`models, 3D models, x-sheets, and produ