.
`
`Ulllted States Patent [19]
`Gustman
`
`US006092080A
`[11] Patent Number:
`[45] Date of Patent:
`
`6,092,080
`Jul. 18, 2000
`
`[54] DIGITAL LIBRARY SYSTEM
`
`5,297,249
`5,317,728
`
`Z/1994 Bernsteinlet al. .................... .. 345/356
`/1994 Tevis et a .
`........................... .. 707/204
`
`
`
`
`
`
`
`[75] Inventor: Samuel Gustman, Santa Monica, Calif. . . . .
`
`
`
`5j414j644
`
`
`
`$313163“ et a1‘ """"""""" " 5/1995 Seaman 618.1. . 364/551.01
`
`
`
`[73] Asslgnee: Sumvor? Ofthe Shoah V1s“a_lH1st°rY
`F?undatl?n, L0S Angeles, Cahf-
`
`.
`[21] Appl' NO" 09/184’796
`
`5/1995 Williams ....... ..
`5,414,808
`5/1995 Banning et al.
`5,421,008
`9/1995 Cramsie et al.
`5,448,726
`4/1996 Bottomley et al
`5,508,732
`5,574,905 11/1996 deCarmo .............. ..
`
`345/328
`..... .. 707/4
`.. 707/103
`348/7
`707/1
`
`[22] Filed;
`
`NOV_ 2, 1998
`
`,
`
`,
`
`
`
`sBtrafclllen-Harder etal. ............ .. e ...................................... ..
`
`
`
`-
`-
`Related US. Application Data
`
`5 664 227 9/1997 Mauldin et al
`3
`3
`.
`
`707/516
`
`5,689,648 11/1997 DiaZ . . . . . . . . . . . . .
`
`. . . .. 707/26
`
`[60] Continuation of application No. 08/677,539, Jul. 10, 1996,
`Pat. No. 5,832,499, which is a division of application No.
`09/076,504, Jul. 10, 1996, and a continuation of application
`NO‘ 08/680’504’ 1111's’ 1996’ Pat‘ NO‘ 578327495.
`
`5832 495 11/1998 Gustman
`578927909
`4/1999 Grasso
`5’893’095
`4/1999 Jain _ _ _ _ _ _ _
`5’9O7’837
`5/1999 Ferrel
`,
`,
`
`707/102
`__ 39500031
`_ _ _ _ _ __ 707/6
`7076
`
`........................................ ..
`
`[51] Int. c1.7 .................................................... .. G06F 17/30
`[52] US. Cl. ................................. .. 707/103; 707/3; 707/6;
`707/102
`[58] Field Of Search .................................. .. 707/3, 6, 102,
`707/103; 708/26, 39, 44; 709/103; 380/4;
`345/356; 713/200; 714/20, 26; 702/186
`_
`References Clted
`U.S. PATENT DOCUMENTS
`
`[56]
`
`OTHER PUBLICATIONS
`Ramaiah, CK, Multimedia systems in libraries and their
`applications, , Defence Scienti?c Information and Docu
`mentation, v91- 18, issue 6, pp 25—40/, Nov- 1998
`The Gale Group, IBM Digital Library Unveils Products,
`Partners, Plans, NeWsbytes, pp. 1—5, Jul. 1997.
`Primary Examiner—Thomas G. Black
`Assistant Examiner—Diane D. MiZrahi
`Attorne , A em, or Firm—The Hecker LaW Grou
`y g
`P
`
`3,593,309
`
`7/1971 Clark, IV et al. ...................... .. 44/347
`
`[57]
`
`ABSTRACT
`
`8/1971 LoiZides et al. .......................... .. 707/1
`3,602,895
`9/1971 Loizides et a1_ __
`376037937
`_ 707/101
`3,613,086 10/1971 Loizides er a1, __
`707/101
`3,643,226
`2/1972 LoiZides et al. ..
`. 340/1725
`3,646,524
`2/1972 Clark, IV et a1- -
`- 340/172-5
`3,651,483
`3/1972 Clark, W et a1~ -
`395/898
`376707309
`6/1972 Amlilalhl etaLl
`~ 71g 159
`22252;? et a '
`' 3976872
`1/1982 Clifton et'gi """""""""""""""" 907/205
`4’31O’883
`4:322:88 3/1982 Howard et ai
`"""""""""" 364/178
`473587824 11/1982 Glickman et a1
`707/5
`
`_
`_
`_
`_
`_
`_
`_
`The invention is a digital library system that includes: 1) a
`data capture mechanism that includes data transfer and
`cataloguing mechanisms, 2) an asset management system
`for access and storage management of data, and 3) a
`distribution system for distributing the data and system
`functionality. A data capture system includes a transfer
`system and a cataloguing system. The ‘transfer system con
`verts multimedia material that exists in analog form to a
`digital format. The cataloguing system catalogues data. The
`cataloguing system creates a catalogue that can be used to
`
`4,408,273 10/1983 Plow . . . . . . . . . . . . . . . . .
`
`. . . .. 707/202
`
`perform content-based searches. A content-based search
`
`4,819,156
`4,928,233
`4,945,428
`479877533
`
`4/1989 Delorme et al.
`5/1990 Minis - - - - - - - - -
`7/1990 Waldo
`(‘51mg 6: atl' 1
`468 28
`6/1992 Hznefie? 6‘: gal """"""""""
`9/1992 lohgson et aL
`""""""""""""" __ 707210
`5’151’989
`8/1993 Bendert et al.
`. 707/205
`5,237,682
`5 287 459 2/1994 Gniewek ................................. .. 369/34
`
`395/ 182.13
`- - - ~- 345/419
`360/92
`
`'
`
`retrieves data based on the ideas or concepts contained in the
`data. An asset management system is used to access the data
`using the catalogue created by the cataloguing system. A
`distribution facility can be used to transmit the data thus
`giving a user access to all of the data contained in the digital
`library system despite the user’s location.
`
`16 Claims, 9 Drawing Sheets
`
`-
`
`C l ap ure
`
`240
`/
`
`r
`
`Cataloguing
`System
`
`254
`
`246 A
`/
`|
`
`250
`
`Transfer
`\>
`——/ System
`
`@
`Y'X
`
`Indexing
`Server
`
`256
`
`216
`
`206
`
`258 / '
`
`260
`
`1
`
`Long Term
`Storage
`
`\
`252
`
`204
`
`246
`
`8
`
`242
`
`NoneLine
`Slur-age
`
`Page 1 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`US. Patent
`
`Jul. 18, 2000
`
`Sheet 1 0f 9
`
`6,092,080
`
`B:
`
`mHH
`
`EMU
`
`
`
`nHHz<OmDH>O\H
`
`cHH
`
`mHH
`
`HuHHmHH
`
`wHH
`
`
`
`>m02m§23:2
`
`
`
`
`
`>~HOEm2OmDH>DnHU
`
`NHH
`
`mU<~HOHmmm<§
`
`mmDOEHHHDm<0m>mvH
`
`OHH
`
`H85me
`
`Page 2 of21
`
`MINDGEEK EXHIBIT 1 001
`
`Page 2 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 2 of9
`
`6,092,080
`
`2:17:02
`
`ow?oum
`
`NmN
`
`Now mam
`
`mom
`
`wExmUE
`325m
`
`EN
`
`“$922k
`
`52am
`
`EN
`
`Page 3 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 3 of9
`
`6,092,080
`
`meow .................... -..
`
`N mam
`
`305mm
`
`m ohm
`
`205mm
`
`won
`
`m 205mm ,
`
`. 21w /
`
`NE
`
`Page 4 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 4 of9
`
`6,092,080
`
`start
`
`402
`/
`search for data in
`local cache
`
`404
`
`all data found in
`local cache
`
`any data in
`another cache?
`
`408
`/
`406
`Yes+ retrieve data into
`local cache
`
`all data
`located?
`
`Yes —>@
`
`412
`
`remaining data
`offline?
`
`N o —> raise error
`
`414
`
`Yes
`416
`/
`V
`retrieve data into
`local cache
`
`418
`
`Figure 4
`
`Page 5 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 5 of9
`
`6,092,080
`
`502
`
`space available
`in cache?
`
`Yes —>@
`
`504
`
`can space be
`freed?
`
`N o —->
`
`raise error
`
`506
`/
`
`Yes
`¢
`
`508
`
`purge unused data
`
`c
`
`i
`
`510
`
`/
`retrieve data into
`cache
`
`/
`
`1
`update cache
`management
`information
`
`514
`
`Figure 5
`
`Page 6 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`US. Patent
`
`Jul. 18, 2000
`
`Sheet 6 0f 9
`
`6,092,080
`
`30
`
`
`
`£§E:E.S=m33.5»
`
`
`
`wwaM:EmmNQ83>
`
`o3
`
`NS
`
`Em.
`
`MESmg
`
`Sufism
`
`was;
`
`$9395
`
`mkmauumh
`
`:3me
`
`Bob
`
`
`
`mmmuu<
`
`~28.“
`
`0H0£9kuwmmv~
`
`moaukmfitw
`
`$3280
`
`kaeu
`
`$55523:
`
`omuswfi
`
`mu=u£§<
`
`Page 7 of21
`
`MINDGEEK EXHIBIT 1 001
`
`Page 7 of 21
`
`MINDGEEK EXHIBIT1001
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 7 of9
`
`6,092,080
`
`gm
`
`
`
`\ :0 km; m. 9th.
`
`25.2
`
`n:
`
`§ 8&5
`
`Page 8 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`U.S. Patent
`
`Jul. 18,2000
`
`Sheet 8 of9
`
`6,092,080
`
`704
`
`704
`
`Segment
`
`Segment
`
`728
`
`f 706
`
`Phrase
`
`732 \
`
`730
`
`714
`./
`Proposed
`Keyword
`
`738
`
`710
`
`Ke 0rd
`yw
`
`720
`./
`Image/
`Video
`
`724
`./
`Proposed
`Person
`
`; 718
`/
`
`Person
`
`_
`
`734
`
`712
`/
`Thesaural
`Keyword
`
`./
`
`Ke 0rd
`yw
`
`T
`ype
`
`716
`
`722
`/
`Thesaural
`Person
`
`736
`
`726
`/
`
`Person
`Information
`
`746
`
`716
`
`Figure 7B
`
`Page 9 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`US. Patent
`
`Jul. 18, 2000
`
`Sheet 9 0f 9
`
`6,092,080
`
`Runaway:
`
`Son903me
`
`13339:
`
`8.3999$me
`
`€5meer
`
`03H6.5238”
`
`mGOEogxovfi
`
`Eusgmfifi./own
`
`mmmh
`
`<mam
`
`mmmm
`
`<35
`
`man
`
`Damn
`
`Ugh
`
`mam.
`
`<35
`
`nomn
`
`8R/Damnwwh
`
`
`
`<35EoimM
`
`muGSmE
`
`mGO
`
`“K8:me
`
`mums
`
`ARE
`
`Deon.
`
`Moon
`
`<omh
`
`mmmh
`
`Amman
`
`mwmh
`
`
`
`<35.202:an
`
`8:39:
`
`03%
`
`Page 10 of21
`
`MINDGEEK EXHIBIT 1 001
`
`Page 10 of 21
`
`MINDGEEK EXHIBIT1001
`
`
`

`

`1
`DIGITAL LIBRARY SYSTEM
`
`6,092,080
`
`This application is a continuation of 80/677,539 Jul. 10,
`1996, US. Pat. No. 5,832,499, Division of 09/076,504 Jul.
`10, 1996 pending application Continuation of 08/680,504
`Jul. 8, 1996 US. Pat. No. 5,832,495.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`This invention relates to a system for cataloguing, storing,
`retrieving, and distributing multimedia data.
`2. Background
`Increasingly, computer systems are being used to present
`multimedia material. Such material is usually in the form of
`text, graphics, video, animation, and sound. (Other examples
`include books, manuscripts, pictures, ?lm, audio
`recordings.) TWo or more of these data types are usually
`combined to form the multimedia data presented by the
`computer system. A computer system that is used to present
`multimedia material is called a multimedia system.
`The multimedia material must be captured before it can be
`used by a multimedia system. For example, some or all of
`the multimedia data is in an analog format and must be
`converted to digital form before it can be used by a multi
`media system. The multimedia data converted from analog
`must be managed. A management facility is needed to
`manage and maintain the data. An access capability is
`needed to search and retrieve stored multimedia data. Once
`it is retrieved, a distribution facility is needed to distribute
`the data to a multimedia system. Thus, a system is needed to
`capture, access, manage, and distribute multimedia material.
`Such a system is digital library system.
`A number of patents that describe softWare and/or hard
`Ware systems are provided beloW. These systems do not
`provide a digital library system that can capture, access,
`manage, and distribute multimedia material.
`A search system is described in US. Pat. No. 5,241,671,
`Reed et al., issued on Aug. 31, 1993 relates to a multimedia
`system that includes a database that is comprised of Words,
`phrases, numbers, letters, maps, charts, pictures, moving
`images, animations, and audio information. A search capa
`bility is provided that provides a series of entry paths for
`locating information in the database. An entry path alloWs a
`user to enter a search request that consists of a set of valid
`terms or stop terms. Astop term is a term that exists on a stop
`term list and may be the Words “the” or “a”, for example.
`Valid terms are linked to related terms using a stem index.
`Astem index contains a root term and a set of stems for each
`term that is related to the root Word. For example, the Word
`leaf is linked to terms “leaves” and “lea?ng”.
`Arepetitive analysis event system that accesses data using
`a time-based number is described in US. Pat. No. 5,414,644,
`Seaman et al., issued on May 9, 1995. The system uses an
`information library that consists of visual data storage and a
`textual database for storing Written descriptions of the visual
`data and a glossary of keyWords that identify repetitive
`events or behavior. A behavioral label is used to de?ne a
`behavioral activity. A series of images or video clips are
`associated With the behavioral label. A user can retrieve
`images by identifying a subject, a behavioral activity, or
`other type of descriptive text. A chronological timeline is
`used to control the order in Which the images are displayed.
`That is, the images are displayed in sequential order using
`the time-based number.
`Amethod for storing and retrieving information that uses
`a “three ?le” concept is described in US. Pat. No. 3,670,
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`310, BharWani et al., issued on Jun. 13, 1972. This concept
`is so named because it uses three ?les: an index ?le, a search
`?le, and a data ?le. The index ?le contains a keyWord record
`for each keyWord. AkeyWord is a Word that exempli?es the
`meaning or value of information. The search ?le contains a
`search record for each data record in the data ?le. A search
`record contains an address for its associated data record in
`the data ?le, the keyWords for the data record. Each keyWord
`in the search record has an associated link address to another
`search record that contains the same keyWord. BharWani
`states that it improves on the “three ?le” concept by: 1) using
`an adjustable keyWord length in the index ?le to conserve
`space, 2) providing a means for marking items as deleted so
`that they can be bypassed, 3) automatically generating
`keyWords based on ?eld values contained in a data record,
`and 4) providing continuous searching even during a data
`base update procedure.
`A knoWledge based information retrieval system is
`described in US. Pat. No. 5,404,506, FujisaWa et al., issued
`on Apr. 4, 1995 . The system provides a visual interface for
`local searching and a natural language interpreter for global
`search. The natural language interpreter is used to infer the
`meaning of a noun phrase or a nominal phrase. The inferred
`meaning is used to retrieve information.
`A system for distributed data from a centraliZed location
`to a remote location is described in US. Pat. No. 4,974,149,
`Valenti, Nov. 27, 1990. The centraliZed system generates a
`descriptor that describes the data and its source location. The
`descriptor may further de?ne When the data is to be
`retrieved. The remote systems use the descriptor to retrieve
`the data. A preferred embodiment uses the descriptor to
`distribute softWare (i.e., executable and data ?les).
`A system for database retrieval Wherein entries in differ
`ent databases are retrieved by a process of matching key
`Words of the databases is described in US. Pat. No. 5,210,
`868, Shimada et al., issued on May 11, 1993. Examples of
`tWo such databases are a mapping database and a customer
`attribute database. Adictionary is used to separate a keyWord
`from a ?rst database into common and proper noun subparts.
`Common and proper noun synonyms are inferred according
`to a set of rules. The synonyms are combined using a
`combination rule and then compared With keyWords in a
`second database to generate a ?nal matching result.
`A system for assembling documents, or ?les is disclosed
`in US. Pat. No. 5,222,236, Potash et al., issued on Jun. 22,
`1993. Documents are stored in a library that is composed of
`a series of volumes. A volume is a logical grouping of
`documents such as legal documents. A volume is decom
`posed into a set of chapters. For example, a chapter Within
`a “legal documents” volume might contain documents
`related to commercial laW. The system further provides a
`series of user interface screens that prompt a user for input
`that is used to update a data ?eld in a document (e.g.,
`addressee).
`A process for creating a search query from a natural
`language query is described in US. Pat. No. 5,265,065,
`Turtle, issued on Nov. 23, 1993. A database contains a
`plurality of stopWords and phrases. The database is used to
`eliminate stopWords from the natural language query. The
`remaining Words are stemmed to their basic roots, or Words.
`The stemmed Words are compared against the database to
`identify phrases. The phrases and any remaining stemmed
`roots form the search query and are referred to as query
`nodes of a query netWork. The query nodes are also repre
`sentation nodes of a document. A synonym database is used
`for ?nding synonyms.
`
`Page 11 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`3
`A service for managing hypertext/hypermedia links is
`described in US. Pat. No. 5,297,249, Bernstein et al., issued
`on Mar. 22, 1994. A Link Manager Services (LMS) com
`ponent provides a universal End User Interface (EUI)
`including menus and dialog boxes that can be called by an
`application program When a link, or marker, is selected by an
`application user. The LMS accesses a database that contains
`information about markers and their associated “presenters”
`(e. g., application or program). In addition, the LMS includes
`a vieWer capability for vieWing and maintaining existing
`links and creating neW links. The LMS is used at runtime to
`generate menus and dialog boxes and manage the hypertext/
`hypermedia links.
`A system that interconnects audio-video equipment such
`as video tape record or video production sWitcher using one
`or more “AV LANS” in Us. Pat. No. 5,307,456, Mackay,
`issued on Apr. 26, 1994. Generic device commands are
`communicated over an AV LAN to a device translator. The
`device translator translates the generic command into a
`device-speci?c command. The AV LANs are interconnected
`using bridges. The AV LANs can further be used to inter
`connect Workstations, minicomputers, mainframes and per
`sonal computers. The Workstations can be used to display
`information about the resources attached to an AV LAN.
`Atext searching system that includes: 1) a morphological
`analyZer that generates a set of Words that are lexically
`related to an input Word and that together With the input
`Word constitute a set of search Words and 2) a search engine
`for searching an index to detect the occurrence of any of the
`search Words in the index is described in US. Pat. No.
`5,369,577, Kadashevich et al., issued on Nov. 29, 1994. The
`morphological analyZer includes a recognition engine that
`identi?es derivational information for a given input Word. A
`thesaurus database is used to generate a list of synonyms for
`the lexically related Words. The synonyms and variations of
`the synonyms (i.e., Words formed by adding a suffix to a
`synonym) are included in the set of search Words. The
`system can further be used to expand an input Word into
`related Words by removing suf?xes. Further expansion is
`accomplished by using the thesaurus database to obtain
`synonyms for the related Words.
`A system for dynamically loading softWare libraries. A
`service requester of an application program sends a request
`to a loader module of an application program is described in
`US. Pat. No. 5,410,698, Danneels et al., issued on Apr. 25,
`1995. The application’s loader module forWards the request
`to a second loader module outside the application program.
`The service requester can be a media services manager of a
`multicast application program that issues a request to load a
`media service provider library. A global dynamic loader
`receives the request as part of the multicast application
`program and forWards it to the global dynamic loader
`executable (i.e., the second loader module) that loads the
`media service provider library.
`A method for manipulating video data that alloW for the
`de?nition of frames in a string of isochronous data using
`frame numbers or names is described in US. Pat. No.
`5,414,808, Williams et al., issued on May 9, 1995. Frames
`can be grouped into segments. Frames can be referenced and
`operations performed on frames using the frame de?nitions.
`A method for storing data in data stores at various
`locations in a netWork is described in Us. Pat. No. 5,442,
`771, Filepp et al., issued on Aug. 15, 1995. These locations
`can be the user system and netWork concentrator facilities
`hierarchically located betWeen the user system and the
`netWork host. Data is cached in either a temporary cache
`
`4
`(e.g., RAM) or a variable-content permanent stage (e.g.,
`variable-content, ?xed disk ?le). A least-recently-used
`approach is used to determine the data that is retained in a
`store. In addition, storage candidacy and version control
`parameters are used to insure currency if maintained for
`time-sensitive data (e.g., neWs or pricing data).
`An image data ?ling system consisting of a library for
`storing a plurality of image storage media (e.g., optical
`disks), a disk array for storing image data retrieved from the
`image storage media, a console for entering user
`instructions, and an output device for displaying image data
`is described in US. Pat. No. 5,463,771, Sotoyanagi et al.,
`issued on Oct. 31, 1995. Acontrol device is used to control
`the retrieval and storage operations.
`A system for storing and retrieving digital images is
`described in US. Pat. No. 5,493,677, Balogh et al., issued on
`Feb. 20, 1996. Acaption or other metadata can be associated
`With a digital image. A natural language capability removes
`ambiguities from the metadata input by a user prior to its
`storage. The natural language capability determines matches
`betWeen a user query and the stored metadata. The system
`alloWs a user to select an image, revieW licensing terms for
`the selected image, and order the image.
`A technique for dynamically optimiZing the processing of
`a database query execution plan is described in US. Pat. No.
`5,495,608, Antoshenkov et al., issued on Feb. 27, 1996. A
`decision is made during processing to either retrieve records
`using indexed keys or by retrieving all records based on
`Which approach is optimal.
`
`SUMMARY OF THE INVENTION
`The invention is a digital library system that includes: 1)
`a data capture mechanism that includes data transfer and
`cataloguing mechanisms, 2) an asset management system
`for access and storage management of data, and 3) a
`distribution system for distributing the data and system
`functionality.
`A data capture system includes a transfer system and a
`cataloguing system. The transfer system converts multime
`dia material that exists in analog form to a digital format. In
`addition to the data output from the transfer system, the
`cataloguing system can also receive textual data as input.
`The cataloguing system catalogues the multimedia and
`textual data. The cataloguing system creates a catalogue that
`can be used to perform content-based searches. A content
`based search retrieves data based on the ideas or concepts
`contained in the data. Data is stored by the transfer system
`independent of content. The cataloguing systems creates a
`catalogue that speci?es the content of the data. The cata
`logue includes one or more catalogue elements Which can be
`complex multimedia assets. Acomplex multimedia asset can
`consist of one or more attribute elements. An attribute
`element is an attribute that can have attributes (i.e., pieces of
`information). A catalogue element is associated With a
`portion of multimedia data (e.g., one or more frames of
`video data).
`An asset management system is used to access the data
`using the catalogue created by the cataloguing system. The
`asset management system identi?es data having the desired
`content. The asset management system includes search tools
`to query the catalogue to identify a set of catalogue elements
`having attributes that satisfy a search criteria. The data
`associated With the catalogue elements have the desired
`content.
`The asset management system includes a broWser, an
`indexing server, an archive server, a tertiary storage
`
`6,092,080
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Page 12 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`6,092,080
`
`5
`manager, and a method player. Generalized interfaces de?ne
`a communication protocol that can be used by any vendor
`supplied browser, indexing server, archive server, tertiary
`storage manager, and/or method player to communicate With
`another asset management system component.
`Arequest for data is received by a broWser. The broWser
`in combination With the indexing server locates a set of
`catalogue elements that satisfy criteria speci?ed in the
`request. The set of catalogue elements are sent to an archive
`server for retrieval. The archive server maintains an identi
`?cation of the location of the multimedia data. Thus, When
`a set of catalogue elements is received from the broWser, the
`archive server can identify the location of the portions of
`multimedia data having the desired content (i.e., the portions
`of multimedia data associated With the catalogue elements
`contained in the set).
`The multimedia data associated With a catalogue element
`is retrieved by the archive server in conjunction With a
`tertiary storage manager. A tertiary storage manager man
`ages a store that contains multimedia data. The system can
`consist of multiple instances of tertiary storage manager to
`manage each data store. The tertiary storage manager can
`manage various types of data store. The archive server
`identi?es the tertiary storage manager that manages the store
`containing the requested multimedia data. The tertiary stor
`age manager retrieves the data and transmits the data to a
`method player. The method player prepares the data
`(converts the data from MPEG to video format) and trans
`mits the prepared data to the broWser. The broWser formats
`a display region and displays the data in the display region.
`A caching mechanism is implemented by the asset man
`agement facility to store retrieved data locally. Preferably,
`cache is used to store multimedia data that is being or Will
`be played on the broWser. The asset management facility
`locates the data and, if necessary, stores the data in local
`cache. Preferably, cache management is supplied by an
`instance of tertiary storage manager. The tertiary storage
`manager that manages the data denormaliZes the data alloW
`ing for faster access.
`A tertiary storage manager that manages the cache uses a
`least recently used (LRU) scheme. Thus, multimedia data
`that has the oldest access time is purged to make room for
`neWly accessed data. The archive server determines Whether
`the local cache contains the multimedia data associated With
`the catalogue elements. If the multimedia data is not stored
`in local cache, the archive server can query other archive
`servers to determine Whether the data is stored in a remote
`cache. If the archive server cannot ?nd a cached copy of the
`data, it Will attempt to retrieve the data from permanent
`storage (e.g., a tape system).
`Adistribution facility can be used to transmit the data thus
`giving a user access to all of the data contained in the digital
`library system despite the user’s location. Multimedia data
`is permanently stored at a centraliZed location. Multimedia
`data that is requested by a user is cached from the centraliZed
`location to the user site. AWide area netWork can be used to
`interconnect user sites With the main site. The WAN can be
`used to transmit data that resides at the main site or another
`user site to a requesting user site. In addition, data can be
`transferred betWeen sites via the Internet.
`Either a centraliZed or decentraliZed distribution architec
`ture can be used With the invention to distribute functionality
`(e.g., asset management functionality). In a centraliZed
`architecture, the asset management facility is located at a
`centraliZed site. Users connect to the asset management
`facility via the Internet, for example. The catalogue and
`
`10
`
`15
`
`20
`
`30
`
`40
`
`45
`
`55
`
`60
`
`65
`
`6
`multimedia data are stored at the central site. The catalogue
`is accessed at the central, or main site to identify the
`requested data. The data is then transmitted to the user via
`the Internet.
`In a decentraliZed architecture, an instance of the asset
`management system is located at the user’s site. A copy of
`the catalogue is resident at the user site. The multimedia data
`is permanently stored at a main site With copies of data that
`has accessed stored at the user’s site. The local catalogue is
`accessed to identify the data requested in a user request. If
`a copy of the requested data does not exist at the local site,
`a search is made for the data at another site. The search ?rst
`examines the cache at the other sites. If the data cannot be
`found in cache at the local or another site. The local site
`accesses the main site to retrieve the requested data. A
`vehicle such as a WAN or the Internet can be used to
`transmit the data betWeen sites.
`The asset management system can include various access
`levels (i.e., simple to complex) each of Which is associated
`With a level of interface to access the data based on the type
`of audience. The audience can be an individual or a group of
`people, for example. At the complex access level, the
`audience must be able to understand the catalogue structure
`(i.e., catalogue element and associated attributes and
`attribute elements).
`At a programmer’s level, an interface consisting of loW
`level softWare routines are available to query the catalogue
`and its associated attributes and attribute elements. The
`loW-level softWare routines can be used to create a higher
`level of abstraction of objects. These objects can become
`selectable elements in a graphical user interface (GUI) for a
`development tool that can be used to create a higher-level
`interface. The GUI can include a drag and drop capability to
`create a GUI and associate GUI objects to objects that
`supply functionality (e. g., objects contained in a higher-level
`interface.)
`A development tool can be used to create a broWser, for
`example. AbroWser can include the ability to vieW instances
`contained in a catalogue and its associated attributes and
`attribute elements. The user can create a query by dragging
`these instances into a search box and specifying conjunction
`information (e.g., “and” or “or).
`At the simplest access level, prede?ned sets are created
`and stored for vieWing by individuals using a single video
`vieWing station or in a virtual reality environment or video
`display kiosks for vieWing by groups of people.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 provides an example of a general purpose com
`puter to be used With the present invention.
`FIG. 2 provides a block overvieW of the data capture and
`interface subsystems according to an embodiment of the
`present invention.
`FIG. 3 provides a block overvieW of the data distribution
`subsystem according to an embodiment of the present inven
`tion.
`FIG. 4 provides a process How for cache management and
`retrieval according to an embodiment of the invention.
`FIG. 5 provides a data retrieval into cache process How
`according to an embodiment of the invention.
`FIG. 6 provides examples of access levels and audiences
`that can be accommodated by interfaces provided by an
`asset management system according to an embodiment of
`the invention.
`FIG. 7A provides an example of catalogue and attribute
`elements and their attributes according to an embodiment of
`the invention.
`
`Page 13 of 21
`
`MINDGEEK EXHIBIT1001
`
`

`

`6,092,080
`
`7
`FIG. 7B illustrates relationships formed between the
`elements identi?ed in FIG. 7A according to an embodiment
`of the invention.
`FIG. 7C provides an illustration of instances of keyWord
`710 and a plurality of associated label attributes according to
`an embodiment of the invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`A digital library system is described. In the folloWing
`description, numerous speci?c details are set forth in order
`to provide a more thorough description of the present
`invention. It Will be apparent, hoWever, to one skilled in the
`art, that the present invention may be practiced Without these
`speci?c details. In other instances, Well-knoWn features have
`not been described in detail so as not to obscure the
`invention.
`An embodiment of the invention can be implemented as
`computer softWare in the form of computer readable pro
`gram code executed on a general purpose computer such as
`illustrated in FIG. 1. A keyboard 110 and mouse 111 are
`coupled to a bi-directional system bus 118. The keyboard
`and mouse are for introducing user input to the computer
`system and communicating that user input to central pro
`cessing unit (CPU) 113. Other suitable input devices may be
`used in addition to, or in place of, the mouse 111 and
`keyboard 110. I/O (input/output) unit 119 coupled to
`bi-directional system bus 118 represents such I/O elements
`as a printer, netWork communications card, modem, A/V
`(audio/video) I/O, etc.
`The computer system of FIG. 1 also includes a video
`memory 114, main memory 115 and mass storage 112, all
`coupled to bidirectional system bus 118 along With keyboard
`110, mouse 111 and CPU 113. The mass storage 112 may
`include both ?xed and removable media, such as magnetic,
`optical or magnetic optical storage systems or any other
`available mass storage technology. Bus 118 may contain, for
`example, thirty-tWo address lines for addressing video
`memory 114 or main memory 115. The system bus 118 also
`includes, for example, a 32-bit data bus for transferring data
`betWeen and among the components, such as CPU 113, main
`memory 115, video memory 114 and mass storage 112.
`Alternatively, multiplex data/address lines may be used
`instead of separate data and address lines.
`In one embodiment of the invention, the CPU 113 is a
`microprocessor manufactured by Motorola, such as the
`680><0 processor or a microprocessor manufactured by Intel,
`such as the 80x86, or Pentium processor, or a SPARC
`microprocessor from Sun Microsystems. HoWever, any
`other suitable microprocessor or microcomputer may be
`utiliZed. Main memory 115 is comprised of dynamic random
`access memory (DRAM). Video memory 114 is a dual
`ported video random access memory. One port of the video
`memory 114 is coupled to video ampli?er 116. The video
`ampli?er 116 is used to drive the cathode ray tube (CRT)
`raster monitor 117. Video ampli?