`Case 2:11-cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 1 of 52 Page ID #2137
`
`EXHIBIT 4
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 2 of 52 Page ID #:138
`Case 2:11-cv—10692-DOC-JPR Document1-4
`Fi|ed12/27/11 Page 2 of 52 Page ID #2138
`
`|l|||| llllllll Ill ||ll|||||| 1.... ...ll Illll ||||| Illlllllll |ll||| III lllll ||||
`
`US005 832495A
`
`United States Patent
`
`19
`
`11
`
`Patent Number:
`
`9
`7
`5 832 495
`
`Gustman
`
`‘
`
`[451 Date of Patent:
`
`Nov. 3, 1998
`
`395/551.01
`395/612
`............. 370/420
`
`_
`
`
`
`
`.
`
`5/1995 Seaman ctal
`5,414,644
`6/199:
`-
`-
`~
`5,428,774
`5,461,611 10/1995 Drake, Jr. etal.
`gglzigiet
`c a an
`:
`gfe°f;°;°:1f1:_.~
`. 395/611
`4/1997 Briggs etal.
`5,617,119
`. 395/604
`5/1997 Braden-Harder et al.
`5,630,121
`............................. .. 395/614
`5/1997 Zellweger
`5,630,125
`
`5,682,330 10/1997 Seaman et al.
`364/551.01
`5,724,605
`3/1993 Wissner ................................. .. 395/806
`
`[54] METHOD AND APPARATUS FOR
`CATALOGUING MULTIMEDIA DATA
`
`Inventor: Samuel Gustman, Santa Monica, Calif.
`[75]
`[73] Assignee: Survivors of the Shoal: Visual History
`F°““dat‘°“’ L°5A“g°1°S’C“hf'
`
`[21] Appl. No.: 680,504
`_
`Fflcdt
`
`[22]
`
`1111- 8, 1996
`
`-,
`
`,
`
`Int. Cl.5 ....................................... G06F 17/30
`[51]
`[52] U.S. Cl. ....................... ..
`707/102; 707/104
`Of S€‘3I‘C]1
`..................................
`
`707/102, 104
`
`Primary Examz‘ner——Wayne Amsbury
`Attorney, Agent, or Firm—Hecker & Harriman
`
`'1l1e invention catalogues data such as multimedia data. A
`catalogue is a collection of one or more catalogue elements.
`An index is used to access a catalogue. An element of a
`catalogue has one or more attributes. An attribute provides
`information that can be used to search for, answer uestions
`fl
`about, and navigate through a catalogue. An attribute of a
`catalogue element can be an element that has attributes. A
`catalogue element attribute that is an element is referred to
`-
`-
`as an attribute element. Attribute elements and attributes are
`dt b .1d
`. d
`th t
`b
`dt f
`.]it t
`t1
`“S5
`° "1,
`,‘‘“m ex
`“ can “use
`° 3°’ “C” “O?”
`access. Within a catalogue, smaller catalogues can be cre-
`ated by, for example, querylng and 115“ d6S1gHat10n-
`
`29 Claims, 34 Drawing Sheets
`
`5,119,474
`5,121,470
`55123933
`5>210-B68
`5,241,671
`
`References Cited
`“E
`NT DOCUMENTS
`Us" P
`6/1992 Bcitel et al.
`5/1992 Tfautmafl
`5/1992 Kflsaham C‘ “L
`5/1993 Shhnad“ ct "L ‘
`8/1993 Reed et al.
`.
`.
`.
`5,274,758 12/1993 Beltel et al.
`5,278,946
`1/1994 Shimada etal. .
`5,280,573
`1/1994 Kuga et a1_
`__
`5,303,296
`4/1994 Zuckcr
`5,404,506
`4/1995 Fujisawa et al.
`5,408,655
`4/1995 Oren at at.
`
`
`
`395/807
`395/140
`395/35?
`395/615
`395/615
`
`395/807
`.. 395/62
`395/333
`379/67
`395/604
`
`.. 395/601
`
`[56]
`
` 214
`
`210
`
`
`
`236
`
`6
`
`Thesaural
`Person
`
`Person
`
`Information
`
`m
`
`Keyword
`
`Proposed
`Keyword
`B8
`
`
`
`Z12
`
`Thesaural
`Keyword
`
`
`
`
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 3 of 52 Page ID #:139
`Case 2:11-cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 3 of 52 Page ID #:139
`
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 1 of 34
`
`5,832,495
`
`E
`
`E
`
`g
`
`E
`u
`
`9-4
`5
`8
`e
`>
`
`o
`h
`
`0
`2
`
`at\—(
`
`E
`V‘
`
`«»
`:4
`
`>-*
`M
`
`E
`“J
`E
`2
`2
`
`E2
`G
`E
`§
`E3
`Q
`>
`
`D
`5
`
`°°
`
`3
`
`DJ
`U
`
`E‘
`B
`onU]
`Q
`2
`
`E
`
`5%
`3
`O
`2
`
`CD
`H1
`1.—1
`
`2
`8
`>4
`LT-1
`M
`
`\—4
`2
`:
`50
`--4
`“'4
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 4 of 52 Page ID #:140
`Case 2:11-cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 4 of 52 Page ID #:140
`
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 2 of 34
`
`5,832,495
`
`mum
`
`«mm
`
`EN
`
`omm
`
`wfim
`
`aomumm
`
`_.HOU..mHG.HOm§H
`
`vmmomoam
`
`comhmm
`
`Hmusmmmafiw
`
`momumm
`
`xmwmfim
`
`omE>
`
`zomnmm
`
`SN
`
`EN
`
`Sm
`
`Sm
`
`25
`
`Ummomoum
`
`Eofixwvm
`
`Emsmmméw
`
`Eozcnovfl
`
`c.Ho>£movH
`
`<mmuswfi
`
`
`
`wow
`
`Sm
`
`mmfinm
`
`SN
`
`Ewfiwwm
`
`
`
`
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 5 of 52 Page ID #:141
`Case 2:11-cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 5 of 52 Page ID #:141
`
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 3 of 34
`
`5,832,495
`
`204
`
`204
`
`Segment
`
`Segment
`
`250
`
`228
`
`
`
`Keyword
`
`Proposed
`Person
`
`
`
`Proposed
`
`
`
`226
`
`Person
`Thesaural
`Thesau‘-'31
`
`Information
`Keyword
`Person
`
`
`
`
`
`
`Figure 2B
`
`
`
`mtHmm%a0P
`
`wwwmmaan
`
`14H3£1E02M1mE++E+3W%mm+«EIEwfiwm.8mm.HIm#64E+E+Hm
`
`
`
`mm+mm+HmHMEmfimwm%£O~HHEmw.H.
`
`5,332,495
`
`Ummaswfl
`
`
`
`Gm+mm+mm+wm+EnEmfimwmEumcmw
`
`29S8C
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 6 of 52 Page ID #:142
`R
`Page 6 of 52 Page ID #2142
`
`._u8mwe1m3.,U.CVO0
`
`DN«RNRENmomSN$.n.SNQ8
`
`Wwmm
`
`
`
`29SaC
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 7 of 52 Page ID #:143
`4
`Du
`Page 7 of 52 Page ID #2143
`
`/:1mg:EtmxfimW0uu.E:U%a
`
`
`uwemmnsZ5Q~u.uww~~»-%~_.muiN§.Eu..®.~n«
`
`
`
`
`
`
`1t.u:EZedMEEW.S=o9§n~uumo95FEBmv~EmaEmN383mvmmuch:e@$...~~u.§:mm§HFENENENNam
`
`,.u.
`
`D:.
`
`
`
`
`t§:E8nmmaneixummt....E§E¢EDn€me.$:_.§§C\E«mmMeE.Emm
`uumaaoitumJ.3»8$§«
`§.§.E§Qam.ma92%3%EN___1__mmWSSNI|mm§:E.
`
`
`
`umuénma.:m._.S8~.%mmmméu_e3:oa~>.m$.mu.ammmuémysm2tm£%8E§E0}:
`
`«m:.um.Sa.
`
`
`183..33m§§§§§W.WEnumxaaE,§:_§%«mm._oa§8_
`
`
`
`
`
`Efiesmux3.333%G1StmKcEufl?.~2oS>.m«Nzméaimmm3::o.Ei:8O
`
`
`~E=u§m:mmWV.uEuZfustmN35§&€§.OMQ~M:D.1Sm.$a~SN~§m.WM
`
`ENEN
`
`13
`
`14u.:m.:Eu§§U
`
`5,832,495
`
`Ommadman
`
`._EE3
`
`
`
`wag.a~=mm.Sn~o3QEN.can
`
`
`
`
`
`3§.:t<Exammmueumfii.§O\£Q:o£mn~Q~
`
`
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 8 of 52 Page ID #:144
`Case 2:11-cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 8 of 52 Page ID #2144
`
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 6 of 34
`
`5,832,495
`
`
`
`dmudm.mmrfl.
`
`
`
`anonUaozrmmvw
`
`Eusmmmah
`
`mm.:.ELEoifi
`
`Ehdmmmah
`
`03H3035M
`
`Hmudwmmfih
`
`mEOUuozramvm
`
`/mam
`
`mmmm
`
`/«mam
`
`mama
`
`<3“.
`
`Emm
`
`9%
`
`uam
`
`mam
`
`<flmN
`
`momm
`
`
`
`8%/commwwm
`
`
`
`«souEo>>%mvH
`
`mufifimfi
`
`m:O
`
`mmmuswfi
`
`mama
`
`flaw
`
`8%
`
`mmmm
`
`<03
`
`mmmm
`
`<mmN
`
`mama
`
`
`
`fimmmUHo>EmmvH
`
`muzfimfi
`
`025..
`
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 9 of 52 Page ID #:145
`Case 2:11—cv—10692-DOC-JPR Document 1-4
`Filed 12/27/11 Page 9 of 52 Page ID #2145
`
`U.S. Patent
`
`Nov. 3, 1998
`
`‘Sheet 7 of 34
`
`5,832,495
`
`302
`
`301
`
`303
`
`54
`E
`J3
`“*
`(U
`
`5,
`(I)
`
`§
`q)
`:-4
`D‘
`on
`- 1-!
`
`E:
`
`314
`
`305
`
`‘S5CO
`
`§
`
`© 8
`
`310
`
`318
`
`O< |
`
`.
`
`U)
`
`co
`
`‘I3U)
`G)
`:3
`<t+O‘
`C
`
`
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 10 of 52 Page ID
` #:146
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 11 of 52 Page ID
` #:147
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 12 of 52 Page ID
` #:148
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 13 of 52 Page ID
` #:149
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 14 of 52 Page ID
` #:150
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 15 of 52 Page ID
` #:151
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 16 of 52 Page ID
` #:152
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 17 of 52 Page ID
` #:153
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 18 of 52 Page ID
` #:154
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 19 of 52 Page ID
` #:155
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 20 of 52 Page ID
` #:156
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 21 of 52 Page ID
` #:157
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 22 of 52 Page ID
` #:158
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 23 of 52 Page ID
` #:159
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 24 of 52 Page ID
` #:160
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 25 of 52 Page ID
` #:161
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 26 of 52 Page ID
` #:162
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 27 of 52 Page ID
` #:163
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 28 of 52 Page ID
` #:164
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 29 of 52 Page ID
` #:165
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 30 of 52 Page ID
` #:166
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 31 of 52 Page ID
` #:167
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 32 of 52 Page ID
` #:168
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 33 of 52 Page ID
` #:169
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 34 of 52 Page ID
` #:170
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 35 of 52 Page ID
` #:171
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 36 of 52 Page ID
` #:172
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 37 of 52 Page ID
` #:173
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 38 of 52 Page ID
` #:174
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 39 of 52 Page ID
` #:175
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 40 of 52 Page ID
` #:176
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 41 of 52 Page ID
` #:177
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 42 of 52 Page ID
` #:178
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 43 of 52 Page ID
` #:179
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 44 of 52 Page ID
` #:180
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 45 of 52 Page ID
` #:181
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 46 of 52 Page ID
` #:182
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 47 of 52 Page ID
` #:183
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 48 of 52 Page ID
` #:184
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 49 of 52 Page ID
` #:185
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 50 of 52 Page ID
` #:186
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 51 of 52 Page ID
` #:187
`
`
`
`Case 2:11-cv-10692-DOC-JPR Document 1-4 Filed 12/27/11 Page 52 of 52 Page ID
` #:188