United States Patent [19J
`Ludwig et al.
`
`I lllll 1111111111111111 111111111111111 1111111111 lllll lllll 111111111111111111
`US005689641A
`[111 Patent Number:
`[45] Date of Patent:
`
`5,689,641
`Nov. 18, 1997
`
`[54] MULTIMEDIA COLLABORATION SYSTEM
`ARRANGEMENT FOR ROUTING
`COMPRESSED AV SIGNAL THROUGH A
`PARTICIPANT SITE WITHOUT
`DECOMPRESSING THE AV SIGNAL
`
`[75]
`
`Inventors: Lester F. Ludwig, Foster City; J. Chris
`Lauwers, Menlo Park; Keith A. Lantz,
`Los Altos; Gerald J. Burnett, Atherton,
`all of Calif.; Emmett R. Bums, Incline
`Village, Nev.
`
`OTHER PUBLICATIONS
`
`Crawford et al. "Videomatic Switching; Systems and Ser(cid:173)
`vices" Digital Communications, 1988 Int. Zurich Seminar,
`1988.
`
`(List continued on next page.)
`
`Primary Examiner-Dinh C. Dung
`Attorney, Agent, or Finn-Cooley Godward, LLP; Craig P.
`Opperman
`
`[73] Assignee: Vicor, luc., Palo Alto, Calif.
`
`[57]
`
`ABSTRACT
`
`[21] Appl. No.: 131,523
`
`Oct. 1, 1993
`
`[22] Filed:
`lut. Cl.6
`.............................. H04N 7/15; H04L 12/00
`[51]
`[52] U.S. Cl . ................................ 395/200.02; 395/200.04;
`395/200.15; 395/200.2; 370/260; 370/270;
`348/15; 348/16
`[58] Field of Search ......................... 395/200.04, 200.15;
`370/62, 260, 261, 265, 270; 348/12, 16,
`15
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`3,723,653
`3,873,771
`3,974,337
`4,005,265
`4,210,927
`
`3/1973 Tatsuzawa ................................. 348/17
`3/1975 Kleinerman et al .................... 370/204
`8/1976 Tatsuzawa ............................... 370/483
`1/1977 Verhoeckx et al ................•....• 348/482
`7/1980 YIIIllde et al ............................. 348/23
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`0 190 0(,()
`0 354 370
`0414222
`0 497 022
`0516371
`0 523 626
`0523618
`0 561 381
`35 07 152
`
`8/1986
`12/1989
`8/1990
`1/1991
`5/1992
`7/1992
`7/1992
`3/1993
`8/1985
`
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`European Pat. Off ..
`Germany.
`
`A multimedia collaboration system that integrates separate
`real-time and asynchronous networks-the former for real(cid:173)
`time audio and video, and the latter for control signals and
`textual, graphical and other data-in a manner that is
`interoperable across different computer and network oper(cid:173)
`ating system platforms and which closely approximates the
`experience of face-to-face collaboration, while liberating the
`participants from the limitations of time and distance. These
`capabilities are achieved by exploiting a variety of hardware,
`software and networking technologies in a manner that
`preserves the quality and integrity of audio/video/data and
`other multimedia information, even after wide area
`transmission, and at a significantly reduced networking cost
`as compared to what would be required by presently known
`approaches. The system architecture is readily scalable to
`the largest enterprise network environments. It accommo(cid:173)
`dates differing levels of collaborative capabilities available
`to individual users and permits high-quality audio and video
`capabilities to be readily superimposed onto existing per(cid:173)
`sonal computers and workstations and their interconnecting
`LANs and WANs. In a particular preferred embodiment, a
`plurality of geographically dispersed multimedia LAN s are
`interconnected by a WAN. The demands made on the WAN
`are significantly reduced by employing multi-hopping
`techniques, including dynamically avoiding the unnecessary
`decompression of data at intermediate hops, and exploiting
`video mosaicing, cut-and-paste and audio mixing technolo(cid:173)
`gies so that significantly fewer wide area transmission paths
`are required while maintaining the high quality of the
`transmitted audio/video.
`
`43 Claims, 34 Drawing Sheets
`
`LOCATIONB
`
`LOCATION C
`
`CISCO EXHIBIT 1006
`Page 1 of 59
`
`

`

`5,689,641
`Page2
`
`U.S. PATENf DOCUMENTS
`
`4,441,180
`4,516,156
`4,529,839
`4,529,840
`4,531,024
`4,574,374
`4,645,872
`4,650,929
`4,710,917
`4,837,798
`4,961,211
`4,987,492
`4,995,071
`5,003,532
`5,010,399
`5,027,400
`5,042,062
`5,099,510
`5,130,793
`5,130,801
`5,170,427
`5,200,989
`5,202,957
`5,218,627
`5,283,637
`5,315,633
`5,374,952
`
`4/1984 Schussler et al. ...................... 359/123
`5/1985 Fabris et al ............................... 358/85
`7/1985 Colton et al ................................ 179/2
`7 /1985 Colton et al. ............................... 179/2
`7 /1985 Colton et al. ............................... 179/2
`3/1986 Scordo ...................................... 370/62
`2/1987 Pressman et al ......................... 379/54
`3/1987 Boerger et al. ........................... 358/86
`12/1987 Tomkins et al ........................... 370/62
`6/1989 Cohen et al .............................. 379/88
`10/1990 Tsugane et al ........................... 379/54
`1/1991 Stults et al .............................. 352/181
`2/1991 Weber et al .............................. 379/53
`3/1991 Ashida et al ............................. 370/62
`4/1991 Goodman et al ......................... 348/14
`6/1991 Baji et al .................................. 380/20
`8/1991 Lee et al ................................... 379/54
`3/1992 Blinken, Jr. et al. ................... 379/202
`7/1992 Bordry et al ............................... 348/6
`7/1992 Yamaguchi ............................... 348/15
`12/1992 Guichard et al .......................... 379/53
`4/1993 Milone ...................................... 379/53
`4/1993 Serrao ....................................... 379/53
`6/1993 Corey et al ............................... 379/53
`2/1994 Goolcharan ............................... 348/17
`5/1994 Champa .................................... 348/16
`12/1994 Flohr ......................................... 348/12
`
`OTHER PUBLICATIONS
`
`Distributed Desktop Conferencing System (Mermaid) Based
`on Group Communication Architecture, The Transactions of
`the Institute of Electronics, Information and Comm. Engi(cid:173)
`neers E74 (1991) Sep., No. 9, Tokyo, JP by Kazutoshi
`Maeno; Shiro Sakata, Toyoko Ohmori; Kazuo Watabe and
`Hideyuki Fukuoka.
`Optimal Communication Architecturs for Multimedia Con(cid:173)
`ferencing in Distributed Systems, Multimedia Laboratory
`Dept. of Computer Science and Engineering, University of
`San Diego, La Jolla, CA by Srinivas Ramanathan, P. Venkat
`Rangan, Harrick M. Vin, and Thomas Kaeppner.
`Optimmum Connection Paths for a Class of Videoconfer(cid:173)
`ences, Yiu-Wing Leung and Tak-Shing Yum, Department of
`Information Engineering, the Chinese University of Honk
`Kong, Shatin, Hong Kong.
`Desk Top Video Conferencing-An hnportant Feature of
`Future Visual Communications by Christoph Weiss,
`Siemens AG-Munich-West Germany.
`
`Hierarchical Conferencing Architectures for Inter-Group
`Multimedia Collaboration, Multimedia Laboratory Depart(cid:173)
`ment of Computer Science and Engineering University of
`California at San Diego, La Jolla, by Harrick M. Vin, P.
`Venkat Rangan and Srinivas Ramanathan.
`Telekommunikation von Angesichtzu Angesicht 2323 Tel(cid:173)
`com Report 9 (1986) Sep./Oct., No. 5, Erlangen, W.Ger(cid:173)
`many by Peter Klein.
`Systems Integration '90 by Peter A. Ng, C.V. Ramamoorthy,
`Laurence C. Seifert and Raymond T. Yeh (Apr. 23-26,
`1990).
`The American Users Forum (Niu-Forum) Aug. 6-9, 1990).
`A Network Environment for Studying Multimedia Network
`Architecture and Control (1989 Globecom, by Robert Lank,
`Laura Pate).
`Frontiers in Computer Communications Technology, Sig(cid:173)
`comm '87 Workshop (Aug. 11-13, 1987).
`Spider: An Investigation in Collaborative Technologies and
`Their Effects on Network Performance by Roderick E.
`Perkins.
`Software Architecture for Integration of Video Services in
`the Etherphone System by P. Venkat Rangan, and Daniel C.
`Swinehart (IEEE Journal on Selected Areas in Communi(cid:173)
`cations, vol. 9, No. 9 Dec. 1991).
`Multimedia Conferencing in the Etherphone Environment
`by Harrick M. Vin, Polle T. Zellweger, Daniel C. Swinehart,
`and P. Venkat Rangan (Xerox Palo Alto Research Center)
`Oct. 1991.
`An Experiment in Integrated Multimedia Conferencing by
`Keith A. Lantz, Department of Computer Science, Stanford
`University, Stanford, CA 94305, Dec. 1986.
`Collaboration Technology Research at Olivetti Research
`California by Keith A. Lantz, J. Chris Lauwers, Barry Arons,
`Carl Binding, Pehong Chen, Jim Donahue, Thomas A.
`Joseph, Richard Koo, Allyn Romanow, Chris Schmandt, and
`Wayne Yamamoto, Aug. 1989.
`Collaboration Awareness in Support of Collaboration Trans(cid:173)
`parency: Requirements for the Next Generation of Shared
`Window Systems by J. Chris Lauwers and Keith A. Lantz of
`Olivetti Research California, Version of Apr. 1989.
`Replicated Architectures for Shared Window Systems: A
`Critique by J. Chris Lauwers, Thomas A. Joseph, Keith A.
`Lantz and Allyn L. Romanow of Olivetti Research Califor(cid:173)
`nia, Version of Apr. 1990.
`
`CISCO EXHIBIT 1006
`Page 2 of 59
`
`

`

`Ol
`
`OrelElOrel
`
`~
`~
`""""
`~
`~ ('D
`
`Sheet 1 of 34
`
`"""" ~
`"""" ~
`~
`~
`
`Nov. 18, 1997
`
`--.J
`
`'"""' a
`
`~
`~
`•
`V'J
`0 •
`
`U.S. Patent
`
`CwmSn1zd.%ghan
`i\SIa
`
`16
`
`16
`
`e
`
`
`
`‘etehOlBASH)tal.aOnel
`PEL
`
`12.1
`
`‘
`
`"' "" ~
`"' "" 00
`
`~
`
`\0
`
`5,689,641
`
`16
`
`Fir.;unE I
`
`EbeelOlPela(SI)gOSEL
`
`CISCO EXHIBIT 1006
`Page 3 of 59
`
`eb91co
`91vaf2undty
`woafo
`
`CISCO EXHIBIT 1006
`Page 3 of 59
`
`

`

`~
`~
`
`--0'-..
`\0
`QC
`--0'-..
`Ul
`
`~
`s,
`N
`~
`!'I)
`
`00 =(cid:173)
`
`1--'
`~
`1--'
`~
`~
`
`~
`
`~ a
`• ;p
`c • 00
`
`D
`
`~
`!!elP I
`l@AI
`
`uca1HUAddH HMalUHSharel 'WhllbolrdllMl-.sll Telephone
`,<J
`-----~
`-----
`ili·i~
`-----
`-----
`Si it~~~
`
`VldeoPhone
`
`I .fie E,dl ~-
`EJI
`
`MonSep2614:00:321992
`f Sun maintenance
`
`Date Updated:
`Remarks:
`
`Pleasanton, CA 94588
`5627 Slonerldge Drive, Suite 310
`
`(Gruliiiiansystems S~poit Corporation (copy)
`
`---------
`I 800-876-9130
`
`Home Address:
`
`Work Address:
`Company:
`Home Phone:
`Work Phone:
`Name:
`
`I
`ltfil4
`
`.--.
`
`Detal-Gnmman Syslems SlfPOII C«poration (copy)
`
`II
`
`I
`
`Fic;uaE 2A
`
`siw. 11 Whllbolnlt I Details I
`~· Add I~
`
`EilElJO'-'rtelHL-WOftjHUShnHH~rdHUM;unU
`
`Calls on Hold:
`
`Gil
`
`~• le, Nuiit anc1 eampary cl
`I 1
`I I £le fdll ftrtnlssloo
`1:fil~
`tom Gijw
`1::1
`
`I
`
`I.Edit
`
`CISCO EXHIBIT 1006
`Page 4 of 59
`
`

`

`~
`.&;.
`'"' 0-..
`\0
`010
`'"' 0-..
`Ol
`
`~
`~
`0
`w
`~ ....
`00. =-~
`
`-....1
`~
`1--'
`$'J
`1--'
`~
`
`z 0
`
`~ = ("'11,-a
`
`~ • 00
`
`•
`
`.!:felp I
`~~,
`
`I
`I
`ll!:!IIA
`
`ijiiona
`
`Boblak• 1 fie £.di
`
`11-11
`
`IQl!g) II \ ·~ ~~~::_,r-,-J
`rcJlgJ µ
`BS a O e·· LOOKATTHli.SDATA!
`~ 1"" 11 ""' Ii "" u :l!!: n "'" 11 ... , 11,.,.iJ, @ , .. _
`
`i CallHU3i lt.1alUIS11w1IIWhlebo1rdllMNsagesH Telephone
`F.i -=-=------==-= -===~---==::;;:
`
`------
`
`~Ji.ii--
`
`I
`
`• YES! I SEE THE PROBLEM.
`
`..........
`
`\~~~
`
`lg)
`1!=1
`A
`
`Fi<;llRE 20
`
`__
`~ [!I [ID [g] lfil (!] {ii
`
`P11111
`
`~ Size: 0:54 min.
`
`Poste-Browser demo-meister-/ln Box
`
`IE)
`
`(Press Righi Mouse Button lor Options
`
`Vlcor Video Enclosure
`
`To: I lauwers
`Dale: lue May 1918:41:361992
`From: I ~Sier Ludwig (1111
`Subject: I meteor meas\Qmenf Joo!
`
`AC~ and Paine-Webber
`World Income
`:eport
`
`.f.dl
`Video File System: Alsr/spoolfalfalfa/jn~.1249.7
`
`...-=---... r I
`
`I
`
`Help H I £Me
`'=:II
`1@1[41
`
`•~------'.6.' I
`
`<A ______ n .. ___ ..
`,S:cll)IS
`
`I
`
`• ~ .
`
`I
`
`--..
`
`Poste-Browser (demo-meister -/In Box)
`
`I
`II fdk ~_iew .Qplions .folders ,Messages
`-JI
`
`IE
`
`CISCO EXHIBIT 1006
`Page 5 of 59
`
`

`

`i-,...
`,l:;:i.
`--0°"I
`\0
`QC
`'61 0°"I
`Ol
`
`('I) ....
`00 er
`
`('I)
`
`.,:..
`"""'
`(.w
`0
`.,:..
`
`1,0
`~
`"'
`00
`~
`~
`z
`
`1,0 "'
`
`""""" a
`~ =
`00 •
`~ •
`
`Fi<;URE 7
`
`35
`
`60
`
`60b
`l
`
`'--"'~
`
`I
`
`60a~1
`
`I
`
`I
`
`l
`
`I
`
`I
`
`35b
`
`60e
`
`SERVER
`MLAN
`
`RESOURCES (16)
`TOMM
`
`---i i t
`
`/
`
`-
`
`12:10
`
`WAN Lro
`
`WAN
`
`GATEWAY
`
`I
`
`HARDWARE
`MLAN
`TO CORRESPONDING
`
`.
`
`h RESOURCES (16)
`
`___, _ _._ _________ TOMM
`
`25b
`
`l I
`I I t
`
`25a
`
`I 3~a l
`1
`30c I
`
`SWITCH
`
`f,JV
`
`HUB
`LAN
`DATA
`
`fH
`
`CISCO EXHIBIT 1006
`Page 6 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 5 of 34
`
`5,689,641
`
`LOCATION B
`
`ws
`
`ws
`
`WAN
`GATEWAY
`40
`
`WS 12-B
`·
`wiN
`AV SW GATEWAY
`30
`40
`LOCATION A
`
`WAN
`GATEWAY
`40
`
`)
`WAN
`GATEWAY
`40
`LOCATION D
`
`WS
`
`WS
`
`12-8
`
`LOCATION C
`
`Fic;un£4
`
`CISCO EXHIBIT 1006
`Page 7 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 6 of 34
`
`5,689,641
`
`L1
`
`L1
`
`L7
`
`L3
`
`L5
`Fit:;lJRE6
`
`-
`-
`-
`
`36a
`36b-1
`36b-2
`
`-
`-
`.
`.
`
`39a
`39b-1
`39b-2
`
`•
`• •
`
`• • •
`
`•
`• •
`
`L5
`Fit:;lJRE ~
`
`- .
`
`
`
`• • •
`
`112-1
`
`122-n
`
`114-1
`
`114-n
`
`•
`• •
`
`116-1
`
`116-n
`
`--
`
`• • •
`
`( 36
`VIDEO
`MOSAIC ING
`CIRCUITRY
`Fi<;llRE 7
`38
`
`AUDIO
`MIXING
`CIRCUITRY
`
`Fi<;URE9
`( 39
`
`VIDEO
`CUT-AND-PASTE
`CIRCUITRY
`
`Fit:;URE 10
`
`DIGITAL FRAME
`BUFFER
`17
`
`116a .........._~~
`
`116b '-'--'-..i...L...I........,_,.....,
`
`116c D.I."D.r:r:.."L."J-
`116d (cid:143)
`
`::::I:O:::C:0,--
`
`1111111
`
`1111111 -
`•
`
`Fit:;lJRE 11
`
`CISCO EXHIBIT 1006
`Page 8 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 7 of 34
`
`5,689,641
`
`EJ
`
`0HangupjinHoldn nMuteU ULeave WordOUsh~reHUWhiteboardU u Adjourn u u Record u
`Calls on Hold:
`m Resume m I Lester Ludwig, Keith Lantz
`UResume n ::=:====================~
`
`~Resume~
`
`Fi<;URE8A
`
`CISCO EXHIBIT 1006
`Page 9 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 8 of 34
`
`5,689,641
`
`El
`
`n Hangup n n Hold n UMuteU ULeave Wordij u ShareU u Whiteboard 1111 Adjourn u u Record n
`Calls on Hold:
`Iii Resume m I Lester Ludwig, Keith Lanti
`~Resume fl ~====================!
`~Resume II
`
`Fi<;UREBB
`
`CISCO EXHIBIT 1006
`Page 10 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 9 of 34
`
`5,689,641
`
`l>I
`
`I ..
`
`CISCO EXHIBIT 1006
`Page 11 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 10 of 34
`
`5,689,641
`
`SITE NO. 1
`PARTICIPANT A
`PARTICIPANT B
`
`--
`
`A,B = 0 UNIT DELAY ~
`C,D= 1 UNIT DELAY D
`
`SITE NO. 2
`PARTICIPANT A
`PARTICIPANT B
`
`D
`
`C,D=0UNITDELAY
`~ A,B = 1 UNIT DELAY
`
`Fit;tJRE 12A
`C+D
`--
`
`A+B
`
`.
`
`SITE NO.1
`PARTICIPANT A
`PARTICIPANT B
`
`SITE NO. 2
`PARTICIPANT A
`PARTICIPANT B
`
`A HEARS B + C + D
`B HEARS A+ C + D
`A,B = 0 UNIT DELAY
`C,D = 1 UNIT DELAY
`Fi<:;URE 12B
`
`C HEARS A+ B + D
`D HEARS A + 8 + C
`C,D = 0 UNIT DELAY
`A,B = 1 UNIT DELAY
`
`-
`
`SITE NO.1
`PARTICIPANT A
`PARTICIPANT B
`PARTICIPANT C
`
`SITE NO. 2
`PARTICIPANT D
`
`-~
`
`A,B,C = 0 UNIT DELAY~
`D= 1 UNIT DELAY ~
`
`~ D = 0 UNIT DELAY
`~ A,B,C = 1 UNIT DELAY
`
`Fi<:;llRE I J A
`
`SITE NO.1
`PARTICIPANT A
`PARTICIPANT B
`PARTICIPANT C
`
`D
`
`A+B+C
`
`-.
`
`SITE NO. 2
`PARTICIPANT D
`
`A HEARS B + C + D
`B HEARS A + C + D
`C HEARS A+ B + D
`A,B = 0 UNIT DELAY
`D = 1 UNIT DELAY
`
`D HEARS A+ B + C
`D = 0 UNIT DELAY
`A,B,C = 1 UNIT DELAY
`
`Fi<:;llRE I JB
`
`CISCO EXHIBIT 1006
`Page 12 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 11 of 34
`
`5,689,641
`
`SITENO.2
`PARTICIPANT C
`
`~
`
`[iliJ
`[£@]
`C = 0 UNIT DELAY
`A,B = 1 UNIT DELAY
`D = 2 UNITS DELAY
`
`D
`
`SITE NO.1
`PARTICIPANT A &
`PARTICIPANT B
`[iliJ
`[£@]
`A,B = 0 UNIT DELAY
`C,D = 1 UNIT DELAY
`Fit:;IIRE 14A
`
`SITE NO. 3
`PARTICIPANT D
`
`~
`
`A B
`
`[iliJ
`[£@]
`0=0 UNIT DELAY
`A,B = 1 UNIT DELAY
`C = 2 UNITS DELAY
`
`SITE NO. 2
`PARTICIPANT C
`
`C
`
`C HEARS A + B + C
`
`G = 0 UNIT DELAY
`A,B = 1 UNIT DELAY
`D = 2 UNITS DELAY
`
`A+B+C
`SITE NO. 1
`SITE NO. 3
`- PARTICIPANT A &
`-.
`. PARTICIPANT D
`PARTICIPANT B A+B+C
`A HEARS B + C + D
`D HEARS A + B + C
`B HEARS A+ C + D
`A,B = 0 UNIT DELAY
`C,D = 1 UNIT DELAY
`Fi<;llRE 14B
`
`D
`
`D = 0 UNIT DELAY
`A,B = 1 UNIT DELAY
`C = 2 UNITS DELAY
`
`SITE NO. 1
`PARTICIPANT A
`
`- C
`
`D
`
`SITE NO. 2
`PARTICIPANT B
`
`-.
`
`-
`
`[iliJ
`[£@]
`A= 0 UNIT DELAY
`B = 1 UNIT DELAY
`C,D = 2 UNITS DELAY
`
`[iliJ
`[£@]
`B = 0 UNIT DELAY
`A,C,D = 1 UNIT DELAY
`Fi<;IIRE 17A
`
`C
`
`A
`
`D
`
`B
`
`SITE NO. 3
`PARTICIPANT C &
`PARTICIPANT D
`[iliJ
`[£@]
`C,D = 0 UNIT DELAY
`B = 1 UNIT DELAY
`A = 2 UNITS DELAY
`
`SITE NO. 1
`PARTICIPANT A
`
`B+C+D
`.
`
`A
`
`SITENO.2
`PARTICIPANT B
`
`C+D
`
`A+B
`
`SITE NO. 3
`PARTICIPANT C &
`PARTICIPANT D
`
`A HEARS B + C + D
`
`B HEARS A+ C + D
`
`B = 1 UNIT DELAY
`C,D = 2 UNITS DELAY
`
`A,C,D = 1 UNIT DELAY
`
`Fit:;IIRE 17B
`
`C HEARS A + B + D
`D HEARS A+ B + C
`C,D = 0 UNIT DELAY
`B = 1 UNIT DELAY
`A= 2 UNITS DELAY
`
`CISCO EXHIBIT 1006
`Page 13 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 12 of 34
`
`5,689,641
`
`A= 0 UNIT DELAY
`B,C,D = 1 UNIT DELAY
`
`SITE NO. 1
`....,_ __ ---4 SITE NO. 4
`- PARTICIPANT A ~ - - . i PARTICIPANT D
`
`SITE NO. 2
`PARTICIPANT B
`
`-
`
`-~ -~ -D G
`~ ..
`I~~ [ili]
`[ili] r:7 ~
`B=0UNITDELAY ~ L..::_j
`A= 1 UNIT DELAY
`'
`C,D = 2 UNITS DELAY
`SITE NO. 3
`PARTICIPANT C
`
`D=0UNITDELAY
`A= 1 UNIT DELAY
`B,C = 2 UNITS DELAY
`
`C = 0 UNIT DELAY
`A= 1 UNIT DELAY
`B,D = 2 UNITS DELAY
`
`Fi<;URE 16
`
`CISCO EXHIBIT 1006
`Page 14 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 13 of 34
`
`5,689,641
`
`A= 0 UNIT DELAY
`B = 1 UNIT DELAY
`C = 2 UNITS DELAY
`D = 3 UNITS DELAY
`
`SITE N0.1
`PARTICIPANT A
`
`-
`
`-
`
`B = 0 UNIT DELAY
`A,C = 1 UNIT DELAY
`D = 2 UNIT DELAY
`~
`[ill]
`SITEN0.2
`PARTICIPANT B
`
`-
`
`C = 0 UNIT DELAY
`B,D = 1 UNIT DELAY
`A = 2 UNITS DELAY
`[ili]
`~
`SITE NO. 3
`r4-
`PARTICIPANT C ""
`
`. tili1 ~
`GJ
`~ I!
`~ SITE NO. 4
`
`D = 0 UNIT DELAY
`C = 1 UNIT DELAY
`B = 2 UNITS DELAY
`A = 3 UNITS DELAY
`
`D
`
`I
`
`PARTICIPANT D
`
`~
`G
`
`Fi(jURE 17A
`
`A= 0 UNIT DELAY
`B = 1 UNIT DELAY
`C = 2 UNITS DELAY
`D = 3 UNITS DELAY
`
`B = 0 UNIT DELAY
`A,C = 1 UNIT DELAY
`D = 2 UNIT DELAY
`
`C = 0 UNIT DELAY
`B,D = 1 UNIT DELAY
`A= 2 UNITS DELAY
`
`SITE NO. 1
`PARTICIPANT A
`
`B+C+D
`-
`A -
`
`SITE NO. 2
`PARTICIPANT B
`
`C+D
`
`-
`A+ B -
`
`SITE NO. 3
`+
`PARTICIPANT C ...
`
`!
`
`I
`
`D = 0 UNIT DELAY
`C = 1 UNIT DELAY
`SITE NO. 4
`B = 2 UNITS DELAY PARTICIPANT D
`A= 3 UNITS DELAY
`
`A+B+C
`
`D
`
`Fit;URE 17B
`
`CISCO EXHIBIT 1006
`Page 15 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 14 of 34
`
`5,689,641
`
`MICROPHONE
`600
`
`CPU
`
`100
`
`KEYBOARD 300
`
`iiiiiiiiiiiiiiii
`
`MOUSE
`400
`
`..___---1 V-OUT 803
`
`1....---..i V-IN 801
`
`ADD-ON BOX 800
`CONTROL
`806
`A-OUTi------.....1
`804
`A-IN 14 ' - - - - - - - '
`802
`
`AV NETWORK (UTP) 901
`
`DATA NETWORK (UTP) 902
`
`Fit:;llRE I BA
`
`CISCO EXHIBIT 1006
`Page 16 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 15 of 34
`
`5,689,641
`
`MONITOR
`
`200
`
`-------
`
`0000
`
`CPU
`
`100
`
`101
`
`150 ___ ___,
`103
`102
`
`KEYBOARD
`
`300
`
`iilliiililililil
`
`MOUSE
`400
`
`AV NETWORK
`UTP)
`901
`
`DATA NETWORK (UTP)
`
`902
`
`Fit:;lJRE I BB
`
`CISCO EXHIBIT 1006
`Page 17 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 16 of 34
`
`5,689,641
`
`ADD-ON BOX
`
`800
`
`811
`
`PREAMP
`
`813 "---
`
`HANDSET VO
`POWER AMP
`PREAMP
`HEADSETl/O
`POWER AMP
`------+--- POWERAMP
`812
`A-OUT
`
`807
`
`804
`
`ECHO
`CANCELER
`
`815
`
`803
`
`814
`
`815
`LOOPBACK/AV MUTE 830
`
`816
`
`A
`837
`A838
`
`806
`
`CONTROL.,._...,
`
`840
`
`AUDIO OUT AUDIO IN
`
`842
`
`841
`
`AN TRANSCEIVERS
`VIDEO OUT VIDEO IN
`
`845
`
`AUDIONIDEO
`1/0
`805
`
`AV NETWORK (lffP)
`
`901
`
`Fit:;URE 19
`
`CISCO EXHIBIT 1006
`Page 18 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 17 of 34
`
`5,689,641
`
`WORKSTATION SOFTWARE
`
`160
`
`163
`
`ROLODEX
`
`162
`
`QUICKDIAL
`
`169
`
`VIDEOPHONE
`
`COLLABORATION
`INITIATOR
`
`161
`
`SNAPSHOT
`SHARING
`
`166
`
`APPLICATION
`SHARING
`
`COMPUTER(cid:173)
`INTEGRATED
`TELEPHONY
`
`COMPUTER·
`INTEGRATED
`FAX
`
`Fi<;llRE 20
`
`CISCO EXHIBIT 1006
`Page 19 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 18 of 34
`
`5,689,641
`
`MLANSERVEA
`SOFTWARE MODULES
`
`62
`
`(SERVICE SERVER)
`7
`AVNM
`69
`
`( WNM
`
`63 [
`JE
`
`r
`
`REAL-TIME
`AUDIO VISUAL
`STORAGE SERVER
`
`67
`~
`
`,-
`
`_}'
`
`CBM
`
`DIRECTORY
`SERVICE
`
`OTHER
`MULTIMEDIA
`SERVICES
`
`Fi<;VRE21
`
`(2) REQUEST CALLEE'S
`ADDRESS
`
`66
`
`CALLER
`
`COLLABORATION
`INITIATOR
`
`DIRECTORY
`SERVICE
`
`(3)
`
`(4) RETURN CALLEE'S
`ADDRESS
`
`(8)
`(5)
`ACCEPT REQUEST CONNECTION
`EVENT
`TO CALLEE'S ADDRESS
`
`(1)
`LOGIN
`
`AVNM
`
`63
`
`(6) CALL EVENT
`
`(7) ACCEPT CALL
`
`(1) LOGIN
`
`Fi<;VRE2J
`
`COLLABORATION
`INITIATOR
`
`CALLEE
`
`AN SWITCHING
`CIRCUITRY 30
`
`81
`WS-1 1---..0-- ..
`'
`\83
`V
`
`I
`I
`I
`
`,
`WS-2 t---...a--'
`82
`Fi<;URE24
`
`CISCO EXHIBIT 1006
`Page 20 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 19 of 34
`
`5,689,641
`
`Ell
`I £.ile Edit .Qptions
`
`Collaboration Initiator
`
`Griner
`
`Lauwers
`
`Lantz
`
`Ludwig
`
`Lake
`
`Van Note
`
`Steel
`
`Kindon
`
`Venner
`
`Kennedy
`
`guest1
`
`guest2
`
`guest3
`
`guest4.
`
`guests
`
`E3[2J8[3~ Whiteboard~~ Messages[! [38
`
`Fit:;URE22
`
`CISCO EXHIBIT 1006
`Page 21 of 59
`
`

`

`Ii-
`.a;.i..
`"' ~
`\0
`QC
`"' ~
`01
`
`~ :e
`
`~
`~
`
`r:.n g-
`
`Fi<;VRE27
`
`36
`
`I CONFERENCE
`
`BRIDGE
`
`I
`
`:: -
`
`.... \0
`f ....
`
`....:J
`\0
`
`~00
`
`136-4
`136-3
`-_ ~~ 1 ____ !3_6:2_
`--------
`--_ .. l
`136-1
`86
`
`30a
`
`CIRCUITRY
`SWITCHING
`AUDIONIDEO
`
`Fi<;llRE 26
`
`63
`
`AVNM
`
`36
`
`WS-2
`
`WS-1
`
`1 CONFERENCE
`
`BRIDGE
`
`---
`
`CBM
`
`64
`
`Fi<;llRE 2~
`
`.. --
`140"\, .. -------
`___ .:1---136-4
`-139
`~-~ -
`1381 ____ 13~·.? _
`-----·--
`.. !~7.l -
`136-1
`30a
`
`_1~
`
`CIRCUITRY
`SWITCHING
`AUDIONIDEO
`
`tJ
`
`AVNM
`
`i ~
`
`....,
`
`....
`,
`
`WS-1
`
`~ = I
`
`00 •
`~ •
`
`\_91b
`
`WS-2
`
`93b
`
`92b
`
`---7--
`CIRCUITRY
`SWITCHING
`
`30b
`
`AN
`
`l94b
`
`GATEWAY
`
`WAN
`
`40b
`
`WAN
`
`(15
`
`l94a
`
`~92a
`
`91a J --c----
`
`93a
`
`WS-1
`
`GATEWAY
`
`WAN
`
`40a
`
`CIRCUITRY
`SWITCHING
`
`30a
`
`NV
`
`CISCO EXHIBIT 1006
`Page 22 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 21 of 34
`
`5,689,641
`
`Fi<;tJRE 28
`
`WORKSTATION w12
`
`•
`•
`•
`
`WORKSTATION
`
`12~
`
`•
`•
`•
`
`MMCR
`
`MULTIMEDIA DOCUMENT
`AUTHORING
`
`MULTIMEDIA CALUCONF.
`RECORDING
`
`Fi<;llRE 29
`
`CISCO EXHIBIT 1006
`Page 23 of 59
`
`

`

`~
`~
`0\.
`-..
`\0
`QC
`0\.
`-..
`tit
`
`~
`~
`N
`N
`~ ......
`~
`
`~
`~ .... \0
`f ....
`
`~
`~
`00 •
`~ •
`
`""""' ~ a
`
`SEGMENTS
`
`VIDEO
`AUDIO/
`
`..
`
`'
`
`EDITOR
`VIDEO
`AUDIO/
`
`...
`.... ,,
`
`--
`
`--------
`
`____ _.. __ _
`
`I i
`
`512
`~ \
`PLAYBACK
`RECORDER'
`
`EVENT
`
`,---J __ _.._ .. _-tl ............. :,', l ,,,-------... ""'
`
`.... ,,,, ,;
`'
`----.. ,:-i....
`
`;
`
`,
`
`-~~
`
`-___ N______
`'
`
`j
`
`------.....
`------~--- -------------
`
`'!II.
`; ........ ----..
`-----
`
`, -.. ---,._. ... ': ,''
`-----1 .... ,::,
`
`I
`
`,,.
`
`l,L
`
`~
`,,--
`
`.,
`
`,,,.
`
`---------......
`'
`-.. -.... -.............. L
`I
`I
`
`------------.. -............ _
`
`--------------------.
`
`-
`
`..
`
`.,
`
`., , ,
`
`-
`
`..
`
`, ,
`, , ,
`
`I,
`
`,.,
`
`,,,,,,,
`
`i
`
`........
`
`STRUCTURE
`
`EDITOR
`
`FACILITIES
`LINKING
`HYPER·
`
`EDITOR
`GRAPHICS
`
`PROGRAM
`
`IMAGING/
`
`PAINT
`
`EDITOR
`TEXT
`
`I
`
`EDITORS
`
`502
`
`TIME-DEPENDENT
`
`MEDIA
`
`(504
`
`I
`
`TIME-INSENSITIVE
`
`MEDIA
`
`Fic;un£ JO
`
`STORAGE SERVER
`
`AUDIONIDEO
`REAL-TIME
`
`FILE SYSTEM
`CONVENTIONAL
`•
`
`•
`
`..
`
`j
`
`•
`
`"'
`
`TIMING
`AND
`
`aH~ ••
`
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`"'
`I
`
`REFERENCE
`
`AND
`LINKS
`
`GRAPHICS I I
`
`IMAGES
`
`----
`
`,,
`
`•
`
`~"
`
`,
`
`,"'
`
`TEXT
`I ti
`,
`,
`,,
`....
`.. --
`
`FACILITIES
`STORAGE
`
`COMPONENTS
`DOCUMENT
`MULTIMEDIA
`
`f J1e
`SNAPSHOTS
`STRUCTURE 11 RECORDED
`.
`---1------......
`
`CISCO EXHIBIT 1006
`Page 24 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 23 of 34
`
`5,689,641
`
`- ~LA_!J .£ ~0-1
`I
`DATALAN w.....---1--~
`HUB
`
`r- -
`I
`I
`I
`
`CONTROL
`
`25
`
`NV
`SWJTa-tlNG
`CIRCUITRY
`
`: _____ ,
`
`I
`..., _______ J
`I
`30
`
`1/0
`
`1/0
`
`502
`
`64
`
`DISK
`
`DISK
`
`62
`
`60e
`
`Fi(jUR£7lA
`
`502
`
`REAL· TIME AUDIONIDEO
`STORAGE SERVER
`
`COMPRESS/
`DECOMPRESS
`
`13b
`
`13a
`
`STORAGE
`MEDIUM
`
`30
`
`AN
`SWITCHING
`CIRCUITRY
`
`DATA LAN
`HUB
`
`I - - - - - - - - - - ,
`13a
`OTHER
`'
`I
`. .__ i~ • STORAGE
`:
`: SERVERS
`:
`
`, ___________ .
`
`I CAMERA 11 DISPLA y I
`
`I CAMERA 11 DISPLA y I
`
`I CAMERA 11 DISPLA y I
`
`CLIENT
`WORKSTATION
`
`CLIENT
`WORKSTATION
`
`CLIENT
`WORKSTATION
`
`12-1
`
`12-2
`Fi<;URE 7 I B
`
`12-3
`
`CISCO EXHIBIT 1006
`Page 25 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 24 of 34
`
`5,689,641
`
`502
`
`REAL-TIME AUDIONIDEO
`STORAGE SERVER
`
`STORAGE
`__,.-t MEDIUM
`
`,....... _
`
`COMPRESS
`MODULES
`
`13b
`
`13a
`
`25
`
`DATA LAN
`HUB
`
`I - - - - - - - - - - ,
`13a
`• OTHER
`1
`1 STORAGE
`:
`....... --..i
`: SERVERS
`:
`1 __________ I
`
`CLIENT
`WORKSTATION
`
`CLIENT
`WORKSTATION
`
`12-1
`
`12-2
`
`Fi<;URE JIC
`
`524
`
`526
`
`12-3
`
`522
`
`MULTIMEDIA
`MAIL SYSTEM
`
`MULTIMEDIA DOCUMENT
`MANAGEMENT SYSTEM
`
`MULTIMEDIA CONFERENCE
`RECORDING SYSTEM
`
`518
`
`CONFERENCE
`INVOKER
`
`CONVENTIONAL
`E-MAIL SYSTEM
`
`506
`
`504
`
`CONVENTIONAL
`FILE SYSTEM
`
`502
`
`REAL-TIME AUDIONlDEO
`STORAGE SERVER
`
`Fi<;URE JID
`
`CISCO EXHIBIT 1006
`Page 26 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 25 of 34
`
`5,689,641
`
`Fic;unE J2
`
`SCSI CROSSBAR
`
`540
`
`Fic;unE JJ
`
`CISCO EXHIBIT 1006
`Page 27 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 26 of 34
`
`5,689,641
`
`USERS+ INFORMATION SYSTEMS:
`
`INFORMATION:
`
`•
`•
`•
`
`•
`•
`•
`
`e AUDIONIDEO OF ALL PARTIES
`e SHARED WINDOWS
`e TELEPOINTING/ANNOTATION
`
`/
`
`VENUES:
`
`SAME TIME
`SAME PLACE
`
`SAME TIME
`DIFFERENT PLACE
`
`DIFFERENT TIME
`SAME PLACE
`
`DIFFERENT TIME
`DIFFERENT PLACE
`
`USERS + INFORMATION SYSTEMS:
`
`INFORMATION:
`
`•
`•
`•
`
`•
`•
`•
`
`e AUDIONIDEO OF ALL PARTIES
`e SHARED WINDOWS
`e TELEPOINTING/ANNOTATION
`
`Fi<;tJRE 74
`
`CISCO EXHIBIT 1006
`Page 28 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 27 of 34
`
`5,689,641
`
`CISCO EXHIBIT 1006
`Page 29 of 59
`
`

`

`~
`
`"' ~ .a;.
`\0
`00
`"' ~
`O'I
`
`~
`c,:i
`N
`~
`('0
`ga
`
`w ...
`
`"
`~
`
`~
`
`~c,:i
`~
`
`f
`
`~ = ~ a
`
`•
`00
`~ •
`
`f!e1p I
`[fil~
`
`(:gklboralon lnllalDr
`
`1 £1t £.di -g,iiana
`
`204
`
`206
`
`~
`
`~
`
`Hca11U1~'iH~Ma1JS•I IWhllboaldllMa:,:sll Telephooe
`
`Kemedy
`
`V.rnr
`
`IClndan
`
`Slelll
`
`Van Nole
`
`l•ke
`
`ludllig
`
`I.IIU
`
`i.-trs
`
`Grner
`
`~ lnBox
`205 ~li~ia
`i fili~j_
`
`El
`
`210
`
`211
`
`11(cid:143)1 I
`fflFcf I PorHollo Coq,oslllon as ol &'3<W2
`~~ (fie 9>1ions Tools §l'ecialHpart1~.t1H1](!1
`[M!:H~:n::~n:~1t9!ill Grab II Aegrab I
`
`Rlduca
`
`40.2% ~
`
`Fixed Income
`
`~
`
`30.0%
`Equity
`
`Share: screen2
`
`IBI
`
`Tim Griner.
`
`202
`
`203
`
`'" r...
`
`E-JI
`
`t!iiii]llm][!!iJI leave Won! IL!l!!:UWhiiet:io.idl I~
`
`Calls on Hold:
`
`~~~!
`,> f.t' !! v2 v!:.
`O~*ll
`
`FiqVRE ;6
`
`pix
`
`Calculator
`
`Mtp
`
`rreker
`
`LS!
`
`Home
`Shell
`~ [!)
`~
`
`CISCO EXHIBIT 1006
`Page 30 of 59
`
`(cid:143)
`

`

`~
`,l;;i,,.
`~
`-..
`\0
`0tJ
`~
`-..
`Ol
`
`,&;:,..
`w
`~
`1,0
`N
`
`l:I" !!
`
`00
`
`~
`.... 1,0
`:<'1 ....
`z 0
`
`... r:l:J
`
`~ = ""'"
`~
`rJl •
`~
`
`1J
`
`-~
`
`l>I
`
`~8t.g1e
`'-'i'eql
`
`.,,
`-.
`•~
`
`PRIORITY
`Ni,..,,._ ..
`
`Cell from Lester Ludwig
`
`~ 1&~~@!
`i iL~~j_
`'
`
`llilEHilfBIVHeboantll':'::THTelephone
`14
`
`t>I
`
`like
`
`ludlllg
`
`t.w
`
`i.-11
`
`Griler
`
`I
`
`204
`
`223
`Eill--1 Gil i
`·11
`71#'
`'8:8'
`
`221
`
`Vjm
`
`211
`
`Tim Griner
`
`El
`
`•(cid:127)
`
`/ 111.. I/,
`
`,
`
`,
`
`I I. I II"
`
`II
`
`~ re:::;;;:,
`
`~ ~ •I Leave Word 111§!l LWhilebQard
`
`.
`Caflsonf-tlld·
`
`Fi<;URE J7
`
`~~~~
`~1eJ7l1~
`
`l\llodex VldaoPhone VPhorw-!est
`
`VCR
`
`206
`
`pol
`
`9, ~ ~ (I "
`
`~ ~
`ftlme ~ '
`
`Shel
`~ 00 =!!!!!o
`5-.
`
`nc=:1
`L~.==:1:.i''r,;nm-.i:. •
`I II
`
`(11111
`
`1!§h
`
`202
`
`203
`
`CISCO EXHIBIT 1006
`Page 31 of 59
`
`

`

`206
`
`pix
`
`C.lculalcr
`
`MIii
`
`maker
`
`~ .....
`
`~
`\0
`.....
`S"J
`
`~ ""4'-a
`~ • r.n •
`
`R from JennHer Street
`
`PRIORITY
`
`234
`
`-230
`
`232
`
`IIEJ Deferred can with Tom Griler ~call
`
`I)
`
`n•=•·-cm11
`
`II
`
`ri::c==-1ru::cnnr.:-11, ... _ .... w_ ..... ~ t? £\
`~nilm----u )Ip ''™ I W!I V///~~~(f'"~I
`
`~~
`
`@ I : :::11
`
`Shall
`•
`
`8
`
`Ill -
`
`231-
`
`[iii
`§I
`
`233
`
`203
`
`"' ""' ~
`""' 00
`
`1--
`
`\CJ
`
`,.,.
`Ol
`
`~
`~
`0
`t.,H
`
`00
`
`t:r !
`
`il Van Note
`205 ~li·i·
`i i..ll~.i
`
`Steel
`
`lake
`
`l.udloig
`
`LIIU
`
`Laun11
`
`Griner
`
`In Box
`
`204
`
`Help_
`1:211:a
`
`~~~~
`o~~[jj]
`
`'!~~!
`
`I\Jlcdex YldaoPhona VPhont-lelll
`
`Fi<;tJRE 78
`
`VCR
`
`CISCO EXHIBIT 1006
`Page 32 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 31 of 34
`
`5,689,641
`
`~
`@)
`I C,
`!
`
`,Ei
`~
`1ij
`(.)
`
`I
`~
`Cl
`
`.....
`~
`
`~
`
`CISCO EXHIBIT 1006
`Page 33 of 59
`
`

`

`~
`,l:ii..
`~
`\0
`~
`~
`01
`
`~
`
`~
`
`,I:;,,.
`w
`s,
`id
`a
`i
`
`00
`
`-..J
`~
`
`w
`
`i,-
`~
`i,-
`
`~ = i
`
`rJl •
`~ •
`
`,~, uBBEIEl@lboardllMNugesUTelephonell I
`
`Kemedy
`
`v,,-
`
`l<indon
`
`Slell
`
`Van Note
`
`I.Ike
`
`Ludwig
`
`llltr
`
`lluwtrt
`
`Gri'ler
`
`205 ~Ji•1a
`i iL~~,i
`
`Hele_
`@][a
`
`~
`
`OK
`
`251
`
`Bl
`
`I
`
`211
`
`Deferred CaN wilh Too, Gmer
`
`204
`
`252
`
`206
`
`Fit:;llRE 40 I
`
`:l"Il:::"1f"u:u"lrtr::" (cid:127)I I ---,., __ ~ ·~"
`(lnil1H::-::=<« )IP :vJY I 1U!I VUtZt
`
`El
`
`~$$&
`
`SunPC
`
`ColorPrinl
`
`Prirt
`
`Edler
`
`Rolodex Ytdeo~hone VPho1111-lelll
`
`VCR
`
`pix
`
`Galculalor
`
`wtrp:
`
`makar
`
`1-bme ~
`
`Shel
`
`~-w~
`o ~ ~Ill
`QT wl~i
`
`-
`
`1111
`
`231-
`
`203
`
`El
`
`CISCO EXHIBIT 1006
`Page 34 of 59
`
`

`

`~
`~
`"' 0'\
`\0
`00
`"' 0'\
`{If
`
`,a::..
`w
`~
`w w
`m.
`ga
`
`---l
`\0
`\0
`i--
`~
`i--
`~
`
`z 0
`
`~ = """'" a
`
`~ • 00
`
`•
`
`,,...__,__-....
`
`...,__.II :,,~,. I
`
`I IU JIU[ /f Ill!(/~ 111,·-s·r:··-·--,
`
`II
`
`,,..,.1 I II
`
`EJ•
`
`1111
`
`F
`
`ll~I ~ J
`
`-[:Al
`
`-(cid:127)
`
`1111220
`
`a..=..111.X ~ ....,,,J4-I I.
`
`Dllll""-r'l'P'""-(cid:127)
`
`4th
`
`Share: metals • aradl
`
`A!:!JL5!Jlr:n
`
`k-u
`
`202--rr,;J ·~ 1111 -•~:.:__-~~---• ;::::v. 2Z!
`NfflGM I~ I
`
`-·
`
`Tim Griner
`
`~~
`
`--=----
`
`203---li
`
`~:11
`
`1111
`
`Telephone
`
`Kemedy
`
`l!lnlaft V...
`
`81111
`
`n Note
`
`V(cid:127)
`
`lake
`
`l.udlllg
`
`LIIR .
`
`i.-a
`
`Griner
`
`lal9811Shn11MMon1
`~!i~i~
`i itj},i__i
`
`[[I]
`
`lnBax
`
`205
`
`"V
`
`263
`&lm;r;J
`lliji CeH~=eu .. I
`
`Fit:;URE41
`
`Edlor
`
`206
`
`---
`
`pix
`
`Galculltor
`
`Whp
`
`1111kt,
`
`·~.
`Prn ~ SunPC
`,> £11 !! v~ w!!.
`o ~"Ill
`11 ~I Ill
`
`CISCO EXHIBIT 1006
`Page 35 of 59
`
`

`

`U.S. Patent
`
`Nov. 18, 1997
`
`Sheet 34 of 34
`
`5,689,641
`
`I
`
`CISCO EXHIBIT 1006
`Page 36 of 59
`
`

`

`5,689,641
`
`1
`MULTIMEDIA COLLABORATION SYSTEM
`ARRANGEMENT FOR ROUTING
`COMPRESSED AV SIGNAL THROUGH A
`PARTICIPANT SITE WITHOUT
`DECOMPRESSING THE AV SIGNAL
`
`BACKGROUND OF THE INVENITON
`
`The present invention relays to computer-based systems
`for enhancing collaboration between and among individuals
`who are separated by distance and/or time (referred to herein
`as "distributed collaboration"). Principal among the inven(cid:173)
`tion's goals is to replicate in a desktop environment, to the
`maximum extent possible, the full range, level and intensity
`of interpersonal communication and information sharing
`which would occur if all the participants were together in the
`same room at the same time (referred to herein as "face-to(cid:173)
`face collaboration").
`It is well known to behavioral scientists that interpersonal
`communication involves a large number of subtle and com(cid:173)
`plex visual cues, referred to by names like "eye contact" and
`''body language," which provide additional information over
`and above the spoken words and explicit gestures. These
`cues are, for the most part, processed subconsciously by the
`participants, and often control the course of a meeting.
`In addition to spoken words, demonstrative gestures and
`behavioral cues, collaboration often involves the sharing of
`visual information-e.g., printed material such as drawings,
`photographs, charts and graphs, as well as videotapes and
`computer-based animations, visualizations and other
`displays-in such a way that the participants can collec(cid:173)
`tively and interactively examine, discuss, annotate and
`revise the information. This combination of spoken words,
`gestures, visual cues and interactive data sharing signifi(cid:173)
`cantly enhances the effectiveness of collaboration in a 35
`variety of contexts, such as "brainstorming and problem·
`solving" sessions among professionals in a particular field,
`consultations between one or more experts and one or more
`clients, sensitive business or political negotiations, and the
`like. In distributed collaboration settings, then, where the 40
`participants cannot be in the same place at the same time, the
`beneficial effects of face-to-face collaboration will be real(cid:173)
`ized only to the extent that each of the remotely located
`participants can be "recreated" at each site.
`To illustrate the difficulties inherent in reproducing the 45
`beneficial effects of face-to-face collaboration in a distrib(cid:173)
`uted collaboration environment, consider the case of
`decision-making in the fast-moving commodities trading
`markets, where many thousands of dollars of profit (or loss)
`may depend on an expert trader making the right decision 50
`within hours, or even minutes, of receiving a request from a
`distant client The expert requires immediate access to a
`wide range of potentially relevant information such as
`financial data, historical pricing information, current price
`quotes, newswire services, government policies and 55
`programs, economic forecasts, weather reports, etc. Much of
`this information can be processed by the expert in isolation.
`However, before making a decision to buy or sell, he or she
`will frequently need to discuss the information with other
`experts, who may be geographically dispersed, and with the 60
`client. One or more of these other experts may be in a
`meeting, on another call, or otherwise t