(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2003/0105820 A1
`(43) Pub. Date:
`Jun. 5, 2003
`Haims et al.
`
`US 20030105820A1
`
`(54) METHOD AND APPARATUS FOR
`FACILITATING ONLINE COMMUNICATION
`
`(76) Inventors: Je?'rey Haims, Jersey City, NJ (US);
`Ron Milione, Huntington Station, NY
`(US); Gene Goldberg, New York, NY
`(Us)
`Correspondence Address:
`BUCKLEY, MASCHOFF, TALWALKAR, &
`ALLISON
`5 ELM STREET
`NEW CANAAN, CT 06840 (US)
`
`(21) Appl. No.:
`
`10/154,303
`
`(22) Filed:
`
`May 24, 2002
`
`(30)
`
`Foreign Application Priority Data
`
`Dec. 3, 2001 (WO) ......................... .. PCT/US01/45187
`
`Publication Classi?cation
`
`(51) Int. Cl? ........................... .. G06F 15/16; 6096 5/00
`(52) Us. 01. ......................... ..709/205; 709/227; 345/753
`(57)
`ABSTRACT
`Embodiments of the present invention provide systems,
`methods, apparatus, computer program code, user interfaces
`and means for facilitating online communication.
`
`Communication Sewer
`200
`
`as _ as
`
`Conference Bridges &
`Audio
`Video
`
`25%;
`
`Web Server Q5
`
`Database
`
`Messaging Server 2%
`
`Presence Server
`208
`
`r15
`
`User Device
`110a
`
`1 4
`
`User Device
`1 10b
`
`GOOGLE EXHIBIT 1017
`
`Page 1 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 1 0f 21
`
`US 2003/0105820 A1
`
`100 /
`
`USER DEVICE
`1.1111
`
`COMMUNICATION
`NETWORK
`E
`
`USER DEVICE
`
`110n
`
`COMMUNICATION
`SERVER
`
`20
`
`FIG. 1
`
`Page 2 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 2 0f 21
`
`US 2003/0105820 A1
`
`K110i
`K110a
`E ii FEE’?
`
`j
`
`INTERNET
`
`E
`
`PSTN
`
`154
`
`COLLABORATION
`SERVER
`202
`
`FIG. 2
`
`Page 3 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 3 of 21
`
`US 2003/0105820 A1
`
`Processor _
`Mia
`
`‘Q2351
`Mass Storage
`
`.L/126b
`Processor _
`M
`Mass Storage
`
`V0
`
`1 4a _ Communication S/W
`221
`
`V0 —
`Lg _ Communication SM
`M
`
`Comm
`11
`
`Video/ _
`AUdiOJlQg
`_
`
`l»
`
`Shared
`
`Dmumenm?-
`
`110a
`
`Comm _
`116
`
`Video/
`AUdiO118b
`
`o
`
`1
`
`b
`
`COMMUNICATION
`NETWORK
`E
`
`Processor
`—2-
`
`‘L,
`
`m
`‘
`Mass Storage m
`
`HO _
`g5
`
`DOMAIN
`DATA m
`
`Comm
`
`USER DATA 0
`
`Video / _ COMMUNICATION
`Audio2_13
`DATA
`5_00
`
`4,
`
`FIG. 3
`
`Page 4 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 4 0f 21
`
`US 2003/0105820 A1
`
`Page 5 of 39
`
`

`

`alcb-cee-SSS
`
`
`
`L9Sb-€01-206
`
`Cleb-eee-SSS
`
`woo'oobiq@souol
`
`"GS6S-SSS-E02
`
`LOSP-ESL-E0e
`
`
`
`‘Wooswoy@GS3u0l
`
`002°002'002'002
`
`
`
`LOSP-ESL-E02
`
`
`
`L9SP-€21-£02yoeayJONC
`
`Z1Zl-996-Z1zZ
`
`ZlZb-99S-Z12yeaJOINC
`
`$‘OIs
`
`‘20‘€0)810|09°€0UNS
`Z#noke7:(20
`¥S2'bSe'vSe'rSe
`“WOS'JOR®yiws
`
`Y3sn
`
`Patent Application Publication
`
`Jun. 5, 2003 Sheet 5 of 21
`
`US 2003/0105820 A1
`
`Ol”
`
`80P
`
`OOF
`
`p07
`
`£0‘L0)$1009«20US
`
`$S¢°SSe'GS¢'SS¢
`‘W00'OdUys
`
`alat-eee-SSS
`
`‘UWSWes
`
`SIONAYASIed
`Ssauqdy
`
`NOILVOO1
`
`¥3sn
`
`NOILVWHOSNI
`
`YAISILNACI
`
`Page 6 of 39
`
`Page 6 of 39
`
`
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 6 0f 21
`
`US 2003/0105820 A1
`
`com |\\
`
`@ .wE
`
`Page 7 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 7 0f 21
`
`US 2003/0105820 A1
`
`X
`
`Industry
`
`Womens
`Childrens
`Shoes
`Textiles
`Home
`
`Mens ’ n
`Design
`Sales/Marketing
`Production
`Warehousing
`Transportation
`Advertising
`Banking
`Internet access
`Search Engines
`
`Z
`
`Line 01
`or Pi'3outillilcisgegment
`
`News Feeds
`
`+
`Y
`Industry Segment
`
`0 Wholesale
`
`0 Retail
`
`0 Manufacturing
`
`Page 8 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 8 of 21
`
`US 2003/0105820 A1
`
`Global Centric Networks
`
`
`
`EmEoQ EEoBoQ
`
`Global Domain
`
`Company B
`
`Company A
`
`Division
`
`Sub
`Depl
`
`Crubs COll'llllUlllCllllUl'l salnc
`mvnonmml
`
`h B m m M 10
`m. m m m d C m w.
`G
`
`D. U
`
`Authorization
`
`Global Buyers Group
`
`Cross commnmcannn me
`
`L
`
`Merchandising
`
`Global Buyers Group
`
`Cross communication vmh
`pcrmsswu only
`
`, 1
`I
`
`‘__——-_---v"
`
`Merchandising
`
`Personal Prul'llc
`Information
`
`Some examples are:
`Credit Card mformilllcn
`
`Home Addxcss
`Ship To Address
`Personal Subscriptions
`E9 The Wall St Journal
`unllne
`MyYulwu'
`Wab Comcm
`
`Page 9 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 9 0f 21
`
`US 2003/0105820 A1
`
`Global Domain
`
`Corporate Domain (N‘)
`
`Corporations (N1)
`
`Divisions (N1)
`
`Departments (N1)
`
`Sub-Deptartmems (N1)
`
`Groups (N1)
`
`Global Domain
`
`Liz Claiborne, Inc. (Corporate Domain)
`
`6 iz Claibone Retail 6 Liz Claibone Wholesale
`
`Permissions
`
`Page 10 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 10 0f 21 US 2003/0105820 A1
`
`600
`
`/
`
`DETERMINE ATTENDEE
`AVAILABILITY
`
`I
`
`INVITE ATTENDEE(S)
`
`m
`
`I
`
`CONDUCT COMMUNICATION
`SESSION
`
`06
`
`FIG. 8
`
`Page 11 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 11 0f 21 US 2003/0105820 A1
`
`jg
`
`USER DEVICE <~—@-— USER DEVICE
`110a
`KN
`1 10n
`\‘l/ a —
`
`COMMUNICATION
`SERVER
`
`2 0
`
`FIG. 9A
`
`Page 12 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 12 0f 21 US 2003/0105820 A1
`
`700
`
`USER DEVICE
`
`m > USER DEVICE
`(
`
`110a '
`
`110n
`
`COMMUNICATION
`SERVER
`
`22g
`
`FIG. 9B
`
`Page 13 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 13 0f 21 US 2003/0105820 A1
`
`‘500
`
`??
`
`LO
`(D
`
`FIG 10A
`
`ll
`
`AN Alli
`
`W All!
`
`Page 14 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 14 0f 21 US 2003/0105820 A1
`
`inq
`1 1
`coco
`
`N
`on
`
`
`
`FIG. 10D
`
`Coq-
`F1-
`0000
`
`2| 0
`
`N
`1—
`00
`
`g
`
`(D
`
`1-7-1
`000000
`
`Y-
`
`_
`
`u.
`
`LL
`
`'
`
`(2
`LL
`
`N
`O
`00
`
`999'
`0000
`
`[\
`00
`
`(\l
`
`8
`
`m
`
`m
`o
`*-
`
`I
`
`<22|<r
`
`1-
`
`LLl
`O
`*
`
`u
`
`r\
`1-
`0o
`
`Page 15 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 15 0f 21 US 2003/0105820 A1
`
`
`
`Io? ..@E
`
`62. .0E
`
`mmww
`
`Page 16 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 16 0f 21 US 2003/0105820 A1
`
`0%
`
`wow GE
`
`DEED
`
`Page 17 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 17 0f 21 US 2003/0105820 A1
`
`cow
`
`gm
`a“
`
`we“
`
`we“
`
`E FEILLE
`
`Page 18 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 18 0f 21 US 2003/0105820 A1
`
`cow
`
`
`
`
`
`BEKMMB Nun 9 3m: #UQU
`
`.5? OE
`
`:HMEEHH
`
`Page 19 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 19 0f 21 US 2003/0105820 A1
`
`n-———>
`
`H
`
`O
`0
`
`<2
`
`U.
`
`H
`
`I
`
`4-—-—I
`
`Z
`O
`
`Q
`
`Ll.
`
`I
`
`2
`O
`
`9'
`
`LL
`
`I
`
`D.
`O
`
`9' LL
`
`Page 20 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 20 of 21.
`
`US 2003/0105820 Al
`
`Resolution
`
`
`Resolution
`
`Resolution
`
`Monitor
`
`Monitor
`
`Monitor
`
`
`
`Page 21 of 39
`
`Page 21 of 39
`
`

`

`Patent Application Publication
`
`Jun. 5, 2003 Sheet 21 of 21
`
`US 2003/0105820 A1
`
`———
`
`cocSebpigequaiajuog
`
`
`
`eo1AeqJesheolAeqJes/p
`seer|PpOd
`JeAIESGan
`
`JeMesUOeo|UNWIWOD
`
`LL‘Sls
`
`002
`
`BOLL
`
`Page 22 of 39
`
`Page 22 of 39
`
`
`
`
`
`
`

`

`US 2003/0105820 Al
`
`Jun. 5, 2003
`
`METHOD AND APPARATUS FOR FACILITATING
`ONLINE COMMUNICATION
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application claimspriority under 35 U.S.C. §§
`119 and 120 to PCT Patent Application Serial No. PCT/
`US01/45187, entitled “Executive Briefing Network”, filed
`on Dec. 3, 2001, the contents of which are hereby incorpo-
`rated by reference in their entirety for all purposes.
`
`FIELD OF THE INVENTION
`
`invention relates generally to elec-
`[0002] The present
`tronic communication methods and apparatus. More particu-
`larly, embodiments of the present invention relate to meth-
`ods, systems, apparatus, computer program code and means
`for facilitating electronic communication among multiple
`participants.
`
`BACKGROUND OF THE INVENTION
`
`[0003] Advances in telecommunications have changed the
`waythat individuals interact with each other. New devices,
`such as wired and wireless telephones, computers and net-
`works such as the Internet make it easy for individuals to
`communicate. Although these advances in communications
`have made it easier to communicate with others, they have
`also created new communication difficulties.
`
`[0004] For example, in some ways, these new communi-
`cations devices have madeit more difficult to reach others.
`At any given time, most individuals can be contacted using
`one or more communication devices. A businessperson
`typically can be reached via either an office e-mail address,
`an office telephone number, an office facsimile machine, a
`home e-mail address, and/or a home telephone number.
`Whenthe personis not at either his home or businessoffice,
`he can often be reached on his cellular telephone. The
`availability of multiple options can make it difficult
`to
`contact someone.
`
`In today’s fast paced business environment,it is
`[0005]
`often desirable to quickly determineif a person is available
`for an on-line communication session, and if so, quickly join
`the person in an on-line communication session. It would be
`desirable to provide systems and methods whichtrack these
`options and allow individuals to be readily contacted. It
`would further be desirable to provide systems and methods
`which allow individuals to be quickly contacted and
`involved in communication sessions with one or more other
`individuals. It would further be desirable to provide systems
`and methods which track the accessibility of individuals,
`allowing an initiator of a communication session to quickly
`ascertain the availability or non-availability of a potential
`participant.
`
`[0006] Advances in communications have further failed to
`provide an adequate solution to the problem offacilitating
`communication among multiple individuals. For example,
`Applicants are not aware of any satisfactory solution to the
`following example scenario. A numberof individuals wish
`to meet to review and discuss a draft document produced by
`another individual. Currently, review of such a documentis
`performed in a number of ways. Each participant may print
`a copy of the draft and mark it up for later discussion.
`
`Page 23 of 39
`
`Alternatively, each participant may electronically edit the
`document and forward the revised documentto one of the
`
`participants designated as the individual responsible for
`collating comments from each of the reviewers. A confer-
`encecall or face-to-face meeting may also be held to discuss
`any comments. This iterative, sequential process can be
`inefficient and time consuming.
`
`[0007] Further, the approach can lead to miscommunica-
`tions and misunderstandings among participants who do not
`have the ability to discuss comments and concerns with
`other participants. Further still, one or more of the partici-
`pants mayutilize a software program that is not compatible
`or available to the systems operated by one or more of the
`otherparticipants. A still further problem liesin the difficulty
`of managing access privileges and permissions among par-
`ticipants from multiple companies. It would be desirable to
`provide a system and method which allowsaccessprivileges
`and permissions to be accurately assigned and maintained,
`thereby ensuring that individuals from different companies
`or entities can communicate and collaborate.
`
`[0008] Tools and systems have been proposed to assist in
`such communications. For example, presentation and docu-
`ment sharing tools have been developed which allow mul-
`tiple participants to view the same document over the
`Internet. Unfortunately, these tools do not allow the sharing
`of any type of document produced by any type of software.
`Further, Applicants are unaware of any tools that allow any
`or all of the participants to mark-up or annotate the shared
`document. It would be desirable to provide systems and
`methods allowing individuals to jointly view, edit and
`manipulate documents even where the document format is
`not compatible with the systems of one or more of the
`participants. Preferably, such systems and methods would
`further support voice, text, and video interaction between the
`participants in a secure and user friendly manner.
`
`[0009] A number of tools have been developed which
`allow individuals to utilize computers as communication
`platforms. For example, a computer equipped with a micro-
`phone and appropriate software and which is in communi-
`cation with the Internet can be used to initiate and receive
`
`voice telephone calls. A computer further equipped with a
`video camera can be used to initiate and receive video
`conference calls. Such existing tools are commonly pro-
`vided as separate applications or applications which utilize
`Microsoft Windows®-style windowingortiling techniques.
`When multiple applications or sessions are in use, it can be
`difficult and inefficient for a user to switch between appli-
`cations. This problem is exacerbated when the computer is
`further utilized to support communication sessions where
`one or more documents are being viewed by multiple
`participants. It would be desirable to provide user interfaces
`and tools which allow participants to securely, efficiently
`and readily manage andinitiate interactions with others.
`
`SUMMARY OF THE INVENTION
`
`[0010] Embodiments of the present invention provide sys-
`tems, methods, apparatus, computer program code, user
`interfaces and meansfor facilitating online communication.
`
`to some embodiments of the present
`[0011] Pursuant
`invention, methods, apparatus, systems, computer program
`code, and meansfor operating a computing deviceto initiate
`a communication session are provided which include:
`
`Page 23 of 39
`
`

`

`US 2003/0105820 Al
`
`Jun. 5, 2003
`
`fields comprising at least one of: a name of a party to a
`conference, a nameof other attendees of the conference, an
`indication of a host of the conference; an address book of
`comprising addresses of other users available for the con-
`ference; and a content section having at least a portion
`thereof presented in a lower half of the display of thefirst
`computing device, the content section including a frame for
`allowing the display and manipulation of a second software
`application by the first user, wherein the second software
`application is not required to be resident on the first com-
`puting device.
`
`to some embodiments of the present
`[0015] Pursuant
`invention, methods, apparatus, systems, computer program
`code, and meansfor facilitating communications between a
`plurality of users are provided which include establishing a
`first user using a first computing device as a moderator of an
`online conference; establishing a second user using a second
`computing device as an attendee of the online conference;
`receiving, from the moderator, an indication of a software
`application and content managedbythe software application
`to make available to the attendee, the software application
`resident on the first computing device; and receiving from
`the attendee a revision to the content generated in a content
`section of a display of the second computing device during
`the online conference. Pursuant to some embodimentsof the
`present invention, a passport function is provided in which
`security and other preference attributes associated with a
`user can be established and permanently associated with the
`user, permitting the user to move within and between
`organizations while maintaining preferences.
`
`[0016] With these and other advantages and features of the
`invention that will become hereinafter apparent, the nature
`of the invention may be more clearly understood byrefer-
`ence to the following detailed description of the invention,
`the appended claims and to the several drawings attached
`herein.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`detecting if a desired participantis available to participate in
`a communication session; transmitting an invitation to said
`desired participant if said desired participant is available;
`receiving an acceptance from said desired participant,
`wherein said transmitting and said receiving are performed
`in substantially real time; and upon receipt of said accep-
`tance, automatically causing meeting information to be
`forwarded to a communication server, said communication
`server establishing said communication session involving
`said meeting initiator device and said desired participant.
`Pursuant to some embodiments of the present invention,this
`initiation of a communication session may includethe use of
`to some embodiments of the present
`[0014] Pursuant
`instant messaging to initiate the communication session.
`invention, methods, apparatus, systems, computer program
`[0012] Pursuant
`to some embodiments of the present
`code, and meansfor initiating an online conference using a
`invention, methods, apparatus, systems, computer program
`network communication software application onafirst com-
`code, and means for operating a computing device to pro-
`puting device are provided which include: selecting a com-
`vide a communications user interface are provided which
`munication type icon for initiating one of the following
`includes an action section for presenting to the user a
`processes of an online conference: an online communication
`plurality of selectable communication type icons; an outline
`of a productivity application, a voice communication, a
`section for presenting to the user a plurality of communi-
`video communication and a text messaging communication;
`cation-related data; and a content section including a frame
`selecting an attendee for the online conference; and trans-
`for allowing the display and manipulation of a second
`mitting a text message for display on a computing device of
`software application by the user. Pursuant to some embodi-
`the selected attendee, wherein the attendee may select an
`ments of the present invention,at least a portion ofthe action
`alternate destination for the display of the text message
`section is presented in an upper portion of a display of a
`when the attendee is not using a second computing device
`computing device. In some embodiments, at least a portion
`having a network address assigned to the attendee.
`of the outline section is presented in a right portion of a
`display of a computing device, in some embodiments, at
`least a portion of the content section is presented in a lower
`section of a display of a computing device. In some embodi-
`ments, the action section, the outline section and the content
`section do not overlap, thereby reducing an opportunity for
`the user to accidentally select an incorrect function on the
`user
`interface. The second software application is not
`required to be resident on the first computing device.
`Embodiments of the present invention permit the integration
`and managementof a number of communications functions,
`using, for example, a plurality of selectable communication
`type icons including at least one of: an online communica-
`tion icon, a video communication icon, an audio communi-
`cation icon, and a text message communication icon.
`[0013] Pursuant
`to some embodiments of the present
`invention, methods, apparatus, systems, computer program
`code, and meansfor providing a user interface for a network
`communications software application includes: an action
`section having at least a portion thereof presented in an
`upperhalf of a display of a first computing device during use
`of a first software application, the action section including a
`plurality of selectable action icons, the selection of any of
`whichbya first user of the computing device initiates at least
`one of the following processes between the first user and a
`second user having a second computing device in commu-
`nication with the first computing device over a communi-
`cations network: an online communication with a produc-
`tivity application,
`a video communication,
`an audio
`communication, and a text message communication; an
`outline section havingat least a portion thereof presented in
`a right half of the display of the first computing device, the
`outline section including a plurality of selectable function
`icons and a plurality of communications data fields,
`the
`plurality of selectable function icons comprising at least one
`of: a telephone keypad with selectable numeric keys, a
`volumecontrol including a mute function, and a conference
`disconnect control;
`the plurality of communications data
`
`[0017] FIG. 1 is a schematic block diagram of an exem-
`plary communication network according to some embodi-
`ments of the present system;
`
`[0018] FIG. 2 is a schematic block diagram of a further
`exemplary communication network according to some
`embodiments of the present system;
`
`[0019] FIG. 3 is a schematic block diagram of the com-
`munication network of FIG. 1 showing details of user
`devices, communication server, and related data;
`
`Page 24 of 39
`
`Page 24 of 39
`
`

`

`US 2003/0105820 Al
`
`Jun. 5, 2003
`
`FIG.4 is a tabular representation of a portion of a
`[0020]
`domain hierarchy database according to an embodimentof
`the present invention;
`
`[0021] FIG. 5 is a tabular representation of a portion of a
`user database according to an embodimentof the present
`invention;
`
`FIG.6 is a tabular representation of a portion of a
`[0022]
`communication database according to an embodimentof the
`present invention;
`
`[0023] FIGS. 7A-C are schematic diagrams depicting
`examples of domain hierarchies in which intercommunica-
`tion among users is facilitated using features of embodi-
`ments of the present invention;
`
`[0024] FIG. 8 is a flowchart depicting an exemplary
`process performed by a user of the communication network
`of the present system;
`
`[0025] FIGS. 9A-B are schematic block diagrams depict-
`ing message flow to establish an ad hoc communication
`session pursuant to embodiments of the present invention;
`
`[0026] FIGS. 10A-Q are illustrations of user interfaces
`presented to a user during communications using the com-
`munication network of FIG. 1; and
`
`[0027] FIG. 11 is a schematic block diagram depicting an
`embodiment of the system of FIG. 1 configured to support
`establishment of instant meetings pursuant to embodiments
`of the present invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`[0028] Applicants have recognized a need for systems,
`methods, apparatus, computer program code, user inter-
`faces, and means for facilitating online communications
`among,
`individuals in a secure manner. Applicants have
`recognized that this communication may befacilitated using
`passport security techniques which ensure that individual
`user preferences are maintained as the user moves within the
`system. Further, Applicants have recognized that security
`techniques are needed to ensure that users from different
`organizations can communicate in a secure fashion.
`
`[0029] Applicants have further recognized a need for
`systems, methods, apparatus, computer program code, user
`interfaces and means for initiating and conducting ad hoc
`communication sessionsor sessionsinitiated and conducted
`in a short period of time. Applicants have further recognized
`a need for user interfaces which allow multiple communi-
`cation and collaboration tools to be manipulated and pre-
`sented in an efficient and readily accessible manner. For
`example, Applicants have discovered that
`the use of a
`“container” or workspace in conjunction with a control
`interface allows users to easily manage and control
`the
`convergence of instant message (“IM”) information deliv-
`ery, document, application and desktop sharing as well as
`communication and collaboration technologies such as
`audio, video, text and other programs.
`
`[0030] A number of terms are used herein to describe
`features of embodiments of the present
`invention. For
`example, as used herein, a “participant” is an individual
`operating a communication device (including a computing
`device, wired or wireless telephone, etc.) to participate in a
`
`Page 25 of 39
`
`communication session, conference or meeting using tech-
`niques of embodiments of the present invention.
`
`[0031] As used herein, the term “communication session”
`or simply “session” is used to refer to a meeting, conversa-
`tion, or other interactive communication between one or
`more participants using techniques of embodiments of the
`present invention. A communication session may include
`audio, video, text or other interaction among participants. A
`communication may also include interactive collaboration
`among participants (e.g., to discuss a documentdisplayed on
`a display monitor of a computing device operated by each of
`the participants). As used herein, a “collaboration session”is
`a communication session which involves the sharing of one
`or more computer applications and/or documents among
`participants. A collaboration session may also involve voice,
`text, and/or video communications among one or more
`participants.
`
`[0032] As used herein, participants in a communication
`session include one or more “attendees” and a “host”. As
`used herein, the term “host” is used to refer to a participant
`in a communication session who initiates the session. Fur-
`ther, the host in a collaboration session is the participant who
`is designated (which designation may change throughout the
`collaboration session) as having the ability to control certain
`interactions or access rights of the other attendees during the
`session. In general, the attendee whoinitiates a collaboration
`session will initially be designated as the “host” and will
`have the ability to pass control to other attendees as well as
`to revoke the designation.
`
`[0033] System Overview
`
`[0034] Reference is now made to the figures wherein
`similar components of embodimentsof the present invention
`are referenced in like manner. Reference is first made to
`
`FIG. 1 where a communication system 100 pursuant to one
`embodimentof the present invention is depicted. As shown
`in FIG. 1, communication system 100 includesa plurality of
`user devices 110a-n in communication with each other and
`a communication server 200 over a communications net-
`
`work 150. Pursuant to embodiments of the present inven-
`tion, users operating user devices 110 may interact with each
`other. This interaction can include audio, video, text, and
`other forms of communication as will be described further
`herein. Further, this interaction can include collaboration
`among users in which users operating user devices 110 may
`jointly view and manipulate applications and/or documents.
`
`[0035] User devices 110 may be any of a number of
`different types of devices which may be used to engage in
`various forms of communication such as voice, video, text
`or graphical interaction. For example, some user devices 110
`may be a computer, such as those based on the Intel®
`Pentium® processor, that are adapted to communicate via
`network 150. The computer may be configured in any of a
`number of different manners, such as, for example, as a
`desk-top computer, lap-top computer, handheld computer,
`personal digital assistant (PDA), or the like. Each user
`device 110 may operate software applications allowing the
`device to communicate via network 150 and to send and
`receive information pursuant to embodiments of the present
`invention. Such user devices 110 may be configured with
`voice input and output devices and, in some embodiments,
`with video capture and display devices as are knownin the
`art. Some user devices 110 may be telephones(either wired
`
`Page 25 of 39
`
`

`

`US 2003/0105820 Al
`
`Jun. 5, 2003
`
`or wireless) which send and receive voice data and, in some
`embodiments, text messages. Other user devices 110 now
`known or later developed which enable communication
`between individuals may also be used with the communi-
`cation system of the present invention.
`
`in communication system 100
`[0036] Each participant
`may operate one or more user devices 100. For example, a
`particular participant may operate both a homeand anoffice
`computer as well as an office telephone and a cellular
`telephone, each of which is in communication with com-
`munication server 100 via network 150. As will be described
`
`below, the participant may designate which user devices he
`wishes to designate as “online” or otherwise available for
`use in communication sessions pursuant to embodiments of
`the present invention. This status may be changed by the
`participant (e.g., the office computer may be designated as
`“online” during working hours, and the home computer may
`be designated as “online” on evenings and weekends while
`the office computer will be designated as “offline” during
`those times). The participant may have multiple devicesall
`“online” at the same time depending onsituation and need.
`Embodiments of the present invention manage these mul-
`tiple devices and the status of all participants using persis-
`tent real-time parallel state control. For example, a commu-
`nication server may be used to perform state control of all
`devices that are logged on or registered with the system. As
`used herein, “state control” is used to refer to the status or
`availability of each device registered with the system (e.g.,
`a device may be “available” or “online” or it may be
`“unavailable” or “offline”). Embodiments of the present
`invention track this state information based, atleast in part,
`on information provided by each participant.
`
`[0037] Embodimentsof the present invention permit inter-
`actions between different
`types of user devices. For
`example, embodiments of the present invention facilitate
`collaborations between users operating personal computers
`and users operating wired or wireless telephonesorthelike.
`
`[0038] As used herein, communication network 150 may
`employ any of a numberof different types and modes of
`communication, and may be for example, a Local Area
`Network (LAN), a Metropolitan Area Network (MAN), a
`Wide Area Network (WAN), a proprietary network, a Public
`Switched Telephone Network (PSTN), a Wireless Applica-
`tion Protocol (WAP) network, a wireless network, a cable
`television network,or an Internet Protocol (IP) network such
`as the Internet, an intranet or an extranet. Moreover, as used
`herein, communications include those enabled by wired or
`wireless technology.
`
`[0039] According to some currently preferred embodi-
`ments, communication between user devices 110a-n and
`communication server 200 is supported by implementation
`of
`telecommunication standards including International
`Telecommunication Union (ITU) recommendation H.323
`“Packet-Based Multimedia Communications Systems” and
`ITU recommendation T.120 “Data Protocols for Multimedia
`Conferencing”, the contents of each of which are incorpo-
`rated herein in their entirety. H.323 specifies components,
`protocols and procedures for real-time point-to-point and
`multipoint multimedia communication over packet-based
`networks and also establishes interoperability guidelines. In
`an embodiment implemented using H.323, each user device
`110 maybe configured as an H.323 client or endpoint where
`
`Page 26 of 39
`
`H.323 data streams and signaling originate and terminate.
`For example, such user devices 110 may be configured with
`a H.323 compliant stack, SIP Client Stack or a standalone
`device such as PDA using universal serial bus (USB) and IP
`telephone. In some embodiments, one or more gateway
`devices may also be provided to facilitate communication
`between different networks.
`
`[0040] Communication server 200 may be configured in
`any of a number of ways knownto those skilled in the art,
`such as, for example, an Intel® Pentium® based-computer
`or the like. In some embodiments, a number of communi-
`cation servers 200 may be utilized to support different
`groups of user devices. In an embodiment where the network
`is configured using H.323, SIP protocols, communication
`server 200 may be configured as a H.323 or SIP gatekeeper
`device providing central managementand control services.
`
`In one embodiment, communication server 200 is
`[0041]
`configured as one or more servers or devices performing
`related functions. For example, communication server 200
`may include a Webserver configured to communicate with
`user devices 110a-n via the Internet. The Web server may
`function to generate Web pages (documents on the Webthat
`typically include an HTMLfile and associated graphics and
`script files) that may be accessed via the Web and allow
`communication with user devices 110a-n in a manner known
`
`in the art. The Web server may be in communication with
`and one or more back end servers such as a media server and
`an application server. The Web server may also be in
`communication with one or more databases, such as, for
`example, one or more databases used to store information
`used to manage and facilitate communications between
`participants. In one embodiment, communication server 200
`is based on several components, including, for example, a
`Harmony6000 application server manufactured by IP Unity,
`Inc. of Milpitas, Calif. (which is used as a conference
`bridge). Those skilled in the art will recognize that other
`devices may also be used to provide the functions and
`capabilities described herein. Pursuant
`to some embodi-
`ments, communication server 200 is implemented to reduce
`dependency on individual communication components. For
`example, other conference bridging software may be used.
`As another example (as will be described further below),
`c