United States Patent 1191
`Howell
`
`US005767897A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,767,897
`Jun. 16, 1998
`
`[54] VIDEO CONFERENCING SYSTEM
`
`[75] Inventor: Brian A. Howell. Marblehead. Mass.
`
`[73] Assignee: PictureTel Corporation. Danvers.
`Mass.
`
`[21] Appl. No.: 332,097
`[221 Filed:
`Oct. 31, 1994
`
`[51] Int. Cl.6 ..................................................... .. H04N 7/15
`[521 US. Cl. ............. ..
`. 343/15; 379/9321; 379/9319
`[58] Field of Search ................................ .. 348/15. 14. 16.
`348/17. 18. 19; 379/96. 93.17. 93.19. 93.21;
`370/62; 395/330; 345/1. 127. 130
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5/1985 Fabris et a1. ............................ .. 348/15
`4,516,156
`4,876,657 10/1989 Saito et a1.
`.
`348/15
`5,206,721
`4/1993 Ashida et al. .
`345/1
`5,307,055
`4/1994 Baskin et a1. ..
`395/154
`5,385,475
`1/1995 Sudman et al,
`395/154
`5,473,744 12/1995 Allen et al. ...... ..
`348/14
`5,502,727
`3/1996 Catanzaro et a]. .
`348/15
`5,583,565 12/1996 Cortjens et a1.
`. 345/127
`5,596,346
`1/1997 Leone et a].
`5,627,825
`5/1997 Barraclough et a]. .................. .. 348/15
`
`OTHER PUBLICATIONS
`
`McClain. Linda. Matrox Studio, “The Ultimate Desktop
`Video Production Suite”.
`Matrox Studio. “Plug This Into Your PC for the Most
`Successful Presentation of Your Life” 1993.
`
`Matrox Studio. “The Ultimate Desktop Video Production
`Suite”. Apr. 1993.
`
`Primary Examiner—Stella Woo
`Attorney, Agent, or F im7-—Fish & Richardson EC.
`
`[57]
`
`ABSTRACT
`
`A video conferencing system wherein a director controller is
`adapted for disposition on a lecture podium. The controller
`includes an interconnected control section and a video
`display section for controlling the distribution of generated
`audio and video information signals among a local and
`remote sites selectively in accordance with command signals
`fed to the controller by a podium speaker. The system is
`adapted to operate in one of two operating modes: a “Main
`screen” mode and a “Mark-up” mode. In the “Main-screen”
`mode. the video display section is made up of two display
`areas; a “presentation” display area. and a “preview” display
`area. The “presentation” display area displays the video
`information which typically is currently being viewed by the
`audience/participants at the remote and local sites. The
`“preview” video display area is privately viewable by the
`podium speaker. displays video information signals from a
`second podium speaker selected one of the video sources. In
`the “Mark-up” mode. the “preview" area is removed and the
`size of the “presentation” area is increased The image in the
`enlarged “presentation” area is adapted for editing]
`annotation by the podium speaker. The edited/annotated
`image is distributed to the local and remote sites.
`
`67 Claims, 5 Drawing Sheets
`
`Qomo_1009
`
`

`
`US. Patent
`
`Jun. 16, 1998
`
`Sheet 1 of 5
`
`5,767,897
`
`NETWORK
`
`V1000
`w®_
`
`Qomo_1009
`
`

`
`U.S. Patent
`
`Jun. 16, 1998
`
`Sheet 2 of 5
`
`5,767,897
`
`__
`
`_
`
`Hm_____M___
`
`..._______..._—..._________.,
`
`_ll
`
`_n.Hmmm__oEo:zos_
`
`omoscm_,2Ha._<o9o»m»zm+)_::nwoomofimdm
`Jompzoo.«Cams_<o.z_<s__>m<_.mx:<So—<mms_<o._<mms_<o
`
`
`_w.89>_mm2.
`
`
`_R."4<zommmn__.E<mms_<oFomotzoz__EmEm#69no.4z_mz_.__omo$mo>
`
`_..._NSmmv_<mn_mn50._Jm.I_o_:n_<mo4<oo.__
`
`mNOEmo_o:<mo>_>m<:_x:<R
`
`1I
`
`II]
`
`N
`Z
`
`w
`
`m>_mo3EvaaI
`—o_:n_<mo9m
`
`rlllIIIIIlllrlll
`
`IllllllllIIJIIIIIIlllllu.
`
`cw
`
`Qomo 1009
`
`
`
`zo:<»zmwm_mn_>>m_>mmn_
`
`u_.llllllllIIIIIIII_mmmJmmananHmmwoos.
`
`
`
`__n=._v_m<s___moo:..zmmEow-z_<2..
`
`Qomo_1009
`
`
`
`
`
`

`
`U.S. Patent
`
`Jun. 16, 1998
`
`Sheet 3 of 5
`
`5,767,897
`
`Qomo 1009
`
`Qomo_1009
`
`

`
`US. Patent
`
`Jun. 16, 1998
`
`Sheet 4 of s
`
`x8531 \ w 03
`Q3‘ 05 81,1 @3
`\mlv
`
`/2:
`“$0 $2
`
`w a 8 8 mm
`m M W W W m E U U E
`
`
`590E. \wl/moi 1 m
`
`56>? \ w w? a: m\ 8 m
`
`1/2: SE 253
`.
`5,5 Qw w @ JUJUAMA w
`
`
`
`wwm “mm @Nm mg @m Qmm NS R Jm
`
`mQESmQS $35 E Eommoo
`
`153 m 8m}: \ E m
`
`‘Ibo
`
`M
`
`w .OE
`
`Qomo_1009
`
`

`
`U.S. Patent
`
`Jun. 16, 1993
`
`Sheet 5 of 5
`
`5,767,897
`
`7:’
`
`|_E_|
`
`115
`
`UD
`
`“2
`
`FIG. 5A ‘so.
`
`‘‘802
`
`1352
`
`SLIDE
`
`1352
`
`SLIDE
`
`81
`
`135
`
`‘
`
`136
`FIG. 5B 1
`
`VCR
`I1-ICEEI [El E]
`
`811
`
`VCR
`EIWEI [El E]
`
`812
`
`FIG. 5C
`
`DOC
`
`DOC
`
`FIG. 5D
`
`PC
`
`PC
`
`8“ E El @ E [II E]
`
`812
`
`FIG. 5E
`
`Qomo_1009
`
`Qomo_1009
`
`

`
`5.767.897
`
`1
`vmno CONFERENCING SYSTEM
`
`BACKGROUND OF THE INVENTION
`This invention relates generally to video conferencing
`systems and more particularly to director controllers used in
`such systems.
`As is known in the art. video conferencing systems are
`being used in a wide variety of settings to enable effective
`communication among audience/participants at local and
`remote sites. The local and remote site each have a video
`camera. a video monitor. a loudspeaker and a microphone.
`A director controller is typically at the local site to enable a
`director to control the distribution of the audio and video
`information signals produced at the sites for viewing and
`listening by the audience/participants at the other sites. For
`example. a director selects the site which is to transmit the
`video information signals to the other sites. One such setting
`is a classroom or meeting room where an instructor or
`moderator. (i.e.. a “presenter”) presents information to the
`local and remote sites. In order to maximize the effective
`ness of the presenter. it is desirable that he/she also act as the
`director. Thus. it is desirable to have a user friendly. director
`controller.
`
`2
`the edited/annotated information to the video monitors at the
`remote and local sites.
`With the arrangement. a more effective. more user
`friendly video conferencing system is provided.
`In accordance with another feature of the invention. icons.
`each representing one of the video sources. are disposed in
`the display section for easy actuation by the podium speaker
`to select the video source for the “presentation” area and
`“preview" areas.
`In accordance with still another feature of the invention.
`a plurality of site selection options are available to the
`podium speaker. including: a “round robin” mode and a “site
`select" mode. In the “round robin” mode. the controller
`selects the video site to present for private viewing by the
`podium speaker by jumping from the video camera at one
`site to the video camera at another site. and so forth. in a
`“round robin" fashion. In the “site select” mode. the con
`troller uses the camera at a site selected by the podium
`speaker. With another site selection option. the controller
`uses the video conferencing system bridge. which can
`respond to audio signals produced by the microphones at the
`local and remote sites. to select one of the video signals
`produced by the video camera at the sites for presentation on
`the video monitors at the other sites during a “teach/direc "
`mode. Thus. the bridge. in response to the audio signals
`produced by the microphones at the remote sites. can be
`directed to select the video signal from such site at which the
`last speaker spoke. or is speaking. for distribution to the
`local and remote sites during the “director/teach” command
`mode. In this way. the podium speaker can view responses
`from the audience/participants at the sites and thereby better
`gage his/her presentation to their viewed responses.
`In accordance with yet another feature of the invention.
`the video display section of the controller includes a tactile
`acuratable. zoom control. responsive to podium speaker
`tactile identi?cation of a portion of the video information
`signals displayed on the "presentation” display area. for
`commanding the camera used as the video source for such
`information to zoom in on the selected identi?ed portion.
`In accordance with another feature of the invention. the
`“presentation" area is adapted to have displayed. in a sub
`region thereof. an image of the podium speaker. The “pre
`sentation" area. together with the sub-region. is distributed.
`in picture-in-picture format. to the remote and local sites.
`This feature is also actuatable by the podium speaker
`interacting with a suitable icon. With such an arrangement.
`the podium speaker is able to maintain contact with the
`audience when presenting the material in the “presentation"
`area.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a diagram of a multi-point video conferencing
`system according to the invention;
`FIG. 2 is a block diagram of a control section used in the
`video conferencing system of FIG. 1;
`FIG. 3 is an illustrative view of a display screen used in
`the control section of FIG. 2 when the video conferencing
`system of FIG. 1 is operating in a “Main-screen" mode;
`FIG. 4 is an illustrative view of a display screen used in
`the control section of FIG. 2 when the video conferencing
`system of FIG. 1 is operating in a “Mark-up" mode; and.
`FIGS. SA-SE are illustrative views of a display screen
`used in the control section of FIG. 2 showing video source
`control when various video sources are selected; FIG. 5A
`showing the video conn-ols when in an “instructor/presenter”
`
`20
`
`25
`
`30
`
`35
`
`SUMMARY OF THE INVENTION
`In accordance with the present invention a video confer
`encing system is provided wherein a director controller is
`adapted for disposition on a lecture podium. The controller
`includes an interconnected control section and a video
`display section for controlling the distribution of generated
`audio and video information signals among a local and
`remote sites selectively in accordance with command signals
`fed to the controller by a director. typically the presenter.
`The system is adapted to operate in one of two operating
`modes: a “Main-screen” mode and a "Mark-up” mode.
`In the “Main-screen" mode. the video display section is
`made up of two display areas; a “presentation" display area.
`and a “preview" display area. The “presentation” display
`area displays the video information which is currently being
`viewed by the audience/participants at the remote and local
`sites. The “preview” video display area is privately viewable
`by the presenting director. (i.e.. podium speaker). and dis
`plays video information signals from a second podium
`speaker selected one of the video sources. The video infor
`mation for the “preview” and “presentation" areas is gen
`erated by one of a number of video sources. including video
`cameras at the remote and local sites. a slide projector. a
`videotape recorder (VCR). a document camera. computer
`images and the like. selected by the podium speaker. The
`“presentation” and “preview” areas are disposed in side-by
`side relationship. A tactile actuatable switch is disposed on
`the display section between the “preview” and “presenta
`tion” areas clearly indicating to the podium speaker that
`touching such switch will transfer the video source used for
`the “preview” area to the “presentation” area and. therefore.
`the “preview" video becomes the video source distributed to
`the local and remote sites.
`In the “Mark-up” mode. the “preview" area is removed
`and the size of the “presentation” area is increased. The
`image in the enlarged “presentation” area is adapted for
`editing or annotation by the podium speaker. The edited/
`annotated image is distributed to the local and remote sites.
`That is. the “presentation” area includes a tactile actuatable
`editing/annotating sensor. responsive to tactile contact with
`the image presented in the “presentation” area. for editing
`and/or annotating such video information and distributing
`
`45
`
`50
`
`55
`
`65
`
`Qomo_1009
`
`

`
`5.767.897
`
`3
`mode is selected. FIG. 5B showing the video controls when
`a slide projector camera is selected. FIG. 5C showing the
`controls when a VCR is selected. FIG. 5D showing the
`controls when a document camera is selected and FIG. 5B
`showing the controls when a PC storage device is selected.
`
`4
`for producing control signals to the microprocessor 38 in
`response to touching by the podium speaker 28 of a touch
`screen display 27 of video display section 26.
`The video selector 34 allows any of 8 video sources. to be
`described. coupled to input ports 35 1-358. to be switched to
`any of eight possible outputs 371-378 in response to a
`control signal fed thereto from microprocessor 38 via line
`43. as will be described hereinafter. Su?ice it to say here.
`however. that a selected one. or ones. of the eight video
`sources fed to input ports 351-358 are coupled to a selected
`one. or ones. of the output ports 371-373 of the selector 34
`in response to touch commands from podium speaker
`28ltouch screen display 27 interaction.
`Here. input port 351 is coupled to a personal camera 76
`directed at the podium speaker 28; input port 352 is coupled
`to a 35 mm slide projector camera 66; input port 353 is
`coupled to a VCR 68 via line 55; input port 354 is coupled
`to a document camera 70; input port 355 is coupled to the
`output of PIP unit 36; input port 356 is coupled to an
`auxiliary video input source. here a video camera 72 directed
`to blackboard 73 (FIG. 1); input port 357 is coupled to a
`selected video camera 14 at one of the far end sites 122-12n
`via the monitor output port of the interface. or CODEC 30;
`and input port 358 is coupled to the local video camera 14
`at local site 121 via the VCR output of the interface. or
`CODEC 30.
`While the video selector 34 has provision for eight
`outputs at output ports 371-378. here. only seven of such
`output ports 371-377 are used. Output port 371 is coupled to
`the monitor 16 insert at local site 12.; output port 372 is
`coupled to the WINl card; output port 373 is coupled to the
`WIN2 card; output port 374 is coupled to video input of
`VCR 68; output port 375 is coupled to an input of Targa.l6
`card 46; output port 376 is coupled to the document camera
`input of interface. or CODEC 30; and. output port 377 is
`coupled to one of the two input ports of the PIP unit 36.
`Finally. it should be noted that while selector 30 has been
`referred to as a “video” selector. it also has a pair of audio
`input ports 359. 3510 and a pair of audio output ports 37 .
`3910. Audio input port 359 is fed by the podium microphone.
`not shown. which picks up speech from the podium speaker
`28. Audio input port 3510 is fed by the audio. or speaker
`(SPIQK). output port of interface. or CODEC 30. Audio
`output port 37 ,0 is fed to the loudspeaker 18 at the local site
`121; while audio output port 379 is fed to the audio (or line)
`input of interface. or CODEC 30. Video selector 34. in
`response to control signals also fed to selector 34 from
`computer 32 via line 43 adjusts: the degree of mixing
`between the podium microphone output at port 359 and the
`audio output from interface. or CODEC 30 at port 3510 to
`produce the audio signal at audio output port 379 for
`distribution to the loudspeakers 18 at the remote sites
`122-12,, via the audio input of interface. or CODEC 30; and.
`also the amount of audio fed from the podium microphone.
`not shown. via port 359 to the audio output port 3710 for the
`local site 121 loudspeaker 18.
`The picture-in-picmre (PIP) unit 36 receives any selected
`one video source of the eight video sources coupled to input
`ports 351-358 of video selector 34 and output port 377 at one
`of the pair of input ports of PIP unit 36. as noted above; and.
`a second one of the pair of input ports to PIP unit 36 is fed
`by the output of the Targa.l6 graphic card 46. as shown. As
`noted above. the output of the PIP unit 36 is fed to input port
`355 of the video selector 34. Onloif and PIP position control
`to the PIP unit 36 (i.e. . whether the should be one picture. or
`a picture in picture (PIP); and. if a PIP. the position of the
`
`10
`
`20
`
`30
`
`25
`
`DESCRIPTION OF THE PREFERRED
`EMBODINIENTS
`Referring now to FIG. 1. a video conferencing system 10
`is shown wherein a local. or near end. site 121 is networked
`with a plurality of remote. or far end. sites 122-12" to
`interchange audio and video information signals via bridge
`13. here a PictureTel M-8000 bridge made by PictureTel
`Corporation. Danvers. Mass. The local. or near end. site 121
`and the plurality of remote. or far end. sites 122-12,, each
`have a video camera 14. a video monitor section 16. a
`loudspeaker 18 and a microphone 20. The local site 121 has
`a director controller 22 disposed on a podium 23. (Here. a
`two monitor arrangement is used. Thus. the monitor 16 has
`two monitors I61. 162. At local site 12.. monitor l6l
`displays the output from the video camera 14 at a selected
`one of the far end sites 122-12" and monitor 162 displays the
`outgoing video signal from the local site 121 to the remote
`sites 122-12,, . At the far end sites 122-12". monitor 16X
`displays the presentation shown to the local site 121 on its
`monitor 162 and monitor 162 displays the video sent by that
`remote site. Monitor 162 is a graphics monitor providing
`double resolution for displaying graphics. to be described. or
`the video presentation described above. It should be
`understood. however. that monitor section 16 may have.
`alternatively. a single monitor for both non-graphic and
`graphic images.
`Referring now also to FIG. 2. the director controller 22
`includes an interconnected control section 24 and a video
`display section 26 arranged to control the distribution of
`generated audio and video information signals among the
`sites 121-12,, selectively in accordance with command sig
`nals fed to the control section 24 by a teacher. moderator. or
`lecturer. hereinafter sometimes referred to as a podium
`speaker 28 (FIG. 1). The control section 24 includes a
`PictureTel Model S-4000 video conferencing interface. or
`CODEC 30. a computer (PC) 32 that contains several video
`cards. to be described. a video selector 34. and a picture in
`picture (PIP) unit 36. Thus. here. director controller 22 is
`adapted to use any existing PictureTel Model 4000 telecon
`ferencing interface.
`Computer 32 is. here. implemented using a personal
`computer. having: a 386 microprocessor 38 adapted to
`operate at a speed of 33 MHz; 8 megabyte of main RAM
`memory 40; an 80 megabyte disk storage hard drive 39; and
`50
`a 3.25 inch ?oppy drive. not shown. The computer 32 also
`has a video section 42 which includes two video capture!
`display cards. here WIN-TV cards (here made by Haup
`pauge Computer Works. Inc.. 91 Cabot Court. Hauppauge.
`NY. 11788) WIN-1. WIN-2 cards. and a VGA graphics card
`44. Each of the WIN-l. WIN-2 cards has a pair of input ports
`A. B. Input port A is a VGA signal input port and input port
`B is a video signal input port. Each one of the WIN-1.
`WIN-2 cards produces a VGA signal at its output. A
`Targa.l6 graphics card 46. here made by True Vision. Inc..
`7340 Shadeland Station. Indianapolis. Ind. 46256. is
`included for capturing (in a bu?‘er memory. not shown. but
`included in the Targa.l6 card 46) and overlaying annotation
`and/or editing video images during a “Mark-up" mode. as
`will be described in detail hereinafter. An Elographic card
`48. here made by R10 Touch Systems (formally Elographic).
`105 Randolph Rd.. Oak Ridge. Tenn. 37830. is also included
`
`45
`
`55
`
`65
`
`Qomo_1009
`
`

`
`5
`HP) is supplied by the video selector 34 via line 54 in
`response to podium speaker 28 touch commands via the
`touch screen 27 to the elographic board 48. to be described
`Here. output port 377 is. typically. from a personal video
`camera 76 directed at the podium speaker 28 and fed to input
`port 351 When in the PIP mode. the podium speaker 28 is
`presented in a sub-region 53 of the “presentation" display
`area 60. in the “Main-screen” mode and a region of the
`display area 60' (FIG. 4) in the “Mark-up” mode and the
`“preview” display area 62.
`The video display section 26. here a touch screen VGA
`display 27. is driven by. and provides input to. the micro
`processor 38 via elographic board 48. The touch screen
`display 27. here a 15 inch. touch screen monitor. is used to
`display video to the podium speaker 28 and to provide touch
`control input for the computer 32. (It should be noted that the
`video conferencing system 10 operates in one of two pri
`mary video display modes. to be described; i.e.. a “Main
`screen” mode and a “Mark-up” mode. each with a different
`display on the VGA display 27. FIG. 2 shows the display 27
`in each mode. for convenience. it being understood that
`there is only one mode displayed on display 27 at any one
`time). The touch outputs from the display 26 are fed as
`inputs to the elographic board 48 within the computer 32 via
`line 41. Video source selection commands. input through the
`touch screen display 27 to the computer 32 via line 41. are
`used by the microprocessor 38 to provide a control signal to
`the video selector 34. via line 43. and to interface. or
`CODEC 30. via line 47. During the “Mark-up” mode. to be
`described. editing and/or annotation of the image in display
`27 may be performed by a graphic pen. not shown. or the
`?nger of the podium speaker 28.
`Referring now also to FIGS. 3 and 4. there are eight. “hard
`button” icons 521-528 disposed across the top of the touch
`screen display 27. These icons are called “hard buttons”
`because they are displayed during both primary operating
`modes of the system 10: during a “Main-screen" mode and
`during a "Mark-up” mode. to be described The “hard
`button” icons 521-528. as well as other touch screen display
`icons to be described. are designed in such a fashion that
`each corresponds to a de?ned area on the touch screen
`display 27 and when actuated by touch. indicates to the
`microprocessor 38 of computer 32. via elographic board 48.
`that the icon has been selected by such touch. The touch may
`be by the podium speaker 28 or a graphic pen. not shown.
`The eight “hard button" icons 521-52B are each individually
`marked with an icon representing an associated pop-up
`control screen function to be described. The “hard button”
`icons 521-528 are shown in FIGS. 3 and 4 for the “Main
`screen” mode and the “Mark-up” mode. respectively.
`As mentioned brie?y above. there are two primary oper
`ating modes used during a video conference: a “Main
`screen” mode and a “Mark-up” mode. Each of these modes
`will be described in detail hereinafter. Su?ice it to say here.
`however. that the “Main-screen" mode is entered on system
`power up. While the “Mark-up mode” also allows control of
`all video sources of the system 10. it also allows the podium
`speaker 28 to annotate and/or edit on top of any video image
`displayed on the touch screen display 27. as indicated in
`FIG. 4. The podium speaker 28 can switch between the
`“Main~screen” mode and the “Mark-up” mode at any time
`by touching the “Mode-switch”. “hard button” icon 528.
`here positioned at the top. far right of the touch screen
`display 27.
`Brie?y. the “Main-screen” mode is the main operational
`mode. It allows the podium speaker 28 to display. via touch
`icons on the touch control display 27. a selected one of a
`
`50
`
`55
`
`65
`
`5.767.897
`
`20
`
`25
`
`35
`
`6
`variety of video sources produced from. inter alia. the
`document camera 70. slide projector 66. VCR 68. etc.
`coupled to the input ports 351-358 of the video selector 34.
`as noted above. to both the near end 121 and far end
`audiences 121-12,, (FIG. 1) via interface. or CODEC 30.
`During the “Main-screen" mode (FIG. 3). the podium speak
`er’s podium mounted. video display touch screen 27 is
`divided into two half areas; a “presentation” display area 60
`which presents the image currently being sent to the video
`monitor 162 at the local site 121 and to monitors 161 at the
`remote sites 12,42"; and. a “preview” display area 62.
`which provides an image for private viewing by the podium
`speaker 28 of the next video image which can be seen by the
`audience. It is noted that the icon video signals presented in
`the “presentation” display area 60 and the “preview” display
`area 62 are formed by the microprocessor 38 which sends
`icon video signals to the WlNl card via the VGA card 44.
`The video signal from the selected one of the video sources
`fed to input ports 351-358 for display in the “preview”
`display area 62 are fed to another input of the VVINI card.
`The WINI card combines the VGA card 44 output. fed to the
`VGA input port A of the WINl card. with the video signal
`at output port 373. fed to the input port B of the WlNl card.
`to provide a VGA signal at its output. The VGA output of the
`WINl card is fed to VGA input port A of the WINZ card.
`Input port B of the WINZ card coupled to video signal at
`output port 372. The VGA output of the WINZ card is fed to
`the video display section 26 via line 51. as shown. Thus. the
`signal at the output of the WINl card includes both the icon
`display information and the “preview" display area infor
`mation. The output signal from the WIN2 card includes icon
`display information. “preview” display area information and
`“presentation” display area information. Thus. after the
`WlNl card “writes” the video signal at output port 373 in
`the. here blue. “preview” display area 62. the WIN2 card
`“writes” the video signal at output port 372 in the. here
`magenta. “presentation” display area 60. Thus. the WINZ
`card provides the image in the “presentation” display area
`60; and. the WlNl card provides the image in the “preview"
`display area 62.
`The “Mark-up” mode (FIG. 4) allows the podium speaker
`28 to annotate and/or edit. on top of the image being sent to
`the local and remote sites 121 to 12". In this mode. there is
`only one display area. the “presentation” display area 60’
`which. during the “Mark-up” mode occupies about 3/5 of the
`total display region. That is. the “Mark-up” display area 60'.
`is very similar to. but larger than. the “presentation” display
`area 60 used in the “Main-screen” mode. i.e. it is essentially
`like the “Main-screen" mode without any next image pre
`view capability. In this. “Mark-up” mode. provisions are
`made to sequence through images or slides from a selected
`one of the video sources; but. there is no ability to preview
`them. Should preview be desired it is an easy matter to
`momentarily enter the “Main-screen" mode via a touch of
`the “Mode-Switch.” “hard button" icon 528 at the top far
`right of the display 27.
`The other “hard button" icons 521-527 disposed along the
`top of the display screen 27 in both the “Main-screen” mode
`and the “Mark-up” mode are mainly used before a video
`conferencing session to setup the user’s preferences and dial
`the call. These other “hard button” icons 521-527 are: “Dial
`Screen” 521; “Setup Screen” 52;; “Swap” 523; "S4000 PIP
`On/O?” 524; “Audio Mute” 525; “Volume Up" 526; and
`“Volume Down” 527. respectively. Brie?y. the “Dial Screen”
`521 allows the user to DiallHang-up call. and access/edit a
`phone book for a pop-up screen. not shown. The “Setup
`Screen" 522 is used to set user preferences and hardware
`
`Qomo_1009
`
`

`
`5,767,897
`
`7
`con?guration and to run diagnostics from a pop-up screen.
`not shown. The “Swap” 523 is used in a one monitor system;
`i.e.. when monitor section 16 has a single monitor. In such
`case. actuation of “Swap” 523 changes between a PIP. or
`small window image. typically of the local site video. on the
`one hand. and a larger window image on the other hand. The
`“S4000 PIP On/Oli" 524 turn the System 4000’s internal
`picture-in-picture (window) image on and 0E. The “Audio
`Mute” 525 turns Oif/On the local site 121 microphone. The
`“Volume Up” 526 increases local site 121 loudspeaker 18
`volume. The “Volume Down” 52, decreases site 121 room
`loudspeaker 18 volume. Once entered. any of the pop-up
`screens can be dismissed by pressing a “Hide” button. not
`shown. on the pop-up screen. not shown.
`Referring again also to FIG. 2. video source selection
`touch control areas 641. 642 in the “main-screen" mode. and
`a video source selection touch screen touch area 643 in the
`“Mark-up” mode. enable the podium speaker 28 to easily
`select one of a plurality of video devices. or video sources.
`such as slide camera 66. video cassette recorder (VCR) 68.
`document camera 70. the auxiliary (AUX) input. such an
`auxiliary camera 72 directed to blackboard 73 (FIG. 1). the
`personal camera 76. etc.. coupled to input ports 351-358.
`There is also a touch control icon. to be described. for
`accessing video images previously saved to the PC's hard
`drive 39. or a disk. as Targa (.TGA) ?les and fed. via Targa
`card 46. through PIP unit 36 to input port 355 of selector or
`CODEC 30', i.e.. graphic input port 355. That is. the output
`of PIP unit 36 on line 74 is considered as a graphic video
`source 74. A multipoint site selection control section 80.
`displayed in the “Main-screen" mode. FIG. 3. has a number
`of text labeled site selection icons. to be described. in section
`80.. and another site selection section 802.
`In general then. the purpose of the “Main-screen” mode is
`to facilitate podium speaker 28 presentation by enabling
`him/her to select from. and sequence through. video sources
`66-76. or video cameras 14 at sites 12,42". while the
`“Mark-up” mode enables the podium speaker 28 to edit.
`mark-up. annotate. etc.. the video provided from a selected
`one of the video sources 66-76.
`"Main-screen” Mode
`As noted above. the “Main-screen" mode is directly
`entered when the system powers up and is the podiurn’s
`basic control mode. The features implemented in the “Main
`screen" mode are: Multipoint site selection and manage
`ment; Point and View camera positioning; Personal PIP;
`Touch screen video source selection control; PC slide pre
`sentation Control; PC slide storage and ?lenaming; Inte
`grated main camera (i.e.. an “Instructor/Presenter" mode. to
`be described); document (DOC) camera; and 35 millimeter
`(mm) video slide projector control. The “presentation" and
`“preview” display areas 60. 62 are simultaneously displayed
`on the touch screen display 27 during the “Main-screen”
`Mode. That is. referring to FIG. 3. the “Main-screen” mode
`breaks the presenter's podium display 27 into ?ve basic
`areas: the “preview” display area 62. or window. on the left;
`the “presentation” display area 60. or window. on the right;
`a site selection area 80 disposed along the bottom of the
`“presentation” display area 60 and “preview” display area
`62; a video source selection area 64'. and. a video source
`control area 81 directly under the “presentation” and “pre
`view" display areas 60. 62. as shown. Video source selection
`area 64 appear in two separate regions 641. 642: i.e.. region
`'5‘. is disposed beneath the “presentation” display area 60 to
`select any one of the plurality of video sources 66-76 at any
`time for distribution to the local and remote sites 121-12";
`
`20
`
`35
`
`45
`
`50
`
`55
`
`65
`
`8
`and. region 642 is disposed beneath the “preview” display
`area 62 to allow the podium speaker 28 to select any one of
`the plurality of video sources 66-76 at any time for his/her
`private viewing in the “preview” display area 62. A “transfer
`button". or icon. 84 is located between the “preview" and
`“presentation” display areas 60. 62.
`The video source icons in each of the areas 641. 642. are:
`an “Instructor/Presenter icon 86; a “Slide Projector” icon 88;
`a “Document” icon 90; a “VCR” icon 92; a “PC Storage”
`icon 94; and an Auxiliary Video" (i.e.. AUX) icon 96. As
`noted above. the “presentation” display area 60 is added to
`the VGA image using the WIN2 card. and the “preview”
`display area 62 is added to the VGA image using the WINl
`card. The image can be selected for either one of the display
`areas 60. 62 from one of a plurality of video sources 66-76
`coupled to the input ports 351-358 of the video selector 34
`via the touch icons in areas 641. 642. respectively. on the
`display 27. However. in order to add annotation to the
`signals fed to the WIN2 card during the “Mark-up” mode. to
`be described. rather than have the video signals at input ports
`352-358 pass directly to output port 372. an “indirect rout
`ing” path is used where video signals are routed through the
`video selector 34 in two sequential passes. More
`particularly. during a ?rst pass. the signals at input ports
`352-354. 356-353 are ?rst coupled to output port 375 for
`Targa board 46 to have superimposed thereon annotation and
`for storage and retrieval of graphic images from hard drive
`disk 39; the composite signal produced then being fed to
`input port 355 for a second pass through the video selector
`34 to the WIN2 card at output port 372. The signal at input
`port 357 is also fed to the DOC output port 376 for distri
`bution by CODEC 30 to the video monitor 162 at local site
`121. and the video monitors 162 at the remote site