(19) United States
`(12) Patent Application Publication (10) Pub. N0.: US 2005/0036509 A1
`(43) Pub. Date:
`Feb. 17, 2005
`Acharya et al.
`
`US 20050036509A1
`
`(54) WIRELESS PRESENTATION SYSTEM
`
`Publication Classi?cation
`
`(76) Inventors: Shrikant Acharya, Fremont, CA (US);
`Shrinath Acharya, Fremont, CA (US);
`John E. Crosbie, Fremont, CA (US);
`Shiro Ninomiya, Fremont, CA (US)
`
`Correspondence Address:
`BRINKS HOFER GILSON & LIONE
`PO. BOX 10395
`CHICAGO, IL 60610 (US)
`
`(21) Appl. No.:
`
`10/859,653
`
`(22) Filed:
`
`Jun. 2, 2004
`
`Related US. Application Data
`
`(60) Provisional application No. 60/475,751, ?led on Jun.
`3, 2003.
`
`(51) Int. CI.7
`
`H04J 3/22; H04L 5/22; H04Q 11/00;
`H04L 12/28; H04Q 7/20;
`H04B 7/14
`(52) us. Cl. ....................... .. 370/466; 370/467; 370/300;
`370/385; 370/401; 455/414.4;
`455/4322; 455/450; 455/20
`
`(57)
`
`ABSTRACT
`
`A system and method for interactive management of mul
`tiple Wireless devices (such as PDA’s or desktop or laptop
`computers) making graphical or video presentations While
`connected Wirelessly to a display device Whose Wireless
`module converts the transmitted data from the Wireless
`devices to the required format for display.
`
`j’
`221
`
`554:1
`
`PDA#2
`223/” USER B
`
`F Us???
`225/
`
`WIRELESS
`
`GRAPHICS
`ENGINE
`
`DISPLAY
`ENGINE
`
`310
`
`2_1_
`21_6
`CPU/
`WIRELESS
`MEMORY
`MODULE
`PROJECTOR #1
`
`Jr WIRELESS
`22-7
`DEVICES
`
`OTHER DISPLAY DEVICES
`
`r J
`
`WIRELESS
`DEVICES
`
`DISPLAY DEVICES
`
`N lo (3
`
`Page 1 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 1 0f 23
`
`US 2005/0036509 A1
`
`TRENDS
`
`151
`
`C)
`0
`
`125
`
`‘r129
`
`49
`
`145
`
`150”
`
`:2 LAN
`
`148
`
`FIG. 1
`
`Page 2 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 2 0f 23
`
`US 2005/0036509 A1
`
`53$‘;
`
`PDA#2
`USER B
`
`L/bFfSTEféP :1
`
`J
`221
`
`223’
`
`225/
`
`M
`22
`GRAPHICS - DISPLAY
`ENGINE
`ENGINE
`
`1210
`
`21s
`216
`WRELEss — _CPU/
`MODULE
`MEMORY
`PROJECTOR #1
`
`WIRELESS
`
`J WIRELESS
`227
`DEVICES
`
`OTHER DISPLAY DEVICES
`
`’ J
`
`WIRELESS
`DEVICES
`
`DISPLAY DEVICES
`
`200
`
`FIG. 2
`
`Page 3 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 3 0f 23
`
`US 2005/0036509 A1
`
`310;
`
`330 ;
`
`USER CONNECTS TO A NETWORK
`i
`f USER IS PRESENTED WITH A LIST OF PROJECTORS AVAILABLE ON THE
`320
`NETWORQUSER MAY ALSO SPECIFY AN UNLISTED PROJECTOR
`i
`USER SELECTS A PROJECTOR
`i
`USER IS AUTOMATICALLY LOGGED IN AND CONNECTED TO THE
`SELECTED PROJECTOR
`i
`350; USER DISPLAYS GRAPHICS OR vIDEO ON THE SELECTED PROJECTOR
`i
`USER DISCONNECTS WHEN DONE
`
`J.
`340
`
`360;"
`
`4101"
`
`420f
`
`USER A CONNECTS TO A NETWORK
`i
`USER A IS PRESENTED WITH A LIST OF PROJECTORS
`i
`430; USER A SELECTS A PROJECTOR AND IS AUTOMATICALLY LOGGED IN
`V
`USERA DISPLAYS GRAPHICS OR vIDEO
`i
`USER B SELECTS THE SAME PROJECTOR
`i
`IF USER B CONNECTS, USERA IS DISCONNECTED
`
`440;
`
`450;
`
`460;
`
`FIG. 4
`
`Page 4 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 4 0f 23
`
`US 2005/0036509 A1
`
`510T
`
`540;"
`
`550 r
`
`USER A IS PRESENTED WITH A LIST OF PROJECTORS BY HIS
`WIRELESS DEVICE
`I
`520; USER A SELECTS A PROJECTOR AND IS AUTOMATICALLY LOGGED IN
`I
`530 ; USER A SELECTS "OTHER IvIuST REQUEST PERMISSION" oPTIoN
`I
`USERA DISPLAYS GRAPHICS OR VIDEO
`I
`USER B SELECTS THE SAME PROJECTOR
`I
`560;“ USER A IS INFORMED THAT USER B WANTS TO USE THE PROJECTOR
`I
`
`USER A MAY EITHER:
`
`(A) GIVE CONTROL TO USER B. USERA IS THEN DISCONNECTED.
`
`(B) REFUSE TO GIVE CONTROL TO USER B.
`
`(C) PUT USER B ON HIS "ALWAYS REFUSE" LIST.
`USER A CAN OPTIONALLY INCLUDE A MESSAGE (EG.:
`"I DON'T THINK THIS IS THE PROJECTOR YOU WANT")
`
`(D) NOT RESPOND. CONTROL IS TRANSFERRED
`TO USER B AFTERA SPECIFIED RESPONSE TIME
`(EG. 30 SECS), AND USERA IS DISCONNECTED.
`I
`IF USER B GAINS CONTROL OF THE PROJECTOR, THEN USER B
`RETAINS CONTROL UNTIL SELECTING "DISCONNECT" OR ANOTHER
`USER IS GIVEN CONTROL
`
`1.
`580
`
`FIG. 5
`
`Page 5 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 5 0f 23
`
`US 2005/0036509 A1
`
`610'"-
`
`6301'
`
`USER A IS PRESENTED WITH A LIST OF PROJECTORS BY THE
`WIRELESS DEVICE
`I
`620 I‘ USER A SELECTS A PROJECTOR AND IS AUTOMATICALLY LOGGED IN
`I
`USER A SELECTS "BECOME MODERATOR" OPTION
`I
`f WHENEVER ANOTHER USER REQUESTS ACCESS TO THE PROJECTOR,
`THE NEW USER APPEARS ON USER A'S USER LIST
`640
`I
`USER A MAY SELECT WHICH USER FROM THE USER LIST CAN SEND
`IMAGES TO THE PROJECTOR
`I
`EACH ADDITIONAL USER IS PRESENTED WITH A DIALOG SHOWING:
`
`650II
`
`660;
`
`CURRENT STATUS (LIVE OR WAITING)
`
`THE ID OF THE MODERATOR (USER A)
`
`A "REQUEST CONNECTION" BUTTON
`
`A"SEND MESSAGE TO MODERATOR" BUTTON
`I
`WHEN ANOTHER USER PRESSES THE "REQUEST CONNECTION"
`BUTTON, USER A'S USER LIST INDICATES THAT THE OTHER USER HAS
`REQUESTEDACONNECTION
`'
`I
`
`670f
`
`USER A MAY EITHER:
`
`680;-
`
`ALLOWANY USER TO USE THE PROJECTOR
`
`PASS MODERATOR STATUS TO ANY USER
`
`SEND A MESSAGE TO ANY USER
`
`SELECT TO BLOCK ALL MESSAGES FROM ANY USER
`I
`THE MODERATOR MAY ASSIGN MODERATORSHIP TO ANY USER.
`6901‘ THE USER MUST ACCEPT MODERATORSHIP TO BECOME MODERATOR
`FIG. 6
`
`Page 6 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 6 0f 23
`
`US 2005/0036509 A1
`
`?/IRELESS PRESENTER
`PRESS [BACK] TO RETURN.
`
`PROJECTOR NAME: MP3130
`PROJECTOR PASSWORD: FREMONT
`
`WIRED NETWORK
`IP ADDRESS:
`
`WIRELESS NETWORK
`IPADDRESS: 172.16.0.1
`WIRELESSNETWORK TYPE: AD-HOC
`NETWORK ID (SSID): HPPROJECTOR
`ENCRYPTION: NO
`WEP KEY:
`\ KEY INDEX:
`10_0
`
`FIG. 7
`
`\
`
`1
`
`Page 7 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 7 0f 23
`
`US 2005/0036509 A1
`
`[1 PROJECTOR SELECTOR
`ENTER THE INFORMATION FROM THE QUICK
`CHOICE>WIRELESS PRESENTER MENU ON THE
`PROJECTOR
`
`@ WIRELESS NETWORK
`
`O WIRED NETWORK [LAN]
`
`PROJECTOR NAME:
`
`MP3130
`
`PROJECTOR PASSWORD:
`
`fremont
`
`NETWORK ID [SSID]:
`
`HPPROJECTOR
`
`IEI IZI
`
`v
`
`v
`
`WIRELESS NETWORK TYPE: 0 INFRASTRUCTURE @AD-HOC
`
`IPADDRESSZ
`
`172.16.0.1
`
`Y
`
`FIG. 8
`
`Page 8 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 8 0f 23
`
`US 2005/0036509 A1
`
`
`
`
`
`mohomhommmI nVEO>>EZ - Emsm H1mm: - O0-0._.-mmFzwwmmn_ wwmjww=>> _H_
`
`
`
`
`
`
`
`
`
`._.omzzoo wwmmm Qz< mohomwomm <pomjmw
`
`
`
`
`
`A A A
`
`/ / /
`
`o8
`
`Page 9 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 9 0f 23
`
`US 2005/0036509 A1
`
`LOG ON TO PROJECTOR ABC
`
`[2]
`
`- A USER NAME AND PASSWORD IS REQUIRED -
`
`.
`USER NAME.
`
`.
`PASSWORD.
`
`/\\/ 1010
`m
`
`/"\\
`\/ 1020
`
`103O/\\,? REMEMBER MY PASSWORD
`
`Iiéééiiiji
`
`CANCEL
`
`PERSONAL SETTINGS
`
`- SETTINGS
`
`USER NAME:
`
`PASSWORD:
`
`/’_~\ 1110
`m
`/"\ 1 120
`
`1130/-\\,E| REMEMBER MY PASSWORD
`
`ADVANCED...
`
`I
`
`?ELP
`
`CANCEL
`
`1140 H6. 11
`
`Page 10 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 10 0f 23
`
`US 2005/0036509 A1
`
`LOGON ADVANCED OPTIONS
`
`USER NAME:
`
`PASSWORD:
`
`PROJECTOR NAME
`
`/ 1210 / 1220
`
`)
`
`/
`
`El
`
`IIP ADDRESS | TYPE
`
`/_/1230
`
`< l
`
`|
`
`| >
`
`
`
`LOGON AS ADMINISTRATOR ,
`
`?ELP
`
`1200
`
`[J
`
`— 1240
`
`FIG. 12
`
`Page 11 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 11 of 23
`
`US 2005/0036509 Al
`
`Smzzooma
`
`
`
`
`
`$2moeémomgm_>_8mmD
`
`mo5m_,oEmi»m$8<25m_zo>z<
`
`
`
`mo5m_8Em=._._.mmm8<OH20_mm=>_m_m_n_Emaomm5:2m%_Eo
`
`
`
`
`
`
`
`
`
`mmm_oo<mobmammmommamsomm._._<mmozgo
`
`(‘O
`?
`
`U.
`
`Page 12 0f41
`
`Page 12 of 41
`
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 12 of 23
`
`US 2005/0036509 A1
`
`Bmzzoomaz
`
`
`
`mozmmoozmzoommH
`
`I
`
`mo5m__,oEm_Emmm8<z<omzo>z<
`
`
`
`ozzzmmmwa_mESm
`
`
`
`
`
`'|m_>>£mjm:o_sEmm:-88Em:”moBm8ED
`
`
`
`moBm8Em=._.rmm_8<O»zO_mm_s_mmn_Emaomm52>.magic
`
`
`
`
`
`
`
`
`
`mmm8<moBm8EmomEmmaomm._._<E029o
`
`3.O_n_
`
`
`
`...Ez_.moEm_8E.5...$3me:
`
`
`
`mopémooz.u.__>_<z$8
`
`
`
`ooozamozz.._=._n_
`
`z<8s_9_mmsm
`
`
`
`m_>>m_._m._._m_._o_s_
`
`mamomo2:9.
`
`2&522¢
`
`Page 13 0f41
`
`Page 13 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 13 0f 23
`
`US 2005/0036509 A1
`
`1322 I
`PROJECTOR ACCESS
`
`1328
`
`a
`U BECOME MODERATOR
`
`ANYONE CAN ACCESS THIS PROJECTOR
`
`0 OTHERS MUST REQUEST PERMISSION TO ACCESS THE PROJECTOR
`
`O IGNORE ALL REQUESTS FOR PROJECTOR ACCESS
`
`1320
`
`FIG. 15
`
`PROJECTOR ABC IS IN USE BY JANE
`
`EI
`
`USER JANE IS CURRENTLY CONNECTED TO PROJECTOR ABC
`
`IF YOU CONNECT, THIS USER WILL BE DISCONNECTED
`
`CON NECT ANYWAY?
`
`[:1 DO NOT SHOW ME THIS MESSAGE AGAIN DURING THIS SESSION
`
`YES
`
`i
`
`NO
`
`FIG. 16
`
`HELP
`
`L
`
`Page 14 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 14 0f 23
`
`US 2005/0036509 A1
`
`PROJECTOR ABC - USER BOB
`
`[2]
`
`YOU ARE NOW CONNECTED. PRESS DISCONNECT WHEN DONE.
`
`YOU CAN HID THIS DIALOG BOX AND USE THE TRAY ICON FOR CONTROL.
`
`FQIééBIINEéTT
`
`i . _ _ _ _ _ _ _ _ _ . . . . _ _ _ _ . _ . -4
`
`_EREEZE FRAME
`
`I] OTHERS MUSTASK PERMISSION TO USE THIS PROJECTOR
`
`@ SHOW THIS DIALOG WHENEVER I CONNECT
`
`COMMAND CONSOLE
`
`HELP
`
`H_IDE
`
`1700
`
`FIG. 17
`
`PROJECTOR ABC
`
`IZI
`
`CONTROL HAS BEEN TRANSFERRED TO JIM.
`USE THE CONNECT SELECTION FROM THE TRAY ICON IF YOU WISH TO RECONNECT.
`
`, _ _ _ . . . . . . . . . _ _ _ _,
`
`Page 15 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 15 0f 23
`
`US 2005/0036509 A1
`
`1324
`\
`PROJECTOR ACCESS
`O ANYONE CAN ACCESS THIS PROJECTOR
`
`1328
`
`E] BECOME MODERATOR
`
`OTHERS MUST REQUEST PERMISSION TO ACCESS THE PROJECTOR
`
`Q IGNORE ALL REQUESTS FOR PROJECTOR ACCESS
`
`m
`
`FIG. 19
`
`PROJECTOR ABC IS IN USE
`
`IZI
`
`PROJECTOR ABC IS BEING USED BY JANE.
`
`WOULD YOU LIKE TO ASK IF YOU CAN CONNECT?
`
`OPTIONAL MESSAGE TO JANE:
`
`FIG. 20
`
`_—
`
`Page 16 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 16 0f 23
`
`US 2005/0036509 A1
`
`CONNECTION REQUEST FOR PROJECTOR ABC
`
`IZI
`
`YOU HAVE RECEIVED A REQUEST TO CONNECT TO THIS PROJECTOR FROM JIM.
`
`IF YOU DO NOT RESPOND WITHIN 1 MINUTE, JIM WILL BE GIVEN CONTROL.
`
`MESSAGE FROM JIM: MY TURN?
`
`ALLOW JIM TO CONNECT?
`
`OPTIONAL MESSAGE TO JIM:
`I
`
`I
`
`YES
`
`NO
`
`BLOCK USER...
`
`HELP
`
`PROJECTOR ABC - USER BOB
`
`2%
`
`2210
`( [2|
`
`YOU ARE NOW CONNECTED - PRESS DISCONNECT WHEN DONE.
`
`YOU CAN HIDE THIS DIALOG BOX AND USE THE TRAY ICON FOR CONTROL.
`
`DISCONNECT
`
`_F_REEZE FRAME
`
`IZII@THER'S'.IIIIST'ZISK.I§ERII.I§SKINiii.U??i?éf?élé?5K}
`E SHOW THIS DIALOG BOX WHENEVER I CONNECT.
`
`COMMAND CONSOLE...
`
`HELP
`
`HIDE
`
`FIG. 22
`
`-2-2°—°
`
`Page 17 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 17 0f 23
`
`US 2005/0036509 A1
`
`1324
`I
`PROJECTOR ACCESS
`O ANYONE CAN ACCESS THIS PROJECTOR
`
`[2| BECOME MQDERATOR
`
`OTHERS MUST REQUEST PERMISSION TO ACCESS THE PROJECTOR
`
`O IGNORE ALL REQUESTS FOR PROJECTOR ACCESS
`
`L22
`
`PROJECTOR ABC - USER BOB
`
`- USERS
`
`USER NAME
`
`IVID
`
`2440
`/
`\ Ill IE1 IE
`\
`-2442
`|ANN.l [GRANTACCESSI
`
`,
`
`2439/~\
`
`- MESSAGES
`
`El ANNOTATION / 2446
`El PASS MODERATORSHIP-J
`ITAKE CONTROL |
`—
`
`/\_-2450
`
`‘: _'2410
`
`§END
`x
`\
`
`?ELP
`
`?IDE
`
`\
`
`2420
`
`IDISQONNECTI SIMPLE VIEW BLOCK USER...
`
`_( ________________ 2
`
`,
`
`)
`247°
`
`I
`FIG. 24 246°
`
`00
`2i
`
`Page 18 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 18 of 23
`
`US 2005/0036509 A1
`
`¢_ImmE<En_o_>_mm<n_Dzo:<Ezz<_H_
`
`
`
`
`
`
`
`mmmo%._.wm_:Om_m
`
`owe»_H_
`
`
`
`.w$8<zo_._.<._.Ozz<oz<89>ofimmaommm><I30>
`
`
`
`._>_=.>mom:§maos_ozmmm_zoammmw_I._
`
`mafiamo55E
`
`om<mobm_.omn_
`
`mmmaammmmzauwm
`
`mmo<mmms_
`
`fl _
`
`Imm.O_n_
`
`Page 19 0f41
`
`Page 19 of 41
`
`
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 19 of 23
`
`US 2005/0036509 A1
`
`Emaomm_o_%<om
`
`
`
`mzO_._.<o_._n_n_<w_m=._._.Omo$__s_._.._mo$___>_<on_mmazw<2mE<Bzz<
`
`
`
`
`
`
`
`wzO:.<o_._n_n_<
`
`
`
`zOs_m<n_mm_m_>$%m
`
`
`
`wzO_._.<o_z3_>__>_oowzo:<o_z:_>_s_oowzo_Eo_z:_>_s_oomzo:<o_z:_>__>_oo
`
`
`
`
`
`
`
`I._.OOE:._mEoomamExoomn__\n_o.~E58a_EoH
`
`
`
`
`
`
`
`zosmézosmézosmzozosm_<o
`
`
`
`
`
`
`
`dzzsa<29dzzsé4oEz8dzzéoEam_zz<:oSE28
`
`
`
`
`
`mgmgmmNfi
`
`
`
`
`
`Eoomammmxoown=\n_o._.
`
`
`
`
`
`~mE:mm__>_<E4<o_m>EE>_E$>_E
`
`mm>_%
`
`mmom
`
`IEzmmxmE38
`
`mwmm
`
`Eosmz
`
`%_>_mn_mammo
`
`NKN$>_%
`
`Eosms_“.0
`
`%_>_mo
`
`Page 20 of 41
`
`Page 20 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 20 of 23
`
`US 2005/0036509 A1
`
`2700
`
`5
`
`CONNECTION MANAGER APPLICATION
`
`MIRROR
`DISPLAY
`DRIVER
`239
`
`NETWORK USER
`MANAGER
`
`STREAM BUFFER
`MANAGEMENT
`
`E)
`
`CLIENT CONNECTION
`COMPONENT
`
`2_7§9
`
`NETWORK TRANSPORT
`COMPONENT
`
`2_7§9
`
`OPERATING SYSTEM
`
`FIG. 27
`
`Page 21 Of41
`
`Page 21 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 21 of 23
`
`US 2005/0036509 A1
`
`.
`
`2871
`
`2873
`
`
`
`NETWORK USER
`MANAGER
` E
`
`
`
`SLIDE MANAGER
`
`2_35§
`
`CLIENT CONNECTION
`COMPONENT
`
` AN NOTATOR
`
`DECODER
`PRESENTATION
`2850
`
`2.8.1.4
`FILE READER
`““
`
`HARDWARE DISPLAY
`NETV‘é%Ff\AKPBF§’}§ETP°RT
`21.3.69
`
`ADAPTER
`
`
`
`E
`
` OPERATING SYSTEM
`
`
`FIG. 28
`
`Page 22 of 41
`
`2800
`j
`
`USER INTERFACE
`
`
`
`
`NETWORK
`NOTES
`USER
`CONTROL
`
`DISPLAY INFO DIALOG
`
`USER PREFERENCES
`
`Page 22 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 22 of 23
`
`US 2005/0036509 A1
`
`2900
`§
`
`2973
`
`2971
`
`MIRROR USER INTERFACE
`
`DISPLAY |N|=o D|ALoG
`
`NETWORK
`USER
`CONTROL
`2_Q§_l
`
`USER PREFERENCES
`
`NETWORK USER
`
`
`
`MANAGER E
`
`DISPLAY
`VIDEO
`CAPTURE
`ggg
`
`HARDWARE DISPLAY
`ADAPTER
`
`2.9%
`
`OPERATING SYSTEM
`
`CLIENT CONNECTION
`COMPONENT
`2_9§_0
`
`NETWORK TRANSPORT
`COMPONENT
`29%
`
`F’|(E5. 22$)
`
`Page 23 of 41
`
`Page 23 of 41
`
`

`
`Patent Application Publication Feb. 17, 2005 Sheet 23 of 23
`
`US 2005/0036509 A1
`
`E5m$m_m_>>m2&8vmom
`
`exmam.sm_s_
`
`H2%“:20
`
`
`
` EEE82magms:BoxmwaE7:om mmom
`
`2&8
`
`\|‘\\{I\J$8$8om.0_n_88
`
`
`
`Lmm885898.0,mmozao8eoz_Eozm_m58z_mz_._Wmmm8_E<~_o
`RRzo_EEzmeV:)88Mm$30“.>8gz<$§m_s_eamWmE>_mohas0m.2:_>Z.>om2&8wWasWmMmetmo__mo_mawe
`
`Page 24 of 41
`
`0%
`
`._.m_zmm_I._.m_
`
`
`
`
`
`ézwmbmoz>m<B$&:moo—awmvam
`
`Page 24 of 41
`
`
`
`
`
`
`
`

`
`US 2005/0036509 A1
`
`Feb. 17, 2005
`
`WIRELESS PRESENTATION SYSTEM
`
`PRIORITY CLAIM
`
`[0001] This application claims the benefit of U.S. Provi-
`sional Application No. 60/475,751, filed Jun. 3, 2003. The
`disclosure of the above application is incorporated herein by
`reference in its entirety.
`
`BACKGROUND OF THE INVENTION
`
`[0002]
`
`1. Technical Field
`
`[0003] This invention relates to computers, and more
`specifically to wireless computer communications.
`
`[0004]
`
`2. Related Art
`
`[0005] Portable computers have used a variety of periph-
`erals and software tools for the projection of presentations
`for viewing by an audience. One example is the use of a
`laptop computer connected to a liquid crystal display (LCD)
`projector to present a PowerPoint® document onto a pro-
`jection screen in a darkened room. The LCD projector may
`be aligned in the room so that its projected image is viewable
`to the audience. The projection is created by a variety of
`technologies, such as the passing of light through an LCD
`panel that selectively transmits monochrome or color pixels
`to form the projected image.
`
`[0006] Wireless devices capable of wireless data transmis-
`sion include laptop computers and handheld computing
`devices such as PDAs (Personal Digital Assistants) and
`cellular telephones. Relative to laptop computers, the advan-
`tage of PDAs is their smaller size, lower cost, and ease of
`portability. The PDAs disadvantage is that their screens are
`of low resolution, primarily intended for viewing by a single
`user, and that they have relatively slow microprocessors. A
`wired presentation solution for PDAs is Presenter-to-Go®
`by MARGI Systems® that provides a wired interface from
`the various I/O ports available on PDAs to the VGA port of
`display devices (e.g., projectors). Compressed data is trans-
`mitted into the PDA (from a personal computer) and de-
`compressed by the Presenter-to-Go® module which con-
`tains a graphic engine that allows high resolution graphics
`output. Thus PowerPoint® and anything printable from a PC
`(personal computer) application may be transmitted to be
`presented on the PDA for high resolution color presentation.
`The Presenter-to-Go® is a wired system and allows use by
`only one presenter at a time.
`
`SUMMARY
`
`[0007] Described herein are techniques and systems for
`connecting computing units such as laptops and PDAs with
`display units such as presentation projectors. These tech-
`niques and systems may be used in a display system that
`may be shared by a group of users, each of whom wishes to
`present video data on a shared digital projector, computer
`monitor, or other video display. The video data may include
`data for still
`images, or may include various types of
`information suitable for delivery to a video display, such as
`images, text, graphics, moving pictures, or presentations.
`
`[0008] The video data may be information usable purely
`for visual display. Additionally, the video data may also be
`audiovisual information, such as purely audio information or
`a mixture of audio and visual information. We note that the
`
`techniques described herein for a display system may be also
`adapted for purely audio implementations. Thus, the data
`provided by a controller may be used on a video display or
`on other audiovisual presentation devices, such as speakers,
`personal computers, home audio systems, cellular tele-
`phones, and other systems. Thus, the video data provided by
`a controller may be audio, video, graphics, still images,
`moving images, or other data types, or combinations thereof.
`The video data may include compressed or uncompressed
`content information, or rendering instructions, or telemetry
`information, or combinations thereof. Rendering instruc-
`tions include commands or other instructions for creating or
`displaying audio, graphics, video, or other audiovisual con-
`tent. Telemetry information includes maintenance informa-
`tion, such as the status of a projector bulb in a display
`projector, or upgrading software that may be loaded onto a
`display system.
`
`[0009] The various users may have a variety of different
`computing devices that connect with the video display, such
`as laptop computers, networked computers, or hand-held
`devices such as PDAs, cellular telephones, mobile tele-
`phones, audio receivers, wireless audio receivers, wireless
`speaker systems, or others. The computing devices may be
`networked or directly linked with the display system, and
`may be connected through wired links (such as Ethernet or
`USB connections) or wireless links (such as wireless Eth-
`ernet or Bluetooth® connections).
`
`[0010] One implementation of a shareable display system
`includes a video display, a data port, and a controller. The
`video display may be a video projector or other form of
`display device, such as an LCD monitor or a CRT monitor,
`and may use wired or wireless data connections between the
`controller and the video display. The video display may
`include more than one display device, which may be useful
`in situations where audiences may need more than one
`display device.
`
`[0011] Alternately, or in addition, the video display may
`be an interface that provides analog or digital video signals
`to one or more display devices. Accordingly, the display
`system may include a display device, or may be connectable
`to a display device, or may be configured so that it can be
`mechanically attached or piggybacked onto a display device.
`
`[0012] The data port is configured to receive video data
`through data links with two or more computing devices. The
`data links may be hard-wired network connections or wire-
`less connections. The controller may be coupled to the video
`display and to the data port, and may be configured to select
`video data for the video display from various video data sets
`available from the plurality of computing devices. The
`controller may arbitrate between video data received
`through the first and second data links.
`
`[0013] This arbitration may be performed in a variety of
`modes. For example, in a self-serve mode, users send video
`data to the shareable display system, and the shareable
`display system updates the display with the most recently
`received video data received. In a roundtable mode, a user
`must relinquish control over the display system before
`another user may send video data to be displayed. In a
`moderated mode, a single user moderates the sharing of the
`display system by other users.
`
`[0014] Other systems, methods, features and advantages
`of the invention will be, or will become, apparent to one with
`
`Page 25 of4l
`
`Page 25 of 41
`
`

`
`US 2005/0036509 A1
`
`Feb. 17, 2005
`
`skill in the art upon examination of the following figures and
`detailed description. It is intended that all such additional
`systems, methods, features and advantages be included
`within this description, be within the scope of the invention,
`and be protected by the following claims.
`
`[0033] FIG. 28 is a block diagram of one implementation
`of PDA slide presentation software.
`
`[0034] FIG. 29 is a block diagram of one implementation
`of mirroring software that may be used in a PDA.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0035] FIG. 30 is a block diagram of one implementation
`of a wireless module in a display device.
`
`[0015] The invention can be better understood with refer-
`ence to the following drawings and description. The com-
`ponents in the figures are not necessarily to scale, emphasis
`instead being placed upon illustrating the principles of the
`invention. Moreover, in the figures, like referenced numerals
`designate corresponding parts throughout
`the different
`views.
`
`[0016] FIG. 1 and FIG. 2 illustrate environments in which
`a display system is shared by several users.
`
`[0017] FIG. 3 is a flow chart illustrating a single-user
`mode for access to a display device.
`
`[0018] FIG. 4 is a flow chart illustrating a self-service
`multiple-user mode for access to a display device.
`
`[0019] FIG. 5 is a flow chart illustrating a roundtable
`multiple-user mode for access to a display device.
`
`[0020] FIG. 6 is a flow chart illustrating a moderated
`multiple-user mode for access to a display device.
`
`[0021] FIG. 7 shows an example of a settings summary
`700 that may be displayed by a shared display device.
`
`[0022] FIG. 8 shows an example of a selection and login
`interface 800 for connecting to a wireless network.
`
`[0023] FIG. 9 shows an example of a display-selection
`interface 900 for a user connecting to a shared presentation
`system on a wireless network.
`
`[0024] FIG. 10 illustrates an example of a user-login
`interface.
`
`[0025] FIG. 11 shows a dialog box for updating user login
`information on a display device.
`
`[0026] FIG. 12 shows a dialog box for an administrator to
`login to a shared display device.
`
`[0027] FIG. 13 and FIG. 14 show examples of a display-
`sharing interface for a user connected to a shared presenta-
`tion system.
`
`[0028] FIG. 15, FIG. 16, FIG. 17, and FIG. 18 illustrate
`examples of user dialog windows that may be implemented
`in a self-service multiple-user access mode.
`
`[0029] FIG. 19, FIG. 20, FIG. 21, and FIG. 22 illustrate
`examples of user dialog windows that may be implemented
`in a roundtable multiple-user access mode.
`
`[0030] FIG. 23, FIG. 24, and FIG. 25 illustrate examples
`of user dialog windows that may be implemented in a
`moderated multiple-user access mode.
`
`[0031] FIG. 26 is a block diagram of one implementation
`of an architecture for embedded software for a display
`system.
`
`[0032] FIG. 27 is a block diagram of one implementation
`of mirroring software that may be used in a laptop computer.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`[0036] FIG. 1 illustrates an environment 100 in which a
`display system is shared by several users. A projector 110
`may be shared by several users for projecting video onto a
`projection screen. The various users may control the pro-
`jector 110 through a variety of computing devices, such as
`laptop computers 125 and 129, a desktop computer 127, or
`PDAs 121 and 123. Other computing devices may also be
`used,
`including portable
`and non-portable
`computing
`devices. Portable devices include devices such as PDA’s,
`cellular telephones and other mobile telephones, and inte-
`grated devices such as palm-held computing devices with or
`without wireless telephone or network connectivity. The
`computing devices may connect to the projector 110 through
`a variety of links. In this illustration, the projector 110 is
`connected into a computer network through a wireless
`access point 150 through a wireless link 114. The wireless
`access point 150 also connects with four of the computing
`devices 121, 123, 125, and 127 through wireless links 141,
`143, 145, and 147, respectively. These wireless connections
`allow digital communications between these computing
`devices and the projector. Alternatively or additionally, a
`wired network connection may be used to provide commu-
`nications between computing devices and the projector 110.
`For example, desktop computer 127 has a wired connection
`148 with a wired local area network (LAN) 151. A wired
`connection 112 connects the projector 110 to the wired LAN
`151. The wired LAN 151 and the wireless access point 150
`may use coordinating protocols to manage communications
`among the various devices connected thereto. Alternatively
`or in addition, connections with the projector 110 may be
`made on an ad-hoc basis. For example, computing device
`129 communicates with the projector 110 through an ad-hoc
`network link 149.
`
`[0037] The display system may maintain a cached list of
`users that have previously logged in to the system. This
`cache may be stored in a memory in the display system, or
`may be stored on a server computer accessible through a
`network. The user’s computing devices may store a cached
`list identifying display systems onto which they have pre-
`viously connected, thereby facilitating reconnections in the
`future.
`
`To prevent unwanted users from gaining access to
`[0038]
`the video display, the display system may include authen-
`tication procedures for identifying users that connect to the
`display system. For example, at the start of a meeting, the
`video display may project a settings summary with connec-
`tion information for viewing by an audience. The connection
`information may include a wireless encryption passphrase or
`other password information, thereby enabling only audience
`members to connect to the display system. Alternatively, or
`in addition,
`the display system may maintain a list of
`approved users, who may then log into the display system.
`
`Page 26 of 41
`
`Page 26 of 41
`
`

`
`US 2005/0036509 A1
`
`Feb. 17, 2005
`
`[0039] The controller may include firmware stored in a
`memory and a processor for running the firmware. To
`increase versatility of the display system, the firmware may
`be configured to allow the display system to interface with
`a variety of computing devices running a variety of operat-
`ing systems, such as various versions of Windows®, Mac
`OS®, or Palm OS® operating systems, among others. The
`firmware may also be configured to accept uncompressed
`data or data compressed according to a variety of compres-
`sion protocols to create images for display. Compression
`formats that may be implemented include, for example,
`JPEG, GIF, TIFF, MPEG, WAV, run-length encoding, MP3,
`and AC3, among others. Alternatively, or in addition, the
`video data may use display instructions or graphics com-
`mands to compactly communicate video information. Other
`techniques for compressing, encoding, and transferring
`video data may also be implemented, such as, for example,
`approaches described in U.S. patent application Ser. No.
`09/746,841 for “INFORMATION TRANSMISSION AND
`DISPLAY METHOD AND SYSTEM FOR A HANDHELD
`
`COMPUTING DEVICE,” and in U.S. patent application
`Ser. No. 10/066,402 for “TRANSFER OF IMAGES TO A
`MOBILE COMPUTING TOOL,” the disclosures of which
`are hereby incorporated by reference herein in their entirety.
`
`[0040] The display system may include a memory-card
`interface that enables the display system to read video data
`from a
`removable memory,
`such as CompactFlash®
`memory, a SmartMedia® memory, or a USB memory stick,
`among others, and display images based on the data from the
`removable memory. The display system may include a
`network interface that enables the display system to read
`video data from an archive, or a server, or an internet
`address, or a data file accessible through the network con-
`nection.
`
`[0041] The display system may include interfaces and
`support for obtaining software updates over a computer
`network. A computer network may also be used to link the
`display system to other supporting tools, such as a database
`of users authorized to access the display system. Such a
`database may also be stored in a memory on the display
`system. Users may similarly store cached information that
`includes identifying characteristics of display systems onto
`which they have previously connected.
`
`Instead of (or in addition to) projecting images on
`[0042]
`a separate display, the display system may be configured to
`employ the users’ computing devices to display video. In
`this mode, the projected images are displayed on one or
`more users’ computing devices, which may be useful in
`situations where users can not view a single projected
`display. The display system may serve as a hub to which
`several users may connect their computing devices. The
`display system may then allow one of the users to project
`video onto the screens of one or more of the other users’
`
`computing devices.
`
`[0043] The display system may serve as a mirroring
`display for a user who sends video data to the display
`system. In this implementation, once a user gains access to
`the display system,
`the video display projects a copy of
`visual information that appears on the screen of the user’s
`computing device. Alternatively, the display system may be
`configured so that the video display serves as an extended
`monitor for the user, working in tandem with the screen of
`
`the user’s computing device. In this implementation, the
`video display may simulate an adjacent screen or an over-
`lapping screen that works in conjunction with the screen of
`the user’s computing device, and may allow contiguous
`cursor movement or scrolling between the screen of the
`user’s computing device and the video display. Still further,
`the video display may be implemented as a separate display
`tool, that displays video independently from the operation of
`the screen of the user’s computing device. These and other
`implementations may be combined so that a user may select
`among them in various operating modes.
`
`[0044] Various data-transfer protocols may be used in
`display systems that implement a display-mirroring func-
`tion. One protocol, for example, may involve “screen scrap-
`ing,” in which an entire screen image is captured on a user’s
`laptop computer or other computing device. The captured
`screen image may then be compressed and transmitted to the
`display system, where it is received, decoded, and displayed.
`Depending on the performance characteristics of the cap-
`turing computing device and the display system, this process
`may limit the frame rate that can be achieved by the display
`system.
`
`[0045] A data-transfer protocol may also include an
`enhanced approach with conditional replenishment of the
`screen contents on a user’s laptop computer or other com-
`puting device, coupled with reducing the screen graphics
`into a set of GDI (Graphics Display Interface) commands
`that may be transmitted to the display system. The display
`system may then re-paint the screen onto the shared display
`device. While this enhancement may use more complicated
`procedures,
`it may also enhance the performance of the
`system by reducing a required channel capacity or increas-
`ing a refresh rate.
`
`[0046] By only updating the changed areas on the screen,
`the data-transfer protocol may reduce the amount of update
`data that has to be sent across a wireless conduit between a
`
`user’s computing device and the display system. A GDI
`engine may be installed on the user’s computing device. The
`GDI interface may be configured to understand the com-
`mands of the user’s computing device,
`thereby largely
`eliminating the need to transmit actual images over a wire-
`less link to the display system. Instead, the GDI interface
`may perform GDI trapping. The GDI interface may harvest
`graphics commands or instructions being used on the user’s
`computing device, and may send those commands or
`instructions to the display system. Exceptions may occur
`when a certain figure or area would require an excessive
`amount of trapped GDI commands to be transmitted. In such
`situations,
`the data-transfer protocol may transfer regular
`graphics information:
`the area may be converted into a
`bitmap or other graphics element and transmitted to the
`display device.
`
`If a user’s computing device has sufficient process-
`[0047]
`ing capability (for example, if the user’s computing device
`is a sophisticated laptop computer), a GDI trap may be
`created on the user’s computing device. The GDI trap may
`capture all the commands provided to the user’s display
`hardware, and transmit these commands to the shared dis-
`play system. If the GDI engines match on the user’s com-
`puting device and on the shared display system, then the
`trapped commands may enable the shared display system to
`replicate the display on the user’s computing device. In
`
`Page 27 of 41
`
`Page 27 o