(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2003/0039340 A1
`(43) Pub. Date:
`Feb. 27, 2003
`Deshpande et al.
`
`US 20030039340A1
`
`(54) ADAPTIVE INSTANT MESSAGING
`
`(75) Inventors: Nikhil M. Deshpande, Beaverton, OR
`(US); Jay G. Gilbert, Portland, OR
`(US); Todd D. Harrison, Beaverton,
`OR (US)
`
`Correspondence Address:
`Schwegman, Lundberg,
`Woessner & Kluth, P.A.
`PO. Box 2938
`Minneapolis, MN 55402 (US)
`
`(73) Assignee: Intel Corporation
`
`(21) Appl. No.:
`
`09/938,778
`
`(22) Filed:
`
`Aug. 24, 2001
`
`Publication Classi?cation
`
`(51) Int. Cl.7 .................................................. .. H04M 11/00
`(52) US. Cl. ........................................................ .. 379/8816
`
`ABSTRACT
`(57)
`A method, apparatus, and system for communicating an
`instant message Where the destination of the instant message
`may select Whether to receive the instant message as text or
`speech independent of the origin of the instant message.
`
`H110
`INSTANT MESSAGING SERVER
`
`100
`/
`
`120-1
`
`NEIWORK
`
`120-2
`
`IIEIwORK
`
`ORIOIII
`CUENT DEVICE
`
`140-1
`sIORACE
`
`\\
`
`19°“
`CONTROLLER
`
`,J
`
`130-1
`135"
`
`PROCESSOR 1
`
`125-1
`1Ex1-1O-sPEECII__
`COIIVERIER
`110-1
`sPEECII-IO-IExI__
`CONVERTER
`
`180-1
`145-1
`,1
`
`DEsIIIIAIIOII
`CUENT DEVICE
`
`130-2
`,1
`H1354
`
`PROOEssOR -
`
`140-2
`\,\
`sIORAOE
`
`‘EO'Z
`
`195-2
`TEXT-T0—SPEECH__
`COIIVERIER
`
`CONTROLLER
`
`‘ 110-2
`
`SPEECH—TO—TEXT__
`COIIVERIER
`
`180-2
`145-2
`
`J50-1
`
`IIEIwORK _
`
`ADAPTER
`
`150-2
`
`IIEIwORK _
`
`ADAPIER
`
`INPUT DEVICE
`
`1554
`,J
`
`IIIPIII DEVICE
`
`1554
`
`OUTPUT DEVICE -
`
`OUTPUT DEVICE -
`
`
`
`Page 1 of 9
`
`Samsung Exhibit 1036
`
`

`

`Patent Application Publication Feb. 27, 2003 Sheet 1 0f 3
`
`US 2003/0039340 A1
`
`lNSTANT MESSAGING SERVER
`
`100
`
`/
`
`120-2
`
`NEIVIDRR
`
`DESTINATION
`CUENT DEVICE
`
`140-2
`\\
`mm
`
`130-2
`,J
`)35-2
`
`PROCESSOR -
`
`[95-2
`
`_ TExT-T0-sREECR__
`‘9° 2
`CDNVERTER
`
`CONTROLLER
`
`‘ 130-2
`
`sPEECII-T0-TExT__
`CDNVERTER
`
`180-2
`145-2
`,_/
`
`120-1
`
`NEIWORK
`
`DRICIN
`CIIENT DEVICE
`
`140-1
`STORAGE
`
`\
`
`r/
`
`150-1
`J35"
`
`PRocEssoR -
`
`195-‘
`
`_ TExT-T0-sPEECII__
`1,90‘
`CDNVERTER
`CONTROLLER
`110-1
`sPEECII-T0-TExT__
`CONVERTER
`
`180-1
`145-1
`,.1
`
`0150-1
`
`NETWORK _
`
`ADAPTER
`
`[1150-2
`
`NETw0RI<
`
`ADAPTER
`
`__
`
`lNP UT DEVICE
`
`1554
`,J
`
`DDTRDT DEVICE -
`
`INPUT DEVICE
`
`155-2
`,./
`
`OUTPUT DEVICE -
`
`FIG. 1
`
`Page 2 of 9
`
`

`

`Patent Application Publication Feb. 27, 2003 Sheet
`2 0f 3
`
`US 2003/0039340 A1
`
`215
`
`CONVERT THE INPUT
`SPEECH T0 TEXT
`
`YES
`
`200
`
`210
`
`IS A SPEECH
`OPTION SELECTED AT
`THE ORIGIN CLIENT
`DEVICE’?
`
`220
`
`SEND THE TEXT
`INSTANT MESSAGE
`
`299
`
`FIG. 2
`
`Page 3 of 9
`
`

`

`Patent Application Publication Feb. 27, 2003 Sheet 3 0f 3
`
`US 2003/0039340 A1
`
`m 300
`
`305
`
`RECEIVE A TEXT
`INSTANT MESSAGE
`
`315
`
`IS THE
`DESTINATION
`CLIENT DEVICE'S SPEECH
`OPTION
`SELECTED?
`
`CONVERT
`TEXT—TO—SPEECH
`
`DISPLAY THE
`TEXT MESSAGE
`
`33D
`,4
`
`325
`[.1
`
`PLAY THE
`SPEECH MESSAGE
`
`@599
`
`FIG. 3
`
`Page 4 of 9
`
`

`

`US 2003/0039340 A1
`
`Feb. 27, 2003
`
`ADAPTIVE INSTANT MESSAGING
`
`FIELD
`
`[0001] This invention relates generally to communication
`betWeen computing devices and more particularly to instant
`messaging betWeen computing devices in a network.
`
`COPYRIGHT NOTICE/PERMISSION
`
`[0002] Aportion of the disclosure of this patent document
`contains material that is subject to copyright protection. The
`copyright oWner has no objection to the facsimile reproduc
`tion by anyone of the patent document or the patent disclo
`sure as it appears in the Patent and Trademark Of?ce patent
`?le or records, but otherWise reserves all copyright rights
`Whatsoever. The folloWing notice applies to the softWare and
`data as described beloW and in the draWings hereto: Copy
`right© Intel, Incorporated, 2001. All Rights Reserved.
`
`BACKGROUND
`
`[0003] When computer netWorks, such as the Internet, ?rst
`began, users sent electronic mail (email) to each other. Email
`is passed betWeen nodes in a netWork using a “store-and
`forWard” technique Where an email is stored at a node in a
`netWork until a short-lived connection is established to the
`neXt node, at Which time the email is passed along. Even
`tually, after traveling through possibly multiple nodes, the
`email arrives at the destination node.
`
`[0004] But, users Wanted a faster Way to communicate
`more akin to talking, so noW instant messaging services are
`available that deliver messages faster than email and alloW
`teXt-based communication to occur in a rapid, conversa
`tional fashion. Whereas email is a store-and-forWard system
`based on short-lived connections, recipients listening for
`instant messages remain connected to their server on a
`long-lived connection. This long-lived connection alloWs
`instant messages to be delivered in close to real time.
`
`[0005] Another difference of some instant messaging sys
`tems from email systems is that instant messages are deliv
`ered to a recipient if the recipient is listening for messages
`and there are no obstacles to delivery. OtherWise, the mes
`sage is dropped, and the sender is informed of the delivery
`failure. Thus, in some instant messaging systems, messages
`are not queued or saved.
`
`[0006] A still further difference of instant messaging from
`email is that email is fundamentally built on one-Way
`message passing, While instant messaging systems are typi
`cally built on request-reply pairs. Many instant messaging
`services also include a presence function, Which enables the
`instant messaging system (and also other users) to knoW
`When a particular user is online.
`
`[0007] Yet another difference of instant messaging from
`email is that many instant messaging services have the
`concept of presence information. That is, the instant mes
`saging service and a user knoW When other users are
`connected. An eXample of an instant messaging service that
`does not have presence information is SMS (Short Message
`Service), Which provides the capability to send short mes
`sages to mobile digital phones.
`
`[0008] Users may send and receive instant messages from
`and to a Wide variety of client computing devices. For
`
`eXample, laptop or notebook computers, desktop computers,
`mainframe computers, handheld computers, and PDAs (Per
`sonal Digital Assistants) are a feW of the possible client
`computing devices.
`
`[0009] Also, users may operate the client devices in a Wide
`variety of locations and circumstances. For eXample, one
`user might be in a meeting in a physical conference room
`and Wish to have a side conversation via instant messaging
`Without disturbing the other meeting participants. Another
`user might be alone in an automobile and Wish to have
`hands-free operation of instant messaging, With no concern
`for the instant messages bothering others.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0010] FIG. 1 depicts a block diagram of an embodiment
`of the invention.
`
`[0011] FIG. 2 depicts a ?oWchart of processing for a
`transmit instant-message function at an origin-client device,
`according to an embodiment of the invention.
`
`[0012] FIG. 3 depicts a ?oWchart of processing for a
`receive instant-message function at a destination-client
`device, according to an embodiment of the invention.
`
`DETAILED DESCRIPTION
`
`[0013] In the folloWing detailed description of eXemplary
`embodiments of the invention, reference is made to the
`accompanying draWings (Where like numbers represent like
`elements), Which form a part hereof, and in Which is shoWn
`by Way of illustration speci?c exemplary embodiments in
`Which the invention may be practiced. These embodiments
`are described in sufficient detail to enable those skilled in the
`art to practice the invention, but other embodiments may be
`utiliZed and logical, mechanical, electrical, and other
`changes may be made Without departing from the scope of
`the present invention. The folloWing detailed description is,
`therefore, not to be taken in a limiting sense, and the scope
`of the present invention is de?ned only by the appended
`claims.
`[0014] In the folloWing description, numerous speci?c
`details are set forth to provide a thorough understanding of
`the invention. HoWever, it is understood that the invention
`may be practiced Without these speci?c details. In other
`instances, Well-knoWn circuits, structures and techniques
`have not been shoWn in detail in order not to obscure the
`invention.
`
`[0015] FIG. 1 depicts a block diagram of instant messag
`ing system 100, according to an embodiment of the inven
`tion. Instant messaging system 100 includes instant-messag
`ing server 110, netWorks 120-1 and 120-2, origin-client
`device 130-1, and destination-client device 130-2. Although
`tWo client devices (130-1 and 130-2) are shoWn, in other
`embodiments any number of client devices may be present.
`
`[0016] Instant-messaging server 110 receives teXt mes
`sages across netWork 120-1 from origin-client devices, such
`as origin-client device 130-1, and forWards the teXt mes
`sages across netWork 120-2 to the appropriate destination
`client device, such as destination-client device 130-2.
`Instant-messaging server 110 may be a server computer.
`Instant-messaging server 110 may use any suitable instant
`messaging functions. Examples of instant-messaging serv
`
`Page 5 of 9
`
`

`

`US 2003/0039340 A1
`
`Feb. 27, 2003
`
`ers are those provided by AOL (America Online), Yahoo!,
`and Microsoft MSN Messenger Service, but any suitable
`instant-messaging server may be used. In another embodi
`ment, instant-messaging server 110 may be provided by a
`paging service. Instant-messaging server 110 may be imple
`mented using any suitable hardWare and/or softWare, such as
`a personal computer available from a number of vendors.
`But, other examples may be portable computers, laptop
`computers, mainframe computers, or any other suitable type
`of hardWare and/or softWare. The invention is not so limited.
`Instant-messaging server 110 may support any suitable
`instant messaging protocol. In an embodiment, instant
`messaging server 110 supports the Internet Engineering Task
`Force’s (IETF) Instant Messaging and Presence Protocol.
`
`[0017] Networks 120-1 and 120-2 can be any suitable
`netWork capable of supporting instant messaging. Although
`tWo netWorks (120-1 and 120-2) are shoWn, in other embodi
`ments any number of netWorks may be present and client
`devices may use the same netWork or different netWorks. In
`an embodiment, netWorks 120-1 and 120-2 may support
`Wireless communications. In another embodiment, netWorks
`120-1 and 120-2 may support hard-Wired communications,
`such as a telephone line or cable. Networks 120-1 and 120-2
`may support any appropriate protocol suitable for instant
`message. In an embodiment netWorks 120-1 and 120-2 are
`the Internet and support IP (Internet Protocol). In other
`embodiments, netWorks 120-1 and 120-2 may be a local area
`netWork
`or a Wide area netWork
`
`[0018] Origin-client device 130-1 includes processor 135
`1, storage device 140-1, netWork adapter 145-1, input device
`150-1, and output device 155-1, all communicatively
`coupled via bus 180-1. Origin-client device 130-1 may be an
`electronic computing device. Although origin-client device
`130-1 is shoWn and described as being the origin of instant
`messages, in another embodiment it may also be the desti
`nation of instant messages.
`
`[0019] Processor 135-1 represents a central processing
`unit of any type of architecture, such as a CISC (Complex
`Instruction Set Computing), RISC (Reduced Instruction Set
`Computing), VLIW (Very Long Instruction Word), or a
`hybrid architecture, although any appropriate processor may
`be used. Processor 135-1 executes instructions and includes
`that portion of client device 130-1 that controls the operation
`of the entire client device. Although not depicted in FIG. 1,
`processor 135-1 typically includes a control unit that orga
`niZes data and program storage in computer memory and
`transfers data and other information betWeen the various
`parts of the client device. Processor 135-1 may receive input
`data from input device 150-1 and netWork adapter 145-1,
`read and store code and data in storage device 140-1, and
`may present output data to a user via output device 155-1.
`Processor 135-1 also may transmit and receive packets of
`information across netWork 120-1 using netWork adapter
`145-1.
`
`[0020] Although origin-client device 130-1 is shoWn to
`contain only a single processor and a single bus, the present
`invention applies equally to client devices that may have
`multiple processors and to client devices that may have
`multiple buses With some or all performing different func
`tions in different Ways.
`
`[0021] Storage device 140-1 represents one or more
`mechanisms for storing data. For example, storage device
`
`140-1 may include read only memory (ROM), random
`access memory (RAM), magnetic disk storage mediums,
`optical storage mediums, ?ash memory devices, and/or other
`machine-readable mediums. Although only one storage
`device 140-1 is shoWn, multiple storage devices and mul
`tiple types of storage devices may be present. Further,
`although origin-client device 130-1 is draWn to contain
`storage device 140-1, the storage device may be distributed
`across other electronic devices.
`
`[0022] Storage device 140-1 contains controller 160-1,
`text-to-speech converter 165-1, and speech-to-text converter
`170-1, Which may include instructions capable of being
`executed on processor 135-1 to carry out the functions of the
`present invention. In another embodiment, some or all of the
`functions of the present invention may be carried out via
`hardWare in lieu of a processor-based system. Of course,
`storage device 140-1 may also contain additional softWare
`and data (not shoWn), Which is not necessary to understand
`ing the invention.
`[0023] Examples of text-to-speech converters and speech
`to-text converters that may be used in embodiments of the
`invention include IBM ViaVoice, Dragon Systems Naturally
`Speaking, and Lucent Technologies Compact PCI (Periph
`eral Component Interconnect) Speech Processing Board.
`But, any suitable speech-to-text and text-to-speech convert
`ers may be used, and the invention is not so limited.
`
`[0024] Bus 180-1 represents one or more busses (e.g., PCI,
`ISA (Industry Standard Architecture), X-Bus, EISA
`(Extended Industry Standard Architecture), or any other
`appropriate bus) and bridges (also termed bus controllers).
`[0025] Input device 150-1 is that part of origin-client
`device 130-1 that accepts input from a user. In an embodi
`ment, input device 150-1 may be a keyboard, but in other
`embodiments, input device 150-1 may be a pointing device,
`mouse, trackball, keypad, touchpad, touch screen, pointing
`stick, microphone, or any other appropriate input device.
`Although only one input device 150-1 is shoWn, in other
`embodiments any number of input devices of the same or of
`a variety of types may be present.
`
`[0026] Output device 155-1 communicates information to
`the user of origin-client device 130-1. Output device 155-1
`may be a cathode-ray tube (CRT) based video display Well
`knoWn in the art of computer hardWare. But, in other
`embodiments output device 155-1 may be replaced With a
`liquid crystal display (LCD) based or gas, plasma-based,
`?at-panel display. In still other embodiments, any appropri
`ate display device is used. In yet embodiments, a speaker
`that produces audio output may be used. Although only one
`output device 155-1 is shoWn, in other embodiments, any
`number of output devices of different types or of the same
`type may be present. In other embodiments, output device
`155-1 might not be present.
`
`[0027] NetWork adapter 145-1 facilitates communication
`betWeen origin-client device 130-1 and netWork 120-1.
`NetWork adapter 145-1 provides a user of origin-client
`device 130-1 With a means of electronically communicating
`information, such as instant messages, With a remote com
`puter, such as instant-messaging server 110. In addition, in
`another embodiment, netWork adapter 145-1 may support
`distributed processing, Which enables origin-client device
`130-1 to share a task With other devices linked to netWork
`
`Page 6 of 9
`
`

`

`US 2003/0039340 A1
`
`Feb. 27, 2003
`
`120-1. Although network adapter 145-1 is shown as part of
`origin-client device 130-1, in another embodiment they may
`be packaged separately. Although only one network adapter
`145-1 is shown, in other embodiments, multiple network
`adapters of the same or of a variety of types may be present.
`[0028] Origin-client device 130-1 may be implemented
`using any suitable hardware and/or software, such as a
`personal computer or other electronic computing device.
`Portable computers, laptop or notebook computers, main
`frame computers, handheld devices, PDAs (Personal Digital
`Assistants), telephones, cellular telephones, smart phones,
`two-way alphanumeric pagers, and network computers or
`Internet appliances are examples of other possible con?gu
`rations of electronic computing devices. The hardware and
`software depicted in FIG. 1 may vary for speci?c applica
`tions and may include more or fewer elements than those
`depicted. For example, other peripheral devices such as
`audio adapters, or chip programming devices, such as
`EPROM (Erasable Programmable Read-Only Memory) pro
`gramming devices may be used in addition to or in place of
`the hardware already depicted. Thus, an embodiment of the
`invention may apply to any hardware con?guration that
`supports instant messaging.
`[0029] Destination-client device 130-2 includes processor
`135-2, storage device 140-2, network adapter 145-2, input
`device 150-2, and output device 155-2, all communicatively
`coupled via bus 180-2. Destination-client device 130-1 may
`be an electronic computing device. Although destination
`client device 130-2 is shown and described as being the
`destination of instant messages, in another embodiment it
`may also be the origin of instant messages.
`
`[0030] Processor 135-2 represents a central processing
`unit of any type of architecture, such as a CISC (Complex
`Instruction Set Computing), RISC (Reduced Instruction Set
`Computing), VLIW (Very Long Instruction Word), or a
`hybrid architecture, although any appropriate processor may
`be used. Processor 135-2 executes instructions and includes
`that portion of client device 130-2 that controls the operation
`of the entire client device. Although not depicted in FIG. 1,
`processor 135-2 typically includes a control unit that orga
`niZes data and program storage in computer memory and
`transfers data and other information between the various
`parts of the client device. Processor 135-2 may receive input
`data from input device 150-2 and network adapter 145-2,
`read and store code and data in storage device 140-2, and
`may present output data to a user via output device 155-2.
`Processor 135-2 also may transmit and receive packets of
`information across network 120-2 using network adapter
`145-2.
`
`[0031] Although destination-client device 130-2 is shown
`to contain only a single processor and a single bus, the
`present invention applies equally to client devices that may
`have multiple processors and to client devices that may have
`multiple buses with some or all performing different func
`tions in different ways.
`
`[0032] Storage device 140-2 represents one or more
`mechanisms for storing data. For example, storage device
`140-2 may include read only memory (ROM), random
`access memory (RAM), magnetic disk storage mediums,
`optical storage mediums, ?ash memory devices, and/or other
`machine-readable mediums. Although only one storage
`device 140-2 is shown, multiple storage devices and mul
`
`tiple types of storage devices may be present. Further,
`although destination-client device 130-2 is drawn to contain
`storage device 140-2, in other embodiments storage device
`140-2 may be distributed across other electronic devices.
`
`[0033] Storage device 140-2 contains controller 160-2,
`text-to-speech converter 165-2, and speech-to-text converter
`170-2, which may include instructions capable of being
`executed on processor 135-2 to carry out the functions of the
`present invention. In another embodiment, some or all of the
`functions of the present invention may be carried out via
`hardware in lieu of a processor-based system. Of course,
`storage device 140-2 may also contain additional software
`and data (not shown), which is not necessary to understand
`ing the invention.
`
`[0034] Examples of text-to-speech converters and speech
`to-text converters that may be used in embodiments of the
`invention include IBM ViaVoice, Dragon Systems Naturally
`Speaking, and Lucent Technologies Compact PCI (Periph
`eral Component Interconnect) Speech Processing Board.
`But, any suitable speech-to-text and text-to-speech convert
`ers may be used, and the invention is not so limited.
`
`[0035] Bus 180-2 represents one or more busses (e.g., PCI,
`ISA (Industry Standard Architecture), X-Bus, EISA
`(Extended Industry Standard Architecture), or any other
`appropriate bus) and bridges (also termed bus controllers).
`[0036] Input device 150-2 is that part of destination-client
`device 130-2 that accepts input from a user. In an embodi
`ment, input device 150-2 may be a keyboard, but in other
`embodiments, input device 150-2 may be a pointing device,
`mouse, trackball, keypad, touchpad, touch screen, pointing
`stick, microphone, or any other appropriate input device.
`Although only one input device 150-2 is shown, in other
`embodiments any number of input devices of the same or of
`a variety of types may be present.
`
`[0037] Output device 155-2 communicates information to
`the user of destination-client device 130-2. Output device
`155-2 may be a cathode-ray tube (CRT) based video display
`well known in the art of computer hardware. But, in other
`embodiments output device 155-2 may be replaced with a
`liquid crystal display (LCD) based or gas, plasma-based,
`?at-panel display. In still other embodiments, any appropri
`ate display device is used. In yet embodiments, a speaker
`that produces audio output may be used. Although only one
`output device 155-2 is shown, in other embodiments, any
`number of output devices of different types or of the same
`type may be present.
`
`[0038] Network adapter 145-2 facilitates communication
`between destination-client device 130-2 and network 120-2.
`Network adapter 145-2 provides a user of destination-client
`device 130-2 with a means of electronically communicating
`information, such as instant messages, with a remote com
`puter, such as instant-messaging server 110. In addition, in
`another embodiment, network adapter 145-2 may support
`distributed processing, which enables destination-client
`device 130-2 to share a task with other devices linked to
`network 120-2. Although network adapter 145-2 is shown as
`part of destination-client device 130-2, in another embodi
`ment they may be packaged separately. Although only one
`network adapter 145-2 is shown, in other embodiments,
`multiple network adapters of the same or of a variety of
`types may be present.
`
`Page 7 of 9
`
`

`

`US 2003/0039340 A1
`
`Feb. 27, 2003
`
`[0039] Destination-client device 130-2 may be imple
`mented using any suitable hardware and/or software, such as
`a personal computer or other electronic computing device.
`Portable computers, laptop or notebook computers, main
`frame computers, handheld devices, PDAs (Personal Digital
`Assistants), telephones, cellular telephones, smart phones,
`tWo-Way alphanumeric pagers, and netWork computers or
`Internet appliances are eXamples of other possible con?gu
`rations of electronic computing devices. The hardWare and
`softWare depicted in FIG. 1 may vary for speci?c applica
`tions and may include more or feWer elements than those
`depicted. For eXample, other peripheral devices such as
`audio adapters, or chip programming devices, such as
`EPROM (Erasable Programmable Read-Only Memory) pro
`gramming devices may be used in addition to or in place of
`the hardWare already depicted. Thus, an embodiment of the
`invention may apply to any hardWare con?guration that
`supports instant messaging.
`
`[0040] As Will be described in detail beloW, aspects of an
`embodiment pertain to speci?c apparatus and method ele
`ments implementable on client devices. In another embodi
`ment, the invention may be implemented as a program
`product for use With a client device. The programs de?ning
`the functions of this embodiment may be delivered to a
`client device via a variety of signal-bearing media, Which
`include, but are not limited to:
`
`[0041] (1) information permanently stored on a non
`reWriteable storage medium (e.g., read only memory
`devices Within a client device such as CD-ROM
`readable by a CD-ROM drive;
`
`[0042] (2) alterable information stored on a reWrite
`able storage medium (e.g., a hard disk drive or
`diskette); or
`
`[0043] (3) information conveyed to a client device by
`a communications medium, such as through a com
`puter or telephone netWork accessed via netWork
`adapter 145-1 or 145-2, including Wireless commu
`nications.
`
`[0044] Such signal-bearing media, When carrying proces
`sor-readable instructions that direct the functions of the
`present invention, represent embodiments of the present
`invention.
`
`[0045] FIG. 2 depicts a ?oWchart of processing for a
`transmit instant-message function at origin-client device
`130-1, according to an embodiment of the invention. Control
`begins at block 200. Control then continues to block 210
`Where controller 160-1 determines Whether the speech
`option in origin-client device 130-1 is selected. When the
`speech option is selected, the user is to input speech via input
`device 150-1. If the determination at block 210 is true, then
`control continues to block 215 Where origin-client device
`130-1 converts the speech input to teXt using speech-to-teXt
`converter 170-1. Control then continues to block 220 Where
`the origin-client device 130-1 transmits the teXt to instant
`messaging server 110 over netWork 120-1 using netWork
`adapter 145-1. Control then continues to block 299 Where
`the function returns.
`
`server 110 over netWork 120-1 using netWork adapter 145-1.
`Control then continues to block 299 Where the function
`returns.
`
`[0047] FIG. 3 depicts a ?oWchart of the processing for a
`receive instant-message function at destination-client device
`130-2, according to an embodiment of the invention. Control
`begins at block 300. Control then continues to block 305
`Where destination-client device 130-2 receives a teXt instant
`message from instant-messaging server 110 across netWork
`120-2 via netWork adapter 145-2.
`
`[0048] Control then continues to block 315 Where con
`troller 160-2 determines Whether the speech option in des
`tination-client device 130-2 is selected. The speech option in
`destination-client device 130-2 is independent of the speech
`option in origin-client device 130-1, so that the origin user
`and the destination user may use different, or the same,
`speech options. If the determination at block 315 is true, then
`control continues to block 320 Where destination-client
`device 130-2 converts the received teXt message to speech
`using teXt-to-speech converter 165-2. Control then continues
`to block 325 Where controller 160-2 sends speech to output
`device 155-2, Which plays the speech for the user. Control
`then continues to block 399 Where the function returns.
`
`[0049] If the determination at block 315 is false, then
`control continues to block 330 Where controller 160-2 sends
`the teXt message to output device 155-2, Which displays the
`teXt message. Control then continues to block 399 Where the
`function returns.
`
`What is claimed is:
`1. A method, comprising:
`determining Whether a speech option is selected at an
`origin device; and
`When the speech option is selected, converting input
`speech to teXt and transmitting an instant message
`comprising the teXt.
`2. The method of claim 1, farther comprising:
`When speech is not selected at the origin device, receiving
`input teXt and transmitting the instant message, Wherein
`the instant message comprises the input teXt.
`3. The method of claim 2, further comprising:
`
`receiving the instant message;
`
`determining Whether a speech option is selected at a
`destination device; and
`When the speech option is selected at the destination
`device, converting the input teXt to speech.
`4. The method of claim 1, further comprising:
`
`receiving the instant message;
`
`determining Whether a speech option is selected at a
`destination device; and
`When the speech option is selected at the destination
`device, converting the teXt to speech.
`5. The method of claim 4, Wherein the speech option at the
`destination device is independent of the speech option at the
`origin device.
`6. A method, comprising:
`
`[0046] If the determination at block 210 is false, then
`control continues directly to block 220 Where controller
`160-1 transmits the input-text message to instant-messaging
`
`receiving an instant message at a destination-client
`device, Wherein the instant message comprises teXt;
`and
`
`Page 8 of 9
`
`

`

`US 2003/0039340 A1
`
`Feb. 27, 2003
`
`determining Whether a speech option at the destination
`client device is selected and if true converting the teXt
`to speech.
`7. The method of claim 6, Wherein When the determining
`operation is false, displaying the teXt.
`8. The method of claim 6, Wherein the speech option at the
`destination-client device is independent of a speech option at
`an origin-client device, Wherein the origin-client device
`originated the instant message.
`9. The method of claim 6, Wherein the instant message is
`received across a long-lived connection.
`10. A computing device, comprising:
`a teXt-to-speech converter to convert teXt in a received
`instant message to speech When a speech option is
`selected, independent of Whether a sender of the instant
`message performed speech input.
`11. The computing device of claim 10, further compris
`ing:
`a speech-to-teXt converter to convert speech to teXt in an
`instant message to be transmitted When the speech
`option is selected.
`12. The computing device of claim 9, Wherein the
`received instant message is received across a long-lived
`connection.
`13. The computing device of claim 9, Wherein the
`received instant message is received via a request-reply pair.
`14. An instant-messaging system, comprising:
`
`an instant-messaging server;
`
`a controller to determine Whether a speech option is
`selected at an origin-client device and to send an instant
`message to the instant-messaging server; and
`
`a speech-to-teXt converter to convert speech to teXt When
`the speech option is selected, Wherein the instant mes
`sage comprises the teXt.
`15. The instant-messaging system of claim 14, Wherein
`the instant-messaging server is to receive the instant mes
`sage on a long-lived connection.
`16. The instant-messaging system of claim 14, Wherein
`the instant-messaging server is to send the instant message
`to a destination-client device.
`17. The instant-messaging system of claim 14, Wherein
`the instant-messaging server is to drop the instant message
`When a destination-client device is not connected.
`18. The instant-messaging system of claim 14, further
`comprising:
`a destination controller to determine Whether a speech
`option is selected at a destination-client device; and
`
`a teXt-to-speech converter to convert teXt to speech When
`the speech option at the destination-client device is
`selected independent of the speech option at an the
`origin-client device.
`19. An instant-messaging system, comprising:
`
`an instant messaging server;
`an origin-client device, comprising:
`an origin controller to determine Whether an origin
`speech option is selected at the origin-client device
`and to send an instant message to the instant-mes
`saging server,
`a speech-to-teXt converter to convert speech to teXt
`When the origin-speech option is selected, Wherein
`the instant message comprises the teXt; and
`
`a destination-client device, comprising:
`
`a destination controller to determine Whether a desti
`nation-speech option is selected at the destination
`client device and to receive the instant message from
`the instant-messaging server, and
`
`a teXt-to-speech converter to convert the teXt to speech
`When the destination-speech option is selected.
`20. The instant-messaging system of claim 19, Wherein
`the origin-speech option is independent of the destination
`speech option.
`21. A signal-bearing medium comprising instructions,
`Wherein the instructions When read and eXecuted by a
`processo