`a2) Patent Application Publication 0) Pub. No.: US 2007/0112925 Al
`(43) Pub. Date: May 17, 2007
`
`Malik
`
`US 20070112925A1
`
`(54) AUDIO MESSAGE DELIVERY OVER
`INSTANT MESSAGING
`
`(60) Provisional application No. 60/382,106, filed on May
`21, 2002.
`
`(76)
`
`Inventor: Dale W. Malik, Dunwoody, GA (US)
`
`Publication Classification
`
`Correspondence Address:
`THOMAS, KAYDEN, HORSTEMEYER &
`RISLEY, LLP/
`BELLSOUTHI.P. CORP
`100 GALLERIA PARKWAY
`SUITE 1750
`ATLANTA, GA 30339 (US)
`Appl. No.:
`11/538,221
`Filed:
`Oct. 3, 2006
`
`Related U.S. Application Data
`
`(21)
`
`(22)
`
`(63)
`
`Continuation of application No. 10/223,903, filed on
`Aug. 19, 2002, now Pat. No. 7,123,695.
`
`(51)
`
`Int. Cl.
`(2006.01)
`GO6F 15/16
`(52) US. Che
`eceeessssssssnssnsssnsesssenesnsensssneeaneesees 709/206
`
`(57)
`
`ABSTRACT
`
`Onepreferred embodimentofthe present invention provides
`a system and method for sending instant messages having
`audio recordings. Briefly described,
`in architecture, one
`embodiment of the system, among others, includes a com-
`municationsclient of a user that is configured to generate an
`instant message having an audio recording and send the
`instant message having an audio recording to another user.
`Methods and other systems are also provided.
`
`
`jo
`
`
`
`THE VIM CLIENT OF THE SECOND
`USER GENERATES VOICE
`PROVIDE DESCRIPTIVE
`
`
`60
`RECORDING
`
`
`
`CAPTION
`465
`
` 425
`
`
`
` THE VIM CLIENT OF THE SECOND
`
`
`
`
`A FIRST USER AUTHORIZES A
`SECOND USER TO BE ABLE TO SEND
`
`A VOICE INSTANT MESSAGE TO THE
`FIRST USER
`410
`
`
`
`
`
`
`THE VIM CLIENT OF THE SECOND
`USER RECEIVES A REQUEST FROM
`THE SECOND USER TO SEND AN
`INSTANT MESSAGE TO THE FIRST
`
`
`USER WHOIS NOT PRESENT 420
`
`
`
` THE VIM CLIENT OF THE SECOND
`USER DETECTS THAT THE FIRST
`USER IS NOT PRESENT AND
`AVAILABLE
`
`
`
`USER CHECKSTO SEEIF IT IS
`CAPABLE OF GENERATING A VOICE
`RECORDING
`430
`
`CAPABLE?
`435
`YES
`
`
`
`
`
`THE VIM CLIENT OF THE SECOND
`
`USER INVITES THE SECOND USER
`
`TO SEND A VOICE INSTANT
`
`ESSAGE TO THEFIRST USER455
`
`
`AUTHORIZED?
`445
`
`
`
`THE VIM CLIENT OF THE SECOND
`USER CHECKSTO SEE IF THE
`
`
`SECOND USER IS AUTHORIZED TO
`LEAVE A VOICE MESSAGE FOR THE
`
`
`FIRST USER
`440
`
`i
`
`
`GENERATE VOICE
`
`INSTANT MESSACT
`
`STORE VOICE
`INSTANT MESSAGE
`UNTILFIRST USER IS
`PRESENT
`475
`
`ONLINE PRESENCE OF
`THE FIRST USER IS
`DETECTED
`480)
`
`
`VOICE INSTANT
`MESSAGE 1S
`
`DELIVERED TO VIM
`CLIENT OF THE FIRST
`USER
`48s
`
`
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 1
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 1
`
`
`
`Patent Application Publication May 17,2007 Sheet 1 of 9
`
`US 2007/0112925 Al
`
`WwW
`N—
`
`oO~_
`~
`
`a)‘ Soiraat
`
`130
`
`FIG.1(PRIORART)
`
`120
`
`145
`
`IM CLIENT
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 2
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 2
`
`
`
`Patent Application Publication May 17,2007 Sheet 2 of 9
`
`US 2007/0112925 Al
`
`INAITOWeav}<—_>POC
`
`INAYTOYeeave
`NAITOWeedVE
`LUVwOrid¢Old
`YHAUAS<rINFITIOWAave
`
`S0C
`
`
`
`IN&ITOwaddve
`
`007
`
`daddve
`
`UAATAS
`
`wadave
`
`SIZ
`
`)I
`0c
`
`£07
`
`INATTOWeddvl
`
`0¢
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 3
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 3
`
`
`
`
`
`
`Patent Application Publication May 17,2007 Sheet 3 of 9
`
`US 2007/0112925 Al
`
`320
`
`
`VIMCLIENTOFASECONDUSER
`
`325
`
`
`
`VOICERECORDER
`
`FIG,3
`
`330
`
`340
`
`A325
` VIMCLIENTOFAFIRSTUSER
`
`AUDIOPLAYER
`
`310
`
`SS
`
`oom
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 4
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 4
`
`
`
`Patent Application Publication May 17,2007 Sheet 4 of 9
`
`US 2007/0112925 Al
`
`
`AALLAIMOSACACIAOUd
`S9FNOLLdvO
`08h==6<daLoaLad
`
`dDOVSSHAINVLSNI
`
`SOIOAALVYANAD
`
`OrrWASNLSU
`CNOOUSFHLJOLNATIOWIAFHL
`
`O9PONICHOOAa
`
`
`
`SDIOASATLVYANADWASO
`
`
`AHLOLSDVSSIWLNYLSNIAOIOAVCNSOLTTEAVAdOLUASN
`GNOODASVSAZRIOHLNY
`UASNLSUV
`
`ADIOATIOLSCINOOSSFHLJOLNAITIOWIAFHL
`
`
`
`
`
`
`
`
`
`
`
`wasnSHLWOdADVSSHWADIOAVFAVATiaIavdvo
`
`
`
`
`
`
`
`
`
`OIFWISNLSU
`
`SQ
`oS
`
`+
`
`OL
`
`OchINdSdudLONSIOHAWASN
`
`
`
`CGNOOdSSHLdOLNAIIOWIAFHL
`
`
`
`WOddLSANOaVSHAISONYWASN
`
`NVCN@SGLWISNGNOOSAHL
`
`
`
`LSUldAHLOLJDVSSAALNVISNI
`
`AOWSSAWINVISNIWASNGNOOSSFHLSALIANIwasn
`
`
`
`JOYONASAadANTINOSeATAVTVAV
`
`
`
`SIWASNLSUTLINAINV.LSNIS30IOAVGNASOL
`
`=
`
`iyINdSauaS¥wasnLSUldTULOLADVSSA
`
`
`CNOOUSFHLAOLNATTIOWIAAHL
`
`LSdHFHLIVAL§LOaladwasn
`
`
`
`CNVLNASaadLONSIwasn
`
`
`
`WIAOLGAYAAITAGAHLJIdusOLSYOSH)DWaSsNn
`
`
`
`LSMIdFHLJOLNATIOOLCaZMIOHLNVSIYASNGNOOHS
`
`STADVSSAACNOOASHHLdOLNYITOWIAFHL
`
`
`
`LNV.LSNIADIOAOFONITIOOT
`
`—
`
`STMHSNLSaldAHL
`
`iCaZRIOHLNY
`
`Shr
`
`
`
`CNODASFHLdOLNATTOWIAAHL
`
`
`
`SI]LI4TISOLSHOSHOWAsSN
`
`ADIOAVONILVAANYDJOATdVdV9
`
`
`
`S8P
`
`vyDld
`
`SEP
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 5
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 5
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication May 17,2007 Sheet 5 of 9
`
`US 2007/0112925 Al
`
`500i
`
`PRESENCE STATUS OF VIM CLIENT OF
`FIRST USER CHANGES FROM OFFLINE TO
`ONLINE
`
`51
`
`MESSAGEIS PLAYED 30
`
`STORED VOICE INSTANT MESSAGEIS
`DELIVERED TO VIM CLIENT OF FIRST USER
`
`520
`
`VOICE RECORDINGIN VOICE INSTANT
`
`FIG. 5
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 6
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 6
`
`
`
`Patent Application Publication May 17,2007 Sheet 6 of 9
`
`US 2007/0112925 Al
`
`‘OTE
`
`W&LLSAS
`
`(S/O)
`
`019
`
`+09
`
`AYOWHN +—09
`
`wossaooud
`
`DONILVYAdO O@E
`IN@ITOWIA709
`
`
`
`809AOVANALNITVOOT
`
`9‘DIA
`
`LAdLNO/LNANI
`
`(s)a0IAda
`
`(o/D
`
`909
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 7
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 7
`
`
`
`
`
`
`
`Patent Application Publication May 17,2007 Sheet 7 of 9
`
`US 2007/0112925 Al
`
`oo,—4
`
`OE
`
`LN&ITIOWIA
`
`
`
`(ANOHdATIAOWD)
`
`UVTATTAO
`SHOMLAN
` AVMALVD
`AXOdad
`
`OSE
`
`ANOOUSVdOINAITIOWIA
`YHSN
`
`
`
`WACAOSAAAOIOA
`
`LOI
`
`wdsSnLSas¥dOLNATTOWIA
`
`UAAVTdOIGNV
`
`ANdnoWIA
`
`Ove
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 8
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 8
`
`
`
`
`
`
`
`Patent Application Publication May 17,2007 Sheet 8 of 9
`
`US 2007/0112925 Al
`
`Qo
`NN
`oo
`
`2Q©>
`
`SYSTEM4
`
`ye800
`
`\ VIMQUEUE VIMCLIENTOFAFIRSTUSER
`
`AUDIOPLAYER
`
`340
`
`310
`
`FIG.8
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 9
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 9
`
`
`
`Patent Application Publication May 17,2007 Sheet 9 of 9
`
`US 2007/0112925 Al
`
`A FIRST USER SUBSCRIBES TO A VOICE MESSAGING SYSTEM 919
`
`THE FIRST USER DESIGNATES THAT NEW VOICEMAIL RECORDINGS
`
`ARE TO BE FORWARDEDTO A VIM CLIENT 915
`
` NEW VOICEMAIL RECORDING FOR THE FIRST USERIS GENERATED
`
`
`TELEPHONE NUMBEROF ORIGINATOR OF VOICEMAIL RECORDING
`
`IS OBTAINED AND ASSOCIATED WITH THE VOICEMAIL RECORDING.
`
`
`
`
`
`
`
`A VOICE MESSAGING INSTANT MESSAGE CONTAINING A
`REFERENCE LINK IS GENERATEDAND FORWARDED TO VIM
`SERVER
`
`30
`
`A VOICE MESSAGING INSTANT MESSAGEIS SENT TO THE VIM
`CLIENT OF THE FIRST USER AND DELIVERED TO THE FIRST USER
`AS SOON AS THE FIRST USER IS PRESENT
`940
`
`VIM CLIENT OF THE FIRST USER RECEIVES THE VOICE MESSAGING
`INSTANT MESSAGE
`950
`
`REFERENCE LINK IS ACTIVATED
`
`ASSOCIATED VOICE RECORDINGIS INCLUDED IN A VOICE INSTANT
`MESSAGE AND SENT TO VIM CLIENT OF THE FIRST USER
`970
`
`VOICE RECORDING IS DELETED FROM VOICE MESSAGING SYSTEM
`
`VOICE INSTANT MESSAGEIS RECEIVED AND VOICE RECORDINGIS
`PLAYED
`990
`
`FIG. 9
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 10
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 10
`
`
`
`US 2007/0112925 Al
`
`May 17, 2007
`
`AUDIO MESSAGE DELIVERY OVER INSTANT
`MESSAGING
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`[0001] This application is a continuation of copending
`USS. utility application entitled, “Voice Message Delivery
`Over Instant Messaging,” having Ser. No. 10/223,903, filed
`Aug. 19, 2002, which is entirely incorporated herein by
`reference and which claims priority to U.S. provisional
`application entitled, “Integration of Instant Messaging and
`Computer Operating Systems,” having Ser. No. 60/382,106,
`filed May 21, 2002, which is entirely incorporated herein by
`reference.
`
`TECHNICAL FIELD
`
`[0002] The present invention is generally related to com-
`munications and, more particularly, is related to a system
`and method for relaying voice messages over a communi-
`cation network.
`
`BACKGROUND
`
`[0003] Presence and availability are terms used to describe
`a present ability of an individual to communicate. Presence
`is an ability of an individual to communicate in real time,
`and availability is the willingness of an individual to com-
`municate in real time. In communications, it is advantageous
`to know whether a potential recipient of a communication
`message is present and available, i.e., available to receive
`and respond to the message before initiating the transmis-
`sion of the message. By making the presence andavailability
`of individual users known before any communication is
`attempted, a realtime communications environmentis facili-
`tated that is more effective and less obtrusive than conven-
`
`tional communication mediums. Clearly, the communication
`message that is sent to an addressee that is known to be
`present and available is more likely to be received promptly
`than a conventional message. For example, often times,
`conventional telephone calls are forwarded to a person’s
`voicemail and are never returned.
`
`is one communication
`Instant messaging (IM)
`[0004]
`medium that employs presence and availability technology.
`An instant messaging network recognizes when a useris
`present” on the network. Accordingly, the network sends
`notification to other users (usually members of a “buddy
`list” or “contact list’) that are also logged on the network
`that the user is “present.” Further, instant messaging lets a
`user display custom status messagesto his “buddies” online
`about the user’s “availability.” For example, a user can
`specify his availability status as being “busy, not taking
`messages.” Therefore another user on the “buddylist” that
`is connected to the instant messaging network will be
`notified that although the user is present on the network, he
`is not available for receiving messages. Presence and avail-
`ability information is most useful when an individual shares
`his or her online status with a trusted group of users. A
`communication message sent to someone who is readily
`present and available is less obtrusive, when the addressee
`has made himself or herself available to the communication.
`
`[0005] An example ofa traditional “closed” instant mes-
`saging (IM) architecture is shown in FIG.1. Thetraditional
`IM architecture consists of a central IM server 105 con-
`
`nected to a numberof individual clients (110, 115, 120, 125,
`130, and 145) in a closed network. For example, to send an
`instant message from client 110 to client 145, IM client 110
`first connects with an IM server 105 using a proprietary
`protocol. For example, AOL® and Yahoo!® use ICQ. Once
`the IM client 110 is connected to the IM server 105, the user
`logs on by entering a user name and password. The IM client
`110 then sends the IM server 105 the connection informa-
`tion, such as the IP address and the number ofthe port
`assigned to the IM client and the name and IP address of
`everyonein the IM contactlist associated with the IM client
`110. An IM client may communicate directly with other IM
`clients if the IP addresses of these IM clients are known to
`
`the transmitting IM client. For convenience, the lines of
`communication between individual IM clients are not shown
`in FIG.1.
`
`[0006] The IM server 105 then creates a temporary file
`that contains the connection information for the IM client
`110 and for each IM client 115, 120, 125, 130, 145. Once the
`temporary files have been created, the IM server 105 checks
`the network to determine whether any IM client identified by
`the contact list associated with IM client 110 is currently
`logged into the system. If the IM server 105 finds any of the
`contacts logged onto the network, the IM server 105 sends
`a message back to the IM client 110 with the connection
`information for each IM client 115, 120, 125, 130, 145
`currently logged onto the network. When the IM client 110
`receives the connection information, the presence status of
`that particular IM client 115, 120, 125, 130, 145 is updated
`to “Online,” for example. The presencestatus is displayed to
`the user. At this point the user may select any IM client 115,
`120, 125, 130, 145 that is registered “Online,” at which point
`a dialog box will appear in which the user may enter text.
`Because the IM client 110 knows the IP address and port
`numberof the IM client 145, the messageis sent directly to
`the recipient IM client 145. The IM client 145 then receives
`the instant message and can respond. Once the IM sessionis
`complete the dialog box is closed, and the IM client 110 goes
`offline and sends a messageto the IM server 105 terminating
`the session. The IM server 105, in response to acknowledg-
`ing that
`the IM client 110 has logged off, generates a
`message to each of the IM clients 115, 120, 145 on the client
`list of IM client 110 indicating that IM client 110 is logged
`off the network.
`
`Jabber is an example of an “open”instant messag-
`[0007]
`ing architecture. Jabber, available from Jabber, Inc. of Den-
`ver, Colo., includes an IM system focusing on providing IM
`access to a user. Jabber includes an Extensible Markup
`Language (XML) open source server software that was
`developed by a community of developers over the Internet.
`Jabber allows communication among applications and sys-
`tems across platforms. Developers write additional modules
`to submit them back for possible incorporation into the
`Jabber software.
`
`[0008] A block diagram illustrating a prior art IM network
`that uses Jabber interoperable XML-based network archi-
`tecture is shown in FIG.2. Jabber is a real-time communi-
`
`cations platform based on open protocols whosearchitecture
`is based on the well-knownelectronic mail system. Because
`Jabber is based on the email system, the Jabber architecture
`contains distributed network servers, called Jabber servers
`215-217 and clients, known as Jabber clients 200-205 that
`receive and send messages to Jabber clients 200-205 con-
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 11
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 11
`
`
`
`US 2007/0112925 Al
`
`May 17, 2007
`
`nected to other Jabber server 215-217 on the Internet.
`However, unlike typical email systems, which are store and
`forward systems, Jabber delivers messages in real
`time
`because the Jabber server 215-217 knows whena particular
`Jabber client 200-205 is online and available. The Jabber
`architecture is based on client-server architecture and not on
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`a client-to-client architecture, as are most IM systems.
`Messages from Jabber client 200 to Jabber client 201 must
`pass through the Jabber server 215. Each Jabber client
`200-205 is attached to a local Jabber server 215-217. Each
`local Jabber server 215-217 receives information from one
`Jabber client 200-205 and transfers the information to
`another Jabber client 200-205 along with presence and
`availability information. Each local Jabber server 215-217
`functions independently from one another, and can commu-
`nicate with any other Jabber server 215-217 that is con-
`nected to the Internet as long as it has been identified, and
`predisposed to do so ahead of time. Each local Jabber server
`215-217 performs two functions: listening for and commu-
`nicating directly with Jabber client applications 200-205,
`and communicating with other Jabber servers 215-217. Each
`local Jabber server 215-217 consists of multiple components
`[0019] FIG.5isa flowchart describing the functionality of
`
`that separately handle individual functions with the Jabber
`a representative implementation of the voice message deliv-
`system.
`ery system of FIG.3.
`
`[0014] Manyaspects of the invention can be better under-
`stood with reference to the following drawings. The com-
`ponents in the drawingsare not necessarily to scale, empha-
`sis
`instead being placed upon clearly illustrating the
`principles of the present invention. Moreover, in the draw-
`ings, like reference numerals designate corresponding parts
`throughout the several views.
`
`FIG. 1 is a block diagram of a closed instant
`[0015]
`messaging architecture of the prior art.
`
`FIG. 2 is a block diagram of an open instant
`[0016]
`messaging architecture of the prior art.
`
`FIG. 3 is a block diagram of a voice message
`[0017]
`delivery system of one preferred embodimentofthe present
`invention.
`
`FIG. 4 isa flowchart describing the functionality of
`[0018]
`a representative implementation of the voice message deliv-
`ery system of FIG.3.
`
`In many instant messaging communications, if a
`[0009]
`user is not present to receive an instant message, the instant
`message canstill be sent and queuedin the IM server 105 or
`Jabber server 215-217 that is servicing the IM client of the
`user. The IM server will hold the message until the user is
`present again on the instant messaging network. In this
`manner, the instant message is delivered to the user as soon
`as the user is present on the instant messaging network.
`
`[0010] Today’s instant messaging services mostly focus
`on the storing of text instant messages in a queue for later
`delivery to the user once the user becomes present on the
`network. However, today’s service typically does not allow
`for non-text instant messages to be stored in a queuefor later
`immediate delivery. Thus, a heretofore unaddressed need
`exists in the industry to address the aforementioned defi-
`ciencies and inadequacies.
`SUMMARY
`
`invention
`[0011] Preferred embodiments of the present
`provide systems and methods for sending voice instant
`messages. Briefly described, in architecture, one embodi-
`ment of the system, among others, can be implemented as
`follows. A communicationsclient of a user is configuredto:
`generate an instant message having an audio recording and
`send the instant message having an audio recording to
`another user.
`
`[0012] The present invention can also be viewed as pro-
`viding methods for sending voice instant messages. In this
`regard, one embodiment of such a method, among others,
`can be broadly summarized by the following steps: gener-
`ating an instant message having an audio recording; and
`sending the instant message having the audio recording.
`
`[0013] Other systems, methods, features, and advantages
`of the present invention will be or become apparent to one
`with skill
`in the art upon examination of the following
`drawings anddetailed description.It is intended thatall such
`additional systems, methods, features, and advantages be
`included within this description and be within the scope of
`the present invention.
`
`FIG. 6 is a block diagram of an implementation of
`[0020]
`the VIM client in FIG. 3 using a general computer system.
`
`FIG. 7 is a block diagram of a voice message
`[0021]
`delivery system of one preferred embodimentofthe present
`invention.
`
`FIG. 8 is a block diagram of a voice message
`[0022]
`delivery system of one preferred embodimentofthe present
`invention.
`
`FIG. 9 is a flowchart describing the functionality of
`[0023]
`a representative implementation of the voice message deliv-
`ery system of FIG.8.
`
`DETAILED DESCRIPTION
`
`[0024] Depicted in FIG. 3 is a block diagram of one
`representative embodiment, among others, of a voice mes-
`sage delivery system 300. The voice message delivery
`system 300 includes a voice instant messaging (VIM)client
`310 of a first user, wherein the VIM client 310 is configured
`to receive and play a voice recording in a voice instant
`messageit receives from other users, such as a seconduser.
`Accordingly, a VIM client 320 of the second user is con-
`figured to generate a voice recording of the second user and
`include the voice recording in an instant message upon
`accepting a VIM invitation. A VIM invitation is a message
`that is transmitted by the VIM client 310 of the first user to
`the VIM client 320 of the second user, wherein the message
`invites or prompts the VIM client 320 of the second user to
`generate a voice recording for thefirst user.
`
`[0025] Each VIM client 310, 320 communicates with and
`receives presence status information from a VIM server 330
`via the Internet or some other communication network 325.
`
`The VIM server 330 may act as a single IM server 105 of
`FIG. 1 or a local IM server, such as a Jabber Server 215 of
`FIG. 2. The VIM server 330 monitors the presence infor-
`mation of the VIM clients, such as the VIM clientofthefirst
`user 310, and notifies a VIM client 310 of the presencestatus
`information of other VIM clients 320 and their associated
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 12
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 12
`
`
`
`US 2007/0112925 Al
`
`May 17, 2007
`
`users. Accordingly, the VIM server 330 includes the capa-
`bilities of conventional IM servers and the additional capa-
`bilities for handling VIM messagedelivery andstorage.
`
`[0026] For example, in one preferred embodimentof the
`invention, the first user designates contact parameters. The
`contact parameters are criteria on (a) whom a user wants to
`receive presence information about and (b) how a user wants
`to receive the presence information. Within the contact
`parameters, the first user may name the second user as a
`person about whom thefirst user wants to receive presence
`information about. Other information may also be contained
`in the contact parameters such as the instant messaging
`addresses of the people namedin the contactlist. The contact
`parameters are then stored in a centralized storage medium
`340 that is accessible by the VIM client 310 ofthe first user
`or the VIM server 330 depending upon the architecture of
`the instant messaging network.
`
`Inaclosed system (FIG. 1), the contact parameters
`[0027]
`are typically stored in a storage medium (not shown) thatis
`accessible by the VIM client 310, 320, such as an internal
`disk drive of a general purpose computer or the memory of
`a mobile device. Then, a copy of the contact parameters are
`given to the VIM server 330. In an open system (FIG. 2),
`however,
`the contact parameters are stored in a storage
`medium (not shown) accessible by the VIM server 330, such
`as an internal disk drive or a separate storage medium, such
`as a database. The VIM server 330 then forwards a copy of
`the contact parameters to the VIM client 310. Typically, the
`VIM client 310 knows from the contact parameters the
`names of the people that the first user wants to receive
`presence status information about. Accordingly, the voice
`message delivery system can be incorporated over many
`instant messaging configurations, such as peer-to-peer, with
`the VIM server 330 providing primarily passive directory
`services, and clients-to-clients, with a single VIM server 330
`providing directory services as well as message queuing and
`delivery.
`
`In one preferred embodiment of the invention,
`[0028]
`whenevera user is not present and available to receive an
`instant message, a voice instant message may be stored in a
`queue 340 of the VIM server 330 for the user. Accordingly,
`the voice instant message is delivered to the user the next
`time that the user connects to the instant messaging network
`via his or her IM client. In an alternative preferred embodi-
`ment of the present invention, a user (“first user’) may
`designate or authorize the people named on his or her
`contact parameters from whom the user will accept voice
`instant messages. Accordingly, a VIM client of an autho-
`rized user (“seconduser”) can check to seeif the second user
`is authorized by the first user to generate a voice instant
`messageforthefirst user. These designations are specified in
`a set of voice contact parameters that may be a subset of the
`contact parameters, or the voice contact parameters may be
`stored separately from the contact parameters. Preferably,
`the voice contact parameters of a first user are readily
`accessible by the VIM clients of other users, such as the
`second user, so that the VIM clients of other users can verify
`if the first user has authorized the other users to send a voice
`
`instant message to the first user.
`
`[0029] The flowchart of FIG. 4 showsthe functionality of
`a representative implementation of the voice message deliv-
`ery system 300 of the present invention. It should also be
`
`noted that in somealternative implementations the functions
`noted in the various blocks may occur out of the order
`depicted in the flowchart of FIG. 4. For example, two blocks
`shown in succession in FIG. 4 may, in fact, be executed
`substantially concurrently. Alternatively,
`the blocks may
`sometimes be executed in the reverse order depending upon
`the functionality involved.
`In other embodiments, some
`blocks shown in FIG. 4 are omitted.
`
`[0030] As depicted in FIG. 4, the functionality of a rep-
`resentative embodiment of the voice message delivery sys-
`tem 300 or method 400 may be construed as beginning at
`block 410. In block 410, a first user designates in voice
`contact parameters that
`the first user will accept voice
`messages from a second user. For example, a first user may
`specify in his or her contactlist the persons thatthe first user
`would like to provide voice instant messaging capability to,
`via checking a box by that person’s name in the person’s
`contactlist, for example. The contact parameters are stored
`in a centralized storage medium 340 that is accessible by the
`VIM client 310 of the first user or the VIM server 330
`
`depending upon the architecture of the instant messaging
`network. Therefore, at a later time, when an authorized user
`attempts to send an instant message tothefirst user and the
`first user is not present and/or available, the authorized user
`may be given the opportunity to generate a voice instant
`message for the first user. In alternative embodiments, the
`authorized user may generate a voice instant message
`regardless of the presence and/or availability state of the first
`user.
`
`Inblock 420, the VIM client 320 of the second user
`[0031]
`receives a request or prompt by the second user to send an
`instant message to the first user. Typically, the request is
`generated after the second user attempts to initiate the
`transmission of the instant message. The VIM client 320 of
`the second user, however, detects that the first user is not
`present and/or available and, therefore, does not initiate the
`sending of the instant message, as shown in block 425.
`Accordingly, in blocks 430-435, the VIM client 320 of the
`second user checks to see if the computing device of the
`VIM client 320 is capable of generating a voice recording.
`Typically, the voice recording capabilities of the computing
`device are specified in settings of the VIM client by the
`seconduser. In blocks 440-445, the VIM client of the second
`user also checks the voice contact parametersofthe first user
`to see if the second user is authorized by the first user to
`leave a voice instant message forthefirst user. If the second
`user is not authorized to leave a voice instant message or if
`the VIM client 320 of the second user cannot generate a
`voice recording, the second useris then given the option of
`sending a textual instant message and having the message
`placed in a queue of the VIM server 330. Alternatively, the
`second user may not be able to store the instant message in
`a queue.
`
`If the second user is authorized to leave a voice
`[0032]
`instant message and the VIM client 320 of the second user
`has the capability to leave a voice instant message, then the
`VIM client 320 of the second user invites or prompts the
`second user to leave a voice message, as depicted in block
`450. If the second user declines the VIM invitation, then the
`second user again is given the option of sending a textual
`instant message and having the message placed in the queue
`of the VIM server 330, as shown in block 455. However, in
`block 460, if the second user accepts the VIM invitation,
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 13
`
`Samsung v. Uniloc, IPR2017-1802
`Uniloc's Ex. 2004, Page 13
`
`
`
`US 2007/0112925 Al
`
`May 17, 2007
`
`then the VIM client 320 of the second user starts a voice
`recorder. Accordingly, the second user speaks into a micro-
`phone that is coupled to the computing device of the VIM
`client 320 of the second user, and the VIM client 320 of the
`second user generates a voice recording for the first user.
`
`In block 465, after the voice recording has been
`[0033]
`generated, the VIM client 320 of the second user prompts the
`second user to type a descriptive caption for the voice
`recording. Then in block 470, a voice instant message is
`generated by including the descriptive caption and the voice
`recording in an instant message. The descriptive caption
`may be marked by XMLtags so that it can subsequently be
`identified by the VIM client 310 of the first user. If a
`descriptive caption is not provided by the second user, the
`voice instant message may be sent without the caption.
`
`[0034] The voice instant message is sent to the VIM server
`330 and stored in a VIM queue 340 of the VIM server 350,
`as depicted in block 475. Next, in block 480, the VIM server
`350 detects whenthe first user is present and/or available to
`receive instant messages again by monitoring the presence
`status of the first user. Then, the VIM server 330 delivers the
`voice instant message from the VIM queue 340 to the VIM
`client 310 of the first user, as depicted in block 485.
`
`[0035] FIG. 5 is a flowchart depicting a method 500 for
`receiving and playing a voice instant message at the VIM
`client 310 of thefirst user for one preferred embodimentof
`the invention. In block 510, the VIM client 310 of thefirst
`user changes from an offline presence status to an online
`presence status. In block 520, the voice instant messages
`stored in the VIM queue 340 for the first user are delivered
`to the VIM client 310 of the first user. Each voice instant
`
`message contains a descriptive caption and a voice recording
`that was provided by the originator of the voice instant
`message. As depicted in block 530, the first user via the VIM
`client 310 plays the voice recording by activating the
`recording using a mouseclick or a keystroke from a key-
`board or keypad,
`for example. Alternatively,
`the voice
`instant message may not be deliveredto the first user, until
`the first user specifically requests for the voice instant
`message to be sent from the queue.
`
`In some embodiments of the present invention, the
`[0036]
`voice instant messageis distinctively marked with XMLtags
`so that a VIM client 310 that receives a voice instant
`
`message will recognize the instant message as a voice
`instant message. Additionally, the descriptive caption may
`be marked so that the VIM client may display the caption
`without opening the voice instant message. After a VIM
`client 310 recognizes a marked voice instant message, the
`VIMclient 310 may promptthe recipient of the voice instant
`message to send a voice instant message in reply. The reply
`voice instant message would then be delivered immediately
`to the addressee if the addressee is presently online. Else, the
`voice instant message would be stored in a VIM queue 340.
`
`[0037] Additionally, in some embodiments of the inven-
`tion where the voice instant message is not automatically
`deliveredto the first user, the VIM server 340 sends the VIM
`client 310 of thefirst user a list of the voice instant messages
`contained in the VIM queue 340forthefirst user so that the
`first user can selectively choose which voice instant mes-
`sages that the first user listens to. The list contains the
`identity of the originator of each voice instant message and
`the descriptive caption for each voice instant message.
`
`for each voice instant message
`[0038] Alternatively,
`placed in the VIM queueforthe first user, the VIM server
`340 may send an update message to the VIM client 310 of
`the first user. The update message may contain an identifier
`or tracking number for the VIM message it pertains to, the
`identity of the originator of the voice instant message, and
`the descriptive caption from the voice instant message.
`Accordingly, the VIM client 310 of the first user may track
`and update the number of voice instant messages that are
`currently awaiting to be received by the first user. Addition-
`ally,
`the VIM client 310 can track the identities of the
`originators of these messages. For example, the VIM client
`310 may display the contact list of thefirst user, and next to
`each user’s name on the contact list, the number of unre-
`ceived voice messagesthat users haveleft the first user may
`be shown.Also, additional information, such as the date and
`time, may be shown.
`
`[0039] The VIM client 310, 320 or the VIM server 330 of
`a representative embodimentof the present invention can be
`implemented in software, firmware, hardware, or a combi-
`nation thereof. Preferably, the VIM client 310, 320 or VIM
`server 330 are implemented