United States Patent [191
`Kosowsky et al.
`
`l|ll|llllllllllllllllllllllllllllllll||||lIlllllllllllllllllllllllllllllll
`US 00559253 8A
`5,592,538
`Patent’ Number:
`[11]
`Jan. 7, 1997
`[45] Date of Patent:
`
`[54] TELECOMMUNICATION DEVICE AND
`lVIETHOD FOR INTERACTIVE VOICE AND
`DATA
`
`[75] Inventors: Richard P. Kosowsky, Boston, Mass;
`Michael P. Santullo, Palo Alto, Calif.;
`lVIichael R. Kosowsky, Hancock, Me.
`
`[73] Assignee: Momentum, Inc., Boston, Mass.
`
`[21] Appl. No.: 28,959
`
`[22] Filed:
`
`Mar. 10, 1993
`
`[51] Int. Cl.‘5 .......................... .. H04M 11/00; H04M 1/00
`[52] US. Cl. ............................... .. 379/93; 379/96; 379/97;
`379/98; 379/88; 379/355
`[58] Field of Search ................................ .. 379/93, 94, 96,
`379/97, 98, 100, 88, 89, 355, 356, 357,
`142, 53, 54, 92, 354; 358/437; 395/575;
`371/82; 374/222
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,150,254
`4,289,930
`4,436,962
`4,436,963
`
`4/1979 Sehussler et a1.
`9/1981 Connolly et al.
`3/1984 Davis et al.
`3/1984 Cottrell et a1.
`
`. .
`
`179/2
`179/2
`179/18 B
`179/18 B
`
`4,649,563
`
`3/1987 Riskin . . . . . . . . . . . . . . . . .
`
`. . . . .. 379/97
`
`4,674,112
`4,839,919
`4,860,342
`4,868,865
`4,899,377
`
`. 379/96
`6/1987 Kondraske et a1. .
`6/1989 Borges et al. .......................... .. 379/96
`8/1989 Danner .................................... .. 379/96
`9/1989 Ogawa et al.
`379/100
`2/1990 Bauer et al. .......................... .. 379/355
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`0326366A2 8/1989 European Pat. Off. ............... .. 379/96
`0392816 1011990 European Pat. Off.
`375/222
`0493084 7/1992 European Pat. Off. ............... .. 379/53
`2035017 6/1980 United Kingdom .
`2156187 10/1985 United Kingdom ................. .. 379/100
`
`OTHER PUBLICATIONS
`
`“For the 90’s, Screen—Based Phones,” The New York Times,
`p. 8 Dec. 13, 1993.
`VoiceView 992, 1992 slide display May 4—6, 1993 Infor—
`mart, Dallas.
`“Telecom Developers 93” I'I'I‘ Northern Telecom, New
`product and service slides, displayed May 4—6, 1993 Tele
`corn Dev. ’93 Infomart.
`“Analog Display Services Interface” slide display May 4—6,
`1993, Infomart, Dallas, by Dialogic Corp.
`“AT&T Smart Phone,” AT&T Network Systems (Market
`ing), Jun., 1991.
`“The Huntington and AT&T To Market Revolutionary Smart
`Phone” News Release, Oct. 1, 1991.
`Voice ‘92, “Improving the User Interface to Enhance Ser
`vices”, 1992.
`
`(List continued on next page.)
`
`Primary Examiner—lason Chan
`Attorney, Agent, or Firm—Wolf, Green?eld & Sacks, RC.
`
`[57]
`
`ABSTRACT
`
`A telecommunication device permits mixed voice commu
`nication and data communication during a single telephone
`call. The device switches freely between bidirectional voice
`communication and bidirectional data communication, as
`required by the data to be communicated. The dynamic
`switching between voice communication and data commu
`nication is arranged so that voice communication is mini
`mally interrupted. Data communication using the device
`includes creation, transmission, reception, storage, retrieval,
`display and use of data messages such as address and
`telephone number records. The device is inexpensive to
`produce and uses existing standards for signalling by tele
`communications equipment. A complete interactive voice
`and data (IVD) system automatically performs data com
`munication between IVD subscriber systems, or between an
`IVD subscriber system and an IVD host system. Further, in
`conjunction with a standard IVR, a complete IVR/IVD
`system automatically performs data communication with
`IVD subscriber systems and IVR voice communications
`with non-IVD subscriber systems.
`
`39 Claims, 6 Drawing Sheets
`
`CALLER _______ —
`
`————— — R501
`
`SUBSCRIBER
`PC COMPUTER
`& MODEM
`
`1
`.
`
`508
`
`IVD
`SUBSCRIBER
`PC COMPUTER
`& MODEM
`
`RECENER '
`
`;
`E
`
`: :
`
`I
`
`i
`:
`
`TELEPHONE
`
`SUBSCRIBER
`STAND-ALONE
`
`I \
`
`FAX/ DATA
`
`1
`
`IVR
`
`DATA LINK
`
`, IVR/IVD HOST
`l
`
`.
`.
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`5,592,538
`Page 2
`
`US. PATENT DOCUMENTS
`
`4,939,767
`
`7/1990 Saito et a1. .............................. .. 379/53
`
`4,991,199
`
`2/1991 Parekh et a1. . . . . .
`
`4,994,926
`
`2/1991 Gordon et a1.
`
`. . . .. 379/97
`
`379/100
`
`5,008,927
`
`4/1991 Weiss et a1. . . . . . .
`
`. . . .. 379/98
`
`5,008,930
`
`4/1991 Gawrys et a1. . . . . . . .
`
`. . . .. 379/96
`
`5,025,373
`
`6/1991 Keyser, Jr. et a1.
`
`5,050,207
`
`9/1991 Hitchcock . . . . . . . . .
`
`5,063,587 11/1991 Semosa et a1.
`5,086,453
`2/1992 Senoo et a1. .... ..
`5,101,427
`3/1992 Kotani et a1.
`5,109,407
`4/1992 Fujita et a1. . . . . . .
`5,138,649
`8/1992 Kisbergh et a1. .
`5,153,897 10/1992 Sumiyoshi et a1.
`
`364/408
`
`. . . .. 379/96
`
`379/96
`379/100
`379/355
`. . . .. 379/53
`358/85
`379/93
`
`5,157,717 10/1992 Hitchcock . . . . . . . . .
`
`. . . .. 379/96
`
`5,164,981 11/1992 Mitchell et a1. ........................ .. 379/88
`5,164,982 11/1992 Davis ...................................... .. 379/96
`5,165,096 11/1992 Matsumoto
`379/92
`5,195,130
`3/1993 Weiss et a1. ..
`379/98
`
`5,200,988
`
`4/1993 Riskin . . . . . . . . . . .
`
`. . . .. 379/52
`
`5,280,520
`5,283,818
`5,321,840
`5,329,589
`
`1/1994 Abe ....................................... .. 379/100
`1/1994 Klausner et a1. ....................... .. 379/89
`6/1994 Ahlin et a1. ..... ..
`395/700
`7/1994 Fraser et a1. ..
`379/93
`
`5,349,635
`
`9/1994 Scott . . . . . . . . . . . . .
`
`. . . .. 379/93
`
`379/96
`5,365,577 11/1994 Davis et a1. ..
`379/96
`5,369,700 11/1994 Koura et a1.
`5,450,472 11/1995 Brax ...................................... .. 379/100
`
`OTHER PUBLICATIONS
`
`“Voiceband Data Transmission Interface Generic Require
`ments,”
`Bell
`Comm.
`Research,
`Tech.
`Ref.
`#TR-NWT-0O0030, Oct. 2, 1992.
`“Generic Requirements for an SPCS to Customer Premises
`.
`.
`. ,” Bell Communications Research, Tech Advisory
`Ta-NWT-001273, Feb. 92.
`
`“ADSI Protocol Overview”, Northern Telecom 58105, Feb.
`4, 1993, Issue I printed Apr. 1993.
`“Telephony” An Interface Publication May 25, 1992.
`“Funds Transfer Report”, Mar. 1992, A Bankers Publication.
`“Super Phones In The US”, Ele. Payments International,
`Issue 64 Apr. 1992.
`“Bank Advertising News” vol. 17, No. 11, Nov. 16, 1992
`New article on MNC telephone banking program.
`The Washington Post, Mar. 27, 1992, article about phones
`that allow customers to review their balance.
`Brochure for A Home Banking System from “Online
`Resources”, 1313 Dolley Madison B1vd., McLean, VA
`22101.
`“Educate Your Market for Home—Banking”, DeLone et a1.
`Bank Marketing Nov. 1992.
`“Renewed Push for Pay—by—Phone”, Michael Quint, Busi
`ness Day, Mar. 7, 1992, part of the New York Times.
`“Information & Interactive Services Report”, Gary H. Arlen,
`Mar. 27, 1992.
`“The PC Comes to Telecom”, Harry Newton, 1993 May
`Teleconnect.
`Brochure from Online Resources & Comm. Corp., 1313
`Dolley Madison Blve., McLean, VA 22101.
`Product information on Visualization of Communication,
`Radish 1705 14 St., S184, Boulder, CO 80302, 1992.
`“Data Over Voice”, Johana Till Johnson, Data Comm, Jun.
`1992.
`“VoiceView”, Radish Comm. Sys., Inc. Cat. No. 992, 1992.
`“Voice and Data Put On One Line, Sans lSDN”, Commu
`nications Radish Comm. Sys., Inc. Comm. Week, May 18,
`1992.
`“VoiceView”, Madeline Bodin, Call Center Magazine Dec.
`1992.
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`US. Patent
`
`Jan. 7, 1997
`
`Sheet 1 0f 6
`
`5,592,538
`
`5v. may 23% 2s. _
`
`
` Qzwm com 08 5:39-202 <21 <61 \ \ \ .
`m: M: /:= M2 £9 £2 _
`
`31 _
`
`\ \ mzoIQwE > mozmwzmo w
`E 3 m“ W29 ~
`
`%w%% 525mm 56% < < l \ 585 W
`
`
`
`
`
`
`
`8m E 8m E mg mg . E/ E3 6528 E3 SE28 H <25 SE28 SE @1203
`
`
`4 73: < /2.: 72.: < 8: _
`
`> ‘V > V > _ > NE. : > _
`
`
`
`4 < l < @6528 Q
`
`
`
`.\.: mom > f 3:\ // SE @5828 g _
`
`
`
`wzoInmE
`
`TE
`
`\ . \ = > “25 v wzoInmE _
`
`
`
`
`
`
`
`wzoInmE GENE; \ 1 122m 53%? _ M29155 1 ‘ uoZmwzwo v W2: 5
`
`E 5 SA > 2% > _
`
`...................................................................... .|@
`
`M ‘ _
`
`no: _
`
`m9 w
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`US. Patent
`
`Jan. 7, 1997
`
`Sheet 2 0f 6
`
`5,592,538
`
`
`
`mo zomma Qzw
`
`qow
`
`
`
`@883 $2185:
`
`mom
`
`.w <<mQO<<
`
`AOUOPONE
`
`
`
`
`00w :4: HUwEO :4... 02mm
`
`
`
`298% Nana/U GEO $53 02%
`3% =9 02% a: SEQ
`
`
`
`zommm ,
`
`
`
`a 55% V60:
`
`
`
`Bwzzou mmzmlmw
`
`
`
`NEES 5E0
`
`vw .35
`
`.FEZZOU
`
`yOOIJEO
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`US. Patent
`
`Jan. 7, 1997
`
`Sheet 3 of 6
`
`5,592,538
`
`INIIIAIDR
`A
`
`/
`
`PSTN
`\ /_.J¥_\ /
`
`RESPONDER
`A
`
`\
`
`DEVICE SENDS "A" DIME IDNE
`
`M301
`
`USER PRESSES "SEND“ KEY
`DEVICE SENDS "A" DIME IoNE
`
`303
`/
`
`DEVICE DEIECIS "A" DIME TONE
`A" DIME
`USER PRESSES "SEND" KEY
`
`DEVICE KEEPS LINE OFF-HOOK \ DEVICE MUTES TELEPHONE » I
`USER HANGS UP TELEPHONE
`DEV'CESENDS B DTMFTONE
`
`SUBSCRIBER
`E
`
`-B-- DTMF
`fsos
`
`USER HEARS -A~ DTMF TONE
`USER PRESSES "RECEIVE" BuIIoN
`DEVICE KEEPS LINE OFF-HOOK
`USER HANGS UP IEIEPIIDNE
`uSER PRESSES CONFIRMATION KEY
`DEVICE SENDS "B" DIME IDNE
`DEV'CEUSTENSFOR ANSWER
`MODEM CARRIER IDNE
`
`USER PRESSES CDNEIRMAIIDN KEY
`DEVICE SENDS "A" DTMF TONE
`
`DEVICE PAUSES
`DEVICE SENDS ANSWER MODEM
`CARRIER TONE
`
`" "
`DEVICE DEIECIS B DIMEIoNE
`DEVICE MuIES TELEPHONE
`DEVICE SENDS ANSWER MODEM
`CARRIER TONE
`DEM PAUSES
`DEVICE SENDS ANSWER MoDEM
`CARRIER TONE
`
`ORIGINATE
`CARRIER
`309
`/
`
`j
`307
`ANSWER
`/ \
`W2
`DEVICE DEIECIS ANSWER MoDEM
`CARRIER TONE
`DEVICE SENDS DRIDNIAIE MODEM
`CARRIER IDNE
`
`SUBSCRIBER
`> PCBASED
`
`> ALL
`
`/
`
`DEVICE DEIECIS ORIGINATE
`MODEM CARRIER IDNE \
`
`MODEM & PROTOCOL HANDSHAKE
`
`DAIA SESSION
`
`DEVICE RECEIVES END SESSION \\ DEVICE SENDS END SESSIoN
`CDMMAND
`313
`CoMMAND
`DEVICE DISABIES MoDEM
`END
`DEVICE DISABLES MDDEM
`DEVICE PAUSES
`SESS'ON
`DEVICE PAUSES
`
`3“
`/
`
`ALL
`
`SUBSCRIBER
`DEVICE CDNNECIS IEIEPEIDNEID / DEVICE CDNNECIS TELEPHONE Io }STAND
`TELEPHONE LINE
`TELEPHONE LINE
`ALONE
`
`USER PICKS UPTELEPHONE
`USER PRESSES CONFIRMATION KEY
`
`USER PICKS UPTELEPHONE
`USER PRESSES C0NEIRMAII0N KEY
`
`SUBSCRIBER
`PC BASED
`
`Fig. 3
`
`SUBSCRIBER
`PC BASED
`
`ALL
`
`SUBSCRIBER
`STAND
`ALONE
`SUBSCRIBER
`PC BASED
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`Jan. 7, 1997
`
`U.S. Patent
`
`
`
`wv
`
`
`
`SOV
`
`
`
`
`
`NOLLVWYONI400
`TWNOSdIdSNIVLSWALSAS
`
`
`
`
`
`
`
`Zlt434dI3NGOANIdWILOVdHDIVADS
`
`wvVd90dd
`
`MOOSSISCAV
`
`lOp600
`
`ASOWAW
`
`SILON
`
`SlAV1dSidG91
`
`43449XL
`
`Sheet 4 of 6
`
`5,592,538
`
`NOILVYINDINOD
`
`SaalIWwVaVd
`
`JDIAIC
`
`8lv
`
`a344Nd
`
`yaddngXaLv
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jan. 7, 1997
`
`Sheet 5 of 6
`
`5,592,538
`
`Y3AI5D3a
`
`!JNOHdATAL
`ddgldDsEns
`
`QAI
`
`Beeeeereeeee
`
`YALNdWODOd
`
`W3AdOW’8
`
`80S
`
`JITaNd
`
`(NLSd)
`
`t!!
`
`CAI
`
`JNOHdd13L
`Q3HOLIMS
`AYOMLAN
`INOIW-ONVLS
`
`ISOHCAIJOIAYIS
`WIGOW*21|YaLNdWODDd
`JNOW-CNVLS
`dIgdOSdNs
`
`SSANISN
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`
`
`
`
`
`

`

`US. Patent
`
`Jan. 7, 1997
`
`Sheet 6 of 6
`
`5,592,538
`
`
`
`20:55“? A .................. - -v zo:<u:&<
`
`
`
`
`
`‘ l I l l l l | | I Il Y I l I l l l l l l
`
`0 . 9“.
`
`30551 A v 5355 \
`
`v /m%
`
`. 50
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`5,592,538
`
`1
`TELECOIVIMUNICATION DEVICE AND
`METHOD FOR INTERACTIVE VOICE AND
`DATA
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`This invention relates generally to telecommunications
`equipment and software. More particularly, the invention
`relates to customer premise equipment and service provider
`equipment for effecting both voice and data communication
`through existing public switched telephone networks,
`including mixed voice and data communication between a
`variety of equipment con?gurations, and management and
`display of data communicated.
`2. Discussion of the Prior Art
`Conventional voice telephones and the public switched
`telephone network (PSTN) are well-known to citizens of
`today’s world. Indeed, telephone systems ranging from the
`simple instrument purchased for home use to very sophis
`ticated business systems are in widespread use. Among the
`systems seeing increased use among several market seg
`ments is the interactive voice response (IVR) system. An
`IVR provides an interactive voice session between customer
`and business in which the business end of the call generates
`voice messages through recording or synthesizing tech
`niques, and the customer interacts using a telephone keypad
`or through voiced statements and voice recognition.
`One generic example of an IVR is the type used by large
`banks to give their retail customers instant telephone access
`to account information. Such a system may give information
`by voice to the customer or may perform various banking
`transactions, responsive to commands keyed into the cus
`tomer’s telephone keypad. For example, the customer may
`inquire as to account balances and may transfer funds from
`one account to another. The customer’s telephone keypad
`must be of the tone type, which is capable of generating
`twelve dual-tone multi-frequency (DTMF) signals out of a
`standard sixteen. The standard DTMF signals are designated
`“1”—“9”, “O”,
`“#” and “A”—“D”. Each comprises one of
`four high frequency tones superposed on one of four low
`frequency tones. The DTMF standard is contained in
`“American National Standard for Telecommunications - e -
`
`10
`
`25
`
`30
`
`35
`
`Interface Between Carriers and Customer Installations - - -
`Analog Voicegrade Switched Access Lines Using Loop
`Start and Ground-Start Signaling”, ANSI Tl.40l-l988, and
`in “Dual-Tone Multifrequency Receiver Generic Require
`ments for End-to-End Signaling Over Tandem-Switched
`Voice Links”, Issue 1, TR-TSY-OOOlSl, Bellcore, March
`1987.
`To begin a typical IVR transaction the customer calls the
`bank’s IVR system from any telephone capable of generat
`ing DTMF signals. The IVR system issues one or more
`requests for commands or information, the requests being in
`the form of pre—recorded or synthesized voice messages. By
`responding with appropriate DTMF signals, the customer
`may navigate through a series of menus or lists of such
`requests until the desired information is delivered to the
`customer as a pre-recorded or synthesized voice message.
`One problem with IVR systems such as described above is
`that the communication bandwidth of the spoken messages
`from the IVR is so low as to be a signi?cant frustration to
`experienced users. Indeed, if a menu of commands contains
`a large number of choices, it may even be di?icult to recall
`the appropriate one at the time for making a selection.
`Navigating a complex series of menus to retrieve some
`
`45
`
`55
`
`65
`
`2
`information can be time-consuming as well. Further, having
`navigated the system once doesn’t make subsequent navi
`gations any easier, except, possibly, that the user may write
`down or remember the sequence of keystrokes that brings a
`desired result.
`Some solutions have been proposed, but each has a
`signi?cant cost or drawback.
`One way to make the described type of communication
`easier is to use a visual data based system, such as a personal
`computer (PC) and modem, in connection with an informa
`tion retrieval service. However, personal computers are still
`a signi?cant expense, to which many individuals may have
`only limited access. In contrast, telephones are ubiquitous
`and inexpensive to acquire. A further drawback to using PCs
`and modems to access customer information, such as bank
`balances, is that on occasion the content of the information
`retrieved precipitates the need for the customer to commu
`nicate with service provider personnel. While the modem
`equipped PC is in use, the telephone line is unavailable for
`voice communication. A desirable solution would permit
`mixed voice communication and data communication dur
`ing a single telephone call.
`Another proposed solution would be to make use of the
`emerging Integrated Switched Digital Network (ISDN) stan
`dards and equipment to effect simultaneous or near-simul
`taneous voice and data based communication. However, this
`solution requires signi?cant investment in new equipment
`by service providers, service customers and the telephone
`companies. A desirable solution would be available to the
`general public at low cost.
`Screen-based telephones are another emerging solution to
`the problems noted above. However, current screen-based
`telephones do not provide bidirectional, mixed voice and
`data communications during a single telephone call, wherein
`data communication may be initiated and terminated by
`either the calling party or the called party. Further, when
`prior art screen-based telephones are receiving data, the
`telephone keypad is disabled, preventing user response until
`the data communication has been completed.
`An Analog Display Services Interface (ADSI) has been
`developed by BELLCORE for use by the various local Bell
`Operating Companies and various service providers.
`Devices compatible with the ADSI communication standard
`are currently under development, but speci?c device capa
`bilities are not indicated in the ADSI standard and are
`presently unknown. The ADSI standard does call for the use
`of non-standard DTMF tones (i.e. not one of “1”—“9”, “O”,
`“#” and “A”—“D”) for session initiation. Thus, devices
`implementing the ADSI standard rely on the use of non
`standard hardware, preventing communication with
`unmodi?ed equipment currently in use. Furthermore, the
`ADSI standard calls for simplex data communication,
`wherein customer premises equipment cannot originate data
`communication. Further, ADSI requires a data session to
`begin using the signals complying with the Bell 202 data
`communication standard which is incompatible with exist
`ing PC modems.
`Another area of art of interest in connection with the
`present invention includes telephone autodialer systems and
`electronic personal organizers. These are electronic devices
`which provide one or more functions including the creation,
`storage, display and transfer of telephone number station
`and address information. Telephone number information
`may include dialing pre?x information, area codes, country
`codes, telephone numbers and auxiliary telephone numbers,
`as well as any other information required to properly dial a
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`5,592,538
`
`3
`telephone number. Address information may include a per
`son’s name, a person’s title, the name of a business at which
`a person works, street address information and other mis
`cellaneous information which may be useful in the context
`of a telephone directory.
`Some devices currently available can autodial a previ
`ously stored telephone number. Thus, in addition to func
`tioning as a conventional personal telephone directory, the
`device can reduce dialing errors by automatically generating
`the sequence of DTMF tones corresponding to a stored
`telephone number.
`However, devices such as described above do not provide
`a means for transfening selected telephone number infor
`mation and address information to another such device over
`the PSTN during a voice conversation. Thus, a user of such
`a device who is having a telephone conversation with
`another user of such a device cannot readily and simply
`transfer a record from the ?rst user’s device to the other
`user’s device electronically. The user would instead recall
`the record to the device’s display and read the information
`aloud to the other user who will manually enter that infor
`mation into the other user’s device. Although some such
`devices do provide a data transfer function, they are intended
`primarily for backup purposes and are limited to batch
`transfers of records using a special, dedicated, local data
`link. For example, special cables or an infrared link may be
`used.
`Yet another area of art of interest in connection with the
`present invention includes “bookmark” functions and macro
`functions used by computer software applications, networks
`and communication software. In this context a bookmark is
`simply a record of certain state information, usually made by
`a software user, so that the same state can be easily recreated
`by the user at some point in the future. Macros are a form
`of software program, intended to accomplish a similar result
`to bookmarks. A macro is simply a record of a sequence of
`key strokes and/or pointing device actions designated by a
`user. Macros are often recorded as the user operates the
`software from an initial state to a ?nal state. Thus, if the user
`places the software program into an initial state identical to
`the initial state from which a macro has been recorded,
`running the macro would produce the same ?nal state as the
`user had previously achieved manually by entering the
`sequence of key strokes and/or pointing device actions.
`However, bookmarks and macros are stored as private data
`accessible only from within the application wherein they
`were created. Thus, they are di?icult to transfer to other
`users of the same software.
`
`45
`
`SUMMARY OF THE INVENTION
`
`50
`
`Accordingly, the present invention will provide mixed
`communication by both voice and data including visual text
`messages during a single telephone call. Further in accor
`dance with the present invention, both modes of communi
`cation may be bidirectional. Yet further in accordance with
`the present invention, the apparatus will not require indi
`viduals to discard the telephone equipment in which they
`have already invested.
`In accordance with another aspect of the present inven
`tion, there is provided an interactive voice and data (IVD)
`subscriber system, any two of which may communicate with
`each other, and optionally an IVD host system which allows
`IVD subscriber system unit to IVD host communication.
`The IVD subscriber system and host are compatible with the
`PSTN for voice communication.
`
`55
`
`60
`
`65
`
`20
`
`25
`
`35
`
`40
`
`4
`In accordance with another aspect of the present inven
`tion, there is provided data management facilities for
`enabling the exchange of data with other devices. Data from
`a database may be selected, transmitted, received, merged,
`displayed and otherwise used by devices according to this
`aspect of the present invention. The data managed may
`include telephone number data, such as found in a telephone
`directory. Thus, devices may exchange telephone number
`data corresponding to either connected party or third parties.
`Furthennore, the data managed may include state informa
`tion, where a device communicated with includes capability
`of identifying which of a plurality of states its controlling
`software is in. By obtaining such state information and
`providing for the exchange of such state information, users
`of common devices with similar usage patterns may share
`data for rapidly retunring to a commonly used state.
`
`BRIEF DESCRIPTION OF THE DRAWING
`
`The present invention will be further understood in con
`nection with the accompanying drawing wherein like
`numerals refer to like elements and wherein:
`FIG. 1 is a block diagram of one embodiment of the
`present invention;
`FIG. 2 is a state diagram of one embodiment of the present
`invention;
`FIG. 3 is a detailed state diagram showing how transitions
`between voice and data modes are e?‘ected;
`FIG. 4 is a memory map of the contents of memory
`elements according to one embodiment of the present inven
`tion;
`FIG. 5 is a general system diagram of some components
`of a complete system, including stand-alone and PC based
`IVD subscriber systems, a stand-alone IVD host system, and
`a IVD host system operated with a standard IVR host
`system; and
`FIG. 6 is a protocol diagram of the communications
`protocol according to one embodiment of the present inven
`tion.
`
`DETAILED DESCRIPTION
`A detailed description will now be given of several
`aspects and embodiments of the present invention.
`A device constructed according to the present invention is
`shown in block diagram form in FIG. 1. This block diagram
`is generic to several alternate embodiments, and so alterna
`tive embodiments of portions of the system will be described
`when appropriate. For example, the invention may be prac
`ticed by installing a plug-in module and a special software
`program within a personal computer system, or the inven
`tion may be practiced as a stand-alone device. Such different
`embodiments may have different construction details. The
`main components of a device according to this invention
`include a display 101, a modern chip 103, a controller chip
`105, memory 107a—107c, and various interface devices,
`including a telephone line interface 109, a telephone inter
`face 111 and user interface keys 113 and 115. The illustrated
`embodiment will now be described in greater detail.
`Display 101 may be, for example, a multi-line, multi
`character liquid crystal display (LCD), such as is commonly
`used in calculators and hand held computers. The display
`could include graphics display capability as well as data
`display capability, if so desired. A suitable size for a small
`data display of the required type is 8 lines of 40 characters
`each, although any convenient size may be used. If the
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`5,592,538
`
`5
`invention is to be practiced using a PC, the monitor screen
`may form a suitable display 101.
`Information to be displayed is transferred to the display
`101 by the controller 105 over a data bus 117. Also associ
`ated with the display 101 are a group of control signals 119a
`for instructing the display 101 regarding the display of
`information transferred. In this embodiment, it is assumed
`that the display includes local memory for holding the
`transferred information to be displayed Other conventional
`display and display memory management techniques known
`to those skilled in the art may be employed. For example, the
`display memory may be part of system memory, with
`controller 105 transferring display content directly from
`system memory to the display as needed. (See the memory
`map of FIG. 4, for example.)
`Modem circuit 103 is used for performing fast, bidirec
`tional, digital data communication between the device of the
`invention and another device to which it is connected
`through the PSTN. The modem circuit 103 is connected to
`controller 105 for digital communication through the data
`bus 117 and a group of control signals 11912. The modem
`circuit 103 is further connected for communication of digital
`information over the telephone line through telephone line
`interface 109. Thus, controller 105 may send or receive
`digital information, such as data information encoded in a
`standard interchange format, for example ASCH, by trans
`ferring appropriate commands and data to the modem circuit
`1
`
`25
`
`6
`recognition and generation. The read only memory (ROM)
`107a, the random access memory (RAM) 1071; and the
`non-volatile RAM (NV RAM) 107C in an embodiment not
`part of a personal computer may be of any conventional type
`convenient to the application. One arrangement of data and
`program information within the memories 107a-107a is
`discussed below in connection with FIG. 5, where ROM
`107a holds a system program, RAM 107b holds transient
`data and NV RAM 107c holds a database of telephone
`number and other data. The precise arrangement of this
`memory space will depend upon the design choices of the
`implementer.
`Having a database of information readily accessible in the
`device’s memory allows a user to transmit commonly used
`data at the touch of a single button, without having to
`compose the message anew each time it is required. One
`example of such a situation occurs when a service provider
`asks a caller to identify themselves. Basic identifying infor
`mation, perhaps omitting a secret personal identi?cation
`number (PIN), could be sent as a data message, without
`requiring the caller to speak or type their name and address
`each time the service provider requests it. This reduces the
`time spent identifying the caller and reduces the likelihood
`that an error will be made in the identi?cation data. A further
`example of such a situation occurs when a caller ?rst
`connects to a service. Coupled with a database entry used to
`dial the call could be data hereinafter called a bookmark,
`which when transmitted to the service provider may indicate
`an extension the caller wishes to connect to, or may indicate
`which service provider function the caller seeks to access.
`Bookmarks are described in greater detail below.
`This database, in one embodiment of the invention, is
`divided into three parts. The ?rst comprises personal infor
`mation data records, such as the name and address of the
`device’s owner. Note that there may be multiple instances of
`each type of personal information data record, for example
`the name and workplace telephone number of each family
`member may be stored. The second part comprises address
`book data records, which are telephone number and other
`related data, such as names and addresses. These data
`records may be used to automatically dial out to the other
`parties and may be sent and received between devices,
`allowing one user to augment his address book by receiving
`records from another. The third part of the database corn‘
`prises notes, which are freely formatted text messages that
`may be sent and received between devices.
`Alternatively, some part of RAM 1072; or NV RAM 1070
`may be a standalone personal information manager (PIM)
`connected through an option port or communication port to
`data bus 117. For example, a SHARP OZ-8000 series device
`or a CASIO B.O.S.S. device could be used to store an
`address book with telephone numbers, a note ?le and
`personal identi?cation information. PIMs are tailored for the
`storage of these types of information. Interfaces between the
`SHARP or CASIO PIMs and other devices such as PCs are
`commercially available. Another PIM con?guration might
`include a PIM application running on a standard PC (e.g.
`ACT! or Packrat).
`The telephone switch 121 is controlled by controller 105.
`The switch 121 functions to connect the telephone interface
`111 to either the telephone line interface 109 or the telephone
`power circuit 125. Thus an externally attached telephone
`may be selectively connected to or disconnected from the
`telephone line. When disconnected, the telephone will still
`receive the power ordinarily provided by the telephone line,
`which, for example, is often necessary for the phone to be
`able to generate DTMF tones.
`
`The modem circuit 103 may be a conventional chip. In the
`embodiment described, it is preferred that the chip used for
`modern circuit 103 comply with certain standards and
`requirements. The modern circuit 103 should comply with
`current versions of the communications standards Bell 103],
`Bell 212A, CCITT V.22 and CCITT V.22bis. The Bell
`communications standards were last published by the pre
`divestiture AT&T as publications No. 41106 and 41214,
`respectively. The CCITT standard was published in the
`“CCITT Red Book: Data Communications over the Tele
`phone Network: Recommendation of the V Series”, Volume
`VIII, Fascicle VIlll, v.22 and V.22bis. By so doing, the
`modem circuit 103 will be compatible with a wide variety of
`other devices. The selected modem circuit 103 should be
`capable of operating in answer or originate mode. The
`importance of this capability will be seen below, when the
`state diagram of the software of this embodiment is dis
`cussed in connection with FIG. 2.
`Controller 105 may be any of a number of readily
`available microprocessor circuits. In embodiments where
`the device is intended to be a standalone unit, micropro
`cessors such as type 8051, manufactured by INTEL, or
`other, similar units may be suitable.
`Alternatively, controller 105 may be a personal computer
`or the processor portion of a personal computer, having the
`other elements shown connected thereto. For example, con
`troller 105, memory elements 107a-107e, display 101 and
`user interfaces 113 and 115, all connected by data bus 117
`and control signals 119a—119e comprise typical components
`of a personal computer system. The balance of the elements,
`particularly including modern circuit 103, telephone line
`interface 109 and telephone interface 111, could be located
`on a plug-in module, also connected to the controller 105
`through data bus 117 and the set of control signals 11%. Or,
`the balance of the components could be located in a modem
`attached to the personal computer, if the modem is capable
`of handset exclusion, that is isolation of an attached tele
`phone from receiving modem tones, and of DTMF tone
`
`30
`
`35
`
`45
`
`50
`
`55
`
`65
`
`Ruiz Food Products, Inc.
`Exhibit 1009
`
`

`

`7
`DTMF receiver 123 is connected