United States Patent [19J
`Davis et al.
`
`[54] TELECOMMUNICATION SYSTEM FOR
`AUTOMATIC SWITCHING BETWEEN
`VOICE AND VISUAL DATA
`COMMUNICATIONS USING FORMS
`
`[75]
`
`Inventors: Richard A. Davis; Anthony J.
`Brittain, both of Boulder; Richard A.
`Smith, Lafayette, all of Colo.
`
`[73] Assignee: Radish Communication Systems, Inc.,
`Boulder, Colo.
`
`[21] Appl. No.: 417,201
`Apr. 5, 1995
`
`[22] Filed:
`
`Related U.S. Application Data
`
`[63] Continuation-in-part of Ser. No. 380,064, Jan. 30, 1995,
`which is a continuation-in-part of Ser. No. 271,850, Jul. 7,
`1994, which is a continuation-in-part of Ser. No. 877,328,
`May 1, 1992, Pat. No. 5,365,577, which is a continuation(cid:173)
`in-part of Ser. No. 589,203, Sep. 27, 1990, Pat. No. 5,164,
`982.
`Int. Cl.6
`...............•.•..........................•.•..... H04M 11/00
`[51]
`[52] U.S. Cl . ................................ 379/96; 379/97; 379/207
`[58] Field of Search .................................. 379/90, 91, 93,
`379/96-98, 100, 201, 207; 375/222; 348/14,
`15, 17, 18
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`Re. 34,429
`4,387,271
`4,656,654
`4,682,957
`4,715,059
`4,815,121
`4,918,722
`4,932,047
`5,040,208
`5,164,981
`5,164,982
`5,243,643
`
`11/1993 Baran et al ..
`6/1983 Artom.
`4/1987 Dumas.
`7/1987 Young.
`12/1987 Cooper-Hart et al ..
`3/1989 Yoshida.
`4/1990 Duehren et al ..
`6/1990 E=ons et al ..
`8/1991 Jolissaint .
`11/1992 Mitchell et al ..
`11/1992 Davis.
`9/1993 Satter et al ..
`
`I 1111111111111111 11111 lllll lllll lllll 111111111111111 lllll 111111111111111111
`US005583922A
`[lll Patent Number:
`[45] Date of Patent:
`
`5,583,922
`Dec. 10, 1996
`
`5,255,305
`5,276,732
`5,283,731
`5,291,546
`
`10/1993 Sattar .
`1/1994 Stent et al ..
`2/1994 Lalonde et al ..
`3/1994 Giler et al ..
`
`OTHER PUBLICATIONS
`
`"intel Proshare Video System" advertisement, ABA Journal
`(page 17, Feb. 1995).
`
`Primary Examiner-Wing F. Chan
`Attorney, Agent, or Firm-Dorr, Carson, Sloan & Birney,
`P.C.
`
`[57]
`
`ABSTRACT
`
`A telecommunication system provides voice and data com(cid:173)
`munications over a conventional telephone line between a
`server station and a client station using visual forms. The
`client station includes a processor, display, telephone, and
`data circuit-terminating equipment (DCE) for data commu(cid:173)
`nications. The server station includes a processor, DCE, and
`either a telephone or a voice card for audio communications.
`Each DCE includes a modem, a start signal generator for
`transmitting a start signal over the telephone line prior to
`transmission of data by the modem, a start signal detector,
`and a switch that automatically switches the DCE from
`voice mode to data mode while data is being communicated.
`The client processor also includes a definition of a visual
`form having a number of controls with predetermined prop(cid:173)
`erties, including properties defining permissible actions that
`can be taken with respect to each control and instructions to
`be executed in response to specified actions. The client
`employs a mouse, keyboard, or the like to select a control in
`the visual form and to perform an action on the· selected
`control. At least some of the controls include a property
`directing the client processor to switch the DCE to data
`mode, transmit data identifying the action, and then return to
`voice mode. The server processor is programmed to execute
`steps in response to the actions received from said client
`station. The visual forms at both stations can be linked so
`that they are automatically updated to reflect actions at the
`other station.
`
`35 Claims, 16 Drawing Sheets
`
`15
`~_.____,
`
`I
`I
`I
`
`(cid:143)
`I ~iilli~~ DCE
`
`j cuerr--;;;;;;:,;--..C.".'~-7
`I
`I
`I
`I
`I
`I
`I
`I
`1
`I
`16
`I
`
`10
`
`14
`_____....~
`
`Im~
`
`I
`I
`I
`I
`I
`I
`I
`I
`12
`L _____________ _I
`
`200
`
`25
`
`r _______ _L.. ___ ~
`I SERVER STATION
`I
`I
`I
`I
`I
`I
`26 I
`I
`I
`
`24
`
`DCE
`
`23
`
`50
`
`21
`
`I
`I
`I
`I
`I
`I
`I
`I
`I
`22
`1
`L ____________ J
`
`Apple Exhibit 1105
`Apple Inc. v. Rembrandt Wireless
`IPR2020-00034
`Page 00001
`
`

`

`U.S. Patent
`5,583,922
`Dec. 10, 1996
`Sheet 1 of 16
`r - - - - - - - - - - - - - - - - - - - - - ,
`2
`I
`~_-_-_-_-
`I
`o
`~ I
`~
`l!ci ,~
`
`~
`
`rrm
`~
`I
`
`lz
`lo
`
`I a:
`I~
`I~
`L __________ - - - - - - - -~
`
`w
`(.)
`C
`
`(\J
`(\J
`
`,-...
`.~
`LC
`
`(0
`(\J
`
`"C ~ ~
`oQ.>o'-
`·- .c .c 0
`:Cc.>a,3=
`::, :t:: (1) Q)
`a.:=Q>Z
`Cl) t,,;,
`
`0
`LO
`
`(0
`
`0
`
`I
`I
`lz
`
`LO
`
`r--------~~--------7
`g
`I
`w
`I
`-
`(.)
`C
`~
`,o ,~
`
`I~
`I~
`Id L ________________ _J
`
`IPR2020-00034 Page 00002
`
`

`

`N
`N
`"' \C
`~
`
`"' "' "' 0C
`
`=--
`s, ....
`Cl.) =-[
`
`N
`
`~
`I:,
`
`=--
`\0
`\0
`....
`f) .... ~=
`
`~ = ;-a
`00. •
`e •
`
`I 24 ..J
`
`.
`•
`
`Board
`Cont.
`
`32
`
`Port
`Serial
`
`)
`
`31
`
`28
`
`Card
`Voice
`
`29
`
`28
`
`Card
`Voice
`~
`
`35 I
`I
`I SERVER STATION
`,--------------7
`
`,-200
`
`26
`
`Network
`Telephone
`Switched
`
`Public
`
`Fig. 2
`
`i
`
`I
`I
`I
`--,
`
`I
`I
`I
`I CLIENT STATION
`,----------~100
`
`L _______________ J
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`12
`
`II
`
`16
`
`DCE
`
`~14
`
`=~~
`
`c::J
`
`D JO?
`
`.---L--.
`
`15
`
`L _______________ _J
`I
`I
`1 I
`I
`I
`DCEI I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`/
`
`33
`'------.------'
`Processor 20
`
`I
`Network
`I 1--__.____,
`I
`I
`I
`l ------------.
`
`--~ Interface
`
`21
`
`IPR2020-00034 Page 00003
`
`

`

`U.S. Patent
`5,583,922
`r------------0---------7
`I
`. - - I
`w
`~ (cid:143)
`g I
`I
`I
`
`li ~
`
`_\-----.
`:::> a:
`>
`
`I
`I
`I
`I z
`10
`I~
`I ~
`I ffi
`I~
`o
`I ~
`m
`L _______ - - - - - - - - - - - -~
`
`Dec. 10, 1996
`
`Sheet 3 of 16
`
`w
`(.)
`0
`
`C\I
`w
`
`X
`Ill
`Q.
`
`r - - - - - - - - - - - - - - - -~
`I
`I
`I
`~I
`I
`lz
`IQ
`
`o
`o
`
`w
`(.)
`C
`
`lO
`
`0
`
`r<)
`
`C\I
`
`Id
`L _______________ _
`
`~
`
`IPR2020-00034 Page 00004
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 4 of 16
`
`5,583,922
`
`Fig. 4
`
`Listen to
`.any CD
`Over the
`Phone
`~CD Source
`~ Cancel I
`
`Dial
`
`IPR2020-00034 Page 00005
`
`

`

`~
`\0
`_,.
`QC w
`Ut
`_,.
`Ut
`
`=--
`s, ...
`m.
`~
`
`f.11
`
`... = ... \C
`~ ...
`i
`
`=--
`\C
`
`~ i a
`
`•
`00.
`~ •
`
`Quit
`
`I'-
`
`Cashier
`
`I'\.
`
`Albums
`Selected
`
`I ~ Rhythm & Blues I
`I
`Country I
`
`,~
`
`~
`~
`~ Contemporary I ~
`
`Top 20
`
`Jazz
`
`Choice
`Your
`Click On
`
`You can find your music by category
`
`Shop By Phone
`
`&CD Source
`
`Fig. 5
`
`IPR2020-00034 Page 00006
`
`

`

`N
`N
`\0
`~ ,....
`00
`01
`,....
`01
`
`0'I
`I-'
`
`s,
`Cl) =-l
`
`0'I
`
`0'I
`\0
`\0
`I-'
`
`I-' ~=
`
`~
`('I)
`~
`
`•
`00
`~ •
`
`""C = ~ a
`
`Quit
`
`Back
`Go
`
`Cashier
`
`~
`
`I'\
`
`Album
`Add
`
`Albums
`Selected
`
`Click On Your Choice
`
`+
`......_
`
`(cid:143)
`..!.
`
`Over
`Start
`
`Hearsay
`Buckshot Le Fonque
`Tenderness
`Live At The Acropolis
`Sax By The Fire
`After The Storm
`Benedictine Monks
`Album
`
`Bestselling Jazz Albums •••
`
`David Sanborn
`Branford Marsalis
`Al Jarreau
`Yanni
`John Tesh
`Norman Brown
`Chant
`Artist
`
`Shop By Phone
`
`~CD Source
`
`Fig. 6
`
`IPR2020-00034 Page 00007
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 7 of 16
`
`5,583,922
`
`Fig. 7
`
`50
`
`I
`16 1220
`r ____ _J
`
`RING
`~-..--... DET i - - - - .
`
`236
`
`238
`
`240
`
`248
`
`LIMITER
`RXIN
`
`AUTO
`GAIN
`CONT
`
`222
`
`MODEM
`
`TXOUT
`
`254
`,---------,
`DATA TONE TONE DATA TONE TONE
`GEN RECV DET.1 DET.2
`XMIT GEN
`250
`
`DCE
`CONT.
`I
`230
`' - - - r - - . - - - - - - ' I
`I
`I
`I
`I
`I
`I
`I
`_J
`
`MODEM CONTROLLER
`
`246
`L ________________ _
`
`13
`
`TO PROCESSOR
`
`IPR2020-00034 Page 00008
`
`

`

`N
`N
`\0
`00 w
`01
`01
`
`'JI
`
`'JI
`
`0'I
`~
`
`s,
`m.
`00. =-
`
`QC
`
`0'I
`\0
`\0
`~
`
`,,,0
`~
`~
`~
`-~
`
`~
`•
`rJ'J.
`~ •
`
`~ a
`
`Fig. 9
`
`45-55
`
`10-20
`
`45-55
`
`Milliseconds: 0-10
`
`Silence
`
`Silence First Tone Period Silence Second Tone Period
`
`Flags
`
`~--------MTone---------~
`
`I
`I
`I 0-1·0 \ 80-90 lo-10\ 100-130 I
`
`\
`'
`
`I
`
`I
`
`\
`
`180-200
`
`Milliseconds : 15-35
`
`..
`
`,
`
`I Data
`
`MTone
`
`Flags
`
`Start Tone
`
`Voice Silence
`
`Fig. 8
`
`IPR2020-00034 Page 00009
`
`

`

`N
`N
`\C
`~ ._..
`QC
`01
`._..
`01
`
`~ =-.
`s,
`00 =-i
`
`\C
`
`\C =-.
`\C
`~
`F
`~
`~
`~
`~
`
`~ i = """"'
`
`•
`00
`d •
`
`Facsimile
`Modem
`Custom
`
`VoiceView V.17 14400 bps
`VoiceView V.17 12000 bps
`Voice View V. 17 9600 bps
`VoiceView V. 17 7200 bps
`Voice view V .29 4800 bps
`VoiceView V.29 9600 bps
`Voice View V.27ter 4800 bps
`VoiceView V.21 300 bps
`
`Not Used
`Not Used
`Not Used
`Not Used
`
`I
`0
`I
`
`I
`I
`0
`0
`0
`0
`0
`0
`
`I
`0
`X
`X
`
`0
`0
`0
`
`0
`0
`I
`I
`I
`0
`0
`0
`
`I
`0
`X
`X
`
`I
`I
`0
`
`0
`0
`0
`0
`0
`I
`I
`I
`
`I
`0
`X
`X
`
`0
`0
`0
`
`0
`I
`I
`0
`I
`I
`0
`I
`
`X
`X
`I
`0
`
`0
`0
`0
`
`I
`0
`I
`I
`0
`I
`I
`0
`
`X
`X
`I
`0
`
`I
`I
`I
`
`0
`0
`0
`0
`0
`0
`0
`0
`
`X
`X
`I
`0
`
`Data Mode
`
`628 Hz
`
`2912.5 Hz 2130 Hz
`
`811 Hz
`
`2312.5 Hz 1412 Hz
`
`Second Tone Period
`
`First Tone Period
`
`Fig. 10
`
`IPR2020-00034 Page 00010
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 10 of 16
`
`5,583,922
`
`ca
`.....
`ctS
`C
`
`O> ca u:
`
`,-
`
`0 er u
`~
`
`Cl) (\J
`Q)
`
`Q)
`-0
`0
`:E Cf)
`(\J g
`iI:
`(\J
`
`~
`(0 co ,-
`
`,....
`C\I .
`>
`
`,..._
`cci
`(\J
`
`~ .
`
`Cl').
`lO
`
`~
`Ct)
`lO
`
`-
`
`'o o,_
`
`---
`
`,-..
`,-..
`
`• -~ L(
`
`Q)
`C:
`
`t2
`
`..... ... ca -(/)
`
`Q)
`(.)
`C:
`
`Q) -·-(/)
`
`Q)
`(.)
`
`~
`
`0
`0
`(\J
`I
`
`0 co ,-
`
`lO
`Cl')
`I
`lO ,-
`
`Cf)
`"O
`C:
`0
`(.)
`Q)
`
`rJJ ·(cid:173)--·-~
`
`IPR2020-00034 Page 00011
`
`

`

`N
`N
`\0
`~ _,.
`00
`Ul
`_,.
`Ul
`
`0-.
`i,-
`
`0 ...,
`l'D ....
`r.,;. =- l'D
`
`i,-
`i,-
`
`i,-
`~
`l'D
`~
`
`0-.
`\0
`\0
`i,(cid:173)
`9
`
`~ i a
`
`•
`• r.,J.
`Cj
`
`Detect Start Tone Detect Flag Detect Mode Tone
`
`\Run CCITT
`
`I CNG
`
`~ Protocol
`
`I CED
`
`T.30
`
`Detect UA Frame
`
`'
`
`I
`I
`I
`
`I MTone I lv.21 Data!
`
`Unscrambled binary
`
`1 at 1200 bps
`
`12100 Hz I -----
`\
`
`\
`
`1
`
`Protocol (V.22 bis) /
`
`Start Data
`
`Modem
`
`Voice I Silence I Start Tone I I Flags 11 MTone I
`Originating DCE
`
`Fig. 13
`
`Detect Mode Tone
`
`Detect Start Tone
`
`Detect Flag
`
`I MTone I _I v-_2_1_o_a-ta-l
`
`I
`I
`
`\ ;
`
`\ ;
`
`Voice
`Answering DCE
`
`~
`,
`
`\
`
`~
`1
`\
`
`~
`I
`;
`\
`
`Voice
`
`Answering DCE
`
`Flags MTone
`
`Voice I Silence I Start Tone
`
`Detect UA Frame
`
`Fig. 12
`
`Originating DCE
`
`IPR2020-00034 Page 00012
`
`

`

`!")
`~
`~
`
`~ a. (D = ~
`d • 'fJ).
`
`•
`
`Voice
`
`Data
`
`MTone
`
`I
`
`Voice
`
`Receive Capabilities Response
`
`Detect CAS/lnterpret as Query
`
`Detect Start Tone
`
`Fig. 15
`
`;
`\
`
`\
`
`Voice
`
`Answering DCE
`
`' "
`
`ADSICAS
`
`Voice I Silence!,_ -S-t-art-"fi-on_e_l
`Originating DCE / /
`
`/
`
`Capabilities Query
`
`Fig. 14
`
`N
`N
`\0
`~ _,.
`00
`01
`_,.
`01
`
`I-" =-.
`s,
`N
`I-"
`~
`
`r.,:;. =(cid:173)~
`
`I-" ~=
`
`',c
`I-"
`
`',c =-.
`
`Receive Capabilities Response
`
`Detect Start Tone Dectect CASllnterpret as Query
`
`Voice
`
`Data
`
`MTone
`
`ADSICAS
`
`I Start Tone
`
`Voice
`
`I
`
`\
`
`\
`
`Answering DCE
`
`Voice
`
`Data
`
`MTone
`
`Receive Capabilities Exchange Msg with Polling
`
`'
`
`'
`
`Capabilities Query
`
`Voice I Silence ( Start Tone l
`Originating DCE
`
`/
`
`/
`
`IPR2020-00034 Page 00013
`
`

`

`
`
`BOUIIIS|BOIOA 390dSuiemsuy
`
`
`
`C
`
`ca
`r;:
`
`(l)
`Q)
`C
`
`Q)
`C:
`~
`(l)
`"O
`0
`~
`0
`Q)
`
`Q)
`
`Q)
`C:
`~
`ca
`
`0
`
`C
`
`Q)
`
`.2
`w
`(.) ~
`C
`O>
`C
`·c
`Q)
`~
`ti)
`C:
`c(
`
`IPR2020-00034 Page 00014
`
`U.S. Patent
`U.S. Patent
`
`Dec. 10, 1996
`Dec. 10, 1996
`
`Sheet 13 of 16
`Sheet 13 of 16
`
`5,583,922
`5,583,922
`
`Q)
`C:
`
`t2
`
`Q)
`"O
`0
`::E
`0
`"O
`
`-
`C: w -0
`Q) -Q)
`
`
`
`QUOLSpoJOpug399}9qBe}4199}0q
`
`Q)
`0
`
`~
`
`Q)
`0
`
`~
`
`(/)
`i5
`
`Q)
`
`-- ()
`-- C:
`
`t2
`~
`
`,2
`::E
`
`h\\
`
`91‘big
`
`<o
`,.._
`-.~
`LL:
`
`
`
`OSIdaalsoay
`
`()
`(/)
`C
`Q)
`>
`·a;
`0
`Q)
`cc
`
`w
`(.)
`C
`O>
`C
`ca
`·-O>
`C
`·c
`0
`
`O>
`
`LL
`
`(l)
`C:
`,2
`ca
`
`Q)
`0
`C:
`.9:?
`·-
`(/)
`
`Q)
`
`~
`
`Ud]Bpo-;y}99}9q
`
`
`(l) _ _,.,.
`oun||s6eis|
`C: -
`-
`O> -
`0 -0
`rn -_,.,.
`-
`Jg -
`
`QUO]URISO9}0Gg
`\|SUOLEISSudlURIS
`-....
`-(/)
`t:: ---
`-
`-(/)
`(1) -(1)
`30dSuyeubuo
`·-- 0
`
`IPR2020-00034 Page 00014
`
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 14 of 16
`
`5,583,922
`
`Bits 8
`
`0
`
`0
`
`7
`
`0
`
`0
`
`6
`
`0
`
`0
`
`Fig. 17
`
`5
`
`4
`
`3
`
`2
`
`0
`0
`Address
`P/F
`0
`UI Control
`
`0 CIR
`
`0
`
`I
`
`1
`
`I
`
`Octet
`
`Capabilities Message
`
`FCS (first octet)
`i---------------:--
`FCS (second octet)
`
`2
`
`•
`
`•
`
`•
`
`Fig. 18
`
`Bits 8
`
`7
`
`6
`
`5
`
`4
`
`3
`
`2
`
`Message Type
`
`Message Length
`
`Capability Element
`
`Capability Element
`
`Octet I
`
`2
`
`3
`•
`•
`•
`
`IPR2020-00034 Page 00015
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 15 of 16
`
`5,583,922
`
`8
`
`0
`
`8
`
`0
`
`8
`
`I
`
`7
`
`0
`
`7
`
`I
`
`7
`
`0
`
`Fig. 19a
`
`6
`
`5
`
`4
`
`3
`
`2
`
`capability type identifier
`
`Octet I
`
`Fig. 19b.
`
`6
`
`5
`
`4
`
`3
`
`2
`
`capability type identifier
`
`capability options
`
`Octet I
`
`Octet 2
`
`Fig. 19c
`
`6
`
`5
`
`4
`
`3
`
`2
`
`capability type identifier
`
`capability options
`
`capability options
`
`Octet I
`
`Octet 2
`
`Octet 3
`
`Octet I
`
`Octet 2
`
`Octet 3
`•
`•
`Octet N
`
`Fig. 19d
`
`8
`
`7
`
`6
`
`5
`
`4
`
`3
`
`2
`
`capability type identifier
`
`I
`I
`length of contents of the capability element
`(octets)
`
`capabilty options
`
`capability options
`
`IPR2020-00034 Page 00016
`
`

`

`U.S. Patent
`
`Dec. 10, 1996
`
`Sheet 16 of 16
`
`5,583,922
`
`Fig. 20
`
`Octet 1 Bits
`
`6 5 4 3 2 1
`
`Capability Type
`.
`.
`.
`Modem Data Mode .
`0 0 0 0 0 1
`Facsimile Data Mode .
`.
`.
`0 0 0 0 1 0
`.
`.
`.
`VoiceView Data Mode .
`0 0 0 1 0 0
`ADSI Server (data transmitter using
`. .
`. .0 0 1 0 0 0
`Bell 202 modulation) .
`ADSI CPE (data receiver using Bell
`. . .
`.
`. .0 0 1 0 0 1
`202 modulation)
`. . .
`Proprietary . .
`.
`.
`. 1 1 1 1 1 1
`
`IPR2020-00034 Page 00017
`
`

`

`5,583,922
`
`1
`TELECOMMUNICATION SYSTEM FOR
`AUTOMATIC SWITCHING BETWEEN
`VOICE AND VISUAL DATA
`COMMUNICATIONS USING FORMS
`
`RELATED APPLICATION
`
`5
`
`2
`Davis discloses a telecommunication display system for
`accommodating both voice and data over a single telephone
`line. The receiving party is provided with a display terminal
`14 that is connected to the telephone line 22, 52 between the
`telephone network 50 and the base of the users telephone 12
`as shown in FIG. 1 of U.S. Pat. No. 5,164,982. The display
`terminal includes a voice/data selector that can automati(cid:173)
`cally recognize digital data and switches from voice com(cid:173)
`munication to data communication modes. This patent dis-
`10 cusses one embodiment of the VoiceView™ products
`marketed by Radish Communications Systems, Inc. of Boul(cid:173)
`der, Colo.
`Emmons et al. disclose an example of a conversational
`video phone. The device communicates both audio signals
`and freeze-frame video images over a standard telephone
`line.
`Yoshida discloses a telephone communication system that
`recognizes speech and automatically switches from data to
`speech transmission.
`Cooper-Hart et al. disclose a conversational freeze-frame
`video phone that has been marketed by Luma Telecom, inc.
`under the name "Luma." This system includes a camera for
`periodically capturing an image that is converted into digital
`data and transmitted over the telephone line to a remote unit
`in a single short burst. Audio transmission is interrupted
`upon detection of a video signal being transmit~ed.
`Young discloses a system for teleconferencing and teach(cid:173)
`ing. Supporting material (e.g., slides) for the presentation are .
`prepared in advance and sent from the originating location
`to a number of remote locations prior to the presentation. .
`The audio portion of the presentation is transmitted by
`standard telephone service from the originating location to
`the remote locations. The telephone line also carries control
`signals from the originating location to control presentation
`of the supporting materials at each remote location.
`Dumas discloses a teleconferencing system that supports
`both audio and graphic communications. Each user has a
`personal computer (PC) with a smart modem that monitors
`the telephone line for a predetermined set of identification
`codes indicating that graphics are about to be sent by another
`conference participant.
`Artom discloses another example of a telephone system
`for combining voice and data communications over a single
`telephone line.
`The advertisement for the Intel ProShare video system
`describes a telecommunications system for voice and video
`communications over an ISDN line, local area network
`(LAN), or two analog telephone lines. One application for
`the ProShare system allows users to review and revise a
`common document that appears on each user's computer
`screen. It is believed that the ProShare system was first
`introduced around January, 1994.
`However, none of the prior art provide a protocol for
`exchanging data using visual forms within the context of
`combined voice and data communications over a single
`conventional telephone line. Such visual forms offer a
`number of substantial advantages in terms of: (1) simplify(cid:173)
`ing and standardizing the interface for data communications
`between stations; (2) increasing system performance by
`limiting the amount of data that must be transmitted to the
`fields that have been the subject of an action at either station;
`(3) providing a means for specifying rules for data entry and
`validation, and (4) providing an architecture whereby sys(cid:173)
`tem control and intelligence can be relegated to a remote
`station. The present invention also allows visual forms to be
`used in a number of settings. For example, the present
`
`The present application is a continuation-in-part of co(cid:173)
`pending U.S. patent application Ser. No. 08/380,064, filed
`Jan. 30, 1995, entitled "Telecommunication System for
`Automatic Switching Between Voice and Visual Data Com(cid:173)
`munications Using a Voice Response Unit (VRU)", which is
`a continuation-in-part of pending U.S. patent application
`Ser. No. 08/271,850, filed Jul. 7, 1994, which is a continu(cid:173)
`ation-in-part of U.S. Ser. No. 877,328, filed May 1, 1992, 15
`U.S. Pat. No. 5,365,577, issued on Nov. 15, 1994, which is
`a continuation-in-part of U.S. Ser. No. 589,203, filed Sep.
`27, 1990, U.S. Pat. No. 5,164,982, issued on Nov. 17, 1992.
`
`BACKGROUND OF THE INVENTION
`
`20
`
`25
`
`1. Field of the Invention
`The present invention relates generally to the field of
`telephony. More specifically, the present invention discloses
`a telecommunication system for voice and data communi(cid:173)
`cations over a single conventional telephone line using
`visual forms.
`2. Statement of the Problem
`The present invention is intended to address the general
`problem of communicating both voice and data over a single 30
`conventional telephone line between a server station and a
`client station. It is often desirable to be able to transmit data
`over a single telephone line interspersed with verbal discus(cid:173)
`sions between the parties. This data can be conveyed as a
`visual form relevant to the conversation. For example, a 35
`customer may wish to review airlines schedules and fares,
`and then make a reservation for a desired flight. A travel
`agent might wish to show a telephone customer a travel
`itinerary as they discuss it. An investor may wish to obtain
`market quotations, or place an order to buy or sell securities. 40
`A broker might want to show a customer a visual confir(cid:173)
`mation of a financial transaction. Each of these types of
`transactions can be facilitated by providing both the server
`station and client station with a shared visual form that is
`automatically updated to reflect actions taken at either 45
`station. These visual forms are populated with predefined
`controls or objects (e.g., data fields, push buttons, option
`lists, bitmap images, text fields, etc.) to provide a user(cid:173)
`friendly interface and to simplify creation of forms.
`Voice/Data Telecommunications-Prior Art. One 50
`embodiment of the present invention allows visual forms to
`be shared between a server station and a client station having
`live operators. A number of telephone systems have been
`invented in the past to allow transmission of both voice and
`data over a single telephone line, including the following: 55
`
`Inventor
`
`Patent No.
`
`Issue Date
`
`Davis
`Emmons et al.
`Yoshida
`Cooper-Hart et al.
`Young
`Dumas
`Artom
`
`5,164,982
`4,932,047
`4,815,121
`4,715,059
`4,682,957
`4,656,654
`4,387,271
`
`Nov. 17, 1992
`June 5, 1990
`Mar. 21, 1989
`Dec. 22, 1987
`July 28, 1987
`April 7, 1987
`June 7, 1983
`
`"Intel ProShare Video System" advertisement, ABA Journal (page 17, Feb.
`1995)
`
`60
`
`65
`
`IPR2020-00034 Page 00018
`
`

`

`5,583,922
`
`5
`
`3
`system allows operators at remote stations to simultaneously
`view the same visual form ( or at least visual forms with
`some fields in common). Actions at either station are auto(cid:173)
`matically transmitted to the other station and used to update
`its copy of the visual form.
`Voice Response Units-Prior Art. Another implementa(cid:173)
`tion of the present invention employs a modified voice
`response unit (VRU) as the server station to provide both
`voice and data communications over a telephone line using
`visual forms. For example, this embodiment is especially
`well suited for processing orders for goods or services, and
`providing information from databases (e.g., airlines sched(cid:173)
`ules, fares and reservations, billing questions, bank account
`information, or brokerage transactions).
`Conventional VRUs have been used for many years to
`provide an automated system for voice and audio commu(cid:173)
`nications with callers. In a typical conventional implemen(cid:173)
`tation, the VRU transmits prerecorded voice messages to
`present the caller with a number of options. The caller 20
`selects one of the options by pressing a corresponding key
`on the caller's telephone key pad. The VRU then transmits
`voice messages that contain information requested by the
`caller, such as bank account balances, airline flight sched(cid:173)
`ules, etc. Most conventional VRUs are limited to commu- 25
`nication of voice and audio tones generated by the telephone
`key pad (e.g., DTMF tones). Therefore, most conventional
`VRUs are inherently limited in their ability to communicate
`data with the caller and have no ability to share screens of
`visual data with the caller.
`One family of VRU components widely used in the 30
`industry is manufactured by Dialogic Corporation of 300
`Littleton Road, Parsippany, N.J. 07054. Dialogic VRU com(cid:173)
`ponents can be combined to create VRU systems in a wide
`variety of configurations. One commonly used configuration
`employs a processor to control a network interface card and 35
`a number of voice cards, similar to the VRU 35 depicted in
`FIG. 2. The network interface card 27 handles a number of
`incoming telephone calls over a Tl carrier or a number of
`analog telephone lines. Each voice card 28 generates voice
`messages from prerecorded data and provides detection and 40
`AID conversion of incoming voice signals. The VRU system
`components can communicate digital voice data with one
`another by means of a PCM expansion bus (PEB) 29. An
`additional ISA or equivalent bus 33 is included to enable the
`processor 20 to communicate with the VRU system com- 45
`ponents as well as other computer components, such as hard
`disk drives and serial ports using a conventional bus archi(cid:173)
`tecture similar to that found in most personal computer
`systems. The processor controls the sequence of operation of
`the entire VRU from a preprogrammed script. For example,
`the script may cause the processor to direct one of the voice
`cards to transmit a series of verbal messages that provides
`the caller with a list of options (e.g., "Press one if you have
`billing questions. Press two for a new service request. Press
`three if you have a natural gas leak.", etc. ) The caller selects
`one of the options by pressing the corresponding key on the 55
`telephone key pad, which transmits an audio signal to the
`VRU. The VRU voice card detects the audio signal and the
`processor follows the script for the selected option. Instruc(cid:173)
`tions are issued by the processor to the network interface
`card and voice cards over the ISA bus using a predefined 60
`command protocol. Digitized voice data can also be com(cid:173)
`municated over the PEB bus from the voice cards to the
`network interface card or other system components.
`A number of other voice processing systems, interactive
`voice response (IVR) systems, and automated systems for 65
`transmitting data in response to telephone calls have been
`invented in the past, including the following:
`
`10
`
`15
`
`50
`
`4
`
`Inventor
`
`Patent No.
`
`Issue Date
`
`Giler et al.
`Lalonde et al.
`Stent et al.
`Baran et al.
`Sattar
`Sattar et al.
`Mitchell et al.
`Jolissrunt
`Duehren et al.
`
`5,291,546
`5,283,731
`5,276,732
`Reissue 34,429
`5,255,305
`5,243,643
`5,164,981
`5,040,208
`4,918,722
`
`Mar. 1, 1994
`Feb. 1, 1994
`Jan. 4, 1994
`Nov. 2, 1993
`Oct. 19, 1993
`Sep. 7, 1993
`Nov. 17, 1992
`Aug. 13, 1991
`Apr. 17, 1990
`
`Giler et al. disclose a fax message system in which action
`information is stored for each fax at a fax receiving station.
`In one embodiment, the sending party provides routing
`information for the fax that is stored by the fax receiving
`station.
`Lalonde et al. disclose a computer system for creating a
`database of classified ads. The system can be accessed by
`means of an interactive voice response system that converts
`text from the database into a voice message.
`Baran et al. disclose an interactive facsimile system that
`allows an unmodified fax machine to interactively select and
`retrieve facsimile pages from a database on a fax server. The
`remote user marks a paper selector sheet form using a pencil
`or pen. The selector sheet is then transmitted by the remote
`fax machine to the fax server.
`The patents to Sattar and Sattar et al. disclose a voice
`processing system (e.g., for voice mail) that can be config(cid:173)
`ured to allow different caller interfaces for each caller.
`Mitchell et al. disclose a voice response system for
`providing interactive data exchange between a caller, an
`operator, and one or more databases. A voice path switch
`initially connects the caller to a databa~e through a voice
`response unit that provides digitized voice prompts and
`questions to the caller. The caller responds by entering
`numbers on the telephone key pad. The voice response unit
`then converts data from the database to voice signals rec(cid:173)
`ognizable by the caller. The voice response unit or the caller
`may selectively transfer the transaction to a human operator.
`The system also provides the operator with a list of infor(cid:173)
`mation transacted thus far between the caller and the voice
`response unit.
`Stent et al. disclose another example of a database
`retrieval system having a voice response unit 26 that
`prompts the caller to make selections by means of DTMF
`signals. The system also allows the call to be switched to a
`human operator.
`Jolissaint discloses a coordinated voice and data display
`system having the capability of suspending a telephone call
`in anticipation of resuming the call at a time in the future.
`The system includes a number of telephones 18 managed by
`a computerized branch exchange (CBX) 14 and a number of
`display terminals 16 managed by a host processor 12. If the
`system becomes congested with incoming calls, the caller
`may be offered the option of leaving a call-back message
`with the system. In one embodiment, a VRU is used to
`prompt the caller to provide information (e.g., the caller's
`telephone number and a call-back time) by means of DTMF
`keys that is stored and subsequently used in the call-back
`procedure.
`Duehren et al. disclose a system in which the delivery of
`electronic information (e.g., fax or binary data) is controlled
`by DTMF commands sent by the user using the telephone
`key pad.
`3. Solution to the Problem
`None of the prior art references uncovered in the search
`show a telecommunications system that supports both voice
`
`IPR2020-00034 Page 00019
`
`

`

`5,583,922
`
`5
`and data communications using a protocol for exchanging
`visual forms. In one embodiment, this enables operators at
`two remote stations to view and discuss a common visual
`form. Any actions taken with respect to the visual form are
`automatically transmitted to the other station so that both 5
`copies of the visual form remain synchronized. In another
`embodiment, a modified VRU is used as the server station.
`The subscriber station displays a visual form that provides
`an interface for data communications with the VRU.
`
`SUMMARY OF THE INVENTION
`
`6
`FIG. 1 is a schematic block diagram of the present system
`showing communication over a telephone network between
`a client station 100 and a server station 200.
`FIG. 2 is a schematic block diagram of an alternative
`embodiment of the present system showing communication
`between a client station 100 and a server station 200
`employing a voice response unit 35.
`FIG. 3 is a schematic block diagram of an alternative
`embodiment of FIG. 2 in which a PBX 190 is employed to
`10 switch a telephone call from the VRU 35 to a live operator.
`FIGS. 4 through 6 are examples of visual forms displayed
`by the client station.
`FIG. 7 is a schematic block diagram of the data circuit(cid:173)
`terminating equipment (DCE) 14.
`FIG. 8 is a diagram of the signals transmitted by a DCE
`constituting the data mode start sequence.
`FIG. 9 is a diagram of the mode tone (MTone) portion of
`the data mode start sequence.
`FIG. 10 is a table of the different data modes for each
`combination of first and second tones shown in FIG. 9.
`FIG. 11 is a diagram of an alternative embodiment of the
`data mode start sequence in which the mode tone sequence
`is replaced with data encoded in a V.21 HDLC frame to
`identify the data mode.
`FIG. 12 is a diagram of a successful data mode start
`sequence between an originating DCE and an answering
`DCE using modem data mode (V.22bis protocol).
`FIG. 13 is a diagram of a successful data mode start
`sequence between an originating DCE and an answering
`DCE using facsimile data mode (CCITT T.30 protocol).
`FIG. 14 is a diagram of a capabilities query and response
`sequence for a DCE.
`FIG. 15 is a diagram of a capabilities exchange sequence
`for a DCE.
`FIG. 16 is a diagram of an unsuccessful data mode start
`sequence for fax or modem data mode in which the start
`40 sequence is rejected by the answering DCE.
`FIG. 17 is a diagram of the message format used for
`communicating capabilities information between DCEs.
`FIG. 18 is a diagram of the format of the capabilities
`query message I-field.
`FIGS. 19a through 19d are diagrams of the formats of
`capability elements within a capabilities query message for:
`(a) single octet format; (b) double octet format; (c) triple
`octet format; and ( d) variable length format for three or more
`octets, respectively.
`FIG. 20 is a table of the codings for the "capability type
`identifier" field in the capability elements shown in FIGS.
`19a through 19d.
`
`This invention provides a telecommunication system for
`voice and data communications over a conventional tele- 15
`phone line between a server station and a client station using
`visual forms. The client station includes a processor, display,
`telephone, and data circuit-terminating equipment (DCE) for
`data communications. The server station includes a proces(cid:173)
`sor, DCE, and either a telephone or a voice card for audio 20
`communications. Each DCE includes a modem, a start
`signal generator for transmitting a start signal over the
`telephone line prior to transmission of data by the modem,
`a start signal . detector, and a switch that automatically
`switches the DCE from voice mode to data mode while data 25
`is being communicated. The client processor also includes a
`definition of a visual form having a number of controls with
`predetermined properties, including properties defining per(cid:173)
`missible actions that can be taken with respect to each
`control and instructions to be executed in response to 30
`specified actions. The client employs a mouse, keyboard, or
`the like to select a control in the visual form and to perform
`an action on the selected control (e.g., press a button, select
`an option from a list, or enter data in a field). At least some
`of the controls include a property directing the client pro- 35
`cessor to switch the DCE to data mode, transmit data
`identifying the action, and then return to voice mode. The
`server processor is programmed to execute steps in response
`to the actions received from said client station. For example,
`the server station can be a voice response unit (VRU) used
`to process orders or provide account information in response
`to actions on the client station's form. Alternatively, the
`server station can display a visual form having at least some
`· controls in common with the client's visual form that are
`automatically updated to reflect changes to the client's 45
`visual form. The visual forms at both