United States Patent
`
`[19]
`
`[11] Patent Number:
`
`6,134,223
`
`
`Burke et al.
`[45] Date of Patent:
`*Oct. 17, 2000
`
`U8006134223A
`
`[54] VIDEOPHONE APPARATUS, METHOD AND
`SYSTEM FOR AUDIO AND VIDEO
`CONFERENCING AND TELEPHONY
`
`.
`5,371,534 12/1994 Dagdeviren et a1.
`5,534,914
`7/1996 Flohr et a1.
`............................... 348/15
`
`.. 370/260
`5,627,825
`5/1997 Barraclough et a1.
`.
`5,675,375
`10/1997 Riffee ........................................ 348/15
`
`[75]
`
`Inventors: Timothy M. Burke, Algonquin;
`Douglas J. Newlin, Geneva, both of 111.
`
`[73] Assignee: Motorola, Inc., Schaumburg, Ill.
`[*] Notice:
`This patent issued on a continued pros-
`ecution application filed under 37 CFR
`1.53(d), and is subject to the twenty year
`patent
`term provisions of 35 U.S.C.
`154(a)(2).
`
`[21] Appl. No.: 08/715,887
`.
`Sep. 18: 1996
`F1169:
`[22]
`Int. Cl.7 ..................................................... H04Q 11/00
`[51]
`[52] US. Cl.
`............................. 370/265- 348/15- 379/202
`[58] Field 0f Search
`’
`370/260 261
`370/263, 265, 266, 267, 268, 269, 270,
`271, 463; 348/15, 423, 379/202, 206
`
`[56]
`
`.
`References Clted
`U.S. PATENT DOCUMENTS
`
`4,847,829
`4,995,071
`5,042,062
`5,343,240
`
`........................ 348/15
`7/1989 Tompkins et a1.
`2/1991 Weber et a1.
`........................... 370/260
`8/1991 Lee et 211..
`8/1994 Yu .
`
`Primary Examiner—Chan Nguyen
`Assistant Examiner—Soon-Dong Hyun
`Attorney, Agent, or Firm—Hugh C. Dunlop; Romi N. Bose
`[57]
`ABSTRACT
`Avideo access apparatus (110, 150, 750, 850) provides for
`audio and video teleconferencing and telephony via a first
`communication channel (103) coupled to a primary station
`(105) having communication with a network (140), such as
`the public switched telephone network or an ISDN network.
`The video access apparatus (110) includes a video network
`interface (210); a radio frequency modulator/demodulator
`(205); a user interface (215); and a processor arrangement
`(1.90) “10160th6 appérams (709 800) is ?0uPleable to a
`“dc". access ”Farms “a a 5&9“? commun}cat1°“. Channel
`for v1deo receptlon and transmlsslon, and v1a a th1rd com-
`munication channel for audio reception and transmission.
`The videophone apparatus includes a video monitor (715), a
`camera interface (235), a video camera (720), and a tele-
`phony module (710). Multiple videophone apparatuses (700,
`800) may be used simultaneously, and multiple video signals
`from the videophone apparatuses (700, 800) may be multi-
`plexed and combined into one composite video signal for
`-
`-
`transmlssmn to the network (140)
`
`14 Claims, 12 Drawing Sheets
`
`|— _____________________________________________ 1
`
`__ - —
`
`276
`V
`103
`.A
`
`\
`
`RF DEMODULATOR
`CHANNEL '0'
`
`2 75a
`
`'T
`
`I
`
`227
`
`
`
`
`
`RF CARRIER
`DETECTOR AND
`SWITCH
`
`.:
`275:
`
`l
`'
`l
`l
`
`
`RF DEMODULATOR
`'
`CHANNEL ’n'
`265
` CATv RF
`
`TRANSCEIVER
`AUDIO/VIDEO COMPRESSION
`
`
`AND DECOMPRESSION
`SUBSYSTEM
`
`
`250
`
`COMMUNICATIONS
`ASIC
`
`255
`
`:
`
`USER/AUDIO
`INTERFACE
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 1
`
`IPR2020-00200
`Apple Inc. EX1013 Page 1
`
`

`

`US. Patent
`
`Oct. 17,2000
`
`Sheet 1 0f 12
`
`6,134,223
`
`COMMUNICATIONS
`CONTROLLER
`
`PROCESSOR
`
`705
`
`
`
`
`
`
`
`
`ARRANGEMENT
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 2
`
`IPR2020-00200
`Apple Inc. EX1013 Page 2
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheetz 0f12
`
`6,134,223
`
`mmww
`
`mum.
`
`————_———
`
`a
`
`
`
`onmmmzmzouomaH>\OHo=<
`
`
`
`zwpm>mm=monmmmmmzoomaoz<
`
`mo~<gzoozmomm
`
`zo_<4=oo=
`
`gm
`
`<zmz<o
`
`mo<mmmHzH
`
`memmmoowmoonz
`
`zmpm»mm=m
`
`mm>H<o
`
`zm>Hwomz<mh
`
`monh<onzzzoo
`
`on<
`
`oHo=<\zmm=
`
`mu<mmmHzH
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 3
`
`IPR2020-00200
`Apple Inc. EX1013 Page 3
`
`
`
`
`
`
`
`
`

`

`S.U
`
`3
`
`6,134,223
`
`255-2"PamrIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIL
`$3382325::_mn11s1:E50%Wigwam:
`2&(L3,:ng._mn3.am,2m“eenI,5x;
`
`n,_QRn2,3%_m__0un_3:31;;
`
`a.mVuNkn9%n0_22:22.
`55:20::I/\_
`
`n_pm.1lllllllllllllllllllllllL
`
`m.QNkama._
`
`8n“SM,
`
`
`
`=MHm>mm=monmmmzmzoome
`
`on<
`
`\onmmmzmzooomoH>\oHo3<
`
`monH<onzzzoo
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 4
`
`IPR2020-00200
`Apple Inc. EX1013 Page 4
`
`
`
`
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet4 0f12
`
`6,134,223
`
`omoH>
`
`moh<43ooz
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 5
`
`mmN.I|\Lmg
`
`OmoH>
`
`QZHmmmuomm
`
`
`
`~3¢2HemoH>\oHo=<
`
`memmmooxm
`
`a\<mam
`
`gubzm>zoo
`
`new
`
`mmo
`
`<\omom
`
`gubmm>zoo
`
`I | | | | | I I l | | | | | I I I I I I | | I I I I | | | | | | | I I I I I
`
`IPR2020-00200
`Apple Inc. EX1013 Page 5
`
`
`
`
`
`
`
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet 5 0f 12
`
`6,134,223
`
`unm‘luy
`
`mMHAHg
`
`QKVV
`
`mo~<44Homo
`
`367%
`
`saw
`
`mm<maz<m I.
`
`
`
`ImamNI:com
`
`xmp4Hm
`
`OMQH>
`
`<mu2<o
`
`
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 6
`
`IPR2020-00200
`Apple Inc. EX1013 Page 6
`
`
`
`
`

`

`US. Patent
`
`Oct. 17,2000
`
`Sheet 6 0f 12
`
`6,134,223
`
`
`
`
`
`
`
`
`
`RECEIVING A RADIO FREQUENCY INPUT
`VIDEO SIGNAL AND AN INPUT
`AUDIO SIGNAL
`
`RECEIVING A FIRST PROTOCOL
`SIGNAL TO FORM A RECEIVED
`PROTOCOL SIGNAL
`
`
`
`CONVERTING THE RECEIVED PROTOCOL
`SIGNAL TO A BASEBAND OUTPUT
`
`VIDEO SIGNAL AND AN
`
`OUTPUT AUDIO SIGNAL
`
`
`
`
`DEMODULATING THE RADIO FREQUENCY
`
`INPUT VIDEO SIGNAL TO FORM
`
`A BASEBAND INPUT VIDEO SIGNAL
`
`
`
`
`
`CONVERTING THE BASEBAND INPUT
`
`MODULATING THE BASEBAND OUTPUT
`VIDEO SIGNAL AND THE INPUT
`VIDEO (AND AUDIO) SIGNAL TO
`
`
`AUDIO SIGNAL TO A SECOND
`
`FORM A RADIO FREQUENCY
`
`
`
`PROTOCOL SIGNAL
`
`OUTPUT VIDEO (AND AUDIO) SIGNAL
`
`
`
`
`
`TRANSMITTING THE RADIO FREQUENCY
`
`
`TRANSMITTING THE SECOND
`
`OUTPUT VIDEO (AND AUDIO) SIGNAL
`
`PROTOCOL SIGNAL TO FORM
`
`TO FORM AN OUTPUT AUDIO/
`
`
`A TRANSMITTED PROTOCOL SIGNAL
`
`VIDEO CONFERENCE SIGNAL
`
`
`
`
`
` VIDEO
`
`CONFERENCE
`
`
`TERMINATED?
`
`
` 550
`
`RETURN
`
`FIGJI
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 7
`
`IPR2020-00200
`Apple Inc. EX1013 Page 7
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet 7 0f 12
`
`6,134,223
`
`Iflmi‘m
`
`605
`
`610
`
`PROVIDE USER INDICATION 0R ALERT
`AND COLLECT ANY NECESSARY
`SIGNALING INFORMATION
`
`YES
`
`635
`INITIALIZE VIDEO CONFERENCE
`CONTROL SYSTEM
`
`64(3
`
`COLLECT VIDEO INPUT REQUEST TYPE
`AND PERFORM REQUESTED SERVICE
`
`645
`
`REQUEST 0R SET UP VIDEO
`CONFERENCE CALL
`
`650
`
`ENTER VIDEO CONFERENCE MODE AND
`TRANSMIT DATA T0 NETWORK
`
` VIDEO
`
`CONFERENCE
`RE UESTED?
`0
`
`
`
`675
`
`"0
`
`520
`
`REQUEST 0R 3E1 up
`IELEPHONY CALL
`
`625
`
`
`
`ENTER TRANSPARENT MODE
`AND TRANSMIT DATA T0 NETWORK
`
`
`
`630
`
` CALL
`TERMINATED?
`
`
`YES
`
`
`
`VIDEO
`
`
`CONFERENCE
`RETURN
`
`TERMINATED?
`
`
`
`F1012
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 8
`
`IPR2020-00200
`Apple Inc. EX1013 Page 8
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet8 0f12
`
`6,134,223
`
`zep<gzeozmamm
`
`
`
`.o.guzz<zo
`
`zuHm¢<omm.Qmm
`in?...
`
`ENE\m2:i
`
`mmm‘
`
`m3."
`
`mo~<43oo=ma#1
`
`_=_guzz<Io
`
`
`
`onmmmzmzooomoH>\oHo=<
`
`onmmmxmzoomooz<
`
`zmhm>mm=m
`
`:m_m>mm:m
`
`
`
`8N$830952onam
`
`gm>H<o
`
`mm>Hmomz<xb
`
`monh<onszzoo
`
`on<
`
`oHo=<\zmm=
`
`mo<mmmsz
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 9
`
`IPR2020-00200
`Apple Inc. EX1013 Page 9
`
`
`
`
`
`
`
`
`
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet 9 0f 12
`
`6,134,223
`
`VIDEO
`
`MONITOR
`
`
`CAMERA
`
`INTERFACE
`
`VIDEO
`
`MONITOR
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 10
`
`IPR2020-00200
`Apple Inc. EX1013 Page 10
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheet10 0f12
`
`6,134,223
`
`.3..me
`
`
`
`can}EN355me
`
`zommmoozmoonz
`
`
`
`onmmmmmzoocmoH>\oHo=<
`
`onmmmmmzoomooz<
`
`supm>mm=m
`
`Qmm
`
`mmm
`
`monH<onzz=oo
`
`on<
`
`oHa:<\zmw=
`
`mu<mmmp2H
`
`wmm
`
`(II_IlmewrIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIL
`522%4omozsoofiaEI«Km..p
`.o.
`
`.
`
`mo~<gamo=mogm
`
`
`
`.=.guzz<zo
`
`afl—
`
`zoh<4=ao=mamm guzz<zo
`
`omm.
`
`um>H<o
`
`omoz<¢xw
`
` mm>Hmomz<zH
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 11
`
`IPR2020-00200
`Apple Inc. EX1013 Page 11
`
`
`
`
`
`
`
`

`

`US. Patent
`
`Oct. 17, 2000
`
`Sheetll 0f12
`
`6,134,223
`
`
`
`
`
`oszmmoommoon>
`
`awe
`
`H=¢zH>\<
`
`mommmoozm
`
`ppmzH>\<
`
`memmwoozm
`
`HDQZH>\<
`
`zommmoozm
`
`mom
`
`a\<
`
`mom
`
`o\<
`
`mom
`
`o\<
`
`mmpmm>zoo
`
`mmpmm>zoo
`
`mmhmu>zoo
`
`
`
`.n.gmzz<=o
`
`mo~<43oozuogm
`
`.FAmzz<=o
`
`2.92US.
`
`mo~<gzaozmomm .o.
`
`guzz<zo
`
`mo_<4=aozmomm
`
`at.$538(a
`
`mom
`
`2nESE
`
`IIIIL
`
`N mN
`
`mm
`
`mo~<43902
`
`omN
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 12
`
`IPR2020-00200
`Apple Inc. EX1013 Page 12
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`US. Patent
`
`()cL 17,2000
`
`Sheet12 0f12
`
`6,134,223
`
`
`
`
`
`
`
`_mmHm<20“<20Hw<20H=¢ZHyozm30mmm...g<onmOMQH>HDQZH»ozm=owmm4<zofimOmoH>H=¢2Hyozmzomm_OHQ=<FDlZH
`
`
`
`oHo<mIbz<w>HmommoHo<zazoomm<m>HmommoHo<zszH;<M>Hmommz<M>Hwowz
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`guzz<zoIbzQAmzz<zoazoomm<20guzz<zo
`
`
`
`eN3%Na
`
`
`
`
`
`oHo<zI_zHIPMH<A=QOIMQ9200mmHIPMH<4DQOZMQ
`
`OHg<mmeHmMIHMH<4=eo=mo
`
`
`
`
`
`
`
`emQH>_=QZH>sz30mz;OMQH>_=¢ZH>02m=owz¢oHo<x
`
`
`
`
`
`
`
`3.95%
`
`mma
`
`Qmm
`
`“mm
`
`
`
`4<chmaccepommozooum<o_A<onmcmaH>omsz
`
`
`
`
`
`
`
`
`
`
`
`oh4<onmgoQOHozmozoommmz_HHzmz<mp
`
`
`
`
`
`g<onmgeochommcmh_Hzmz<zh<sac;
`
`
`
`
`sumA<onmcmoH>HDmZHaz<mmm<m32m4<onmcmoH>HsmzHoz<mmm<m
`
`
`
`
`
`1H2<:10;Oh4<onmozoowm<:10;OF4<onm
`
`
`
`oz<mmm<mhmsz<:10;oh
`
`
`
`
`
`4<onmcmoH>bzmzH
`
`I_zMIHHzm>zoo
`
`
`
`
`
`OMQH>PDQZHoz<mmm<m
`
`
`
`4<bHcHo:Hz<Obg<onm
`
`
`
`6N“a<onmmomNam“
`
`
`
`ozoommmzhhmm>zoo
`
`
`
`A<hHoHoozoomm<0%
`
`A<onmmom
`
`4<onmcmoH>FDQZHcz<mmm<m
`
`
`
`
`
`
`bmsz<OH4<onmOMQH>FDQZHoz<m
`A<onmmumA<HHOH¢
`
`uwm<mHmzH;HIPHzm>zoo
`
`
`
`
`
`mamA<HHQHQIhz=o=omzpHmmHmMIRmszzoo
`
`
`
`
`
`4<onmcmaH>omszzoo<m~<mmoohm4<onm
`
`
`
`-zoomzpoz<A<onwOHQ=<hslemzhHzm>zoo
`
`
`
`
`
`
`
`4<chmcmoH>HzmzH>02m=owxg
`
`3m8»
`
`QMXMQQHpgaz
`
`oawh<zH=xm
`
`
`
`onmmHzmz<mHOmoH>
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1013 Page 13
`
`IPR2020-00200
`Apple Inc. EX1013 Page 13
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`6,134,223
`
`1
`
`VIDEOPHONE APPARATUS, METHOD AND
`SYSTEM FOR AUDIO AND VIDEO
`CONFERENCING AND TELEPHONY
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`This application is related to a pending first application,
`Newlin et al., US. patent application Ser. No. 08/658,792,
`filed Jun. 5, 1996, entitled “Audio/Visual Communication
`System and Method Thereof”,
`(the “first
`related
`application”); and is related to a pending second application,
`Burke et al., US. patent application Ser. No. 08/706,100,
`filed Aug. 30, 1996, entitled “Apparatus, Method And Sys-
`tem For Audio And Video Conferencing And Telephony”,
`(the “second related application”); both incorporated by
`reference herein, with priority claimed for all commonly
`disclosed subject matter.
`FIELD OF THE INVENTION
`
`to audio and video
`This invention relates in general
`communications systems and, more specifically,
`to an
`apparatus, method and system for audio and video confer-
`encing and telephony.
`BACKGROUND OF THE INVENTION
`
`Currently, audio and video (visual) conferencing capa-
`bilities are implemented as computer based systems, such as
`in personal computers (“PCs”), as stand-alone, “roll about”
`room systems, and as videophones. These systems typically
`require new and significant hardware, software and
`programming, plus require significant communications net-
`work connections, for example, multiple channels of an
`Integrated Services Digital Network (“ISDN”) connection
`or a T1/E1 connection.
`
`For example, stand-alone, “roll about” room systems for
`audio and video conferencing typically require dedicated
`hardware at significant expense, in the tens of thousands of
`dollars, utilizing dedicated video cameras,
`television
`displays, microphone systems, and the additional video
`conferencing equipment. Such systems may also require as
`many as six (or more) contiguous ISDN B channels (or
`T1/E1 DSOs), each operating at 64 kbps (kilobits per
`second). PC based systems also typically require, at a
`minimum, ISDN basic rate interface service, consisting of 2
`ISDN B channels (each operating at 64 kbps) plus one D
`channel (operating at 16 kbps). Such communication net-
`work capability is also expensive and potentially
`unnecessary, particularly when the additional channels are
`not in continuous use.
`
`Current audio/visual telephony or conferencing systems
`are also limited to providing such audio/visual functionality
`only at designated nodes, i.e., the specific system location,
`and are neither mobile nor distributed (having multiple
`locations). Stand-alone, “roll about” room systems allow
`such audio and video conferencing only within or at that
`particular physical location. Video phones are also currently
`limited to their installed locations. Similarly, PC based
`systems provide such functionality only at the given PC
`having the necessary network connections (such as ISDN)
`and having the specified audio/visual conferencing
`equipment, such as a video camera, microphone, and the
`additional computer processing boards which provide for the
`audio/visual processing . For other PCs to become capable
`of such audio/visual conferencing functionality, they must
`also be equipped with any necessary hardware, software,
`programming and network connections.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`Such conventional audio/visual conferencing systems are
`also difficult to assemble, install, and use. For example, the
`addition of audio/visual functionality to a PC requires the
`addition of a new PC card, camera, microphone, the instal-
`lation of audio/visual control software, and the installation
`of new network connections, such as ISDN. In addition,
`such network connectivity may require additional program-
`ming of the PC with necessary ISDN specific configuration
`information, such as configuration information specific to
`the central office switch type of the service provider and
`ISDN service profile identifier (SPID) information. Video
`conference call set up procedures typically are also difficult
`and complicated utilizing these current systems.
`Conventional audio/visual
`telephony and conferencing
`equipment is also limited to communication with similar
`equipment at the far end (remote location). For example,
`videophone systems which utilize typical telephone systems
`(“POTS”—plain old telephone service) transmit information
`in analog form, for example, as trellis code modulated data,
`at V.34 and V.34 bis rates (e.g., highest rates of approxi-
`mately 28.8 to 33 kbps). Such POTS-based videophone
`systems would not be compatible with ISDN audio/visual
`conferencing and telephony systems which transmit infor-
`mation in digital form, such as utilizing Q.931 message
`signaling, Q.921 LAPD datalink, and Q.910 physical inter-
`face digital protocols, with data rates of 128 kbps (two B
`channels) or more with additional channels or DSOs.
`In addition, such current audio/visual telephony and con-
`ferencing equipment are relatively expensive and, in most
`instances, sufficiently expensive to be prohibitive for
`in-home or other consumer use. For example, the cost of roll
`about, room based systems is typically tens of thousands of
`dollars. PC based videoconferencing systems, with ISDN
`network connections, are also expensive, with costs in the
`thousands of dollars.
`
`Current audio/visual telephony and conferencing equip-
`ment also do not provide for multiple, simultaneous video
`conferences from more than one location. For example,
`current systems (such as those in PCs) do not provide for
`multiplexed video conference sessions, in which the output
`video may include display of video input from several video
`cameras at multiple locations.
`Accordingly, a need has remained for audio/visual con-
`ferencing and telephony systems, equipment, and methods
`which may operate at more than one designated node or
`location within the user premises, or may be mobile, or may
`be configured as needed for additional locations. Such a
`system should be compatible for use with other existing
`video conferencing systems, should be user friendly, easy to
`install and use, and should be relatively less expensive for
`in-home purchase and use by consumers. In addition, such
`a system should be able to provide multiple video confer-
`encing sessions which may originate from multiple loca-
`tions.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram illustrating an audio/video
`network configuration for a video access apparatus in accor-
`dance with the present invention.
`FIG. 2 is a high level block diagram illustrating a first
`embodiment of a video access apparatus and a first embodi-
`ment of a video conferencing system of the invention
`disclosed in the second related application.
`FIG. 3 is a detailed block diagram illustrating a second
`embodiment of a video access apparatus and a second
`embodiment of a video conferencing system of the invention
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 14
`
`IPR2020-00200
`Apple Inc. EX1013 Page 14
`
`

`

`6,134,223
`
`3
`disclosed in the second related application of the invention
`disclosed in the second related application.
`FIG. 4 is a block diagram illustrating a CATV RF trans-
`ceiver of the preferred apparatus embodiment of the inven-
`tion disclosed in the second related application.
`FIG. 5 is a block diagram illustrating a microprocessor
`subsystem and communications ASIC of the preferred appa-
`ratus embodiment of the invention disclosed in the second
`
`related application.
`FIG. 6 is a block diagram illustrating a audio/video
`compression and decompression subsystem of the preferred
`apparatus embodiment of the invention disclosed in the
`second related application.
`FIG. 7 is a block diagram illustrating a user audio
`interface of the preferred apparatus embodiment of the
`invention disclosed in the second related application.
`FIG. 8 is a block diagram illustrating an RF modulator of
`the preferred apparatus embodiment of the invention dis-
`closed in the second related application.
`FIG. 9 is a block diagram illustrating an RF demodulator
`of the preferred apparatus embodiment of the invention
`disclosed in the second related application.
`FIG. 10 is a block diagram illustrating a camera interface
`of the preferred apparatus embodiment of the invention
`disclosed in the second related application.
`FIG. 11 is a flow diagram illustrating the method of the
`preferred embodiment of the invention disclosed in the
`second related application.
`FIG. 12 is a flow diagram illustrating the telephony and
`video conference control methodology in accordance with
`the preferred embodiment of the invention disclosed in the
`second related application.
`FIG. 13 is a block diagram illustrating a third embodiment
`of a video access apparatus 750 and a third embodiment of
`a video conferencing system 705, utilizing a plurality of
`videophone apparatuses 700, in accordance with the present
`invention.
`
`FIG. 14 is a detailed block diagram illustrating a first
`embodiment of a videophone apparatus 700 in accordance
`with the present invention.
`FIG. 15 is a detailed block diagram illustrating a second
`embodiment of a videophone apparatus 800 in accordance
`with the present invention.
`FIG. 16 is a detailed block diagram illustrating a fourth
`embodiment of a video access apparatus 850 in accordance
`with the present invention.
`FIG. 17 is a block diagram illustrating an expanded
`audio/video compression and decompression subsystem 760
`in accordance with the present invention.
`FIG. 18 is a flow diagram illustrating the video multi-
`plexing method in accordance with the present invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`As disclosed in the second related application, and as
`illustrated in FIGS. 1 through 12, the preferred embodiment
`of the invention disclosed in the second related application
`provides for audio and visual conferencing and telephony
`capability at one or more locations within the user premises,
`may be mobile, and may be configured as needed for
`additional
`locations. In addition,
`in accordance with the
`preferred embodiment disclosed in the second related
`application,
`the audio/visual conferencing and telephony
`system utilizes equipment typically found in consumers’
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`homes or premises, such as existing televisions, video
`cameras or camcorders, and telephones. In addition, such a
`system is designed to be compatible for use with other
`existing video conferencing systems, may be utilized over a
`variety of connected telecommunications networks (such as
`ISDN or POTS), is user friendly, easy to install and use, and
`should be relatively less expensive for in-home purchase and
`use by consumers.
`As mentioned above, a need has also remained for audio/
`visual telephony and conferencing equipment to provide for
`multiple, simultaneous video conferences from more than
`one location. In accordance with the preferred embodiment
`of the present invention, multiple, simultaneous video con-
`ferences from more than one location may occur, providing
`for multiplexed video conference sessions,
`in which the
`output video may include display of video input from
`several video cameras at multiple locations. In addition, in
`accordance with the present invention, various videophone
`apparatus embodiments are disclosed, which provide an
`alternative to the use of telephones, video cameras and
`televisions as utilized and disclosed in the invention of the
`second related application. The various videophone appara-
`tus embodiments in accordance with the present invention
`are also compatible for use with other existing video con-
`ferencing systems, may be utilized over a variety of con-
`nected telecommunications networks (such as ISDN or
`POTS), are user friendly, easy to install and use, and also
`should be relatively less expensive for in-home purchase and
`use by consumers.
`FIG. 1 is a block diagram illustrating a configuration of an
`audio/video network 100 for a video access apparatus 110 in
`accordance with the invention disclosed in the second
`
`related application. As illustrated in FIG. 1, video access
`apparatus 1101 through video access apparatus 110”
`(individually and collectively referred to as a video access
`apparatus(es) 110) may have an outdoor location,
`for
`example, at subscriber premises 1091 (video access appara-
`tus 1101), or may have indoor locations, for example, at
`subscriber premises 1092 and 109” (video access apparatus
`1101 and video access apparatus 110”). The video access
`apparatus 110 illustrated in FIG. 1 may have a first embodi-
`ment as illustrated in FIG. 2, a second (non-multichannel
`and non-multiplexing) embodiment as video access appara-
`tus 150 illustrated in FIG. 3, a third, multichannel embodi-
`ment as video access apparatus 750 illustrated in FIG. 13, or
`a fourth, multichannel and multiplexing embodiment as
`video access apparatus 850 illustrated in FIG. 16. As a
`consequence, as used herein, reference to any of the embodi-
`ments of the video access apparatus 110, 150, 750 or 850
`shall be understood to mean and include the other apparatus
`embodiment or its equivalents. Referring to FIG. 1,
`in
`accordance with the invention disclosed in the second
`
`related application, the video access apparatus 110 provides
`audio and video telephony and conferencing services over a
`first communication channel 103 which, in the preferred
`embodiment, is hybrid fiber coaxial cable (“HFC”) utilized
`in the audio/video network 100 (which may have multiple
`configurations). Also in the preferred embodiment utilizing
`HFC, the video access apparatus 110 (150 or 750) is also
`referred to as a video cable access unit. The first commu-
`
`nication channel 103, in turn, is connected through a primary
`station 105 to a cable television network (“CATV”) video
`services infrastructure 102, and through a local digital
`switch 135 to a network 140. The network 140, for example,
`may be a public switched telephone network (“PSTN”) or an
`Integrated Services Digital Network (“ISDN”), or any com-
`bination of such existing or future telecommunications net-
`works.
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 15
`
`IPR2020-00200
`Apple Inc. EX1013 Page 15
`
`

`

`6,134,223
`
`5
`Continuing to refer to FIG. 1, a primary station 105, also
`referred to as head end equipment, includes a control unit
`referred to in the preferred embodiment as a cable control
`unit (“CCU”) 115, a network interface (or telecommunica-
`tions network interface) 130, a combiner 104, and is cou-
`pleable to the CATV video services infrastructure 102. The
`CCU 115 consists of a communications controller 125 and
`
`a bank of transceivers 1201 through 120”, also referred to as
`cable port
`transceiver (“CPX”) cards in the preferred
`embodiment. The communications controller 125 transmits
`
`and receives industry standard time division multiplexed
`(“TDM”) signals, via the network interface 130, to and from
`a local digital switch (“LDS”) which connects to the rest of
`the network 140. In the preferred embodiment, incoming
`(received) signals to the communications controller 125 are
`converted to an internal signaling format, may also have
`TDM time slots interchanged, and are then routed to the
`transceivers 1201 through 120”. The transceivers 1201
`through 120” convert the received signals to frequencies
`(e.g, radio frequencies (“RF”)), preferably frequencies com-
`patible with cable television (CATV) networks. The primary
`station 105 provides concentration of the resources of the
`network 140 through time slot and frequency management
`techniques. The audio/video network 100 comprises the
`primary station 105 (with the network interface 130 for
`connection to the network 140 and the coupleability to the
`CATV video services infrastructure 102), along with a
`plurality of video access apparatuses, such as video access
`apparatuses 1101 through 110” (connected to the primary
`station 105 over the first communication channel 103).
`In the preferred embodiment,
`the signaling over the
`audio/video network 100 uses a protocol referred to as
`“CACS” (for Cable ficess Signaling), for transmission and
`reception of data such as voice, video, computer files and
`programs, and other information (collectively referred to as
`data). CACS is a multi-layered protocol consisting of a
`plurality of 768 kbps H/4-DQPSK (differential quadrature
`phase shift keying) modulated RF carriers using TDM
`framing in the downstream path (from the primary station
`105 to a video access apparatus 110) and TDMA (time
`division multiple access) in the upstream path (to the pri-
`mary station 105 from a video access apparatus 110). In the
`preferred embodiment, each CACS carrier supports as many
`as eight time slots of individually addressable user data
`packets, in which each packet contains 160 bits of user data
`(the “payload”) plus address and error correction informa-
`tion. The preferred CACS frame rate is 400 frames per
`second, providing a net user data throughput of 64 kbps
`(kilobits per second) for each assigned time slot. Time slots
`also may be concatenated to provide even greater data rates,
`for example, up to 512 kbps when all eight time slots are
`assigned to a single user.
`As a consequence, N><64 kbps services may be supported
`with the CACS protocol, where N is the number of assigned
`time slots. In the case of connectivity for ordinary telephony
`commonly known as POTS (Plain Old Telephone Service),
`a single time slot is used in which digital PCM (pulse code
`modulated) audio samples are transported in the payload of
`the CACS time slot. In the case of connectivity for higher
`rate services, such as basic rate ISDN (two 64 kbps B
`channels plus one 16 kbps D channel), two or more time
`slots are used to transport the user (bearer) data. For video
`conferencing and telephony service, compressed digital
`audio and video signals may occupy from one to multiple
`time slots per carrier (e.g., 8 time slots per carrier), depend-
`ing on the method of compression used and the desired
`quality of the service, and depending upon the number of
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`
`video network interfaces 210 (or CATV RF transceivers
`245) utilized in the video access apparatus 110 (or 150)
`discussed below.
`
`Also in the preferred embodiment, modulated CACS RF
`carriers occupy an RF bandwidth of 600 kHz and may be
`assigned anywhere within the downstream and upstream
`CATV frequency bands. Typically,
`in domestic, North
`American CATV systems, the downstream band has been
`designated from 50 to 750 MHZ, with an upstream band
`designated from 5 to 40 MHZ. Referring to FIG. 1, for
`transmission to the user premises 1091 through 109”, the
`transceivers 1201 through 120” receive a TDM data stream
`from the communications controller 125 and create CACS
`
`frames of eight time slots, along with associated overhead
`signaling information (including error control data), result-
`ing in a 768 kbps data stream. The data stream is then
`converted to a H/4-DQPSK signal, which in turn is then
`upconverted in frequency from baseband to an RF carrier
`within the CATV downstream band. This H/4-DQPSK sig-
`nal may then be optionally combined (in the combiner 104
`of the primary station 105) with other video services signals
`from the CATV video services infrastructure 102, and trans-
`mitted over the first communication channel 103.
`
`At the receiving end, as discussed in greater detail below,
`a video access apparatus 110 downconverts the CACS
`carrier to baseband and demodulates the II/4-DQPSK
`signal, resulting in received CACS frames. Time slot infor-
`mation (i.e., the data in the payload) is then extracted from
`the CACS frames and transferred to an audio codec in the
`
`transferred to an
`case of telephony (a POTS call), or
`audio/video compression and decompression subsystem in
`the case of a video conferencing call or session. Conversely,
`for upstream transmission, voice or video data originating,
`respectively, from the audio codec or an audio/video com-
`pression and decompression subsystem, is put into CACS
`protocol formatted TDMA data packets. The TDMA data
`packets are then converted into a H/4-DQPSK signal,
`upconverted to an RF carrier, and injected into the upstream
`path of the audio/video network 100, on first communication
`channel 103. In turn, one of the transceivers 1201 through
`120” receives the upstream signal from a video access
`apparatus 110, RF downconverts the signal to baseband and
`demodulates the H/4-DQPSK signal, resulting in a received
`TDMA data packet. The user data is then extracted from the
`packet and transferred to the communications controller
`125, which reformats the user data into an appropriate
`network signal (analog or digital) and, through the network
`interface 130, transmits the network signal, multiplexed with
`other signals, to the network 140 (via the local digital switch
`135).
`In the preferred embodiment, the CACS protocol consists
`of three types of signaling channels which use designated
`time slots on CACS carriers. A first
`type of signaling
`channel, referred to as a broadcast channel, is utilized to
`transmit general system information, only in the down-
`stream direction to the various video access apparatuses 110,
`and to transmit information such as terminating alerts to a
`video access apparatus 110 when a call is to be received
`from the network 140. A plurality of a second type of
`signaling channel, referred to as access channels, are used by
`the various video access apparatuses 110 to gain access to
`the audio/video network 100 or the network 140. Aplurality
`of a third type of signaling channel, referred to as traffic
`channels, are full-duplex and are used to transport user data
`to and from the network 140.
`
`In the preferred embodiment, traffic channels may consist
`of one or more time slots and are assigned to users based on
`
`|PR2020-00200
`
`Apple Inc. EX1013 Page 16
`
`IPR2020-00200
`Apple Inc. EX1013 Page 16
`
`

`

`6,134,223
`
`7
`
`demand (trunked) from a pool of available time slots. A
`traffic channel is assigned for the duration of a call (POTS
`or video), and upon call
`termination,
`is subsequently
`released to the pool of available time slots. When a video
`access apparatus 110 first powers up, it registers with the
`CCU 115 by first scanning the downstream spectrum for a
`CACS broadcast channel, synchronizing with that channel,
`and obtaining information concerning a location of an access
`channel. On the access channel, the video access apparatus
`110 requests an assignment of a traffic channel, and then
`transmits a registration message over the assigned traffic
`channel of the plurality of traffic channels. After registration
`is complete, the video access apparatus 110 may make or
`receive calls through the network 140.
`If a call origination is required, the video access apparatus
`110 makes a request to the CCU 115 for the required number
`of time slots through the access channel. The CCU 115 then
`grants the request and assigns a traffic channel (carrier
`frequency and associated time slot(s)). If a call delivery is
`required, the CCU 115 alerts the identified, addessed video
`access apparatus 110 of an incoming call over the broadcast
`channel. Via the access channel, the video access apparatus
`110 then requests a traffic channel. The CCU 115 grants the
`request and a traffic channel is assigned.
`In the preferred embodiment,
`the CACS protocol also
`provides the capability for transferring calls to other avail-
`able carrier frequencies and time slots, especially in the
`event of high noise conditions. Preferably, the quality of all
`user traffic channels is continuously monitored, and if the
`quality starts to degrade due to noise, the call is transferred
`to another RF carrier having less noise.
`FIG. 2 is a high level block diagram illustrating a first
`embodime