`
`
`
`
`
`
`
`(12) United States Patent
`US 7,010,032 B1
`(10) Patent N0.:
`
`
`
`
`
`
`
`
` Kikuchi et al. (45) Date of Patent: Mar. 7, 2006
`
`
`
`
`USOO7010032B1
`
`
`
`
`
`
`
`(54) MOVING IMAGE CODING APPARATUS AND
`DECODING APPARATUS
`
`
`
`
`(75)
`
`
`
`
`
`
`
`
`Inventorsz YoshihirO Kikuchi, Kanagawa (JP);
`Tadaaki Masuda, Tokyo (JP); Takeshi
`
`
`
`
`
`
`
`Nagai, Kanagawa (JP)
`
`
`
`ot1ce:
`* N'
`
`
`
`
`
`(22)
`
`(30)
`
`(51)
`
`
`
`
`
`
`
`
`(73) Assignee: Kabushiki Kaisha Toshiba, Kawasaki
`
`(JP)
`ISC a1mer, t e term 0 t
`u ect to an
`IS
`yd'l'
`Sbj
`fh’
`h
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`patent is extended or adjusted under 35
`
`
`
`U.S.C. 154(b) by 0 days.
`
`
`
`
`(21) Appl. No.: 09/522,950
`
`
`
`
`Filed:
`Mar. 10, 2000
`
`
`
`
`
`Foreign Application Priority Data
`
`
`
`
`
`Mar. 12, 1999
`(JP)
`.............................. P.11-067120
`
`
`
`
`Sep. 6, 1999
`.............................. P.11-251929
`(JP)
`
`
`Int. Cl.
`(2006.01)
`H04N 7/12
`
`
`
`
`
`
`
`................................................. 375/240.01
`(52) US. Cl.
`
`
`
`
`
`(58) Field of Classification Search ........... 375/240.01,
`375/240.27, 240.12, 845.1; 386/68, 101,
`
`
`
`
`386/125; 370/468, 487, 537; 348/4231; H04N 7/44,
`
`
`
`
`
`H04N 7/12
`
`
`
`
`
`
`
`
`See application file for complete search history.
`
`
`
`
`
`
`
`
`
`
`
`
`(56)
`
`
`
`
`
`References CitEd
`U.S. PATENT DOCUMENTS
`
`
`
`
`
`
`
`
`5,990,955 A * 11/1999 Koz ...................... 375/24001
`5,995,707 A * 11/1999 Lee ............................. 386/81
`
`
`
`
`
`
`
`
`
`
`
`
`6,229,951 131*
`5/2001 Schultz et a1.
`................ 386/68
`6,404,817 B1 *
`6/2002 Saha et a1.
`............. 375/24027
`
`
`
`
`
`
`
`
`
`
`
`
`6,542,518 131*
`4/2003 Miyazawa .................. 370/468
`
`
`
`* cited by examiner
`
`
`
`Primary Examiner—Nhon Diep
`
`
`
`
`
`(74) Attorney, Agent, or Firm—Oblon, Spivak, McClelland,
`Maier & Neustadt, PC.
`
`
`
`
`
`
`(57)
`
`
`
`ABSTRACT
`
`
`
`
`
`
`
`
`
`
`
`
`
`Amoving image coding apparatus which has coders (17, 18,
`
`
`
`
`
`
`
`
`
`19)
`for dividing an input moving image signal
`into a
`
`
`
`
`
`
`
`
`
`plurality of frames, dividing each of the frames into one or
`
`
`
`
`
`
`
`
`
`more image areas, compressing and coding the image areas,
`
`
`
`
`
`
`
`
`and outputting an area image code string, a system multi-
`
`
`
`
`
`
`
`
`plexer (20) for separating frame header information indicat-
`
`
`
`
`
`
`
`
`
`
`ing the coding mode, etc., of the frame frame from the frame
`
`
`
`
`
`
`
`
`frame and adding the frame header information to one or
`
`
`
`
`
`
`
`
`
`
`more coded area image code strings, and a sender (25) for
`
`
`
`
`
`
`
`
`
`collecting one or more area image code strings to which the
`
`
`
`
`
`
`
`frame header information is added, adding packet header
`
`
`
`
`
`
`
`
`information, putting into a packet, and sending the packet.
`
`
`
`
`21 Claims, 21 Drawing Sheets
`
`
`
`20
`
`
`
`
`
`
`
`
`13
`26
`
`
`AUDIONOICE SIGNAL —4—> AUDIONOICE
`RTP
`SYSTEM
`
`
`
`
`
`
`
`CODER
`
`
`MULTIPLEXER
`SENDER
`
`
`
`
`GRAPHICS DATA
`
`21
`
`
`
`22
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`11
`
`
`
`
`VIDEO SIGNAL1 4» VIDEO CODEFI
`
`17
`
`
`
`12
`
`
`VIDEO SIGNAL 2 —4-> VIDEO CODEFI
`
`18
`
`
`
`19
`
`
`
`
`
`15
`
`
`5'
`
`
`
`16
`
`d
`
`
`CONTROL SIGNAL
`
`
`
`
`
`Page 1 of 33
`
`GOOGLE EXHIBIT 1017
`
`GOOGLE EXHIBIT 1017
`
`Page 1 of 33
`
`

`

`
`3Ps”U
`
`tn
`
`
`
`
`27,
`
`
`
`S
`
`
`
`
`
`
`
`US 7,010,032 B1
`
`wfat
`
`a$8089>Ma:omt
`
`
`
`
`
`F2205Omo_>
`
`6mm2m2
`
`E0889>
`
`
`
`
`
`m._<20_mOmo_>
`
`1.mmuckflmmmmxmafiszmomflummi
`
`
`
` n_u8a55%mm9mmm2
`
`
`
`._<zo_mmo_o>\o_n5<
`
`ESmoiméw
`
`$sz4858
`
`m;
`
`
`
`m:
`
`
`
`Page 2 of 33
`
`Page 2 of 33
`
`
`

`

`
`
`US. Patent
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 2 0f 21
`
`
`
`US 7,010,032 B1
`
`V81
`
`
`
`V01
`
`
`V80
`
`V00
`
`
`VOL1
`
`
`VOLo
`
`
`/\
`
`//\\
`
`
`/\
`GOV1
`
`
`
`
`/\
`
`
`
`GOVo
`
`/\
`VOPG
`
`
`VOPn
`
`VOPn+1
`
`VOPm
`
`
`
`
`
`VISUAL OBJECT SEQUENCE (VS)
`
`
`
`
`
`VISUAL OBJECT (V0)
`
`
`
`
`
`VIDEO OBJECT LAYER (VOL)
`
`
`
`GROUP OF VOP (GOV)
`
`
`
`
`
`VIDEO OBJECT PLANE (VOP)
`
`
`
`Page 3 of 33
`
`Page 3 of 33
`
`

`

`
`aPS”U
`
`t
`
`
`
`7
`
`600
`
`S
`
`1
`
`
`
`US 7,010,032 B1
`
`
`
`
`
`
`
` 2.f898:88%.898:EVE“:898:880.mEva:82>Eva/a89>Eva:89>
`
`
`
`
`
`
`m80.8Efim80>.
`
`
`
`2,EVE;292528105880
`
`n.m3,at
`
`
`
`
`
`
`
`Page 4 of 33
`
`
`
`
`
`355%ag
`
`
`
`.53sz8at
`
`Page 4 of 33
`
`
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 4 0f 21
`
`
`
`US 7,010,032 B1
`
`mm
`
`
`
`
`
`
`
`moh<mmzmwEonmm><._oz>m
`
`
`
`
`
`vm
`
`3m
`
`
`
`9
`
`
`
`Em3m5m9mmmm
`
`w.OE
`
`
`
`
`
`
`
`:23wmmoo<
`
`mOH<mmzmo
`
`
`:2:$82
`
`
`mozmwzmo
`
`
`
`
`
`
`
`
`t2:wmwoo<
`
`
`
`:2:mmmoo<
`
`
`
`
`
`mozmmzmw
`
`
`mObEmZmo
`
`mg
`
`—m
`
`
`
`
`
`
`
`
`
`._._z:mmmoo<
`
`m0p<mmzmw
`
`Page 5 of 33
`
`Page 5 of 33
`
`
`
`
`
`
`
`

`

`
`M
`
`mm
`
`s_a+|e.
`
`_o<oN><N__n“NFN_
`
`
`
`US 7,010,032 B1
`
`
`
`+|l
`
`
`
`mmmEizmQRommovmoEDOm02.595200
`
`
`
`
`
`ENE:GEEES:025_+I+I+I+I+I+I+I+I+I+|+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+EtaNoFFMasai
`
`
`
`+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`
`Fomzoz<mF>mFo<oN><Nmeo<Nmm><Noz>m
`
`___
`
`Fig02.8:E...........n7+I+I+J+I+I+I+I+I+I+I+I+I+I+I+I+_
`
`m.NFo+I+I+I+I+I+I+I+I+I+L+I+I+I+I+I+I+I+I+I+I+r+u+I+I+I+I+I+I+I+I+I+
`
`I+
`
`
`
`
`
`m_m“+:
`7”mmo<mx_u+.MNFNv
`
`12<mezc_+1+I+I+I+I+I+L+I+I+I+I+I+I+I+I+I+1+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`
`
`
`@255Game55%2925281025_+I+I+I+I+I+I+I+I+I+I+I+I+1+I+I+I+I+I+I+I+i+l+l+l+I+I+I+I+I+I+I+
`
`mmmgszmozmsonFN_2_oo_x.N_Nu>_
`
`+H
`
`+u+u+u+u+u+u+u+u+u+n+n+u+H+n+u+u+n+u+n+n+n+u+u+n+n+H+u+u+n+u+n+
`
`
`“w“aPs”U
`
`tnu
`
`
`
`mGE
`
`F
`
`+|
`
`+I+I+I+I+I+I+I+I+I+1+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+oNNFomNmNFFFmNFomVmNFomNFmmNNNFoNNFo
`
`Page 6 of 33
`
`Page 6 of 33
`
`

`

`S”U
`
`t
`
`3
`
`6m
`
`M6
`
`US 7,010,032 B1
`
`t52898:880898:898:898:898:898:mmo>Efim¢o>90>o>m>8><._oz>mEm
`a.PEva:89>«6SE
`Efimn5>8::oz>mQE2,.898:808898:898:mE3335
`
`
`
`M899989>mmGE
`
`
`Eva:89>90GE
`
`
`
`
`
`w3:mm:898:8953898:898:%n_>oz>8m8::0365
`
`n599:.89>590E89>85:80;Qm6E
`
`
`oz>8m52mo>Efim80>85:uz>mQEESE:mmxmgEEG:EHoz>8mEgg!mmofi:EVE/:2$95:88mmofi:
`
`
`
`
`
`
`weGE
`
`Page 7 of 33
`
`
`
`mmo<mImooommo<mImoOoEma/BI$351.
`
`
`
`
`
`Page 7 of 33
`
`
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 7 0f 21
`
`
`
`US 7,010,032 B1
`
`mo—
`
`5?9:
`
`PE
`
`mm>_m0mm
`
`Emhw>m
`
`
`
`mmxm_._n=._.._:_>m_o
`
`Fm—
`
`mmw
`
`mm—
`
`
`
`vow
`
`mGE
`
`
`
`m:
`
`
`
`0mo_>
`
`mwooowo
`
`m:
`
`0mo_>
`
`$0080
`
`
`
`
`
`mmmrxo<m><fi0mn=>
`
`m.2206
`
`
`
`5m?x0<m><$0wo_>
`
`3<20_w
`
`Page 8 of 33
`
`
`
`
`
`<55202.0300mn—mmm0_Im<m0
`
`
`
`zo_k<§m0”_z_._0E.200
`
`
`
`mmooomo
`
`
`
`0:
`
`m?
`
`m0_0>\0_03<mm0_0>\0_0:<
`
`m:
`
`m:
`
`
`
`._<zo_mx0<m><fi
`
`Page 8 of 33
`
`
`

`

`US. Patent
`
`Mar. 7, 2006
`
`Sheet 8 0f 21
`
`US 7,010,032 B1
`
`mow
`
`
`
`.52:mwmoo<
`
`mwooomo
`
`R:mow
`
`
`
`
`
`
`
`82.
`
`m:
`
`
`
`no?coo?amo—m:mmFmm?
`
`mmo_.
`
`E
`
`Page 9 of 33
`
`
`
`:2:mwmoo<:2:wmmoo<.223mmmoo<
`
`
`
`
`
`
`
`
`
`:2:mwmoo<
`
` $9080
`
`
`$0095$0003mmo00mo
`
`mwooomo._.mv_o<mmm><._oz>w
`
`Page 9 of 33
`
`
`
`
`

`

`
`
`US 7,010,032 B1
`
`2
`
`
`
`
`
`898E$sz6528meeo
`
`
`m9:
`
`FI
`
`mm.2
`888mEm<20moiaéo
`
`
`
`taPS”U
`
`
`
`m
`
`09
`
`tEZwEt
`
`888.E88089>F22%89>
`
`7,Nu
`
`r.NEE
`
`we2m898QE88089>N35889>
`
`
`
`w8028Em88089020522299890299298
`
`mGE
`
`
`
`
`
`
`
`Page 10 of 33
`
`Page 10 of 33
`
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 10 0f 21
`
`
`
`US 7,010,032 B1
`
`
`mkm
`___
`
`
`
`
`
`
`o<04><mE<mm._.m._._mOmn=>
`
`+IT
`
`+I+I+I+I+I+I+I+I+I+IT+I+I+I+II+II+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`
`_A
`
`
`
`
`[TI_++1_+
`
`
`
`E90259aEm............u._I+I+I+II+I+I+I+I+I+I+I+I+I+I+
`
`mNFo+I+II+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+II+I+I+I+I+I+I+I+I+I+I+I
`
`IT
`
`2.0E
`
`EOE:_1325m2:_+I+I+I+I+ITI+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`
`
`
`Em_EmsszmoszOmm_E:58_x_a_N0:
`
`+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+FomwmmmwmNFommNomvmNFomwmmmvmNFomNF0
`
`zo_F<N_zo%oz>m_+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`+n+u+n+u+u+u+n+u+n+u+n+n+u+u+H+n+u+n+n+u+n+n+u+n+n+u+n+u+n+n+u+n+_EmczmgGame
`momaom
`
`Pagell,of33
`
`
`
`mmmgzmeAommovmacaw“24:395on.
`
`
`
`
`
`
`
`Page 11 of 33
`
`

`

`S.U
`
`
`P
`
`m
`
`
`
`6002
`
`0H
`
`1
`
`
`
`US 7,010,032 B1
`
`
`
`
`
`
`
`n899a89>55:89>85E89>
`
`7.,898:880898:.mEEEEIm:8$.on89>
`
`w898:89592898:.0EEEIo:8BEE89>
` mmo<mImooo
`
`898:808898:.EIEEEIEIIQ:8
`
`
`
`
`89$:89%:898:89%:
`
`mmo<w1mooomwo<m1
`
`
`
`
`
`
`
`m:GE
`
`.85:89>
`
`
`
`
`898:.ma:mo>E538<:GE
`e898:808898:898:898:
`
`
`Page 12 of 33
`
`Page 12 of 33
`
`

`

`etaPs”U
`
`t
`
`M
`
`6
`
`n
`
`12
`
`US 7,010,032 B1
`
`nQE
`
`mm>mommEmE88389>E
`
`
`F._<zo_mx0<m><fiOmo_>
`
`Mmg
`
`
`
`7,NNFa«mm_m:
`
`m.EEOWEEmE88589>
`
`
`
`wEamowmEmmmooomo$52052%g
`
`8Na:
`
`E>mowmDE
`
`SN_
`
`_
`
`
`
`zO_._.<_>EOuz_Jomfizoo
`
`
`
`EamommEmESzopoaoommmmmoinzmo
`
`
`
`
`
`N.2205,xo<m><fiOmn=>
`
`
`
`
`
`.7205x0<m><._mmo_o>\o_n5<
`
`m“GE
`
`Page 13 0f33
`
`Page 13 of 33
`
`
`
`

`

`
`U.S. Patent
`
`
`
`Mar. 7, 2006
`
`Sheet 13 0f 21
`
`
`
`US 7,010,032 B1
`
`
`
`
`
`5—
`
`Er
`
`mmozmmmE
`
`
`
`
`
`.26E
`
`n:
`
`mmaoo955
`
`
`
`._<zo_.wOmn=>
`
`Page 14 of 33
`
`mm?
`
`mmozmw9E
`
`
`
`mmooomo_o>\o_oa<
`
`JoEzoo
`
`zoEngz
`
`
`
` mmozmm
`
`
`
`
`._<zo_wm05>553<
`
`
`
`20:.<2mou_z_405.200
`
`
`
`Page 14 of 33
`
`
`
`

`

`US. Patent
`
`Mar. 7, 2006
`
`Sheet 14 0f 21
`
`US 7,010,032 B1
`
`
`
`mm:JOIHZOO
`
`292%;we
`
`
`
`
`
`mmemeZO_._.<_>_mOn_Z_405.200
`
`ENN:
`
`5m5.5*
`
`
`
`mm>_momE9E$5085953.3205xo<m><._n_855
`
`om:
`
`mowmm—m9. mmma:
`
`
`
`
`mmeOmmn:.mmeOOmDm0_O>\O_DD<.2205¥O<m><u_n_m0_O>\O_DD<
`
`36E
`
`Page 15 0f33
`
`Page 15 of 33
`
`
`

`

`
`US. Patent
`
`
`
`Mar. 7, 2006
`
`SheetlS 0f21
`
`
`
`US 7,010,032 B1
`
`+I+I+I+I+I+J+I+I+I+r+l+|+I+I+r+l+l+I+I+I+I+I+I+w+|+n+l+I+I+I+I+I+
`
`+I+I+I+|+I+I+I+I+I+I+I+I+I+|+|+|+|+1+I+I+I+|+I+I+I+I+I+I+I+I+I+I+FommFm.mFmNFommFmmFmNFoawFmmwmNFomNF0
`
`+|+1+I+I+I+I+|+|+I+1+I+I+n+I+I+I+I+I+v+a+l+l+1+l+l+l+|+n+I+I+I+I+‘20:30me_F>E_>__on_F_mo%_oo_MB.GK
`
`
`
`AzozaommmBzimmmmmimzz29:81:00._Q2.0:
`
`
`
`
`
`FommmemeFommemmeFommmemeFomNF0
`
`+I+I+I+I+u+I+I+I+I+I+|+I+I+I+I+I+u+l+u+u+n+l+n+n+n+u+a+n+l+l+l+u+
`
`+1+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+0+I+I+I+I+I+
`A_F>:$eeo:_lme_fin_o>+E:oo..........oooo3<2.GE
`
`FommemFmNFomwFommeFommmevmmFomNF0
`
`+1+1+I+I+I+|+I+I+I+I+I+I+c+I+I+I+I+I+I+I+I+I+I+I+I+a+t+l+l+l+l+l+
`
`+|+I+I+I+I+I+I+|+I+I+I+I+I+I+I+I+I+|+I+I+1+I+I+I+I+I+I+I+1+I+I+I+mmwwmvfim
`Ea“$528_-ms=-n_o>6mgmgmg:_.
`
`
`FoooFmmwmNFommFomwmNFomwFomvmNFomNFo
`
`+1+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+x+c+t+l+l+l+l+l+l+I+I+I+I+I+
`
`+I+I+1+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+1+I+|+I+I+1+I+I+I+I+I+I+I+I+Um“mVFl
`.2EstE,.mm<mm2:_.
`
`+I+L+I+I+I+I+1+I+I+I+++++++++1++++I+I+I+I+I+I+I+I+I+I+FommFmmwmNFoowFomwmNFomwFmmvmNFomNFo
`
`
`
`Page 16 of 33
`
`Page 16 of 33
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 16 0f 21
`
`
`
`US 7,010,032 B1
`
`_o_o_1_m_<_>_o_o_m:
`
`7,1_oo_I.:-___o.:|::_3-:3.3-:31
`
`+I+I+I+I+I+I+1+t+l+s
`
`+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+I+
`
`
`
`+I+I+I+I+I+I+I+I+I+IFmmmomwmmom
`
`
`
`9GE
`
`FommNmmvmmrommfimmvaFoNFo
`
`+I+I+I+|+I+I+I+I+I+I+I+r+t+l+I+I+I+L+I+I+I+I+
`
`PageiY7of33
`
`Page 17 of 33
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 17 0f 21
`
`
`
`US 7,010,032 B1
`
`
`
`@5onmmOmo<Qmo_>_oEwe/E:mO>
`
`
`
`
`
`55%89>Eva:89>
`
`
`
`
`
`
`.$55:SEEEmmiEOE:Eggs.E05:
`
`
`
`
`
`m5..OE
`
`0:GI
`
`
`
`
` N9253.awe/E:Ema/GImmo<wIwooommo<mI
`
`
`n_O>PEn_O>.E<._.wao>PE
`
`
`
`
`
`
`
`
`Ilf|..................Ilmll
`
`
`
`«5GE
`
`Page 18 of 33
`
` E5:E2:
`
`69m:$05:ExmszEma:
`
`
`
`
`
`
`
`
`
`mhmxo/EmmOmo<omo_>_n_EVE/EOmn=>
`
`
`
`
`
`Page 18 of 33
`
`

`

`US. Patent
`
`Mar. 7, 2006
`
`Sheet 18 0f 21
`
`US 7,010,032 B1
`
`.5onRES
`
`
`
`«8
`
`Eva:89>
`
`
`
`
`
`3:59m:ExméEOE:%025mmEm
`
`EBB:38ES:
`
`
`
`ESE:E93:mmofix59$:
`
`
`
`40>o>m>Em
`
`36E
`
`mmm
`
`0mm
`
`omw
`
`PE
`
`mmozmw
`
`:2:512.
`
`.
`
`$20589>
`
`Page 19 of 33
`
`Page 19 of 33
`
`
`
`
`
`
`

`

`US. Patent
`
`Mar. 7, 2006
`
`Sheet 19 0f 21
`
`US 7,010,032 B1
`
` Ema/m:WEE:$2M:
`
`EOE:E#25mg5
`
`Eva:89>
`
`mmo<mz
`
`mooo
`
`.536:955
`
`
`
`$05:$05:EofizEOE:
`40>0>m>Em
`
`mF.GE
`
`9m
`
`5w
`
`mom
`
`omw
`
`omw
`
`
`
`aim
`
`mmZmomm
`
`Omo_>
`
`mmoooma
`
`
`
`.2205Omn=>
`
`:23.5950
`
`Page 20 of 33
`
`Page 20 of 33
`
`
`
`
`
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 20 0f 21
`
`
`
`US 7,010,032 B1
`
`
`FIG. 20
`
`
`OUTPUT VIDEO INITIAL HEADER
`
`SET INITIAL VALUES OF RTP HEADER
`
`801
`
`
`
`$02
`
`
`
`PREPARE INITIAL RTP PACKET
`
`$03
`
`RECORD INITIAL RTP PACKET
`
`504
`
`
`
`
`
`
`
`INPUT ONE FRAME
`
`
`
`
`
`CODE ONE FRAME
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CALCULATE TIME STAMP
`
`
`
`
`
`OUTPUT VIDEO PACKET
`
`
`
`305
`
`
`
`SOB
`
`
`
`307
`
`
`
`808
`
`
`
`
`
`LAST
`
`
`VIDEO PACKET IN ONE
`
`
`
`FRAME?
`
`
`YES M<-1
`
`
`
`810
`
`
`
`
`
`
`
`
`S12
`
`
`
`S13
`
`
`
`S14
`
`
`
`
`
`315
`
`316
`
`Page 21 of 33
`
`Page 21 of 33
`
`

`

`
`US. Patent
`
`
`
`
`Mar. 7, 2006
`
`
`
`
`Sheet 21 0f 21
`
`
`
`US 7,010,032 B1
`
`
`FIG. 21
`
`
`
`
`
`Page 22 of 33
`
`Page 22 of 33
`
`

`

`
`1
`MOVING IMAGE CODING APPARATUS AND
`
`
`
`DECODING APPARATUS
`
`
`DETAILED DESCRIPTION OF THE
`
`
`INVENTION
`
`
`
`
`
`
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`1. Field of the Invention
`
`
`
`
`
`
`
`
`
`
`
`This invention relates to a moving image coding appara-
`
`
`
`
`
`
`
`
`tus and a moving image decoding apparatus used with a
`
`
`
`
`
`
`
`system for compressing, coding, and multiplexing an image
`
`
`
`
`
`
`
`
`
`and voice and transmitting them via a network and particu-
`
`
`
`
`
`
`
`larly used with a system for transmitting a compressed
`
`
`
`
`
`
`
`
`
`image and voice on a packet-based network such as an
`intranet or the Internet.
`
`
`
`
`
`
`
`
`2. Description of the Related Art
`
`
`
`
`
`
`In video telephones, videoconference systems, digital
`
`
`
`
`
`
`television broadcasting, etc., a technique for compressing
`
`
`
`
`
`
`
`
`and coding a moving image and voice to less information
`
`
`
`
`
`
`amounts, multiplexing compressed moving image code
`
`
`
`
`
`
`
`
`
`
`
`string, voice code string, and data code string into one code
`
`
`
`
`
`
`
`
`
`string, and transmitting and storing the code string is used.
`
`
`
`
`
`
`Techniques of motion compensation, discrete cosine
`
`
`
`
`
`
`
`transform (DCT), sub-band coding, pyramid coding, vari-
`
`
`
`
`
`
`
`able-length coding, etc., and systems provided by combining
`
`
`
`
`
`
`
`the techniques are developed. ISO MPEG1 and MPEG2 and
`ITU-T H.261, H.262, and H.263 exist as international stan-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`dards for compressing and coding moving images, and ISO
`
`
`
`
`
`
`
`
`
`
`MPEG system, ITU-T H.221, H223, and the like exist as
`
`
`
`
`
`
`
`international standards for multiplexing code strings pro-
`
`
`
`
`
`
`
`
`vided by compressing moving images and voice and audio
`
`
`
`
`
`
`
`
`
`
`signals and any other data. They are described in detail in
`
`
`
`
`
`document 1, “Multimedia coding no kokusaihyoujyun”
`
`
`
`
`
`
`
`
`edited and written by YASUDA Hiroshi, Maruzen (1994)
`and document 2, “MEPG-4 no subete” edited and written by
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`MIKI, Kougyou chousakai (September 1998), and the like.
`
`
`
`
`
`
`
`On the other hand, RTP (Realtime Transport Protocol)
`
`
`
`
`
`
`exists as a protocol for executing real-time transmission of
`
`
`
`
`
`
`
`
`a moving image code string provided by compressing and
`
`
`
`
`
`
`coding a moving image on a packet-based network such as
`an intranet or the Internet. The RTP is described in detail in
`
`
`
`
`
`
`
`
`document 3, Schulzrinne, Casner, Frederick, Jacobson RTP,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`“A Transport Protocol for Real Time Applications,” RFC
`
`
`
`
`
`
`
`
`1889, Internet Engineering Task Force (January 1996), and
`the like.
`
`
`45
`In addition to a fixed RTP header used in common, an RTP
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`header proper to the compressing and coding technology can
`
`
`
`
`
`
`
`
`
`also be used as an RTP packet header. For example, the RTP
`headers for MPEG-1 and MPEG-2 are defined in document
`
`
`
`
`
`
`
`4, D. Hoffman, G. Fernando, V. Goyal, M. Civanlar, “RTP
`
`
`
`
`
`
`Payload format for MPEG1/MEGP2 video,” RFC 2250,
`
`
`
`
`
`
`
`
`
`
`
`
`
`Internet Engineering Task Force (January 1998).
`
`
`
`
`
`
`
`Document 4 defines an RTP format for transmitting a
`
`
`
`
`
`
`previously-multiplexed packet using an MPEG system and
`
`
`
`
`
`
`
`
`an RTP format proper to video/audio for entering a coded
`
`
`
`
`
`
`
`video/audio bit stream directly in an RTP packet.
`In the former RTP format, one or more transport stream
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`(TS) packets in an MPEG2 system in an RTP packet intact.
`Thus, if a transmission line error such as a packet loss occurs
`
`
`
`
`
`
`
`
`on a transmission line or medium for transmitting an RTP
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`packet, it is made impossible to decode not only the lost RTP
`
`
`
`
`
`
`
`
`
`
`packet, but also the video bit stream in any other RTP packet
`to be decoded using the header information of the video bit
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`stream contained in the lost RTP packet. Consequently, the
`
`
`
`
`
`
`
`transmission line error causes large degradation to occur in
`
`
`
`
`
`
`the decoded video signal; this is a problem.
`On the other hand, as the latter RTP format, an RTP format
`
`
`
`
`
`
`
`
`
`extended for an MPEG video bit stream is used. FIG. 16
`
`
`
`
`
`
`
`
`
`
`
`50
`
`55
`
`60
`
`65
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Page 23 of 33
`
`
`
`US 7,010,032 B1
`
`
`2
`
`
`
`
`
`
`
`shows an example of the extended RTP format proper to
`
`
`
`
`
`
`
`
`MPEG video. In FIG. 16, f_[0,0], f_[0,1], f_[1,0], f_[1,1],
`DC, PS, T, P, C, Q, V, A, R, etc., is the same as information
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`contained in a picture header in an MPEG video bit stream.
`
`
`
`
`
`
`
`
`Thus, the information contained in the picture header in the
`video bit stream is also entered in an RTP header of any
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`other RTP packet than the RTP packet in which the picture
`
`
`
`
`
`
`
`
`header is entered, whereby if the RTP packet in which the
`
`
`
`
`
`
`
`
`
`picture header is entered is lost, in any other RTP packet, the
`information contained in the RTP header can be used for
`
`
`
`
`
`
`
`
`
`
`video decoding.
`However, the extended RTP format involves the follow-
`
`
`
`
`
`
`
`
`
`
`ing problems:
`
`
`
`
`
`
`
`(1) To prepare and transmit an RTP packet in a coding
`
`
`
`
`
`
`apparatus, processing of entering the header informa-
`
`
`
`
`
`
`
`tion contained in a video code string in an RTP packet
`
`
`
`
`
`
`
`header must be performed. After the RTP packet is
`
`
`
`
`
`
`received in a decoding apparatus, the information con-
`
`
`
`
`
`
`
`
`tained in the RTP header must be decoded and passed
`
`
`
`
`
`
`
`to a video decoding apparatus. The operation amounts
`
`
`
`
`
`
`increase because the steps are involved.
`
`
`
`
`
`
`
`
`
`(2) The advantage of the extended RTP format can be
`
`
`
`
`
`
`
`provided on a network capable of transmitting RTP
`
`
`
`
`
`
`
`packets, such as an intranet or the Internet, but cannot
`
`
`
`
`
`
`
`be provided on a network incapable of transmitting
`
`
`
`
`
`
`
`RTP packets, such as a circuit switching network, since
`
`
`
`
`
`
`
`
`video code strings must be transmitted using any other
`
`
`
`
`
`
`multiplexing system other than the RTP.
`
`
`
`
`
`
`
`As described above, to transmit packets undergoing sys-
`
`
`
`
`
`
`
`
`tem multiplexing in RTP packets in the coding apparatus for
`
`
`
`
`
`
`
`
`coding a moving image signal and transmitting the coded
`
`
`
`
`
`
`
`
`signal using an RTP packet, when the RTP packet containing
`important information such as the header information on a
`
`
`
`
`
`
`video bit stream is lost, this error also affects other RTP
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`packets, causing large degradation to occur in the decoded
`
`
`
`moving image signal.
`
`
`
`
`
`
`
`
`To use the RTP format proper to video coding, processing
`for entering the header information contained in a video
`
`
`
`
`
`
`
`code string in an RTP header becomes intricate. To connect
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`a network capable of transmitting RTP packets also to a
`
`
`
`
`
`
`
`network incapable of transmitting RTP packets for transmit-
`
`
`
`
`
`
`
`
`ting a video code string, the advantage of the RTP extended
`
`
`
`header cannot be provided.
`SUMMARY OF THE INVENTION
`
`
`
`
`
`The invention has been made to solve the above problem,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`and therefore an object of the invention is to provide a
`
`
`
`
`
`
`
`
`moving image coding apparatus and a moving image decod-
`
`
`
`
`
`
`
`
`ing apparatus for suppressing the adverse effect of an RTP
`
`
`
`
`
`
`
`
`packet loss when a moving image signal is coded and is
`
`
`
`
`
`
`
`transmitted using an RTP packet and simplifying processing
`of entering header information in an RTP header.
`
`
`
`
`
`
`
`
`
`
`
`
`
`According to the invention, there is provided a moving
`
`
`
`
`
`
`
`image coding apparatus comprising coding means for divid-
`
`
`
`
`
`
`
`
`ing an input moving image signal into a plurality of screens
`
`
`
`
`
`
`
`
`(frames), dividing each of the screens (frames) into one or
`
`
`
`
`
`
`
`
`
`more image areas, compressing and coding the image areas,
`
`
`
`
`
`
`
`
`
`and outputting an area image code string, means for sepa-
`
`
`
`
`
`
`
`rating screen (frame) header information indicating the
`
`
`
`
`
`
`
`
`
`coding mode, etc., of the screen (frame) from the screen and
`
`
`
`
`
`
`
`
`adding the screen (frame) header information to one or more
`
`
`
`
`
`
`
`coded area image code strings, and conversion-to-packet
`
`
`
`
`
`
`
`
`means for collecting one or more area image code strings to
`
`
`
`
`
`
`
`which the screen header information is added, adding packet
`
`
`
`
`
`
`
`
`header information, putting into a packet, and sending the
`
`packet.
`
`Page 23 of 33
`
`

`

`
`
`US 7,010,032 B1
`
`
`3
`
`
`
`
`
`
`According to the invention, there is provided a moving
`
`
`
`
`
`
`image decoding apparatus comprising reception means for
`
`
`
`
`
`
`
`
`receiving a moving image code string put into a packet,
`
`
`
`
`
`
`
`
`separation means for separating one or more area image
`
`
`
`
`
`
`
`
`code strings contained in each packet of the moving image
`
`
`
`
`
`
`
`
`
`code string, area image decoding means for decoding the
`
`
`
`
`
`
`
`
`separated area image code string and outputting a decoded
`
`
`
`
`
`
`
`
`area image signal, screen decoding means for assembling the
`
`
`
`
`
`
`
`
`
`decoded area image signal for each screen (image frame)
`
`
`
`
`
`
`
`and outputting a decoded screen signal (decoded image
`
`
`
`
`
`
`
`frame signal), and means for generating a decoded moving
`
`
`
`
`
`
`
`image signal based on the decoded screen signal.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`
`
`4
`DETAILED DESCRIPTION OF THE
`
`
`PREFERRED EMBODIMENTS
`
`
`
`
`
`
`5
`
`
`
`10
`
`15
`
`
`
`20
`
`25
`
`
`
`30
`
`35
`
`
`
`40
`
`
`
`45
`
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`
`
`
`
`
`
`
`Referring now to the accompanying drawings, there are
`
`
`
`
`
`shown preferred embodiments of the invention.
`First Embodiment
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 1 shows the configuration of a coding apparatus
`
`
`
`
`
`
`according to a first embodiment of the invention. Video
`
`
`
`
`
`
`
`signals 11 and 12 and an audio/voice signal 13 input from
`
`
`
`
`
`
`
`input means for inputting a moving image, such as a camera
`
`
`
`
`
`
`
`
`or a videocassette recorder (VCR), and converted into digital
`
`
`
`
`
`
`
`
`signals are input to video coders 17 and 18 and an audio/
`
`
`
`
`
`
`
`voice coder 19 respectively. Graphics data 15 and a control
`
`
`
`
`
`
`
`
`
`signal 16 for performing control are input
`to a system
`
`
`multiplexer 20.
`
`
`
`
`
`
`
`
`The video signals 11 and 12 are compressed and coded by
`the first and second video coders 17 and 18 and are input to
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the system multiplexer 20 as first and second video code
`
`
`
`
`
`
`
`strings 21 and 22. The audio/voice signal 13 is compressed
`
`
`
`
`
`
`
`
`and coded by the audio/voice coder 19 and is input to the
`
`
`
`
`
`
`system multiplexer 20 as an audio/voice code string 23.
`
`
`
`
`
`
`
`
`
`The video code strings 21 and 22, the audio/voice code
`
`
`
`
`
`
`
`
`
`string 23, the graphics data 15, and the control signal 16 are
`
`
`
`
`
`
`
`multiplexed by the system multiplexer 20 to generate a
`
`
`
`
`
`
`
`
`
`system code string 24. An RTP sender 25 puts the system
`
`
`
`
`
`
`
`
`
`code string 24 into an RTP packet and sends it as an RTP
`
`
`packet 26.
`
`
`
`
`
`
`
`
`
`The video coders 17 and 18 performs highly efficient
`
`
`
`
`
`
`
`compression coding of a moving image signal by using
`
`
`
`
`
`
`DCT, quantization, variable-length coding, inverse quanti-
`
`
`
`
`
`
`
`
`zation, inverse DCT, motion compensation, etc. That is, the
`
`
`
`
`
`
`
`
`moving image signal is divided into a plurality of frames, for
`example, frames and each frame is divided into one or more
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`image areas, namely, blocks. The blocks are compressed and
`coded in accordance with a coding mode such as an intra-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`coding mode or an interceding mode to prepare a block
`
`
`
`
`
`
`
`
`coding string (image area coding string). Such processing is
`described in detail in document 2, etc., and therefore only
`
`
`
`
`
`
`
`the topics related to the invention will be discussed.
`
`
`
`
`
`
`
`The number of video signals and that of video coders may
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`be one or may be two or more as in the example in FIG. 1.
`
`
`
`
`
`
`
`
`
`To code a plurality of video signals, for example, before a
`
`
`
`
`
`
`
`
`moving image signal is coded, it can also be divided into a
`
`
`
`
`
`
`
`
`plurality of video objects such as a human figure and a
`
`
`
`
`
`
`
`
`background for inputting and coding the objects separately.
`To handle such video objects, video bit stream has a
`
`
`
`
`
`
`
`
`
`hierarchical structure as shown in FIG. 2. The layer corre-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`sponding to the general sequence of a moving image is
`
`
`
`
`
`
`
`
`called VS (Visual Object Sequence) and one or more VOs
`
`
`
`
`
`
`
`
`(Visual Objects) exist in the VS. For example, if a human
`
`
`
`
`
`
`
`figure exists in a background, successive motion of only the
`
`
`
`
`
`
`
`
`human figure can be described as one V0, and a sequence
`
`
`
`
`
`
`
`
`of only the background can also be described individually.
`
`
`
`
`
`
`
`Further, each VO has a layer called VOL (Video Object
`
`
`
`
`
`
`
`
`
`Layer) under the V0. The VOL is a layer for giving a
`
`
`
`
`
`
`plurality of spatial resolutions or temporal resolutions to the
`
`
`
`
`
`
`V0; it is provided for performing spatio/temporal scalability
`
`
`
`
`
`
`
`
`
`coding. VOP (Video Object plane) at
`the lowest
`layer
`corresponds to a conventional frame and means data at “one
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`instant” in each resolution of each VO (snap shot). A layer
`
`
`
`
`
`
`
`called GOV (Group of VOP) containing time information,
`etc., for executing random access exists between the VOL
`
`
`
`
`
`
`
`
`
`
`
`
`and VOP as an option.
`If a code string is sent via a transmission line or medium
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`where a bit error or a packet loss occurs,
`the following
`
`
`
`
`
`
`
`
`
`
`
`
`In the accompanying drawings:
`
`
`
`
`
`FIG. 1 is a block diagram of a coding apparatus according
`to a first embodiment of the invention;
`
`
`
`
`
`
`
`
`
`
`FIG. 2 is a drawing to show the hierarchical structure of
`
`
`
`
`a video code string;
`
`
`
`
`
`FIGS. 3A to 3D are drawings to describe video packets;
`
`
`
`
`
`FIG. 4 is a block diagram to show the configuration of a
`
`
`system multiplexer;
`
`
`
`
`
`FIG. 5 is a drawing to show the formats of an RTP packet
`
`
`
`header and payload;
`
`
`
`
`
`
`FIGS. 6A to 6E are drawings to show the relationships
`
`
`
`
`
`
`
`
`among RTP-packet, sync layer packet, and video bit stream;
`
`
`
`
`
`
`FIG. 7 is a block diagram of a decoding apparatus
`
`
`
`
`
`corresponding to the coding apparatus in FIG. 1;
`
`
`
`
`
`FIG. 8 is a block diagram to show the configuration of a
`
`
`system demultiplexer;
`
`
`
`
`
`FIG. 9 is a block diagram of a coding apparatus according
`to a second embodiment of the invention;
`
`
`
`
`
`FIG. 10 is a drawing to show the format of a video RTP
`
`
`
`
`
`
`packet;
`
`
`
`
`
`
`FIGS. 11A to 11E are drawings to show the relationship
`between RTP packet and video bit stream;
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 12 is a block diagram of a decoding apparatus
`
`
`
`
`
`corresponding to the coding apparatus in FIG. 9;
`
`
`
`
`
`FIG. 13 is a block diagram of a coding apparatus accord-
`ing to a third embodiment of the invention;
`
`
`
`
`
`
`
`
`
`
`
`FIG. 14 is a block diagram of a decoding apparatus
`
`
`
`
`
`
`corresponding to the coding apparatus in FIG. 13;
`
`
`
`
`
`
`
`
`FIGS. 15A to 15E are drawings to show time stamp
`formats to describe a fourth embodiment of the invention;
`
`
`
`
`
`
`FIG. 16 is a drawing to show an RTP format in a related
`
`
`
`
`
`
`art;
`
`
`
`
`
`
`
`
`FIGS. 17A to 17C are drawings to show examples of RTP
`
`
`
`
`
`
`
`packet division prohibited according to RTP packet division
`rules;
`
`
`
`
`
`
`
`FIG. 18 is a block diagram to show a coding apparatus for
`
`
`
`
`
`
`generating information and a medium for recording the
`
`
`
`
`information according to the invention;
`FIG. 19 is a block diagram to show an information record
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`medium and a decoding apparatus for decoding the infor-
`
`
`
`
`mation according to the invention;
`FIG. 20 is a flowchart to show information recording and
`
`
`
`
`
`
`
`
`
`
`
`preparation processing according to the invention; and
`
`
`
`
`
`
`FIG. 21 is a block diagram to show an example of a
`
`
`
`
`
`
`wireless moving image transmission system incorporating
`
`
`
`
`
`
`
`
`the coding apparatus and the decoding apparatus according
`to the invention.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Page 24 of 33
`
`Page 24 of 33
`
`

`

`5
`
`
`
`
`
`
`
`mechanism is adopted for video coding in order to reduce
`the adverse effect of the error:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`As shown in FIG. 3A, the VOP is separated into units
`
`
`
`
`
`
`
`
`called video packets each consisting of several macro blocks
`
`
`
`
`
`
`(MBs). A marker for
`recovering synchronization (RM:
`
`
`
`
`
`
`
`Resynchronization marker) is added to the top of each video
`
`
`
`
`
`
`
`packet of a video code string, as shown in FIG. 3B.
`
`
`
`
`
`FIGS. 3C and 3D are drawings to show header informa-
`
`
`
`
`
`
`
`
`
`
`tion of the video packet (VP header in FIG. 3B). The video
`
`
`
`
`
`
`
`
`packet header contains a flag called HEC (Header Extension
`
`
`
`
`
`
`
`
`Code). If the flag is “1,” information of time code (MTB,
`
`
`
`
`
`
`
`
`
`VTI), VOP coding mode (VCP), intra DC VLC table change
`
`
`
`
`
`
`
`information (intra DC VLC threshold, IDVT), motion vector
`
`
`
`
`
`
`
`
`range information (VOP F code forward, VFF), etc., con-
`
`
`
`
`
`
`
`
`
`tained in the VOP header is also added to the video packet
`header, as shown in FIG. 3D.
`
`
`
`
`
`
`
`
`FIG. 4 shows the configuration of the system multiplexer
`
`
`
`
`
`
`20. The system multiplexer 20 is made up of access unit
`
`
`
`
`
`
`
`generators 31a to 316 and a sync layer packet (SL-PDU)
`
`
`
`
`
`
`
`
`generator 32. The access unit generators 31a to 316 separate
`
`
`
`
`
`
`
`
`
`input code strings 21, 22, 23, 15, and 16 into predetermined
`
`
`
`
`
`
`
`
`
`units called access units. For example, the video code string
`
`
`
`
`
`
`
`
`may be separated into access units in VOP units. The
`
`
`
`
`
`
`
`
`
`number, time stamp, and the like for identifying the code
`
`
`
`
`
`
`string are added to each access unit.
`
`
`
`
`
`
`
`
`
`
`The access units are input
`to the sync layer packet
`
`
`
`
`
`
`
`
`
`generator 32, which then generates sync layer packets (also
`
`
`
`
`
`
`
`
`
`called SL-PDU) as a system code string 24. For the sync
`
`
`
`
`
`
`
`
`
`
`layer packets, the access units may be used intact or the
`access units may be divided into further fine units. The
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`system code string 24 consisting of the generated sync layer
`packets is sent to the RTP sender 25 in FIG. 1, which then
`
`
`
`
`
`
`
`
`
`
`
`
`generates an RTP packet 26.
`
`
`
`
`
`
`
`FIG. 5 shows an example of the generated RTP packet 26.
`
`
`
`
`
`
`
`It shows the RTP packet separated every 32 bits; 00 to 31 on
`
`
`
`
`
`
`
`
`
`the horizontal axis indicate bit positions of the RTP packet
`
`
`
`
`
`
`
`
`
`separated every 32 bits. In the figure, fields of V, P, X, .
`.
`.
`
`
`
`
`
`
`
`
`
`CSRC shown as RTP Header provide the RTP header (RTP
`
`
`
`
`
`
`
`fixed header). This topic is described in detail in document
`3 and therefore will not be discussed again in detail.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The sync layer packet generated by the sync layer packet
`
`
`
`
`
`
`
`generator 32 is entered in RTP payload in FIG. 5. In the RTP
`
`
`
`
`
`
`
`
`payload, first a sync layer packet header (SL-PDU header)
`
`
`
`
`
`
`
`
`is placed, followed by sync layer packet payload (SL-PDU
`
`
`
`
`
`
`
`
`paylo