FILE HISTORY
`US 6,807,524
`
`6,807,524
`PATENT:
`INVENTORS: Bessette, Bruno
`Salami, Redwan
`Lefebvre, Roch
`
`TITLE:
`
`Perceptual weighting device and method for
`efficient coding of wideband signals
`
`APPLICATION
`NO:
`FILED:
`ISSUED:
`
`US2001830276A
`
`20 JUN 2001
`19 OCT 2004
`
`COMPILED:
`
`05 FEB 2016
`
`Ex. 1002 / Page 1 of 518
`Apple v. Saint Lawrence
`
`

`

`BEST COPY
`
`PATENT NUMBER
`
`-lI-
`
`p1204W0
`1259
`
`-
`
`--
`
`ISSUING CLASSWICATION
`r-
`CROSS REFERENCE(S)
`SUBCLASS (ONE SUBCLASS PER BLOCK)
`6' a a
`
`CLASS
`
`__y
`
`ORIGINAL
`
`SUBCLASS
`CLASS
`7 o,1
`.oo.)
`INTERNATIONAL CLASSIFICATION
`
`SContinued
`
`on issue Slip inside File Jacket
`
`STERMINAL
`SCLAMER
`
`Sh
`
`Drwg.
`
`DRAWINGS
`F;gs. Drwg.
`
`Print Fig.
`
`T
`
`CLAIMS ALLOWED
`Print Claim for O.G.
`
`I Claims
`
`] The tek of this patent
`subequeit to
`_
`
`(date)
`
`not extend beyqni the expiration date
`of U.P5eatent. No.
`
`NOTICE OF ALLOWANCE MAILED ,
`
`- VALDII
`immij
`
`ISSUE FEE
`mount Due
`
`tc..id
`
`O The terminnal
`.months o
`this patent have been disclaimed.
`
`ment Examiner)
`
`-
`
`(Date)
`
`E-E
`
`WARA~NG:
`The Information dedgeed herein may be restdoted. Unauthorized disclosu~'may be prohibited by the United States Code Title 35, Sections 122, 181 and 388.
`Possesasen oublds the U.S. Patent & Trademark Office is restricted to auth~Mid sen~fyee anti contractors only.
`j FICHE
`CD-ROM
`FILED WITH:
`DISK (CRF)
`Fomn PTO-436A
`(nev. ee)
`(Attached in pocket on rgt inside flap)
`
`ISSUE FEE IN FILE
`
`IFA(FI
`
`I.
`
`I
`
`I?i i
`
`I
`
`Ex. 1002 / Page 2 of 518
`
`

`

`6,807,524
`
`PERCEPTUAL WEIGHTING DEVICE AND METHOD FOR EFFICIENT
`CODING OF WIDEBAND SIGNALS
`
`Transaction History
`
`
`Transaction Description
`Date
`04-25-2001 Receipt of 371 Request
`05-15-2001 371 Application Preexamination Docketing
`05-15-2001 Correspondence Address Change
`05-21-2001 371 Application Preexamination Docketing
`05-22-2001 Notice of DO/EO Missing Requirements Mailed
`06-20-2001 Preliminary Amendment
`06-20-2001 Preliminary Amendment
`06-20-2001 Applicant 371 Filing Paper Received
`06-20-2001
`Initial Exam Team nn
`06-28-2001 Released to OIPE
`06-28-2001 Notice of DO/EO Acceptance Mailed
`07-25-2001 Application Dispatched from OIPE
`07-25-2001
`IFW Scan & PACR Auto Security Review
`09-18-2001
`Information Disclosure Statement (IDS) Filed
`09-18-2001
`Information Disclosure Statement (IDS) Filed
`10-04-2001 Case Docketed to Examiner in GAU
`01-24-2002 Case Docketed to Examiner in GAU
`01-24-2002 Case Docketed to Examiner in GAU
`06-10-2003 Miscellaneous Incoming Letter
`07-15-2003 Case Docketed to Examiner in GAU
`09-12-2003 Case Docketed to Examiner in GAU
`10-20-2003 Non-Final Rejection
`10-24-2003 Mail Non-Final Rejection
`01-23-2004 Response after Non-Final Action
`01-30-2004 Date Forwarded to Examiner
`04-01-2004
`Information Disclosure Statement (IDS) Filed
`04-01-2004
`Information Disclosure Statement (IDS) Filed
`04-13-2004 Oath or Declaration Required
`04-13-2004 Notice of Allowance Data Verification Completed
`04-14-2004 Correction - Oath or Declaration NOT Required
`04-14-2004 Mail Notice of Allowance
`04-14-2004 Mail Oath of Declaration Required
`04-21-2004 Dispatch to Publications
`04-22-2004 Workflow - File Sent to Contractor
`04-22-2004 Receipt into Pubs
`04-23-2004 Receipt into Pubs
`06-10-2004 Receipt into Pubs
`06-21-2004 Workflow - Customer Service Request - Finish
`06-21-2004 Workflow - Customer Service Request - Begin
`06-30-2004 Receipt into Pubs
`07-13-2004
`Issue Fee Payment Verified
`07-13-2004
`Issue Fee Payment Received
`08-09-2004 Receipt into Pubs
`09-10-2004 Receipt into Pubs
`09-17-2004 Dispatch to FDC
`09-17-2004 Application Is Considered Ready for Issue
`09-20-2004 Receipt into Pubs
`09-30-2004
`Issue Notification Mailed
`10-19-2004 Petition Entered
`10-19-2004 Workflow incoming petition IFW
`10-19-2004 Recordation of Patent Grant Mailed
`
`Ex. 1002 / Page 3 of 518
`
`

`

`10-19-2004 Patent Issue Date Used in PTA Calculation
`12-13-2004 Mail-Petition Decision - Granted
`03-12-2008 Correspondence Address Change
` 
`
`Ex. 1002 / Page 4 of 518
`
`

`

`09/830276
`
`K-
`
`PTENT APPLICATION
`
`nfg Ilel
`
`09830276
`
`INITIALS
`
`CONTENTS
`Date Received
`(Incl. C. of M.)
`or
`Date Mailed
`
`M_ .
`
`42_____
`
`.._______
`
`___
`
`44._
`
`_____
`
`_____07
`
`.JUN 2O0lv' 45
`
`1. Appication
`2.
`
`papers.
`
`1
`
`Date Received
`(Incl. C.f M)
`or
`Date Mailed
`
`W____
`
`_
`
`_
`
`_
`
`4L..
`
`7.
`
`Am
`
`G
`
`46.
`
`_____
`
`4
`47' __ _ _ __
`
`_ _
`
`______
`
`__
`
`_
`
`__
`
`_
`
`__
`
`_
`
`__
`
`_
`
`__
`
`_
`
`9.
`
`50.
`
`52. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`ER/353.
`
`____
`
`_
`
`14.
`
`15. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`55.____
`
`56.
`
`_
`
`_
`
`_
`
`__
`
`___
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`--
`
`16. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`57._
`
`17.
`
`. 18. __
`
`19. __
`
`5__ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _
`
`8._ _ _ _ _ _ _ _ _ _ _ _ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`59.
`
`60._
`
`61._
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`20. __
`
`_
`
`21. .~.
`
`22. __
`
`23. __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`62._
`
`63. _
`
`64. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`24. __
`
`25. __
`
`26. __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`65._
`
`66. _
`
`67.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`-_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`27. __
`
`28.
`
`29. __
`
`30. __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`68.
`
`69.__
`
`70. _
`
`71.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`__
`
`__
`
`31.
`
`32. __
`
`33. __
`
`34. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`72.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`.
`
`.~73.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`74._
`
`75. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`35.
`
`36. __
`
`37. __
`
`-__ _ _ _ _ _ _ _ _ _ _ _
`
`_ _ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`76. _
`
`77. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`78.-_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`38. __
`
`39. __
`
`40. _
`
`41. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`79. _
`
`80._
`
`81. _
`
`82. _
`
`(LEFT OUTSIDE)
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`Ex. 1002 / Page 5 of 518
`
`

`

`ISSUE SLIP STAPLE AREA (for additional cross references)
`
`PCSITION
`
`INITIALS
`
`ID NO.
`
`DATE
`
`LL
`
`=,,
`!
`FEE DETERMINATION
`O.I.P.E. CLASSIFIER
`FORMALITY REVIEW
`RESPONSE FORMALITY REVIEW
`
`--
`
`,,
`
`'-_
`
`_-"
`
`'_
`
`INDEX OF CLAIMS
`' ................................. Rejected
`N .............................. Non-elected
`Interference
`................................. Allowed
`I ..............................
`S
`(Through numeral)... Canceled
`-
`A .:............................... Appeal
`+ ................................. Restricted
`0 .............................. Objected
`
`Date
`
`Claim
`
`Date
`
`Claim
`
`Date
`
`Claim
`
`ut.
`
`5
`
`1
`
`-
`
`51
`52
`53
`54
`55
`56
`57
`58
`59
`60
`61
`62
`63
`64
`65
`661
`67
`68
`69
`70
`71
`72
`73
`74
`75
`76
`77
`78
`79
`80
`81
`82
`83
`84
`85
`88
`87
`88
`89
`90
`91
`92
`93
`94
`95
`98
`97
`98
`99
`1
`
`If more than 150 claims or 10 actions
`staple additional sheet here
`
`(LEFT INSIDE)
`
`101
`102
`10
`104
`105
`106
`107
`106
`109
`10
`111
`112
`
`114
`11
`1151
`116
`117
`118
`119
`20
`121
`22
`123
`124
`125
`26
`127
`128
`129
`130
`131
`32
`133
`134
`13
`
`136
`137
`38
`139
`40
`141-
`142
`14,
`144
`45
`146
`147
`14_
`14
`
`15
`
`-
`
`1
`
`S 3
`
`
`
`4
`$ 5
`(6 6
`7
`
`10
`ii 11
`
`y
`
`13 13
`1 14
`I 15
`16
`17
`.ir 18
`19
`20
`21
`22
`- 23
`24
`5 25
`( 26
`S27
`.a 28
`a9 29
`80 30
`7 31
`32
`33
`934
`35
`936
`S37
`138
`1739
`0 40
`1 41
`(J42
`93 43.
`44
`45
`46
`7 47
`48
`4 40
`50
`
`I
`
`Ex. 1002 / Page 6 of 518
`
`

`

`SEARCHED
`
`SEARCH NOTES
`(INCLUDING SEARCH STRATEGY)
`
`Class
`7IoL
`
`7oL4
`7 Lt
`
`Sub.
`
`;3Sa
`
`,1oa
`
`Date
`fI3j 4~')
`(iOcIt:j
`I ~Jb3
`
`LD(;A
`
`SJw
`
`Exmr.
`
`Date
`
`Exmr.
`
`£ A5 t5,c
`
`JyJ
`
`(0/1/03
`I &/' /o
`
`SE kL 4 e Pr;Ny;
`
`Sv 6; eM.2% h
`
`De;I w/
`DA..JJ k
`
`rpu
`
`I-I
`
`3/ j/o
`
`[ I
`
`:j'.
`
`INTERFERENCE SEARCHED
`Class
`Sub.
`Date
`Exmr.
`
`ac~x
`
`lrL
`
`..................
`
`I
`
`(RIGHT OUTSIDE)
`
`Ex. 1002 / Page 7 of 518
`
`

`

`L
`Number
`
`Hits Search Text
`
`S 14 "perceptualweighing"
`
`113 "weighing filter"
`
`3 "weighing filter" and preemphasis
`
`1003625 W(z)
`
`504 "W(z)"
`
`0 "W(z)" and weighing and preemphasis
`
`25 "W(z)" and weighing
`
`0 "weighing factor" and preemphasis
`
`386 "emphasis filter"
`
`DB
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`0 "weighing.filter" and "emphasis filter"
`
`USPAT
`
`0 "weighing filter" and "emphasis filter"
`
`USPAT
`
`15 "emphasis filter" and "weighing"
`
`233 ((pitch or perceptual) near (filter or
`filtering)) and (coding encoding encoder
`coder)
`18 (((pitch or perceptual) near (filter or
`filtering)) and (coding encoding encoder
`coder)) and (preprocessor or prefilter)
`1084 CELP
`
`712 CELP and 704/$
`
`US PAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`14 (CELP and 704/$) and "perceptual filter"
`
`USPAT
`
`1086 CELP "perceptual filter"
`
`14 CELP and "perceptual filter"
`
`47 CELP and (perceptual near (filter or
`filtering))
`50 ((pitch or perceptual) near (filter or
`filtering)) and (coding encoding encoder
`coder)and kroon
`0 "H.sub.z (a)=1-.beta.z-[(n+L)/L}L)" and
`kroon
`0 "H.sub.z (a)=1-.beta.z-[(n+L)/L]L)"
`
`0 "(a)-l-.beta.z-[(n+L)/L]L)"
`
`2020 "H.sub.z"
`
`1 "H.sub.z" and kroon
`
`0 "b(z)" and CELP
`
`18 CELP and preemphasis
`
`81 "preemphasis filter"
`
`211 "preemphasis filter" and 704/$
`
`3 "preemphasis filter" and "0.7"
`
`4279 filter same "0.7"
`
`14 filter same "0.7" and celp
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`USPAT
`
`Search History
`
`10/9/03 10:16:40 AM
`
`Page 1
`
`c : \Cases\BrunoBessette\Bruno-W
`
`. wep
`
`Time stamp
`
`2003/10/06
`10:24
`2003/10/06
`10:24
`2003/10/06
`10:27
`2003/10/06
`10:27
`2003/10/06
`10:27
`2003/10/06
`10:28
`2003/10/06
`10:31
`2003/10/06
`10:31
`2003/10/06
`10:32
`2003/10/06
`10:32
`2003/10/06
`10:32
`2003/10/06
`10:48
`2003/10/06
`13:00
`
`2003/10/06
`13:00
`
`2003/10/06
`11:26
`2003/10/06
`11:49
`2003/10/06
`15:02
`2003/10/06
`11:50
`2003/10/06
`12:02
`2003/10/06
`12:02
`2003/10/06
`13:41
`
`2003/10/06
`13:41
`2003/10/06
`14:46
`2003/10/06
`13:42
`2003/10/06
`13:42
`2003/10/06
`13:46
`2003/10/06
`14:46
`2003/10/06
`15:19
`2003/10/06
`15:19
`2003/10/06
`15:19
`2003/10/07
`10:26
`2003/10/07
`10:26
`2003/10/07
`14:01
`
`Ex. 1002 / Page 8 of 518
`
`

`

`5441.n ~594Zn
`544481.pn. 5699482.pn. 5701392.pn.
`5754974.pn.
`5444816.pn. 5699482.pn. 5701392.pn.
`5754974.pn.
`5444816.pn. 5699482.pn. 5701392.pn.
`5754976.pn.
`64-13200
`
`kokai
`
`"1-mu" and celp
`
`-
`
`I
`
`mu and celp
`
`"l-mu" and celp
`
`mu and 0.7 and celp
`
`USPAT
`
`USPAT
`
`USPAT
`
`JPO
`
`JPO
`
`JPO
`
`JPO
`
`USPAT
`
`USPAT
`
`mu and 0.7 and celp and "emphasis filter"
`
`USPAT
`
`_7__.f. Ui/O
`Zo3/10/UI
`14:03
`2003/10/07
`14:04
`2003/10/07
`14:04
`2003/10/08
`15:34
`2003/10/08
`15:37
`2003/10/08
`15:37
`2003/10/08
`15:38
`2003/10/08
`15:47
`2003/10/08
`15:49
`2003/10/08
`15:50
`
`Search History
`
`10/9/03 10:16:40 AM
`
`Page 2
`
`C: \Cases\BrunoBessette\BrunoWS . wsp
`
`Ex. 1002 / Page 9 of 518
`
`

`

`111
`
`111li II 111
`
`H1i 1111
`
`US006807524B1
`US 6,807,524 Bl
`Oct. 19, 2004
`
`(12) United States Patent
`Bessette et al.
`
`(54) PERCEPTUAL WEIGHTING DEVICE AND
`METHOD FOR EFFICIENT CODING OF
`WIDEBAND SIGNALS
`
`(75)
`
`Inventors:
`
`Bruno Bessette, Rock Forest (CA);
`Redwan Salami, Sherbrooke (CA);
`Roch Lefebvre, Canton de Magog
`(CA)
`
`(73) Assignee:
`
`Voiceage Corporation, Quebec (CA)
`
`(*) Notice:
`
`(21)
`
`Appl. No.
`
`:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`09/830,276
`
`(22)
`(86)
`
`PCI Filed:
`
`Oct. 27, 1999
`
`PCT No.:
`§ 371 (cX1),
`(2), (4) Date:
`
`PCT/CA99/01010
`
`Jun. 20, 2001
`
`(87) PCT Pub. No.: WOO0/25304
`
`PCT Pub. Date: May 4, 2000
`Foreign Application Priority Data
`(30)
`Oct. 27, 1998
`(CA) .......................................... 2252170
`Int. Cl.7 ................................................ G10L 19/04
`(51)
`704/200.1; 704/219; 704/262;
`(52) U.S. Cl .................
`704/224
`(58) Field of Search ................................. 704/222, 201,
`704/219, 262, 224
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`4,932,061 A
`5,307,441 A
`5,359,696 A
`5,444,816 A
`5,519,807 A
`5,664,055 A
`5,699,482 A
`5,701,392 A
`5,754,976 A
`5,963,898 A
`
`6/1990 Koon et al,.
`704/222
`* 4/1994
`zenag .....................
`* 10/1994 Gerson et al .............. 704/223
`8/1995 Adoul ct al.
`5/1996 Cellario et al.
`" 9/1997 Kroon ..................... 704/223
`121997 Adoul t al.
`12/1997 Adoul e al.
`5/1998 Adoul et al.
`10/1999 Navarro et al.
`
`(10o) Patent No.:
`(45) Date of Patent:
`
`6,006,174 A
`6,064,962 A
`6,192,334 BI
`6,449,590 B1
`
`* 12/1999
`" 5/2000
`2/2001
`* 92002
`
`Lin et al .................... 704/201
`Oshildri et al ........... 704/262
`Nomura
`Gao ........................... 704/219
`
`FOREIGN PATENT DOCUMENTS
`0 465 057 Al
`0465057 A
`0732686 A
`0 732 686 A2
`02-012300 A
`03-116199 A
`6-348300 A
`10-282997 A
`WO 96/21220
`
`1/1992
`1/1992
`9/1996
`9/1996
`1/1990
`5/1991
`12/1994
`10/1998
`7/1996
`
`OTHER PUBLICATIONS
`
`"Predictive Coding of Speech Signals and Subjective Error
`Criteria" by Bishnus S. Atal et al., IEEE Transaction ASSP,
`vol. 27, No. 3, pp. 247-254 Jun. 1979.
`
`* cited by examiner
`Primary Examiner--Tlivaldis Ivars Amits
`Assistant Eaminer-James S. Wozniak
`(74) Attorney, Agent, or Firmnn-Birch, Stewart, Kolasch &
`Birch, LLP
`(57)
`
`ABSTRACT
`
`A perceptual weighting device for producing a perceptually
`weighted signal in response to a wideband signal comprises
`a signal pre-emphasis filter, a synthesis filter calculator, and
`a perceptual weighting filter. The signal pre-emphasis filter
`enhances the high frequency content of the wideband signal
`to thereby produce a pre-emphasized signal. The signal
`pr-emphasis filter has a transfer function of the form:
`P(z)-1-pz ', wherein p is a pre-emphasis factor having a
`value located between 0 and 1. The synthesis filter calculator
`is responsive to the pre-emphasized signal for producing
`synthesis filter coefficients. Finally, the perceptual weighting
`filter processes the pre-emphasized signal in relation to the
`synthesis filter coefficients to produce the perceptually
`weighted signal. The perceptual weighting filter has a trans-
`fer function, with fixed denominator, of the form: W (z)-A
`1.
`') where 0cy2<,
`(z/,)/(1-y 2
`
`49 Claims, 4 Drawing Sheets
`
`SV ED
`ra -- --------------------
`- .......-----------
`S
`
`-
`
`.
`
`.
`
`.
`I
`
`.
`
`.
`
`. .
`
`.
`.
`.
`----------
`
`.
`
`.
`
`.
`
`pnE
`
`rL
`
`W
`. .. . .
`
`......
`
`ls.=
`.. -_ -- .
`
`.
`
`L__-
`
`- -
`
`P ANXY
`
`IN
`
`MN12AAN
`
`. z;
`
`S
`
`Y~uc
`
`,M
`
`c SEO
`
`9t
`
`L-----------
`-------------------------------------------. 1,
`Ipy NEP°NSE --- "I--- -
`--- Y--
`-------
`-
`p;
`
`Ex. 1002 / Page 10 of 518
`
`

`

`U.S. Patent
`
`Oct. 19, 2004
`
`Sheet 1 of 4
`
`US 6,807,524 Bi
`
`--------- ------
`
`------------
`
`_
`
`I
`
`Cw
`
`E
`
`I
`
`i i
`
`II
`
`1 Lnos
`
`I
`
`I
`
`Ix
`
`'dV~
`
`Oa
`
`+
`
`_ II
`
`.i
`
`L
`
`an
`
`a°;u
`
`I
`
`I hzo
`
`E°o
`
`Ex. 1002 / Page 11 of 518
`
`

`

`U.S. Patent
`
`Oct. 19, 2004
`
`Sheet 2 of 4
`
`US 69807,524 B1
`
`- xV
`CL W-w
`
`1
`
`Ex. 1002 / Page 12 of 518
`
`

`

`N.1'IIKIIIIIIlla.I
`
`p
`t
`
`“5928
`
`r
`
`. . . . . . . . . . .
`
`I
`b , ;, I
`
`I'
`
`39
`f- -
`--J i,
`I I
`
`ti
`
`I
`
`I "-
`
`I
`
`Z
`
`—I_—‘-—-_—J
`I.______..
`- - = ---'
`-
`--- ----
`r"
`
`o~
`o
`
`<n
`
`," I
`t. _
`
`t
`
`I
`
`.
`
`"
`>
`
`g
`
`I
`
`. °o
`
`I
`
`i 'i , -' .. I
`L
`
`e
`
`-
`
`------ r
`
`L,"
`
`H1
`
`II
`
`1
`
`-
`
`
`
`5858cx8308
`
`I
`I
`
`I
`
`L
`
`Iota18E
`
`-
`
`L
`
`I
`
`U.S. Patent
`US. Patent
`
`Oct. 19, 2004
`Oct. 19, 2004
`
`4fl03amS
`Sheet 3 of 4
`
`US 6,807,524 B1
`US 6,807,524 B1
`
`-------------,
`
`L
`
`j
`
`h
`
`1+
`
`,
`
`$9
`a
`
`d
`
`s
`
`1
`
`I
`
`I
`I __
`
`moBmdm
`
`<a
`w
`
`iN
`
`
`
`>05544.22.:
`
`Emopémzuo-Iumfim
`
`
`
`Ex. 1002 / Page 13 of 518
`
`

`

`U.S. Patent
`
`Oct. 19, 2004
`
`Sheet 4 of 4
`
`US 6,807,524 B1
`
`--------------------------------
`
`'l
`
`CELLULAR
`COMMUNICATION
`SYSTEM
`
`---
`,--------L4
`
`419
`
`4
`,-418
`
`417/
`
`RECEIVER
`I
`
`46
`
`1,1
`
`TX
`.
`
`,
`
`l
`
`pg
`I
`
`RX
`
`i
`I
`
`41----
`
`I
`
`I
`
`427
`TCONTROLLER
`
`40
`
`ST BASETION
`
`BASE
`
`STATION
`
`STATION
`
`402-
`
`-
`
`- 42
`
`402
`
`409
`
`S---------------
`
`-- 4
`
`406
`
`r------
`-
`S'
`In
`mPo
`iI
`I
`
`-
`
`_
`
`" .-------- r
`'.-"
`I
`
`-
`I I
`
`C
`CONTROL
`| TERMINAL
`
`Ex. 1002 / Page 14 of 518
`
`

`

`US 6,807,524 B1
`
`1
`PERCEPTUAL WEIGHTING DEVICE AND
`METHOD FOR EFFICIENT CODING OF
`WIDEBAND SIGNALS
`
`This application is the national phase under 35 U.S.C.
`§371 of PCi' International Application No. PCT/CA99/
`01010 which has an International filing date of Oct. 27,
`1999, which designated the United States of America and
`was published in English.
`BACKGROUND OF THE INVENTION
`1. Field of the invention
`The present invention relates to a perceptual weighting
`device and method for producing a perceptually weighted
`signal in response to a wideband signal (0-7000 Hz) in order
`to reduce a difference between a weighted wideband signal
`and a subsequently synthesized weighted wideband signal.
`2. Brief description of the prior art
`The demand for efficient digital wideband speech/audio
`encoding techniques with a good subjective quality/bit rate
`trade-off is increasing for numerous applications such as
`audio/video teleconferencing, multimedia, and wireless
`applications, as well as Internet and packet network appli-
`cations. Until recently, telephone bandwidths filtered in the
`range 200-3400 Hz were mainly used in speech coding
`applications. However, there is an increasing demand for
`wideband speech applications in order to increase the intel-
`ligibility and naturalness of the speech signals. A bandwidth
`in the range 50-7000 Hz was found sufficient for delivering
`a face-to-face speech quality. For audio signals, this range
`gives an acceptable audio quality, but is still lower than the
`CD quality which operates on the range 20-20000 Hz.
`A speech encoder converts a speech signal into a digital
`bitstream which is transmitted over a communication chan-
`nel (or stored in a storage medium). The speech signal is
`digitized (sampled and quantized with usually 16-bits per
`sample) and the speech encoder has the role of representing
`these digital samples with a smaller number of bits while
`maintaining a good subjective speech quality. The speech
`decoder or synthesizer operates on the transmitted or stored
`bit stream and converts it back to a sound signal.
`One of the best prior art techniques capable of achieving
`a good quality/bit rate trade-off is the so-called Code Excited
`Linear Prediction (CELP) technique. According to this
`technique, the sampled speech signal is processed in suc-
`cessive blocks of L samples usually called frames where L
`is some predetermined number (corresponding to 10-30 ms
`of speech). In CELP, a linear prediction (LP) synthesis filter
`is computed and transmitted every frame. The L-sample
`frame is then divided into smaller blocks called subframes of
`size N samples, where L-kN and k is the number of
`subframes in a frame (N usually corresponds to 4-10 ms of
`is determined in each
`speech). An excitation signal
`subframe, which usually consists of two components: one
`from the past excitation (also called pitch contribution or
`adaptive odebook) and the other from an innovative code-
`book (also called fixed codebook). This excitation signal is
`transmitted and used at the decoder as the input of the LP
`synthesis filter in order to obtain the synthesized speech.
`An innovative codebook in the CELP context, is an
`indexed set of N-sample-long sequences which will be
`referred to as N-dimensional codevectors. Each codebook
`sequence is indexed by an integer k ranging from 1 to M
`where M represents the size of the codebook often expressed
`as a number of bits b, where M-2b.
`To synthesize speech according to the CELP technique,
`each block of N samples is synthesized by filtering an
`appropriate codevector from a codebook through time vary-
`the spectral characteristics of the
`ing filters modelling
`
`speech signal. At the encoder end, the synthesis output is
`computed for all, or a subset, of the codevectors from the
`codebook (codebook search). The retained codevector is the
`one producing the synthesis output closest to the ori*inal
`Sspeech signal according to a perceptually weighted distor-
`tion measure. This perceptual weighting is performed using
`a so-called perceptual weighting filter, which is usually
`derived from the LP synthesis filter.
`in encoding
`The CELP model has been very successful
`telephone band sound signals, and several CELP-based
`10 standards exist in a wide range of applications, especially in
`digital cellular applications. In the telephone band, the sound
`signal is band-limited to 200-3400 Hz and sampled at 8000
`samples/sec. In wideband speech/audio applications, the
`sound signal is band-limited to 50-7000 Hz and sampled at
`1516000 samples/sec.
`Some difficulties arise when applying the telephone-band
`optimized CELP model to wideband signals, and additional
`features need to be added to the model in order to obtain high
`quality wideband signals. Wideband signals exhibit a much
`wider dynamic range compared to telephone-band signals,
`20 which results in precision problems when a fixed-point
`implementation of the algorithm is required (which is esseo-
`tial in wireless applications). Furthermore, the CELP model
`will often spend most of its encoding bits on the low-
`frequency region, which usually has higher energy contents,
`25 resulting in a low-pass output signal. To overcome this
`problem, the perceptual weighting filter has to be modified
`in order to suit wideband signals, and pre-emphasis tech-
`niques which boost the high frequency regions become
`important to reduce the dynamic range, yielding a simpler
`fixed-point implementation, and to ensure a better encoding
`30 of the higher frequency contents of the signal.
`In CELP-type encoders, the optimum pitch and innova-
`tive parameters are searched by minimizing the mean
`squared error between the input speech and synthesized
`speech in a perceptually weighted domain. This is equivalent
`35 to minimizing the error between the weighted input speech
`and weighted synthesis speech, where the weighting is
`performed using a filter having a transfer function W(z) of
`the form:
`l.
`w(gr)t.(Z/st4(4gZ) where oct<r,<
`40 In analysis-by-synthesis (AbS) coders, analysis show that
`the quantization error is weighted by the inverse of the
`weighting filter, W-'(z), which exhibits some of the formant
`structure in the input signal. Thus, the masking property of
`the human ear is exploited by shaping the error, so that it has
`45 more energy in the formant regions, where it will be masked
`by the strong signal energy present in those regions. The
`amount of weighting is controlled by the factors IT and 72.
`This filter works well with telephone band signals.
`However, it was found that this filter is not suitable for
`so efficient perceptual weighting when it was applied to wide-
`band signals. It was found that this filter has inherent
`limitations in modelling the formant structure and the
`required spectral tilt concurrently. The spectral tilt is more
`pronounced in wideband signals due to the wide dynamic
`55 range between low and high frequencies It was suggested to
`add a tilt filter into filter W(z) in order to control the tilt and
`formant weighting separately.
`OBJECT OF THE INVENTION
`An object of the present invention is therefore to provide
`a perceptual weighting device and method adapted to wide-
`band signals, using a modified perceptual weighting filter to
`obtain a high quality reconstructed signal, these device and
`method enabling fixed point algorithmic implementation.
`SUMMARY OF THE INVENTION
`in accordance with the present
`More specifically,
`invention, there is provided a perceptual weighting device
`
`65
`
`Ex. 1002 / Page 15 of 518
`
`

`

`for producing a perceptually weighted signal in response to
`a wideband signal in order to reduce a difference between a
`weighted wideband signal and a subsequently synthesized
`weighted wideband signal. This perceptual weighting device
`comprises:
`a) a signal preemphasis filter responsive to the wideband
`signal for enhancing the high frequency content of the
`wideband signal to thereby produce a preemphasised
`signal;
`b) a synthesis filler calculator responsive to the preem-
`phasised signal for producing synthesis filter coeffi-
`cients; and
`c) a perceptual weighting filter, responsive to the preem-
`phasised signal and the synthesis filter coefficients, for
`filtering the preemphasised signal in relation to the
`synthesis filter coefficients to thereby produce the per-
`ceptually weighted signal. The perceptual weighting
`filter has a transfer function with fixed denominator
`whereby weighting of the wideband signal in a formant
`region is substantially decoupled from a spectral tilt of
`that wideband signal.
`The present invention also relates to a method for pro-
`ducing a perceptually weighted signal in response to a
`wideband signal in order to reduce a difference between a
`weighted wideband signal and a subsequently synthesized
`weighted wideband signal. This method comprises: filtering
`the wideband signal to produce a preemphasised signal with
`enhanced high frequency content; calculating, from the
`preemphasised signal, synthesis filter coefficients; and fil-
`tering the preemphasised signal in relation to the synthesis
`filter coefficients to thereby produce a perceptually weighted
`speech signal. The filtering comprises processing the pre-
`emphasis signal through a perceptual weighting filter having
`a transfer function with fixed denominator whereby weight-
`ing of the wideband signal in a formant region is substan-
`tially decoupled from a spectral tilt of the wideband signal.
`In accordance with preferred embodiments of the subject
`invention:
`reduction of the dynamic range comprises filtering the
`wideband signal through a transfer function of the
`form:
`
`wherein p is a preemphasis factor having a value
`located between 0 and 1;
`the preemphasis factor p is 0.7;
`the perceptual weighting filter has a transfer function of
`the form:
`w(r).-A (rlyt(1-y; -x)
`
`where Ocy~2,.c 1 and y2 and y, are weighting control
`values; and
`the variable y, is set equal to p.
`Therefore, the overall perceptual weighting of the quan-
`tization error is obtained by a combination of a preemphasis
`filter and a modified weighting filter to enable high subjec-
`tive quality of the decoded wideband sound signal into filter
`W(z) in order to control the tilt and formant weighting
`separately.
`The solution to the problem exposed in the brief descrip-
`tion of the prior art is accordingly to introduce a preemphasis
`filter at the input, compute the synthesis filter coefficients
`based on the preemphasized signal, and use a modified
`perceptual weighting filter by fixing its denominator. By
`reducing the dynamic range of the wideband signal, the
`preemphasis filter renders the wideband signal more suitable
`
`35s
`
`40
`
`45
`
`so
`
`ss
`
`60o
`
`US 6,807,524 B1
`
`20.
`
`as
`
`30
`
`for fixed-point implementation, and improves the encoding
`of the high frequency contents of the spectrum.
`The present invention further relates to an encoder for
`encoding a wideband signal, comprising: a) a perceptual
`s weighting device as described herein above; b) an pitch
`to the perceptually
`codebook search device responsive
`weighted signal for producing pitch codebook parameters
`and an innovative search target vector; c) an innovative
`codebook search device, responsive to the synthesis filter
`coefficients and to the innovative search target vector, for
`10 producing innovative codebook parameters; and d) a signal
`forming device for producing an encoded wideband signal
`comprising the pitch codebook parameters, the innovative
`codebook parameters, and the synthesis filter coeficients.
`Still further in accordance with the present invention,
`15 there is provided:
`a cellular communication system for servicing a large
`geographical area divided into a plurality of cells,
`comprising: a) mobile transmitter/receiver units; b)
`cellular base stations respectively situated in the cells;
`c) a control terminal for controlling communication
`between the cellular base stations; d) a bidirectional
`wireless communication sub-system between each
`mobile unit situated in one cell and the cellular base
`station of this cell, this bidirectional wireless commu-
`nication sub-system comprising, in both the mobile unit
`and the cellular base station:
`i) a transmitter including an encoder as described
`hereinabove for encoding a wideband signal and a
`transmission circuit for transmitting the encoded
`wideband signal; and
`ii) a receiver including a receiving circuit for receiving
`a transmitted encoded wideband signal and a decoder
`for decoding the received encoded wideband signal.
`a cellular mobile transmitter/receiver unit comprising:
`a) a transmitter including an encoder as described
`hereinabove for encoding a wideband signal and a
`transmission circuit for transmitting the encoded
`wideband signal; and
`b) a receiver including a receiving circuit for receiving
`a transmitted encoded wideband signal and a decoder
`for decoding the received encoded wideband signal;
`a cellular network element comprising:
`a) a transmitter including an encoder as described
`hereinabove for encoding a wideband signal and a
`transmission circuit for transmitting the encoded
`wideband signal; and
`b) a receiver including a receiving circuit for receiving
`a transmitted encoded wideband signal and a decoder
`for decoding the received encoded wideband signal;
`and
`a bidirectional wireless communication sub-system
`between each mobile unit situated in one cell and the
`cellular base station of this cell, this bidirectional
`wireless communication sub-system comprising,
`in
`both the mobile unit and the cellular base station:
`a) a transmitter including an encoder as described
`hereinabove for encoding a wideband signal and a
`transmission circuit for transmitting the encoded
`wideband signal; and
`b) a receiver including a receiving circuit for receiving
`a transmitted encoded wideband signal and a decoder
`for decoding the received encoded wideband signal.
`The objects, advantages and other features of the present
`invention will become more apparent upon reading of the
`6s following non restrictive description of preferred embodi-
`ments thereof, given by way of example only with reference
`lo the accompanying drawings.
`
`Ex. 1002 / Page 16 of 518
`
`

`

`US 6,807,524 B1
`
`5
`BRIEF DESCRIPTION OF THE DRAWINGS
`In the appended drawings:
`FIG. 1 is a schematic block diagram of a preferred
`embodiment of wideband encoding device;
`FIG. 2 is a schematic block diagram of a preferred
`embodiment of wideband decoding device;
`FIG. 3 is a schematic block diagram of a preferred
`embodiment of pitch analysis device; and
`FIG. 4 is a simplified, schematic block diagram of a o0
`cellular communication system in which the wideband
`encoding device of FIG. 1 and the wideband decoding
`device of FIG. 2 can be used.
`
`s
`
`is
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`As well known to those of ordinary skill in the art, a
`cellular communication system such as 401 (see FIG. 4)
`provides a telecommunication service over a large geo-
`graphic area by dividing that large geographic area into a 20
`number C of smaller cells. The C smaller cells are serviced
`by respective cellular base stations 402,, 402, .
`. 402, to
`provide each cell with radio signalling, audio and data
`channels.
`Radio signalling channels are used to page mobile radio- 2s
`telephones (mobile transmitter/receiver units) such as 403
`within the limits of the coverage area (cell) of the cellular
`base station 402, and to pl