IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`REQUEST FOR :X PARTE REEXAMINATION
`UNDER35 U.S.C. $8 302 ET SEQ., AND
`37 CER. § 1.510 ETSEQ.
`
`In re Patent of:
`
`Inventor: Patrick Pirim
`
`Patent No.: 6,959,293
`
`Filed: February 23, 2001
`
`Issued: October 25, 2005
`
`For. Method and Device for Automatic
`Visual Perception
`
`Mail Stop Ax Parte Reexam
`Commussioner for Patents
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`REQUEST FOR EX PARTE REEXAMINATION OF U.S. PATENT NO. 6,959,293
`
`IPT Ex-2003, p. 0001
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0001
`LG v IPT
`IPR2023-00104
`
`

`

`TABLE OF CONTENTS
`
`REQUEST FOR £XPARTE REEXAMINATION OFU.S. PATENTNO.6,959,293... ccscsore i
`
`"TABLE OF EXHIBITS ......cccsccococscsccscsonococooncsceacsonoascacnceccncsoncascacaceccncsoncescscsceccnosoncesescscecenononcese ly
`
`I
`
`CLAIM FOR WHICH REEXAMINATION IS REQUESTED AND THE
`PROPOSED GROUNDS FOR RETECTION ....ccocscscsescosesesccscscsesvenesscacscscscovesesasassesesees i
`
`ff
`
`PROCEDURAL BACKGROUND AND RELATED PROCEEDINGS.csccscsonocccnononsenone 2
`
`Ue.
`
`OVERVIEWQF THE ’293 PATENT AND ITS RELEVANT PROSECUTION .vccocccses 3
`
`A.
`
`B.
`
`THE °293 PATENT ooo cccceccccccccccceccececcccececceeesecesvececeesesstsesvevecersesttenevevectsststtteneveeed
`
`PROSECUTION HISTORY RELEVANT TO CLAIM | OF THE 293 PATENT ooo... 6
`
`TV.
`
`OVERVIEWOF THE PRIOR ART.....ccccscsscscsesescosescssovesesessosesescoscsesessosesessoscnesessoseseeses é
`
`A.
`
`B.
`
`Cc.
`
`PTRIM POT ooo cecccccececececcaceceveetesecececrsseveeteseceecarsteveeteseceesarssaventvseeeesersrenenees 6
`
`STEGED ooo coco cccececececcccevecuecececeececavecssreceseececavecsireceseecevaverstteceseecevavarsttteesvecevaverees 10
`
`TROTA ccc ccccccccevececcecececcueuvevevcsceseceusuvevevecsessacaenvereveesereasacusevevevseseecacavevevevseneecs 12
`
`¥V.
`
`VE
`
`STATEMENTOF EACHSUBSTANTIAL NEW QUESTION OF
`PATENTABILITY.....ccscserorococsovoesescrorocscsovoeceserorocecsouvecesovercescsoececesovercescsoevecesovercescsoeoeces 14
`
`DETALED EXPLARATION OF THE PERTINENCY ARB MARRNER OF
`APPLYING THE CITED PRIOR ART TO CLAIM 1... cccscscnccscnonccocsononceacnonceocaononoeae is
`
`A.
`
`B.
`
`CLAIM CONSTRUCTION ooo coco cccccccecccececececsueeecececececeaeussvecececeseaesstseseececersacsstneeees 15
`
`CLAIM | OF THE °293 PATENT IS INVALID AS OBVIOUS UNDER 35 U.S.C. 8
`103 OVER PIRIM PCT IN VIEWOF SIEGEL. cece cece eetrttectetteees is
`
`1.
`
`2.
`
`3.
`
`4.
`
`[1 PRE]: A VISUAL PERCEPTION PROCESSOR FOR AUTOMATICALLY DETECTING
`AN EVENT OCCURRING IN A MULTIDIMENSIONALSPACEG, J) EVOLVING OVER
`TIME WITH RESPECT TO AT LEAST ONE DIGITIZED PARAMETER IN THE FORMOF
`
`A DIGITAL SIGNAL ON A DATA BUS, SAID DIGITAL SIGNAL BEING IN THE FORM
`OF A SUCCESSION Aur OF BINARY NUMBERS ASSOCIATED WITH
`SYNCHRONIZATION SIGNALS ENABLING TO DEFINE A GIVEN INSTANT ('P) OF
`THE MULTIDIMENSIONALSPACE AND THE POSITION (, J) IN THIS SPACE, THE
`VISUAL PERCEPTION PROCESSOR COMPRISING o00....0.000c.cccceccceeseeceettseeeeees 16
`
`[LA]: THE DATA BUS; [IB]: ACONTROLUNIT ooo eee eeeeey 17
`
`[ic]: A TIME COINCIDENCES BUS CARRYING AT LEAST A TIME COINCIDENCE
`SIGNALS ooo cece eee ce eee cca ceeee tenets tec enetenceeeseteeesevescnieteseecesereteeseireneesenes i7
`
`[1D]: AT LEAST TWO HISTOGRAMCALCULATION UNITS FOR THE TREATMENT
`OF THE AT LEAST ONE PARAMETER, 200000000000 ccccccccce cee ccc tee eceeteteteettseeneeiees 19
`
`i
`
`IPT Ex-2003, p. 0002
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0002
`LG v IPT
`IPR2023-00104
`
`

`

`(ay
`
`6.
`
`[ fE]: THE HISTOGRAM CALCULATION UNITS BEING CONFIGURED TO FORM A
`HISTOGRAM REPRESENTATIVE OF THE PARAMETER AS A FUNCTION OF A
`
`VALIDATIONSIGNAL occ c nent e reece et ee en eens eee eeeneeeeeeeeeseneteeeeeeeneeees 20
`
`[if]: TO DETERMINEBY CLASSIFICATION A BINARYCLASSIFICATIONSIGNAL
`RESULTING FROM A COMPARISONOF THE PARAMETER AND A SELECTION
`
`CRITERION C, WHEREIN THE CLASSIFICATION SIGNALIS SENT TO THE TIME
`COINCIDENCES BUS, AND WHEREIN THE VALIDATION SIGNALIS PRODUCED
`FROM TIME COINCIDENCES SIGNALS FROMTHE TIME COINCIDENCE BUS SO
`
`THAT THE CALCULATION OF THE HISTOGRAMDEPENDS ON THE
`
`CLASSIFICATIONSIGNALS CARRIED BY THE TIME COINCIDENCE BUS. ........... 23
`
`C,
`
`°293 PATENT CLAIM1 IS INVALID AS OBVIOUS UNDER 35 U.S.C. § 103 OVER
`PIRIM PCT IN VIEW OF HIROTA 20000cc cece cece ect cet eeeettteecttseeseeenses 24
`
`1,
`
`2.
`
`[1 PRE] -~[1D], [iF] ARE UNDISPUTED To BE DISCLOSED IN PiRIM PCT...... 25
`
`[ fE]: THE HISTOGRAM CALCULATION UNITS BEING CONFIGURED TO FORM A
`HISTOGRAM REPRESENTATIVE OF THE PARAMETERAS A FUNCTION OF A
`
`VALIDATIONSIGNAL occ c nent e reece et ee en eens eee eeeneeeeeeeeeseneteeeeeeeneeees 25
`
`CLAIM | OF THE °293 PATENT IS INVALID AS OBVIOUS UNDER 35 U.S.C. 8
`103 OVER HIROTALooe cence cet toe e ct ett as tore btteutietteetseneteenrees 29
`
`1.
`
`2.
`
`3.
`
`4,
`
`wa
`
`6.
`
`[1 PRE]: A VISUAL PERCEPTION PROCESSOR FOR AUTOMATICALLY DETECTING
`AN EVENT OCCURRING IN A MULTIDIMENSIONAL SPACE (1, J) EVOLVING OVER
`TIME WITH RESPECT TO AT LEAST ONE DIGITIZED PARAMETER IN THE FORMOF
`
`A DIGITAL SIGNAL ON A DATABUS, SAID DIGITAL SIGNAL BEING IN THE FORM
`OF A SUCCESSION Ant OF BINARY NUMBERS ASSOCIATED WITH
`SYNCHRONIZATION SIGNALS ENABLING TO DEFINE A GIVEN INSTANT (T} OF
`THE MULTIDIMENSIONALSPACE AND THE POSITION (, J) IN THIS SPACE, THE
`VISUAL PERCEPTION PROCESSOR COMPRISING .00000.0.000 0 cccccecceeetettteteene 2G
`
`[LA]: THE DATA BUS; [IB]: A CONTROL UNIT occ cece eens 34
`
`[ich A TIME COINCIDENCES BUS CARRYING AT LEAST A TIME COINCIDENCE
`SIGNALS oooene eee r nse reno eo pete be rbot beter ebense renner ene 32
`
`[iD]: AT LEAST TWO HISTOGRAMCALCULATION UNITS FOR THE TREATMENT
`OF THE AT LEAST ONE PARAMETER
`33
`
`[TE]: THE HISTOGRAMCALCULATION UNITS BEING CONFIGUREDTO FORM A
`HISTOGRAM REPRESENTATIVE OF THE PARAMETER AS A FUNCTION OF A
`
`VALIDATION SIGNAL ooo. cne een e ene e eset en ee neta cerca eteeneeasseceseneseseneen ses 34
`
`[if]: TO DETERMINEBY CLASSIFICATION A BINARYCLASSIFICATIONSIGNAL
`RESULTING FROMA COMPARISON OF THE PARAMETER AND A SELECTION
`CRITERION C, WHEREIN THE CLASSIFICATION SIGNALIS SENT TO THE TIME
`COINCIDENCES BUS, AND WHEREIN THE VALIDATION SIGNAL IS PRODUCED
`FROM TIME COINCIDENCES SIGNALS FROMTHE TIME COINCIDENCE BUS SO
`
`THAT THE CALCULATION OF THE HISTOGRAM DEPENDS ON THE
`
`CLASSIFICATIONSIGNALS CARRIED BY THE TIME COINCIDENCE BUDS. 0.0.0.0... 35
`
`il
`
`IPT Ex-2003, p. 0003
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0003
`LG v IPT
`IPR2023-00104
`
`

`

`JU.
`
`FEE PURSUANTTO 37 CLELUR. § LSEGGA) ..cceccscsosocscnnoncesononsencnonccsenonocesonensecesononsene 36
`
`VUE
`
`CERTIFICATION OF SERVICE PURSUANT TO 37 C.BLR § LSEO(B)(S)... cece 36
`
`1X.
`
`CERTIFICATION OF NO ESTOPPEL UNDER 37 C.P.R. § LS1O(B)(G) ..scsrsese 36
`
`CONCLUSION...ccccsosorsesereroecevorcecesesoroescrevorsesenoecescnoscescsononsesevoecesevonorseseneroeseseroesescnoeoeaes 37
`
`ii
`
`IPT Ex-2003, p. 0004
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0004
`LG v IPT
`IPR2023-00104
`
`

`

`TABLE OF EXRIEBITS
`
`
` U.S.PatentNo.6,959,293
`
`First Amended Complaint for Patent Infringement,
`
`/mage Processing
`
`technologies, LLC v. Samsung flectronics Co., Lid., ECF No. 69 (E.D.
`
`Tex. Dec. 23, 2016}
`
`Answer, Affirmative Defenses, and Counterclaims (“Answer”) to the First
`
`Amended Complaint
`
`for Patent
`
`Infringement,
`
`/mage Processing
`
`Technologies, LLC v. Samsung Electronics Co., Lid., ECF No. 132 (ED.
`
`Tex. Dec. 23, 2016)
`
`Excerpts of File History for U.S. Patent No. 6,959,293
`
`International Patent Publication WO 99/36893 (Pirim PCT’)
`
`Siegel, Howard I, et al., “PASM: A Partitionable SIMD/MIMD System
`
`for Image Processing and Pattern Recognition,” TEEE Transactions on
`
`Computers, Vol. C-30, No. 12 (December 1981) (Siegel”)pe
`
`pe
`
`pe
`
`U.S. Patent No. 4,817,175 (Tenenbaum’)
`
`U.S. Patent No. 4,891,787 Gifford’)
`
`Memorandum Opinion and Order, fmage Processing Technologies, LLCy.
`
`samsung Electronics Co., Lid., ECF No. 174 (B.D. Tex. Tune 21, 2017)pe
`
`Patent Owner
`
`Image Processing Technologies, LLC’s Preliminary
`
`Response Pursuant to 37 C.F.R. § 42.107, IPR2017-00336 (P.T.A.B. Mar.
`
`
`
`
`
`15, 2017)
`enenennennnnnnnnenrenennnnnnnnennfmm
`Decision Granting Institution of /nter Partes Review, IPR2017-00336,
`
`13
`
`14
`
`Paper 15 (P.T.AB. May25, 2017)
`
`Certificate of Service
`
`iv
`
`IPT Ex-2003, p. 0005
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0005
`LG v IPT
`IPR2023-00104
`
`

`

`} CLADM FOR WHICH REEXAMINATION IS REQUESTED AND THE
`PROPOSED GROUNDS FOR REJECTION
`
`Samsung Electronics Co., Lid. and Samsung Electronics America, Inc. (collectively,
`
`“Requester” or “Samsung”’), through its undersigned counsel, hereby respectfully requests ex
`
`parte reexarmmnation of Claim 1 of U.S. Patent No. 6,959,293 (“the °293 Patent”) pursuant to 35
`
`U.S.C§ 302 ef seg. and the provisions of 37 CFR. § 1.510 ef seg. [tis submitted that Claim 1
`
`of the "293 Patent is renderedinvalid by the following prior art patent and printed publications:
`
`L.
`
`International Patent Publication WO 99/36893 (“Prim PCT’), published July 22,
`
`1999, a copy of which is annexed hereto as Exhibit 5.
`
`2. Siegel, Howard J., ef al, “PASM: A Partitionable SIMD/MIMD Systern for
`
`Image Processing and Pattern Recognition,” /EEE Transactions on Computers,
`
`Vol. C-30, No. 12 (December 1981) (“Siegel”), a copy of whichis annexed hereto
`
`as Exhibit 6.
`
`fad US. Patent No. 6,118,895 (Hirota”), filed March 5, 1996, issued September 12,
`
`2000, a copy of which is annexed hereto as Exhibit 7.
`
`Specifically, Requester submits that Claim 1 should be rejected as follows:
`
`I.
`
`2.
`
`3.
`
`as obvious under 35 U.S.C. § 103 over Prim PCT in viewofSiegel.
`
`as obvious under 35 U.S.C. § 103 over Pirim PCTin view of Hirota.
`
`as obvious under 35 U.S.C. § 103 over Hirota.
`
`A copy of every prior art patent and printed publication relied upon or referred to herein is
`
`submitted herewith as required by 37 CFR. § 1.510(b}3).
`
`Pursuant to 37 C.F.R. § 1.510(b)(4), annexed hereto as Exhibit 1
`
`is a copy of the’293
`
`Patent including the front face, drawings, specification, and claims (in double column format) for
`
`which ex parfe reexamination is requested, including a copy of the Certificate of Correction
`
`dated September 21, 2010. To the best of Requester’s knowledge, as of the date of this request,
`
`no reexaminationcertificate or other certificate of correction has been issued in connection with
`
`the °293 Patent.
`
`IPT Ex-2003, p. 0006
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0006
`LG v IPT
`IPR2023-00104
`
`

`

`HE.
`
`PROCEDURAL BACKGROUNDAND RELATED PROCEEDINGS
`
`Patent Owner Image Processing Technologies, LLC (“Patent Owner” or “IPT”) brought
`suit against Requester asserting Claims 1, 3, 18, 19, 22 and 29 of the °293 Patent.' Jimage
`
`Processing Technologies, LEC v. Samsung Electronics Co., Lid. and Samsung Electronics
`
`America, Inc, Case No. 2:16-CV-0505-IRG (ED. Tex.,
`
`filed May 13, 2016) (the IPT
`
`litigation’). Four of the six asserted claims (Claims 3, 18, 19 and 22} were found invalid as
`
`indefinite by the district court, and Claim 29 was found invalid as directed to ineligible subject
`
`matter under 35 U.S.C. § 101. This case is presently stayed pending resolution of multiple /mfer
`
`Partes Reviews. While Claims 3-22, and 29 of the °293 Patent have been rendered invalid as a
`
`result of the district court’s rulings,’ the district court has not yet considered or decided any issue
`
`relating to the validity of Claim 1.
`
`Concurrent with the IPT Litigation, Requester filed petitions for /ater Partes Review
`
`CUPR”’) of all claims of the °293 Patent.
`
`IPR2017-00336, challenging claims 1, 18, 19, 22 and
`
`29 of the °293 Patent, was filed on November 29, 2016, and IPR2017-01189, challenging all
`
`other claims of the "293 Patent, was filed on March 30, 2017. Of the six claims of the °293
`
`Patent asserted in the IPT litigation, review of Claim 22 was instituted on May 25, 2017
`
`(EPR2017-00336, Paper 15). No final written decision has issued in either of these IPR
`
`proceedings.
`
`The Pirim PCT, which names the inventor of the subject °293 Patent as an inventor, was
`
`asserted as prior art against Claim 1 and other claims in IPR2017-0036.
`
`In responding to that
`
`petition, Patent Owner argued only that part of one limitation of Claim 1
`
`is missing from the
`
`Pirim PCT. Ex. 12 at 30-34. While the Board instituted review of Claim 22 as obvious over the
`
`Pirira PCT, it agreed with Patent Owner and denied institution as to Claim 1. Ex. 13 at 20-26.
`
`As described in detail below, Requester has since located two newprior art references, Siegel
`
`and Hirota, which were not previously considered in connection with the prior prosecution or
`
`TPR challenges to any claim ofthe °293 Patent. Each of these new references clearly discloses
`
`the aspect of Claim 1 alleged by Patent Owner to be missing from the Pirim PCT. These new
`
`' Patent Owneralso asserted five other patents against Requester in this same litigation. Those
`other patents are not relevant to the present request.
`
`° Yn addition to the asserted claims, non-asserted dependent claims 4-17 and 20-21 are rendered
`invalid by virtue of their dependency on indefinite independent claims.
`
`IPT Ex-2003, p. 0007
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0007
`LG v IPT
`IPR2023-00104
`
`

`

`references are from the samefield of art as the Pirim PCTand the °293 Patent, and consist of a
`
`combination of prior art elements according to known methods to yield predictable results, and
`
`also require only simple substitution of one known element for another to obtain predictable
`
`results. Requester, therefore, submits that these new references in combination with the Pirim
`
`PCT, and Hirota alone, render Claim 1 invalid.
`
`HE
`
`=©606oOVERVIEWOF THE °293 PATENT AND ITS RELEVANT
`PROSECUTION
`
`A. THE ’293 PATENT
`
`The ’293 Patent to Patrick Pirim was filed on February 23, 2001 and claims priority to a
`
`prior French application, filed February 24, 2000. Ex. 1 at 1,50.
`
`It claims a device and method
`
`for processing an image to detect an “event” in a multi-dimensional space, such as a digital
`
`image. The described system generates one or more histograms of parameters associated with
`
`digitized picture elements or “pixels” making up the image. See, e.g., Ex. | at Claims 3, 23, 28.
`
`For example, an input video signal S(t} comprises a succession of frames, each made up of
`
`pixels: “{t]his signal S(t) carries a value ay of the parameter A for each pixel G, 9).” /d. at 7:59-
`
`60. “Parameter A” refers to a property of a pixel, such as its speed, shape, color, etc. /d. at 1:18-
`
`20, 29-31. The values of A for the pixels of a given frame are analyzed using a histogram
`
`processing unit (or histogramcalculation unit), such as depicted in Figure 3, annotated below:
`
`IPT Ex-2003, p. 0008
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0008
`LG v IPT
`IPR2023-00104
`
`

`

`
`
`$
`
`Ate:
`
`rnihy
`AeeAOLDWOhte
`
`eae:
`
`
`
`FIG. 3
`
`
`
` NER
`108s
`
`
`tiles
`
`DATAIAssdsccncss“..Some
`
`
`
`SOTTh
`ootonehonnnaadss
`SANAnnnene
`Wis
`
`
` ESSN ANNAN
`
`*
`:
`“aNanaRR
`::
`334
`SEUSSSNESPEASNESSSSEEERSENSNIMESRSNIESEIAN
`
`
`‘:
`
`
`
`Digital DATA({A), corresponding to parameter A, flows through input multiplexer 105
`
`(shaded green) to the address input of histogram memory 100 (shaded red). The value of
`
`DATA(A) may thereby be used to select a memorylocation within the histogram memory 100,
`
`while an incrementer 107 (not shaded) would increase the value stored at that memory location.
`
`Thus, if each DATA(A) were an 8-bit value representing brightness (ranging from 0 to 255) for a
`
`pixel
`
`in the frame, the histogram memory would increment the value stored at the address
`
`corresponding to the brightness value for that pixel. Once the entire frame or image is processed,
`
`the histogram mernory would contain a value at each of 256 memory addresses representing the
`
`number of pixels having the brightness value corresponding to that address. See id. at 8:45-64.
`
`According to the ’293 Patent, the system may include multiple histogram calculation units of the
`
`type shown in Figure 3, with eachtreating a different parameter (B, C, D, E.. . ) of each pixel.
`
`ld. at Fig. 30, 20:26-42.
`
`Figure 3 also depicts a “classifier unit? 101 (shaded blue) that compares DATA(A)
`
`values to a particular condition, for example, brightness equal to 203. Ex.
`
`1 at 9:31-34. The
`
`output of the classifier indicating whether or not the condition is met is sent to coincidence bus
`
`Lil (shaded yellow).
`
`/d@. at 9:36-42. Output signals from the classifiers associated with other
`
`histogram units (B, C, D, E .. .) are also present on comeidence bus 111 and are sent to
`
`IPT Ex-2003, p. 0009
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0009
`LG v IPT
`IPR2023-00104
`
`

`

`coincidence unit 102 (shaded purple). fd. at 10:34-40. The coincidence unit 102 (shaded purple)
`
`determines whether a pixel will be added to the histogram memory 100 (shaded red) based on
`
`selected classification conditions. Ex.
`
`1 at Fig. 3 (validation signal). For example, a second
`
`histogram calculation unit may be configured to treat color with the classifier umit of that
`
`histogram calculation unit set to indicate whether the color of the pixel is red. The coincidence
`
`unit may then be configured to enable the histogram memory for those pixels having both
`
`brightness greater than 100 and color equal to red. See id, at 9:36—-50.
`
`In one embodiment, shown in Figure 32, the system includes 16 histogram calculation
`
`units,
`
`SaSeaSaneyae SISimaeermeriegeriSNenitinnnrsninniRmaryintnirynmranfinSenihmrtincrnanNa
`
`< i
`
`porns
`
`i513
`asa
`
`pis
`
`
`onaaranneeeereneeoeaeaa
`
`ensGeaenneneannaminanans
`
`As described in the specification,
`
`in this embodiment, a control unit determines which of
`
`multiple parameters “are to be processed at a given time by one or several dedicated polyvalent
`
`histogram unit(s).” Ex.
`
`| at 21:43-47. It is this example that Patent Owner has argued embodies
`
`Claim | that is the subject ofthis request. Ex. 12 at 13.
`
`ai
`
`IPT Ex-2003, p. 0010
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0010
`LG v IPT
`IPR2023-00104
`
`

`

`B. PROSECUTION HISTORY RELEVANT TO CLAIM I OF THE °293 PATENT
`
`The °293 Patent’s file history includes one rejection of Claim 1 based on anticipation by
`
`U.S. Patent No. 5,359,533 (Ric Ka”). Ex. 4 at 44-45. The examiner explained that Ric Ka
`
`discloses a “data bus,” a “time coincidences bus,” and a “histogram unit.” /d. Applicant seemed
`
`to agree that those elements were disclosed by Ric Ka, and thus made the following amendments
`
`to the claim:
`
`£A visual perception processor for*rautomatically
`(Currently Amended)
`1.
`
`at least one digitized parameter in the form of adigital signal on a data bus, said digital signal
`
`being in the form of a succession aj; ofbinary numbers associated with synchronization signals
`
`enabling to define a given instant
`
`
`(T) of the multidimensional space and the position (i,j) in this
`
`
`space,the visual perception processor comprising:
`
`{{a]] the data bus;
`
`acontrol unit
`
`a time coincidences bus carrying at least a time coincidence signal; and
`
`at least two ee-mere histogram calculation units for the treatment of the at least
`
`one parameter, that-resetve-the-dataDATACA),DATA(B),.--DATAE)viathe-date-bus-and
`
`the histogram calculation units being configured to form a histogram
`
`representative of the parameter as a function ofa validation signal and to determine by
`
`classification a binary classification signal resulting from a comparison of the parameter and a
`
`selection criterion C, wherein the classification signal is sent to the time coincidences bus, and
`
`wherein the validation signal is produced fromtime coincidences signals from the time
`
`coincidence bus sothatthecalculation of the histogram depends on the classification signals
`
`carried by the time coincidence bus.
`
`Ex. 4 at 11. Thus, the requirement that the two histogram calculation units form a histogram of
`
`common (e., “the”) parameter, was added by amendmentto distinguish the known priorart.
`
`FV.
`
`OVERVIEWOF THE PRIOR ART
`
`A. Pram PCT
`
`Pirim PCT was published on July 22, 1999, based on an international application filed
`
`January 15, 1999, designating the U.S. and qualifies as prior art under at least pre-ATA 35 U.S.C.
`
`IPT Ex-2003, p. 0011
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0011
`LG v IPT
`IPR2023-00104
`
`

`

`§§ 102(a), 102(b), and § 119 (but no patent shall be granted... for an invention which had
`
`been... described in a printed publication in any country more than one year before the date of
`
`the actual filing of the application in this country.”). Ex.
`
`5S at Cover. The sole inventor of the
`
`°293 Patent, Patrick Pirim, is also named as one of the two named inventors of the Pirim PCT.
`
`Id. Pirim PCTis of record in the original prosecution history of the °293 Patent but was never
`
`discussed or used in a rejection by the examiner. See Ex. 4 at 44-45: Ex. 1 at Cover.
`
`Pinm PCT discloses “a generic image processing system” that
`
`is used to “detect
`
`drowsiness” in a driver by acquiring images of the driver and forming histograms to analyze
`
`opening and closing of the driver’s eyes. Ex. 5 at 1. As reflected the below comparison of
`
`Figure 14 from the Pirrm PCT and Figure 3 of the "293 Patent, the Pinm PCTdiscloses and uses
`
`the same histogram calculation unit disclosed and claimed in the °293 Patent:
`
`Ex.
`<<.telSeninroe
`
`1 C293 Patent), Fig. °
`
`cgtrnnvienieneennines Reapersannaeieneee ageSenieeeeeeNeNEY
`
`RarveiBeseSRLPSEwhEEdBietnemrenny
`Fete 5
`Fam ra
`i
`
`
`
`aah
`3
`:é
`Learns, 89%
`%,
`
`
`
`
`
`14
`Ws
`:
`se
`~ Sa or
`
`x_TR
`
`nau
`f
`
`
`
`anon
`| CROSERSS
`ra “BSTE
`
`DATAwimsscny
`
`LCOURNTER
`i
`
`“VALGATION
` RAEDAAOEEOEOPPOEPLOLOLEOIEIEEDEDEEPEE!
`
`
`Pinm PCT’s image processing system “receives a digital video signal S originating from
`
`a video camera or other imaging device 13 which monitors a scene 13a.”
`
`Jd. at 10.
`
`“Signal
`
`S(PD represents signal S composed of pixels PL”
`
`/d. at 11. Each video frame comprises
`
`horizontal scannedlines, each including “a succession of pixels or image-points PE e.g., ara, a1,
`
`and ar3forlinelii... 2 fd.
`
`Like the °293 Patent, Figure 14 of the Pirrm PCT (annotated above) discloses a histogram
`
`unit having a memory 100 (shaded red}. Data(V), representing pixel parameter V, proceeds
`
`IPT Ex-2003, p. 0012
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0012
`LG v IPT
`IPR2023-00104
`
`

`

`through input multiplexer 104 (shaded green) to the address input of memory 100.
`
`/d@. at 27.
`
`Fust as in the °293 Patent, the value of data(V) maythereby be used to select a memory location
`
`within the memory 100, while an incrementer 110 would increase the value stored at that
`
`memory location. Thus, as in the °293 Patent, the value stored at the address corresponding to
`
`the value of the input data parameter is incremented to accumulate a histogram of the parameter.
`
`Tad.
`
`Like the “293 Patent, Pirim PCT also discloses a “classifier 25b” (shaded blue) that
`
`compares data(V) to a “register 106 that enables the classification criteria to be set by the user, or
`
`by a separate computer program.” Jd. at 27-28. The output of classifier 25b proceeds to bus 23
`
`(shaded yellow}, which also carries the output of other classifiers in the system.
`
`/d. at 29. These
`
`signals proceed to validation unit 31 (shaded purple).
`
`“Each validation unit generates a
`
`validation signal which is communicated to its associated histogram formation block 24-29. The
`
`validation signal determines, for each incoming pixel, whether the histogram formation block
`
`will utilize that pixel in forming it histogram.” /d. at 28. The operation is summarized as follows:
`
`Thus, using the classifiers in combination with validation units 30-35, the
`system may select for processing only data points in any selected classes
`within any selected domains. For example, the system may be used to
`detect only data points having speed 2, direction 4, and luminance 125 by
`setting each of the following registers to “1”: the registers in the validation
`units for speed, direction, and luminance, register 2 in the speed classifier,
`register 4 in the direction classifier, and register 125 in the luminance
`classifier. In order to formthose pixels into a block, the registers in the
`validation units for the x and y directions would be set to “1” as well.
`
`Id. at 29.
`
`Pirim PCTdiscloses one embodiment (shown in Figure 12, below) that uses six of the
`
`histogramunits (annotated in red) shown in Figure 14 (above) to process the image:
`
`IPT Ex-2003, p. 0013
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0013
`LG v IPT
`IPR2023-00104
`
`

`

`
`
`AAERERPDaeeatAERPLELESoeRAnnerPAOLOLEEELERPRATPOLEDdtd,Annnnndncheseniieispecrrereoraeace.OEEREEHEASPERERAERLELEDLPEPSOBELEEeaA
`
`
`
`PERNT BERS
`
`
`
`.
`
`Rearing
`
`ERE
`ae
`GRRE. FX op
`3
`“
`
`Serccccnened way
`ha
`3
`; atau
`HRY
`
`
`AAs SREUO “*
`*
`wwe,
`:
`3
`
`ree
`ee
`RRS
`Bog SAA
`srnssonvennnnien
`
`siviiinneinntecenmeaascimniinn dt
`NANG Bee
`SARAARANAnnuities
`L- ata
`¥ asad
`$
`x
`ec
`xis
`
`:
`
`;
`RA
`
`
`
`
`OLCOLEELSECLEREESAELEESDLMIEEPIPEDESEELEPPCDEDPPPOPELEIED t
`
`
`
`
`MAhhenpttnpetrttenendLihanoteMappbbbbbibttittihéfgg
`
`x
`¢
`:
`j
`i.
`se Ph pasava vay byw ewnye ci baneavee setanaiind nvr wn An
`3
`3
`o
`:
`‘
`Fisted— i
`
`sO
`
`i
`i
`
`
`
`j
`aebaeees
`3
`
`se
`
`
`i
`
`zgsg%.
`
`msCn .:
`
`poonnne| 4¢‘t
`
`z
`pads
`ete
`
`z
`Poet,
`§
`x
`ERRIRAE |S
`Secmnnniinciganmnt
`i
`‘
`"RE
`
`Ex. 5, Fig. 12 (annotations added). “Figure 12 is a block diagram showing the interrelationship
`
`between the various histogram formation units.” Ex. 5 at 8. “In general, each of the histogram
`
`formation blocks 24-29 is identical to the others and functions in the same manner.” /d. at 26.
`
`Pirim PCTexplains the functioning of Figure 12:
`
`includes a bus 23 for
`Referring to Fig. 12, histogram processor 22a
`communicating signals between the various components thereof,
`for
`receiving input commands from a controller 42 and for transmitting output
`signals to controller 42. Histogram formation and processing blocks 24 -
`29 receive the various input signals, i.e, delayed digital video signal SR,
`speed V, oriented directions (in Freeman code) DE time constant CO,first
`axis x(m) and second axis yim}... .. The function of each histogram
`formation block is to enable a histogram to be formed for the domain
`associated with that block. For example, histogram formation block 24
`receives the delayed digital video signal SR and enables a histogram to be
`formed for the luminance values of the video signal. Since the luminance
`of the signal will generally be represented by a number in the range of 0-
`255, histogram formation block 24 is preferable a memory addressable
`with 8 bits, with each memory location having a sufficient number ofbits
`to correspond to the numberof pixels in a frame.
`
`IPT Ex-2003, p. 0014
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0014
`LG v IPT
`IPR2023-00104
`
`

`

`B. SIEGEL
`
`Siegel was not considered during prosecution or in any other Patent Office proceeding for
`
`the °293 Patent. Siegel teaches the use of multiple histogram calculation units (called “PEs”) to
`
`form histograms of the same image parameter (pixel gray level) in order to increase the speed of
`
`image processing.
`
`Siegel is an [EEEarticle published in 1981.
`
`It is authenticated under Federal Rule of
`
`Evidence 901(8), the ancient documents rule, because it is located on the IEEE website (a place
`
`where it would be if authentic) and is dated 1981. It qualifies for an exception to the rule against
`
`hearsay under Federal Rule of Evidence 803(16)} because it is over 20 years old. Siegel was
`
`publicly available more than one year before the priority date of the °293 Patent, as proven by
`
`US. Patent Nos. 4,523,273, 4,817,175, and 4,891,787, all of which reference Siegel and were
`
`filed in 1982, 1987, and 1986, respectively. See Ex. 8 at 2:9-15; Ex. 9 at Other Publications: Ex.
`
`10 at 3:52-55. Additionally, TEEE publications are subject
`
`to Official Notice of public
`
`availability, the hearsay exception in Fed. R. Evid. 803(17), and the residual hearsay exception.
`
`See, e.g., [PR2014-00527, Paper 41 at 10-12 (P.T.A.B. May 18, 2015} (denying motion to
`
`exclude prior art IEEE publication). Siegel, therefore, qualifies as prior art under pre-AIA 35
`
`U.S.C. §102(b).
`
`Siegel
`
`describes PASM, which
`
`is
`
`“a
`
`large-scale
`
`dynamically
`
`reconfigurable
`
`multimicroprocessor system.
`
`It is a special purpose system being designed to exploit the
`
`parallelism of image processing and pattern recognition tasks.” Ex. 6 at Abstract. Byusing
`
`multiple processors to process an image in parallel, the image can be processed and patterns
`
`recognized in “real-time,” which is a capability that is useful for “such applications as robot
`
`(machine) vision, automatic guidance of air and spacecraft, and air traffic control.” Jd. at 934.
`
`PASM’s parallelism “may be used to obtain significant reductions of execution time on
`
`computationally intensive tasks.” Ex. 6 at 942.
`
`Siegel provides a block diagram of the
`
`components of PASM:
`
`16
`
`IPT Ex-2003, p. 0015
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0015
`LG v IPT
`IPR2023-00104
`
`

`

`|
`
`tf
`
`\
`
`STORAGE
`SYSTEM
`
`s¥STER
`
`|
`;
`
`|
`;
`
`aca
`
`STORAGE
`
`_
`PARALLEL
`COMPUTATIONKEOM CONTROL~
`UNET
`LERS
`
`Fig. 1. Blockdiagram overview of PASM.
`As ifustrated in Figure 1, PASMincludes a parallel computation unit (PCU}, which
`
`contains multiple processors that process the image data. Ex. 6 at 935.
`
`In one embodiment,
`
`shown in Figure 2 below, the PCU contains multiple processor-memory pairs (one of which is
`
`annotated red}, each referred to as a “processing element” or “PE.” /d at 936.
`
`,
`|
`
`
`
`AEPBORECOREMYSee7eoe
`
`PED RSE
`“FSSC,
`4x3
`
`
`
`heedat6 a
`
`FE-PEconfiguration of the paraliel computation ems,
`
`Referring back to Figure 1, above, PASMalso includes microcontrollers, which are
`
`microprocessors that control the PCUprocessors. The system additionally includes a memory
`
`storage system and a system control unit, which coordinates the activities of the various
`
`components of PASM. Id.
`
`Siegel discloses an “example of how PASMcan be used to expedite image processing
`
`tasks is presented.” Ex. 6 at 942. As part of that example, Siegel discloses using its parallel
`
`il
`
`IPT Ex-2003, p. 0016
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0016
`LG v IPT
`IPR2023-00104
`
`

`

`processors (multiple PEs) to each form a histogram of gray level (a pixel parameter) for a
`
`segment of the image:
`
`Nowconsider implementing the histogram calculation. Since the
`image ms is distributed over 1024 PE’s, each PE will calculate a
`256-bin histogram based on its 16 X 16 segment of the image.
`Then these
`‘local’ histograms will be combined using the
`algorithm described below.
`
`id, at 943-44,
`
`In this manner, PASMts able to process the image hundreds of times faster than
`
`if only a single processor (PE) were used to form a histogram of the entire image: “the parallel
`
`algorithm is about three orders of magnitude faster than the sequential algorithm executed on a
`
`single PCU PE.” fa.
`
`C. Hota
`
`Hirota was not considered during prosecution or in any other Patent Office proceeding
`
`for the °293 Patent. Hirota teaches the use of multiple histogram calculation units to form
`
`histograms of the same image parameter (2 composite color signal “VH”") in order to perform a
`
`particular image processing task—i.e., determine whether the scanned document is color or black
`
`and white. Hirota is a U.S. Patent that was filed on March 5, 1996, well before the priority date
`
`of the °293 Patent. Thus, Hirota is prior art under at least pre-ATA 35 U.S.C. § 102(e).
`
`Hirota discloses a “digital full color copying machine” that “can determine document
`
`9
`types,” such as color or black and white, automatically. Ex. 7 at Abstract, 2:30-33. A cross
`
`sectional view of the copying machine is shown in Figure 1, with element 10 representing a
`
`signal processing umt.
`
`/d. at 4:2~4. The signal processor 10, which is shown in more detail in
`
`Figures 2A and 2B, “receives analog image signals of 400 dots per inch of red, green, and blue
`
`from the linear CCD sensor 36 on which a light reflected from a document is focused” and
`
`includes a histogram generator 110. /d. at 4.51-56, 5:6-7.
`
`The histogram generator 110 has two histogram calculation units that are used to
`
`calculate histograms of color data to determine whether the document being copied is a black
`
`and white document or a color document.
`
`/d@. at 2:48--51 (the document type of the document {a
`
`color document or black-and-white document) is determined according to the first and second
`
`histograms”). Hirota discloses two embodiments for the histogram generator 110, one in Figure
`
`4 and one in Figure 13 (reproduced below). Ex. 7 at 3:42, 3:60-61, Fig. 4, Certificate of
`
`Correction Fig. 13. The second embodiment in Figure 13 “is the same as that shown in FIG. 4
`
`i2
`
`IPT Ex-2003, p. 0017
`LG v IPT
`IPR2023-00104
`
`IPT Ex-2003, p. 0017
`LG v IPT
`IPR2023-00104
`
`

`

`except that an edge detection circuit 220 and an AND gate 222 of negative logic are added.” fd.
`
`at 16:63-67.
`
`
`
`;
`
`|
`
`D
`
`oy
`
`Value
`
`generator
`
`8
`
`A
`
`2t4
`
`SHEE
`
`\
`206
`
`Samnting
`terval
`deter
`ecmuination
`
`;
`
`Samplin