`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`1
`
`·1· ·UNITED STATES PATENT AND TRADEMARK OFFICE
`· · ·BEFORE THE PATENT TRIAL AND APPEAL BOARD
`·2· ·-----------------------------------------X
`· · ·TOYOTA MOTOR CORPORATION,
`·3
`
`·4· · · · · · · · · · ·Petitioner,
`
`·5· · · · · · · · · · · · · · ·IPR2013-00412
`· · ·VS.· · · · · · · · · · · ·IPR2013-00413
`·6· · · · · · · · · · · · · · ·IPR2013-00416
`
`·7
`· · ·AMERICAN VEHICULAR SCIENCES, LLC,
`·8
`· · · · · · · · · · · ·Patent Owner.
`·9· ·-----------------------------------------X
`
`10
`
`11
`
`12· · · · · · · · · DEPOSITION OF
`
`13· · · · ·NIKOLAOS PAPANIKOLOPOULOS, PH.D.
`
`14· · · · · · ·Monday, February 24, 2014
`
`15· · · · · · · · New York, New York
`
`16
`
`17
`
`18
`
`19
`
`20
`
`21
`
`22
`
`23· ·Reported By:
`
`24· ·LINDA J. GREENSTEIN
`
`25· ·JOB NO. 89371
`
`
`800.211.DEPO (3376)800.211.DEPO (3376)
`
`EsquireSolutions.comEsquireSolutions.com
`
`
`
`
`
`IPR2013-00424 - Ex. 1022
`Toyota Motor Corp., Petitioner
`1
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`2
`
`·1· · · · · · · · · · · February 24, 2014
`
`·2· · · · · · · · · · · 9:00 A.M.
`
`·3
`
`·4
`
`·5
`
`·6
`
`·7· · · · · · · Deposition of NIKOLAOS
`
`·8· ·PAPANIKOLOPOULOS, PH.D., taken by Patent
`
`·9· ·Owner, pursuant to Notice, held at Kenyon &
`
`10· ·Kenyon, L.L.P., One Broadway, New York, New
`
`11· ·York, before Linda J. Greenstein, a
`
`12· ·Certified Shorthand Reporter and Notary
`
`13· ·Public of the State of New York.
`
`14
`
`15
`
`16
`
`17
`
`18
`
`19
`
`20
`
`21
`
`22
`
`23
`
`24
`
`25
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.com
`EsquireSolutions.com
`
`
`
`
`
`
`
` 2
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`3
`
`·1· ·A P P E A R A N C E S:
`
`·2
`
`·3
`
`·4· ·KENYON & KENYON, L.L.P.
`· · ·Attorneys for Petitioner
`·5· · · · · · One Broadway
`· · · · · · · New York, New York 10004-1007
`·6
`· · ·BY:· · · MATT BERKOWITZ, ESQ.
`·7· · · · · · 212.908.6462
`· · · · · · · mberkowtiz@kenyon.com
`·8
`
`·9
`· · ·McANDREWS, HELD & MALLOY, LTD.
`10· ·Attorneys for American Vehicular Sciences,
`· · ·LLC
`11· · · · · · 500 West Madison Street
`· · · · · · · 34th Floor
`12· · · · · · Chicago, Illinois 60661
`
`13· ·BY:· · · CHRISTOPHER M. SCHARFF, ESQ.
`· · · · · · · 312.775.8000
`14· · · · · · cscharff@mcandrews-ip.com
`
`15
`
`16
`
`17· ·Also Present:
`
`18
`· · ·McAndrews, Held & Malloy, Ltd.
`19· ·Thomas J. Wimbiscus, Esq.
`
`20
`
`21
`
`22
`
`23
`
`24
`
`25
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.com
`EsquireSolutions.com
`
`
`
`
`
`
`
` 3
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`4
`
`·1· · · · · · · · ·STIPULATIONS
`
`·2
`
`·3· · · ·IT IS HEREBY STIPULATED AND AGREED
`
`·4· ·by and between counsel for the respective
`
`·5· ·parties hereto, that the sealing, filing
`
`·6· ·and certification of the within
`
`·7· ·Deposition(s) may be signed and sworn to
`
`·8· ·before any officer authorized to administer
`
`·9· ·an oath with the same force and effect as
`
`10· ·if signed and sworn to before the officer
`
`11· ·before whom said Deposition(s) was (were)
`
`12· ·taken;
`
`13
`
`14· · · ·IT IS FURTHER STIPULATED AND AGREED,
`
`15· ·that all objections, except as to the form,
`
`16· ·are reserved to the trial.
`
`17
`
`18
`
`19· ·*· · · · · · · · · *· · · · · · · · ·*
`
`20
`
`21
`
`22
`
`23
`
`24
`
`25
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 4
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`5
`
`·1· · · · ·NIKOLAOS PAPANIKOLOPOULOS, PH.D.
`
`·2· ·having been first duly sworn, was examined
`
`·3· ·and testified as follows:
`
`·4· ·EXAMINATION BY
`
`·5· ·MR. SCHARFF:
`
`·6· · · · Q.· · Good morning.
`
`·7· · · · · · · Could you please state your name
`
`·8· ·and spell it for the record, please.
`
`·9· · · · A.· · Yes.· My name is Nikos
`
`10· ·Papanikolopoulos, N-I-K-O-S
`
`11· ·P-A-P-A-N-I-K-O-L-O-P-O-U-L-O-S.
`
`12· · · · Q.· · And what's your home address?
`
`13· · · · A.· · Is 4125 Garfield,
`
`14· ·G-A-R-F-I-E-L-D -- like the cartoon
`
`15· ·character -- Minneapolis, Minnesota 55409.
`
`16· · · · Q.· · And how old are you today?
`
`17· · · · A.· · 49.· Almost 50.
`
`18· · · · Q.· · You've been retained by Toyota
`
`19· ·to serve as an expert in an Inter Parte's
`
`20· ·Review Proceeding; is that correct?
`
`21· · · · A.· · Yes.
`
`22· · · · Q.· · And, in particular, that's IPR
`
`23· ·numbers 2013 00419 and 00424.
`
`24· · · · · · · Is that right?
`
`25· · · · A.· · Yes.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 5
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`6
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · Q.· · And so if I refer to those IPR
`
`·3· ·numbers today just by the last three
`
`·4· ·numbers, as the 419 and the 424, will you
`
`·5· ·understand what I'm referring to?
`
`·6· · · · A.· · Yes.
`
`·7· · · · · · · Do you want me to use the same
`
`·8· ·or I should use the patent number?
`
`·9· · · · Q.· · Whichever is convenient for you,
`
`10· ·but I'll probably refer to them mostly by
`
`11· ·the IPR numbers.· But when I'm asking you
`
`12· ·to look at a particular patent, I'll refer
`
`13· ·to the patent number.
`
`14· · · · · · · Just so you understand too,
`
`15· ·based on the agreement of the parties,
`
`16· ·we're going to have a single transcript
`
`17· ·that's going to cover both of these IPRs,
`
`18· ·and there's going to be some overlap on
`
`19· ·questions like your background and some
`
`20· ·things like that.
`
`21· · · · · · · But when I'm talking about a
`
`22· ·specific IPR matter number, I'll call it
`
`23· ·out by number; and when I'm referring to a
`
`24· ·specific declaration or specific patent,
`
`25· ·I'll call it out.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 6
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`7
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · · · · But if you have any questions
`
`·3· ·about which one I'm talking about, please
`
`·4· ·speak up and let me know.
`
`·5· · · · A.· · Sure.
`
`·6· · · · Q.· · Are you aware that Toyota and
`
`·7· ·AVS are currently involved in patent
`
`·8· ·litigation in the Eastern District of
`
`·9· ·Texas?
`
`10· · · · A.· · Yes, I am aware.
`
`11· · · · Q.· · Have you done any work for
`
`12· ·Toyota in connection with the litigation?
`
`13· · · · A.· · I have worked on a task that
`
`14· ·involves some of the indefiniteness claims.
`
`15· · · · Q.· · So you're an expert for Toyota
`
`16· ·in a litigation as well as in the IPRs?
`
`17· · · · A.· · I'm not sure of the term
`
`18· ·"expert."
`
`19· · · · · · · I was asked -- I was given a
`
`20· ·task to offer certain opinions.
`
`21· · · · Q.· · Okay.
`
`22· · · · · · · Do you know yet whether you're
`
`23· ·going to be submitting an expert report in
`
`24· ·the litigation?
`
`25· ·DIR· · · · MR. BERKOWITZ:· Object to form,
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 7
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`8
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·and just caution the witness not to reveal
`
`·3· ·anything, the communications you may have
`
`·4· ·had with attorneys regarding future work.
`
`·5· · · · · · · If the answer calls for that,
`
`·6· ·then I instruct you not to answer.
`
`·7· · · · A.· · I'm going to follow the lawyer's
`
`·8· ·advice.
`
`·9· · · · Q.· · Which patents did you work on in
`
`10· ·connection with the litigation?
`
`11· · · · A.· · If my recollection is correct,
`
`12· ·it involves the '000, the '057.
`
`13· · · · Q.· · And those are the same two
`
`14· ·patents that you are working on in
`
`15· ·connection with the IPRs; is that right?
`
`16· · · · A.· · Yes.· This is the case.
`
`17· · · · Q.· · Now, you've served as an expert
`
`18· ·witness before; is that right?
`
`19· · · · A.· · Yes, that's the case.
`
`20· · · · Q.· · And in what matter did you serve
`
`21· ·as an expert witness before?
`
`22· · · · A.· · This is a case that involves ABB
`
`23· ·verses RGB, and I worked for ABB in a
`
`24· ·similar role, expressing opinions.
`
`25· · · · · · · I was given a claim construction
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 8
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`9
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·and then I had to express an opinion.
`
`·3· · · · Q.· · What does "ABB" stand for?
`
`·4· · · · A.· · It's ASEA Brown Boveri.· It's
`
`·5· ·one of the largest automation manufacturers
`
`·6· ·in the world.
`
`·7· · · · Q.· · Was that the only matter in
`
`·8· ·which you've served as an expert witness?
`
`·9· · · · A.· · I have worked for -- so this is
`
`10· ·the only case where I have actually been
`
`11· ·deposed.· I have worked for other companies
`
`12· ·and firms, like ADT and Hamburg law firms
`
`13· ·expressing opinions, looking at prior art,
`
`14· ·but this was the only case I was deposed
`
`15· ·for a technical set of issues.
`
`16· · · · Q.· · Okay.
`
`17· · · · · · · In that matter, you were an
`
`18· ·expert testifying on behalf of ABB?
`
`19· · · · A.· · Yes.· I have I testified for
`
`20· ·ABB.
`
`21· · · · Q.· · Was that a patent litigation
`
`22· ·matter?
`
`23· · · · A.· · This was an IPR case.
`
`24· · · · · · · Actually, there were four IPR
`
`25· ·cases.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
` 9
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`10
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · Q.· · Okay.
`
`·3· · · · · · · And what was the technology
`
`·4· ·involved?
`
`·5· · · · A.· · The technology involved a range
`
`·6· ·from motion control devices to cameras,
`
`·7· ·sensors and software as related to auto bus
`
`·8· ·controller.
`
`·9· · · · Q.· · Did you submit a declaration in
`
`10· ·those matters?
`
`11· · · · A.· · Yes.· I have submitted four
`
`12· ·different declarations.· Different -- let
`
`13· ·me -- just to be precise -- should I
`
`14· ·mention the numbers for you?· I don't
`
`15· ·recall the numbers exactly.
`
`16· · · · Q.· · Do you remember the last three
`
`17· ·numbers for any of them?
`
`18· · · · A.· · Yes.· 2013 00062.· I think the
`
`19· ·other one was 00063 and 2013 00074.
`
`20· · · · · · · And the fourth one I don't
`
`21· ·recall because it was submitted -- I
`
`22· ·haven't touched it for a long time.
`
`23· · · · Q.· · And you've already submitted
`
`24· ·declarations for each of those?
`
`25· · · · A.· · Yes.· The best of my
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`10
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`11
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·recollection.
`
`·3· · · · Q.· · Were you an expert on behalf of
`
`·4· ·the patentholder or on behalf of the
`
`·5· ·petitioner?
`
`·6· · · · A.· · On behalf of the petitioner.
`
`·7· · · · Q.· · And you were already deposed in
`
`·8· ·connection with those IPRs?
`
`·9· · · · A.· · I have been deposed for the 062
`
`10· ·and the 074.
`
`11· · · · Q.· · Was that one deposition or two?
`
`12· · · · A.· · One deposition.
`
`13· · · · Q.· · And are those IPRs still
`
`14· ·pending?
`
`15· · · · A.· · Just to be precise, I still
`
`16· ·believe it's the case, but I don't have --
`
`17· ·my only information comes from the lawyers
`
`18· ·involved, so just to the best of my
`
`19· ·knowledge.
`
`20· · · · Q.· · When was your deposition?
`
`21· · · · A.· · Early December.
`
`22· · · · Q.· · And did any of those IPRs
`
`23· ·involve pattern recognition technology?
`
`24· · · · · · · MR. BERKOWITZ:· Object to form.
`
`25· · · · A.· · Let me clarify:
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`11
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`12
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · · · · Pattern recognition with respect
`
`·3· ·to the claim construction that we are
`
`·4· ·dealing with here or --
`
`·5· · · · Q.· · Just generally as you would use
`
`·6· ·that term.
`
`·7· · · · · · · MR. BERKOWITZ:· Same objection.
`
`·8· · · · A.· · With the assumption of the claim
`
`·9· ·construction that I was given here, there
`
`10· ·was a very small component, but this was
`
`11· ·not the gist of the case.
`
`12· · · · Q.· · What was the gist of the case?
`
`13· · · · A.· · The gist of the case was
`
`14· ·actually the ability to decompose software
`
`15· ·-- controlled software from high level to
`
`16· ·low level, and how actually you can isolate
`
`17· ·device drivers from high level software.
`
`18· · · · Q.· · I should have mentioned this
`
`19· ·earlier, but you probably already know from
`
`20· ·your prior deposition that we have a court
`
`21· ·reporter that's going to be transcribing
`
`22· ·the deposition, so if you can avoid
`
`23· ·inaudible answers or nodding your head, to
`
`24· ·answer in the form of an audible answer,
`
`25· ·and you have done that.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`12
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`13
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · A.· · And if there is something, just
`
`·3· ·tell me, and I will.
`
`·4· · · · Q.· · And if you don't understand one
`
`·5· ·of my questions, you can always ask me to
`
`·6· ·repeat it or to clarify.
`
`·7· · · · · · · But if you answer a question,
`
`·8· ·I'll assume that you understood it.
`
`·9· · · · · · · Is that okay?
`
`10· · · · A.· · Yes.
`
`11· · · · Q.· · We'll try to take a break about
`
`12· ·once every hour.· If you need an additional
`
`13· ·break at any time, just let me know.
`
`14· · · · · · · Is there any reason today why
`
`15· ·you would not be able to testify
`
`16· ·truthfully?
`
`17· · · · A.· · No.· I don't believe that's the
`
`18· ·case.
`
`19· · · · Q.· · Are you on any medications that
`
`20· ·may affect your ability to testify?
`
`21· · · · A.· · No, to the best of my knowledge.
`
`22· · · · · · · · · · ·(Toyota Exhibit 1016 for
`
`23· ·identification in IPR 419, Multi-page
`
`24· ·document, Declaration of Nikolaos
`
`25· ·Papanikolopoulos, Ph.D.)
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`13
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`14
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·BY MR. SCHARFF:
`
`·3· · · · Q.· · I'm going to show you what
`
`·4· ·Toyota has marked as Exhibit 1016 in the
`
`·5· ·419 IPR.
`
`·6· · · · · · · Actually, before I ask you
`
`·7· ·questions about this, so you came to
`
`·8· ·today's deposition with some documents; is
`
`·9· ·that right?
`
`10· · · · A.· · Yes.
`
`11· · · · Q.· · What documents are those?
`
`12· · · · A.· · The documents include my two
`
`13· ·declarations and the Lemelson patent.
`
`14· · · · Q.· · I'm going to be showing you
`
`15· ·copies of each of those later.
`
`16· · · · · · · Did you bring anything else into
`
`17· ·the deposition today?
`
`18· · · · A.· · No.
`
`19· · · · Q.· · So you didn't bring any notes or
`
`20· ·anything?
`
`21· · · · A.· · No.
`
`22· · · · Q.· · Can you go to the back of the
`
`23· ·419 declaration to your CV.
`
`24· · · · A.· · Sure.
`
`25· · · · Q.· · Starting at page 68 of your
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`14
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`15
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·declaration, is that your curriculum vitae?
`
`·3· · · · A.· · Yes.
`
`·4· · · · Q.· · Is everything accurate in your
`
`·5· ·CV?
`
`·6· · · · A.· · To the best of my knowledge.
`
`·7· · · · Q.· · Let's start with your education.
`
`·8· · · · · · · That's listed on the first page
`
`·9· ·of your CV on page 68 of the declaration;
`
`10· ·is that right?
`
`11· · · · A.· · Yes.
`
`12· · · · Q.· · Could you please walk me through
`
`13· ·your education after high school.
`
`14· · · · A.· · So I got a diploma of
`
`15· ·engineering from the National Technical
`
`16· ·University of Athens in 1987.
`
`17· · · · · · · Then I went to Carnegie Mellon
`
`18· ·and I received a Master's of Science and
`
`19· ·Electrical Computer Engineering in December
`
`20· ·of 1988.
`
`21· · · · · · · And also I received a Ph.D., a
`
`22· ·Doctor of Philosophy in Electrical
`
`23· ·Engineering in 1992.
`
`24· · · · Q.· · Below your name, you have listed
`
`25· ·your current employment; is that correct?
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`15
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`16
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · A.· · Yes.
`
`·3· · · · Q.· · So you're currently employed as
`
`·4· ·a Professor at the University of Minnesota;
`
`·5· ·is that right?
`
`·6· · · · A.· · Yes.
`
`·7· · · · Q.· · And how long have you worked
`
`·8· ·there?
`
`·9· · · · A.· · I joined the University of
`
`10· ·Minnesota in August/September of 1992,
`
`11· ·immediately after my graduation.
`
`12· · · · Q.· · So soon after you received your
`
`13· ·Ph.D., you started at the University of
`
`14· ·Minnesota?
`
`15· · · · A.· · Yes.
`
`16· · · · Q.· · And then on that same page, page
`
`17· ·68, there's a heading that says "Research
`
`18· ·Experience."
`
`19· · · · · · · Under that, you list:
`
`20· · · · · · · "Distributed systems robotics,
`
`21· ·robotics, computer vision, medical
`
`22· ·robotics, sensor networks, robotic visual
`
`23· ·are tracking and servoing, sensor-based
`
`24· ·control and transportation systems, active
`
`25· ·vision, computer engineering, signature
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`16
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`17
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·recognition and identification, and object
`
`·3· ·recognition."
`
`·4· · · · · · · Is your research since 1992
`
`·5· ·primarily in robotics then?
`
`·6· · · · · · · MR. BERKOWITZ:· Object to form.
`
`·7· · · · A.· · My research actually covers a
`
`·8· ·variety of topics.· So as you are well
`
`·9· ·aware, or you might be aware, in these
`
`10· ·environments -- so if you see, I'm in
`
`11· ·charge of several labs or centers.
`
`12· · · · · · · So one is the Center For the
`
`13· ·Field of Robotics.· The other one, it has
`
`14· ·to do with the transportation systems in
`
`15· ·the sector and safety.· And then the point
`
`16· ·is, my research changes as we move from
`
`17· ·year to year.
`
`18· · · · · · · So when I joined Minnesota, my
`
`19· ·expertise was computer vision and robotics.
`
`20· ·But Minnesota had a long tradition in
`
`21· ·transportation systems, so when you're an
`
`22· ·assistant professor, you look for
`
`23· ·opportunities to -- for exciting projects.
`
`24· · · · · · · So I started working, and you
`
`25· ·can see this in my grants with the
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`17
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`18
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·Minnesota Department of Transportation, a
`
`·3· ·variety of transportation-related projects.
`
`·4· · · · · · · So the order that you see here
`
`·5· ·is not really indicative because things
`
`·6· ·change.· So right now, for example, I'm
`
`·7· ·doing sensors, particular cameras, for --
`
`·8· ·interconnected to vehicles, which is a new
`
`·9· ·initiative.
`
`10· · · · · · · So things evolve, there is new
`
`11· ·technology, so on and so forth.
`
`12· · · · Q.· · So since 1992, what percentage
`
`13· ·of your research has specifically related
`
`14· ·to automotive applications?
`
`15· · · · · · · MR. BERKOWITZ:· Object to form.
`
`16· · · · A.· · With respect to hours spent?
`
`17· · · · Q.· · Sure.
`
`18· · · · · · · With respect to hours spent.
`
`19· · · · A.· · It's very difficult to pin down
`
`20· ·because sometimes there are grants which
`
`21· ·are starting, awards -- certain grants
`
`22· ·which are starting and certain grants which
`
`23· ·are expiring.
`
`24· · · · · · · The work, for example, that you
`
`25· ·do for intelligent transportation systems
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`18
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`19
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·might be transferred to robotic systems and
`
`·3· ·the other way around, so it's very
`
`·4· ·difficult to pin down.
`
`·5· · · · · · · I will answer this question by
`
`·6· ·telling you that if you see my most cited
`
`·7· ·paper in Google Scholar, it is a paper
`
`·8· ·about intelligent transportation systems.
`
`·9· · · · · · · So although I have started a
`
`10· ·very successful company in robotics, people
`
`11· ·seem to appreciate more a paper with me and
`
`12· ·Gupte and Masoud in this area.
`
`13· · · · · · · So this, can give you an idea --
`
`14· ·I think it's more important to look at the
`
`15· ·impact than the amount of time that you can
`
`16· ·spend.
`
`17· · · · Q.· · But in terms of the time that
`
`18· ·you spent by hours, would you say that
`
`19· ·research specifically relating to
`
`20· ·automotive applications is greater or less
`
`21· ·than 50 percent?
`
`22· · · · A.· · You know, at the beginning of my
`
`23· ·career, it might have been even more than
`
`24· ·50 percent in transportation systems,
`
`25· ·because the existence of the Center for
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`19
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`20
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·Transportation Studies -- so this is a
`
`·3· ·federally funded center -- and I was the
`
`·4· ·only -- one of the few individuals with
`
`·5· ·computer vision background, so I would say
`
`·6· ·at the beginning at least it was more than
`
`·7· ·50 percent of my time.
`
`·8· · · · · · · And also the robotics, that I
`
`·9· ·receive a grant from DARPA.· DARPA is the
`
`10· ·defense -- they stretch out of the Army, so
`
`11· ·it's DARPA.· So a lot of my time, more than
`
`12· ·50 percent of the time was expended on
`
`13· ·transportation systems.
`
`14· · · · Q.· · So overall, since 1992, is the
`
`15· ·amount of time by hours that you spent
`
`16· ·specifically on automotive applications
`
`17· ·greater or less than 50 percent?
`
`18· · · · A.· · To be precise, I will say that
`
`19· ·it has changed depending on the funding and
`
`20· ·the interest and the -- between 50 percent
`
`21· ·and 33 percent.
`
`22· · · · Q.· · Okay.
`
`23· · · · A.· · So one-third, I will say, is
`
`24· ·actually --
`
`25· · · · Q.· · Okay.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`20
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`21
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · · · · In the last year, what percent
`
`·3· ·in terms of hours spent would you say of
`
`·4· ·your research -- not any of your expert
`
`·5· ·work -- has related specifically to
`
`·6· ·automotive applications?
`
`·7· · · · A.· · I will give you one example:
`
`·8· · · · · · · We have a significant
`
`·9· ·multi-million dollar contract from the
`
`10· ·Federal Highway Administration to monitor
`
`11· ·using cameras, track parking spaces.
`
`12· · · · · · · So if I look at the time I have
`
`13· ·charged to this, it might be close to
`
`14· ·40 percent of my time.· You see, at the
`
`15· ·university we're allowed to charge some of
`
`16· ·the time, and also get other grants, so
`
`17· ·this is what I use as a metric.
`
`18· · · · Q.· · Is any of your research work
`
`19· ·sponsored by any automakers?
`
`20· · · · A.· · Currently or in the past?
`
`21· · · · Q.· · Both.
`
`22· · · · · · · First let's look at currently
`
`23· ·and then let's talk about the past.
`
`24· · · · A.· · Currently -- you see, the
`
`25· ·majority of the work comes from federal
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`21
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`22
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·agencies, so we have had gifts or donation
`
`·3· ·of equipment, but -- I have to look at my
`
`·4· ·grants.
`
`·5· · · · · · · Currently, I don't have any
`
`·6· ·support from automakers, but I have to look
`
`·7· ·at my grants just to tell you exactly,
`
`·8· ·because there were some gifts.
`
`·9· · · · · · · For example, 3M gave us a gift
`
`10· ·of a few thousand dollars a year.· They
`
`11· ·have an automotive select transportation
`
`12· ·unit that makes the film that goes on the
`
`13· ·stop signs.· So if you want me to do this,
`
`14· ·I will be glad to.
`
`15· · · · Q.· · Has any of your research work
`
`16· ·specifically been sponsored by any
`
`17· ·automakers?
`
`18· · · · A.· · If you don't mind, could I check
`
`19· ·my -- just to refresh my memory.
`
`20· · · · · · · The answer is no, but this list
`
`21· ·doesn't include gifts.· For example, Honda
`
`22· ·has donated some equipment, but I don't
`
`23· ·recall -- because this goes to the
`
`24· ·foundation, so... from this list, the
`
`25· ·answer is no.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`22
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`23
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · Q.· · Has any of your research ever
`
`·3· ·involved any equipment donated by Toyota?
`
`·4· · · · A.· · To the best of my recollection,
`
`·5· ·no.
`
`·6· · · · Q.· · Now, in your CV, you have listed
`
`·7· ·some publications in which you are an
`
`·8· ·author or co-author; is that right?
`
`·9· · · · A.· · Yes.· There are listed several.
`
`10· · · · Q.· · It looks like there's about 247
`
`11· ·publications listed on your CV; is that
`
`12· ·right?
`
`13· · · · A.· · If you look, there are 76 --
`
`14· · · · Q.· · So it's 76 publications.
`
`15· · · · A.· · So there are 76 journal
`
`16· ·publications, and the last few weeks, I
`
`17· ·just sent a few more.
`
`18· · · · · · · There are several -- more than
`
`19· ·five book chapters, and there are a lot of
`
`20· ·conference papers.
`
`21· · · · Q.· · Are the most recent ones listed
`
`22· ·at the beginning?
`
`23· · · · A.· · Yes.· So the idea is that you
`
`24· ·start with things that are actually
`
`25· ·accepted, or in the process of being
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`23
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`24
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·published, and then you move backwards.
`
`·3· · · · · · · And then at the end, I have the
`
`·4· ·ones that we have not received any word
`
`·5· ·about acceptance or rejection.
`
`·6· · · · Q.· · Out of the journal papers that
`
`·7· ·you've written, approximately how many, in
`
`·8· ·terms of percentage, would you say relate
`
`·9· ·specifically to automotive applications?
`
`10· · · · · · · MR. BERKOWITZ:· Object to form.
`
`11· · · · A.· · Do you want -- just to be
`
`12· ·precise, do you want the specific claim
`
`13· ·construction of the case here or just in
`
`14· ·general?
`
`15· · · · Q.· · Just in general, automotive
`
`16· ·applications, approximately what percentage
`
`17· ·of your journal papers relate to automotive
`
`18· ·applications?
`
`19· · · · A.· · Let me tell you one example that
`
`20· ·is really -- let's take the number one, for
`
`21· ·example, which is a paper that has been
`
`22· ·accepted:· "IEEE Transactions on Pattern
`
`23· ·Analysis and Machine Intelligence."
`
`24· · · · · · · The obvious application of this
`
`25· ·paper is in testing and detection, human
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`24
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`25
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·detection.· So it might appear that this is
`
`·3· ·not related, but the objective -- so do you
`
`·4· ·want me to be inclusive of this or --
`
`·5· · · · Q.· · I can be a little bit more
`
`·6· ·precise:
`
`·7· · · · · · · Out of your journal papers,
`
`·8· ·approximately how many in terms of
`
`·9· ·percentage specifically refer in the paper
`
`10· ·to automotive applications?
`
`11· · · · · · · MR. BERKOWITZ:· Object to form.
`
`12· · · · A.· · Which paper?
`
`13· · · · Q.· · Any of these papers.
`
`14· · · · A.· · You mentioned is related to the
`
`15· ·paper.
`
`16· · · · Q.· · No, I'm sorry.
`
`17· · · · · · · How many of these by percentage
`
`18· ·in the paper refer to automotive
`
`19· ·applications?
`
`20· · · · · · · MR. BERKOWITZ:· Object to form.
`
`21· · · · · · · Foundation.
`
`22· · · · A.· · With the assumption that I
`
`23· ·stated earlier, that a lot of these cover
`
`24· ·human detection, auditory tracking.
`
`25· · · · · · · If you can give me a few
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`25
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`26
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· ·minutes, I can enumerate.
`
`·3· · · · · · · More than 30.· Just a rough
`
`·4· ·count.
`
`·5· · · · Q.· · And then if you go to your book
`
`·6· ·chapters on page 75, you are an author or
`
`·7· ·co-author on seven book chapters; is that
`
`·8· ·right?
`
`·9· · · · A.· · Yes.
`
`10· · · · Q.· · Number 1 is entitled:
`
`11· · · · · · · "Robot Surveillance and
`
`12· ·Security."
`
`13· · · · · · · Is that right?
`
`14· · · · A.· · Yes.
`
`15· · · · Q.· · Number 2 is entitled:
`
`16· · · · · · · "Distributed Robotic Items:· A
`
`17· ·Framework for Simulated and Real-World
`
`18· ·Modeling."
`
`19· · · · · · · Is that right?
`
`20· · · · A.· · Yes.
`
`21· · · · Q.· · Number 3 is:
`
`22· · · · · · · "A Framework for Large-Scale
`
`23· ·Multi-Robot Teams."
`
`24· · · · · · · Is that right?
`
`25· · · · A.· · Yes.
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSolutions.com
`
`
`
`
`
`
`
`26
`
`
`
`
`NIKOLAOS PAPANIKOLOPOULOS, PH.D.·NIKOLAOS PAPANIKOLOPOULOS, PH.D.·
`
`TOYOTA MOTOR vs. AVSTOYOTA MOTOR vs. AVS
`
`February 24, 2014February 24, 2014
`
`27
`
`·1· · · · Nikolaos Papanikolopoulos, Ph.D.
`
`·2· · · · Q.· · Number 4 is:
`
`·3· · · · · · · "Using Visual Features for
`
`·4· ·Localizing within Topological Maps of
`
`·5· ·Indoor Environments."
`
`·6· · · · · · · Is that right?
`
`·7· · · · A.· · Yes.
`
`·8· · · · Q.· · Number 5 is:
`
`·9· · · · · · · "Using Active Deformable Models
`
`10· ·in Robot Visual Servoing."
`
`11· · · · A.· · Yes.
`
`12· · · · Q.· · Number 6 is:
`
`13· · · · · · · "Visual Servoing for Robotic
`
`14· ·Assembly."
`
`15· · · · A.· · Yes.
`
`16· · · · Q.· · Number 7 is:
`
`17· · · · · · · "Controlled Active Vision."
`
`18· · · · · · · Is that right?
`
`19· · · · A.· · Yes.
`
`20· · · · Q.· · So out of the seven book
`
`21· ·chapters, five of them specifically refer
`
`22· ·to "robot" or "robotics," is that right, in
`
`23· ·the title?
`
`24· · · · · · · MR. BERKOWITZ:· Objection.
`
`25· · · · A.· · Again, if you look, for example,
`
`800.211.DEPO (3376)
`800.211.DEPO (3376)
`EsquireSolutions.comYVer1f
`EsquireSol