`
`
`ATTORNEY Docket No.
`TRANSMITTAL LETTER TO THE UNITED STATES
`0079124-000111
`
`DESIGNATED/ELECTED OFFICE (DO/EO/US)
`U.S. APPLICATION No,
`(if known)
`CONCERNING A SUBMISSION UNDER35 U.S.C. 371
`Unassigned
`~
`
`INTERNATIONAL APPLICATION NO.
`INTERNATIONALFILING DATE
`PRIORITY DATE CLAIMED
`
`13 February 2014PCT/EP2014/052842 13 February 2013
`
`TITLE OF INVENTION
`FOCUS SCANNING APPARATUS RECORDING COLOR
`FIRST NAMED INVENTOR
`
`
`
`
`
`
`
`Bo ESBECH et.al.
`
`Applicant herewith submits to the United States Designated/Elected Office (DO/EO/US) the following items and other information.
`1. C] This is an express request to begin national examination procedures (35 U.S.C. 371(f)). NOTE: The express request under 35 U.S.C.
`371(f) will not be effective unless the requirements under 35 U.S.C. 371 (c)(1), (2), and (4) for paymentof the basic national fee, copy
`of the International Application and English translation thereof(if required), and the oath or declaration of the inventor(s) have been
`received,
`
`2. CJ A copyofthe International Application (35 U.S.C. 371(c)(2)) is attached hereto (not requiredif the International Application was
`previously communicated by the International Bureau or wasfiled in the United States Receiving Office (RO/US)).
`
`3.
`
`4.
`
`An English language translation of the International Application (35 U.S.C. 371(c)(2))
`a.
`xX]
`is attached hereto.
`b. [] has been previously submitted under 35 U.S.C. 154(d)(4).
`An oath ordeclaration of the inventor(s) (85 U.S.C. 371(c)(4))
`a, Q is attached.
`
`b. C waspreviouslyfiled in the international phase under PCT Rule 4.1 7(iv).
`
`Items 5 to 8 below concern amendments madein the international phase.
`PCT Article 19 and 34 amendments
`
`5. L] Amendmentsto the claims under PCT Article 19 are attached (not required if communicated by the International Bureau) (35 U.S.C.
`371(c)(3)).
`6. Englishtranslation of the PCT Article 19 amendmentis attached (35 U.S.C. 371(c)(3)).
`70 English translation of annexes (Article 19 and/or 34 amendments only) ofthe International Preliminary Examination Report is
`attached (35 U.S.C. 371(c)(5)).
`
`Cancellation of amendments madein the international phase
`8a. [] Donotenter the amendment madein the international phase under PCT Article 19.
`8b. L] Donotenter the amendment madein the international phase under PCTArticle 34.
`NOTE: A proper amendment made in English under Article 19 or 34 will be entered in the U.S. national phase application absent a clear
`instruction from applicant not to enter the amendment(s).
`
`Thefollowing items 9 to 17 concern a document(s) or information included.
`9. x An Information Disclosure Statement under 37 CFR 1.97 and 1.98.
`
`10.
`
`A preliminary amendment
`
`[EX] An Application Data Sheet under 37 CFR 4.76.
`11.
`12. CL A substitute specification. NOTE: A substitute specification cannot include claims. See 37 CFR 1.125(b).
`13. | A powerof attorney and/or changeof addressletter.
`14. LC A computer-readable form of the sequencelisting in accordance with PCT Rule 13ter.3 and 37 CFR 1.821-1.825.
`15. [] Assignment papers (cover sheet and document(s). Name of Assignee : 3Shape A/S.
`16. L] 37 CFR 3.73(c) Statement (whenthere is an Assignee).
`
`Align Ex. 1002 (Part 1 of 3)
`U.S. Patent No. 9,962,244
`
`[Page 1 of 3]
`
`0001
`
`Align Ex. 1002 (Part 1 of 3)
`U.S. Patent No. 9,962,244
`
`0001
`
`

`

`
`
`
`ATTORNEY DOCKETNO.
`U.S. APPLICATION NO. (If known)
`INTERNATIONAL APPLICATION NO.
`0079124-000111
`Unassigned
`PCT/EP2014/052842
`
`17. [X] Otheritemsorinformation:
`
`
`
`General Authorization for Petitions for Extensions of Time and Payment of Fees
`Form PCT/IB/304
`Form PCT/IB/304
`Form PCT/IB/308 (First Notice)
`Form POT/IB/308 (Second Notice)
`Form PCT/ISA/210
`
`The following fees have been submitted.
`
`CALCULATIONSPTO USE ONLY
`
`18.
`
`Basic national fee (87 CFR 1.492(8)) oo... cccssssensereerersssesseetee coeeneeesneeransenners (1631}
`
`$280
`
`$
`
`280.00
`
`20.
`
`19, IX] Examination fee (37 CFR 1.492(c))
`If the written opinion prepared by ISA/US orthe International preliminary
`examination report prepared by IPEA/US indicatesall claims satisfy provisions of
`PCT Article 33(1)-(4) occ cccsessesssectessesersecerseesssscaseececsnessianenrenesressenseraresseses (1643)
`Alb other Situations... escsesseceterecnensestensnssnenssnesssnsssvesereeseeseseeeieeserenes (1633)
`[X] Search fee (37 CFR 1.492(b))
`If the written opinion prepared by ISA/US orthe International preliminary
`examination report prepared by IPEA/US indicates all claims satisfy provisions of
`PCT Article 33(1)-(4) caccscccsssssssssssssssssssescssecsssesssssesarcevecsvecestsvecssuesnvessessesseeasnese (1640)
`Search fee (87 CFR 1.445(a)(2)) has been paid on the international application to
`the USPTOasan International Searching AUthority.......ccceccensectersaseeeres (1641)
`International Search Report prepared by an ISA other than the US andprovided to
`the Office or previously communicated to the US by the IB...csc (1642)
`All other situations... ccssccsssssssssrssssesssesssvessneesessessssneserssseseessesseesessseessees (1632)
`
`$0
`$720
`
`$0
`
`$120
`
`$480
`$600
`
`TOTAL OF 18, 19 and 20 =
`i] Additional fee for specification and drawings filed in paper over 100 sheets
`(excluding sequencelisting in compliance with 37 CFR 1,821 (c) or (e) in an
`electronic medium or computer program listing in an electronic medium)
`(37 CFR 1.492())).
`Fee for each additional 50 sheets of paperor fraction thereof...(1681)
`
`$400
`
`Total Sheets
`
`Extra sheets
`
`Numberof each additional 50 orfraction
`thereof (round up to a whole number)
`
`RATE
`
`$
`
`720.00
`
`$
`
`480.00
`
`$1,480.00
`
`Surcharge of $140.00 for furnishing any of the search fee, examination fee, or the oath or declaration
`after the date of commencementof the national stage (37 CFR 1.492(h)).
`CLAIMS
`-
`NUMBER FILED
`NUMBER EXTRA
`
`RATE
`
`$
`
`140.00
`
`880.00
`
`+ $780 (1616
`(if applicable
`MULTIPLE DEPENDENT CLAIMS)
`Processing fee of $140.00 (1618) for furnishing the English translation later than 30 months from the
`earliest claimed priority date (37 CFR 1.492(i)).
`+
`TOTAL OF ABOVE CALCULATIONS =
`2,500.00
`$
`C] Applicant asserts small entity status. See 37 CFR 1.27. Fees above are reduced by %.
`
`LI Applicant certifies micro entity status. See 37 CFR 1,29. Fees above are reduced by %.
`Applicant must attach form PTO/SB/15Aor B or equivalent.
`
`D
`
`
`
`
`
`2,500.00
`$
`Amount to be
`refunded:
`Amount to be
`charged:
`
`Fee for recording the enclosed assignment (37 CFR 1.21(h)). The assignment must be accompanied
`by an appropriate cover sheet (37 CFR 3,28, 3,31), $40.00 per property
`+
`TOTAL FEES ENCLOSED =
`
`TOTAL NATIONALFEE =
`
`$
`
`2,500.00
`
`Page 2 of 3
`
`0002
`
`0002
`
`

`

`
`
`L] A check in the amount of $___ to cover the above fees is enclosed.
`Cl Please charge my Deposit Account No, 02-4800 in the amount of $___ to cover the abovefees.
`
`[Xx] The Director is hereby authorized to charge additional fees which may be required, or credit any overpayment, to Deposit Account
`No, 02-4800 as follows:
`
`X<]
`any required fee
`| any required fee except for excess claims fees required under 37 CFR 1.492(d) and (e) and multiple dependent claim fee
`required under 37 CFR 1.492(f).
`
`Fees are to be charged to a credit card. WARNING: Information on this form may become public. Credit card information should
`not be Included on this form. Provide credit card information and authorization on PTO-2038. The PTO-2038 should only be
`mailed or faxed to the USPTO. However, when paying the basic national fee, the PTO-2038 may NOTbe faxed to the USPTO.
`
`ADVISORY:Iffiling by EFS-Web, do NOTattach the PTO-2038 form as a PDF along with your EFS-Web submission. Please be
`advised that this is not recommended and by doing so your credit card information may be displayed via PAIR. To protect
`your information, it is recommendedto pay fees online by using the electronic payment method.
`
`NOTE: Where an appropriate time limit under 37 CFR 1.496 has not been met, a petition to revive (37 CFR 1.137(a) or (b)) must be
`
`filed andgranted to restore the International Application to pending status.
`Statement under 37 CFR 1.56 or 1.78 for AIA (First Inventor to File)Transition Applications
`CL This application (1) claimspriority to or the benefit of an application filed before March 16, 2013, and (2) also contains, or contained at
`any time, a claim to a claimed invention that has an effectivefiling date on or after March 16, 2013.
`
`NOTE 1: By providing this statement under 37 CFR 1.55 or 1.78, this application, with a filing date on or after March 16, 2073, will be
`examined underthe first inventorto file provisions of the AIA.
`
`NOTE2: A U.S. national stage application may not claim priority to the international application of whichit is the national phase. Thefiling
`_date of a U.S, national stage application is the international filing date. See 35 U.S.C. 363
`
`Correspondence Address
`
`
`EX] The address associated with Customer Number 21839_or CJ Correspondence address below
`
`BuchananIngersoll & Rooney PC
`
`Address
`
`P.O. Box 1404
`
`Ed
`
`|Email|
`
`
`
`Registration No.
`
`Signature Date|July 28, 2015
`D.Bo Oe
`:
`
`Name
`
`/
`
`[Page 3 of 3]
`
`0003
`
`0003
`
`

`

`
`
`Attorney Docket No. 0079124-000111
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`In re Patent Application of
`
`Bo ESBECH etal.
`
`Application No.: Unassigned
`
`Filed:
`
`July 28, 2015
`
`For.
`
`FOCUS SCANNING APPARATUS
`RECORDING COLOR
`
`Neeeeeeeeeeeeseeesee
`
`Group Art Unit: Unassigned
`
`Confirmation No.: Unassigned
`
`GENERAL AUTHORIZATION FORPETITIONS
`FOR EXTENSIONS OF TIME AND PAYMENT OF FEES
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`Commissioner:
`
`in accordance with 37 C.F.R. § 1.136(a)(3), the U.S. Patent and Trademark Office is
`hereby provided with a general authorization to treat any concurrentor future reply requiring a
`petition for an extension oftime forits timely submission as containing a request therefor for the
`appropriate length of time.
`
`The Commissioneris hereby authorized to charge any appropriate fees that may be
`required by this paper, or any other submissionsin this application, and to credit any
`overpayment, to Deposit Account No. 02-4800.
`
`Respectfully submitted,
`
`BUCHANAN INGERSOLL & ROONEY PC
`
`Date:_July 28, 2015 By: “SD Boos
`
`
`
`Travis D, Boone
`Registration No. 52635
`
`Customer Number 21839
`703.836.6620
`
`Buchanan Ingersoll & Rooney rc
`Atlorneys & Government Relations Professionals
`
`0004
`
`0004
`
`

`

`
`
`PTO/AIA/82A (07-12)
`Approvedfor use through 14/30/2014, OMB 0651-0035
`U.S, Patent and Trademark Office; U.S, DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unlessit displays a valid OMB control number.
`
`TRANSMITTAL FOR POWER OF ATTORNEY TO ONE OR MORE
`REGISTERED PRACTITIONERS
`
`NOTE: This form is to be submitted with the Power of Attorney by Applicant form (PTO/AIA/82B or equivalent) to identify the
`application to which the Powerof Attorneyis directed, in accordance with 37 CFR 1.5.
`Ifthe Power of Attorney by Applicant for
`is not accompanied bythis transmittal form or an equivalent, the Powerof Attorney will not be recognized in the application.
`
`SIGNATUREof Applicant or Patent Practitioner
`
`Signature
`SD. Boor
`Date
`July 28, 2015
`
`
`
`*Total of ONE (1) form is submitted.
`
`
`
`
`
`
`Name Telephone_|(703) 836-6620Travis D, Boone
`
`Registration Number|52635
`
`NOTE:This form must be signed in accordance with 37 CFR 1.33, See 37 CFR 1.4(d) for signature requirements andcertifications.
`
`This collection ofinformation is required by 37 CFR 1.31, 1.32 and 1.33. The information is required to obtain orretain a benefit by the public whichIs to file (and
`by the USPTOto process) an application. Confidentiality is governed by 35 U.S.C, 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 3 minutes
`to complete, including gathering, preparing, and submitting the completed application form to the USPTO. Timewill vary depending upontheindividual case. Any
`comments on the amountof time you require to complete this form and/or suggestions for reducing this burden, should be sentto the Chief Information Officer,
`U.S. Palent and Trademark Office, U.S. Department of Commerce, P.O, Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS
`TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1460, Alexandria, VA 22313-1460.
`
`ff you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`0005
`
`0005
`
`

`

`
`
`PTOIAIAD2 (0719)
`Doo Code: PA,
`"Approved for use through 44/30/2014, OMB 0001-0084 «
`Document Degoriptlon: Powerof Attomey
`:
`U8, Palant and Trademark Offica; U8, DEPARTMENT OF COMMERCE
`'
`‘
`Underthe Paperwork Raductlon Aot of 1986, no peldons are requirad to reapondt fo rt cblledtlon of Infarmatfon untoasIl displays a valid OMB contol number
`
`POWER OF ATTORNEYBY APPLICANT
`ni hereby revokeail previous powersofattorney glven In the application Identiflad In sither the atlached transmittallatterof
`the boxes below,
`,
`:
`.
`.
`
`
`Application Number
`
`-
`
`Fillng Data
`
`see
`
`|
`
`:
`
`at
`
`.
`
`CJ
`
`‘
`
`Tho address gasoclatedwith GudtomerNumber: |
`
`OR
`
`‘
`
`.
`
`
`
`
`
`
`
`
`(Note; The boxes above may beleft blankIf information ls provided on form PTO/AIA/82A,)
`| haraby appoint the Patent Practitionar(s) assoclatad with the following Customer Numberas my/our allornay(s) of agents) and
`to transact all businessin the United Statas Patent and Trademark Offico connsoted therewith for the application sefarenced
`In
`the attached (rangmitlal letter (form PTO/AIA/82A)or Identified above: 21839
`
`
`OR
`] Thereby appoint Practitloner(s) named in the altached llst (form PTO/AIA/82C) as my/our atfornay(s) or agents), and to transact
`
`
`all business In the United States Patent and Trademark Office connected therewilh for {he patent application referenced In the
`allaohed {ransmittal letter (form PTO/AIA/82A)of Identiled above, (Note: Complete form PTOINA/826,)
`6
`+
`
`
`
`
`
`pondenceaddressfor the application Idantifled In the attached transmittal
`Plaase recognize or change the corres
`
`
`letter or the boxes aboveto:
`'
`
`
`The addressassociated with the above-mentlonad Customer Number’
`OR
`'
`
`
`
`
`awe
`
`
`
`
`
`
`
`
`
`
`Individual Name
`
`,
`
`ok
`
`polyteTT
`Poountry
`Telephone idig
`am the Appiloant (if the Applicant Is a Jurlstic‘antily, list the Applicant name In tha box);
`3Shape A/S
`-
`
`tnvantor orJoint Invenior(ite not required below)
`:
`‘ Legal Repreaentalive of a Doceased of Legally Incapaaitated Inventor(tltg not required below)
`Asalones or Person to Whom the lavantor la Under an Obligalion te Assign
`(provide algner'a title If appiloant Io @ jurlailo antily)
`
`CI Person Who Otherwlad Showa Sulffclont Proprlotary,Interest (6.9,a palitlon under 37 CFR 41,48(b)(2) was granted In the
`
`application or is conoyrrehtly being tiled with this document)
`(provide signers title If applidant Is 4 jurlatle antit
`
`PoLIASIGNATUREofApplionntforPptont
`
`
`
`
`
`
`[Thoundarelgnecl(whose{iif[sHuphledbelow)iaauthorizedtoaolonbehalfofthedeplioant(e.g.,wheretheapploantIsajurtsttaently),|
`[SignatureUNTate(Optional)Tlove4Zor|
`|Name[koifotohman
`reog hapa
`1.33, See 97 CFR 1.4 for signatuye requirémente
`NOTE: Signuture » This fofhh
`mustbe signed by the applloant in aacordance with 37 OFF
`|
`and cartiftoations, If more (Nan one applicant, use mulilale farms,
`
`[Trotat of
`forma are submilted,
`.
`|_|
`
`
`
`bilo Which19
`to fil (and by the
`His collection of information le required by 37 CFR 7,137,
`1.42, and 1.35, Tho Information [9 raquirad to ob{aln of rolaln A benefit by tho {
`9
`USPTO to process) an applloation, Confidontiniily is governed by 45 U,S,0, 122 and 47 GFR tA fund 4,14, Thig collection la aalimatad lo fake 3 minulas lo complate,
`induding galhurtng, preparing, and submiiing the completed appllontlon famte We USPTO,Tmowill vary dopehding upon the Indiddual case, Any cominients on the amount
`“Paparimant of Commerce, P.O, Box 1480, Alexanddn, VA 22919-1480, DO NOT SEND FERS OR GOMPLETEC FORMS TO THI8 ADDRESS, SEND TO: Conmulsatoner
`for Patonts, P.O, Box 4460, Aloxandile,VA 22449-4400,
`;
`" if'yau needagsistance fn eomplating tho form, nal! 1-200-PTO-0169 artd salaot option 2
`
`
`
`aflimayouraquiratocomplatathisforaursuggaallone{orréducingthisburden, ehatddbagenttotheOhialeneOliicar,U.S,PatantandTrademarkOffice,U.S.
`
`
`
`0006
`
`0006
`
`

`

`
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`Patent
`Attorney’s Docket No. 0079124-000111
`
`Group Art Unit: Unassigned
`
`Confirmation No.: Unassigned
`
`))
`
`)) ))
`
`In re Patent Application of
`
`Bo ESBECH et al.
`
`Application No.: Unassigned
`
`Filed:
`
`July 28, 2015
`
`For:
`
`FOCUS SCANNING APPARATUS
`RECORDING COLOR
`
`PRELIMINARY AMENDMENT
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`Commissioner:
`
`Prior to examination of the above-captioned patent application, kindly amend the
`
`application as follows.
`
`0007
`
`0007
`
`

`

`
`
`AMENDMENTSTO THE SPECIFICATION:
`
`Please replace the original specification with the attached substitute specification.
`
`Please find attached:
`
`- Marked-Up Copyof substitute specification
`
`- Clean Copy of substitute specification.
`
`No new matter has been added.
`
`0008
`
`0008
`
`

`

`
`
`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 3
`
`AMENDMENTSTO THE CLAIMS:
`
`The followinglisting of claims will replace all prior versions andlistings of claimsin this
`
`application.
`
`LISTING OF CLAIMS:
`
`1.
`
`(Currently Amended) A focus scanner system for recording surface geometry
`
`and surface color of an object, the focus scanner system comprising:
`
`[[-]] a multichromatic light source configured for providing a multichromatic probelight
`
`for illumination of the object,
`
`[[-I] a color image sensor comprising an array of image sensor pixels for capturing one
`
`or more 2D imagesoflight received from said object, and
`
`
`
`surface-colorinformationfora-bleck of said-image-sensor pixels-from-a-series-of2Dimage
`
`-a-data-processia
`
`
`
`recordedbysaidcolorimage Sensor
`
`wherethe-scanner-systen-is-awherein the focus scanner system is configured to
`
`operate eperating by translating a focus plane along an optical axis of the focus scanner system
`
`and capturing a series of the 2D images, each 2D image ofthe seriesis at a different focus
`
`plane position pesitions such that each theseries of captured 2D imagesforms a stack of 2D
`
`images;and
`
`a data processing system configured to derive surface geometry information for a block
`
`of said image sensorpixels from the 2D imagesin the stack of 2D images captured by said
`
`color image sensor, the data processing system also configured to derive surface color
`
`information for the block of said image sensorpixels from at least one of the 2D images used to
`
`derive the surface geometry information.
`
`0009
`
`0009
`
`

`

`
`
`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 4
`
`2.
`
`
`(Currently Amended) The focus scanner system according to claim 1, wherein
`
`the data processing system is configured for generating a sub-scanof a part of the object
`
`surface based on surface geometry information and surface color information derived from a
`
`plurality of blocks of image sensorpixels.
`
`3.
`
`(Currently Amended) The focus scanner system according to claim 1 eF2,
`
`wherein the data processing system is configured for combining a number of sub-scans to
`
`generate a digital 3D representation of the object.
`
`4.
`
`(Currently Amended) The focus scanner systera according to claim 1 any-efthe
`
`preceding-claims, where the scanner system comprises a pattern generating element
`
`configured for incorporating a spatial pattern in said probelight.
`
`5.
`
`
`
`(Currently Amended) The focus scanner system according to claim 1 any-eHthe
`
`preceding-claims, where deriving the surface geometry information and surface color
`
`information comprises calculating for several 2D images a correlation measure betweenthe
`
`portion of the 2D image captured by said block of image sensorpixels and a weight function,
`
`where the weight function is determined based on information of the configuration of the spatial
`
`pattern.
`
`6.
`
`(Currently Amended) The focus scanner system according to the-preceding claim
`
`5, wherein deriving the surface geometry information and the surface color information for a
`
`block of image sensorpixels comprisesidentifying the position along the optical axis at which
`
`the corresponding correlation measure has a maximum value.
`
`0010
`
`0010
`
`

`

`
`
`Attorney's Docket No. 0079124-000111
`Application No, Unassigned
`Page 5
`
`7.
`
`(Currently Amended) The focus scanner system according to claim Zor8 6,
`
`wherein generating a sub-scan comprises determining a correlation measure function
`
`describing the variation of the correlation measure along the optical axis for each block of image
`
`sensorpixels and identifying the position along the optical axis at which the correlation measure
`
`functions have their maximum value for the block.
`
`8.
`
`(Currently Amended) The focus scanner systema according to claim 7 eF8, where
`
`the maximum correlation measure value is the highest calculated correlation measure value for
`
`the block of image sensorpixels and/or the highest maximum value of the correlation measure
`
`function for the block of image sensor pixels.
`
`9.
`
`
`
`(Currently Amended) The focus scanner system according to claim 6 any-of
`
`claims-6-te-9, wherein the data processing system is configured for determining a sub-scan
`
`color for a point on a generated sub-scan based on the surface colorinformation of the 2D
`
`image in the series in which the correlation measure has its maximum value for the
`
`corresponding block of image sensorpixels.
`
`10.
`
`
`(Currently Amended) The focus scanner system according to the-preceding claim
`
`9, wherein the data processing system is configured for deriving the sub-scancolorfor a point
`
`on a generated sub-scan basedonthe surface colorinformation of the 2D imagesin the series
`
`in which the correlation measure has its maximum value for the corresponding block of image
`
`
`
`sensorpixels and on at least one additional 2D image,such-as-aneighboring2D-image-from
`
`the-series-ofcaptured2Dimages.
`
`0011
`
`0011
`
`

`

`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 6
`
`11.
`
`(Currently Amended) The focus scanner system according to the-preceding claim
`
`40, where the data processing system is configured for interpolating surface colorinformation of
`
`at least two 2D imagesin a series when determining the sub-scan color, such as an
`
`interpolation of surface color information of neighboring 2D imagesin a series.
`
`
`
`12. (Currently Amended) The focus scanner system according to claim10anyef
`
`claims-10to-, wherein the data processing system is configured for computing an averaged
`
`sub-scan color for a numberof points of the sub-scan, where the computing comprises an
`
`
`
`
`
`averaging of sub-scan colors of different points,such-as-aweighted_averagingofthecolors_of
`
`13.
`
`
`
`(Currently Amended) The focus scanner system according to claim 1 anyeHthe
`
`preceding-claims, where the data processing system is configured for determining object color
`
`for a least one point of the generated digital 3D representation of the object from sub-scan color
`
`of the sub-scans combined to generate the digital 3D representation, such that the digital 3D
`
`representation expresses both geometry and colorprofile of the object.
`
`
`
`14.theprevious claim(Currently Amended) The focus scanner system according to
`
`
`
`413, wherein determining the object color comprises computing a weighted average of sub-scan
`
`color values derived for corresponding points in overlapping sub-scansat that point of the object
`
`surface.
`
`
`
`15. (Currently Amended) The focus scanner system according to claim 1anyofthe
`
`previous-claimes, wherein the data processing system is configured for detecting saturated pixels
`
`0012
`
`0012
`
`

`

`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 7
`
`in the captured 2D images andfor mitigating or removing the error in the derived surface color
`
`information or the sub-scan color caused by the pixel saturation.
`
`16,
`
`(Currently Amended) The focus scanner system according to the-previeus claim
`
`15, wherein the error caused by the saturated pixel is mitigated or removed by assigning a low
`
`weight to the surface color information of the saturated pixel in the computing of the smoothed
`
`sub-scan color and/or by assigning a low weight to the sub-scan color computed based on the
`
`saturated pixel.
`
`
`
`17, (Currently Amended) The focus scanner system according to claim1any-efthe
`
`preceding-claims, wherein the data processing system is configured for comparing the derived
`
`surface color information of sections of the captured 2D images and/or of the generated sub-
`
`scans of the object with predetermined color ranges for teeth and fororal tissue, and for
`
`suppressing the red componentof the derived surface color information or sub-scan color for
`
`sections where the color is not in one of the two predetermined color ranges.
`
`18.
`
`(Currently Amended) The focus scanner system according to claim 1, any-efthe
`
`
`
`precedingclaimswhere the color image sensor comprisesacolorfilter array comprising at least
`
`three types ofcolorsfilters, each allowinglight in a known wavelength range, W1, W2, and W3
`
`respectively, to propagate through the colorfilter.
`
`19.
`
`(Currently Amended) The focus scanner system according to claim 1, any-efthe
`
`preceding-claims where the surface geometry information is derived from light in a selected
`
`wavelength range of the spectrum provided by the multichromatic light source.
`
`0013
`
`0013
`
`

`

`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 8
`
`
`
`20.thepreceding claim(Currently Amended) The focus scanner system according to
`
`
`
`19, where the colorfilter array is such that the proportion of the image sensor pixels of the color
`
`image sensorwith color filters that match the selected wavelength range of the spectrum is
`
` larger than 50%
`
`21.
`
`(Currently Amended) The focus scanner system according to claim 19 er29,
`
`wherein the selected wavelength range matches the W2 wavelength range.
`
`22,
`
`(Currently Amended) The focus scanner system according to claim 19 any-of
`
`claimst9te-24, wherein the color filter array comprises a plurality of cells of 6x6 colorfilters,
`
`where the color filters in positions (2,2) and (5,5) of each cell are of the VV1 type, the colorfilters
`
`in positions (2,5) and (5,2) are of the W3 type.
`
`
`
`23,thepreceding claim(Currently Amended) The focus scanner system according to
`
`
`
`22, where the remaining 32 color filters in the 6x6 cell are of the W2 type.
`
`24.
`
`(Currently Amended) The focus scanner according to the-preseding claim 23,
`
`where the pattern generating element is configured to provide that the spatial pattern comprises
`
`alternating dark and bright regions arranged in a checkerboard pattern.
`
`25.
`
`(Currently Amended) A focus scanner system for recording surface geometry
`
`
`and surface color of an object, the focus scanner systera comprising:
`
`a multichromatic light source configured for providing a multichromatic probe light, and
`
`a color image sensor comprising an array of image sensor pixels for capturing one or
`
`more 2D imagesoflight received from said object,
`
`0014
`
`0014
`
`

`

`
`
`
`
`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 9
`
`where at least for a block of said image sensorpixels, both surface color information and
`
`surface geometry information of a part of the object are derived at least partly from one 2D
`
`image captured by said color image sensor.
`
`26.
`
`(Currently Amended) A method of recording surface geometry and surface color
`
`of an object, the method comprising:
`
`obtaining a focus scanner system according to claim1any-ofthe-previous-claims,
`
`illuminating the surface of said object with multichromatic probe light from said
`
`multichromatic light source;
`
`capturing a series of 2D imagesof said object using said color image sensor; and
`
`deriving both surface geometry information and surface color information for a block of
`
`image sensorpixels at least partly from one captured 2D image.
`
`27.
`
`(New) The focus scanneraccording to claim 1, wherein the same series of 2D
`
`images is taken from one passof the focus scanneralong the optical axis,
`
`28.
`
`(New) The focus scanneraccording to claim 1, wherein the multichromatic light
`
`source, the color image sensor, and at least a portion of the data processing system are
`
`included in a hand held unit.
`
`29.
`
`(New) The focus scanneraccording to claim 19, where the colorfilter array is
`
`such that the proportion of the image sensorpixels of the color image sensor with colorfilters
`
`that match the selected wavelength range of the spectrum has a proportion that equals 32/36,
`
`60/64 or 96/100.
`
`0015
`
`0015
`
`

`

`
`
`
`
`
`
`Attorney's Docket No. 0079124-000111
`Application No. Unassigned
`Page 10
`
`30.
`
`(New) The focus scanner according to claim 10, wherein said at least one
`
`additional 2D image comprises a neighboring 2D image from the series of captured 2D images.
`
`31,
`
`(New) The focus scanner according to claim 12, wherein the averaging of sub-
`
`scan colors of different points comprises a weighted averaging of the colors of the surrounding
`
`points on the sub-scan.
`
`0016
`
`0016
`
`

`

`
`
`Attorney’s Docket No. 0079124-000111
`Application No. Unassigned
`Page 11
`
`REMARKS
`
`By wayof the foregoing amendment,the claims have been amended to delete multiple
`
`dependencies, and to otherwise conform with conventional U.S. format. No new matter has
`
`been introduced by these changes. It is to be understood that applicants reservethe right to
`
`submit additional claims within the-scopeof the original claims or supported by the specification.
`
`It is requested that the application be examined on the basis of the amendments
`
`presented herein. Early and favorable consideration of this application is respectfully requested.
`
`Should any questionsarise in connection with this application, it is respectfully requested
`
`that the undersigned be contacted at the number indicated below.
`
`Respectfully submitted,
`
`BUCHANAN INGERSOLL & ROONEY PC
`
`By:
`
`/Travis D. Boone/
`Travis D. Boone
`Registration No. 52635
`
`Date: July 28, 2015
`
`Customer No. 21839
`(703) 836-6620
`
`0017
`
`0017
`
`

`

`SUBSTITUTE SPECIFICATION
`CLEAN COPY
`
`Attorney Docket No. 0079124-000111
`
`FOCUS SCANNING APPARATUS RECORDING COLOR
`
`Field of the application
`
`The application relates to three dimensional (3D) scanning of the surface geometry
`
`and surface color of objects. A particular application is within dentistry, particularly
`
`for intraoral scanning.
`
`Background
`
`10
`
`3D scanners are widely knownfrom the art, and so are intraoral dental 3D scanners
`
`(e.g., Sirona Cerec, Cadent Itero, 3Shape TRIOS).
`
`The ability to record surface color is useful in many applications. For example in
`
`15
`
`dentistry, the user can differentiate types of tissue or detect existing restorations.
`
`For example in materials inspection, the user can detect surface abnormalities such
`
`as crystallization defects or discoloring. None of the above is generally possible
`
`from surface geometry information alone.
`
`20
`
`W02010145669 mentions the possibility of recording color.
`
`In particular, several
`
`sequential images, each taken for an illumination in a different color - typically blue,
`
`green, and red - are combined to form a synthetic color image. This approach
`
`hence requires means to change light source color,
`
`such as color
`
`filters.
`
`Furthermore, in handheld use, the scanner will move relative to the scanned object
`
`25
`
`during the illumination sequence, reducing the quality of the synthetic color image.
`
`Also US7698068 and US8102538 (Cadent Inc.) describe an intraoral scannerthat
`
`records both geometry data and texture data with one or more image sensor(s).
`
`However, there is a slight delay between the color and the geometry recording,
`
`30
`
`respectively. US7698068 requires sequentialillumination in different colors to form
`
`a synthetic image, while US8102538 mentions white light as a possibility, however
`
`0018
`
`0018
`
`

`

`SUBSTITUTE SPECIFICATION
`CLEAN COPY
`
`Attorney Docket No. 0079124-000111
`
`from a secondillumination source or recorded by a second image sensor,the first
`
`set being used for recording the geometry.
`
`W02012083967 discloses a scannerfor recording geometry data and texture data
`
`with two separate cameras. While the first camera has a relatively shallow depth of
`
`field as to provide focus scanning based on multiple images, the second camera
`
`has a relatively large depth of field as to provide color texture information from a
`
`single image.
`
`Color-recording scanning confocal microscopes are also known from the prior art
`
`10
`
`(e.g., Keyence VK9700; see a