`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and TrademarkOffice
`Address: COMMISSIONER FOR PATENTS
`PO. Box 1450
`Alexandria, Virginia 22313-1450
`www.uspto.gov
`
`APPLICATION NUMBER
`
`PATENT NUMBER
`
`GROUP ART UNIT
`
`FILE WRAPPER LOCATION
`
`60/580, 108
`
`Change of Address/Powerof Attorney
`
`The following fields have been set to Customer Number 20529 on 11/29/2004
`
`e Correspondence Address
`e Powerof Attorney
`e Maintenance Fee Address
`
`The addressof record for Customer Number 20529is:
`NATH & ASSOCIATES
`1030 15th STREET, NW
`6TH FLOOR
`WASHINGTON, DC 20005
`
`The Practitioners of record for Customer Number 20529 are:
`
`PTO INSTRUCTIONS:
`
`Please take the following action when the correspondence address has been changed to a customer
`number:
`1) Add 'ADDRESS CHANGE TO CUSTOMER NUMBER'onthe next available content line of
`the File Jacket.
`2) Put a line through the old address on the File Jacket and enter the Customer Numberas the
`new address.
`.
`3) File this Notice in the File Jacket.
`
`Please take the following action when the correspondence address has NOT been changed:
`1) File this Notice in the File Jacket
`
`Page 1 of 67
`
`.
`
`3SHAPE 1021
`
`3ShapevAlign
`
`IPR2021-01383
`
`Page 1 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`
`
` Old's'n69S91
`
`Attorney Docket No.
`
`26211PRO
`
`TO
`
`0108 IU.S.P i
`60/58A
`Ny61
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`In re Application of:
`
`BABAYOFF, Noam
`
`Serial No.
`
`NOT YET ASSIGNED
`
`Filed: — June 17, 2004
`
`st
`aqa
`N
`
`0
`
`For:
`
`METHOD AND APPARATUS FOR COLOUR IMAGING A THREE-DIMENSIONAL
`
`STRUCTURE
`
`TRANSMITTAL LETTER
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`Sir:
`
`Submitted herewith for filing in the U.S. Patent and Trademark
`Office is the following PROVISIONAL APPLICATION:
`(1) Transmittal Letter
`(2) Cover sheet .for filing Provisional Application
`(3)
`61 page Provisional Application consisting of:
`_36 pages Textual Specification,
`_13 pages of 78 Claims,
`page of the Abstract,
`l,
`_12 sheets of Drawings;
`(4) Check No. 2J20}
`$ 80.00 for filing fee as a small entity;
`(5) Postcard for early notification of serial number.
`
`The Commissioner is hereby authorized to charge any deficiency
`or credit any excess to Deposit Account No. 14-0112.
`
`Respectfully submitted,
`NATH & ASSOCIATES PLLC
`
`By: S%hllee
`
`MY Nath
`.G
`Registration No. 26,965
`Marvin C. Berkowitz
`Registration No. 47,421
`Customer No. 20529
`
`June 17, 2004
`Date:
`NATH & ASSOCIATES PLLC
`1030 15™ street, NW - 6" Floor
`Washington, D.C. 20005
`GMN/MCB/ng: ProvAp_Trans_MCB
`
`Page2 of 67
`
`3SHAPE 1021
`
`3ShapevAlign
`
`IPR2021-01383
`
`Page 2 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`Gary M. Nath (oc. xy
`Todd L, Juneau we. 1)
`Ross A, Epstein ca
`Marvin C. Berkowitz wc. ca
`Robert C. Ryan ow, a+
`Robert P. Cogan ca, vo
`
`,
`
`'
`
`NATH & ASSOCIATES PLLC
`Attorneys at Law
`1030 Fifteenth Street, N.W.
`Sixth Floor
`Washington, D.C. 20005-1503
`
`Harold L. Novick oc. so++
`So
`Irvin A. Lavine wa,Retired
`Donald M. Sandler ip), Retired*
`Unfair Cinonesie
`Licensing and Litigation
`
`+ +Of Counsel
`
`TELEPHONE(202) me
`(202) 775-9393
`FACSIMILE (202) 775-8396
`(202) 822-9409
`E-MAIL: IP@NATHLAW.COM
`WEB: WWW.NATHLAW.COM
`
`Michelle L. Hartlandyva)
`Lee C. Heiman ica:
`Jerald L. Meyer qvaj-
`Tanya E. Harkins can)
`Joshua B. Goldberg cvs)
`Sheldon M. McGee oo
`Derek Richmondway
`Ryan A. Heck wv. rm
`H. David Starr wc. mp)
`Alvin E. Tanenholtz =
`Angela Y. Dai»
`Jarrod N. Raphael +
`*Practice limited to Matters and Proceedings
`before Federal Courts and Agencies; not
`Admitted in DC
`
`** Registered Patent Agent: not Admitted in DC
`
`COVER SHEET FOR FILING U.S. PROVISIONAL APPLICATION
`
`UNDER 37 CFR 1.53 (c)
`
`Commissioner for Patents
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`Re:
`
`New U.S. Provisional Patent Application
`For: METHOD AND APPARATUS FOR COLOUR IMAGING A THREE-
`DIMENSIONAL STRUCTURE
`Inventor(s):
`BABAYOFF, Noam
`Attorney Docket:
`26211PRO
`
`Sir:
`
`ing:
`
`Attached hereto is the application identified above,
`
`includ-
`
`61
`
`Pages Application Consisting of:
`Pages of Textual Specification
`36
`Pages of_78
`claims
`13
`Page of the Abstract
`0
`Pages of Drawings
`12
`Executed Inventor's Declaration
`
`names
`application
`provisional
`present
`The
`
`inventor(s):1) Noam BABAYOFF, Holon, ISRAEL.
`
`the
`
`following
`
`The Government filing fee” is calculated as follows:
`Base Fee (Provisional Application) .......... .
`
`$8
`
`.160.00
`
`TOTAL FILING FEE’
`(accounting for possible small entity status) ...
`
`$
`
`80.00
`
`Page3 of 67
`
`3SHAPE 1021
`
`3ShapevAlign
`
`IPR2021-01383
`
`Page 3 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`Page 2
`
`Docket No. 26211PRO
`
`X
`
`Reduced by one-half, as applicant(s) is/are a "small entity".
`
`12. Sheets of Drawing(s)
`
`is/are attached.
`
`X
`
`The
`80.00.
`Submitted herewith is a check in the amount of $
`Commissioner is hereby authorized to charge any deficiency or
`credit any excess to Deposit Account No. 14-0112.
`
`Respectfully submitted,
`
`NATH & ASSOCIATES PLic
`
`Seefiat
`
`Registration No. 26,965
`Marvin C. Berkowitz
`Registration No. 47,421
`Customer No. 20529
`
`Date: June 17, 2004
`
`NATH & ASSOCIATES PLLC
`1030 15™ Street NW - 6Floor
`Washington, D.C. 20005
`(202) -775-8383
`GMN/MCB/ng: ProvAp_CoverSheet
`
`Page 4 of 67
`
`3SHAPE 1021
`
`3ShapevAlign
`
`IPR2021-01383
`
`Page 4 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`-l-
`
`METHOD AND APPARATUS FOR COLOUR IMAGING A THREE-
`
`DIMENSIONAL STRUCTURE
`
`FIELD OF THE INVENTION
`
`The presentinvention relates to optical scanners, particularly for providing
`
`a digital
`representation of three-dimensional objects including color. The
`invention finds particular application in the surveyingofthe intraoral cavity.
`
`10
`
`BACKGROUND OF THE INVENTION
`
`Many methods have been developed for obtaining the three dimensional
`
`location of surface points of an object, for a host of applications including, inter
`
`alia, the intraoral cavity. Techniques for direct non-contact optical measurement,
`
`in particular for direct optical measurementof teeth and the subsequent automatic
`
`15
`
`manufacture of dentures, are known. The term “direct optical measurement”
`
`signifies surveying of teeth in the oral cavity of a patient. This facilitates the
`
`obtainment of digital constructional data necessary for the computer-assisted
`
`design (CAD) or computer-assisted manufacture (CAM) of tooth replacements
`
`20
`
`without having to make any cast impressionsof the teeth. Such systems typically
`include an optical probe coupled to an optical pick-up or receiver such as charge
`coupled device (CCD) anda processor implementing a suitable image processing
`
`technique to design and fabricate virtually the desired product. Such methods
`
`include, for example, confocal imaging techniques as described in WO 00/08415
`
`three-
`assigned to the present assignee. These methods provide a digital
`dimensional surface model
`that
`is inherently monochromatic,
`i.e., no color
`
`25
`
`information is obtained in the imaging process.
`
`information with three-dimensional objects is not
`Associating color
`straightforward, particularly when the position information is obtained by using a
`three dimensional scanning method, while the color information is obtained by
`using a two dimensional scanning method. The problem of conformally mapping
`
`30
`
`01516806\4-03
`
`Page 5 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 5 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`-2-
`
`the two dimensional color information onto the three dimensional surface model
`
`is difficult and it is common for mismatching of the color with three-dimensional
`
`points to occur. Essentially, where two-dimensional color detectors are used for
`
`obtaining the color information,
`
`it
`
`is difficult
`
`to accurately associate color
`
`information from the detectors with the correct points on the three dimensional
`
`surface model, particularly where relative movement between the object and the
`
`device occurs between the acquisition of the three-dimensional topological data
`
`and acquisition of the two-dimensional imagedata.
`
`EP 837 659 describes a process and device for obtaining a three
`
`10
`
`dimensional image of teeth. Three-dimensional surface data is obtained by first
`
`covering the surface with an opaque, diffusely reflecting material, and the object
`
`is illuminated with monochromatic light. The image of the object underthe layer
`
`is obtained by the process described in US 4,575,805 using intensity pattern
`
`techniques. In order to obtain a two-dimensional color image of the object, the
`
`15
`
`reflecting layer has to be removed. The method thus requires the camera to be
`
`manually re-aligned so that the two-dimensional color image should moreorless
`
`correspond to the same part of the object as the three dimensional image. Then,
`
`the three dimensional image may be viewed on a screen as a two-dimensional
`
`image, and it is possible to superimpose on this two-dimensional image the two-
`
`20
`
`dimensional color imageof the teeth taken by the camera.
`
`US 6,594,539 provides an intraoral imaging system that produces images
`
`of a dental surface, including three dimensional surface images and also two
`
`dimensional color images, with the same camera.
`
`In 5,440,393,
`
`the shape and dimensions of a dental patients mouth cavity
`
`25
`
`including upper and lowertooth areas and the jaw structure, are measuredby an optical
`
`scanner using an external radiation source, whose reflected signals are received
`
`externally and converted into electronic signals for analysis by a computer. Both surface
`
`radiation and reflection from translucent internal surfaces are scanned, and processing
`
`of reflections may involvea triangulation system or holograms.
`
`30
`
`In US 5,864,640, a scanner is described having a multiple view detector
`
`responsive to a broad spectrum ofvisible light. The detector is operative to develop
`
`01516806\4-03
`
`Page 6 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 6 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`several images of a three dimensional object to be scanned. The imagesare taken from
`several relative angles with respect to the object. The images depict several surface
`
`portions of the object to be scanned. A digital processor, coupled to the detector,
`
`is
`
`responsive to the images and is operative to develop with a computational unit 3-D
`
`coordinate positions and related image information of the surface portions of the object,
`
`and provides 3-D surface information that is linked to color information without need to
`
`conformally map 2-D color data onto 3-D surface.
`
`Of general background interest, US 4,836,674, US 5,690,486, US
`
`6,525,819, EP 0367647 and US 5,766,006 describe devices for measuring the
`
`10
`
`color of teeth.
`
`15
`
`SUMMARYOF THE INVENTION
`
`In accordance with the present
`
`invention, a device and method for
`
`determining the surface topology and colour of at least a portion of a three
`
`dimensional structure is provided. Preferred non-limiting embodiments of the
`
`invention are concerned with the imaging of a three-dimensional topology of a teeth
`
`20
`
`segment, optionally including such where one or moreteeth are missing. This may
`
`allow the generation of data for subsequent use in design and manufactureof, for
`
`example, prosthesis of one or more teeth for incorporation into said teeth segment.
`
`Particular examples are the manufacture of crowns, bridges dental restorations or
`
`dental filings. The colour and surface data is provided in a form that is highly
`
`25
`
`manipulable and useful in many applications including prosthesis colour matching
`
`and orthodontics, among others.
`
`The determination of the 3D surface topology of a portion of a three-
`
`dimensional structure is preferably carried out using a confocal focusing method,
`
`30
`
`comprising:
`
`01516806\4-03
`
`Page 7 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 7 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`a
`
`-4-
`
`providing an array of incident light beams propagating in an optical path
`(a)
`leading through a focusing optics and a probing face; the focusing optics defining
`one or more focal planes forward said probing face in a position changeable by said
`optics, each light beam having its focus on one of said one or more focal plane; the
`beams generatingaplurality of illuminated spots onthestructure;
`(b)
`detecting intensity of returned light beams propagating from each of these
`spots along an optical path opposite to that of the incidentlight;
`(c)
`repeating steps (a) and (b) a plurality of times, each time changingposition
`of the focal planerelative to the structure; and
`
`10
`
`15
`
`20
`
`25
`
`for each of the illuminated spots, determining a spot-specific position,
`(d)
`being the position of the respective focal plane, yielding a maximum measured
`intensity of a respective returned light beam; and
`based on the determined spot-specific positions, generating data representative of
`the topology ofsaid portion.
`
`The determination of the spot-specific positions in fact amounts to
`determination of the in-focus distance. The determination of the spot-specific
`position may be by measuringthe intensity per se, or typically is performed by
`measuring the displacement (S) derivative of the intensity (I) curve (dI/dS) and
`determining the relative position in which this derivative function indicates a
`maximum intensity. The term ‘“‘spot-specific position (SSP)” will be used to
`denote the relative in-focus position regardless of the manner in which it is
`determined. It should be understood that the SSP is always a relative position as
`the absolute position depends on the position of the sensing face. However the
`generation of the surface topology does not require knowledge of the absolute
`position, as all dimensions in the cubic field of view are absolute.
`
`The SSP for each illuminated spot will be different for different spots. The
`position of each spot in an X-Y frame of reference is known and by knowingthe
`relative positions of the focal plane needed in order to obtain maximum intensity
`(namely by determining the SSP) , the Z or depth coordinate can beassociated with
`
`01516806\4-03
`
`Page8 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 8 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`a
`
`-5-
`
`each spot and thus by knowing the X-Y-Z coordinates of each spot the surface
`
`topology can be generated.
`
`In order to determine the Z coordinate (namely the SSP) of each illuminated
`
`spot the position of the focal plane may be scannedoverthe entire range of depth or
`
`Z component possible for the measured surface portion. Alternatively the beams
`
`may have components, each of which has a different focal plane. Thus, by
`
`independent determination of SSP for the different light components, e.g. 2 or 3
`
`with respective corresponding 2 or 3 focal planes, the position of the focal planes
`
`may be changed by the focusing optics to scan only part of the possible depth
`
`10
`
`range, with all
`
`focal planes
`
`together covering the expected depth range.
`
`Alternatively, the determination of the SSP may involve a focal plane scan of only
`
`part of the potential depth range and for illuminated spots where a maximum
`
`illuminated intensity was not reached, the SSP is determined by extrapolation from
`
`the measured values or other mathematical signal processing methods. Thus, in
`
`15
`
`each case, a Z-value is obtained for each point along an X-Y grid representing a
`
`plurality of light beams. In this manner, a three-dimensional (3D) numerical entity
`
`E maybecrated, comprising a plurality of coordinates (X, Y, Z) representative of
`
`the surface topology of the object being scanned.
`
`Alternatively, any other suitable method may be employedto obtain the 3D
`entity E.
`
`20
`
`According to the present invention, a two dimensional (2D) colour image of
`
`the 3D structure that is being scanned is also obtained, but typically within a short
`
`time interval with respect to the 3D scan. Further, the 2D colour image is taken at
`
`substantially the same angle and orientation with respect to the structure as was the
`
`25
`
`case when the 3D scan was taken. Accordingly, there is very little or no substantial
`
`distortion between the X-Y plane of 3D scan, and the plane of the image,i.e., both
`
`planes are substantially parallel, and moreoversubstantially the same portion of the
`
`structure should be comprised in both the 3D scan and the 2D image. This means
`
`that each X-Y point on the 2D imagesubstantially corresponds to a similar point on
`
`30
`
`the 3D scan having the samerelative X-Y values. Accordingly, the same point of
`
`015 16806\4-03
`
`Page 9 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 9 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`aj
`
`-6-
`
`the structure being scanned has substantially the same X-Y coordinates in both the
`2D image and the 3D scan, and thus the colour value at each X, Y coordinate of the
`2D colour scan may be mapped directly to the spatial coordinates in the 3D scan
`having the same X, Y coordinates, wherein to create a numerical entity I
`representing the colour and surface topology ofthe structure being scanned.
`Where the X,Y coordinates of the colour image do not precisely correspond
`to those of the 3D scan, for example as may arise where one CCD is for the 3D
`scanning, while another CCDis used for the 2D colour image, suitable interpolation
`methods may be employed to mapthe colour data to the 3D spartial data.
`To provide a more accurate mapping, it is possible to construct a 2D image
`along the X-Y plane of the 3D model, and using procedures such as optical
`recognition, manipulate the colour 2D image to best fit over this 3D image. This
`procedure may be used to correct for any slight misalignment between the 2D
`colour scan and the 3D scan. Once the colour 2D image has been suitably
`manipulated,
`the colour values of the colour 2D image are mapped onto the
`adjusted X-Y coordinates ofthe 3D scan.
`Thus the present invention providesa relatively simple andeffective way for
`mapping 2D colourinformation onto a 3D surface model.
`
`10
`
`15
`
`The present invention thus provides a device and method for obtaining a
`numerical entity that represents the colour and surface topology of an object. When
`applied particularly to the intraoral cavity, the device of the invention provides
`advantages over monochrome 3D scaners, including such scanners that are based
`on confocal focusing techniques. For example, the 2D colour image capability on
`its own enables the dental practitioner to identify the area of interest within the oral
`cavity with a great degree of confidencein order to better aim the device for the 3D
`scanning.
`In other words, an improved viewfinder is automatically provided.
`Further, rendition of a full colour 3D image of the target area can help the
`practitioner to decide on the spot whetherthe scan is sufficiently good, or whether
`there are still parts of the teeth or soft tissues that should have been included, and
`
`20
`
`25
`
`30
`
`01516806\4-03
`
`Page 10 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 10 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`at
`
`‘
`
`-7-
`
`thus help the practitioner to deciode whether or not to acquire another 3D colour
`
`entity.
`
`Creation of a colour 3D entity that
`
`is manipulable by a computer is
`
`extremely useful in enabling the practictioner to obtain data from such an entity that
`
`is useful for procedures carried outin the dental cavity.
`
`Thus, according to the present
`
`invention, a device is provided for
`
`determining the surface topology and associated color of at least a portion of a
`
`three dimensional structure, comprising:
`
`scanning means adapted for providing depth data of said portion
`
`10
`
`corresponding to a two-dimensional reference array substantially orthogonal to a
`
`depth direction;
`
`imaging means adapted for providing two-dimensional color image data
`
`of said portion associated with said reference array;
`
`wherein the device is adapted for maintaining a spatial disposition with
`
`15
`
`respect
`
`to said portion that
`
`is substantially fixed during operation of said
`
`scanning meansand said imaging means.
`
`The is adapted for providing a time interval between acquisition of said
`
`depth data and acquisition of said color image data such that substantially no
`
`significant relative movement between said device and said portion occurs. The
`
`20
`
`time interval may be between about 0 seconds to about 100 milliseconds, for
`
`example 50 milliseconds.
`
`The device further comprise processing means for associating said color
`
`data with said depth data for corresponding data points of said reference array. In
`
`described embodiments,
`
`the operation of said scanning means is based on
`
`25
`
`confocal imaging techniques. Such scanning means may comprise:
`
`a probing memberwith a sensing face;
`
`first illumination means for providing a first array of incident light beams
`
`transmitted towardsthe structure along an optical path through said probing unit to
`
`generate illuminated spots on said portion along said depth direction, wherein said
`
`30
`
`first array is defined within said reference array;
`
`01516806\4-03
`
`Page 11 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 11 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`a)
`
`-8-
`
`a light focusing optics defining one or more focal planes forward said
`probing face at a position changeable by said optics, each light beam having its
`focus on oneof said one or more focal plane;
`a translation mechanism for displacing said focal plane relative to the
`structure along an axis defined by the propagation ofthe incident light beams;
`a first detector having an array of sensing elements for measuring intensity
`of each ofa plurality of light beams returning from said spots propagating through
`an optical path oppositeto that of the incident light beams;
`a processor coupled to said detector for determining for each light beam a
`spot-specific position, being the position of the respective focal plane of said one or
`more focal planes yielding maximum measuredintensity of the returned light beam,
`and based on the determined spot-specific positions, generating data representative
`
`of the topology of said portion.
`
`The first array is arranged to provide depth data at a plurality of
`predetermined spatial coordinates substantially corresponding to the spatial
`disposition of said incidentlight beams.
`The first illumination means comprises a source emitting a parent light
`beam and a beam splitter for splitting the parent beam into said array of incident
`light beams. Thefirst illumination means may comprise a grating or microlens
`
`array.
`
`The device may comprise a polarizer for polarizing said incident light
`beams are polarized. Further, the device may comprise a polarization filter for
`filtering out
`from the returned light beams light components having the
`polarization of the incident light beams.
`The illumination unit may comprise at least two light sources and each of
`said incident beams is composedof light components from the at least two light
`sources. Theat least two light sources emit each a light componentof different
`wavelength. The light directing optics defines a different focal plane for each
`
`10
`
`15
`
`20
`
`25
`
`01516806\4-03
`
`Page 12 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 12 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`-9-
`
`light component and the detector independently detects intensity of each light
`
`components.
`Theat least two light sources maybe located so as to define optical paths
`of different lengths for the incident light beams emitted by each of the at least
`
`two light sources.
`Typically, the focusing optics operatesin a telecentric confocal mode.
`Optionally, the light directing optics comprises opticalfibers.
`Typically, the sensing elements are an array of charge coupled devices
`(CCD). The detector unit may comprise a pinhole array, each pinhole
`corresponding to one of the CCDsin the CCDarray.
`
`The operation of said imaging means may bebasedon:
`illuminating said portion with three differently-colored illumination
`radiations, the said illuminations being combinableto provide whitelight,
`capturing a monochromatic image of said portion corresponding to each
`said illuminating radiation, and
`combining the monochromatic imagesto create a full color image,
`wherein each said illuminating radiation is provided in the form of a
`second array of incident light beams transmitted towards the portion along an
`optical path through said probing unit to generate illuminated spots on said
`portion along said depth direction, wherein said second array is defined within
`said reference frame.
`
`The second array is arranged to provide color data at a plurality of spatial
`coordinates substantially corresponding to the spatial coordinates of said first
`array. The device may comprise colorillumination means adapted for providing
`three second illuminating radiations, each of a different color. The color
`illumination means comprises secondillumination means for providing said three
`secondilluminating radiations, each of a different color. Alternatively, the color
`illumination means comprises second illumination means for providing two said
`
`01516806\4-03
`
`10
`
`15
`
`20
`
`25
`
`30
`
`Page 13 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 13 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`-10-
`
`illumination means
`second illuminating radiations, and wherein said first
`provides anothersaid secondilluminating radiation each said second illuminating
`radiation being of a different color. Optionally, each one of said second
`illumination radiations is a different one of red, green or blue light. The second
`illumination means may comprise radiation transmission elements that are
`configured to be located out of the path of said light beams or said returnedlight
`beam at least within said light focusing optics. The probing member may be
`made fromalight transmissive material having an upstream optical interface
`with said light focusing optics and a reflective face for reflecting light between
`said optical interface and said sensing face. The second illumination means may
`be optically coupled to said optical
`interface for selectively transmitting
`illuminating radiations in at least two colors to said portion via said sensing face.
`The color illumination means may comprise second illumination means for
`providing two said second illuminating radiations, and wherein said first
`illumination means provides another said second illuminating radiation each said
`second illuminating radiation being of a different color. The probing member
`may comprise a removable sheath having an inner
`surface substantially
`complementary to an outer surface of said probing member, and having a
`window in registry with said sensing face, wherein said sheath is made from a
`waveguiding material and is adapted to transmit said light from said second
`illuminating means from an upstream face thereof to a downstream face
`associated with said window. The secondillumination means may be optically
`coupled to said upstream face
`for
`selectively transmitting said second
`illuminating radiations in at least two colors to said portion via said downstream
`face. Preferably, the sheath is disposable after use with a patient.
`In another embodiment, the reflective face comprises a dichroic coating,
`having relatively high reflectivity and low optical transmission properties for a
`said second illuminating radiation provided bysaid first illumination means, and
`relatively low reflectivity and high optical transmission properties for the two
`said second illuminating radiations provided by said second illumination means.
`
`30
`
`01516806\4-03
`
`Page 14 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`10
`
`15
`
`20
`
`25
`
`Page 14 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`at
`
`-11-
`
`The second illumination means may be adapted for providing second
`illuminating radiations within said light focusing optics. In particular, the second
`illumination means may be adapted for providing second illuminating radiations
`at an aperture stop plane of said light focusing optics. The second illumination
`means may be provided on a bracket having an aperture configuredto allow said
`light beams and said returning light beams to pass therethrough without being
`optically affected by said bracket.
`The device may comprise a mirror inclined to the optical axis of said light
`focusing optics and having an aperture configured to allow said light beams and
`said returning light beams to pass therethrough without being optically affected
`by said mirror, and wherein said secondillumination means comprises at least
`one white illumination source optically coupled with suitable color filters, said
`filters selectively providing illumination radiation in each color in cooperation
`with said white illumination source, wherein said mirror is coupled to said white
`i!lumination source to direct radiation therefrom along said optical axis. The
`white illumination source may comprise a phosphorus InGaN LED. The filters
`may be arranged on sectors of a rotatable disc coupled to a motor, predetermined
`selective angular motionof said disc selectively couples said white illumination
`source to each saidfilter in turn.
`Optionally, the second illumination means are in the form of suitable
`LED's, comprising at least one LED for providing illumination radiation in each
`color. Optionally, the second illumination means are in the form of suitable
`LED's, comprising at least one white illumination source optically coupled with
`suitable color filters, said filters selectively providing illumination radiation in
`each color in cooperation with said white illumination source. The white
`illumination source may comprise a phosphorus InGaN LED.Thefilters may be
`arranged on sectors of a rotatable disc coupled to a motor, predetermined
`selective angular motion of said disc selectively couples said white illumination
`source to each said filter in turn. The device may further comprise a plurality of
`
`10
`
`15
`
`20
`
`25
`
`30
`
`01516806\4-03
`
`Page 15 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 15 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`a)
`
`-12-
`
`optical fibers in optical communication with said filters and with radiation
`
`transmission elements comprised in said secondillumination means.
`
`The first detector is adapted for selectively measuring intensity of each
`
`said second illuminating radiation after reflection from said portion.
`
`Alternatively,
`
`the operation of said imaging means
`
`is based on
`
`illuminating said portion with substantially white illumination radiation, and
`
`capturing a color image of said portion, wherein said white illuminating radiation
`is provided in the form of a second array of incident light beams transmitted
`
`10
`
`towards the portion along an optical path through said probing unit to generate
`
`illuminated spots on said portion along said depth direction, wherein said second
`
`array is defined within said reference frame. The second array is arranged to
`
`provide color data at a plurality of spatial coordinates substantially corresponding
`
`to the spatial coordinates of said first array. The imaging means comprises:-
`
`15
`
`white illumination radiation means;
`
`second detector having an array of sensing elements for measuring
`intensity of said white illuminating radiation after reflection from said portion.
`
`Alternatively,
`
`the operation of said imaging means
`
`is based on
`
`20
`
`illuminating said portion with substantially white illumination radiation,
`
`selectively passing radiation reflected from said portion through a number of
`color filters, capturing a monochromatic image of said portion corresponding to
`each saidfilter, and combining the monochromatic imagesto create a full color
`
`image, wherein said illuminating radiation is provided in the form of a second
`
`25
`
`array of incident light beams transmitted towards the portion along an optical
`path through said probing unit to generate illuminated spots on said portion along
`said depth direction, wherein said second array is defined within said reference
`
`frame. The second array is arranged to provide color dataat a plurality of spatial
`coordinates substantially corresponding to the spatial coordinates of said first
`
`30
`
`array.
`
`01516806\4-03
`
`Page 16 of 67
`
`3SHAPE 1021
`
`3Shapev Align
`
`IPR2021-01383
`
`Page 16 of 67
`
`3SHAPE 1021 3Shape v Align IPR2021-01383
`
`

`

`-13-
`
`Alternatively,
`
`the operation of
`
`said imaging means
`
`is based on
`
`illuminating said portion with three differently-colored illumination radiations,
`
`capturing a monochromatic image of said portion corresponding to each said
`illuminating radiation, and combining the monochromatic imagesto create a full
`color image, wherein eachsaid illuminating radiation is provided in the form of a
`second array of incident light beam