`
`fa:
`
`Align Ex. 1002 (Part 3 of 3)
`U.S. Patent No. 9,962,244
`
`0701
`
`
`
`
`

`

`
`
`aaa
`
`oe
`
`0702
`
`

`

`i
`
`
`
`0703
`
`
`
`

`

`}3
`
`fea
`
`
`
`0704
`
`
`
`

`

`oe
`
`erry,
`
`fa
`
`PR
`
`0705
`
`
`
`
`
`

`

`
`
`areryodfo
`
`200
`
`
`
`thywast TF
`
`peak:
`
`0706
`
`
`
`
`
`
`

`

`hon
`
`gerry
`
`0707
`
`oe
`
`fa30
`
`
`
`

`

`[9
`
`
`
`
`0708
`
`
`
`

`

`1a}
`
`fo3
`
`0709
`
`
`

`

`
`
`0710
`
`
`

`

`
`
`0711
`
`
`

`

`
`
`0712
`
`
`

`

`worry(0384.
`
`
`
`
`
`0713
`
`
`
`

`

`nS
`tnt
`
`OOT
`
`0714
`
`
`
`

`

`nt
`apt
`iiiiiiiii%
`
`oft
`
`oeoo
`
`oe“or
`¢’A
`
`
`0715
`
`
`
`
`
`
`

`

`SNerrneteeciapingnctanee17a:
`FannernetanentOrbeee
`
`13
`
`at
`
`0716
`
`
`
`
`

`

`PS LWALESAU A
`
`i FS NW &
`
`130~
`
`0717
`
`

`

`PN LALESAU A
`
`ih FS WH &
`
`
`
`0718
`
`

`

`
`
`*
`
`nes
`
`BS
`
`
`
`
`
`
`
`
`
`x xg& £
`
`
`
`“pstmt
`';
`
`Q
`
`: ji; ;i;:\; {i
`
`i
`
`Y a:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`0719
`
`

`

`osCEEEe:oeWe
`
`pepereemnmmmmnennenctti:
`
`OOf
`
`we
`ee
`
`‘;
`
`Swe’
`x*
`
`0720
`
`
`
`
`
`

`

`00¢
`
`saSsnsnassanannanniznancannnnamannacinnn
`
`Janenanacnannnsnnnntenn
`
`Tee
`tnt
`
`Lt
`
`OLT
`
`
`
`0721
`
`
`
`
`
`
`

`

`nS
`tnt
`
`Bee
`
`f
`
`éST
`
`veeerA©
`
`spt
`
`be
`
`0722
`
`
`
`
`
`
`

`

`ops
`
`ieeeEr
`
`
` aeheopp
`
`
`0723
`
`
`

`

`on
`
`1Wee
`
`
`
`“resietened
`
`LLPIESSPLELOLAVLTOIT
`
`Ley
`
`~—ana=2
`
`EEEELEANSONISNSOOOOLATIONIONIANYEE
`
`Sa
`
`0724
`
`
`
`
`
`
`

`

`
`
`*
`
`
`
` SOMAay
`*PNiggSie
`oe
`
`—
`
`
`
`“
`
`
`aoe rr
` SOOM,
`
`Mhitleongyr“thee,
`Aoe-
`
`Ha
`ietein
`
`PAHbiriywr
`
`
`
`
`
`
`
`0725
`
`

`

`
`
`Yili
`
`me
`
`pat
`
`0726
`
`
`
`

`

`ad&
`
`
`
`0727
`
`
`
`

`

`
`
`on
`WR
`
`
`
`0728
`
`

`

`
`
`*
`
`nes
`
`BS
`
`
`
`WEas 0
`
`
`
`0729
`
`

`

`ad&
`
`
`
`0730
`
`
`
`

`

`ad&
`
`
`
`0731
`
`
`
`

`

`
`
`
`12) ERTERSATIONALAPPLIUATIORN PULESHERS ORE THE PAPENT CONOPERATRON PREATY GATT}
`Teermatinaal Bareau.
`ATEEn
`
`CHD bvterdational Pablestion Nunsher
`
`WO 201 2/007003 Al
`
`(19) Warld fuiclicctual Preperty Oraanixetion
`
`id8y hvternational Pablicaion Bade
`{9 Jantary 2012 (PS.€02083)
`
`Qi} laterastional Patent Ctawiication:
`MGIC FRA 1006.05
`
`an,tb tne
`
`Daternadianal Appdications Nworber:
` ISRBy BU
`
`
`MEE SLOPBOD)
`kageNDR.
`74) Agent: HOARERID Acs:
`J3R- E24
`Capnitaipen KL
`
`
`BY)
`
`on
`
`
` SeenRRR.
`
`
`saree
`aae Ville OF
`
`
`
`
`pence
`
`i203 Leteraatinval Filly Pate:
`
`(28) Piling Lancusen:
`AG} Poblicatiia ¢canmaacd:
`iH Priors Dake
`.
`
`Rag Wirga: GOR), Clapsent,
`
`mei; ISIRER, Bae
`
` Fd b
`
`
`
`wed dn aay
`
`
`
`
`iH{
`
`¥7003Al
`WO2012/
`
`
`
`0732
`
`

`

` 4y‘
`
`wo 2012007003ATI
`epee.
`
`
` national search repert dda 28h
`
`SM, TROAR
`Of 8d, OF OMGA, GN, GO,
`
`NORE TOL
`
`GW) MIL, MELNE
`pehitebed:
`
`BOs
`
`0733
`
`

`

`We) 20 1 A/00TH
`
`PETARSOT /BS80R7S
`
`2D madeling of an object using textural features
`
`This invenlion generally relates ta a methad for 3D madaling of an abject
`
`adagied to be inserted In a caviy of a patient ar worn by a patient. More
`
`Fi
`
`particularly,
`
`the invention relates to acquiring digital representations of at
`
`least a part of the lopation where the object is adapted to be arranged.
`
`Designing and modeling of feeth are known In thefield
`
`of dental resteratians.
`
`When @ palienl requires a denial
`
`resioration, such as crows, bridges,
`
`cnothe ot
`
`abuimeris, or implants, the dentist wil prepare ihe teeth e.g. a damaged
`
`iooth is grinded down to make a prenaration where a crown is glued onta, An
`alternative treatment is to insert implants, such as. Wanium screws, into the
`
`jaw of the patient ancl mount crowns or bridges an the implants. After
`
`preoaring the ieeth or
`
`inseriing an implant,
`
`the. dentist can make an
`
`woe SFE
`
`impression of the upper jaw, ihe lower jaw and a bile registration or a single
`
`impression in a doubkesided fray, also known as tiple trays. The
`impressions are sent
`toe
`the denial
`fechricians who memnufacture the
`
`restoraiions @.g. the bridge. The first step to manufacture ihe restoration is
`
`traditionally to cast the uooer and lower denial models from impressions of
`
`20
`
`ihe upper and the lower jaw, respectively. The modele are usually made of
`
`gypsum and oflen aligned Ina denial articulator using the bie registration ip
`simulate the real be ane chewing motion. The dental fechninian builds up
`
`the denis!
`
`restoration inside [he artiquiaior
`
`Jo ensure @ nice visual
`
`appearance and bite functionality.
`
`BY az)
`
`GAD technology for manufacturing dental restorations Is rapidly expanding
`improving qualily, reducing cost and facilitating the possibility io manufacture
`
`in atvactive materiais otherwise not available. The first step in the CAD
`
`manufacturing pracess is to create & 2-dimensional model of the patients
`ieeih, This is traditionally done by SD seanning one or bolh of the denial
`gypsum models. The d-dimensional replicas of {he teeth are imparted info a
`
`0734
`
`

`

`We) 20A/DO TA
`
`PETTDROT /OS00 73
`
`ed
`
`such as a bridgs
`resioraiian,
`GAD pragram, where ihe entire dental
`substructure,
`is designed. The
`final
`restoration 30 design ia
`then
`
`manufactred @g. using a miling machine, SD printer,
`
`raped prototyping
`
`manufacturing or other manufacturing equipment Accuracy requirements for
`
`Fi
`
`the dental restorations. are very high otherwise the dental festoration wil hot
`be visual appealing, filanto the teeth, oguld cause pain or causeinfections.
`
`WOO0CISO35A discloses a commpularimolemented methad for use in creating
`
`a digHal model of an individual component of a patient's denition, ihe method
`
`comarising:
`
`(a) receiving a data set that farms a lhree-cimensional
`
`(3D)
`
`reoresertatian of
`
`ihe
`
`satients dentition:
`
`(6)
`
`applying a conwuter
`
`amplemented test to the dala set to dently data slemenis thal represent
`
`ports of anindividual component of the patient's dentitien; and {c} creating
`
`a digital model. ofthe individual component base upon ite Kentted data
`
`siemenia,
`
`US7S349876 relates ts a system for use In diagnosis and planning treatment
`
`of a humian patient and comprises: a general ourpose computer system
`
`having @ processor and a user interlace: a memory accessible [a sais
`
`genera: purpese scompuler system storing a) @ first set of digital data
`
`2g
`
`image iniormalion obtained from a first
`feapreseriting patient crariofacial
`imaging devins, and b) a senond sef of digital data representing patient
`
`craniofacial image information obtainedfrom a second image device diferent
`
`fram said first image device, said first ancl second seis of data representing
`
`ai {east in part cammon craniGiacial anatomical structures of saicl patient, at
`lgast one of said first and second sets of digital data including data
`
`reoreasenting the external visual appearance or sunace configuration af ihe
`
`face of the pationl, wherein said first and second digital data sets are each
`
`oblained af differant points in fime and are nol captured In a correlated
`
`fashion; and @ sel of carmputer instructions stored on a machine readable
`
`at
`
`storage medium accessible io said general purpase compute system,
`
`0735
`
`

`

`We) 20A/DO TA
`
`PETT/DROT /OS00 73
`
`where Saki sel af insiructians comprises instructionie for causing said
`general ooibuter systeni fo: 1} automatically: andar wih the aid of operator
`
`interaction, superimpose said first set of digital data anc said second sel of
`
`digital data so as io provide 8 composite, combined digital representation of
`
`Fi
`
`said craniciacia! anaiomical structures created from said first and second
`
`digital data seis each obtained at differant poinis in time and not captured in
`
`a correlated fashion iy @ common coardinake system: wherein said set of
`
`instructions comprise instructions for oraating a virtual GD face at least from a
`
`portion of saicl cranidfacial anafomical stuchuras Using an acthre model
`
`matching strategy) 2) display saicl campesits, combined cigital representation
`
`of said craniofacial anatamical structures, Inchucing said virtual 0 Tace, to a
`
`user of said systeny.
`
`webs oF
`
`2g
`
`USEQOS TSaZH0A diacioses systems and methods fo fahricate 2 restorative
`
`prosthesis. The system includes a scanner to ints orally capture color and
`
`transiucenoy information along wilh a three dimensional (30) shape of the
`
`dentition being reconstructed. The sysiem also includes a campute aided
`
`cesign (CAD) module to receive the colar and translucency information and
`
`the 2D shane to render @ color accurate representation of the prosthesis for
`
`review, wherein the color, irangiucency and surface information is combined
`
`i a single digital prescriotion which is e@lactranicaly fansfered fo a
`laboratory or GAD/CAM sysien for fabrication. The sysiem provides the
`capablity for QD shane, color and. translucency characteriatios af the final
`
`prosifesis to be measured and quanitatively compared to the preseribeci
`
`requirernents,
`
`However, f remains a croblern to improve and expand the use of geometrical
`
`dala and textural date ioe patientrelated technology.
`
`0736
`
`

`

`WG202007005
`
`PUTRI S073
`
`Diselased isa method for oD madaiing of & 2D obiset aclanied to be inseried
`
`imor worn by & paheni. where: the method comprises:
`
`- acquiring a 3D digital representation of al least a part of the location whare
`
`Fi
`
`the 3D obiect is adapted te be arranged, where the 3Ddigital represeniation
`cumprises geometrical data of thelocation:
`
`~agquiing a 20 digital representation of at least a part of the lonation where
`
`the object is adapted to be arranged, where Ihe 2D digital representation
`
`comprises fexiural data relating te one or more features of the location:
`
`where & desired coverage of the location is obtained by acqubing each of the
`
`20 digiai
`
`representation comprising textural dala and the 30 digital
`
`readresentation. comprising geanieltical dala fram) one or more diferent
`
`viewpoints relative to ihe Jocation:
`
`- aligning the 2D digital representation comorising textural data and the 30
`
`nee CFE
`
`digital representation comprising geamebical data;
`
`— combining at least & part of the 20 digital reprasentation. comprising textural
`
`data and the SD digits! representation camprising geometrical data ta obtain
`
`a combined 3D digdalpresentation campsinig Goth geomeitncal dala and
`
`textural data of ihe location:
`
`- visualizing the combined 3D representation camorising the geamve}rical data
`
`andthe textural data of the location; anc
`
`- 8D modeling the 3D obleot such that ine madsied 3D object. is adapted ip
`
`he inseried in or worn by a satienl, where said 30 moadeling apnies
`
`information of
`
`the one or more features from the acquired 20. dite!
`
`RS est
`
`representation comprising textural data.
`
`Disclosed is a method for 30 morieling of a SD oblect adanted to be inseanad
`
`in or. warn Dy a patient, whereinthe method comprises the stens of
`
`0737
`
`

`

`We) 20A/DO TA
`
`PETT/DROST /OS00 73
`
`art
`
`- acquinrig & 3D digital representation af al least a part of the location whers
`{he object is adapied to be arranged, where the 3D digital representation
`
`comprises geomelrical data of the location;
`
`Fi
`
`- acquiring. a 20Ddigital represertation of af least a part of the location where
`8
`
`the oblect is adapted ta be arranged, where the
`comprises textural data of {he location:
`where the acquisition of the 20 digital representation comprising fextural data
`
`2D digital representation
`
`and 30 digtal representation comprising geometrical data is performed by
`
`repositioning {he looation and acquisition means relative to each other for
`
`‘GC
`
`obtaining a desired coverage of the location;
`
`least part of the 2D digilal representation
`- allgning and combining at
`comprising fextural data and the 3D digital
`representation camprising
`
`geometrical data to obtain @ combined SD digital representation comprising
`
`both geometrical data and textural data of the fonation,
`
`‘>
`
`+ Weuallging Ihe combined SD representation comprising ihe geamebrcal data
`
`and the textural data of the iouation: and
`
`- applying Bvermation of one or more features from the 28D digital
`representation comprising textural data of the location, when modeling the
`
`aD abject,
`
`iv some embodiments, the lowaiion is automatically repositioned rslalive to
`
`an acquisition urit during the acquisition of the 2D digital representation
`
`comprising textural data and during the acquisiion of
`
`the SD dighal
`
`ragresantatioy comprising geometrical cata, such thal af least one of the
`
`25
`
`digital representations ie acquired aulomatioally yam a number of diferent
`
`viewpoinis and the desired coverage is ablained.
`
`Disclosed is a method for 20 rrodeling of a SD obiect aclaoted to be inserted
`
`ta mt
`
`in or worn Oy a patient wherein the method comprises :
`
`0738
`
`

`

`We) 20A/DO TA
`
`PETT/DROST /OS00 73
`
`g
`
`- acquinrig & 3D digital representation of at least a part af the locaton where
`ihe 30 objectis anapied to be arfanged, where the 30 digital representation
`
`comprises gsomatrical data of the lncation:
`
`- acquiling a 2D digital representation of at least 9 part of ine location where
`
`ihe object is adapted to be arranged, where fhe 2D digital renresentation
`comprises textural dala rlaling fo one or more features of the location;
`
`where a desired coverage af thelocation is obtained by acquiring gach of the
`
`20 digital
`
`representation somorsing fextural deta and the aD dighel
`
`reoreseniation camprising Geomeirioal dala from one or more diferent
`
`veh oo
`
`viewpoints relative to ihe looation:
`
`- aligning the 2D digital representation commiising textural data and the 30
`\
`cigital representation comprising geometrical data; and
`
`- 8D modeling the 42 ablect such that the mudaisd 3D object is adapted to
`
`we CFE
`
`be inseried in or worn by a salient, where said 30 modeling apnles
`
`information of fhe one or more features from the acquired 2D dighal
`
`representation comprising textural data.
`
`iy Some embodiments, af isasi @ part of [he £D digital represaniation
`
`byes cS
`
`comprising Hodurst data and the SD digital
`
`reoraseritation carnprising
`
`geometrical data
`
`are
`
`combined to
`
`obtain
`
`a
`
`combined OO digital
`
`fepreseniahen comprising both geomeirical data and textural data of the
`
`jooation, and where the method comgyises visuallzing the combined 3D
`
`ropreseniaiion comprising the ceormetrioal data and the textural data of the
`
`location,
`
`Disclosed is a system fer 830 modeling of a SD object adapted to be inserted
`
`in ar worn by 8 patient, whereinthe system commisis:
`
`0739
`
`

`

`We) 20 TADO TR
`
`PETY/DROT /OS00 73
`
`~an iurrination unit configured for Huminating at isast pert of a sean volume
`ofthe system:
`
`~ an acquisition unit configured for acguring a 2D digital representation
`
`camorising textural data ard a GD digital
`
`representation comprising
`
`&
`
`geometrical data of a location arranged! in the scan volume;
`
`~ a first digital signal processorunit configured for:
`
`®
`
`@
`
`®
`
`We
`
`analysing the acattred 2D digital
`
`representations and 30 digital
`
`representations,
`
`aligning the 2D digital representation and the 2D digital representation:
`
`and
`
`combining af ieast part of fhe 2D digital representation and the 3D
`
`digital representation fo obtain a combines! GQ digital representation
`
`ooprising both geometrical data and textural data of the incation:
`
`~ @ visualization device for visualizing the combined SD representation
`
`15
`
`earnprsing the geometrical data anc thetextural date of the location: and
`
`- a Second digital signal processor und configured for 3D modeling the 30
`
`object such inet ihe modeled SO object is adapted to be inserted In arwern
`
`by € patient, where said 3D modeling comprises anoiing information from
`
`the acquired 2D digital representation,
`
`20
`
`in ihe context of the present invention, the phrase "scan volume" may referto
`
`the volume In which @ location can be lluminated with light fram fhe light
`
`source(s} and light reflected from the location can be received by the
`
`25
`
`Gamers,
`
`such that
`
`the 2D digital
`
`represeniaiien and the S80 digital
`
`regresanialion can be acquired a! a location arranged in the scan vaiume.
`
`in the context of ihe present Invention, the phrase “applying information of
`
`one or more features from the 2D digital representation” may refer to case
`
`0740
`
`

`

`WG2018007005
`
`PULPAS0I73
`
`where the 2D digtal raprasentatian provides ihe inermatian of the one or
`more features,
`
`Yhe feature may be part of ihe incatinn or defined an the location, a ghysical
`
`model or sn imoression of
`
`ihe location, and the acquired 2D. digital
`
`Fi
`
`fenreseniation comprising fexfurel data niay provide the information of the
`
`aneor more features.
`
`in. the comfext of the praesent invention, the phrases “object” and "SD object”
`
`may be used interchageabiy.
`
`in the. context of the present Invention. the phrases “moedeling™ and “SO
`
`modeling” may be used interchageahly.
`
`A feature having a geometry thal allows the feature to be entified in 2 digital
`
`representation of the lonation may be referred. fo as a geometical feature.
`
`A feature having @ texture thei allows the feature to be identifisd In a digital
`
`ropresentation of the location may be referred to as a lextural feature.
`
`A feature may have & both a geometry and 6 texture. A feature may nus
`
`both besefererredl to. as a geometrical feature and an textural leature when
`
`ihe feature has boih @ geomielry and @ texture that slows the feature to bs
`
`idenified in a digital representation of the location.
`
`The location may be the part or af the part of the patients body where the a0
`
`25
`
`ohiee! adapted to be iInséried nor worn by the patient
`
`in the context of the present invention, (ne phrase “a feature of the incation®
`
`may refer (o-slhuatinys where the feaiure is an integrated pan of inelocation,
`
`such a8.¢.9. fhe margin line ofa tooth ofepared for a restoration, fo-situations
`
`ta mt
`
`where the feature js defined directly on the location, such eg. a part af an
`
`arihodentic applianos ar a line drawn on a patients tesih by a dental
`
`0741
`
`

`

`WG208007005
`
`PULPAS0I73
`
`technician, or situaiions where the feature is defined on a physical model or
`an impression of thé incation, such 88 & line Gfawn on & gdypsom model of a
`
`set of teeth,
`
`Fi
`
`The phrase“the location” may refer to the Jooation lisell. a physical madel of
`
`ihe location or an impression of ihe location, For example may the phrase
`“acquiring @ 2D digital! representation of the location” refer fo the shuation
`
`where @ 2D digital representation is acquired of the location, of a physical
`
`et of thelocation, or of an impression of the location,
`
`The phrase “textural data of the location” may accordingly refer to situations
`
`where the feature having 4 texture is an intearated part of the tocation, ane
`
`where the features ig definad by e.g. @ dental
`
`technician direct or the
`
`ication or on @ physical mode! or an impression of
`
`the location. For
`
`‘5
`
`éxample, one leature may De a colored line drawn on & physical model ol a
`
`set of igeth, where the feature is a boudary of a removable paral denture,
`
`and the texture of ihe feature is the color in which the bouclaryis defined. The
`
`igature is hence not an integrated part of the location, Le. ihe patients mouth,
`
`bul is clefined later on the physinal model.
`
`in the context of the present
`
`20s
`
`invention,
`
`the drawn line may sill be considered to be a leature of the
`
`fogtion.
`
`The 2D digital representation comprising textural data of the localion may
`
`comprise one or more 2D images of the location or of a physical mode! ar an
`
`25
`
` impressian of he location. The ane ar more 2D images may be acquired
`
`framihe same or from diferent viewpairis
`
`relative to the loaation.
`
`The 20 digital renresentation camerisingdural data may he aocuirad from
`the sania wiewponiis as fhe 3D digita readresantation comprising geamietrical
`data, This may allow for a relatively straight fonward alignment of the 2D
`
`ta as
`
`digital representation and the 3D digital representation.
`
`0742
`
`

`

`We) 20 TADO TR
`
`PETY/DRIO /OS00 73
`
`1D
`
`The 2D digital representation comonsing textural data may be acquired from
`viewpoints that are not the same. as the viewpoints from which the 30 digital
`
`reprasentation comprising geometrical data is acquirert.
`
`Fi
`
`A 2D image comprising dala relating to the texture of the location may be
`referred id as a lexiural image or a texlurs image.
`
`Gonsequenty,
`
`i
`
`is an advantage that
`
`features from the 2D digital
`
`repregeniation comprising textural data of @ location can be used for
`
`facittating 3D modeling of an object which le adapted to ke arranged in that
`
`iooation. When using textural data of the location when modeling the ablect,
`
`ihe result of the modeling may be improvedl because different types of dala
`
`are used, whereby dierent tyoas of featuresof fhe lonation can be detected
`
`and sceaunied for in the modeling process of the object.
`
`Texture ig defined as the feel, shane, and look of the surface of the foevation,
`
`thus texture may comprise the smoothness, roughness, sofiness, calor ste.
`
`ef the incation. Texture oan refer im the properties fald and sensations
`
`caused by the external surfaceof the focation received through the sense of
`
`louch. Texture can also be used io describe the feel of non-lactie
`
`sensations. Texture can comorise a patiern, color ar other visual properties
`
`of the surface of the Incation. Thus textural data is data describing the texture
`
`ofthe surface of the locaton,
`
`25
`
`Geometry is defined ag the size, shape, realalive position of features, and the
`properiies of space, and does therefore canosrn lengits, areas and volumes
`
`of the location. Thus geometrical data is data describing the geometry of the
`
`surface of the focatign.
`
`ta mt
`
`The 2D. diglal represeniation. comarising textural data and. the SD digital
`
`representation comprising geometrical data of the location can be acquired
`
`0743
`
`

`

`We) 20 TADO TR
`
`PETT/DRIO /OS00 73
`
`4
`
`from) any vicavoain? By means of repositioning the localion and anquisitien
`
`moans, such as light source and camera used for acquiring the dighal
`
`representations, relative to each other. The repositioning may be performed
`
`automatically using at least a two-axls motion system i-a.g. a scanner. Thus
`
`Fi
`
`the sbanner may comorise a fwo-anis or [hree-axis motion sysiem adapted ta
`
`perform gequisitien sulamaiically of the digital representationis-of the looation
`
`fram any viewpoint
`
`Thus it may be an advantage that the same motion system is used for
`
`raposiicning the location for acquisition of beth geometrical and textural
`dgia. The motion system may be arranged in a 30 scanner info which 3
`
`model cr an impression to be scarmed is placed. The millon. systern may
`
`perform translational and/or relational movement of the medel or impression
`
`or of fhe agcuistion means, Le.
`
`the ght source and/or the camara for
`
`acquiing Me 20 digittel reoreasniatian camprising textural date and the ao
`
`digital reoreseniation comprising geometrical data. Thus the repositioning
`
`may be of the location for which dale are being captured, ¢.3. the model or
`
`ampression, andar the repasiliating may be of the acquisition means, ight
`
`sourpe(s) and camera, Whan having two or three axes in fhe motion syste,
`
`the mociel or immrassion can be scanmed both from the sides and from the
`
`fep,
`
`Adesired coverage of the location may be full caverage of the entire location
`
`orof part of the jonation, or just coverage of a speniic area of ine location. A
`
`cesirad coverage may be obtained by capturing é.g. three or four textural
`
`25
`
`sages, which can then be assembled info a compoaile. textural image. More
`
`or jess textural images may be captured for oblaining a dered caverags.
`
`The
`
`aligning and the
`
`combining may dascibe kaw the two digital
`
`representations, ihe 20 digital representations comonsing geometfical caia
`
`ta mt
`
`and the 2D digital renresenialions comprising lexlural data of the location,
`
`0744
`
`

`

`We) 20 TADO TR
`
`PETT/DRIO /OS00 73
`
`12
`
`are processed in order fa obtain a combined 3D digiial representation
`
`cormonsing fhe geonmetical and the textural data.
`
`Alignment may be defined as the adjustment of a digital representation of 4
`
`Fi
`
`location i relation with another digital representation of the location, such
`inal siuctures of ihe dighal representatians are oginciding. Thus commenor
`
`alike structures of the 3D digital representalian camprising geometnoal data
`
`of the location and the 2Ddigital reprasentation comorising textural data of
`
`the location are aligned.
`
`Alming and canibining the represeniations may iniprove the visualization
`
`and the precision of feature celection,
`
`in the context of the present Invention, he phrase “visualizing the combined
`
`oD representation” may refer to a visuallzetion of af data provicled by the
`
`combined SO representation or to a Weualization of a part of the cata
`
`provided by the combined 30 representation. The weuaiized carnbined 3D
`
`represanitation may hence provide a visualization of the extracted information
`rather
`than all
`the data which can be provided imm the 20 digital
`
`representation.
`
`Applying the information of the one or more textural features of the location,
`
`when modeling the object, can be defined as that whan modeling ihe object
`
`which is adapted In be Inseried, wom of arranged in ine location,
`
`the
`
`information of the textural features of the iocation is used such that the object
`
`25
`
`fis inte the location taking account of the textural feaiuras of the lecalion,
`
`Filling of the object may mean that ihe insertion or wearing of the oblect does
`
`nat cause pain for the patient, ars that the insertion or wear of the object is
`
`aesthetically pleasing.
`
`ta mt
`
`Wuhin dentisiry, modeling of an obiect may comprise modeling of ane ar
`
`more denial reeiarations ar restoration substruoiures, modeling of one or
`
`0745
`
`

`

`We) 20A/DO TA
`
`PETT/DROT /OS00 73
`
`13
`
`mors implariia or immant abuimerita, modeling orthadontio apolianoss or
`modeling orthodontic movement of one or more teeth, modeling a denture,
`
`é.q. a full or parlial fixed ar remavable parlial dantura, or modeling one or
`
`more teeth in a denture.
`
`Fi
`
`Thus ihe modeling may comprise madsling of
`
`restorations, orfhocontic
`
`imelaris, dentures eto. When the GD commuieraidad design
`apglanoss,
`(OAD) modeling cemprises for axampie restorahons, the virtually modelad
`
`restorations, such as crowns and bridges, can ba manufactured by maans of
`
`computer-aided maniiacturing (CAM), and the manufactured resturaiions or
`
`appliance can then eventually be Inseried.inia the patent's mouth by a
`
`gente.
`
`The sieo of applying the information af the one or more features of the
`
`incation when modeiing the object anc othar aiaps of the method may be
`
`performed digitally on a computer and shown on @ user Interface such as a
`
`screen, such thal ihe user of operator obiains a visual representation of the
`
`daia sets and the diferant operations performed on ihe data seis, and the
`oparator can then pavarm, finalize or check the modeling of the abject.
`
`The method may comprise maniiachuing of the modeled 8D object anciar
`
`irsaiment planning of the location using ane or more objects manufactured
`
`by moans of the methad,
`
`Disclosed is also a method of manufacturing €@ S0 object aclapted to be
`
`25
`
`inseried in or warn by a paten!, where the method of manufacturing
`
`eamorises the steps of the methad for 3D madsling of the OD object and a
`step of manufacturing the modeled 3D obiect.
`
`As an alternative to the wording acquiring a cligital renresentation of af least a
`
`as
`
`ta
`
`partof {he location where the object is adapted fo be arranged, the methec
`
`0746
`
`

`

`We) 20 TADO TR
`
`PETY/DRI /OS00 73
`
`i4
`
`may comonise aoquiring a digial renreseniation of ihe looation where ihe
`
`obieel is adapled to -be arranged,
`
`The 2D digtal representation of the location and the 30 medel of he 3D
`
`abject may be by a inangular-based recresantalion, where 3D sunface are
`parameterized by a number of vertices, which ars connected by triangles.
`
`Let
`
`Thus the geomelical
`
`scans ae sutace scans providing a surface
`
`representation. When modeling the abject for filing inte the fooation, His thus
`
`ihe modeling is
`the object which Is being modeled, or
`the surface of
`performed on the surface of the abject or outside the surface of the abject.
`
`Q
`
`For performing modeling cuiskie the surfgoa, ar offset of the surface may be
`
`mace. digitally.
`
`In the offset a copy of the surface is. placed! a distance irom
`
`the surface, Such that modeling can be performed on a shape similar to the
`
`surface shape, but without mocieling the object surface lisel,
`
`ineg OT sears, a valume is scarimad and thus a volumetric representation
`and not a surlace representation is made.
`
`reeds ESE
`
`WOOTS935 described above disoiases a method of obtaining data sets that
`
`fonvie SD representations. of the patien!’s denilion and io identify date
`
`alemants
`
`representing
`
`individual
`
`components, where
`
`the
`
`individual
`
`coemagnanit Gan be an individual tooth or gum tissue, Thus that method is
`
`pS ae
`
`concerned with SD representations for identifying 6.q. a Individual tooth and
`
`thus not cancerned with the detection of features of fhe teoth, e.g. detected
`
`frov:
`
`a& 2D represeniation. Fhe method is used for creating onthodantic
`
`appliances to implement a reatmernt plan.
`
`US7234937 deseribed abave discloses a syste for storing and combining
`
`aierent data representations of craniofacial image information of a catent
`
`including esternal visual anpearance or surface configuration of the face of
`
`ihe patient for creating a virlual 30 face. Thus iis documert relates to
`
`0747
`
`

`

`We) 20A/DO TAD
`
`PETT/DRTT /OS00 73
`
`wset
`
`qwaniolanial
`
`image mNvfarmation, and the dooument does for sxamole not
`
`disclose using informmalion of heatunss ar mddeding of an abject.
`
`in US2OG391SSZH0A alsa described ahove,
`
`the color and transiucency
`
`Fi
`
`infaymation and the 3D shape is used to render a culor gocurate
`
`representation of the prosthesis for review, such that the user can review
`
`whether the color of the prosthesis is correct.
`
`US2004 1U7080 relates to maniwwacture of sar pleces and discloses a method
`
`woke, cs
`
`for camputer-asaisied madaliing of customised eargiaces cornprising at least
`
`one Oak being individually matched fo an auchory oarial and/or a meatus,
`
`where {fe method comprises a number of steps including the step of: al
`
`obtaining athree-clmensicnal computer model, 0O-mocael, of the location, 1.6.
`
`of at least part of Ihe auditory carnal, where ihe 3D-modeil of the location has
`
`web: Fe
`
`an ouler surface, The document also disclases that in some embodiments an
`
`impressian of the ear ar audiiory canal, which Is used to generale fhe 3D
`digital representation of the canal,
`is scanned such thet a texture scan,
`
`including @ colour scan,
`
`is provided, Furthermore,
`
`in scene. ambodimenis
`
`texture marked on the imaression is used for inilel arrangement, anc in some
`
`20
`
`embodiments the method comprises assigning colours and/or texturing fo the
`sunface of the shall, UG2D041 07080 dees far example not discioss thal the
`
`acquisition of tha 20 digital representation comprising textural data and SD
`
`digital
`
`representation comprising geoametrica: data are performed by
`
`automatically repositioning the location and acquisition means relative to
`
`28
`
`each other for obiaining a desired coverage of the locatiun. Furthermore, ihe
`
`cecumuy#t does
`
`not disclose
`
`a
`
`cambined and aligned
`
`3D cigiial
`
`representation.
`
`in-some embodiment, the methed comprises extracting the information af the
`
`20
`
`ong or more features from the 2D digital represeniaiian comprising textural
`oats.
`
`0748
`
`

`

`We) 20 TADO TR
`
`PETT/DRIO /OS00 73
`
`Thus information of the one or more features may be extraoferd before
`applying the information of the features, when modeling the 3D object.
`
`insome embodiments extracting the information of the one or more fealures
`
`Fi
`
`is performed auwomatioally.
`
`Automatically extracting infermatian of ane or more features of Ihe loogtion
`
`may be defined as fhab one or more of the features of the locabon is
`
`auiomatically detected from the 2D digital representation comprising textural
`
`Sata,
`
`The Infarmation ray be exiracted Tram festures that are defied using 4
`
`rather complex paiiern on the location. A feature may for example be defined
`
`using @ closed lonp to mark the scges of the feature and numnbar of
`
`infersenting nes aranged in forn a grid within this ecige. A feature may aise
`
`be defined using a line comprising a number of cisiunct ine segments, Fora
`
`fine comprising a number of disiunct ine segments, the full
`
`line may be
`
`formed by jolning the line seqmerts. This may be realized by estimating the
`
`gradients of neighboring line segmental ihe encs facing each other. When
`
`ihe gradient vectors are subsantialy parallel,
`
`the bvo fine segments are
`
`possibly sections of the same line, and can hence be virtuallyicined, When @
`
`number af intersecting lines form a grid, the gradients of the line segments
`
`between the intersections may be deiermined and the evaluation of the
`
`relative arrangement of ihelines Inthe intersactions may comprise dentfying
`
`the ciferant parts of the intersection from the gradient of the fines batween
`
`25
`
`ihe infersections,
`
`Alleratively, ihe extraction of Information of fhe one or more feat