1111111111111111 IIIIII IIIII 1111111111 11111 1111111111 11111 lllll lllll 111111111111111 11111111
`US 20130110469Al
`
`c19) United States
`c12) Patent Application Publication
`Kopelman
`
`c10) Pub. No.: US 2013/0110469 Al
`May 2, 2013
`(43) Pub. Date:
`
`(54) METHODS AND SYSTEMS FOR CREATING
`AND INTERACTING WITH THREE
`DIMENSIONAL VIRTUAL MODELS
`
`(76)
`
`Inventor: Avi Kopelman, Tenalfy, NJ (US)
`
`(21) Appl. No.:
`
`13/574,723
`
`(22) PCT Filed:
`
`Jul. 19, 2011
`
`(86) PCT No.:
`
`PCT/ILll/00574
`
`§ 371 (c)(l),
`Jan.4,2013
`(2), ( 4) Date:
`Related U.S. Application Data
`
`(60) Provisional application No. 61/365,556, filed on Jul.
`19, 2010.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`G06T 19100
`(52) U.S. Cl.
`CPC ...................................... G06T 19100 (2013.01)
`USPC .............................................................. 703/1
`
`(2006.01)
`
`(57)
`
`ABSTRACT
`
`Systems and methods are provided for modifying a virtual
`model of a physical structure with additional 3D data
`obtained from the physical structure to provide a modified
`virtual model.
`
`33
`
`22
`
`___/10
`
`~RM1
`
`23
`
`20 w
`
`~=
`
`16
`
`26
`
`24
`
`0001
`
`Exhibit 1029 page 1 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 1 of 8
`
`US 2013/0110469 Al
`
`Providing a first three dimensional (3D) virtual model representative
`of a first physical part of a physical structure to a computer system
`~
`~ 4 10
`Displaying a first image on a display operatively connected to said
`computer system, said first image corresponding to said first 3D
`virtual model
`i
`"-----4 20
`Identifying on said first image at least a first image portion thereof by
`interacting with said display
`~ 4 30
`~
`Causing the computer system to modify the first 3D virtual model,
`to delete or remove or replace a first virtual model part of the first
`3D virtual model corresponding to the first image portion by
`applying a corresponding function (i.e., a delete function or a
`remove function or a replace function) to the first image portion via
`interaction with said first image on said display, to provide a
`modified first 3D virtual model, wherein said first virtual model part
`is representative of a first physical portion of the first physical part
`~
`\___4 40
`Providing a second 3D virtual model representative of a second part
`of said physical structure, wherein said second part at least partially
`overlaps said first physical portion of said first physical part of said
`physical structure
`i
`\_45 0
`Registering said second 3D virtual model with respect to said
`modified first 3D virtual model to provide a composite third 3D
`virtual model wherein said first virtual model part is at least partially
`replaced with a corresponding part of said second 3D virtual model
`t
`"----4 60
`Outputting said third 3D virtual model from said computer system.
`.
`Fig. 1
`
`~ 4 70
`
`0002
`
`Exhibit 1029 page 2 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 2 of 8
`
`US 2013/0110469 Al
`
`33
`
`22
`
`~ 1 0
`
`~RM 1
`
`23
`
`20
`
`00
`
`= ~=
`
`16
`
`26
`
`24
`
`Fig. 2
`
`0003
`
`Exhibit 1029 page 3 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 3 of 8
`
`US 2013/0110469 Al
`
`0
`<D
`LO
`
`..-
`
`~ > 0
`
`C<) .
`·-LL
`
`0)
`
`0004
`
`Exhibit 1029 page 4 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 4 of 8
`
`US 2013/0110469 Al
`
`VM1'
`
`DVM1
`
`32
`
`33
`
`DVM2
`
`Fig. 4
`
`Fig. 5
`
`DRM1
`
`RM2
`
`0005
`
`Exhibit 1029 page 5 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 5 of 8
`
`US 2013/0110469 Al
`
`33
`
`VM3
`
`VM1'
`
`Fig. 6
`
`0006
`
`Exhibit 1029 page 6 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 6 of 8
`
`US 2013/0110469 Al
`
`650
`
`620
`
`630
`
`Fig. 7
`
`0007
`
`Exhibit 1029 page 7 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 7 of 8
`
`US 2013/0110469 Al
`
`/RM1
`
`/
`
`/ 700
`
`750
`
`Fig. 8
`
`0008
`
`Exhibit 1029 page 8 of 26
`DENTAL IMAGING
`
`

`

`Patent Application Publication May 2, 2013 Sheet 8 of 8
`
`US 2013/0110469 Al
`
`/
`Providing a first three dimensional (3D) virtual model representative
`of a first part of a physical structure to a computer system
`
`400'
`
`'
`
`I
`
`"'------41 0 I
`•
`Displaying a first image on a display operatively connected to said
`computer system, said first image corresponding to said first 3D
`virtual model
`""-
`I
`420
`Providing a second 3D virtual model representative of a second part
`of said physical structure, wherein said second part at least partially
`overlaps said first part of said physical structure
`~430'
`•
`Displaying said second image on the display, said second image
`corresponding to the second 3D virtual model, and registering said
`second 3D virtual model with respect to said modified first 3D
`virtual model
`t
`~440'
`Marking/identifying on said first image at least a first image portion
`thereof by interacting with said display
`
`i
`
`\___...--4 50'
`
`Causing the computer system to modify the first 3D virtual model, to
`delete or remove or replace a first virtual model part of the first 3D
`virtual model corresponding to the first image portion by applying a
`corresponding function (i.e., a delete function or a remove function or
`a replace function) to the first image portion via interaction with said
`first image on said display, to provide a modified first 3D virtual
`model, and concurrently or subsequently replacing said first virtual
`model part with a corresponding part of said second 3D virtual
`model to provide a composite third 3D virtual model
`
`Outputting said third 3D virtual model from said computer system.
`
`Fig. 9
`
`470'
`
`~ 460 I
`
`0009
`
`Exhibit 1029 page 9 of 26
`DENTAL IMAGING
`
`

`

`US 2013/0110469 Al
`
`May 2, 2013
`
`1
`
`METHODS AND SYSTEMS FOR CREATING
`AND INTERACTING WITH THREE
`DIMENSIONAL VIRTUAL MODELS
`
`FIELD OF THE INVENTION
`
`[0001] This invention relates to computer based methods
`and systems, particularly to computer based methods and
`systems that are useful in dentistry and other fields, and that
`are particularly useful in prosthodontics and/or orthodontics
`in particular.
`
`BACKGROUND OF THE INVENTION
`
`[0002] There are many procedures associated with the intra
`oral cavity in which a precise three-dimensional virtual rep(cid:173)
`resentation of the intra oral cavity can be useful to the dental
`practitioner.
`[0003] Such virtual representations (also referred to inter(cid:173)
`changeably herein as "virtual models", "computer models",
`"3D numerical entities", and so on) enable the practitioner to
`study the intra oral cavity of individual patients via a com(cid:173)
`puter system, in a similar manner to the study of the tradi(cid:173)
`tional physical plaster model. Furthermore, three-dimen(cid:173)
`sional numerical entities of the intra oral cavity also allow the
`practitioner to study methods or approaches when dealing
`with particular dental problems of any given patient, and for
`the design of physical entities, for example prostheses, dental
`brackets, aligners and so on, in relation therewith. For
`example, in prosthodontics, a computer model of a patient's
`teeth may be manipulated to provide machining data to manu(cid:173)
`facture a physical model of the intra oral cavity, and/or to
`design and manufacture a coping and/or a prosthesis, while in
`orthodontics a computer model of a patient's teeth may be
`manipulated to enable a dental appliance, including for
`example orthodontic brackets and/or aligners, to be designed
`and manufactured, and/or for designing a treatment.
`[0004] A parameter used in the design and manufacture of
`a dental prosthesis, such as a crown or bridge, is the finish
`line, or transition boundary between the prosthesis and the
`dental preparation, and this needs to be precisely defined in
`three-dimensions. Obtaining finish line coordinates from a
`computer virtual model is more efficient and often more
`accurate than from a plaster cast, and moreover facilitates the
`production of such a prosthesis, for example via CNC
`machining, rapid prototyping, or other computerised tech(cid:173)
`nologies, if desired.
`[0005] However, it is often the case that when scanning the
`intra oral cavity to obtain 3 D data of the preparation and finish
`line, on which the virtual model is based, part of the finish
`line, and possibly also the shoulder and other parts of the
`preparation, may be obscured by soft tissues such as the gum
`that, no longer being supported by the dental surfaces that
`have been removed, deform to cover at least a part of the finish
`line on the prepared dental site.
`[0006] Additionally or alternatively, part or all of the finish
`line may be obscured by other agents or materials, including,
`for example, accumulation of one or more of saliva, blood,
`lubricant used with a dental drill, debris resulting from work(cid:173)
`ing the dental site, and so on.
`[0007] Similar issues may arise when scanning the intra
`oral cavity to obtain 3D data of the position and orientation of
`a dental implant in relation to the surrounding portions of the
`intra-oral cavity, and in addition the corresponding impres-
`
`sion abutment (also referred to herein as a scanning body)
`may partially obscure part of the intra-oral cavity.
`[0008] Similarly, there are other situations in which a vir(cid:173)
`tual model of a physical item, obtained from scanning the
`physical item, is partially obscured or incomplete, or in which
`part of the physical item needs to be subsequently modified
`after obtaining the virtual model. Such situations would con(cid:173)
`ventionally require a rescanning of the entire physical item,
`and this may involve significant additional time, inconve(cid:173)
`nience and, where the physical item is a part of the body of a
`patient (such as for example the intra oral cavity), this may
`also involve significant patient discomfort.
`
`SUMMARY OF THE INVENTION
`[0009] Herein "intra oral cavity" (also referred to inter(cid:173)
`changeably herein as dental cavity) is taken to include, but not
`be limited to, one or more real teeth and/or one or more
`prosthetic teeth and/or part of one or more real teeth, of one
`jaw or ofbothjaws ofa patient, and/or can also include all the
`real teeth and/or prosthetic teeth in one or both jaws, and/or
`adjacent gingiva and other adjacent objects of the patient,
`and/or can include a physical model or other physical repre(cid:173)
`sentation of one or more or all the real teeth, and/or one or
`more or all of the prosthetic teeth, and/or part of one or more
`or all the real teeth, of one jaw or of both jaws, and/or of
`adjacent gingiva and/or other adjacent objects, of the patient.
`[0010] Herein, "dental material" refers to any material
`associated with dental structures of the intra oral cavity,
`including but not limited to natural dental materials such as
`for example enamel, dentine, pulp, dental roots, and also
`including non-natural dental materials from which items such
`as for example metallic and non-metallic fillings, restora(cid:173)
`tions, crowns, bridges, copings, preparations, and so on, are
`made from.
`[0011] Herein, "dental clinic" refers to the interface
`between a dental practitioner and a patent, and thus includes
`any physical entity, in particular a clinic, in which there is
`interaction between a dental patient and a dental practitioner.
`While "dental practitioner" typically refers to a dentist, doc(cid:173)
`tor or dental technician, it also includes herein all other car(cid:173)
`egivers, including for example dental surgeons, orthodontists,
`prosthodontists, dental assistants or any other caregiver or
`professional that may interact with a dental patient during the
`course of a dental treatment, or that may be involved in
`determining, preparing or providing dental treatment to a
`patient, particularly prosthodontic treatment and/or orth(cid:173)
`odontic treatment. While "dental patient" (also referred to
`interchangeably herein as "patient") typically refers to a per(cid:173)
`son requiring the dental services of a dental practitioner, it
`also includes herein any person regarding whom it is desired
`to create a 3D numerical model of the intra oral cavity thereof,
`for example for the purpose of practicing the same or for
`carrying out research.
`[0012] The term "prosthesis" is herein taken to include any
`restoration and any onlays, such as crowns and bridges, for
`example, and inlays, such as caps, for example, or veneering,
`or any other artificial partial or complete denture.
`[0013] The term "virtual", applied herein with respect to
`models, manipulation of models, and so on, in particular 3D
`virtual models, for example, refers to being created, simu(cid:173)
`lated, manipulated, carried out, and so on by means of a
`CAD/CAM system, a computer, a computer network, or the
`like, i.e., in a computer environment, particularly with refer(cid:173)
`ence to digital dentistry.
`
`0010
`
`Exhibit 1029 page 10 of 26
`DENTAL IMAGING
`
`

`

`US 2013/0110469 Al
`
`May 2, 2013
`
`2
`
`[0014] While the term "preparation" typically refers to the
`stump and including the finish line and shoulder that is left of
`the tooth that is to be replaced by the prosthesis-typically a
`crown-and on which the crown or other prosthesis is to be
`mounted or seated, the term "preparation" herein also
`includes artificial stumps, pivots, cores and posts, or other
`devices that may be implanted in the intraoral cavity in such
`a position or in a position that is optimal for implanting the
`crown or other prosthesis.
`[0015] The term "prosthodontic procedure" refers, inter
`alia, to any procedure involving the intraoral cavity and
`directed to the design, manufacture or installation of a dental
`prosthesis at a dental site within the intraoral cavity, or a real
`or virtual model thereof, or directed to the design and prepa(cid:173)
`ration of the dental site to receive such a prosthesis.
`[ 0016] The term "3 D virtual model" is used herein synony(cid:173)
`mously with digital model, virtual model, 3D virtual model,
`3D model, three dimensional model, 3D numerical entity,
`numerical entity, computer model, 3D computer model,
`dimensional data, 3D digitized data, 3D representation, and
`other such terms, and relates to a virtual representation in a
`computer environment of a real object, such as for example a
`dentition or at least a part of the intraoral cavity, or of a real
`(physical) model thereof, for example of a plaster model or a
`stone model of the dentition or any dental structure. In par(cid:173)
`ticular a virtual dental model is one example of such a 3D
`virtual model of a dental structure.
`[0017] The term "physical part" is used herein, synony(cid:173)
`mously with "real part" to refer to a physical object, in par(cid:173)
`ticular a physical dental object having a real (physical) sur(cid:173)
`face and included but not limited to part or all of the dentition
`of the intraoral cavity including dies, a coping, a prosthesis,
`and so on, or to a physical dental model of part or all of the
`dentition of the intraoral cavity including dies, a coping, a
`prosthesis, and so on.
`[0018] The term "scanning" and its analogues refer to any
`procedure directed at obtaining 3D topographic data of a
`surface, particularly of a dental surface, wherein to provide a
`3D virtual model, and thus includes mechanical-based or
`other contact systems and methods, typically based on 3D
`probes for example, and/or any other non-contact systems
`and methods included but not limited to optical-based sys(cid:173)
`tems and methods and/or radiation-based systems and meth(cid:173)
`ods, including for example confocal-based systems and meth(cid:173)
`ods, for example as disclosed in WO 00/08415, the contents
`of which are incorporated herein in their entirety by refer(cid:173)
`ence, x-ray systems and methods including CT systems and
`methods, laser scanners, ultrasound scanners, and/or indeed
`any other suitable system and method for providing 3D vir(cid:173)
`tual model.
`[0019] The terms "tool" and "machining tool" are taken
`herein interchangeably to include any tool that is adapted for
`material removal, and may include inter alia mechanical tools
`such as drills for example, laser tools such as for example
`laser drills or cutters, ultrasonic tools such as for example
`ultrasonic cutters, and so on. Preferably, the machining paths
`and material removal characteristics of such tools can be
`finely controlled, typically by computer systems or other
`automated means.
`[0020] According to a first aspect of the invention there is
`provided a computer based method for modifying a virtual
`model of a physical structure, comprising:
`[0021]
`(A) displaying an image of said virtual model on
`a display operatively connected to a computer system;
`
`[0022]
`(B) identifying at least a portion of said virtual
`model that is desired to be modified by interacting with
`the displayed image,
`[0023]
`(C) modifying said virtual model by replacing in
`the computer system at least said portion of said virtual
`model with additional 3D data obtained from the physi(cid:173)
`cal structure to provide a modified virtual model.
`[0024] For example, the physical structure can comprise
`any one of an intra-oral cavity of a patient and a physical
`dental model representative of said intra-oral cavity. Addi(cid:173)
`tionally or alternatively, said virtual model includes a first
`three dimensional (3D) virtual model representative of a first
`physical part of the physical structure, and step (A) comprises
`providing to the computer system said first 3D virtual model
`and displaying on said display a first display image corre(cid:173)
`sponding to said first 3D virtual model.
`[0025] For example, step (B) comprises identifying on said
`first display image at least a first display image portion thereof
`by interacting with said display, said first display image por(cid:173)
`tion corresponding to said portion of said virtual model, and
`said portion of said virtual model being representative of a
`first physical portion of said first physical part, and optionally
`step (C) comprises, subsequent to step (B):
`[0026]
`causing the computer system to at least one of
`delete, remove and replace said portion of said virtual
`model by applying a corresponding function, i.e., a cor(cid:173)
`responding computer-implemented function (i.e. a
`delete function, a remove function or a replace function,
`respectively) to said first display image portion via inter(cid:173)
`action with said first display image on said display, to
`provide a modified first 3D virtual model;
`[0027] providing said additional 3D data in the form of a
`second 3D virtual model representative of a second
`physical part of said physical structure, wherein a spatial
`disposition of said second physical part with respect to
`said first physical part is known or determinable;
`[0028] virtually registering said second 3D virtual model
`with respect to said modified first 3D virtual model to
`provide said modified virtual model wherein said por(cid:173)
`tion of said virtual model is replaced with a correspond(cid:173)
`ing part of said second 3D virtual model representative
`of a second physical portion of said second physical part;
`[0029] outputting said modified virtual model from said
`computer system.
`[0030] Alternatively, steps (B) and (C) comprise:
`[0031] providing said additional 3D data in the form of a
`second 3D virtual model representative of a second
`physical part of said physical structure, wherein a spatial
`disposition of said second physical part with respect to
`said first physical part is known or determinable;
`[0032] virtually registering said second 3D virtual model
`with respect to said first 3D virtual model and further
`displaying in said display a second display image corre(cid:173)
`sponding to said second 3D virtual model in registry
`with said first 3D virtual model;
`[0033]
`identifying on said first display image at least a
`first display image portion thereof by interacting with
`said display, said first display image portion correspond(cid:173)
`ing to said portion of said virtual model, and said portion
`of said virtual model being representative of a first
`physical portion of said first physical part;
`[0034]
`causing the computer system to at least one of
`delete, remove and replace said portion of said virtual
`model by applying a corresponding function, i.e., a cor-
`
`0011
`
`Exhibit 1029 page 11 of 26
`DENTAL IMAGING
`
`

`

`US 2013/0110469 Al
`
`May 2, 2013
`
`3
`
`responding computer-implemented function, i.e., a cor(cid:173)
`responding computer-implemented function (i.e. a
`delete function, a remove function or a replace function,
`respectively) to said first display image portion via inter(cid:173)
`action with said first display image on said display, to
`provide said modified virtual model, wherein said por(cid:173)
`tion of said virtual model is replaced with a correspond(cid:173)
`ing part of said second 3D virtual model representative
`of a second physical portion of said second physical part;
`[0035] outputting said modified virtual model from said
`computer system.
`[0036] For example, said first display image is visually
`encoded in a different manner to said second display image to
`facilitate identifying said first display image portion
`[0037] Additionally or alternatively, said second physical
`part at least partially overlaps said first physical portion of
`said first physical part of said physical structure to provide
`data on said spatial disposition of said second physical part
`with respect to said first physical part.
`[0038] Additionally or alternatively, said second physical
`portion of said second physical part spatially corresponds to
`but is topographically different from said first physical por(cid:173)
`tion of said first physical part.
`[0039] Additionally or alternatively, said corresponding
`part of said second 3D virtual model spatially corresponds to
`but is topographically different from said portion of said
`virtual model.
`[0040] Additionally or alternatively, said first virtual model
`part represents a corresponding said first physical part of the
`physical structure, wherein said first virtual model part is
`considered to fail to comply with a predetermined require(cid:173)
`ment therefor. For example, said predetermined requirement
`comprises providing high surface definition of a surface of
`interest in said first physical part of the physical structure. For
`example, at least a part of said surface of interest in said first
`portion of said first physical part was obscured when the said
`first 3D virtual model was created, and wherein said second
`portion of said second physical part corresponds to said first
`portion of said first physical part wherein said at least a part of
`said surface of interest is now unobscured. For example, said
`first portion of said first physical part was obscured with a
`material including one or more of saliva, debris, blood, and
`wherein said second portion of said second physical part
`corresponds to said first portion of said first physical part
`wherein said material has been removed from said surface of
`interest. For example, said first portion of said first physical
`part was obscured with an artifact, and wherein said second
`portion of said second physical part corresponds to said first
`portion of said first physical part wherein said artifact has
`been removed. For example, said artifact comprises an
`impression abutment or any other structure mounted onto a
`dental implant that is embedded in said physical structure.
`[0041] Additionally or alternatively, said predetermined
`requirement comprises providing a surface of interest in said
`first physical part of the physical structure that is configured
`for enabling a prosthesis to be mounted with respect thereto.
`For example, at least a part of said surface of interest in said
`first portion of said first physical part is inadequate for
`enabling a prosthesis to be mounted with respect thereto, and
`wherein said second portion of said second physical part
`corresponds to said first portion of said first physical part
`wherein said at least a part of said surface of interest has been
`physically altered. For example, where said at least a part of
`said surface of interest has been physically altered via a
`
`material removal operation wherein to modify the topology of
`said at least a part of said surface of interest. An example of
`this is where said at least a part of said surface of interest
`comprises a finish line of a tooth onto which it is desired to
`mount the prosthesis, and said finish line is inadequately
`defined in said first portion of said first physical part, but
`where said finish line is adequately defined in said second
`portion of said second physical part.
`[0042] For example, said at least part of said surface of
`interest comprises a preparation surface of a preparation of a
`tooth onto which it is desired to mount the prosthesis, wherein
`in said first portion of said first physical part said preparation
`surface is inadequate for mounting the prosthesis thereto, and
`wherein in said second portion of said second physical part
`said preparation surface is inadequate for mounting the pros(cid:173)
`thesis thereto.
`[0043] Additionally or alternatively, said first virtual model
`part is distorted or deficient and fails to properly represent a
`corresponding said first physical part of the physical struc(cid:173)
`ture.
`[0044] Additionally or alternatively, the method further
`comprises manufacturing a physical dental model of the intra
`oral cavity based on said modified virtual model.
`[0045] Additionally or alternatively, the method further
`comprises designing an orthodontic treatment plan based on
`said modified virtual model.
`[0046] Additionally or alternatively, the method further
`comprises manufacturing a dental aligner based on said
`modified virtual model.
`[0047] Additionally or alternatively, the method further
`comprises manufacturing orthodontic appliances based on
`said modified virtual model.
`[0048] Additionally or alternatively, the method further
`comprises manufacturing a dental prosthesis based on said
`modified virtual model.
`[0049] According to the first aspect of the invention there is
`also provided a computer system configured for modifying a
`virtual model of a physical structure, comprising:
`a display configured for displaying a display
`[0050]
`image of said virtual model and for identifying at least a
`portion of said virtual model that is desired to be modi(cid:173)
`fied responsive to interaction of a user with the displayed
`display image, and further configured for modifying
`said virtual model by replacing in the computer system
`at least said identified portion of said virtual model with
`additional 3D data obtained from the physical structure
`to provide a modified virtual model.
`[0051] For example, the computer system can configured
`for applying a computer implemented method as defined
`above for the first aspect of the invention, mutatis mutandis.
`[0052] According to the first aspect of the invention there is
`also provided a computer readable medium that embodies in
`a tangible manner a program executable for:
`(A) enabling displaying a display image of a vir(cid:173)
`[0053]
`tual model of a physical structure;
`(B) enabling interaction with the displayed dis(cid:173)
`[0054]
`play image to identify at least a portion of said virtual
`model that is desired to be modified
`(C) enabling modifying said virtual model by
`[0055]
`replacing at least said identified portion of said virtual
`model with additional 3D data obtained from the physi(cid:173)
`cal structure to provide a modified virtual model.
`[0056] For example, the program can be configured for
`applying a computer implemented method as defined above
`
`0012
`
`Exhibit 1029 page 12 of 26
`DENTAL IMAGING
`
`

`

`US 2013/0110469 Al
`
`May 2, 2013
`
`4
`
`for the first aspect of the invention, mutatis mutandis. Addi(cid:173)
`tionally or alternatively, the computer readable medium com(cid:173)
`prises any one of optical discs, magnetic discs, magnetic
`tapes, or solid state memory storage.
`[0057] According to a second aspect of the invention there
`is provided a computer based method for modifying a virtual
`model of a physical structure, comprising:
`[0058]
`(A) providing to the computer system said virtual
`model obtained from the physical structure;
`[0059]
`(B) providing to the computer system additional
`3D data obtained from at least a part of the physical
`structure;
`[0060]
`(C) identifying at least one portion of the virtual
`model that is desired to be modified with at least a part of
`said additional 3D data; and
`[0061]
`(D) modifying the virtual model in the computer
`system at least by replacing said at least one identified
`portion of said virtual model with said at least part of
`said 3D data to provide a modified virtual model.
`[0062] For example, step (A) comprises displaying a dis(cid:173)
`play image of said virtual model on a display operatively
`connected to a computer system. For example, step (B) com(cid:173)
`prises displaying a display image of said modified virtual
`model on said display. For example, step (C) comprises iden(cid:173)
`tifying said at least one portion of the virtual model on said
`display. For example, step (C) comprises interacting with said
`display images on said display to thereby replace said corre(cid:173)
`sponding portion of said virtual model with said portion of
`said additional 3D data.
`[0063] Additionally or alternatively, said additional 3D
`data includes at least one portion thereof that corresponds to
`but is different from a corresponding portion of said virtual
`model.
`[0064] For example, said physical structure comprises any
`one of an intra-oral cavity of a patient and a physical dental
`model representative of said intra-oral cavity.
`[0065] Additionally or alternatively, said virtual model
`includes a first three dimensional (3D) virtual model repre(cid:173)
`sentative of a first physical part of the physical structure, and
`step (A) comprises providing to the computer system said first
`3D virtual model and displaying on said display a first display
`image corresponding to said first 3D virtual model. For
`example, the method can comprise identifying on said first
`display image at least a first display image portion thereof by
`interacting with said display, said first display image portion
`corresponding to said portion of said virtual model, and said
`portion of said virtual model being representative of a first
`physical portion of said first physical part.
`[0066] For example, step (C) comprises:
`[0067]
`causing the computer system to at least one of
`delete, remove and replace said portion of said virtual
`model by applying a corresponding function, i.e., a cor(cid:173)
`responding computer-implemented function (i.e. a
`delete function, a remove function or a replace function,
`respectively) to said first display image portion via inter(cid:173)
`action with said first display image on said display, to
`provide a modified first 3D virtual model;
`[0068] providing said additional 3D data in the form of a
`second 3D virtual model representative of a second
`physical part of said physical structure, wherein a spatial
`disposition of said second physical part with respect to
`said first physical part is known or determinable;
`[0069] virtually registering said second 3D virtual model
`with respect to said modified first 3D virtual model to
`
`provide said modified virtual model wherein said por(cid:173)
`tion of said virtual model is replaced with a correspond(cid:173)
`ing part of said second 3D virtual model representative
`of a second physical portion of said second physical part;
`[0070] outputting said modified virtual model from said
`computer system.
`[0071] For example, steps (B) and (C) comprise:
`[0072] providing said additional 3D data in the form of a
`second 3D virtual model representative of a second
`physical part of said physical structure, wherein a spatial
`disposition of said second physical part with respect to
`said first physical part is known or determinable;
`[0073] virtually registering said second 3D virtual model
`with respect to said first 3D virtual model and further
`displaying in said display a second display image corre(cid:173)
`sponding to said second 3D virtual model in registry
`with said first 3D virtual model;
`[0074]
`identifying on said first display image at least a
`first display image portion thereof by interacting with
`said display, said first display i