I 1111111111111111 1111111111 111111111111111 111111111111111 IIIIII IIII IIII IIII
`US010728519B2
`
`c12) United States Patent
`Babayoff
`
`(IO) Patent No.: US 10,728,519 B2
`(45) Date of Patent:
`Jul. 28, 2020
`
`(54) METHOD AND APPARATUS FOR COLOUR
`IMAGING A THREE-DIMENSIONAL
`STRUCTURE
`
`(71) Applicant: ALIGN TECHNOLOGY, INC., San
`Jose, CA (US)
`
`(72)
`
`Inventor: Noam Babayoff, Rishon Le Zion (IL)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2,467,432 A
`2,531,222 A
`
`4/ 1949 Kesling et al.
`11/ l 9 50 Kesling
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`(73) Assignee: ALIGN TECHNOLOGY, INC., San
`Jose, CA (US)
`
`AU
`AU
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by O days.
`
`5/1979
`3031677 A
`7 /1981
`517102 B2
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 16/373,482
`
`(22) Filed:
`
`Apr. 2, 2019
`
`AADR. American Association for Dental Research, Summary of
`Activities, Mar. 20-23, 1980, Los Angeles, CA, p. 195.
`(Continued)
`
`(65)
`
`Prior Publication Data
`
`US 2019/0230336 Al
`
`Jul. 25, 2019
`
`Primary Examiner - Rebecca A Volentine
`(74) Attorney, Agent, or Firm - FisherBroyles, LLP
`
`Related U.S. Application Data
`
`(57)
`
`ABSTRACT
`
`(63) Continuation of application No. 16/270,419, filed on
`Feb. 7, 2019, which is a continuation of application
`(Continued)
`
`(51)
`
`Int. Cl.
`H04N 13115
`G0JB 11125
`
`(2018.01)
`(2006.01)
`(Continued)
`
`(52) U.S. Cl.
`CPC ......... H04N 13115 (2018.05); A61B 1100009
`(2013.01); A61B 1100096 (2013.01);
`(Continued)
`( 58) Field of Classification Search
`None
`See application file for complete search history.
`
`A device for determining the surface topology and associ(cid:173)
`ated color of a structure, such as a teeth segment, includes
`a scanner for providing depth data for points along a
`two-dimensional array substantially orthogonal to the depth
`direction, and an image acquisition means for providing
`color data for each of the points of the array, while the spatial
`disposition of the device with respect to the structure is
`maintained substantially unchanged. A processor combines
`the color data and depth data for each point in the array,
`thereby providing a three-dimensional color virtual model of
`the surface of the structure. A corresponding method for
`determining the surface topology and associate color of a
`structure is also provided.
`
`34 Claims, 11 Drawing Sheets
`
`M
`
`L _ _ _ _ _ _ _ _ _ _ _ _ v _____ .
`41
`
`GRATING OR
`MICROLENS
`ARRAY
`
`38
`
`40
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`US 10,728,519 B2
`Page 2
`
`Related U.S. Application Data
`
`No. 15/175,267, filed on Jun. 7, 2016, which is a
`continuation of application No. 14/755,171, filed on
`Jun. 30, 2015, now Pat. No. 9,404,740, which is a
`continuation of application No. 14/511,091, filed on
`Oct. 9, 2014, now Pat. No. 9,101,433, which is a
`continuation of application No. 14/150,505, filed on
`Jan. 8, 2014, now Pat. No. 8,885,175, which is a
`continuation of application No. 13/868,926, filed on
`Apr. 23, 2013, now Pat. No. 8,675,207, which is a
`continuation of application No. 13/620,159, filed on
`Sep. 14, 2012, now Pat. No. 8,451,456, which is a
`continuation of application No. 13/333,351, filed on
`Dec. 21, 2011, now Pat. No. 8,363,228, which is a
`continuation of application No. 12/770,379, filed on
`Apr. 29, 2010, now Pat. No. 8,102,538, which is a
`continuation of application No. 12/379,343, filed on
`Feb. 19, 2009, now Pat. No. 7,724,378, which is a
`continuation of application No. 11/889,112, filed on
`Aug. 9, 2007, now Pat. No. 7,511,829, which is a
`continuation of application No. 11/154,520, filed on
`Jun. 17, 2005, now Pat. No. 7,319,529.
`
`(60) Provisional application No. 60/580,109, filed on Jun.
`17, 2004, provisional application No. 60/580,108,
`filed on Jun. 17, 2004.
`
`(51)
`
`(2018.01)
`(2018.01)
`(2018.01)
`(2018.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2017.01)
`(2017.01)
`(2006.01)
`(2017.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`Int. Cl.
`H04N 13/207
`H04N 131257
`H04N 131271
`H04N 13/296
`A61B 1/00
`A61B 1106
`A61B 1124
`A61B 11247
`A61B 5100
`A61B 51107
`GOJB 11124
`GOJJ 3102
`GOJJ 3/10
`GOJJ 3/50
`G06T 7112
`G06T 7190
`A61C 9/00
`G06T 7100
`GOIN 21125
`HOJL 271148
`A61C 19104
`G0JJ 3/46
`G0JJ 3/51
`(52) U.S. Cl.
`CPC .......... A61B 110615 (2013.01); A61B 110638
`(2013.01); A61B 110646 (2013.01); A61B
`110676 (2013.01); A61B 110684 (2013.01);
`A61B 1124 (2013.01); A61B 11247 (2013.01);
`A61B 510068 (2013.01); A61B 510088
`(2013.01); A61B 511077 (2013.01); A61B
`511079 (2013.01); A61C 9/0053 (2013.01);
`A61C 9/0066 (2013.01); A61C 19104
`(2013.01); GOJB 11124 (2013.01); GOJB 11125
`(2013.01); GOJJ 3102 (2013.01); GOJJ 310205
`(2013.01); GOJJ 310208 (2013.01); GOJJ
`310216 (2013.01); GOJJ 310218 (2013.01);
`GOJJ 310224 (2013.01); GOJJ 310243
`
`(2013.01); GOJJ 310256 (2013.01); GOJJ 3/10
`(2013.01); GOJJ 3/50 (2013.01); GOJJ 3/501
`(2013.01); GOJJ 3/508 (2013.01); GOIN
`211255 (2013.01); G06T 710012 (2013.01);
`G06T 7112 (2017.01); G06T 7190 (2017.01);
`HOJL 27/14868 (2013.01); H04N 13/207
`(2018.05); H04N 131257 (2018.05); H04N
`131271 (2018.05); H04N 13/296 (2018.05);
`G0JJ 3/462 (2013.01); G0JJ 3/51 (2013.01);
`G06T 2207/10024 (2013.01); G06T
`2207/10028 (2013.01); G06T 2207/30036
`(2013.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2,779,470 A
`3,013,467 A
`3,407,500 A
`3,600,808 A
`3,660,900 A
`3,683,502 A
`3,738,005 A
`3,860,803 A
`3,916,526 A
`3,922,786 A
`3,950,851 A
`3,971,065 A
`3,983,628 A
`4,014,096 A
`4,195,046 A
`4,253,828 A
`4,324,546 A
`4,324,547 A
`4,348,178 A
`4,349,277 A
`4,478,580 A
`4,500,294 A
`4,504,225 A
`4,505,673 A
`4,526,540 A
`4,575,330 A
`4,575,805 A
`4,591,341 A
`4,609,349 A
`4,611,288 A
`4,629,324 A
`4,640,620 A
`4,656,860 A
`4,663,720 A
`4,664,626 A
`4,676,747 A
`4,727,416 A
`4,742,464 A
`4,755,139 A
`4,763,791 A
`4,793,803 A
`4,798,534 A
`4,802,846 A
`4,836,674 A
`4,836,778 A
`4,837,732 A
`4,850,864 A
`4,850,865 A
`4,856,991 A
`4,877,398 A
`4,880,380 A
`4,889,238 A
`4,890,608 A
`4,895,431 A
`4,935,635 A
`4,936,862 A
`4,937,928 A
`4,941,826 A
`4,964,770 A
`
`1/1957 Walters
`12/1961 Marvin et al.
`10/1968 Kesling et al.
`8/1971 Reeve et al.
`5/1972 Andrews et al.
`8/1972 Wallshein et al.
`6/1973 Cohen et al.
`1/1975 Levine et al.
`11/1975 Schudy et al.
`12/1975 Lavin et al.
`4/1976 Bergersen et al.
`7/1976 Bayer
`10/1976 Acevedo et al.
`3/1977 Dellinger et al.
`3/1980 Kesling et al.
`3/1981 Coles et al.
`4/1982 Heidinger et al.
`4/1982 Arcan et al.
`9/1982 Kurz
`9/1982 Mundy
`10/1984 Barrut et al.
`2/1985 Lewis et al.
`3/1985 Yoshii
`3/1985 Yoshii et al.
`7/1985 Dellinger et al.
`3/1986 Hull et al.
`3/1986 Moermann et al.
`5/1986 Andrews et al.
`9/1986 Cain et al.
`9/1986 Duret et al.
`12/1986 Stern
`2/1987 Schmidt
`4/1987 Orthuber et al.
`5/1987 Duret et al.
`5/1987 Kesling et al.
`6/1987 Kesling et al.
`2/1988 Cooper
`5/1988 Duret et al.
`7/1988 Abbatte et al.
`8/1988 Halverson et al.
`12/1988 Martz et al.
`1/1989 Breads et al.
`2/1989 Posca
`6/1989 Lequime et al.
`6/1989 Baumrind et al.
`6/1989 Brandestini et al.
`7/1989 Diamond et al.
`7/1989 Napolitano et al.
`8/1989 Breads et al.
`10/1989 Kesling et al.
`11/1989 Martz et al.
`12/1989 Batchelor et al.
`1/1990 Steer et al.
`1/1990 Tsujiuchi
`6/1990 O'Harra et al.
`6/1990 Walker et al.
`7/1990 Van et al.
`7/1990 Loran et al.
`10/1990 Steinbichler et al.
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,975,052 A
`4,983,120 A
`4,983,334 A
`5,003,166 A
`5,008,743 A
`5,011,405 A
`5,017,133 A
`5,027,281 A
`5,035,613 A
`5,055,039 A
`5,059,118 A
`5,100,316 A
`5,121,333 A
`5,125,832 A
`5,128,870 A
`5,130,064 A
`5,131,843 A
`5,131,844 A
`5,139,419 A
`5,145,364 A
`5,151,609 A
`5,151,856 A
`5,155,558 A
`5,168,386 A
`5,176,517 A
`5,177,556 A
`5,184,306 A
`5,186,623 A
`5,193,124 A
`5,239,178 A
`5,257,203 A
`5,273,429 A
`5,278,756 A
`5,305,430 A
`5,306,144 A
`5,328,362 A
`5,338,198 A
`5,339,154 A
`5,340,309 A
`5,342,202 A
`5,363,159 A
`5,368,478 A
`5,372,502 A
`5,381,224 A
`5,381,236 A
`5,382,164 A
`5,395,238 A
`5,431,562 A
`5,440,326 A
`5,440,393 A
`5,440,496 A
`5,447,432 A
`5,448,472 A
`5,452,219 A
`5,454,717 A
`5,455,899 A
`5,456,600 A
`5,458,487 A
`5,474,448 A
`5,495,429 A
`RE35,169 E
`5,512,036 A
`5,518,397 A
`5,528,735 A
`5,533,895 A
`5,542,842 A
`5,549,476 A
`5,562,448 A
`5,587,912 A
`5,605,459 A
`5,606,459 A
`5,607,305 A
`5,608,529 A
`5,614,075 A
`5,615,003 A
`
`12/1990 Spencer et al.
`1/1991 Coleman
`1/1991 Adell et al.
`3/1991 Girod
`4/1991 Katzir
`4/1991 Lemchen
`5/1991 Miura et al.
`6/1991 Rekow et al.
`7/1991 Breads et al.
`10/1991 Abbatte et al.
`10/1991 Breads et al.
`3/1992 Wildman et al.
`6/1992 Riley et al.
`6/1992 Kesling
`7/1992 Erdman et al.
`7/1992 Smalley et al.
`7/1992 Hi! gers et al.
`7/1992 Marinaccio et al.
`8/1992 Andreiko et al.
`9/1992 Martz et al.
`9/1992 Nakagawa
`9/1992 Raimann
`10/1992 Tannenbaum
`12/1992 Galbraith
`1/1993 Truax et al.
`1/1993 Rioux
`2/1993 Erdman et al.
`2/1993 Breads et al.
`3/1993 Subbarao
`8/1993 Derndinger
`10/1993 Riley et al.
`12/1993 Rekow et al.
`1/1994 Lemchen et al.
`4/1994 Glassner
`4/1994 Hibst
`7/1994 Watson et al.
`8/1994 Wu et al.
`8/1994 Gassler
`8/1994 Robertson et al.
`8/1994 Deshayes et al.
`11/1994 Melvin
`11/1994 Andreiko et al.
`12/1994 Massenet al.
`1/1995 Dixon
`1/1995 Morgan et al.
`1/1995 Stern et al.
`3/1995 Andreiko et al.
`7/1995 Andreiko et al.
`8/1995 Quinn et al.
`8/1995 Wenz et al.
`8/1995 Andersson et al.
`9/1995 Andreiko et al.
`9/1995 Mushabac
`9/1995 Dehoff et al.
`10/1995 Andreiko et al.
`10/1995 Forslund
`10/1995 Andreiko et al.
`10/1995 Komatsu
`12/1995 Andreiko et al.
`2/1996 Craven
`3/1996 Lemchen et al.
`4/1996 Tamburrino
`5/1996 Andreiko et al.
`6/1996 Strasnick et al.
`7/1996 Andreiko et al.
`8/1996 Andreiko et al.
`8/1996 Stern et al.
`10/1996 Mushabac
`12/1996 Andersson et al.
`2/1997 Kuroda et al.
`2/1997 Nakatsuji
`3/1997 Andersson et al.
`3/1997 Hori
`3/1997 Andre, Sr. et al.
`3/1997 Hermary
`
`US 10,728,519 B2
`Page 3
`
`5,621,648 A
`5,645,420 A
`5,645,421 A
`5,655,653 A
`5,659,420 A
`5,661,519 A
`5,675,380 A
`5,675,407 A
`5,683,243 A
`5,690,486 A
`5,692,894 A
`5,702,249 A
`5,725,376 A
`5,725,378 A
`5,730,151 A
`5,733,126 A
`5,737,084 A
`5,737,121 A
`5,740,267 A
`5,742,700 A
`5,749,830 A
`5,754,298 A
`5,759,030 A
`5,766,006 A
`5,784,098 A
`5,788,639 A
`5,793,900 A
`5,799,100 A
`5,800,174 A
`5,823,778 A
`5,847,832 A
`5,848,115 A
`5,857,853 A
`5,864,640 A
`5,866,058 A
`5,878,152 A
`5,879,158 A
`5,880,826 A
`5,880,961 A
`5,880,962 A
`5,912,735 A
`5,934,288 A
`5,951,475 A
`5,957,686 A
`5,964,587 A
`5,971,754 A
`5,975,893 A
`6,015,289 A
`6,019,721 A
`6,026,172 A
`6,044,309 A
`6,049,743 A
`6,057,909 A
`6,059,721 A
`6,061,091 A
`6,062,861 A
`6,068,482 A
`6,081,739 A
`6,097,854 A
`6,099,314 A
`6,123,544 A
`6,137,893 A
`6,148,120 A
`6,152,731 A
`6,179,611 Bl
`6,181,474 Bl
`6,183,248 Bl
`6,190,165 Bl
`6,205,243 Bl
`6,208,788 Bl
`6,217,325 Bl
`6,217,334 Bl
`6,219,461 Bl
`6,222,174 Bl
`6,229,913 Bl
`6,244,861 Bl
`6,262,738 Bl
`6,263,233 Bl
`6,263,234 Bl
`
`4/1997 Crump et al.
`7/1997 Bergersen et al.
`7/1997 Slootsky et al.
`8/1997 Chester et al.
`8/1997 Wakai
`8/1997 Franetzki
`10/1997 Florent
`10/1997 Geng
`11/1997 Andreiko et al.
`11/1997 Zigelbaum
`12/1997 Schwartz et al.
`12/1997 Cooper
`3/1998 Poirier et al.
`3/1998 Wang et al.
`3/1998 Summer
`3/1998 Andersson et al.
`4/1998 Ishihara
`4/1998 Dixon
`4/1998 Echerer et al.
`4/1998 Yoon et al.
`5/1998 Kaneko et al.
`5/1998 Falk
`6/1998 Jung
`6/1998 Murlj acic et al.
`7/1998 Shoji
`8/1998 Zavislan
`8/1998 Nourbakhsh
`8/1998 Clarke et al.
`9/1998 Andersson et al.
`10/1998 Schmitt et al.
`12/1998 Liskow et al.
`12/1998 Little et al.
`1/1999 Van et al.
`1/1999 Miramonti et al.
`2/1999 Batchelder et al.
`3/1999 Sussman
`3/1999 Doyle et al.
`3/1999 Jung
`3/1999 Crump et al.
`3/1999 Andersson et al.
`6/1999 Xu
`8/1999 Avila et al.
`9/1999 Gueziec
`9/1999 Anthony et al.
`10/1999 Sato et al.
`10/1999 Sondhi et al.
`11/1999 Chishti et al.
`1/2000 Andreiko et al.
`2/2000 Holmes
`2/2000 Lewis, Jr.
`3/2000 Honda et al.
`4/2000 Baba et al.
`5/2000 Yahav
`5/2000 Rudischhauser
`5/2000 Van De Poe!
`5/2000 Andersson
`5/2000 Snow et al.
`6/2000 Lemchen
`8/2000 Szeliski
`8/2000 Kopelman et al.
`9/2000 Cleary
`10/2000 Michael
`11/2000 Sussman
`11/2000 Jordan et al.
`1/2001 Everett et al.
`1/2001 Ouderkirk
`2/2001 Chishti et al.
`2/2001 Andreiko et al.
`3/2001 Migdal et al.
`3/2001 Nosov
`4/2001 Chishti et al.
`4/2001 Hultgren et al.
`4/2001 Wallack
`4/2001 Tullis
`5/2001 Nayar
`6/2001 Andreiko et al.
`7/2001 Gibson
`7/2001 Zavislan et al.
`7/2001 Engelhardt et al.
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`US 10,728,519 B2
`Page 4
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`6,276,934 Bl
`6,281,931 Bl
`6,309,215 Bl
`6,315,553 Bl
`6,322,359 Bl
`6,350,120 Bl
`6,362,888 Bl
`6,376,818 Bl
`6,377,298 Bl
`6,382,975 Bl
`6,398,548 Bl
`6,402,707 Bl
`6,414,750 B2
`6,417,917 Bl
`6,420,698 Bl
`6,450,949 Bl
`6,477,403 Bl
`6,482,298 Bl
`6,511,183 B2
`6,519,037 B2
`6,519,359 Bl
`6,522,777 Bl
`6,524,101 Bl
`6,525,819 Bl
`6,525,828 Bl
`6,530,882 Bl
`6,549,288 Bl
`6,554,611 B2
`6,572,372 Bl
`6,575,751 Bl
`6,577,405 B2
`6,594,539 Bl
`6,614,539 Bl
`6,629,840 B2
`6,648,640 B2
`6,697,164 Bl
`6,705,863 B2
`6,722,880 B2
`6,750,873 Bl
`6,765,606 Bl
`6,769,769 B2
`6,788,210 Bl
`6,788,338 Bl
`6,816,625 B2
`6,845,175 B2
`6,937,348 B2
`6,947,582 Bl
`6,958,766 B2
`6,962,289 B2
`6,977,732 B2
`7,010,223 B2
`7,012,700 B2
`7,013,191 B2
`7,062,311 Bl
`7,064,830 B2
`7,068,825 B2
`7,069,186 B2
`7,078,720 B2
`7,086,863 B2
`7,098,435 B2
`7,099,732 B2
`7,110,124 B2
`7,142,312 B2
`7,160,110 B2
`7,161,741 Bl
`7,166,537 B2
`7,205,531 B2
`7,230,725 B2
`7,305,121 B2
`7,319,529 B2
`7,397,505 B2
`7,446,885 B2
`7,456,842 B2
`7,474,307 B2
`7,494,338 B2
`
`8/2001 Rakocz
`8/2001 Tsao
`10/2001 Phan et al.
`11/2001 Sachdeva et al.
`11/2001 Jordan et al.
`2/2002 Sachdeva et al.
`3/2002 Jung
`4/2002 Wilson
`4/2002 Scheele
`5/2002 Poirier et al.
`6/2002 Muhammad et al.
`6/2002 Ernst et al.
`7/2002 Jung
`7/2002 Jung
`7/2002 Dimsdale
`9/2002 Farkas
`11/2002 Eglichi
`11/2002 Bhatnagar et al.
`1/2003 Shimizu
`2/2003 Jung
`2/2003 Nafis
`2/2003 Paulsen
`2/2003 Phan et al.
`2/2003 Delawter et al.
`2/2003 Grosskopf et al.
`3/2003 Farkas
`4/2003 Migdal et al.
`4/2003 Shi sh ti et al.
`6/2003 Phan et al.
`6/2003 Lehmann et al.
`6/2003 Kranz
`7/2003 Geng
`9/2003 Shimizu
`10/2003 Chishti et al.
`11/2003 Rubbert
`2/2004 Babayoff et al.
`3/2004 Phan et al.
`4/2004 Chishti et al.
`6/2004 Bernardini
`7/2004 Iddan
`8/2004 Podoleanu
`9/2004 Huang
`9/2004 Dinev
`11/2004 Lewis, Jr.
`1/2005 Kopelman
`8/2005 Geng
`9/2005 Vilsmeier
`10/2005 Cooper
`11/2005 Vatan
`12/2005 Chen
`3/2006 Thoms
`3/2006 De Groot
`3/2006 Rubbert
`6/2006 Sendai
`6/2006 Giorgianni
`6/2006 Rubbert
`6/2006 Jung
`7/2006 Yamaguchi
`8/2006 Van Der Zel
`8/2006 Mueller et al.
`8/2006 Geng
`9/2006 Jensen
`11/2006 Quadling
`1/2007 Imgrund
`1/2007 Schaack
`1/2007 Jacobsen
`4/2007 Watanabe
`6/2007 Babayoff
`12/2007 Kaufmann
`1/2008 Babayoff
`7/2008 Brehmer
`11/2008 Zabolitzky
`11/2008 Kosolapov
`1/2009 Chishti
`2/2009 Durbin
`
`7,495,778 B2
`7,511,829 B2
`7,538,774 B2
`7,625,335 B2
`7,630,538 B2
`7,679,723 B2
`7,698,068 B2
`7,724,378 B2
`7,751,871 B2
`7,756,327 B2
`7,762,814 B2
`7,936,392 B2
`8,102,538 B2
`8,363,228 B2
`8,400,635 B2
`8,451,456 B2
`8,537,204 B2
`8,675,207 B2
`8,885,175 B2
`9,101,433 B2
`9,404,740 B2
`2001/0046317 Al
`2002/0006217 Al
`2002/0006597 Al
`2002/0010568 Al
`2002/0028418 Al
`2002/0050988 Al
`2002/0057438 Al*
`
`2/2009 Sieckmann
`3/2009 Babayoff et al.
`5/2009 Kunita
`12/2009 Deiclunann
`12/2009 Nishiyama
`3/2010 Schwotzer
`4/2010 Babayoff
`5/2010 Babayoff et al.
`7/2010 Rubbert
`7/2010 Komiya
`7/2010 Van Der Zel
`5/2011 Ng
`1/2012 Babayoff
`1/2013 Babayoff
`3/2013 Inglese
`5/2013 Babayoff
`9/2013 Cho
`3/2014 Babayoff
`11/2014 Babayoff
`8/2015 Babayoff
`8/2016 Babayoff et al.
`11/2001 Kamon
`1/2002 Rubbert
`1/2002 Andreiko et al.
`1/2002 Rubbert
`3/2002 Farag et al.
`5/2002 Petrov et al.
`5/2002 Decker
`
`2002/0091402 Al
`2002/0100884 Al
`2003/0009252 Al
`2003/0031596 Al
`2003/0071194 Al*
`
`7/2002 Feinsod
`8/2002 Maddock
`1/2003 Pavlovskaia et al.
`2/2003 Tanaami
`4/2003 Mueller
`
`GO 1B 11/2509
`356/601
`
`GOlB 11/00
`250/208.1
`
`2003/0107747 Al
`2003/0139834 Al
`2003/0224311 Al
`2003/0231793 Al
`2004/0027450 Al
`2004/0029068 Al
`2004/0107080 Al *
`
`6/2003 Iwasaki
`7/2003 Nikolskiy et al.
`12/2003 Cronauer et al.
`12/2003 Crampton
`2/2004 Yoshino
`2/2004 Sachdeva et al.
`6/2004 Deiclunann ............. A61F 11/08
`703/6
`
`A61C 7/00
`433/24
`
`A61B 5/1077
`348/207.99
`
`7/2004 Geng
`2004/0125205 Al
`7/2004 Pavlovskaia et al.
`2004/0128010 Al
`8/2004 Drowley
`2004/0165097 Al
`2004/0197727 Al* 10/2004 Sachdeva .
`
`2004/0254476 Al
`2005/0055118 Al
`2005/0088529 Al*
`
`12/2004 Quadling et al.
`3/2005 Nikolskiy et al.
`4/2005 Geng
`
`2005/0089213 Al
`2005/0128196 Al
`2005/0225849 Al
`2005/0243330 Al
`2005/0283065 Al
`2006/0017720 Al
`2006/0025692 Al
`2006/0087645 Al
`2006/0098213 Al
`2006/0103854 Al
`2006/0245187 Al
`2007 /0035641 Al
`2007/0194214 Al
`2008/0082000 Al
`2008/0280258 Al
`2011/0199606 Al
`2012/0092678 Al
`2013/0070985 Al
`2013/0243284 Al
`2014/0119622 Al
`2015/0022824 Al
`2015/0164335 Al
`
`4/2005 Geng
`6/2005 Popescu et al.
`10/2005 Gouch
`11/2005 Magarill
`12/2005 Babayoff
`1/2006 Li
`2/2006 Ishihara
`4/2006 Davidson-Sokal
`5/2006 Itoh
`5/2006 Franke
`11/2006 Scott
`2/2007 Yamada
`8/2007 Pfeiffer
`4/2008 Thoms
`11/2008 Wen
`8/2011 Jung
`4/2012 Babayoff
`3/2013 Babayoff
`9/2013 Babayoff
`5/2014 Babayoff
`1/2015 Babayoff
`6/2015 Van et al.
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`US 10,728,519 B2
`Page 5
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2015/0297329 Al
`2016/0295191 Al
`
`10/2015 Babayoff
`10/2016 Babayoff et al.
`
`FOREIGN PATENT DOCUMENTS
`
`AU
`CA
`DE
`DE
`DE
`DE
`DE
`DE
`DE
`DE
`DE
`DE
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`ES
`FR
`FR
`FR
`FR
`GB
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`KR
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`
`6/1994
`5598894 A
`4/1982
`1121955 A
`2749802 Al
`5/1978
`10/1989
`19883810455
`4/1992
`19904034007
`4/1997
`1995136297
`19636354 Al
`3/1998
`5/1999
`1997149974
`7/2000
`69327661 T2
`5/2001
`1999155702
`1/2005
`2003128040
`6/2005
`2003156412
`0091876 Al
`10/1983
`1/1989
`0299490 A2
`0367647 Al
`5/1990
`7 /1990
`0376873 A2
`6/1992
`0490848 A2
`0541500 Al
`5/1993
`7 /1994
`0607295
`8/1995
`0665686
`4/1998
`0837659 Al
`1/2000
`0667753 Bl
`10/2000
`1041378
`12/2000
`0774933 Bl
`5/2001
`0731673 Bl
`11/2002
`1256831
`4/2003
`1301140
`11/2005
`1596158
`1/1980
`463897 Al
`6/1978
`2369828 Al
`3/1991
`2652256 Al
`12/1994
`2707018
`7 /1998
`2758076
`8/1979
`1550777 A
`5/1978
`S5358191 A
`7 /1980
`S5596406
`1/1992
`H0428359 A
`7 /1994
`3321866
`7 /1994
`06201337
`7 /1994
`H03063507
`9/1996
`08508174
`9/1996
`H08508174 A
`1/1997
`H0926312
`11/1997
`H09304685
`9/1998
`Hl0239023
`3/2001
`200182935
`3/2001
`2001066112
`3/2001
`2001074422
`3/2001
`2001082935 A
`1/2004
`2004029537
`2/2004
`2004062093
`8/2004
`2004226072
`10/2004
`2004294097
`10/2005
`2005279028
`10/2007
`100765300
`11/1989
`WO-8911260 Al
`8/1990
`WO-9008512 Al
`4/1991
`9103988
`4/1991
`WO-9104713 Al
`5/1994
`WO-9410935 Al
`2/1997
`9703622
`7 /1998
`9829708
`7 /1998
`WO-9832394 Al
`10/1998
`WO-9844865 Al
`12/1998
`WO-9858596 Al
`WO-0008415 Al * 2/2000
`0066972
`11/2000
`0069358
`11/2000
`0070303
`11/2000
`02056756
`7/2002
`
`A61B 1/00096
`
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`
`WO-02056756 A2
`03052347
`03060587
`03094102
`WO-03105289 A2
`2005059470
`WO-2010145669 Al
`
`7/2002
`6/2003
`7/2003
`11/2003
`12/2003
`6/2005
`12/2010
`
`OTHER PUBLICATIONS
`
`Alcaniz, et aL, "An Advanced System for the Simulation and
`Planning of Orthodontic Treatments," Karl Heinz Hohne and Ron
`Kikinis (eds.), Visualization in Biomedical Computing, 4th Intl.
`Conf., VBC '96, Hamburg, Germany, Sep. 22-25, 1996, Springer-
`Verlag, pp. 511-520.
`Alexander et al., "The DigiGraph Work Station Part 2 Clinical
`Management," JCO, pp. 402-407 (Jul. 1990).
`Altschuler, "3D Mapping of Maxillo-Facial Prosthesis," AADR
`Abstract #607, 2 pages total, (1980).
`Altschuler et al., "Analysis of3-D Data for Comparative 3-D Serial
`Growth Pattern Studies of Oral-Facial Structures," IADRAbstracts,
`Program and Abstracts of Papers, 57th General Session, IADR
`Annual Session, Mar. 29, 1979-Apr. 1, 1979, New Orleans Marriot,
`Journal of Dental Research, vol. 58, Jan. 1979, Special Issue A, p.
`221.
`Altschuler et al., "Laser Electro-Optic System for Rapid Three-
`Dimensional (3D) Topographic Mapping of Surfaces," Optical
`Engineering, 20(6):953-961 (1981).
`Altschuler et al., "Measuring Surfaces Space-Coded by a Laser-
`Projected Dot Matrix," SPIE Imaging Applications for Automated
`Industrial Inspection and Assembly, vol. 182, p. 187-191 (1979).
`Andersson et al., "Clinical Results with Titanium Crowns Fabri-
`cated with Machine Duplication and Spark Erosion," Acta. Odontol.
`Scand., 47:279-286 (1989).
`Andrews, The Six Keys to Optimal Occlusion Straight Wire,
`Chapter 3, pp. 13-24 (1989).
`Bartels, et al., An Introduction to Splines for Use in Computer
`Graphics and Geometric Modeling, Morgan Kaufmann Publishers,
`pp. 422-425 ( 1987).
`Baurnrind, "A System for Craniofacial Mapping Through the Inte-
`gration of Data from Stereo X-Ray Films and Stereo Photographs,"
`an invited paper submitted to the 1975 American Society ofPhotogram
`Symposium on Close-Range Photogram Systems, University of III.,
`Aug. 26-30, 1975, pp. 142-166.
`Baurnrind et al., "A Stereophotogranunetric System for the Detec-
`tion of Prosthesis Loosening in Total Hip Arthroplasty," NATO
`Symposium on Applications of Human Biostereometrics, Jul. 9-13,
`1978, SPIE, vol. 166, pp. 112-123.
`Baurnrind et al., "Mapping the Skull in 3-D," reprinted from J. Calif.
`Dent. Assoc., 48(2), 11 pages total, (1972 Fall Issue).
`Baurnrind, "Integrated Three-Dimensional Craniofacial Mapping:
`Background, Principles, and Perspectives," Semin. in Orthod.,
`7(4):223-232 (Dec. 2001).
`Begole et al., "A Computer System for the Analysis of Dental
`Casts," The Angle Orthod., 51(3):253-259 (Jul. 1981).
`Bernard et al.,"Computerized Diagnosis in Orthodontics for Epide-
`miological Studies: A Progress Report," Abstract, J. Dental Res.
`Special Issue, vol. 67, p. 169, paper presented at International
`Association for Dental Research 66th General Session, Mar. 9-13,
`1988, Montreal, Canada.
`Bhatia et al., "A Computer-Aided Design for Orthognathic Sur-
`gery," Br. J. Oral Maxillofac. Surg., 22:237-253 (1984).
`Biggerstaff, "Computerized Diagnostic Setups and Simulations,"
`Angle Orthod., 40(1):28-36 (Jan. 1970).
`Biggerstaff et al., "Computerized Analysis of Occlusion in the
`Postcanine Dentition," Am. J. Orthod., 61(3): 245-254 (Mar. 1972).
`Biostar Opeation & Training Manual. Great Lakes Orthodontics,
`Ltd. 199 Fire Tower Drive, Tonawanda, New York. 14150-5890, 20
`pages total (1990).
`Blu, et al., "Linear interpolation revitalized", IEEE Trans. Image
`Proc., 13(5):710-719 (May 2004.
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`US 10,728,519 B2
`Page 6
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Bourke, "Coordinate System Transformation," (Jun. 1996), p. 1,
`retrieved from the Internet Nov. 5, 2004, URL< http://astronomy.
`swin.edu.au/-pbourke/prolection/coords>.
`Boyd et al., "Three Dimensional Diagnosis and Orthodontic Treat(cid:173)
`ment of Complex Malocclusions With the Invisalipn Appliance,"
`Semin. Orthod., 7(4):274-293 (Dec. 2001).
`Brandestini et al., "Computer Machined Ceramic Inlays: In Vitro
`Marginal Adaptation," J. Dent. Res. Special Issue, Abstract 305, vol.
`64, p. 208 ( 1985).
`Brook et al., "An Image Analysis System for the Determination of
`Tooth Dimensions from Study Casts: Comparison with Manual
`Measurements ofMesio-distal Diameter," J. Dent. Res., 65(3):428-
`431 (Mar. 1986).
`Burstone et al., Precision Adjustment of the Transpalatal Lingual
`Arch: Computer Arch Form in Predetermination, Am, Journal of
`Orthodontics, vol. 79, No. 2 (Feb. 1981), pp. 115-133.
`Burstone (interview), "Dr. Charles J. Burstone on the Uses of the
`Computer in Orthodontic Practice (Part l)," J. Clin. Orthod.,
`13(7):442-453 (Jul. 1979).
`Burstone (interview), "Dr. Charles J. Burstone on The Uses of the
`Computer in Orthodontic Practice (Part 2)," J. Clin. Orthod.,
`13(8):539-551 (Aug. 1979).
`Cardinal Industrial Finishes, Powder Coatings information posted
`at<http://www.cardinalpaint.com>on Aug. 25, 2000, 2 pages.
`Carnaghan, "An Alternative to Holograms for the Portrayal of
`Human Teeth," 4th Int'!. Conf. on Holographic Systems, Compo(cid:173)
`nents and Applications, Sep. 15, 1993, pp. 228-231.
`Cha, et al. 3D profilometry using a dynamically configurable
`confocal microscope, 3640 IS&T/SPIE. Conference on Three Dimen(cid:173)
`sional Image Capture and Applications II. 246-253. Jan. 1999.
`Chaconas et al., "The DigiGraph Work Station, Part 1, Basic
`Concepts," JCO, pp. 360-367 (Jun. 1990).
`Chafetz et al., "Subsidence of the Femoral Prosthesis, A
`Stereophotogrammetric Evaluation," Clin. Orthop. Relat. Res., No.
`201, pp. 60-67 (Dec. 1985).
`Chiappone, (1980). Constructing the Gnathologic Setup and Positioner,
`J. Clin. Orthod, vol. 14, pp. 121-133.
`Cogswell, et al. Colour confocal reflection microscopy using red,
`green and blue lasers, 165 J. Microscopy 103-117 (1990).
`Cogswell, et al. High-resolution, multiple optical mode confocal
`microscope: I. System design, image acquisition and 3D visualiza(cid:173)
`tion, 2184 SPIE 48-54 (1994).
`Constans. The Confocal Microscope, 18(22) The Scientist 32-33
`(2004).
`Cottingham, (1969). Gnathologic Clear Plastic Positioner, Am. J.
`Orthod, vol. 55, pp. 23-31.
`Crawford, "CAD/CAM in the Dental Office: Does It Work?",
`Canadian Dental Journal, vol. 57, No. 2, pp. 121-123 (Feb. 1991).
`Crawford, "Computers in Dentistry: Part 1 CAD/CAM: The Com(cid:173)
`puter Moves Chairside," Part 2 F. Duret-AMan with a Vision,"Part
`3 The Computer Gives New Vision-Literally," Part 4 Bytes 'N
`Bites-The Computer Moves from the Front Desk to the Operatory,
`Canadian Dental Journal, vol. 54 (9), pp. 661-666 ( 1988).
`Crooks, "CAD/CAM Comes to USC," USC Dentistry, pp. 14-17
`(Spring 1990).
`Cureton, Correcting Malaligned Mandibular Incisors with Remov(cid:173)
`able Retainers, J. Clin. Orthod, vol. 30, No. 7 (1996) pp. 390-395.
`Curry et al., "Integrated Three-Dimensional Craniofacial Mapping
`at the Craniofacial Research Instrumentation Laboratory/University
`of the Pacific," Semin. Orthod., 7(4):258-265 (Dec. 2001).
`Cutting et a/., "Three-Dimensional Computer-Assisted Design of
`Craniofacial Surgical Procedures: Optimization and Interaction
`with Cephalometric and CT-Based Models," Plast. 77(6):877-885
`(Jun. 1986).
`DCS Dental AG, "The CAD/CAM 'DCS Titan System' for Pro(cid:173)
`duction of Crowns/Bridges," DSC Production AG, pp. 1-7 (Jan.
`1992.
`
`Definition for gingiva. Dictionary.comp. 1-3. Retrieved from the
`internet Nov. 5, 2004<http:/ /reference.com/search/search?q~
`gingiva>.
`Defranco et al., "Three-Dimensional Large Displacement Analysis
`of Orthodontic Appliances," J. Biomechanics, 9:793-801 (1976).
`Dental Institute University of Zurich Switzerland, Program for
`International Symposium JD on Computer Restorations: State of the
`Art of the CEREC-Method, May 1991, 2 pages total.
`Dentrac Corporation, Dentrac document, pp. 4-13 (1992).
`Dent-X posted on Sep. 24, 1998 at<http://www.dent-x.com/DentSim.
`htm>, 6 pages.
`Doyle, "Digital Dentistry," Computer Graphics World, pp. 50-52,
`54 (Oct. 2000).
`DuraClearTM product information, Allesee Orthodontic Appliances(cid:173)
`Pro Lab, 1 page ( 1997).
`Duret et al., "CAD/CAM Imaging in Dentistry," Curr. Opin. Dent.,
`1:150-154 (1991).
`Duret et al, "CAD-CAM in Dentistry," J. Am. Dent. Assoc. 117:715-
`720 (Nov. 1988).
`Duret, "The Dental CAD/CAM, General Description of the Proj(cid:173)
`ect," Hennson International Product Brochure, 18 pages total, Jan.
`1986.
`Duret,"Vers Une Prosthese Inforrnatisee," (English translation attached),
`Tonus, vol. 75, pp. 55-57 (Nov. 15, 1985).
`Economides, "The Microcomputer in the Orthodontic Office," JCO,
`pp. 767-772 (Nov. 1979).
`Elsasser, Some Observations on the History and Uses of the Kesling
`Positioner, Am. J. Orthod. (1950) 36:368-374.
`English translation of Japanese Laid-Open Publication No. 63-11148
`to inventor T. Ozukuri (Laid-Open on Jan. 18, 1998) pp. 1-7.
`Felton et al., "A Computerized Analysis of the Shape and Stability
`of Mandibular Arch Form," Am. J. Orthod. Dentofacial Orthop.,
`92(6):478-483 (Dec. 1987).
`Friede et al., "Accuracy ofCephalometric Prediction in Orthognathic
`Surgery," Abstract of Papers, J. Dent. Res., 70:754-760 (1987).
`Futterling et al., "Automated Finite Element Modeling of a Human
`Mandible with Dental Implants," JS WSCG '98----Conference Pro(cid:173)
`gram, retrieved from the Internet:<http://wscg.zcu.cz/wscg98/
`papers98/Strasser 98.pdf>, 8 pages.
`Gao et al., "3-D element Generation for Multi-Connected Complex
`Dental and Mandibular Structure," Proc. Intl Workshop on Medical
`Imaging and Augmented Reality, pp. 267-271 (Jun. 12, 2001).
`Gim-Alldent Deutschland, "Das DUX System: Die Technik," 2
`pages total (2002).
`Gottleib et al., "JCO Interviews Dr. James A. McNamura, Jr., on the
`Frankel Appliance: Part 2: Clinical 1-1 Management,"J. Clin. Orthod.,
`16(6):390-407 (Jun. 1982).
`Grayson, "New Methods for Three Dimensional Analysis ofCraniofacial
`Deformity, Symposium: JW Computerized Facial Imaging in Oral
`and Maxiiofacial Surgery," AAOMS, 3 pages total, (Sep. 13, 1990).
`Guess et al., "Computer Treatment Estimates in Orthodontics and
`Orthognathic Surgery," JCO, pp. 262-28 (Apr. 1989).
`Heaven et a/., "Computer-Based Image Analysis of Artificial Root
`Surface Caries," Abstracts of Papers, J. Dent. Res., 70:528 (Apr.
`17-21, 1991).
`Hibbs, A.R., Confocal Microscopy for Biologists, Appx. 1, 355-443
`(2004).
`Highbeam Research, "Simulating Stress Put on Jaw," Tooling &
`Production [online], Nov. 1996, n pp. 1-2, retrieved from the
`Internet on Nov. 5, 2004, URL http://static.highbeam.
`com/t/toolingampproduction/november0 11996/
`simulatingstressputonfa . . . >.
`Hikage, "Integrated Orthodontic Management System for Virtual
`Three-Dimensional Computer Graphic Simulation and Optical Video
`Image Database for Diagnosis and Treatment Planning", Journal of
`Japan KA Orthodontic Society, Feb. 1987, English translation, pp.
`1-38, Japanese version, 46(2), pp. 248-269 (60 pages total).
`Hoffmann, et al., "Role of Cephalometry for Planning of Jaw
`Orthopedics and Jaw Surgery Procedures," (Article Summary in
`English, article in German), Informatbnen, pp. 375-396 (Mar.
`1991).
`
`3SHAPE 1001 3Shape v Align IPR2021-01383
`
`

`

`US 10,728,519 B2
`Page 7
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Hojjatie et al., "Three-Dimensional Finite Element Analysis of
`Glass-Ceramic Dental Crowns," J. Biomech., 23(11): 1157-1166
`(1990).
`Huckins, "CAD-CAM Generated Mandibular Model Prototype
`from MRI Data," AAOMS, p. 96 (1999).
`Important Tip About Wearing the Red White & Blue Active Clear
`Retainer System, Allesee Orthodontic Appliances-Pro Lab, 1 page
`1998).
`JCO Interviews, Craig Andreiko , DDS, MS on the Elan and Orthos
`Systems, JCO, pp. 459-468 (Aug. 1994).
`JCO Interviews, Dr. Homer W. Phillips on Computers in Orthodon(cid:173)
`tic Practice, Part 2, JCO. 1997; 1983:819-831.
`Jernvall, et al. Laser confocal microscopy and geographic informa(cid:173)
`tion systems in the study of dental morphology. Palaeontological
`electronica 2( 1 ). 1999. http://www.biocenter.helsinki.fi/bi/evodevo/
`pdf/pe99.pdf.
`Jerrold, "The Problem, Electronic Data Transmission and the Law,"
`AJO-DO, pp. 478-479 (Apr. 1988).
`Jones et al., "An Assessment of the Fit ofa Parabolic Curve to Pre(cid:173)
`and Post-Treatment Dental Arches," Br. J. Orthod., 16:85-93 (1989).
`Jp Faber et al., "Computerized Interactive Orthodontic Treatment
`Planning," Am. J. Orthod., 73(1):36-46 (Jan. 1978).
`Kamada et.al., Case Reports on Tooth Positioners Using LTV Vinyl
`Silicone Rubber, J. Nihon University School of Dentistry (1984)
`26(1): 11-29.
`Kamada et.al., Construction of Tooth Positioners with LTV Vinyl
`Silicone Rubber and Some Case KJ Reports, J. Nihon University
`School of Dentistry (1982) 24(1):1-27.
`Kanazawa et al., "Three-Dimensional Measurements of the Occlusal
`Surfaces of Upper Molars in a Dutch Population," J. Dent Res.,
`63(11):12