Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

被引:36
|
作者
Zanjani, Farhad Ghazvinian [1 ]
Pourtaherian, Arash [1 ]
Zinger, Svitlana [1 ]
Moin, David Anssari [2 ]
Claessen, Frank [2 ]
Cherici, Teo [2 ]
Parinussa, Sarah [2 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol, NL-5612 AJ Eindhoven, Netherlands
[2] Promaton Co Ltd, NL-1076 GR Amsterdam, Netherlands
关键词
Deep learning; 3D point cloud; Instance object segmentation; Intra-oral scan;
D O I
10.1016/j.neucom.2020.06.145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:286 / 298
页数:13
相关论文
共 50 条
  • [31] Dynamic Convolution for 3D Point Cloud Instance Segmentation
    He, Tong
    Shen, Chunhua
    van den Hengel, Anton
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5697 - 5711
  • [32] 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans
    Hou, Ji
    Dai, Angela
    Niessner, Matthias
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4416 - 4425
  • [33] Tree Instance Segmentation in Urban 3D Point Clouds Using a Coarse-to-Fine Algorithm Based on Semantic Segmentation
    Burmeister, Josafat-Mattias
    Richter, Rico
    Reder, Stefan
    Mund, Jan-Peter
    Doellner, Jurgen
    19TH 3D GEOINFO CONFERENCE 2024, VOL. 10-4, 2024, : 79 - 86
  • [34] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [35] Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing
    Hu, Shi-Min
    Cai, Jun-Xiong
    Lai, Yu-Kun
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (07) : 2485 - 2498
  • [36] THISNet: Tooth Instance Segmentation on 3D Dental Models via Highlighting Tooth Regions
    Li, Pengcheng
    Gao, Chenqiang
    Liu, Fangcen
    Meng, Deyu
    Yan, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5229 - 5241
  • [37] Fast Segmentation of 3D Point Clouds for Ground Vehicles
    Himmelsbach, M.
    v. Hundelshausen, Felix
    Wuensche, H. -J.
    2010 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2010, : 560 - 565
  • [38] GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds
    Zhang, Zihui
    Yang, Bo
    Wang, Bing
    Li, Bo
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17619 - 17629
  • [39] BPNet: Bezier Primitive Segmentation on 3D Point Clouds
    Fu, Rao
    Wen, Cheng
    Li, Qian
    Xiao, Xiao
    Alliez, Pierre
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 754 - 762
  • [40] 3D Segmentation of Humans in Point Clouds with Synthetic Data
    Takmaz, Ayca
    Schult, Jonas
    Kaftan, Irem
    Akcay, Mertcan
    Leibe, Bastian
    Sumner, Robert
    Engelmann, Francis
    Tang, Siyu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1292 - 1304