Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

被引:36
|
作者
Zanjani, Farhad Ghazvinian [1 ]
Pourtaherian, Arash [1 ]
Zinger, Svitlana [1 ]
Moin, David Anssari [2 ]
Claessen, Frank [2 ]
Cherici, Teo [2 ]
Parinussa, Sarah [2 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol, NL-5612 AJ Eindhoven, Netherlands
[2] Promaton Co Ltd, NL-1076 GR Amsterdam, Netherlands
关键词
Deep learning; 3D point cloud; Instance object segmentation; Intra-oral scan;
D O I
10.1016/j.neucom.2020.06.145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:286 / 298
页数:13
相关论文
共 50 条
  • [1] Mask-MCNet: Instance Segmentation in 3D Point Cloud of Intra-oral Scans
    Zanjani, Farhad Ghazvinian
    Moin, David Anssari
    Claessen, Frank
    Cherici, Teo
    Parinussa, Sarah
    Pourtaherian, Arash
    Zinger, Svitlana
    de With, Peter H. N.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT V, 2019, 11768 : 128 - 136
  • [2] Privacy-Preserved Federated Learning for 3D Tooth Segmentation in Intra-Oral Mesh Scans
    Liu, Songshang
    Yang, Howard H.
    Tao, Yiqi
    Feng, Yang
    Hao, Jin
    Liu, Zuozhu
    FRONTIERS IN COMMUNICATIONS AND NETWORKS, 2022, 3
  • [3] Hierarchical Self-Supervised Learning for 3D Tooth Segmentation in Intra-Oral Mesh Scans
    Liu, Zuozhu
    He, Xiaoxuan
    Wang, Hualiang
    Xiong, Huimin
    Zhang, Yan
    Wang, Gaoang
    Hao, Jin
    Feng, Yang
    Zhu, Fudong
    Hu, Haoji
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (02) : 467 - 480
  • [4] Deep Learning Approach to Semantic Segmentation in 3D Point Cloud Intra-oral Scans of Teeth
    Zanjani, Farhad Ghazvinian
    Moin, David Anssari
    Verheij, Bas
    Claessen, Frank
    Cherici, Teo
    Tan, Tao
    de With, Peter H. N.
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 102, 2019, 102 : 557 - 571
  • [5] SoftGroup for 3D Instance Segmentation on Point Clouds
    Thang Vu
    Kim, Kookhoi
    Luu, Tung M.
    Thanh Nguyen
    Yoo, Chang D.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2698 - 2707
  • [6] Scalable SoftGroup for 3D Instance Segmentation on Point Clouds
    Vu, Thang
    Kim, Kookhoi
    Nguyen, Thanh
    Luu, Tung M.
    Kim, Junyeong
    Yoo, Chang D.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (04) : 1981 - 1995
  • [7] Teeth3DS: a benchmark for teeth segmentation and labeling from intra-oral 3D scans
    Ben-Hamadou, Achraf
    Smaoui, Oussama
    Chaabouni-Chouayakh, Houda
    Rekik, Ahmed
    Pujades, Sergi
    Boyer, Edmond
    Strippoli, Julien
    Thollot, Aurélien
    Setbon, Hugo
    Trosset, Cyril
    Ladroit, Edouard
    arXiv, 2022,
  • [8] Rethinking Task and Metrics of Instance Segmentation on 3D Point Clouds
    Arase, Kosuke
    Mukuta, Yusuke
    Harada, Tatsuya
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 4105 - 4113
  • [9] Learning Regional Purity for Instance Segmentation on 3D Point Clouds
    Dong, Shichao
    Lin, Guosheng
    Hung, Tzu-Yi
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 56 - 72
  • [10] Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds
    Yang, Bo
    Wang, Jianan
    Clark, Ronald
    Hu, Qingyong
    Wang, Sen
    Markham, Andrew
    Trigoni, Niki
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32