Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

被引:36
|
作者
Zanjani, Farhad Ghazvinian [1 ]
Pourtaherian, Arash [1 ]
Zinger, Svitlana [1 ]
Moin, David Anssari [2 ]
Claessen, Frank [2 ]
Cherici, Teo [2 ]
Parinussa, Sarah [2 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol, NL-5612 AJ Eindhoven, Netherlands
[2] Promaton Co Ltd, NL-1076 GR Amsterdam, Netherlands
关键词
Deep learning; 3D point cloud; Instance object segmentation; Intra-oral scan;
D O I
10.1016/j.neucom.2020.06.145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:286 / 298
页数:13
相关论文
共 50 条
  • [21] TSPconv-Net: Transformer and Sparse Convolution for 3D Instance Segmentation in Point Clouds
    Ning, Xiaojuan
    Liu, Yule
    Ma, Yishu
    Lu, Zhiwei
    Jin, Haiyan
    Shi, Zhenghao
    Wang, Yinghui
    MATHEMATICS, 2024, 12 (18)
  • [22] Attention-Based Joint Semantic-Instance Segmentation of 3D Point Clouds
    Hao, Wen
    Wang, Hongxiao
    Liang, Wei
    Zhao, Minghua
    Xia, Zhaolin
    ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2022, 22 (02) : 19 - 28
  • [23] Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representation
    Shin, Sangyun
    Zhou, Kaichen
    Vankadari, Madhu
    Markham, Andrew
    Trigoni, Niki
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 4060 - 4069
  • [24] Mask-Attention-Free Transformer for 3D Instance Segmentation
    Lai, Xin
    Yuan, Yuhui
    Chu, Ruihang
    Chen, Yukang
    Hu, Han
    Jia, Jiaya
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3670 - 3680
  • [25] A graph-based approach for simultaneous semantic and instance segmentation of plant 3D point clouds
    Mirande, Katia
    Godin, Christophe
    Tisserand, Marie
    Charlaix, Julie
    Besnard, Fabrice
    Hetroy-Wheeler, Franck
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [26] Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction
    Chen, Hui
    Chen, Wanlou
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7447 - 7451
  • [27] BERT-ENHANCED WITH CONTEXT-AWARE EMBEDDING FOR INSTANCE SEGMENTATION IN 3D POINT CLOUDS
    Yang, Hongxin
    Yan, Hailun
    Wang, Ruisheng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7519 - 7522
  • [28] Method to evaluate the noise of 3D intra-oral scanner
    Desoutter, Alban
    Solieman, Osama Yusuf
    Subsol, Gerard
    Tassery, Herve
    Cuisinier, Frederic
    Fages, Michel
    PLOS ONE, 2017, 12 (08):
  • [29] Interactive Object Segmentation in 3D Point Clouds
    Kontogianni, Theodora
    Celikkan, Ekin
    Tang, Siyu
    Schindler, Konrad
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 2891 - 2897
  • [30] SEGCloud: Semantic Segmentation of 3D Point Clouds
    Tchapmi, Lyne P.
    Choy, Christopher B.
    Armeni, Iro
    Gwak, JunYoung
    Savarese, Silvio
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 537 - 547