3D Soma Detection in Large-Scale Whole Brain Images via a Two-Stage Neural Network

被引:9
|
作者
Wei, Xiaodan [1 ]
Liu, Qinghao [1 ]
Liu, Min [1 ]
Wang, Yaonan [1 ]
Meijering, Erik [2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Natl Engn Res Ctr Robot Visual Percept & Control T, Changsha 410082, Hunan, Peoples R China
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
基金
中国国家自然科学基金;
关键词
Soma detection; two-stage neural network; image segmentation; deep learning; neuron reconstruction; MICROSCOPY IMAGES; VISUALIZATION; SEGMENTATION; CONVOLUTION; MORPHOLOGY; ALGORITHM;
D O I
10.1109/TMI.2022.3206605
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
3D soma detection in whole brain images is a critical step for neuron reconstruction. However, existing soma detection methods are not suitable for whole mouse brain images with large amounts of data and complex structure. In this paper, we propose a two-stage deep neural network to achieve fast and accurate soma detection in large-scale and high-resolution whole mouse brain images (more than 1TB). For the first stage, a lightweight Multi-level Cross Classification Network (MCC-Net) is proposed to filter out images without somas and generate coarse candidate images by combining the advantages of the multi convolution layer's feature extraction ability. It can speed up the detection of somas and reduce the computational complexity. For the second stage, to further obtain the accurate locations of somas in the whole mouse brain images, the Scale Fusion Segmentation Network (SFS-Net) is developed to segment soma regions from candidate images. Specifically, the SFS-Net captures multi-scale context information and establishes a complementary relationship between encoder and decoder by combining the encoder-decoder structure and a 3D Scale-Aware Pyramid Fusion (SAPF) module for better segmentation performance. The experimental results on three whole mouse brain images verify that the proposed method can achieve excellent performance and provide the reconstruction of neurons with beneficial information. Additionally, we have established a public dataset named WBMSD, including 798 high-resolution and representative images (256 x 256 x 256 voxels) from three whole mouse brain images, dedicated to the research of soma detection, which will be released along with this paper.
引用
收藏
页码:148 / 157
页数:10
相关论文
共 50 条
  • [21] Refining 3D models using a two-stage neural network-based iterative process
    Loh, AWK
    Robey, MC
    West, GA
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL I, PROCEEDINGS, 2002, : 172 - 175
  • [22] Reconstruction of 3D genome architecture via a two-stage algorithm
    Segal, Mark R.
    Bengtsson, Henrik L.
    BMC BIOINFORMATICS, 2015, 16
  • [23] Refining 3D models using a two-stage neural network-based iterative process
    Loh, A.W.K.
    Robey, M.C.
    West, G.A.
    Proceedings - International Conference on Pattern Recognition, 2002, 16 (01): : 172 - 175
  • [24] DEEP NEURAL NETWORK FOR 3D PARTICLE DETECTION IN 3D FLUORESCENCE MICROSCOPY IMAGES VIA DENSITY MAP REGRESSION
    Spilger, R.
    Chagin, V. O.
    Bold, C. S.
    Schermelleh, L.
    Muller, U. C.
    Cardoso, M. C.
    Rohr, K.
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [25] TSF: Two-Stage Sequential Fusion for 3D Object Detection
    Qi, Heng
    Shi, Peicheng
    Liu, Zhiqiang
    Yang, Aixi
    IEEE SENSORS JOURNAL, 2022, 22 (12) : 12163 - 12172
  • [26] Fast Two-Stage 3D Object Detection with Semantic Guidance
    Huang Mang
    Hui Bin
    Liu Zhaoji
    Jin Tianming
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (12)
  • [27] TSFF: a two-stage fusion framework for 3D object detection
    Jiang, Guoqing
    Li, Saiya
    Huang, Ziyu
    Cai, Guorong
    Su, Jinhe
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [28] TSFF: a two-stage fusion framework for 3D object detection
    Jiang, Guoqing
    Li, Saiya
    Huang, Ziyu
    Cai, Guorong
    Su, Jinhe
    PeerJ Computer Science, 2024, 10
  • [29] A Two-Stage Framework for 3D Face Reconstruction from RGBD Images
    Wang, Kangkan
    Wang, Xianwang
    Pan, Zhigeng
    Liu, Kai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (08) : 1493 - 1504
  • [30] Foreign Object Detection in Railway Images Based on an Efficient Two-Stage Convolutional Neural Network
    Chen, Weixun
    Meng, Siming
    Jiang, Yuelong
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022