BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [21] Image Aesthetics Assessment Using Fully Convolutional Neural Networks
    Apostolidis, Konstantinos
    Mezaris, Vasileios
    MULTIMEDIA MODELING (MMM 2019), PT I, 2019, 11295 : 361 - 373
  • [22] Brain Tumor Automatic Segmentation Using Fully Convolutional Networks
    Cui, Shaoguo
    Mao, Lei
    Xiong, Shuyu
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2017, 7 (07) : 1641 - 1647
  • [23] A Supervised Image Registration Approach for Late Gadolinium Enhanced MRI and Cine Cardiac MRI Using Convolutional Neural Networks
    Upendra, Roshan Reddy
    Simon, Richard
    Linte, Cristian A.
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, 2020, 1248 : 208 - 220
  • [24] Non-rigid medical image registration using multi-scale residual deep fully convolutional networks
    Yang, T. J.
    Tang, Q.
    Li, L.
    Bai, X. H.
    JOURNAL OF INSTRUMENTATION, 2021, 16 (03)
  • [25] Subcortical Brain Segmentation in MR image based on Residual Fully Convolutional Networks
    Wang, Chuyuan
    Ma, Shuailei
    Wei, Ying
    Li, Xiang
    Liu, Yue
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 4834 - 4837
  • [26] Supervised learning of image restoration with convolutional networks
    Jain, Viren
    Murray, Joseph F.
    Roth, Fabian
    Turaga, Srinivas
    Zhigulin, Valentin
    Briggman, Kevin L.
    Helmstaedter, Moritz N.
    Denk, Winfried
    Seung, H. Sebastian
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 636 - +
  • [27] Performance improvement of weakly supervised fully convolutional networks by skip connections for brain structure segmentation
    Sugino, Takaaki
    Roth, Holger R.
    Oda, Masahiro
    Kin, Taichi
    Saito, Nobuhito
    Nakajima, Yoshikazu
    Mori, Kensaku
    MEDICAL PHYSICS, 2021, 48 (11) : 7215 - 7227
  • [28] Semantic Image Segmentation for Autonomous Driving Using Fully Convolutional Networks
    Kaymak, Cagri
    Ucar, Ayegul
    2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA PROCESSING (IDAP 2019), 2019,
  • [29] MRI Image Segmentation by Fully Convolutional Networks
    Wang, Yabiao
    Sun, Zeyu
    Liu, Chang
    Peng, Wenbo
    Zhang, Juhua
    2016 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2016, : 1697 - 1702
  • [30] REGISTRATION OF HIGH RESOLUTION SAR AND OPTICAL SATELLITE IMAGERY USING FULLY CONVOLUTIONAL NETWORKS
    Hoffmann, Stefan
    Brust, Clemens-Alexander
    Shadaydeh, Maha
    Denzler, Joachim
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5152 - 5155