BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [31] Brain Tumor Segmentation Using Deep Fully Convolutional Neural Networks
    Kim, Geena
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2017, 2018, 10670 : 344 - 357
  • [32] Brain Image Labeling Using Multi-atlas Guided 3D Fully Convolutional Networks
    Fang, Longwei
    Zhang, Lichi
    Nie, Dong
    Cao, Xiaohuan
    Bahrami, Khosro
    He, Huiguang
    Shen, Dinggang
    PATCH-BASED TECHNIQUES IN MEDICAL IMAGING (PATCH-MI 2017), 2017, 10530 : 12 - 19
  • [33] Multi-Focus Image Fusion Algorithm Based on Supervised Learning for Fully Convolutional Neural Networks
    Li Heng
    Zhang Liming
    Jiang Meirong
    Li Yulong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (08)
  • [34] FULLY CONVOLUTIONAL NETWORKS FOR MULTI-MODALITY ISOINTENSE INFANT BRAIN IMAGE SEGMENTATION
    Nie, Dong
    Wang, Li
    Gao, Yaozong
    Shen, Dinggang
    2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 1342 - 1345
  • [35] Weakly supervised learning for image keypoint matching using graph convolutional networks
    Pang, Shuchao
    Du, Anan
    Orgun, Mehmet A.
    Chen, Hechang
    KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [36] RegiNet: Gradient guided multispectral image registration using convolutional neural networks
    Wei, Zeming
    Jung, Cheolkon
    Su, Chen
    NEUROCOMPUTING, 2020, 415 : 193 - 200
  • [37] Supervised remote sensing image segmentation using boosted convolutional neural networks
    Basaeed, Essa
    Bhaskar, Harish
    Al-Mualla, Mohammed
    KNOWLEDGE-BASED SYSTEMS, 2016, 99 : 19 - 27
  • [38] DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference in Image Recognition
    Xie, Jiyang
    Ma, Zhanyu
    Xue, Jing-Hao
    Zhang, Guoqiang
    Sun, Jian
    Zheng, Yinhe
    Guo, Jun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9208 - 9219
  • [39] Pulmonary CT Registration Through Supervised Learning With Convolutional Neural Networks
    Eppenhof, Koen A. J.
    Pluim, Josien P. W.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (05) : 1097 - 1105
  • [40] Automatic Analysis of Lesion in Cardiovascular Image using Fully Convolutional Neural Networks
    Tang, Weijia
    Zhang, Chuang
    Wu, Ming
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 145 - 149