BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [41] Spatial Relational Attention Using Fully Convolutional Networks for Image Caption Generation
    Jiang, Teng
    Gong, Liang
    Yang, Yupu
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2020, 19 (02)
  • [42] MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision
    Li, Hongming
    Fan, Yong
    HUMAN BRAIN MAPPING, 2022, 43 (07) : 2218 - 2231
  • [43] DS-UI: Dual-supervised mixture of Gaussian mixture models for uncertainty inference in image recognition
    Xie, Jiyang
    Ma, Zhanyu
    Xue, Jing-Hao
    Zhang, Guoqiang
    Sun, Jian
    Zheng, Yinhe
    Guo, Jun
    IEEE Transactions on Image Processing, 2021, 30 : 9208 - 9219
  • [44] Fast Image Processing with Fully-Convolutional Networks
    Chen, Qifeng
    Xu, Jia
    Koltun, Vladlen
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2516 - 2525
  • [45] Document Image Binarization with Fully Convolutional Neural Networks
    Tensmeyer, Chris
    Martinez, Tony
    2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), VOL 1, 2017, : 99 - 104
  • [46] 3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation
    Nie, Dong
    Wang, Li
    Adeli, Ehsan
    Lao, Cuijin
    Lin, Weili
    Shen, Dinggang
    IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (03) : 1123 - 1136
  • [47] End to End Unsupervised Rigid Medical Image Registration by Using Convolutional Neural Networks
    Liu, Huiying
    Chi, Yanling
    Mao, Jiawei
    Wu, Xiaoxiang
    Liu, Zhiqiang
    Xu, Yuyu
    Xu, Guibin
    Huang, Weimin
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 4064 - 4067
  • [48] Joint fully convolutional and graph convolutional networks for weakly-supervised segmentation of pathology images
    Zhang, Jun
    Hua, Zhiyuan
    Yan, Kezhou
    Tian, Kuan
    Yao, Jianhua
    Liu, Eryun
    Liu, Mingxia
    Han, Xiao
    MEDICAL IMAGE ANALYSIS, 2021, 73
  • [49] Using Deep Convolutional Neural Networks for Neonatal Brain Image Segmentation
    Ding, Yang
    Acosta, Rolando
    Enguix, Vicente
    Suffren, Sabrina
    Ortmann, Janosch
    Luck, David
    Dolz, Jose
    Lodygensky, Gregory A.
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [50] Graph Convolutional Networks for Semi-Supervised Image Segmentation
    Fabijanska, Anna
    IEEE ACCESS, 2022, 10 : 104144 - 104155