BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [1] Bayesian Fully Convolutional Networks for Brain Image Registration
    Cui, Kunpeng
    Fu, Panpan
    Li, Yinghao
    Lin, Yusong
    JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
  • [2] NON-RIGID IMAGE REGISTRATION USING SELF-SUPERVISED FULLY CONVOLUTIONAL NETWORKS WITHOUT TRAINING DATA
    Li, Hongming
    Fan, Yong
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1075 - 1078
  • [3] A Novel Dual-supervised Convolutional Network for Retinal Vessel Segmentation
    Li, Zizheng
    Guan, Junlin
    Wang, Huadeng
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 567 - 571
  • [4] Supervised local error estimation for nonlinear image registration using convolutional neural networks
    Eppenhof, Koen A. J.
    Pluim, Josien P. W.
    MEDICAL IMAGING 2017: IMAGE PROCESSING, 2017, 10133
  • [5] Weakly-supervised convolutional neural networks for multimodal image registration
    Hu, Yipeng
    Modat, Marc
    Gibson, Eli
    Li, Wenqi
    Ghavamia, Nooshin
    Bonmati, Ester
    Wang, Guotai
    Bandula, Steven
    Moore, Caroline M.
    Emberton, Mark
    Ourselin, Sebastien
    Noble, J. Alison
    Barratt, Dean C.
    Vercauteren, Tom
    MEDICAL IMAGE ANALYSIS, 2018, 49 : 1 - 13
  • [6] Generating anthropomorphic phantoms using fully unsupervised deformable image registration with convolutional neural networks
    Chen, Junyu
    Li, Ye
    Du, Yong
    Frey, Eric C.
    MEDICAL PHYSICS, 2020, 47 (12) : 6366 - 6380
  • [7] Deformable image registration using convolutional neural networks
    Eppenhof, Koen A. J.
    Lafarge, Maxime W.
    Moeskops, Pim
    Veta, Mitko
    Pluim, Josien P. W.
    MEDICAL IMAGING 2018: IMAGE PROCESSING, 2018, 10574
  • [8] Accurate Hippocampus Segmentation Using Fully Convolutional Networks and Deformable Image Registration Based Data Augmentation
    Li, H.
    Yang, J.
    Xiao, Y.
    Fan, Y.
    MEDICAL PHYSICS, 2018, 45 (06) : E362 - E362
  • [9] Brain CT registration using hybrid supervised convolutional neural network
    Hongmei Yuan
    Minglei Yang
    Shan Qian
    Wenxin Wang
    Xiaotian Jia
    Feng Huang
    BioMedical Engineering OnLine, 20
  • [10] Brain CT registration using hybrid supervised convolutional neural network
    Yuan, Hongmei
    Yang, Minglei
    Qian, Shan
    Wang, Wenxin
    Jia, Xiaotian
    Huang, Feng
    BIOMEDICAL ENGINEERING ONLINE, 2021, 20 (01)