Towards Generalised Neural Implicit Representations for Image Registration

被引:0
|
作者
Zimmer, Veronika A. [1 ,2 ,3 ]
Hammernik, Kerstin [1 ,5 ]
Sideri-Lampretsa, Vasiliki [1 ]
Huang, Wenqi [1 ]
Reithmeir, Anna [1 ,2 ,4 ]
Rueckert, Daniel [1 ,3 ,5 ]
Schnabel, Julia A. [1 ,2 ,4 ,6 ]
机构
[1] Tech Univ Munich, Sch Computat Informat & Technol, Munich, Germany
[2] Helmholtz Munich, Munich, Germany
[3] Tech Univ Munich, Sch Med, Klinikum Rechts Isar, Munich, Germany
[4] Munich Ctr Machine Learning MCML, Munich, Germany
[5] Imperial Coll London, Dept Comp, London, England
[6] Kings Coll London, London, England
来源
关键词
Image registration; Neural implicit representation; Generalisation; Periodic activation functions; LEARNING FRAMEWORK;
D O I
10.1007/978-3-031-53767-7_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural implicit representations (NIRs) enable to generate and parametrize the transformation for image registration in a continuous way. By design, these representations are image-pair-specific, meaning that for each signal a new multi-layer perceptron has to be trained. In this work, we investigate for the first time the potential of existent NIR generalisation methods for image registration and propose novel methods for the registration of a group of image pairs using NIRs. To exploit the generalisation potential of NIRs, we encode the fixed and moving image volumes to latent representations, which are then used to condition or modulate the NIR. Using ablation studies on a 3D benchmark dataset, we show that our methods are able to generalise to a set of image pairs with a performance comparable to pairwise registration using NIRs when trained on N = 10 and N = 120 datasets. Our results demonstrate the potential of generalised NIRs for 3D deformable image registration.
引用
收藏
页码:45 / 55
页数:11
相关论文
共 50 条
  • [41] VIINTER: View Interpolation with Implicit Neural Representations of Images
    Feng, Brandon Yushan
    Jabbireddy, Susmija
    Varshney, Amitabh
    [J]. PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [42] Transformers as Meta-learners for Implicit Neural Representations
    Chen, Yinbo
    Wang, Xiaolong
    [J]. COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 : 170 - 187
  • [43] Capturing dynamical correlations using implicit neural representations
    Sathya R. Chitturi
    Zhurun Ji
    Alexander N. Petsch
    Cheng Peng
    Zhantao Chen
    Rajan Plumley
    Mike Dunne
    Sougata Mardanya
    Sugata Chowdhury
    Hongwei Chen
    Arun Bansil
    Adrian Feiguin
    Alexander I. Kolesnikov
    Dharmalingam Prabhakaran
    Stephen M. Hayden
    Daniel Ratner
    Chunjing Jia
    Youssef Nashed
    Joshua J. Turner
    [J]. Nature Communications, 14 (1)
  • [44] Meta-learning Sparse Implicit Neural Representations
    Lee, Jaeho
    Tack, Jihoon
    Lee, Namhoon
    Shin, Jinwoo
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [45] Geometric implicit neural representations for signed distance functions
    Schirmer, Luiz
    Novello, Tiago
    da Silva, Vinícius
    Schardong, Guilherme
    Perazzo, Daniel
    Lopes, Hélio
    Gonçalves, Nuno
    Velho, Luiz
    [J]. Computers and Graphics (Pergamon), 2024, 125
  • [46] Immersive Video Compression using Implicit Neural Representations
    Kwan, Ho Man
    Zhang, Fan
    Gower, Andrew
    Bull, David
    [J]. 2024 PICTURE CODING SYMPOSIUM, PCS 2024, 2024,
  • [47] Phase Transitions, Distance Functions, and Implicit Neural Representations
    Lipman, Yaron
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [48] Latent assimilation with implicit neural representations for unknown dynamics
    Li, Zhuoyuan
    Dong, Bin
    Zhang, Pingwen
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2024, 506
  • [49] Capturing dynamical correlations using implicit neural representations
    Chitturi, Sathya R.
    Ji, Zhurun
    Petsch, Alexander N.
    Peng, Cheng
    Chen, Zhantao
    Plumley, Rajan
    Dunne, Mike
    Mardanya, Sougata
    Chowdhury, Sugata
    Chen, Hongwei
    Bansil, Arun
    Feiguin, Adrian
    Kolesnikov, Alexander I.
    Prabhakaran, Dharmalingam
    Hayden, Stephen M.
    Ratner, Daniel
    Jia, Chunjing
    Nashed, Youssef
    Turner, Joshua J.
    [J]. NATURE COMMUNICATIONS, 2023, 14 (01)
  • [50] Image registration based on neural network
    Wang, Shuxiu
    Lei, Sheng
    Chang, Faliang
    [J]. 2008 INTERNATIONAL SPECIAL TOPIC CONFERENCE ON INFORMATION TECHNOLOGY AND APPLICATIONS IN BIOMEDICINE, VOLS 1 AND 2, 2008, : 133 - +