MULTI-VIEW VARIATIONAL AUTOENCODERS ALLOW FOR INTERPRETABILITY LEVERAGING DIGITAL AVATARS: APPLICATION TO THE HBN COHORT

被引:1
|
作者
Ambroise, Corentin [1 ]
Grigis, Antoine [1 ]
Duchesnay, Edouard [1 ]
Frouin, Vincent [1 ]
机构
[1] Univ Paris Saclay, CEA Saclay, Neurospin, Paris, France
关键词
D O I
10.1109/ISBI53787.2023.10230552
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
If neural network-based methods are praised for their prediction performance, they are often criticized for their lack of interpretability. When dealing with multi-omics or multi-modal data, neural network methods must be able learn the independent and joint effect of heterogeneous views while yielding interpretable results intra- and inter-views. In the literature, multi-view generative models exist to learn joint information in a reduced-size latent space. Among these models, multi-view variational autoencoders are very promising. In this work, we demonstrate how they provide a convenient statistical framework to learn the input data joint distribution and offer opportunities for the results interpretation. We design a method that discovers the relationships between one view and others. The generative capabilities of the model enable the exploration of a whole disorder spectrum through the generation of realistic values. While modifying a subject's clinical score, the model retrieves a representation of the subject's brain at this clinical status, so-called digital avatar. By computing associations between cortical regions measures and behavioral scores, we showcase that such digital avatars convey interpretable information in a multi-modal cohort with children experiencing mental health issues.
引用
收藏
页数:5
相关论文
共 2 条
  • [1] Leveraging Transformer-based autoencoders for low-rank multi-view subspace clustering
    Lin, Yuxiu
    Liu, Hui
    Yu, Xiao
    Zhang, Caiming
    PATTERN RECOGNITION, 2025, 161
  • [2] A VARIATIONAL MULTI-VIEW LEARNING FRAMEWORK AND ITS APPLICATION TO IMAGE SEGMENTATION
    Li, Zhenglong
    Liu, Qingshan
    Lu, Hanqing
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1516 - 1519