Improving ultrasound tongue image reconstruction from lip images using self-supervised learning and attention mechanism

被引：0
|
作者：
Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan [1 ]
不详 [2 ]
机构：
来源：
arXiv |
关键词：
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Attention mechanisms - Cross modality - Cross-modality mapping - Human organs - Image sequence - Images reconstruction - Speech production - Supervised learning problems - Ultrasound tongue imaging - Vocal-tracts
引用
收藏
相关论文
共 50 条
  • [31] Retinal Image Understanding Emerges from Self-Supervised Multimodal Reconstruction
    Hervella, Alvaro S.
    Rouco, Jose
    Novo, Jorge
    Ortega, Marcos
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 321 - 328
  • [32] COMPLEX-VALUED SELF-SUPERVISED POLSAR IMAGE CLASSIFICATION INTEGRATING ATTENTION MECHANISM
    Kuang, Zuzheng
    Bi, Haixia
    Li, Fan
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5958 - 5961
  • [33] Classification of Polyps in Endoscopic Images Using Self-Supervised Structured Learning
    Huang, Qi-Xian
    Lin, Guo-Shiang
    Sun, Hung-Min
    IEEE ACCESS, 2023, 11 : 50025 - 50037
  • [34] Self-supervised learning for medical image analysis using image context restoration
    Chen, Liang
    Bentley, Paul
    Mori, Kensaku
    Misawa, Kazunari
    Fujiwara, Michitaka
    Rueckert, Daniel
    MEDICAL IMAGE ANALYSIS, 2019, 58
  • [35] Kidney Tumor Classification on CT images using Self-supervised Learning
    Özbay E.
    Özbay F.A.
    Gharehchopogh F.S.
    Computers in Biology and Medicine, 2024, 176
  • [36] Improving Self-supervised Molecular Representation Learning using Persistent Homology
    Luo, Yuankai
    Shi, Lei
    Thost, Veronika
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] Self-Supervised Image Prior Learning with GMM from a Single Noisy Image
    Liu, Haosen
    Liu, Xuan
    Lu, Jiangbo
    Tan, Shan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2825 - 2834
  • [38] Ultrasound carotid plaque segmentation via image reconstruction-based self-supervised learning with limited training labels
    Zhou, Ran
    Ou, Yanghan
    Fang, Xiaoyue
    Azarpazhooh, M. Reza
    Gan, Haitao
    Ye, Zhiwei
    Spence, J. David
    Xu, Xiangyang
    Fenster, Aaron
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 1617 - 1636
  • [39] Improving correlation based super-resolution microscopy images through image fusion by self-supervised deep learning
    Beck, Lior M.
    Shocher, Assaf
    Rossman, Uri
    Halfon, Ariel
    Irani, Michal
    Dron, Dan
    OPTICS EXPRESS, 2024, 32 (16): : 28195 - 28205
  • [40] Self-Supervised Transfer Learning from Natural Images for Sound Classification
    Shin, Sungho
    Kim, Jongwon
    Yu, Yeonguk
    Lee, Seongju
    Lee, Kyoobin
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
12345