Improving ultrasound tongue image reconstruction from lip images using self-supervised learning and attention mechanism

被引：0
|
作者：
Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan [1 ]
不详 [2 ]
机构：
来源：
arXiv |
关键词：
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Attention mechanisms - Cross modality - Cross-modality mapping - Human organs - Image sequence - Images reconstruction - Speech production - Supervised learning problems - Ultrasound tongue imaging - Vocal-tracts
引用
收藏
相关论文
共 50 条
  • [21] Self-supervised learning of hologram reconstruction using physics consistency
    Luzhe Huang
    Hanlong Chen
    Tairan Liu
    Aydogan Ozcan
    Nature Machine Intelligence, 2023, 5 : 895 - 907
  • [22] Daytime sea fog monitoring using multimodal self-supervised learning with band attention mechanism
    Tao Li
    Wei Jin
    Randi Fu
    Caifen He
    Neural Computing and Applications, 2022, 34 : 21205 - 21222
  • [23] Self-Supervised Variable Rate Image Compression using Visual Attention
    Sinha, Abhishek Kumar
    Moorthi, S. Manthira
    Dhar, Debajyoti
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1720 - 1724
  • [24] Self-Supervised Learning for Ultrasound Probe Angle Prediction in Plantar Fascia Images
    Roop, Benjamin W.
    Brady, Kevin J.
    Gjesteby, Lars A.
    Baum, Brian S.
    Brattain, Laura J.
    2023 IEEE 19TH INTERNATIONAL CONFERENCE ON BODY SENSOR NETWORKS, BSN, 2023,
  • [25] Enhancing dental caries classification in CBCT images by using image processing and self-supervised learning
    Zanini, Luiz Guilherme Kasputis
    Rubira-Bullen, Izabel Regina Fischer
    Nunes, Fátima de Lourdes dos Santos
    Computers in Biology and Medicine, 2024, 183
  • [26] A Deep Learning Model with Self-Supervised Learning and Attention Mechanism for COVID-19 Diagnosis Using Chest X-ray Images
    Park, Junghoon
    Kwak, Il-Youp
    Lim, Changwon
    ELECTRONICS, 2021, 10 (16)
  • [27] Remote sensing image intelligent interpretation: from supervised learning to self-supervised learning
    Tao C.
    Yin Z.
    Zhu Q.
    Li H.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1122 - 1134
  • [28] An intelligent detection method for plasmodium based on self-supervised learning and attention mechanism
    Fu, Min
    Wu, Kai
    Li, Yuxuan
    Luo, Linkai
    Huang, Wei
    Zhang, Qi
    FRONTIERS IN MEDICINE, 2023, 10
  • [29] Self-supervised Learning with Attention Mechanism for EEG-based seizure detection
    Xiao, Tiantian
    Wang, Ziwei
    Zhang, Yongfeng
    Lv, Hongbin
    Wang, Shuai
    Feng, Hailing
    Zhao, Yanna
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [30] Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach
    Li, Ji
    Wang, Weixi
    Ji, Hui
    SIAM JOURNAL ON IMAGING SCIENCES, 2023, 16 (04): : 2247 - 2284
12345