Spatiotemporal-atlas-based Dynamic Speech Imaging

被引:3
|
作者
Fu, Maojing [1 ,2 ]
Woo, Jonghye [3 ]
Liang, Zhi-Pei [1 ,2 ]
Sutton, Bradley P. [2 ,4 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[3] Massachusetts Gen Hosp, Gordon Ctr Med Imaging, Boston, MA 02114 USA
[4] Univ Illinois, Dept Bioengn, Urbana, IL 61801 USA
关键词
speech imaging; dynamic MRI; partial separability; spatiotemporal atlas; sparsity constraint; LOW-RANK; MRI; RECONSTRUCTION; SPARSITY; REGISTRATION; ACQUISITION; IMPATIENT; MODEL;
D O I
10.1117/12.2216528
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Dynamic magnetic resonance imaging (DS-MRI) has been recognized as a promising method for visualizing articulatory motion of speech in scientific research and clinical applications. However, characterization of the gestural and acoustical properties of the vocal tract remains a challenging task for DS-MRI because it requires: 1) reconstructing high-quality spatiotemporal images by incorporating stronger prior knowledge; and 2) quantitatively interpreting the reconstructed images that contain great motion variability. This work presents a novel imaging method that simultaneously meets both requirements by integrating a spatiotemporal atlas into a Partial Separability (PS) model-based imaging framework. Through the use of an atlas-driven sparsity constraint, this method is capable of capturing high-quality articulatory dynamics at an imaging speed of 102 frames per second and a spatial resolution of 2.2 x 2.2 mm(2). Moreover, the proposed method enables quantitative characterization of variability of speech motion, compared to the generic motion pattern across all subjects, through the spatial residual components.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Atlas of breast imaging
    Clin Imaging, 4 (305):
  • [42] Atlas-Based Multiorgan Segmentation for Dynamic Abdominal PET
    Ren, Silin
    Laub, Priscille
    Lu, Yihuan
    Naganawa, Mika
    Carson, Richard E.
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2020, 4 (01) : 50 - 62
  • [43] Speech articulation assessment using dynamic Magnetic Resonance Imaging techniques
    Ventura, S. R.
    Vasconcelos, M. J. M.
    Freitas, D. R.
    Ramos, I. M.
    Tavares, Joao Manuel R. S.
    COMPUTATIONAL VISION AND MEDICAL IMAGE PROCESSING: VIPIMAGE 2011, 2012, : 225 - 231
  • [44] Evaluation of the dynamic velopharynx during speech production with magnetic resonance imaging
    McFarland, EG
    Narra, VR
    Witt, PD
    Hirselj, DA
    Foster, GJ
    RADIOLOGY, 1998, 209P : 332 - 332
  • [45] Spatiotemporal dynamics of audiovisual speech processing
    Bernstein, Lynne E.
    Auer, Edward T., Jr.
    Wagner, Michael
    Ponton, Curtis W.
    NEUROIMAGE, 2008, 39 (01) : 423 - 435
  • [46] Revealing Spatiotemporal Brain Dynamics of Speech Production Based on EEG and Eye Movement
    Zhao, Bin
    Huang, Jinfeng
    Zhang, Gaoyan
    Dang, Jianwu
    Chen, Minbo
    Fu, Yingjian
    Wang, Longbiao
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1427 - 1431
  • [47] Denoising for Dynamic Vision Sensor Based on Augmented Spatiotemporal Correlation
    Xu, Ninghui
    Wang, Lihui
    Zhao, Jiajia
    Yao, Zhiting
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4812 - 4824
  • [48] Spatiotemporal imaging of complexity
    Robinson, Stephen E.
    Mandell, Arnold J.
    Coppola, Richard
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2013, 6
  • [49] Spatiotemporal Density-Based Clustering for Dynamic Spectrum Sensing
    Ebersole, Christopher
    Buchenroth, Anthony
    Zilz, David
    Chakravarthy, Vasu
    2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), 2020, : 720 - 725
  • [50] Runoff Prediction Based on Dynamic Spatiotemporal Graph Neural Network
    Yang, Shuai
    Zhang, Yueqin
    Zhang, Zehua
    WATER, 2023, 15 (13)