Spatiotemporal-atlas-based Dynamic Speech Imaging

被引:3
|
作者
Fu, Maojing [1 ,2 ]
Woo, Jonghye [3 ]
Liang, Zhi-Pei [1 ,2 ]
Sutton, Bradley P. [2 ,4 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[3] Massachusetts Gen Hosp, Gordon Ctr Med Imaging, Boston, MA 02114 USA
[4] Univ Illinois, Dept Bioengn, Urbana, IL 61801 USA
关键词
speech imaging; dynamic MRI; partial separability; spatiotemporal atlas; sparsity constraint; LOW-RANK; MRI; RECONSTRUCTION; SPARSITY; REGISTRATION; ACQUISITION; IMPATIENT; MODEL;
D O I
10.1117/12.2216528
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Dynamic magnetic resonance imaging (DS-MRI) has been recognized as a promising method for visualizing articulatory motion of speech in scientific research and clinical applications. However, characterization of the gestural and acoustical properties of the vocal tract remains a challenging task for DS-MRI because it requires: 1) reconstructing high-quality spatiotemporal images by incorporating stronger prior knowledge; and 2) quantitatively interpreting the reconstructed images that contain great motion variability. This work presents a novel imaging method that simultaneously meets both requirements by integrating a spatiotemporal atlas into a Partial Separability (PS) model-based imaging framework. Through the use of an atlas-driven sparsity constraint, this method is capable of capturing high-quality articulatory dynamics at an imaging speed of 102 frames per second and a spatial resolution of 2.2 x 2.2 mm(2). Moreover, the proposed method enables quantitative characterization of variability of speech motion, compared to the generic motion pattern across all subjects, through the spatial residual components.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Speech Analysis and Synthesis Based on Dynamic Modes
    Vargas, Julio
    McLaughlin, Stephen
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2011, 19 (08): : 2566 - 2578
  • [32] Speech Emotion Recognition Based on Dynamic Models
    Lv, Guoyun
    Hu, Shuixian
    Lu, Xipan
    2014 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), VOLS 1-2, 2014, : 480 - 484
  • [33] Quantifying articulatory variations across phonological environments: An atlas-based approach using dynamic magnetic resonance imaging
    Xing, Fangxu
    Zhuo, Jiachen
    Stone, Maureen
    Liu, Xiaofeng
    Reese, Timothy G.
    Wedeen, Van J.
    Prince, Jerry L.
    Woo, Jonghye
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2024, 156 (06): : 4000 - 4009
  • [34] Correction to: The Haskins pediatric atlas: a magnetic-resonance-imaging-based pediatric template and atlas
    Peter J. Molfese
    Daniel Glen
    Laura Mesite
    Robert W. Cox
    Fumiko Hoeft
    Stephen J. Frost
    W. Einar Mencl
    Kenneth R. Pugh
    Peter A. Bandettini
    Pediatric Radiology, 2021, 51 : 671 - 672
  • [35] Improving spatiotemporal resolution of USPIO-enhanced dynamic imaging of rat kidneys
    Sun, Y
    Yang, DW
    Ye, Q
    Williams, M
    Moura, JMF
    Boada, F
    Liang, ZP
    Ho, C
    MAGNETIC RESONANCE IMAGING, 2003, 21 (06) : 593 - 598
  • [36] Photoelectrochemical imaging system with high spatiotemporal resolution for visualizing dynamic cellular responses
    Zhou, Bo
    Das, Anirban
    Zhong, Muchun
    Guo, Qian
    Zhang, De-Wen
    Hing, Karin A.
    Sobrido, Ana Jorge
    Titirici, Maria-Magdalena
    Krause, Steffi
    BIOSENSORS & BIOELECTRONICS, 2021, 180
  • [37] Basque Popular Speech Atlas project
    Garcia, Txomin
    EUSKERA, 2010, 55 (01): : 537 - 538
  • [38] Spatiotemporal imaging, spatiotemporal pulse shaping, and spatiotemporal coherent control
    Koehl, RM
    Crimmins, TF
    Brennan, CJ
    Nelson, KA
    ULTRAFAST PHENOMENA XI, 1998, 63 : 92 - 94
  • [39] The 'Scenes' of the Dynamic Atlas
    Pugliano, Antonio
    RICERCHE DI STORIA DELL ARTE, 2021, 44 (02) : 65 - 68
  • [40] A dynamic brain atlas
    Hill, DLG
    Hajnal, JV
    Rueckert, D
    Smith, SM
    Hartkens, T
    McLeish, K
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION-MICCAI 2002, PT 1, 2002, 2488 : 532 - 539