Spatiotemporal-atlas-based Dynamic Speech Imaging

被引:3
|
作者
Fu, Maojing [1 ,2 ]
Woo, Jonghye [3 ]
Liang, Zhi-Pei [1 ,2 ]
Sutton, Bradley P. [2 ,4 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[3] Massachusetts Gen Hosp, Gordon Ctr Med Imaging, Boston, MA 02114 USA
[4] Univ Illinois, Dept Bioengn, Urbana, IL 61801 USA
关键词
speech imaging; dynamic MRI; partial separability; spatiotemporal atlas; sparsity constraint; LOW-RANK; MRI; RECONSTRUCTION; SPARSITY; REGISTRATION; ACQUISITION; IMPATIENT; MODEL;
D O I
10.1117/12.2216528
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Dynamic magnetic resonance imaging (DS-MRI) has been recognized as a promising method for visualizing articulatory motion of speech in scientific research and clinical applications. However, characterization of the gestural and acoustical properties of the vocal tract remains a challenging task for DS-MRI because it requires: 1) reconstructing high-quality spatiotemporal images by incorporating stronger prior knowledge; and 2) quantitatively interpreting the reconstructed images that contain great motion variability. This work presents a novel imaging method that simultaneously meets both requirements by integrating a spatiotemporal atlas into a Partial Separability (PS) model-based imaging framework. Through the use of an atlas-driven sparsity constraint, this method is capable of capturing high-quality articulatory dynamics at an imaging speed of 102 frames per second and a spatial resolution of 2.2 x 2.2 mm(2). Moreover, the proposed method enables quantitative characterization of variability of speech motion, compared to the generic motion pattern across all subjects, through the spatial residual components.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] High Spatiotemporal Imaging Based on Optical Field Engineering
    Li Runfeng
    Shi Kebin
    ACTA OPTICA SINICA, 2019, 39 (01)
  • [22] Dynamic spatiotemporal correlation coefficient based on adaptive weight
    Mo, Guoli
    Tan, Chunzhi
    Zhang, Weiguo
    Yu, Xuezeng
    FINANCIAL INNOVATION, 2023, 9 (01)
  • [23] Dynamic spatiotemporal correlation coefficient based on adaptive weight
    Guoli Mo
    Chunzhi Tan
    Weiguo Zhang
    Xuezeng Yu
    Financial Innovation, 9
  • [24] DYNAMIC VISUAL SALIENCY MODELING BASED ON SPATIOTEMPORAL ANALYSIS
    Chen, Duan-Yu
    Tyan, Hsiao-Rong
    Hsiao, Dun-Yu
    Shih, Sheng-Wen
    Liao, Hong-Yuan Mark
    2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4, 2008, : 1085 - 1088
  • [25] Neuromorphic Imaging With Density-Based Spatiotemporal Denoising
    Zhang, Pei
    Ge, Zhou
    Song, Li
    Lam, Edmund Y.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 530 - 541
  • [26] A spatiotemporal molecular atlas of the ovulating mouse ovary
    Mantri, Madhav
    Zhang, Hanxue Hannah
    Spanos, Emmanuel
    Ren, Yi A.
    De Vlaminck, Andiwijn
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2024, 121 (05)
  • [27] A spatiotemporal atlas of organogenesis in the development of orchid flowers
    Liu, Chang
    Leng, Jing
    Li, Yonglong
    Ge, Tingting
    Li, Jinglong
    Chen, Yamao
    Guo, Chunce
    Qi, Ji
    NUCLEIC ACIDS RESEARCH, 2022, 50 (17) : 9724 - 9737
  • [28] SCAN: Spatiotemporal Cloud Atlas for Neural cells
    Deng, Yushan
    Lu, Yubao
    Li, Mengrou
    Shen, Jiayi
    Qin, Siying
    Zhang, Wei
    Zhang, Qiang
    Shen, Zhaoyang
    Li, Changxiao
    Jia, Tengfei
    Chen, Peixin
    Peng, Lingmin
    Chen, Yangfeng
    Zhang, Wensheng
    Liu, Hebin
    Zhang, Liangming
    Rong, Limin
    Wang, Xiangdong
    Chen, Dongsheng
    NUCLEIC ACIDS RESEARCH, 2023, : D998 - D1009
  • [29] A spatiotemporal atlas of cholestatic injury and repair in mice
    Wu, Baihua
    Shentu, Xinyi
    Nan, Haitao
    Guo, Pengcheng
    Hao, Shijie
    Xu, Jiangshan
    Shangguan, Shuncheng
    Cui, Lei
    Cen, Jin
    Deng, Qiuting
    Wu, Yan
    Liu, Chang
    Song, Yumo
    Lin, Xiumei
    Wang, Zhifeng
    Yuan, Yue
    Ma, Wen
    Li, Ronghai
    Li, Yikang
    Qian, Qiwei
    Du, Wensi
    Lai, Tingting
    Yang, Tao
    Liu, Chuanyu
    Ma, Xiong
    Chen, Ao
    Xu, Xun
    Lai, Yiwei
    Liu, Longqi
    Esteban, Miguel A.
    Hui, Lijian
    NATURE GENETICS, 2024, 56 (05) : 938 - 952
  • [30] A spatiotemporal atlas of mouse liver homeostasis and regeneration
    Xu, Jiangshan
    Guo, Pengcheng
    Hao, Shijie
    Shangguan, Shuncheng
    Shi, Quan
    Volpe, Giacomo
    Huang, Keke
    Zuo, Jing
    An, Juan
    Yuan, Yue
    Cheng, Mengnan
    Deng, Qiuting
    Zhang, Xiao
    Lai, Guangyao
    Nan, Haitao
    Wu, Baihua
    Shentu, Xinyi
    Wu, Liang
    Wei, Xiaoyu
    Jiang, Yujia
    Huang, Xin
    Pan, Fengyu
    Song, Yumo
    Li, Ronghai
    Wang, Zhifeng
    Liu, Chuanyu
    Liu, Shiping
    Li, Yuxiang
    Yang, Tao
    Xu, Zhicheng
    Du, Wensi
    Li, Ling
    Ahmed, Tanveer
    You, Kai
    Dai, Zhen
    Li, Li
    Qin, Baoming
    Li, Yinxiong
    Lai, Liangxue
    Qin, Dajiang
    Chen, Junling
    Fan, Rong
    Li, Yongyin
    Hou, Jinlin
    Ott, Michael
    Sharma, Amar Deep
    Cantz, Tobias
    Schambach, Axel
    Kristiansen, Karsten
    Hutchins, Andrew P.
    NATURE GENETICS, 2024, 56 (05) : 953 - 969