Captioning System with Function of Inserting Mathematical Formula Images

被引:0
|
作者
Takeuchi, Yoshinori [1 ]
Sato, Yuji [1 ]
Horiike, Kazuki [2 ]
Wakatsuki, Daisuke [3 ]
Minagawa, Hiroki [3 ]
Ohnishi, Noboru [2 ]
机构
[1] Daido Univ, Sch Informat, Dept Informat Syst, Minami Ku, 10-3 Takiharu Cho, Nagoya, Aichi 4578530, Japan
[2] Nagoya Univ, Grad Sch Informat Sci, Chikusa Ku, Nagoya, Aichi 4648603, Japan
[3] Tsukuba Univ Technol, Fac Ind Technol, Tsukuba, Ibaraki 3058520, Japan
关键词
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose a captioning system with a function of inserting mathematical formula images. [We match/The system matches?] mathematical formulas presented orally during a lecture with those simultaneously projected on a screen in the lecture room. We then manually extract the mathematical formula images from the screen for displaying on the monitor of the system. A captionist can input mathematical formulas by pressing a corresponding function key. This is much easier than inputting mathematical formulas by typing. We conducted an experiment in which participants evaluated the usefulness of the proposed captioning system. Experimental results showed that 14 of the 22 participants could input more sentences when using the function of inserting mathematical formula images than when not using it. Furthermore, from the results of a questionnaire, we could confirm that the proposed system is effective.
引用
收藏
页码:33 / 40
页数:8
相关论文
共 50 条
  • [1] Performance evaluation of a mathematical formula recognition system with a large scale of printed formula images
    Ashida, Kazuki
    Okamoto, Masayuki
    Imai, Hiroki
    [J]. SECOND INTERNATIONAL CONFERENCE ON DOCUMENT IMAGE ANALYSIS FOR LIBRARIES, PROCEEDINGS, 2006, : 320 - +
  • [2] Mathematical Formula Detection in Heterogeneous Document Images
    Chu, Wei-Ta
    Liu, Fan
    [J]. 2013 CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI), 2013, : 140 - 145
  • [3] Database of handwritten Arabic mathematical formula images
    Hadj Ali, Ibtissem
    Mahjoub, Mohammed Ali
    [J]. 2016 13TH INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS, IMAGING AND VISUALIZATION (CGIV), 2016, : 145 - 149
  • [4] A formula for inserting point masses
    Wong, Manwah Lilian
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2009, 233 (03) : 852 - 855
  • [5] An Improved Algorithm for Symbol Segmentation of Mathematical Formula Images
    Wang, Haiyan
    Wang, Yu
    Lu, Liying
    Liu, Jianhang
    Li, Shibao
    Zhang, Yang
    [J]. 2016 16TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2016, : 461 - 464
  • [6] Mathematical formula information retrieval system
    Hou, Yong
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2023, 23 (06) : 2949 - 2973
  • [7] Mathematical formula detection in document images: A new dataset and a new
    Hu, Kai
    Zhong, Zhuoyao
    Sun, Lei
    Huo, Qiang
    [J]. PATTERN RECOGNITION, 2024, 148
  • [8] Captioning Ultrasound Images Automatically
    Alsharid, Mohammad
    Sharma, Harshita
    Drukker, Lior
    Chatelain, Pierre
    Papageorghiou, Aris T.
    Noble, J. Alison
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 338 - 346
  • [9] Captioning Images with Diverse Objects
    Venugopalan, Subhashini
    Mooney, Raymond
    Hendricks, Lisa Anne
    Darrell, Trevor
    Rohrbach, Marcus
    Saenko, Kate
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1170 - 1178
  • [10] Captioning the Images: A Deep Analysis
    Chaudhari, Chaitrali P.
    Devane, Satish
    [J]. COMPUTING, COMMUNICATION AND SIGNAL PROCESSING, ICCASP 2018, 2019, 810 : 987 - 999