Visualizing Natural Language Descriptions: A Survey

被引:24
|
作者
Hassani, Kaveh [1 ]
Lee, Won-Sook [1 ]
机构
[1] Univ Ottawa, Sch Comp Sci & Elect Engn, Ottawa, ON K1N 6N5, Canada
关键词
Text-to-picture conversion; text-to-scene conversion; text-to-animation conversion; natural language understanding; symbol grounding; CONVERSION; TOOL;
D O I
10.1145/2932710
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A natural language interface exploits the conceptual simplicity and naturalness of the language to create a high-level user-friendly communication channel between humans and machines. One of the promising applications of such interfaces is generating visual interpretations of semantic content of a given natural language that can be then visualized either as a static scene or a dynamic animation. This survey discusses requirements and challenges of developing such systems and reports 26 graphical systems that exploit natural language interfaces and addresses both artificial intelligence and visualization aspects. This work serves as a frame of reference to researchers and to enable further advances in the field.
引用
收藏
页数:34
相关论文
共 50 条
  • [1] Generating Customizable Natural Language Descriptions
    Costa, A.
    Paraboni, I
    [J]. IEEE LATIN AMERICA TRANSACTIONS, 2019, 17 (08) : 1252 - 1258
  • [2] NATURAL-LANGUAGE DESCRIPTIONS OF PROCEDURES
    OLSON, GM
    TRAHAN, M
    ROSHWALB, L
    EATON, M
    [J]. BULLETIN OF THE PSYCHONOMIC SOCIETY, 1983, 21 (05) : 353 - 353
  • [3] Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
    Feng, Qi
    Ablavsky, Vitaly
    Bai, Qinxun
    Sclaroff, Stan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5847 - 5856
  • [4] Capturing Assertions from Natural Language Descriptions
    Harris, Ian G.
    [J]. 2013 1ST INTERNATIONAL WORKSHOP ON NATURAL LANGUAGE ANALYSIS IN SOFTWARE ENGINEERING (NATURALISE), 2013, : 17 - 24
  • [5] RHETORICAL VARIANCE IN NATURAL-LANGUAGE DESCRIPTIONS
    MAYBURY, MT
    [J]. SCANDINAVIAN CONFERENCE ON ARTIFICIAL INTELLIGENCE - 89, 1989, : 819 - 823
  • [6] Generating natural language descriptions of project plans
    Wasko, M
    Dale, R
    [J]. ADVANCED TOPICS IN ARTIFICIAL INTELLIGENCE, 1999, 1747 : 109 - 121
  • [7] Formal Reasoning on Natural Language Descriptions of Processes
    Sanchez-Ferreres, Josep
    Burattin, Andrea
    Carmona, Josep
    Montali, Marco
    Padro, Lluis
    [J]. BUSINESS PROCESS MANAGEMENT (BPM 2019), 2019, 11675 : 86 - 101
  • [8] Semantic Novelty Detection in Natural Language Descriptions
    Ma, Nianzu
    Politowicz, Alexander
    Mazumder, Sahisnu
    Chen, Jiahua
    Liu, Bing
    Robertson, Eric
    Grigsby, Scott
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 866 - 882
  • [9] Translating Video Content to Natural Language Descriptions
    Rohrbach, Marcus
    Qiu, Wei
    Titov, Ivan
    Thater, Stefan
    Pinkal, Manfred
    Schiele, Bernt
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 433 - 440
  • [10] Generating Natural Language Descriptions From Tables
    Cao, Juan
    [J]. IEEE ACCESS, 2020, 8 : 46206 - 46216