Visualizing Natural Language Descriptions: A Survey

被引:24
|
作者
Hassani, Kaveh [1 ]
Lee, Won-Sook [1 ]
机构
[1] Univ Ottawa, Sch Comp Sci & Elect Engn, Ottawa, ON K1N 6N5, Canada
关键词
Text-to-picture conversion; text-to-scene conversion; text-to-animation conversion; natural language understanding; symbol grounding; CONVERSION; TOOL;
D O I
10.1145/2932710
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A natural language interface exploits the conceptual simplicity and naturalness of the language to create a high-level user-friendly communication channel between humans and machines. One of the promising applications of such interfaces is generating visual interpretations of semantic content of a given natural language that can be then visualized either as a static scene or a dynamic animation. This survey discusses requirements and challenges of developing such systems and reports 26 graphical systems that exploit natural language interfaces and addresses both artificial intelligence and visualization aspects. This work serves as a frame of reference to researchers and to enable further advances in the field.
引用
收藏
页数:34
相关论文
共 50 条
  • [21] Video Event Understanding using Natural Language Descriptions
    Ramanathan, Vignesh
    Liang, Percy
    Li Fei-Fei
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 905 - 912
  • [22] Analyzing the Gap Between Workflows and their Natural Language Descriptions
    Groth, Paul
    Gil, Yolanda
    [J]. 2009 IEEE CONGRESS ON SERVICES (SERVICES-1 2009), VOLS 1 AND 2, 2009, : 299 - 305
  • [23] Leveraging a Corpus of Natural Language Descriptions for Program Similarity
    Zilberstein, Meital
    Yahav, Eran
    [J]. ONWARD!'16: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL SYMPOSIUM ON NEW IDEAS, NEW PARADIGMS, AND REFLECTIONS ON PROGRAMMING AND SOFTWARE, 2016, : 197 - 211
  • [24] Generating Parametric BRDFs from Natural Language Descriptions
    Memery, Sean
    Cedron, Osmar
    Subr, Kartic
    [J]. COMPUTER GRAPHICS FORUM, 2023, 42 (07)
  • [25] The Role of Context in the Interpretation of Natural Language Location Descriptions
    Stock, Kristin
    Hall, Mark
    [J]. PROCEEDINGS OF WORKSHOPS AND POSTERS AT THE 13TH INTERNATIONAL CONFERENCE ON SPATIAL INFORMATION THEORY (COSIT 2017), 2018, : 245 - 254
  • [26] Characterizing the Natural Language Descriptions in Software Logging Statements
    He, Pinjia
    Chen, Zhuangbin
    He, Shilin
    Lyu, Michael R.
    [J]. PROCEEDINGS OF THE 2018 33RD IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMTED SOFTWARE ENGINEERING (ASE' 18), 2018, : 178 - 189
  • [27] Zoom: a corpus of natural language descriptions of map locations
    Altamirano, Romina
    Ferreira, Thiago C.
    Paraboni, Ivandre
    Benotti, Luciana
    [J]. PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL) AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (IJCNLP), VOL 2, 2015, : 69 - 75
  • [28] The identification of index terms in natural language object descriptions
    Heidorn, PB
    [J]. ASIS 99: PROCEEDINGS OF THE 62ND ASIS ANNUAL MEETING, VOL 36, 1999: KNOWLEDGE: CREATION ORGANIZATION AND USE, 1999, 36 : 472 - 481
  • [29] Detecting geospatial location descriptions in natural language text
    Stock, Kristin
    Jones, Christopher B.
    Russell, Shaun
    Radke, Mansi
    Das, Prarthana
    Aflaki, Niloofar
    [J]. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2022, 36 (03) : 547 - 584
  • [30] Natural Language Reasoning, A Survey
    Yu, Fei
    Zhang, Hongbo
    Tiwari, Prayag
    Wang, Benyou
    [J]. ACM Computing Surveys, 2024, 56 (12)