Towards Object Descriptions in Natural Language from Qualitative Models

被引：2

作者：

Falomir, Zoe ^{[1
]}

Museros, Lledo ^{[1
]}

Rodenas, Pablo ^{[1
]}

Sanz, Ismael ^{[1
]}

机构：

[1] Univ Jaume 1, E-12071 Castellon de La Plana, Spain

来源：

ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT | 2012年 / 248卷

关键词：

qualitative shape and colour; context-free grammar; natural language;

D O I：

10.3233/978-1-61499-139-7-59

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

An approach is presented aimed to produce narrative descriptions of objects within digital images which are understandable by human beings. A context-free grammar is defined based on qualitative models for colour and shape description. This approach was tested using images of the MPEG-7 CE Shape-1 library and images of tile geometric pieces. The results show that a general or detailed narrative description can be obtained from different kinds of images containing one or more objects and they also support the further application of our approach to (i) teach children about shapes by giving them instructions on how play the game known as join-the-dots and (ii) help children with visual impairments to carry out visual oddity tasks in psychological tests.

引用

页码：59 / 68

页数：10

共 50 条

[1] Framer: Planning Models from Natural Language Action Descriptions
Lindsay, Alan
Read, Jonathon
Ferreira, Joao F.
Hayton, Thomas
Porteous, Julie
Gregory, Peter
[J]. TWENTY-SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATED PLANNING AND SCHEDULING, 2017, : 434 - 442
[2] Generating Formal System Models from Natural Language Descriptions
Drechsler, Rolf
Harris, Ian G.
Wille, Robert
[J]. 2012 IEEE INTERNATIONAL HIGH LEVEL DESIGN VALIDATION AND TEST WORKSHOP (HLDVT), 2012, : 164 - +
[3] The identification of index terms in natural language object descriptions
Heidorn, PB
[J]. ASIS 99: PROCEEDINGS OF THE 62ND ASIS ANNUAL MEETING, VOL 36, 1999: KNOWLEDGE: CREATION ORGANIZATION AND USE, 1999, 36 : 472 - 481
[4] Towards a Qualitative Representation for Specifying Natural Language
Dapoigny, Richard
Barlatier, Patrick
[J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA), 2017, : 42 - 47
[5] Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptions
Fakhoury, Sarah
Musuvathi, Madan
Chakraborty, Saikat
Lahiri, Shuvendu K.
[J]. arXiv, 2023,
[6] Natural Language Generation of Museum Object Descriptions based on User Model
Chen, Hsiao Wei
Lim, Mary Grace
Perez, Patricia Bea
Reyes, Joanna Patricia
Lim, Nathalie Rose
[J]. PACLIC 22: PROCEEDINGS OF THE 22ND PACIFIC ASIA CONFERENCE ON LANGUAGE, INFORMATION AND COMPUTATION, 2008, : 141 - 150
[7] Improving Object Disambiguation from Natural Language using Empirical Models
Prendergast, Daniel
Szafir, Daniel
[J]. ICMI'18: PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2018, : 477 - 485
[8] Capturing Assertions from Natural Language Descriptions
Harris, Ian G.
[J]. 2013 1ST INTERNATIONAL WORKSHOP ON NATURAL LANGUAGE ANALYSIS IN SOFTWARE ENGINEERING (NATURALISE), 2013, : 17 - 24
[9] Generating Natural Language Descriptions From Tables
Cao, Juan
[J]. IEEE ACCESS, 2020, 8 (08): : 46206 - 46216
[10] Automatically Generating Natural Language Descriptions for Object-Related Statement Sequences
Wang, Xiaoran
Pollock, Lori
Vijay-Shanker, K.
[J]. 2017 IEEE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION, AND REENGINEERING (SANER), 2017, : 205 - 216

← 1 2 3 4 5 →