Natural language descriptions of human Behavior from video sequences

被引:0
|
作者
Tena, Carles Fernandez [1 ]
Baiget, Pau [1 ]
Roca, Xavier [1 ]
Gonzalez, Jordi [2 ]
机构
[1] Comp Vis Ctr, Edifici O Campus UAB, Bellaterra 08193, Spain
[2] UPC, Inst Robot Informat Ind, Barcelona 08028, Spain
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This contribution addresses the generation of textual descriptions in several natural languages for evaluation of human behavior in video sequences. The problem is tackled by converting geometrical information extracted from videos of the scenario into predicates in fuzzy logic formalism, which facilitates the internal representations of the conceptual data and allows the temporal analysis of situations in a deterministic fashion, by means of Situation Graph Trees (SGTs). The results of the analysis are stored in structures proposed by the Discourse Representation Theory (DRT), which facilitate a subsequent generation of natural language text. This set of tools has been proved to be perfectly suitable for the specified purpose.
引用
收藏
页码:279 / +
页数:3
相关论文
共 50 条
  • [1] Generating natural language description of human behavior from video images
    Kojima, A
    Izumi, M
    Tamura, T
    Fukunaga, K
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS: APPLICATIONS, ROBOTICS SYSTEMS AND ARCHITECTURES, 2000, : 728 - 731
  • [2] Translating Video Content to Natural Language Descriptions
    Rohrbach, Marcus
    Qiu, Wei
    Titov, Ivan
    Thater, Stefan
    Pinkal, Manfred
    Schiele, Bernt
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 433 - 440
  • [3] Video Event Understanding using Natural Language Descriptions
    Ramanathan, Vignesh
    Liang, Percy
    Li Fei-Fei
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 905 - 912
  • [4] A framework for creating natural language descriptions of video streams
    Khan, Muhammad Usman Ghani
    Al Harbi, Nouf
    Gotoh, Yoshihiko
    [J]. INFORMATION SCIENCES, 2015, 303 : 61 - 82
  • [5] Programming in Natural Language: Building Algorithms from Human Descriptions
    Wachtel, Alexander
    Eurich, Felix
    Tichy, Walter F.
    [J]. ACHI 2018: THE ELEVENTH INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTER-HUMAN INTERACTIONS, 2018, : 51 - 59
  • [6] Automatically Generating Tests from Natural Language Descriptions of Software Behavior
    Kamalakar, Sunil
    Edwards, Stephen H.
    Dao, Tung M.
    [J]. ENASE: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON EVALUATION OF NOVEL APPROACHES TO SOFTWARE ENGINEERING, 2013, : 238 - 245
  • [7] Conceptual representations between video signals and natural language descriptions
    Arens, M.
    Gerber, R.
    Nagel, H. -H.
    [J]. IMAGE AND VISION COMPUTING, 2008, 26 (01) : 53 - 66
  • [8] Capturing Assertions from Natural Language Descriptions
    Harris, Ian G.
    [J]. 2013 1ST INTERNATIONAL WORKSHOP ON NATURAL LANGUAGE ANALYSIS IN SOFTWARE ENGINEERING (NATURALISE), 2013, : 17 - 24
  • [9] Generating Natural Language Descriptions From Tables
    Cao, Juan
    [J]. IEEE ACCESS, 2020, 8 : 46206 - 46216
  • [10] Automatically Generating Natural Language Descriptions for Object-Related Statement Sequences
    Wang, Xiaoran
    Pollock, Lori
    Vijay-Shanker, K.
    [J]. 2017 IEEE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION, AND REENGINEERING (SANER), 2017, : 205 - 216