Scene Attribute Semantic Relational Regularization for Transport-Travel Scene Understanding

被引:0
|
作者
Wei, Xin Lei [1 ]
Cheng, Ruifen [2 ]
Liu, Yingji [1 ]
Zhou, Wei [1 ]
Tian, Daxin [3 ]
机构
[1] Minist Transport, Res Inst Highway, Beijing 10088, Peoples R China
[2] Zhengzhou Univ Ind Technol, Sch Management, Zhengzhou 451150, Peoples R China
[3] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Visualization; Sun; Optimization; Task analysis; Semisupervised learning; Topology; Homeomorphism; scene recognition; attribute learning; cross-media; semantic relation; transport-travel scene; crowd scene;
D O I
10.1109/ACCESS.2020.3001294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Attribute learning has improved the performance in scene understanding and scene recognition. However, there are many attributes described by words or short texts in a static scene and traffic crowd scene. If there are two similar scenes, the semantic relationship topology structures of corresponding attribute groups of the two scenes are also homogeneity. But it is difficult to learn a semantic relation topology projection across semantic text data and visual data. To solve the problem, we construct approximate homeomorphism mapping based on the scene attributes semantic relational regularization. Hence, we propose a novel attribute semantic topological relationship regularization based scene attribute semantic learning(ARSL) method for scene semantic understanding. We establish a transport and travel scene recognition model based on attribute semantic features which are achieved by the proposed ARSL algorithm. In order to verify the proposed method, the experiments are implemented on the static transport-travel scene dataset and dynamic transport-travel crowds scene dataset respectively. The static transport-travel scene dataset is constructed by the SUN Attribute dataset including images and texts. However, the dynamic transport-travel crowds scene dataset is constructed through the WWW Crowd dataset including videos and texts, and the dynamic transport-travel crowd scene dataset is named as the WWW Crowd-Sub dataset. The performances of the proposed method are improved by 38.48% and 17.51% on the SUN Attribute dataset and WWW Crowd-Sub dataset respectively. The experimental results on the SUN Attribute dataset and WWW Crowd-Sub dataset demonstrate that the proposed approach has superior performance compared to state of the art. It can be demonstrated that the performance of the proposed ARSL method is effective against static transport-travel scene and dynamic transport-travel crowd scene.
引用
收藏
页码:118083 / 118100
页数:18
相关论文
共 50 条
  • [1] Rainy Night Scene Understanding With Near Scene Semantic Adaptation
    Di, Shuai
    Feng, Qi
    Li, Chun-Guang
    Zhang, Mei
    Zhang, Honggang
    Elezovikj, Semir
    Tan, Chiu C.
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (03) : 1594 - 1602
  • [2] Representation Learning for Semantic Scene Understanding
    Farshad, Azade
    [J]. HHAI 2023: AUGMENTING HUMAN INTELLECT, 2023, 368 : 445 - 458
  • [3] Indoor Scene Understanding with Geometric and Semantic Contexts
    Choi, Wongun
    Chao, Yu-Wei
    Pantofaru, Caroline
    Savarese, Silvio
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 112 (02) : 204 - 220
  • [4] Exploiting context for semantic scene content understanding
    Luo, Jiebo
    [J]. ICIS '06: INTERNATIONAL CONGRESS OF IMAGING SCIENCE, FINAL PROGRAM AND PROCEEDINGS: LINKING THE EXPLOSION OF IMAGING APPLICATIONS WITH THE SCIENCE AND TECHNOLOGY OF IMAGING, 2006, : 479 - 479
  • [5] Semantic Foggy Scene Understanding with Synthetic Data
    Sakaridis, Christos
    Dai, Dengxin
    Van Gool, Luc
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (09) : 973 - 992
  • [6] Adopting Abstract Images for Semantic Scene Understanding
    Zitnick, C. Lawrence
    Vedantam, Ramakrishna
    Parikh, Devi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (04) : 627 - 638
  • [7] The Cityscapes Dataset for Semantic Urban Scene Understanding
    Cordts, Marius
    Omran, Mohamed
    Ramos, Sebastian
    Rehfeld, Timo
    Enzweiler, Markus
    Benenson, Rodrigo
    Franke, Uwe
    Roth, Stefan
    Schiele, Bernt
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3213 - 3223
  • [8] Indoor Scene Understanding with Geometric and Semantic Contexts
    Wongun Choi
    Yu-Wei Chao
    Caroline Pantofaru
    Silvio Savarese
    [J]. International Journal of Computer Vision, 2015, 112 : 204 - 220
  • [9] Semantic Foggy Scene Understanding with Synthetic Data
    Christos Sakaridis
    Dengxin Dai
    Luc Van Gool
    [J]. International Journal of Computer Vision, 2018, 126 : 973 - 992
  • [10] LEARNABLE CONTEXTUAL REGULARIZATION FOR SEMANTIC SEGMENTATION OF INDOOR SCENE IMAGES
    Chu, Jun
    Xiao, Xu
    Meng, Gaofeng
    Wang, Lingfeng
    Pan, Chunhong
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1267 - 1271