Person Re-Identification With Visual Semantic Representation Mining and Reasoning

被引:0
|
作者
Zhao, Chuang [1 ]
Shi, Yuxuan [1 ]
Ling, Hefei [1 ]
Wang, Qian [1 ]
Zhao, Chengxin [1 ]
Chen, Jiazhong [1 ]
Li, Ping [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
基金
中国博士后科学基金;
关键词
Person Re-ID; semantic mining; attention mechanism; graph convolutional network; ATTENTION; NETWORK;
D O I
10.1109/TBIOM.2023.3281357
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification aims to match images of the same person in different scenarios. The challenge of this task is how to extract discriminative features from person images with complex background noise, severe occlusions and large pose variations. Recently, some studies have attempted to apply human semantic parsing or attention mechanisms to help capture human parts or important object regions. Despite the performance improvements, these methods either require the introduction of additional prior knowledge or ignore the connections between the human body parts. To solve the above problem, we propose a novel Visual Semantic Representation Mining and Reasoning (SRMR) block to capture more discriminative semantic features of person images. Specifically, to get rid of the restriction of the external model, we propose to directly mine the clustering relationship between each local feature in the global structure and obtain the discriminative region in the person image by voting. Then, to establish the relationship between person body parts, we utilize Graph Convolutional Networks (GCN) to effectively construct the correlation between body parts. Extensive ablation studies demonstrate that our SRMR block can significantly improve the feature representation power and achieve state-of-the-art performance on several popular benchmarks.
引用
收藏
页码:486 / 497
页数:12
相关论文
共 50 条
  • [1] Learning Semantic Representation on Visual Attribute Graph for Person Re-identification and Beyond
    Tang, Geyu
    Gao, Xingyu
    Chen, Zhenyu
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [2] Transferring a Semantic Representation for Person Re-Identification and Search
    Shi, Zhiyuan
    Hospedales, Timothy M.
    Xiang, Tao
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4184 - 4193
  • [3] Person Re-Identification by Semantic Region Representation and Topology Constraint
    Lei, Jianjun
    Niu, Lijie
    Fu, Huazhu
    Peng, Bo
    Huang, Qingming
    Hou, Chunping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (08) : 2453 - 2466
  • [4] Parts Semantic Segmentation Aware Representation Learning for Person Re-Identification
    Gao, Hua
    Chen, Shengyong
    Zhang, Zhaosheng
    APPLIED SCIENCES-BASEL, 2019, 9 (06):
  • [5] Multi-level semantic appearance representation for person re-identification system
    Fendri, Emna
    Frikha, Mayssa
    Hammami, Mohamed
    PATTERN RECOGNITION LETTERS, 2018, 115 : 30 - 38
  • [6] Semantic Part Constraint for Person Re-identification
    Chen Ying
    Chen Qiaoyuan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (12) : 3037 - 3044
  • [7] Human Semantic Parsing for Person Re-identification
    Kalayeh, Mahdi M.
    Basaran, Emrah
    Gokmen, Muhittin
    Kamasak, Mustafa E.
    Shah, Mubarak
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1062 - 1071
  • [8] Sparse representation matching for person re-identification
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    Bhanu, Bir
    INFORMATION SCIENCES, 2016, 355 : 74 - 89
  • [9] SSRR: Structural Semantic Representation Reconstruction for Visible-Infrared Person Re-Identification
    Yang, Xi
    Tian, Menghui
    Li, Meijie
    Wei, Ziyu
    Yuan, Liu
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6273 - 6284
  • [10] A Visual Surveillance System for Person Re-Identification
    El-Alfy, Hazem
    Muramatsu, Daigo
    Teranishi, Yuuichi
    Nishinaga, Nozomu
    Makihara, Yasushi
    Yagi, Yasushi
    THIRTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION 2017, 2017, 10338