Multi-human Parsing with a Graph-based Generative Adversarial Model

被引:16
|
作者
Li, Jianshu [1 ]
Zhao, Jian [3 ]
Lang, Congyan [4 ]
Li, Yidong [4 ]
Wei, Yunchao [5 ]
Guo, Guodong [6 ]
Sim, Terence [1 ]
Yan, Shuicheng [7 ]
Feng, Jiashi [2 ]
机构
[1] Natl Univ Singapore, 13 Comp Dr, Singapore 117417, Singapore
[2] Natl Univ Singapore, 4 Engn Dr 3, Singapore 117583, Singapore
[3] Inst North Elect Equipment, Beijing Haidian Dist, Peoples R China
[4] Beijing Jiaotong Univ, Beijing 100044, Peoples R China
[5] Univ Technol Sydney, 15 Broadway, Ultimo, NSW 2007, Australia
[6] Baidu IDL, Beijing 100085, Peoples R China
[7] Yitu Technol, Beijing, Peoples R China
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Human parsing; multi-human parsing; human-centric image analysis; generative adversarial networks; graph convolution network;
D O I
10.1145/3418217
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human parsing is an important task in human-centric image understanding in computer vision and multimedia systems. However, most existing works on human parsing mainly tackle the single-person scenario, which deviates from real-world applications where multiple persons are present simultaneously with interaction and occlusion. To address such a challenging multi-human parsing problem, we introduce a novel multi-human parsing model named MI-I-Parser, which uses a graph-based generative adversarial model to address the challenges of close-person interaction and occlusion in multi-human parsing. To validate the effectiveness of the new model, we collect a new dataset named Multi-Human Parsing (MHP), which contains multiple persons with intensive person interaction and entanglement. Experiments on the new MHP dataset and existing datasets demonstrate that the proposed method is effective in addressing the multi-human parsing problem compared with existing solutions in the literature.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Multi-human Parsing Based on Dynamic Convolution
    Yan, Min
    Zhang, Guoshan
    Zhang, Tong
    Zhang, Yueming
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7185 - 7190
  • [2] Multi-Human Parsing Machines
    Li, Jianshu
    Zhao, Jian
    Chen, Yunpeng
    Roy, Sujoy
    Yan, Shuicheng
    Feng, Jiashi
    Sim, Terence
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 45 - 53
  • [3] Fine-Grained Multi-human Parsing
    Zhao, Jian
    Li, Jianshu
    Liu, Hengzhu
    Yan, Shuicheng
    Feng, Jiashi
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (8-9) : 2185 - 2203
  • [4] Fine-Grained Multi-human Parsing
    Jian Zhao
    Jianshu Li
    Hengzhu Liu
    Shuicheng Yan
    Jiashi Feng
    [J]. International Journal of Computer Vision, 2020, 128 : 2185 - 2203
  • [5] Generative Modeling of Multimodal Multi-Human Behavior
    Ivanovic, Boris
    Schmerling, Edward
    Leung, Karen
    Pavone, Marco
    [J]. 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 3088 - 3095
  • [6] Understanding Humans in Crowded Scenes: Deep Nested Adversarial Learning and A New Benchmark for Multi-Human Parsing
    Zhao, Jian
    Li, Jianshu
    Cheng, Yu
    Sim, Terence
    Yan, Shuicheng
    Feng, Jiashi
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 792 - 800
  • [7] An Effective Neural Network Model for Graph-based Dependency Parsing
    Pei, Wenzhe
    Ge, Tao
    Chang, Baobao
    [J]. PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, 2015, : 313 - 322
  • [8] Nondiscriminatory treatment: A straightforward framework for multi-human parsing
    Yan, Min
    Zhang, Guoshan
    Zhang, Tong
    Zhang, Yueming
    [J]. NEUROCOMPUTING, 2021, 460 : 126 - 138
  • [9] Graph-based Dependency Parsing with Graph Neural Networks
    Ji, Tao
    Wu, Yuanbin
    Lan, Man
    [J]. 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2475 - 2485
  • [10] UniParser: Multi-Human Parsing With Unified Correlation Representation Learning
    Chu, Jiaming
    Jin, Lei
    Teng, Yinglei
    Li, Jianshu
    Wei, Yunchao
    Wang, Zheng
    Xing, Junliang
    Yan, Shuicheng
    Zhao, Jian
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5159 - 5171