Zero-Shot Classification Based on Multitask Mixed Attribute Relations and Attribute-Specific Features

被引:12
|
作者
Gong, Ping [1 ,2 ]
Wang, Xuesong [1 ,3 ]
Cheng, Yuhu [1 ,3 ]
Wang, Z. Jane [4 ]
Yu, Qiang [5 ]
机构
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Jiangsu, Peoples R China
[2] Xuzhou Med Univ, Sch Med Imaging, Xuzhou 221004, Jiangsu, Peoples R China
[3] Xuzhou Key Lab Artificial Intelligence & Big Data, Xuzhou 221116, Jiangsu, Peoples R China
[4] Univ British Columbia, Elect & Comp Engn Dept, Vancouver, BC V6T 1Z4, Canada
[5] China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Attribute relation learning; attribute-specific features; multitask; zero-shot classification; OBJECTS;
D O I
10.1109/TCDS.2019.2902250
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot classification is a hot topic in computer vision and pattern recognition. Most zero-shot classification methods are based on the intermediate level representation of attributes to achieve knowledge transfer from the training classes to the unseen test classes. Recently, multitask learning (MTL) has been shown as one of state-of-the-art approaches for attribute learning and zero-shot classification. Aiming at the attribute relation learning, features shared by attributes learning and attribute heterogeneity, we propose a zero-shot classification based on multitask mixed attribute relations and attribute-specific features. First, considering the relationship between attribute-attribute and attribute-features, a second-order attribute relation and attribute-specific features learning model is constructed from training samples based on MTL. Second, second-order attribute relation is extended to high-order attribute relation and multiple attribute classifiers are learned. Finally, zero-shot classification is completed based on the maximum posterior probability. Experimental results on AWA and PubFig data sets show that the proposed method can yield more accurate attribute prediction and zero-shot classification compared with several multitask attribute learning methods.
引用
收藏
页码:73 / 83
页数:11
相关论文
共 50 条
  • [1] Zero-Shot Image Classification Based on Attribute
    Zhang, Wei
    Chen, Wenbai
    Chen, Xiangfeng
    Han, Hu
    [J]. 2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 25 - 30
  • [2] Zero-Shot Learning Based on Multitask Extended Attribute Groups
    Wang, Xuesong
    Li, Qianyu
    Gong, Ping
    Cheng, Yuhu
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (03): : 2003 - 2011
  • [3] Attribute relation learning for zero-shot classification
    Liu, Mingxia
    Zhang, Daoqiang
    Chen, Songcan
    [J]. NEUROCOMPUTING, 2014, 139 : 34 - 46
  • [4] ATTRIBUTE DRIVEN ZERO-SHOT CLASSIFICATION AND SEGMENTATION
    Yang, Shu
    Shi, Yemin
    Wang, Yaowei
    Wang, Jing
    Fei, Zesong
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
  • [5] Zero-Shot Image Classification Method Based on Attribute Weighting
    Chen, Wenbai
    Chen, Xiangfeng
    Liu, Chang
    Wu, Hao
    Li, Denghua
    [J]. PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 84 - 88
  • [6] Learning Autoencoder of Attribute Constraint for Zero-Shot Classification
    Wang, Kun
    Wu, Songsong
    Gao, Guangwei
    Zhou, Quan
    Jing, Xiao-Yuan
    [J]. PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 605 - 610
  • [7] Learning Discriminative Instance Attribute for Zero-Shot Classification
    Wang, Lu
    Wu, Songsong
    Yu, Jun
    Jing, Xiao-Yuan
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), VOL 1, 2016, : 210 - 213
  • [8] Attribute-Based Classification for Zero-Shot Visual Object Categorization
    Lampert, Christoph H.
    Nickisch, Hannes
    Harmeling, Stefan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) : 453 - 465
  • [9] Attribute-Based Zero-Shot Learning for Encrypted Traffic Classification
    Hu, Ying
    Cheng, Guang
    Chen, Wenchao
    Jiang, Bomiao
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4583 - 4599
  • [10] Hierarchical Zero-Shot Classification with Convolutional Neural Network Features and Semantic Attribute Learning
    Markowitz, Jared
    Schmidt, Aurora C.
    Burlina, Philippe M.
    Wang, I-Jeng
    [J]. PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 194 - 197