Aesthetic Attributes Assessment of Images

被引:24
|
作者
Jin, Xin [1 ,2 ]
Wu, Le [1 ]
Zhao, Geng [1 ]
Li, Xiaodong [1 ]
Zhang, Xiaokun [1 ]
Ge, Shiming [3 ]
Zou, Dongqing [4 ]
Zhou, Bin [5 ]
Zhou, Xinghui [1 ]
机构
[1] Beijing Elect Sci & Technol Inst, Dept Cyber Secur, Beijing 100070, Peoples R China
[2] CETC Big Data Res Inst Co Ltd, Guiyang 550018, Guizhou, Peoples R China
[3] Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China
[4] SenseTime Res, Beijing 100084, Peoples R China
[5] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
aesthetic assessment; image captioning; semi-supervised learning;
D O I
10.1145/3343031.3350970
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes captioning. This is a new formula of image aesthetic assessment, which predicts aesthetic attributes captions together with the aesthetic score of each attribute. We introduce a new dataset named DPC-Captions which contains comments of up to 5 aesthetic attributes of one image through knowledge transfer from a full-annotated small-scale dataset. Then, we propose Aesthetic Multi-Attribute Network (AMAN), which is trained on a mixture of fully-annotated small-scale PCCD dataset and weakly-annotated large-scale DPC-Captions dataset. Our AMAN makes full use of transfer learning and attention model in a single framework. The experimental results on our DPC-Captions and PCCD dataset reveal that our method can predict captions of 5 aesthetic attributes together with numerical score assessment of each attribute. We use the evaluation criteria used in image captions to prove that our specially designed AMAN model outperforms traditional CNN-LSTM model and modern SCA-CNN model of image captions.
引用
收藏
页码:311 / 319
页数:9
相关论文
共 50 条
  • [1] Multiple Aesthetic Attribute Assessment by Exploiting Relations Among Aesthetic Attributes
    Gao, Zhen
    Wang, Shangfei
    Ji, Qiang
    ICMR'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2015, : 575 - 578
  • [2] Aesthetic Quality Assessment of Photographic Images
    Song, Chunjin
    Zhou, Bingyin
    Guo, Wei
    PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 3088 - 3093
  • [3] Composition and Style Attributes Guided Image Aesthetic Assessment
    Celona, Luigi
    Leonardi, Marco
    Napoletano, Paolo
    Rozza, Alessandro
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5009 - 5024
  • [4] Cognitive attributes and aesthetic preferences in assessment and differentiation of landscapes
    Sevenant, Marjanne
    Antrop, Marc
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2009, 90 (09) : 2889 - 2899
  • [5] AUTOMATIC AESTHETIC VALUE ASSESSMENT IN PHOTOGRAPHIC IMAGES
    Jiang, Wei
    Loui, Alexander C.
    Cerosaletti, Cathleen Daniels
    2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010), 2010, : 920 - 925
  • [6] Image Aesthetic Assessment Assisted by Attributes through Adversarial Learning
    Pan, Bowen
    Wang, Shangfei
    Jiang, Qisheng
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 679 - 686
  • [7] Assessment Method for Agricultural Landscapes through the Objective Quantification of Aesthetic Attributes
    Zubelzu, S.
    del Campo, C.
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH, 2014, 8 (04) : 1251 - 1260
  • [8] Gourmet Photography Dataset for Aesthetic Assessment of Food Images
    Sheng, Kekai
    Dong, Weiming
    Huang, Haibin
    Ma, Chongyang
    Hu, Bao-Gang
    SA'18: SIGGRAPH ASIA 2018 TECHNICAL BRIEFS, 2018,
  • [9] Assessment method for forest landscapes based on aesthetic attributes as explanatory variables of preferences
    Zubelzu, Sergio
    Hernandez, Ana
    MADERA Y BOSQUES, 2015, 21 (01): : 45 - 62
  • [10] An interpretable approach for automatic aesthetic assessment of remote sensing images
    Tong, Jingru
    Zhang, Guo
    Kong, Peijie
    Rao, Yu
    Wei, Zhengkai
    Cui, Hao
    Guan, Qing
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16