Aesthetic Attributes Assessment of Images

被引:24
|
作者
Jin, Xin [1 ,2 ]
Wu, Le [1 ]
Zhao, Geng [1 ]
Li, Xiaodong [1 ]
Zhang, Xiaokun [1 ]
Ge, Shiming [3 ]
Zou, Dongqing [4 ]
Zhou, Bin [5 ]
Zhou, Xinghui [1 ]
机构
[1] Beijing Elect Sci & Technol Inst, Dept Cyber Secur, Beijing 100070, Peoples R China
[2] CETC Big Data Res Inst Co Ltd, Guiyang 550018, Guizhou, Peoples R China
[3] Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China
[4] SenseTime Res, Beijing 100084, Peoples R China
[5] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
aesthetic assessment; image captioning; semi-supervised learning;
D O I
10.1145/3343031.3350970
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes captioning. This is a new formula of image aesthetic assessment, which predicts aesthetic attributes captions together with the aesthetic score of each attribute. We introduce a new dataset named DPC-Captions which contains comments of up to 5 aesthetic attributes of one image through knowledge transfer from a full-annotated small-scale dataset. Then, we propose Aesthetic Multi-Attribute Network (AMAN), which is trained on a mixture of fully-annotated small-scale PCCD dataset and weakly-annotated large-scale DPC-Captions dataset. Our AMAN makes full use of transfer learning and attention model in a single framework. The experimental results on our DPC-Captions and PCCD dataset reveal that our method can predict captions of 5 aesthetic attributes together with numerical score assessment of each attribute. We use the evaluation criteria used in image captions to prove that our specially designed AMAN model outperforms traditional CNN-LSTM model and modern SCA-CNN model of image captions.
引用
收藏
页码:311 / 319
页数:9
相关论文
共 50 条
  • [31] Automatic Aesthetic Quality Assessment Of Photographic Images Using Deep Convolutional Neural Network
    Suran, Sruthy
    Sreekumar, K.
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE (ICIS), 2016, : 77 - 82
  • [32] NEW IMAGES + AESTHETIC PROBLEMS WITH ELECTRONICALLY PRODUCED IMAGES
    MARCO
    CHANGE INTERNATIONAL, 1984, (02): : 101 - 103
  • [33] Consumers' WTP for Sustainability Turfgrass Attributes with Consideration of Aesthetic Attributes and Water Conservation Policies
    Jung, Hyojae
    Chung, Chanjin
    AGRICULTURE-BASEL, 2024, 14 (01):
  • [34] Attributes of images in describing tasks
    Jorgensen, C
    INFORMATION PROCESSING & MANAGEMENT, 1998, 34 (2-3) : 161 - 174
  • [35] Attributes in Multiple Facial Images
    Liu, Xudong
    Guo, Guodong
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 318 - 324
  • [36] LOCAL ANISOTROPIC ATTRIBUTES OF IMAGES
    POPOV, PG
    JOURNAL OF OPTICAL TECHNOLOGY, 1994, 61 (02) : 127 - 130
  • [37] Developing perceptual scales to measure properties of aesthetic attributes
    Zanker, Johannes M.
    Holmes, Tim
    Stevanov, Jasmina
    PERCEPTION, 2015, 44 : 66 - 66
  • [38] Categorization of Aesthetic Pleasure Derived Attributes: A Cultural Perspective
    Henao, Angela
    ADVANCES IN AFFECTIVE AND PLEASURABLE DESIGN (AHFE 2017), 2018, 585 : 479 - 488
  • [39] Aesthetic multi-attributes network for image captioning
    Yang, Hongtao
    Li, Yuchen
    Jin, Xin
    Zhou, Xinghui
    Shi, Ping
    Liu, Yehui
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
  • [40] Aesthetic Multi-attributes Captioning Network for Photos
    Yang, Hongtao
    Li, Yuchen
    Zhou, Xinghui
    Jin, Xin
    Shi, Ping
    Liu, Yehui
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2023, 2024, 1998 : 121 - 130