Aesthetic Attributes Assessment of Images

被引:24
|
作者
Jin, Xin [1 ,2 ]
Wu, Le [1 ]
Zhao, Geng [1 ]
Li, Xiaodong [1 ]
Zhang, Xiaokun [1 ]
Ge, Shiming [3 ]
Zou, Dongqing [4 ]
Zhou, Bin [5 ]
Zhou, Xinghui [1 ]
机构
[1] Beijing Elect Sci & Technol Inst, Dept Cyber Secur, Beijing 100070, Peoples R China
[2] CETC Big Data Res Inst Co Ltd, Guiyang 550018, Guizhou, Peoples R China
[3] Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China
[4] SenseTime Res, Beijing 100084, Peoples R China
[5] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
aesthetic assessment; image captioning; semi-supervised learning;
D O I
10.1145/3343031.3350970
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes captioning. This is a new formula of image aesthetic assessment, which predicts aesthetic attributes captions together with the aesthetic score of each attribute. We introduce a new dataset named DPC-Captions which contains comments of up to 5 aesthetic attributes of one image through knowledge transfer from a full-annotated small-scale dataset. Then, we propose Aesthetic Multi-Attribute Network (AMAN), which is trained on a mixture of fully-annotated small-scale PCCD dataset and weakly-annotated large-scale DPC-Captions dataset. Our AMAN makes full use of transfer learning and attention model in a single framework. The experimental results on our DPC-Captions and PCCD dataset reveal that our method can predict captions of 5 aesthetic attributes together with numerical score assessment of each attribute. We use the evaluation criteria used in image captions to prove that our specially designed AMAN model outperforms traditional CNN-LSTM model and modern SCA-CNN model of image captions.
引用
收藏
页码:311 / 319
页数:9
相关论文
共 50 条
  • [21] Discovering Beautiful Attributes for Aesthetic Image Analysis
    Marchesotti, Luca
    Murray, Naila
    Perronnin, Florent
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (03) : 246 - 266
  • [22] Aesthetic and functional bra attributes as emotional triggers
    Greggianin, Monica
    Tonetto, Leandro Miletto
    Brust-Renck, Priscila
    FASHION AND TEXTILES, 2018, 5
  • [23] Aesthetic and functional bra attributes as emotional triggers
    Mônica Greggianin
    Leandro Miletto Tonetto
    Priscila Brust-Renck
    Fashion and Textiles, 5
  • [24] Form Attributes to Measure and Understand Aesthetic Preferences
    Saadi, Jana I.
    Yang, Maria C.
    Chong, Leah
    PROCEEDINGS OF ASME 2023 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2023, VOL 6, 2023,
  • [25] Understanding the Aesthetic Experience: The Relationship Between Aesthetic Attributes and Emotional Competence.
    Edwards, Alexandra
    Zanker, Johannes
    PERCEPTION, 2022, 51 : 137 - 137
  • [26] Discovering Beautiful Attributes for Aesthetic Image Analysis
    Luca Marchesotti
    Naila Murray
    Florent Perronnin
    International Journal of Computer Vision, 2015, 113 : 246 - 266
  • [27] Aesthetic primitives of images for visualization
    Peters, Gabriele
    11th International Conference Information Visualization, 2007, : 316 - 325
  • [28] THE AESTHETIC VALUE OF FRACTAL IMAGES
    SHORT, L
    BRITISH JOURNAL OF AESTHETICS, 1991, 31 (04): : 342 - 355
  • [29] Research Progress on the Aesthetic Quality Assessment of Complex Layout Images Based on Deep Learning
    Pu, Yumei
    Liu, Danfei
    Chen, Siyuan
    Zhong, Yunfei
    APPLIED SCIENCES-BASEL, 2023, 13 (17):
  • [30] A COMPREHENSIVE AESTHETIC QUALITY ASSESSMENT METHOD FOR NATURAL IMAGES USING BASIC RULES OF PHOTOGRAPHY
    Mavridaki, Eftichia
    Mezaris, Vasileios
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 887 - 891