Style-aware adversarial pairwise ranking for image recommendation systems

被引:0
|
作者
Zhefu Wu
Song Zhang
Agyemang Paul
Luping Fang
机构
[1] Zhejiang University of Technology,College of Information Engineering
关键词
Image recommendation; Style features; Content features; Iterative perturbation; Adversarial training;
D O I
暂无
中图分类号
学科分类号
摘要
The vulnerability of Machine Learning (ML) models to adversarial attack and their prominence pose security issues, notably in image recommendation systems. The adversarial training method is an excellent strategy for improving the generalization capacity of ML models by creating attacks in the embedding space during training. While there has been a plethora of testing on image recommendation system vulnerabilities and defenses, iterative adversarial training methodologies have received little attention. Furthermore, when browsing visual images, consumers are more interested in the content and how well the image style matches the content. However, when compared to image content, the impact of image styles on the adversarial recommendation community has rarely been examined. In this work, we propose a robust Adversarial Content and Style Bayesian Personalized Ranking (ACSBPR) approach that leverages content and style features for image recommendation. The ACSBPR technique makes three significant contributions: (1) Incorporate content and style features jointly for image recommendation. (2) Present a multi-objective pairwise ranking with Dynamic Negative Sampling to optimize the system and anticipate consumer preferences. (3) To reduce the influence of the attack, we train the ACSBPR objective function using minimax iterative adversarial training. Extensive investigations on the Flickr dataset demonstrate that our strategy achieves better performance when compared to state-of-the-art image recommendation models.
引用
收藏
相关论文
共 50 条
  • [1] Style-aware adversarial pairwise ranking for image recommendation systems
    Wu, Zhefu
    Zhang, Song
    Paul, Agyemang
    Fang, Luping
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2023, 12 (02)
  • [2] Learning to Style-Aware Bayesian Personalized Ranking for Visual Recommendation
    He, Ming
    Zhang, Shaozong
    Meng, Qian
    IEEE ACCESS, 2019, 7 : 14198 - 14205
  • [3] Style-Aware Image Recommendation for Social Media Marketing
    Zhang, Yiwei
    Yamasaki, Toshihiko
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3106 - 3114
  • [4] Room Style Estimation for Style-Aware Recommendation
    Ataer-Cansizoglu, Esra
    Liu, Hantian
    Weiss, Tomer
    Mitra, Archi
    Dholakia, Dhaval
    Choi, Jae-Woo
    Wayfair, Dan Wulin
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2019, : 267 - 270
  • [5] Deep Ranking for Style-Aware Room Recommendations
    Yildiz, Ilkay
    Ataer-Cansizoglu, Esra
    Liu, Hantian
    Golbus, Peter
    Tezcan, Ozan
    Choi, Jae-Woo
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13975 - 13976
  • [6] A Style-aware Discriminator for Controllable Image Translation
    Kim, Kunhee
    Park, Sanghun
    Jeon, Eunyeong
    Kim, Taehun
    Kim, Daijin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18218 - 18227
  • [7] Parallel Style-Aware Image Cloning for Artworks
    Zhao, Yandan
    Jin, Xiaogang
    Xu, Yingqing
    Zhao, Hanli
    Ai, Meng
    Zhou, Kun
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (02) : 229 - 240
  • [8] Learning Style-Aware Symbolic Music Representations by Adversarial Autoencoders
    Valenti, Andrea
    Carta, Antonio
    Bacciu, Davide
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1563 - 1570
  • [9] Disentangling Structure and Aesthetics for Style-aware Image Completion
    Gilbert, Andrew
    Collomosse, John
    Jin, Hailin
    Price, Brian
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1848 - 1856
  • [10] Style-Aware Contrastive Learning for Multi-Style Image Captioning
    Zhou, Yucheng
    Long, Guodong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 2257 - 2267