Online Corrupted User Detection and Regret Minimization

被引:0
|
作者
Wang, Zhiyong [1 ]
Xie, Jize [2 ]
Yu, Tong [3 ]
Li, Shuai [2 ]
Lui, John C. S. [1 ]
机构
[1] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Adobe Res, San Francisco, CA USA
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world online web systems, multiple users usually arrive sequentially into the system. For applications like click fraud and fake reviews, some users can maliciously perform corrupted (disrupted) behaviors to trick the system. Therefore, it is crucial to design efficient online learning algorithms to robustly learn from potentially corrupted user behaviors and accurately identify the corrupted users in an online manner. Existing works propose bandit algorithms robust to adversarial corruption. However, these algorithms are designed for a single user, and cannot leverage the implicit social relations among multiple users for more efficient learning. Moreover, none of them consider how to detect corrupted users online in the multiple-user scenario. In this paper, we present an important online learning problem named LOCUD to learn and utilize unknown user relations from disrupted behaviors to speed up learning, and identify the corrupted users in an online setting. To robustly learn and utilize the unknown relations among potentially corrupted users, we propose a novel bandit algorithm RCLUB-WCU. To detect the corrupted users, we devise a novel online detection algorithm OCCUD based on RCLUB-WCU's inferred user relations. We prove a regret upper bound for RCLUB-WCU, which asymptotically matches the lower bound with respect to T up to logarithmic factors, and matches the state-of-the-art results in degenerate cases. We also give a theoretical guarantee for the detection accuracy of OCCUD. With extensive experiments, our methods achieve superior performance over previous bandit algorithms and high corrupted user detection accuracy.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Dynamic Thresholding and Pruning for Regret Minimization
    Brown, Noam
    Kroer, Christian
    Sandholm, Tuomas
    [J]. THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 421 - 429
  • [32] Wasserstein Distributionally Robust Regret Minimization
    Cho, Youngchae
    Yang, Insoon
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 820 - 825
  • [33] Revisiting Online Submodular Minimization: Gap-Dependent Regret Bounds, Best of BothWorlds and Adversarial Robustness
    Ito, Shinji
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [34] Efficient Phi-Regret Minimization in Extensive-Form Games via Online Mirror Descent
    Bai, Yu
    Jin, Chi
    Mei, Song
    Song, Ziang
    Yu, Tiancheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [35] User Profile Detection in Health Online Fora
    Pertin, Camille
    Deccache, Carole
    Gagnayre, Remi
    Hamon, Thierry
    [J]. BUILDING CONTINENTS OF KNOWLEDGE IN OCEANS OF DATA: THE FUTURE OF CO-CREATED EHEALTH, 2018, 247 : 730 - 734
  • [36] Abusive Language Detection in Online User Content
    Nobata, Chikashi
    Tetreault, Joel
    Thomas, Achint
    Mehdad, Yashar
    Chang, Yi
    [J]. PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'16), 2016, : 145 - 153
  • [37] Sampling of Alternatives in Random Regret Minimization Models
    Angelo Guevara, C.
    Chorus, Caspar G.
    Ben-Akiva, Moshe E.
    [J]. TRANSPORTATION SCIENCE, 2016, 50 (01) : 306 - 321
  • [38] Regret Minimization Algorithms for Pricing Lookback Options
    Gofer, Eyal
    Mansour, Yishay
    [J]. ALGORITHMIC LEARNING THEORY, 2011, 6925 : 234 - 248
  • [39] Meta-Learning for Simple Regret Minimization
    Azizi, Javad
    Kveton, Branislav
    Ghavamzadeh, Mohammad
    Katariya, Sumeet
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 6709 - 6717
  • [40] Sharp Dichotomies for Regret Minimization in Metric Spaces
    Kleinberg, Robert
    Slivkins, Aleksandrs
    [J]. PROCEEDINGS OF THE TWENTY-FIRST ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2010, 135 : 827 - +