Online Corrupted User Detection and Regret Minimization

被引:0
|
作者
Wang, Zhiyong [1 ]
Xie, Jize [2 ]
Yu, Tong [3 ]
Li, Shuai [2 ]
Lui, John C. S. [1 ]
机构
[1] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Adobe Res, San Francisco, CA USA
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world online web systems, multiple users usually arrive sequentially into the system. For applications like click fraud and fake reviews, some users can maliciously perform corrupted (disrupted) behaviors to trick the system. Therefore, it is crucial to design efficient online learning algorithms to robustly learn from potentially corrupted user behaviors and accurately identify the corrupted users in an online manner. Existing works propose bandit algorithms robust to adversarial corruption. However, these algorithms are designed for a single user, and cannot leverage the implicit social relations among multiple users for more efficient learning. Moreover, none of them consider how to detect corrupted users online in the multiple-user scenario. In this paper, we present an important online learning problem named LOCUD to learn and utilize unknown user relations from disrupted behaviors to speed up learning, and identify the corrupted users in an online setting. To robustly learn and utilize the unknown relations among potentially corrupted users, we propose a novel bandit algorithm RCLUB-WCU. To detect the corrupted users, we devise a novel online detection algorithm OCCUD based on RCLUB-WCU's inferred user relations. We prove a regret upper bound for RCLUB-WCU, which asymptotically matches the lower bound with respect to T up to logarithmic factors, and matches the state-of-the-art results in degenerate cases. We also give a theoretical guarantee for the detection accuracy of OCCUD. With extensive experiments, our methods achieve superior performance over previous bandit algorithms and high corrupted user detection accuracy.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Online Agnostic Boosting via Regret Minimization
    Brukhim, Nataly
    Chen, Xinyi
    Hazan, Elad
    Moran, Shay
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] On the Regret Minimization of Nonconvex Online Gradient Ascent for Online PCA
    Garber, Dan
    [J]. CONFERENCE ON LEARNING THEORY, VOL 99, 2019, 99
  • [3] Trend Detection based Regret Minimization for Bandit Problems
    Nakhe, Paresh
    Reiffenhaeuser, Rebecca
    [J]. PROCEEDINGS OF 3RD IEEE/ACM INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS, (DSAA 2016), 2016, : 263 - 271
  • [4] Equivalence Analysis between Counterfactual Regret Minimization and Online Mirror Descent
    Liu, Weiming
    Jiang, Huacong
    Li, Bin
    Li, Houqiang
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [5] Stochastic User Equilibrium for Route Choice Model Based on Random Regret Minimization
    Bekhor, Shlomo
    Chorus, Caspar
    Toledo, Tomer
    [J]. TRANSPORTATION RESEARCH RECORD, 2012, (2284) : 100 - 108
  • [6] Cautious Regret Minimization: Online Optimization with Long-Term Budget Constraints
    Liakopoulos, Nikolaos
    Destounis, Apostolos
    Paschos, Georgios
    Spyropoulos, Thrasyvoulos
    Mertikopoulos, Panayotis
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [7] Online Monte Carlo Counterfactual Regret Minimization for Search in Imperfect Information Games
    Lisy, Viliam
    Lanctot, Marc
    Bowling, Michael
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), 2015, : 27 - 36
  • [8] Algorithms for Average Regret Minimization
    Storandt, Sabine
    Funke, Stefan
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1600 - 1607
  • [9] Rank-Regret Minimization
    Xiao, Xingxing
    Li, Jianzhong
    [J]. 2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1848 - 1860
  • [10] Regret Minimization with Performative Feedback
    Jagadeesan, Meena
    Zrnic, Tijana
    Mendler-Duener, Celestine
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,