Always Strengthen Your Strengths: A Drift-Aware Incremental Learning Framework for CTR Prediction

被引:2
|
作者
Liu, Congcong [1 ]
Teng, Fei [1 ,2 ]
Zhao, Xiwei [1 ]
Lin, Zhangang [1 ]
Hu, Jinghe [1 ]
Shao, Jingping [1 ]
机构
[1] JD COM, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
关键词
CTR Prediction; Incremental Learning; Catastrophic Forgetting;
D O I
10.1145/3539618.3591948
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
CTR prediction is crucial in recommendation systems and online advertising platforms, where user-generated data streams that drift over time can lead to catastrophic forgetting if the model continuously adapts to new data distribution. Conventional strategies for catastrophic forgetting are challenging to deploy due to memory constraints and diverse data distributions. To address this, we propose a novel drift-aware incremental learning framework based on ensemble learning for CTR prediction, which uses explicit error-based drift detection on streaming data to strengthen well-adapted ensembles and freeze ensembles that do not match the input distribution, avoiding catastrophic interference. Our method outperforms all baselines considered in offline experiments and A/B tests.
引用
收藏
页码:1806 / 1810
页数:5
相关论文
共 43 条
  • [1] Feature Staleness Aware Incremental Learning for CTR Prediction
    Wang, Zhikai
    Shen, Yanyan
    Zhang, Zibin
    Lin, Kangyi
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2352 - 2360
  • [2] An Incremental Learning framework for Large-scale CTR Prediction
    Katsileros, Petros
    Mandilaras, Nikiforos
    Mallis, Dimitrios
    Pitsikalis, Vassilis
    Theodorakis, Stavros
    Chamiel, Gil
    [J]. PROCEEDINGS OF THE 16TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2022, 2022, : 490 - 493
  • [3] Drift-Aware Feature Learning Based on Autoencoder Preprocessing for Soft Sensors
    Wang, Junming
    Shu, Jing
    Alam, Md Masruck
    Gao, Zhaoli
    Li, Zheng
    Tong, Raymond Kai-Yu
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (03)
  • [4] Follow the Will of the Market: A Context-Informed Drift-Aware Method for Stock Prediction
    Song, Chen-Hui
    Xiao, Xi
    Zhang, Bin
    Xia, Shu-Tao
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2311 - 2320
  • [5] The TriLS Approach for Drift-Aware Time-Series Prediction in IIoT Environment
    Uchiteleva, Elena
    Primak, Serguei L.
    Luccini, Marco
    Hussein, Ahmed Refaey
    Shami, Abdallah
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (10) : 6581 - 6591
  • [6] Drift-Aware Edge Intelligence for Remaining Useful Life Prediction in Industrial Internet of Things
    Ong, Kevin Shen Hoong
    Niyato, Dusit
    Friedrichs, Thomas
    [J]. 2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 198 - 201
  • [7] Adaptive data quality scoring operations framework using drift-aware mechanism for industrial applications
    Bayram, Firas
    Ahmed, Bestoun S.
    Hallin, Erik
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2024, 217
  • [8] PAL: A Position-bias Aware Learning Framework for CTR Prediction in Live Recommender Systems
    Guo, Huifeng
    Yu, Jinkai
    Liu, Qing
    Tang, Ruiming
    Zhang, Yuzhou
    [J]. RECSYS 2019: 13TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, 2019, : 452 - 456
  • [9] An Embedding Learning Framework for Numerical Features in CTR Prediction
    Guo, Huifeng
    Chen, Bo
    Tang, Ruiming
    Zhang, Weinan
    Li, Zhenguo
    He, Xiuqiang
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 2910 - 2918
  • [10] Enhancing CTR Prediction with Context-Aware Feature Representation Learning
    Wang, Fangye
    Wang, Yingxu
    Li, Dongsheng
    Gu, Hansu
    Lu, Tun
    Zhang, Peng
    Gu, Ning
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 343 - 352