Always Strengthen Your Strengths: A Drift-Aware Incremental Learning Framework for CTR Prediction

被引:2
|
作者
Liu, Congcong [1 ]
Teng, Fei [1 ,2 ]
Zhao, Xiwei [1 ]
Lin, Zhangang [1 ]
Hu, Jinghe [1 ]
Shao, Jingping [1 ]
机构
[1] JD COM, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
关键词
CTR Prediction; Incremental Learning; Catastrophic Forgetting;
D O I
10.1145/3539618.3591948
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
CTR prediction is crucial in recommendation systems and online advertising platforms, where user-generated data streams that drift over time can lead to catastrophic forgetting if the model continuously adapts to new data distribution. Conventional strategies for catastrophic forgetting are challenging to deploy due to memory constraints and diverse data distributions. To address this, we propose a novel drift-aware incremental learning framework based on ensemble learning for CTR prediction, which uses explicit error-based drift detection on streaming data to strengthen well-adapted ensembles and freeze ensembles that do not match the input distribution, avoiding catastrophic interference. Our method outperforms all baselines considered in offline experiments and A/B tests.
引用
收藏
页码:1806 / 1810
页数:5
相关论文
共 43 条
  • [21] An incremental learning framework for pipeline weld crack damage identification and leakage rate prediction
    Huang, Jing
    Zhang, Zhifen
    Yu, Yanlong
    Li, Yongjie
    Zhang, Shuai
    Qin, Rui
    Xing, Ji
    Cheng, Wei
    Wen, Guangrui
    Chen, Xuefeng
    [J]. ENGINEERING APPLICATIONS OF COMPUTATIONAL FLUID MECHANICS, 2024, 18 (01)
  • [22] Online drift compensation framework based on active learning for gas classification and concentration prediction
    Se, Haifeng
    Song, Kai
    Jiang, Jinhai
    Liu, Hui
    Wang, Bo
    Wang, Xuanhe
    Zhang, Weiyan
    Liu, Jijiang
    [J]. SENSORS AND ACTUATORS B-CHEMICAL, 2024, 398
  • [23] A Machine Learning based Context-aware Prediction Framework for Edge Computing Environments
    Aljulayfi, Abdullah Fawaz
    Djemame, Karim
    [J]. CLOSER: PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, 2021, : 143 - 150
  • [24] Multi-stage framework with difficulty-aware learning for progressive dose prediction
    Li, Fan
    Niu, Sijie
    Han, Yingying
    Zhang, Yan
    Dong, Zihao
    Zhu, Jian
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
  • [25] A Complementary Continual Learning Framework Using Incremental Samples for Remaining Useful Life Prediction of Machinery
    Ren, Xiangyu
    Qin, Yong
    Wang, Biao
    Cheng, Xiaoqing
    Jia, Limin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024,
  • [26] A State-by-State online transfer learning framework with incremental clustering for blood glucose prediction
    Zhang, Xinyu
    Yu, Xia
    Zhang, Zhanhu
    Li, Hongru
    Lu, Jingyi
    Zhou, Jian
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [27] Topology-aware Multi-task Learning Framework for Civil Case Judgment Prediction
    Le, Yuquan
    Xiao, Sheng
    Xiao, Zheng
    Li, Kenli
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [28] A Combined Model- and Learning-Based Framework for Interaction-Aware Maneuver Prediction
    Bahram, Mohammad
    Hubmann, Constantin
    Lawitzky, Andreas
    Aeberhard, Michael
    Wollherr, Dirk
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (06) : 1538 - 1550
  • [29] A Novel NBTI-Aware Chip Remaining Lifetime Prediction Framework Using Machine Learning
    Chen, Yu-Guang
    Lin, Ing-Chao
    Wei, Yong-Che
    [J]. PROCEEDINGS OF THE 2021 TWENTY SECOND INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2021), 2021, : 476 - 481
  • [30] A flexible deep learning-aware framework for travel time prediction considering traffic event
    Xu, Miao
    Liu, Hongfei
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 106 (106)