Efficient Multistream Classification using Direct Density Ratio Estimation

被引:5
|
作者
Haque, Ahsanul [1 ]
Chandra, Swarup [1 ]
Khan, Latifur [1 ]
Hamlen, Kevin [1 ]
Aggarwal, Charu [2 ]
机构
[1] Univ Texas Dallas, Dept Comp Sci, Richardson, TX 75083 USA
[2] IBM TJ Watson Res Ctr, Yorktown Hts, NY USA
基金
美国国家科学基金会;
关键词
Multistream Classification; Data Shift adaptation; Direct Density Ratio Estimation;
D O I
10.1109/ICDE.2017.63
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional data stream classification techniques assume that the stream of data is generated from a single non-stationary process. On the contrary, a recently introduced problem setting, referred to as Multistream Classification involves two independent non-stationary data generating processes. One of them is the source stream that continuously generates labeled data instances. The other one is the target stream that generates unlabeled test data instances from the same domain. The distributions represented by the source stream data is biased compared to that of the target stream. Moreover, these streams may have asynchronous concept drifts between them. The multistream classification problem is to predict the class labels of target stream instances, while utilizing labeled data available from the source stream. In this paper, we propose an efficient solution for multistream classification by fusing drift detection into online data shift adaptation. Experiment results on benchmark data sets indicate significantly improved performance over the only existing approach for multistream classification.
引用
收藏
页码:155 / 158
页数:4
相关论文
共 50 条
  • [1] Ensemble Direct Density Ratio Estimation for Multistream Classification
    Chandra, Swarup
    Haque, Ahsanul
    Tao, Hemeng
    Liu, Jie
    Khan, Latifur
    Aggarwal, Charu
    [J]. 2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 1364 - 1367
  • [2] Multistream Classification with Relative Density Ratio Estimation
    Dong, Bo
    Gao, Yang
    Chandra, Swarup
    Khan, Latifur
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 3478 - 3485
  • [3] A Framework for Multistream Regression with Direct Density Ratio Estimation
    Haque, Ahsanul
    Tao, Hemeng
    Chandra, Swarup
    Liu, Jie
    Khan, Latifur
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3149 - 3156
  • [4] Statistical outlier detection using direct density ratio estimation
    Hido, Shohei
    Tsuboi, Yuta
    Kashima, Hisashi
    Sugiyama, Masashi
    Kanamori, Takafumi
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2011, 26 (02) : 309 - 336
  • [5] Statistical outlier detection using direct density ratio estimation
    Shohei Hido
    Yuta Tsuboi
    Hisashi Kashima
    Masashi Sugiyama
    Takafumi Kanamori
    [J]. Knowledge and Information Systems, 2011, 26 : 309 - 336
  • [6] Nonparametric direct density ratio estimation using beta kernel
    Igarashi, Gaku
    [J]. STATISTICS, 2020, 54 (02) : 257 - 280
  • [7] Density Ratio Estimation via Infinitesimal Classification
    Choi, Kristy
    Meng, Chenlin
    Song, Yang
    Ermon, Stefano
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [8] Direct Learning of Sparse Changes in Markov Networks by Density Ratio Estimation
    Liu, Song
    Quinn, John A.
    Gutmann, Michael U.
    Suzuki, Taiji
    Sugiyama, Masashi
    [J]. NEURAL COMPUTATION, 2014, 26 (06) : 1169 - 1197
  • [9] Unsupervised Recycled FPGA Detection Based on Direct Density Ratio Estimation
    Isaka, Yuya
    Ahmed, Foisal
    Shintani, Michihiro
    Inoue, Michiko
    [J]. 2021 IEEE 27TH INTERNATIONAL SYMPOSIUM ON ON-LINE TESTING AND ROBUST SYSTEM DESIGN (IOLTS), 2021,
  • [10] Salient object detection based on direct density-ratio estimation
    Yamanaka, Masao
    Matsugu, Masakazu
    Sugiyama, Masashi
    [J]. IPSJ Online Transactions, 2013, 6 (2013) : 96 - 103