Configuring Competing Classifier Chains in Distributed Stream Mining Systems

被引:8
|
作者
Fu, Fangwen [1 ]
Turaga, Deepak S. [2 ]
Verscheure, Olivier [2 ]
van der Schaar, Mihaela [1 ]
Amini, Lisa [2 ]
机构
[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA
[2] IBM TJ Watson Res Ctr, Hawthorne, NY 10532 USA
关键词
Nash bargaining solutions; networked classifiers; resource management; stream mining;
D O I
10.1109/JSTSP.2007.909368
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Networks of classifiers are capturing the attention of system and algorithmic researchers because they offer improved accuracy over single model classifiers, can be distributed over a network of servers for improved scalability, and can be adapted to available system resources. In this paper, we develop algorithms to optimally configure networks (chains) of such classifiers given system processing resource constraints. We first formally define a global performance metric for classifier chains by trading off the end-to-end probabilities of detection and false alarm. We then design centralized and distributed algorithms to provide efficient and fair resource allocation among several classifier chains competing for system resources. We use the Nash Bargaining Solution from game theory to ensure this. We also extend our algorithms to consider arbitrary topologies of classifier chains (with shared classifiers among competing chains). We present results for both simulated and state-of-the-art classifier chains for speaker verification operating on real telephony data, discuss the convergence of our algorithms to the optimal solution, and present interesting directions for future research.
引用
收藏
页码:548 / 563
页数:16
相关论文
共 50 条
  • [31] OPTIMALITY OF SYSTEMS OF IDENTICALLY DISTRIBUTED COMPETING PROCESSES
    Kapitonova, Yu. V.
    Kovalenko, N. S.
    Pavlov, P. A.
    CYBERNETICS AND SYSTEMS ANALYSIS, 2005, 41 (06) : 793 - 799
  • [32] LDA classifier monitoring in distributed streaming systems
    Bernstein, Ran
    Osadchy, Margarita
    Keren, Daniel
    Schuster, Assaf
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 123 : 156 - 167
  • [33] A family of design patterns for flexibly configuring network services in distributed systems
    Schmidt, DC
    THIRD INTERNATIONAL CONFERENCE ON CONFIGURABLE DISTRIBUTED SYSTEMS, PROCEEDINGS, 1996, : 124 - 135
  • [34] COLLABORATIVE DATA STREAM MINING IN UBIQUITOUS ENVIRONMENTS USING DYNAMIC CLASSIFIER SELECTION
    Gomes, Joao Bartolo
    Gaber, Mohamed Medhat
    Sousa, Pedro A. C.
    Menasalvas, Ernestina
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2013, 12 (06) : 1287 - 1308
  • [35] Learning Optimal Classifier Chains for Real-time Big Data Mining
    Xu, Jie
    Tekin, Cem
    van der Schaar, Mihaela
    2013 51ST ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2013, : 512 - 519
  • [36] Distributed and scalable sequential pattern mining through stream processing
    Chun-Chieh Chen
    Hong-Han Shuai
    Ming-Syan Chen
    Knowledge and Information Systems, 2017, 53 : 365 - 390
  • [37] Distributed and scalable sequential pattern mining through stream processing
    Chen, Chun-Chieh
    Shuai, Hong-Han
    Chen, Ming-Syan
    KNOWLEDGE AND INFORMATION SYSTEMS, 2017, 53 (02) : 365 - 390
  • [38] A scalable distributed stream mining system for highway traffic data
    Liu, Ying
    Choudhary, Alok
    Zhou, Jianhong
    Khokhar, Ashfaq
    KNOWLEDGE DISCOVERY IN DATABASES: PKDD 2006, PROCEEDINGS, 2006, 4213 : 309 - 321
  • [39] The Research on Distributed Data Stream Mining based on Mobile Agent
    Yue Fuqiang
    PEEA 2011, 2011, 23
  • [40] A Grid Data Mining architecture for Learning Classifier Systems
    Santos, M.F.
    Matthew, Wesley
    Kovacs, T.
    Santos, H.
    WSEAS Transactions on Computers, 2009, 8 (05): : 820 - 830