A scalable distributed stream mining system for highway traffic data

被引:0
|
作者
Liu, Ying [1 ]
Choudhary, Alok
Zhou, Jianhong
Khokhar, Ashfaq
机构
[1] Chinese Acad Sci, Grad Univ, Data Technol & Knowledge Econ Res Ctr, Beijing 100080, Peoples R China
[2] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
关键词
data stream; distributed computing; real-time; traffic; sensor;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To achieve the concept of smart roads, intelligent sensors are being placed on the roadways to collect real-time traffic streams. Traditional method is not a real-time response, and incurs high communication and storage costs. Existing distributed stream mining algorithms do not consider the resource limitation on the lightweight devices such as sensors. In this paper, we propose a distributed traffic stream mining system. The central server performs various data mining tasks only in the training and updating stage and sends the interesting patterns to the sensors. The sensors monitor and predict the coming traffic or raise alarms independently by comparing with the patterns observed in the historical streams. The sensors provide real-time response with less wireless communication and small resource requirement, and the computation burden on the central server is reduced. We evaluate our system on the real highway traffic streams in the GCM Transportation Corridor in Chicagoland.
引用
收藏
页码:309 / 321
页数:13
相关论文
共 50 条
  • [21] VEDAS: A mobile and distributed data stream mining system for real-time vehicle monitoring
    Kargupta, H
    Bhargava, R
    Liu, K
    Powers, M
    Blair, P
    Bushra, S
    Dull, J
    Sarkar, K
    Klein, M
    Vasa, M
    Handy, D
    PROCEEDINGS OF THE FOURTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, 2004, : 300 - 311
  • [22] Implementation of a distributed data mining system
    Cho, J
    Baik, S
    Bala, J
    COMPUTATIONAL SCIENCE - ICCS 2005, PT 3, 2005, 3516 : 1016 - 1019
  • [23] A distributed and mobile data mining system
    Wang, F
    Na, HL
    Guo, Y
    Jin, H
    PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT'2003, PROCEEDINGS, 2003, : 916 - 918
  • [24] Modeling Data Stream Intensity in Distributed Stream Processing System
    Gorawski, Marcin
    Marks, Pawel
    Gorawski, Michal
    COMPUTER NETWORKS, CN 2013, 2013, 370 : 372 - 383
  • [25] Scalable Distributed Stream Join Processing
    Lin, Qian
    Ooi, Beng Chin
    Wang, Zhengkui
    Yu, Cui
    SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 811 - 825
  • [26] Bleach: A Distributed Stream Data Cleaning System
    Tian, Yongchao
    Michiardi, Pietro
    Vukolic, Marko
    2017 IEEE 6TH INTERNATIONAL CONGRESS ON BIG DATA (BIGDATA CONGRESS 2017), 2017, : 113 - 120
  • [27] Building a Distributed Generic Recommender Using Scalable Data Mining Library
    Bhatia, Lavannya
    Prasad, S. S.
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION TECHNOLOGY CICT 2015, 2015, : 98 - 102
  • [28] A Workflow Management System for Scalable Data Mining on Clouds
    Marozzo, Fabrizio
    Talia, Domenico
    Trunfio, Paolo
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2018, 11 (03) : 480 - 492
  • [29] Load Adaptive Distributed Stream Processing System for Explosive Stream Data
    Lee, Myungcheol
    Lee, Miyoung
    Hur, Sung Jin
    Kim, Ikkyun
    2015 17TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2015, : 753 - 757
  • [30] Scalable and Parameterized Architecture for Efficient Stream Mining
    Zhang, Li
    Li, Dawei
    Zou, Xuecheng
    Hu, Yu
    Xu, Xiaowei
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2018, E101A (01): : 219 - 231