A scalable distributed stream mining system for highway traffic data

被引:0
|
作者
Liu, Ying [1 ]
Choudhary, Alok
Zhou, Jianhong
Khokhar, Ashfaq
机构
[1] Chinese Acad Sci, Grad Univ, Data Technol & Knowledge Econ Res Ctr, Beijing 100080, Peoples R China
[2] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
关键词
data stream; distributed computing; real-time; traffic; sensor;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To achieve the concept of smart roads, intelligent sensors are being placed on the roadways to collect real-time traffic streams. Traditional method is not a real-time response, and incurs high communication and storage costs. Existing distributed stream mining algorithms do not consider the resource limitation on the lightweight devices such as sensors. In this paper, we propose a distributed traffic stream mining system. The central server performs various data mining tasks only in the training and updating stage and sends the interesting patterns to the sensors. The sensors monitor and predict the coming traffic or raise alarms independently by comparing with the patterns observed in the historical streams. The sensors provide real-time response with less wireless communication and small resource requirement, and the computation burden on the central server is reduced. We evaluate our system on the real highway traffic streams in the GCM Transportation Corridor in Chicagoland.
引用
收藏
页码:309 / 321
页数:13
相关论文
共 50 条
  • [1] Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System
    Fang, Jun-Hua
    Zhao, Peng-Peng
    Liu, An
    Li, Zhi-Xu
    Zhao, Lei
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2019, 34 (04) : 747 - 761
  • [2] Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System
    Jun-Hua Fang
    Peng-Peng Zhao
    An Liu
    Zhi-Xu Li
    Lei Zhao
    Journal of Computer Science and Technology, 2019, 34 : 747 - 761
  • [3] NIM: Scalable Distributed Stream Process System on Mobile Network Data
    Pan, Lujia
    Qian, Jianfeng
    He, Caifeng
    Fan, Wei
    He, Cheng
    Yang, Fan
    2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2013, : 1101 - 1104
  • [4] Distributed and scalable sequential pattern mining through stream processing
    Chun-Chieh Chen
    Hong-Han Shuai
    Ming-Syan Chen
    Knowledge and Information Systems, 2017, 53 : 365 - 390
  • [5] Distributed and scalable sequential pattern mining through stream processing
    Chen, Chun-Chieh
    Shuai, Hong-Han
    Chen, Ming-Syan
    KNOWLEDGE AND INFORMATION SYSTEMS, 2017, 53 (02) : 365 - 390
  • [6] A Scalable Distributed Private Stream Search System
    Zhang, Peng
    Li, Yan
    Liu, Qingyun
    Lin, Hailun
    2015 IEEE 35TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2015, : 128 - 135
  • [7] Scalable concept drift adaptation for stream data mining
    Hu, Lisha
    Li, Wenxiu
    Lu, Yaru
    Hu, Chunyu
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 6725 - 6743
  • [8] Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining
    Van Renesse, R
    Birman, KP
    Vogels, W
    ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2003, 21 (02): : 164 - 206
  • [9] Data mining techniques for effective and scalable traffic analysis
    Baldi, M
    Baralis, E
    Risso, F
    INTEGRATED NETWORK MANAGEMENT IX: MANAGING NEW NETWORKED WORLDS, 2005, : 105 - 118
  • [10] A communication efficient and scalable distributed data mining for the astronomical data
    Govada, A.
    Sahay, S. K.
    ASTRONOMY AND COMPUTING, 2016, 16 : 166 - 173