Large-Scale Data-Driven Traffic Sensor Health Monitoring

被引:0
|
作者
Tongge Huang
Pranamesh Chakraborty
Anuj Sharma
Chinmay Hegde
机构
[1] Iowa State University,Civil, Construction, and Environmental Engineering Department
[2] Indian Institute of Technology Kanpur,Department of Civil Engineering
[3] New York University,Electrical and Computer Engineering Department
来源
Journal of Big Data Analytics in Transportation | 2021年 / 3卷 / 3期
关键词
Sensor health monitoring; Anomaly detection; Clustering analysis; Bayesian changepoint detection;
D O I
10.1007/s42421-021-00049-w
中图分类号
学科分类号
摘要
Accurate traffic data collection is essential for supporting advanced traffic management system operations. This study investigated a large-scale data-driven sequential traffic sensor health monitoring (TSHM) module that can be used to monitor sensor health conditions over large traffic networks. Our proposed module consists of three sequential steps for detecting different types of abnormal sensor issues. The first step detects sensors with abnormally high missing data rates, while the second step uses clustering anomaly detection to detect sensors reporting abnormal records. The final step introduces a novel Bayesian changepoint modeling technique to detect sensors reporting abnormal traffic data fluctuations by assuming a constant vehicle length distribution based on average effective vehicle length (AEVL). Our proposed method is then compared with two benchmark algorithms to show its efficacy. Results obtained by applying our method to the statewide traffic sensor data of Iowa show it can successfully detect different classes of sensor issues. This demonstrates that sequential TSHM modules can help transportation agencies determine traffic sensors’ exact problems, thereby enabling them to take the required corrective steps.
引用
收藏
页码:229 / 245
页数:16
相关论文
共 50 条
  • [1] A Data-driven Mechanism for Large-scale Data Distribution
    Shi Peichang
    Li Yiying
    Ding Bo
    Jiang Longquan
    Liu Hui
    Zhang Jie
    2016 WORLD AUTOMATION CONGRESS (WAC), 2016,
  • [2] Data-driven Authoring of Large-scale Ecosystems
    Kapp, Konrad
    Gain, James
    Guerin, Eric
    Galin, Eric
    Peytavie, Adrien
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06):
  • [3] Large-scale Data-driven Segmentation of Banking Customers
    Hossain, Md Monir
    Sebestyen, Mark
    Mayank, Dhruv
    Ardakanian, Omid
    Khazaei, Hamzeh
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 4392 - 4401
  • [4] Data-driven realistic animation of large-scale forest
    School of Computer Science, Wuhan University, Wuhan 430079, China
    不详
    不详
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2008, 20 (08): : 1015 - 1022
  • [5] Large-scale mode identification and data-driven sciences
    Mukhopadhyay, Subhadeep
    ELECTRONIC JOURNAL OF STATISTICS, 2017, 11 (01): : 215 - 240
  • [6] Data-Driven Sensor Selection using Gumbel-max Sampling for Large-Scale IoT
    Chen, Yuxuan
    Chen, Yuan
    Li, Guobing
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [7] A Hybrid Processing System for Large-Scale Traffic Sensor Data
    Zhao, Zhuofeng
    Ding, Weilong
    Wang, Jianwu
    Han, Yanbo
    IEEE ACCESS, 2015, 3 : 2341 - 2351
  • [8] Data-Driven Cell Zooming for Large-Scale Mobile Networks
    Jiang, Hao
    Yi, Shuwen
    Wu, Lihua
    Leung, Henry
    Wang, Yuan
    Zhou, Xian
    Chen, Yanqiu
    Yang, Lintao
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2018, 15 (01): : 156 - 168
  • [9] Large-Scale Data-Driven Airline Market Influence Maximization
    Li, Duanshun
    Liu, Jing
    Jeon, Jinsung
    Hong, Seoyoung
    Le, Thai
    Lee, Dongwon
    Park, Noseong
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 914 - 924
  • [10] Personal workspace for large-scale data-driven computational experiment
    Sun, Yiming
    Jensen, Scott
    Pallickara, Sangmi Lee
    Plale, Beth
    2006 7TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2006, : 112 - +