A Spatiotemporal Causality Based Governance Framework for Noisy Urban Sensory Data

被引:0
|
作者
Yan, Bi-Ying [1 ,2 ]
Yang, Chao [3 ,4 ]
Deng, Pan [5 ]
Sun, Qiao [1 ]
Chen, Feng [1 ,6 ]
Yu, Yang [1 ,2 ,7 ]
机构
[1] Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Peking Univ, Sch Math Sci, Beijing 100871, Peoples R China
[4] Peng Cheng Lab, Shenzhen 518052, Peoples R China
[5] Beihang Univ, Res Inst Frontier Sci, Beijing 100191, Peoples R China
[6] Guiyang Acad Informat Technol, Guiyang 550081, Peoples R China
[7] Guiyang Municipal Commiss Transport, Guiyang 550003, Peoples R China
关键词
trajectory data; recurrent neural network; spatiotemporal (ST) big data; urban computing;
D O I
10.1007/s11390-020-9724-x
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Urban sensing is one of the fundamental building blocks of urban computing. It uses various types of sensors deployed in different geospatial locations to continuously and cooperatively monitor the natural and cultural environment in urban areas. Nevertheless, issues such as uneven distribution, low sampling rate and high failure ratio of sensors often make their readings less reliable. This paper provides an innovative framework to detect the noise data as well as to repair them from a spatial-temporal causality perspective rather than to deal with them individually. This can be achieved by connecting data through monitored objects, using the Skip-gram model to estimate spatial correlation and long short-term memory to estimate temporal correlation. The framework consists of three major modules: 1) a space embedded Bidirectional Long Short-Term Memory (BiLSTM)-based sequence labeling module to detect the noise data and the latent missing data; 2) a space embedded BiLSTM-based sequence predicting module calculating the value of the missing data; 3) an object characteristics fusion repairing module to correct the spatial and temporal dislocation sensory data. The approach is evaluated with real-world data collected by over 3 000 electronic traffic bayonet devices in a citywide scale of a medium-sized city in China, and the result is superior to those of several referenced approaches. With a 12.9% improvement in data accuracy over the raw data, the proposed framework plays a significant role in various real-world use cases in urban governance, such as criminal investigation, traffic violation monitoring, and equipment maintenance.
引用
收藏
页码:1084 / 1098
页数:15
相关论文
共 50 条
  • [41] Estimation of Vector Autoregressive Parameters and Granger Causality From Noisy Multichannel Data
    Rangarajan, Prashant
    Rao, Rajesh P. N.
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2019, 66 (08) : 2231 - 2240
  • [42] Data Matters: A Strategic Action Framework for Data Governance
    Zhang, Qingqiang
    Sun, Xinbo
    Zhang, Mingchao
    [J]. INFORMATION & MANAGEMENT, 2022, 59 (04)
  • [43] Analyzing spatiotemporal congestion pattern on urban roads based on taxi GPS data
    Zhang, Kaisheng
    Sun, Daniel
    Shen, Suwan
    Zhu, Yi
    [J]. JOURNAL OF TRANSPORT AND LAND USE, 2017, 10 (01) : 675 - 694
  • [44] Analysis on spatiotemporal urban mobility based on online car-hailing data
    Zhang, Bin
    Chen, Shuyan
    Ma, Yongfeng
    Li, Tiezhu
    Tang, Kun
    [J]. JOURNAL OF TRANSPORT GEOGRAPHY, 2020, 82
  • [45] A knowledge discovery framework for the assessment of tactical behaviour in soccer based on spatiotemporal data
    Hoch, T.
    Tan, X.
    Leser, R.
    Baca, A.
    Moser, B. A.
    [J]. MATHEMATICAL AND COMPUTER MODELLING OF DYNAMICAL SYSTEMS, 2017, 23 (04) : 384 - 398
  • [46] GLOSS: Tensor-based anomaly detection in spatiotemporal urban traffic data
    Sofuoglu, Seyyid Emre
    Aviyente, Selin
    [J]. SIGNAL PROCESSING, 2022, 192
  • [47] A scalable framework for spatiotemporal analysis of location-based social media data
    Cao, Guofeng
    Wang, Shaowen
    Hwang, Myunghwa
    Padmanabhan, Anand
    Zhang, Zhenhua
    Soltani, Kiumars
    [J]. COMPUTERS ENVIRONMENT AND URBAN SYSTEMS, 2015, 51 : 70 - 82
  • [48] A spatiotemporal framework for the joint risk assessments of urban flood and urban heat island
    Tang, Xianzhe
    Huang, Xi
    Tian, Juwei
    Jiang, Yuhao
    Ding, Xue
    Liu, Wei
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 127
  • [49] A Visual Analytics Framework for Big Spatiotemporal Data
    Wang, Shaohua
    Zhong, Ershun
    Cai, Wenwen
    Zhou, Qiang
    Lu, Hao
    Gu, Yongquan
    Yun, Weiying
    Hu, Zhongnan
    Long, Liang
    [J]. PROCEEDINGS OF THE 2ND ACM SIGSPATIAL INTERNATIONAL WORKSHOP ON ANALYTICS FOR LOCAL EVENTS AND NEWS (LENS 2018), 2018,
  • [50] An Integrated Visual Analytics Framework for Spatiotemporal Data
    Wang, Shaohua
    Zhong, Ershun
    Zhou, Qiang
    Cui, Xue
    Lu, Hao
    Yun, Weiying
    Hu, Zhongnan
    Cai, Wenwen
    Long, Liang
    [J]. PROCEEDINGS OF THE 1ST ACM SIGSPATIAL INTERNATIONAL WORKSHOP ON ADVANCES IN RESILIENT AND INTELLIGENT CITIES (ARIC-2018), 2018, : 41 - 45