Artificial Neural Networks for Real-Time Data Quality Assurance

被引:1
|
作者
Sousa I. [1 ]
Casimiro A. [1 ]
Cecílio J. [1 ]
机构
[1] Faculty of Sciences, University of Lisbon, Lisbon
来源
Ada User Journal | 2022年 / 43卷 / 02期
基金
欧盟地平线“2020”;
关键词
Data quality; Environmental monitoring; Forecasting; Neural networks; Sensor networks;
D O I
10.1145/3577949.3577966
中图分类号
学科分类号
摘要
Wireless Sensor Networks used in aquatic environments for continuous monitoring are typically subject to phys-ical or environmental factors that create anomalies in collected data. A possible approach to identify and correct these anomalies, hence to improve the quality of data, is to use artificial neural networks, as done by the previously proposed ANNODE (Artificial Neural Network-based Outlier Detection) framework [1]. In this paper we propose ANNODE+, which extends the ANNODE framework by detecting missing data in addition to outliers. We also describe the design and implementation of ANNODE+, implemented in Python to exploit readily available machine learning (ML) tools and libraries, also allowing online processing of incom-ing measurements. To evaluate the ANNODE+ capa-bilities, we used a dataset from a sensor deployment in Seixal’s bay, Portugal. This dataset includes measurements of water level, temperature and salinity. We observed that our implementation of ANNODE+ per-formed as intended, being able to detect injected anomalies and successfully correcting them. © 2022, Ada-Europe. All rights reserved.
引用
收藏
页码:117 / 120
页数:3
相关论文
共 50 条
  • [41] Real-time analysis of data from many sensors with neural networks
    Van Laerhoven, K
    Aidoo, KA
    Lowette, S
    FIFTH INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, 2001, : 115 - 122
  • [42] Urban flood prediction in real-time from weather radar and rainfall data using artificial neural networks
    Duncan, Andrew P.
    Chen, Albert S.
    Keedwell, Edward C.
    Djordjevic, Slobodan
    Savic, Dragan A.
    WEATHER RADAR AND HYDROLOGY, 2012, 351 : 568 - 573
  • [43] US IOOS Program Office Quality Assurance of Real-Time Ocean Data Project
    Howard, Matthew
    Crout, Richard L.
    Toll, Raymond F., Jr.
    2012 OCEANS, 2012,
  • [44] REAL-TIME QUALITY ASSURANCE OF MALARIA SURVEILLANCE DATA IN MYANMAR AND ITS BORDER WITH CHINA
    Aung, Poe Poe
    Thein, Zaw Win
    Aye, Kyin Hla
    Lwin, Hnin Wai
    Han, Kay Thwe
    Fang, Huang
    Plowe, Christopher V.
    Zainabadi, Kayvan
    Adams, Matthew
    Nyunt, Myaing Myaing
    AMERICAN JOURNAL OF TROPICAL MEDICINE AND HYGIENE, 2017, 95 (05): : 475 - 476
  • [45] Artificial Intelligence Integration in Cloud-based Real-time Data Quality Assurance for Multi-Institutional Clinical Trials
    Zhang, Jun
    Jacko, Richard
    Trung Vu
    Poon, David
    Subramanian, Preethi
    Sbory, Timothy
    Vora, Shivangi
    Cearlock, Sydney
    Melchioris, Max
    Barmash, Elizabeth
    Orabella, Matthew
    Markeson, Chris
    Knopp, Michael
    JOURNAL OF NUCLEAR MEDICINE, 2018, 59
  • [46] Real-time water quality prediction in water distribution networks using graph neural networks with sparse monitoring data
    Li, Zilin
    Liu, Haixing
    Zhang, Chi
    Fu, Guangtao
    WATER RESEARCH, 2024, 250
  • [47] Basic quality assurance/quality control information required for reporting real-time quantitative PCR data
    Gibson, Kristen E.
    Borchardt, Mark A.
    Journal - American Water Works Association, 2013, 105 (01): : 45 - 47
  • [48] Real-time video quality assessment in packet networks: A neural network model
    Mohamed, S
    Rubino, G
    Afifi, H
    Cervantes, F
    PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 2035 - 2041
  • [49] A study of real-time packet video quality using random neural networks
    Mohamed, S
    Rubino, G
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2002, 12 (12) : 1071 - 1083
  • [50] Developing artificial neural networks to estimate real-time onboard bus ride comfort
    Teron Nguyen
    Duy Q. Nguyen-Phuoc
    Y. D. Wong
    Neural Computing and Applications, 2021, 33 : 5287 - 5299