A Practical Yet Accurate Real-Time Statistical Analysis Library for Hydrologic Time-Series Big Data

被引:1
|
作者
Sun, Jun [1 ]
Ye, Feng [1 ]
Nedjah, Nadia [2 ]
Zhang, Ming [3 ]
Xu, Dong [4 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, Rua Sao Francisco Xavier 524, BR-20550013 Rio De Janeiro, Brazil
[3] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金;
关键词
hydrologic information; statistical analysis; Flink; stream data; time series;
D O I
10.3390/w15040708
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Using different statistical analysis methods to examine hydrologic time-series data is the basis of accurate hydrologic status analysis. With the wide application of the Internet of Things and sensor technologies, traditional statistical analysis methods are unable to meet the demand for real-time and accurate hydrologic data analysis. The existing mainstream big-data analysis platforms lack analysis methods oriented to hydrologic data. In this context, a real-time statistical analysis library based on the new generation of big data processing engine Flink, called HydroStreamingLib, was proposed and implemented. Furthermore, in order to prove the efficiency and handiness of the proposed library, a real-time statistical analysis system of hydrologic stream data was developed based on the concepts available in the proposed library. The results showed that HydroStreamingLib provides users with an efficient, real-time statistical verification method, thus extending the application capabilities of Flink Ecology in some specific fields.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Real-time analysis and management of big time-series data
    Biem, A.
    Feng, H.
    Riabov, A. V.
    Turaga, D. S.
    [J]. IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2013, 57 (3-4)
  • [2] AUTORUN ANALYSIS OF HYDROLOGIC TIME-SERIES
    SEN, Z
    [J]. JOURNAL OF HYDROLOGY, 1978, 36 (1-2) : 75 - 85
  • [3] Real-Time Data ETL Framework for Big Real-Time Data Analysis
    Li, Xiaofang
    Mao, Yingchi
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 1289 - 1294
  • [4] Real-time independent component analysis of fMRI time-series
    Esposito, F
    Seifritz, E
    Formisano, E
    Morrone, R
    Scarabino, T
    Tedeschi, G
    Cirillo, S
    Goebel, R
    Di Salle, F
    [J]. NEUROIMAGE, 2003, 20 (04) : 2209 - 2224
  • [5] Implementing a Real-Time Data Stream for Time-Series Stellar Photometry
    Bogosavljevic, M.
    Ioannou, Z.
    [J]. SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY IV, 2016, 9913
  • [6] Time-series data server optimized for multichannel and real-time processing
    Goto, H
    [J]. ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 2006, 89 (07): : 8 - 18
  • [7] Big Data Analysis for Sensor Time-Series in Automation
    Jirkovsky, Vaclav
    Obitko, Marek
    Novak, Petr
    Kadera, Petr
    [J]. 2014 IEEE EMERGING TECHNOLOGY AND FACTORY AUTOMATION (ETFA), 2014,
  • [8] AUTORUN ANALYSIS OF HYDROLOGIC TIME-SERIES - COMMENT
    CHANDER, S
    SPOLIA, SK
    KUMAR, A
    [J]. JOURNAL OF HYDROLOGY, 1980, 45 (3-4) : 333 - 339
  • [9] Statistical analysis of real-time PCR data
    Joshua S Yuan
    Ann Reed
    Feng Chen
    C Neal Stewart
    [J]. BMC Bioinformatics, 7
  • [10] Statistical analysis of real-time PCR data
    Yuan, JS
    Reed, A
    Chen, F
    Stewart, CN
    [J]. BMC BIOINFORMATICS, 2006, 7 (1)