Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
|
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] A POCS-based method for estimating unobserved values in microarray time-series data
    Zeng, Jia
    Yan, Hong
    PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 3898 - 3902
  • [32] A Dependable Time Series Analytic Framework for Cyber-Physical Systems of IoT-based Smart Grid
    Wang, Chang
    Zhu, Yongxin
    Shi, Weiwei
    Chang, Victor
    Vijayakumar, P.
    Liu, Bin
    Mao, Yishu
    Wang, Jiabao
    Fan, Yiping
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2019, 3 (01)
  • [33] Real-time Data Driven Monitoring and Optimization Method for IoT-based Sensible Production Process
    Zhang, Yingfeng
    Sun, Shudong
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC), 2013, : 486 - 490
  • [34] Enabling Smart Agriculture: An IoT-Based Framework for Real-Time Monitoring and Analysis of Agricultural Data
    Oguz, Faruk Enes
    Ekersular, Mahmut Nedim
    Sunnetci, Kubilay Muhammed
    Alkan, Ahmet
    AGRICULTURAL RESEARCH, 2024, 13 (03) : 574 - 585
  • [35] IoT Equipment Monitoring System Based on C5.0 Decision Tree and Time-Series Analysis
    Zhu, Biaokai
    Hou, Xinyi
    Liu, Sanman
    Ma, Wanli
    Dong, Meiya
    Wen, Haibin
    Wei, Qing
    Du, Sixuan
    Zhang, Yufeng
    IEEE ACCESS, 2022, 10 : 36637 - 36648
  • [36] Compression algorithm of road traffic data in time series based on temporal correlation
    Wang, Yong-dong
    Xu, Dong-wei
    Lu, Yun
    Shen, Jun-Yan
    Zhang, Gui-jun
    IET INTELLIGENT TRANSPORT SYSTEMS, 2018, 12 (03) : 177 - 185
  • [37] Feedback control of unknown chaotic dynamical systems based on time-series data
    Chen, G
    Chen, GR
    de Figueiredo, RJP
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1999, 46 (05): : 640 - 644
  • [38] Crop growth monitoring through Sentinel and Landsat data based NDVI time-series
    Boori, M. S.
    Choudhary, K.
    Kupriyanov, A., V
    COMPUTER OPTICS, 2020, 44 (03) : 409 - 419
  • [39] Energy monitoring of process systems: time-series segmentation-based targeting models
    Janos Abonyi
    Tibor Kulcsar
    Miklos Balaton
    Laszlo Nagy
    Clean Technologies and Environmental Policy, 2014, 16 : 1245 - 1253
  • [40] Energy monitoring of process systems: time-series segmentation-based targeting models
    Abonyi, Janos
    Kulcsar, Tibor
    Balaton, Miklos
    Nagy, Laszlo
    CLEAN TECHNOLOGIES AND ENVIRONMENTAL POLICY, 2014, 16 (07) : 1245 - 1253