Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
|
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Research on cognitive biology based algorithm for mining time-series data
    Yang, BR
    Li, LX
    Song, W
    International Conference on Computing, Communications and Control Technologies, Vol 2, Proceedings, 2004, : 279 - 284
  • [22] Enterprise Pollution Prevention and Control Monitoring Model Based on the Time-series Algorithm
    Xu, Xiaochuan
    Li, Ming
    Liu, Haixu
    Zhang, Gaili
    Kou, Jian
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 715 - 719
  • [23] Robust Control Performance Monitoring for Varying-Dimensional Time-Series Data Based on SCADA Systems
    Wang, Jie
    Zhao, Chunhui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [24] Advantages of IoT-Based Geotechnical Monitoring Systems Integrating Automatic Procedures for Data Acquisition and Elaboration
    Carri, Andrea
    Valletta, Alessandro
    Cavalca, Edoardo
    Savi, Roberto
    Segalini, Andrea
    SENSORS, 2021, 21 (06)
  • [25] On Data-Driven Self-Calibration for IoT-Based Gas Concentration Monitoring Systems
    You, Yang
    You, Kai
    Chen, Hao
    Oechtering, Tobias J.
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (15) : 13848 - 13861
  • [26] Text data compression and storage algorithm based on time series model
    Weng Y.-H.
    Li N.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (07): : 2109 - 2114
  • [27] Multihorizons transfer strategy for continuous online prediction of time-series data in complex systems
    Zhou, Liang
    Wang, Huawei
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (10) : 7706 - 7735
  • [28] Tracking Data Faults in an IoT-Based PM2.5 Monitoring System Using Time Series Data: A Case Study in Songkhla Municipality, Thailand
    Chatasa, Thanetphon
    Charoensawat, Porkom
    Nakkliang, Nontawat
    Inthasuth, Tanakorn
    Kaewthong, Natapon
    Boonsong, Wasana
    2024 INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS, AND COMMUNICATIONS, ITC-CSCC 2024, 2024,
  • [29] A lossless compression method of time-series data based on increasing average of neighboring signals
    Takezawa, Tetsuya
    Asakura, Koichi
    Watanabe, Toyohide
    IEEJ Transactions on Electronics, Information and Systems, 2008, 128 (02) : 318 - 325
  • [30] A Time-Series Data Analysis Methodology for Effective Monitoring of Partially Shaded Photovoltaic Systems
    Tsafarakis, Odysseas
    Sinapis, Kostas
    van Sark, Wilfried G. J. H. M.
    ENERGIES, 2019, 12 (09)