Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
|
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] An IoT-Based System for Autonomous, Continuous, Real-Time Patient Monitoring and Its Application to Pressure Injury Management
    Mansfield, Sam
    Vin, Eric
    Obraczka, Katia
    17TH ANNUAL INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS 2021), 2021, : 66 - 68
  • [42] Keyframe compression and decompression for time series data based on the continuous hidden Markov model
    Inamura, T
    Tanie, H
    Nakamura, Y
    IROS 2003: PROCEEDINGS OF THE 2003 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2003, : 1487 - 1492
  • [43] GNN-Based Energy-Efficient Anomaly Detection for IoT Multivariate Time-Series Data
    Guo, Hongtai
    Zhou, Zhangbing
    Zhao, Deng
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 2492 - 2497
  • [44] Identification and Monitoring of Irrigated Areas in Arid Areas Based on Sentinel-2 Time-Series Data and a Machine Learning Algorithm
    Yu, Lixiran
    Xie, Hong
    Xu, Yan
    Li, Qiao
    Jiang, Youwei
    Tao, Hongfei
    Aihemaiti, Mahemujiang
    AGRICULTURE-BASEL, 2024, 14 (10):
  • [45] Novel solution of the controller and backup controller placement problem for improving reliability in IoT-based data monitoring systems
    Zangeneh, Iman
    Bidgoli, Amir Massoud
    Dolati, Ardeshir
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (02):
  • [46] Correlation Analysis of Network Big Data and Film Time-Series Data Based on Machine Learning Algorithm
    Li, Na
    Xia, Langbo
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [47] Correlation Analysis of Network Big Data and Film Time-Series Data Based on Machine Learning Algorithm
    Li, Na
    Xia, Langbo
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [48] Real-time detection of urban gas pipeline leakage based on machine learning of IoT time-series data
    Yuan, Hongyong
    Liu, Yiqing
    Huang, Lida
    Liu, Gang
    Chen, Tao
    Su, Guofeng
    Dai, Jiakun
    MEASUREMENT, 2025, 242
  • [49] Enhancing Data Quality Management in Structural Health Monitoring through Irregular Time-Series Data Anomaly Detection Using IoT Sensors
    Cho, Junhwi
    Lim, Kyoung Jae
    Kim, Jonggun
    Shin, Yongchul
    Park, Youn Shik
    Yeon, Jaeheum
    BUILDINGS, 2024, 14 (07)
  • [50] Semantic Grid Resource Monitoring and Discovery with Rule Processing based on the Time-series Statistical Data
    Pahlevi, Said Mirza
    Kojima, Isao
    2008 9TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2008, : 358 - 360