Smart Meter Data Compression using Generalized Deduplication

被引:5
|
作者
Feher, Marcell [1 ]
Yazdani, Niloofar [1 ]
Hansen, Morten Tranberg [2 ]
Vester, Flemming Enevold [2 ]
Lucani, Daniel E. [1 ]
机构
[1] Aarhus Univ, Agile Cloud Lab, DIGIT, Aarhus, Denmark
[2] Kamstrup AS, Skanderborg, Denmark
关键词
compression; IoT; generalized deduplication; smart meters;
D O I
10.1109/GLOBECOM42002.2020.9322393
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Utility providers are relying more often on smart, wirelessly connected smart meters to collect consumption information of their customers. The sheer amount of connected smart meters and the growing requirements to provide more frequent reports from each device arc putting a large strain on existing systems and protocols. In this paper, we propose three novel lossless compression schemes that significantly reduce the size of standard DLMS data messages uploaded by smart electricity meters. Using real life data sets, we show that these methods can achieve compression rates of over 90% while being transparent to the DLMS protocol.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Lossless Compression of Time Series Data with Generalized Deduplication
    Vestergaard, Rasmus
    Zhang, Qi
    Lucani, Daniel E.
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [2] Generalized Deduplication: Lossless Compression by Clustering Similar Data
    Talasila, Prasad
    Lucani, Daniel E.
    PROCEEDING OF THE 2019 IEEE 8TH INTERNATIONAL CONFERENCE ON CLOUD NETWORKING (CLOUDNET), 2019,
  • [3] Smart Meter Data Compression and Reconstruction Using Deep Convolutional Autoencoders
    Yuan, Yuxuan
    Zhang, Qianzhi
    Dehghanpour, Kaveh
    Bu, Fankun
    Wang, Zhaoyu
    2020 52ND NORTH AMERICAN POWER SYMPOSIUM (NAPS), 2021,
  • [4] Compression of smart meter big data: A survey
    Wen, Lulu
    Zhou, Kaile
    Yang, Shanlin
    Li, Lanlan
    RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 91 : 59 - 69
  • [5] Impact of Compression and Aggregation in Wireless Networks on Smart Meter Data
    Zeinali, Mehdi
    Thompson, John S.
    2016 IEEE 17TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2016,
  • [6] Multiresolution matrix factorisation as a compression method for smart meter data
    Ahmad, Arfah
    Datta, Amitava
    Sreeram, Victor
    Mishra, Yateendra
    JOURNAL OF ENGINEERING-JOE, 2020, 2020 (08): : 737 - 744
  • [7] Household Classification Using Smart Meter Data
    Carroll, Paula
    Murphy, Tadhg
    Hanley, Michael
    Dempsey, Daniel
    Dunne, John
    JOURNAL OF OFFICIAL STATISTICS, 2018, 34 (01) : 1 - 25
  • [8] Frequency Selective Auto-Encoder for Smart Meter Data Compression
    Lee, Jihoon
    Yoon, Seungwook
    Hwang, Euiseok
    SENSORS, 2021, 21 (04) : 1 - 20
  • [9] A divide-and-conquer method for compression and reconstruction of smart meter data
    Liu, Bo
    Hou, Yufan
    Luan, Wenpeng
    Liu, Zishuai
    Chen, Sheng
    Yu, Yixin
    APPLIED ENERGY, 2023, 336
  • [10] Mixing Deduplication and Compression on Active Data Sets
    Constantinescu, Cornel
    Glider, Joseph
    Chambliss, David
    2011 DATA COMPRESSION CONFERENCE (DCC), 2011, : 393 - 402