HDQGF:Heterogeneous Data Quality Guarantee Framework Based on Deep Learning

被引:0
|
作者
Zhang, Yun [1 ,2 ]
Jin, Zongze [1 ]
Zhu, Weilin [1 ]
Chi, Lei [1 ,2 ]
Wang, Weiping [1 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
关键词
date quality; data preprecessing; deep learning; heterogeneous integration;
D O I
10.1109/CSCWD49262.2021.9437684
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although user-generated data on the Internet contains rich information, many approaches cannot effectively guarantee data quality for data analysis from raw data. In recent years, many researches on data quality guarantee using machine learning have shown that enhancing data quality is conducive to improve the accuracy of analysis results. But the existing approaches only consider the single dimension and neglect the fusion of heterogeneous data, such as images or social graphs. To consider this element and address the above issue, we leverage the deep learning technique to guarantee the data quality by using the heterogeneous data. Our framework is named HDQGF, which is an end-to-end approach using a combination of multiple networks to fuse heterogeneous information. In order to verify the effectiveness of the model, we designed related experiments on three real datasets. According to the experimental results, our model HDQGF can enhance the performance by improving the data quality.
引用
收藏
页码:901 / 906
页数:6
相关论文
共 50 条
  • [31] DeepAM: a heterogeneous deep learning framework for intelligent malware detection
    Yanfang Ye
    Lingwei Chen
    Shifu Hou
    William Hardy
    Xin Li
    Knowledge and Information Systems, 2018, 54 : 265 - 285
  • [32] GammaLearn: a Deep Learning framework for IACT data
    Jacquemont, Mikael
    Vuillaume, Thomas
    Benoit, Alexandre
    Maurin, Gilles
    Lambert, Patrick
    Lamanna, Giovanni
    Brill, Ari
    36TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2019, 2021,
  • [33] A deep learning framework for characterization of genotype data
    Ausmees, Kristiina
    Nettelblad, Carl
    G3-GENES GENOMES GENETICS, 2022, 12 (03):
  • [34] Identifying the quality characteristics of pork floss structure based on deep learning framework
    Shen, Che
    Ding, Meiqi
    Wu, Xinnan
    Cai, Guanhua
    Cai, Yun
    Gai, Shengmei
    Wang, Bo
    Liu, Dengyong
    CURRENT RESEARCH IN FOOD SCIENCE, 2023, 7
  • [35] LEARNING FROM HETEROGENEOUS DATA WITH DEEP GAUSSIAN PROCESSES
    Ajirak, Marzieh
    Preis, Heidi
    Lobel, Marci
    Djuric, Petar M.
    2023 IEEE 9TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING, CAMSAP, 2023, : 46 - 50
  • [36] Data Quality Guarantee Mechanism Based on Sunk Cost Effect
    Xu, Yonghua
    Liu, Jiaqi
    Yang, Yuying
    2023 IEEE 6TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS, 2023,
  • [37] Synthetic training data generation for deep learning based quality inspection
    Gutierrez, Pierre
    Luschkova, Maria
    Cordier, Antoine
    Shukor, Mustafa
    Schappert, Mona
    Dahmen, Tim
    FIFTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2021, 11794
  • [38] Analysis of the policy guarantee mechanism of rural infrastructure based on deep learning
    Jin, Xin
    Zuo, Xiangbin
    Dong, Xiaoli
    Dong, YanJiao
    Ding, Huanhuan
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2021, 166
  • [39] A data-driven and the deep learning based CDN recommendation framework for ICPs
    Qiao, Bo
    Yin, Hao
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2019, 12 (05) : 1445 - 1453
  • [40] A data-driven and the deep learning based CDN recommendation framework for ICPs
    Bo Qiao
    Hao Yin
    Peer-to-Peer Networking and Applications, 2019, 12 : 1445 - 1453