HDQGF:Heterogeneous Data Quality Guarantee Framework Based on Deep Learning

被引:0
|
作者
Zhang, Yun [1 ,2 ]
Jin, Zongze [1 ]
Zhu, Weilin [1 ]
Chi, Lei [1 ,2 ]
Wang, Weiping [1 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
关键词
date quality; data preprecessing; deep learning; heterogeneous integration;
D O I
10.1109/CSCWD49262.2021.9437684
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although user-generated data on the Internet contains rich information, many approaches cannot effectively guarantee data quality for data analysis from raw data. In recent years, many researches on data quality guarantee using machine learning have shown that enhancing data quality is conducive to improve the accuracy of analysis results. But the existing approaches only consider the single dimension and neglect the fusion of heterogeneous data, such as images or social graphs. To consider this element and address the above issue, we leverage the deep learning technique to guarantee the data quality by using the heterogeneous data. Our framework is named HDQGF, which is an end-to-end approach using a combination of multiple networks to fuse heterogeneous information. In order to verify the effectiveness of the model, we designed related experiments on three real datasets. According to the experimental results, our model HDQGF can enhance the performance by improving the data quality.
引用
收藏
页码:901 / 906
页数:6
相关论文
共 50 条
  • [21] DeepIDC: A Prediction Framework of Injectable Drug Combination Based on Heterogeneous Information and Deep Learning
    Yang, Yuhe
    Gao, Dong
    Xie, Xueqin
    Qin, Jiaan
    Li, Jian
    Lin, Hao
    Yan, Dan
    Deng, Kejun
    CLINICAL PHARMACOKINETICS, 2022, 61 (12) : 1749 - 1759
  • [22] A deep learning-based framework to identify and characterise heterogeneous secure network traffic
    Ul Islam, Faiz
    Liu, Guangjie
    Liu, Weiwei
    ul Haq, Qazi Mazhar
    IET INFORMATION SECURITY, 2023, 17 (02) : 294 - 308
  • [23] Digital Holographic Reconstruction Based on Deep Learning Framework With Unpaired Data
    Yin, Da
    Gu, Zhongzheng
    Zhang, Yanran
    Gu, Fengyan
    Nie, Shouping
    Ma, Jun
    Yuan, Caojin
    IEEE PHOTONICS JOURNAL, 2020, 12 (02):
  • [24] Spark Based Distributed Deep Learning Framework For Big Data Applications
    Khumoyun, Akhmedov
    Cui, Yun
    Hanku, Lee
    2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND COMMUNICATIONS TECHNOLOGIES (ICISCT), 2016,
  • [25] A Deep Learning based architecture for rainfall estimation integrating heterogeneous data sources
    Folino, Gianluigi
    Guarascio, Massimo
    Chiaravalloti, Francesco
    Gabriele, Salvatore
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [26] Deep Learning for Fault Diagnosis Based on Multi-sourced Heterogeneous Data
    Ma, Yan
    Guo, Zhihong
    Su, Jianjun
    Chen, Yufeng
    Du, Xiuming
    Yang, Yi
    Li, Chengqi
    Lin, Ying
    Geng, Yujie
    2014 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2014,
  • [27] Sea Ice Image Classification Based on Heterogeneous Data Fusion and Deep Learning
    Han, Yanling
    Liu, Yekun
    Hong, Zhonghua
    Zhang, Yun
    Yang, Shuhu
    Wang, Jing
    REMOTE SENSING, 2021, 13 (04) : 1 - 20
  • [28] Geospatial data quality guarantee
    Service du Secrétariat général des archives et des communications, Commission scolaire du Val-des-Cerfs, Canada
    不详
    Geomatica, 1 (29-48):
  • [29] Quality guarantee data geospatial
    Plante, Katherine
    Gervais, Marc
    Geomatica, 2015, 69 (01) : 7 - 27
  • [30] DeepAM: a heterogeneous deep learning framework for intelligent malware detection
    Ye, Yanfang
    Chen, Lingwei
    Hou, Shifu
    Hardy, William
    Li, Xin
    KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 54 (02) : 265 - 285