HDQGF:Heterogeneous Data Quality Guarantee Framework Based on Deep Learning

被引:0
|
作者
Zhang, Yun [1 ,2 ]
Jin, Zongze [1 ]
Zhu, Weilin [1 ]
Chi, Lei [1 ,2 ]
Wang, Weiping [1 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
关键词
date quality; data preprecessing; deep learning; heterogeneous integration;
D O I
10.1109/CSCWD49262.2021.9437684
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although user-generated data on the Internet contains rich information, many approaches cannot effectively guarantee data quality for data analysis from raw data. In recent years, many researches on data quality guarantee using machine learning have shown that enhancing data quality is conducive to improve the accuracy of analysis results. But the existing approaches only consider the single dimension and neglect the fusion of heterogeneous data, such as images or social graphs. To consider this element and address the above issue, we leverage the deep learning technique to guarantee the data quality by using the heterogeneous data. Our framework is named HDQGF, which is an end-to-end approach using a combination of multiple networks to fuse heterogeneous information. In order to verify the effectiveness of the model, we designed related experiments on three real datasets. According to the experimental results, our model HDQGF can enhance the performance by improving the data quality.
引用
收藏
页码:901 / 906
页数:6
相关论文
共 50 条
  • [1] DeepFusion: A Deep Learning Framework for the Fusion of Heterogeneous Sensory Data
    Xue, Hongfei
    Jiang, Wenjun
    Miao, Chenglin
    Yuan, Ye
    Ma, Fenglong
    Ma, Xin
    Wang, Yijiang
    Yao, Shuochao
    Xu, Wenyao
    Zhang, Aidong
    Su, Lu
    PROCEEDINGS OF THE 2019 THE TWENTIETH ACM INTERNATIONAL SYMPOSIUM ON MOBILE AD HOC NETWORKING AND COMPUTING (MOBIHOC '19), 2019, : 151 - 160
  • [2] Slicing Framework for Service Level Agreement Guarantee in Heterogeneous Networks-A Deep Reinforcement Learning Approach
    Zhang, Heng
    Xu, Shugong
    Zhang, Shunqing
    Jiang, Zhiyuan
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (01) : 193 - 197
  • [3] A Deep Learning-Based Framework for Offensive Text Detection in Unstructured Data for Heterogeneous Social Media
    Bacha, Jamshid
    Ullah, Farman
    Khan, Jebran
    Sardar, Abdul Wasay
    Lee, Sungchang
    IEEE ACCESS, 2023, 11 : 124484 - 124498
  • [4] Towards a Data Quality Framework for Heterogeneous Data
    Micic, Natasha
    Neagu, Daniel
    Campean, Felician
    Zadeh, Esmaeil Habib
    2017 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2017, : 155 - 162
  • [5] A deep learning framework for Hybrid Heterogeneous Transfer Learning
    Zhou, Joey Tianyi
    Pan, Sinno Jialin
    Tsang, Ivor W.
    ARTIFICIAL INTELLIGENCE, 2019, 275 : 310 - 328
  • [6] DLPF: A parallel deep learning programming framework based on heterogeneous architecture
    Wang Y.
    Dou Y.
    Lü Q.
    Li B.
    Li T.
    1600, Science Press (53): : 1202 - 1210
  • [7] A Data-Driven Autonomous Assessment Framework for Education Quality Based on Multiscale Deep Learning
    Wang, Junqiao
    Cho, Sung-Je
    Chen, Xiwang
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (09)
  • [8] A unified deep learning framework for urban functional zone extraction based on multi-source heterogeneous data
    Lu, Weipeng
    Tao, Chao
    Li, Haifeng
    Qi, Ji
    Li, Yansheng
    REMOTE SENSING OF ENVIRONMENT, 2022, 270
  • [9] A contemporary technique to guarantee quality of service (QoS) for heterogeneous data traffic
    Calduwel, Newton P.
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON INFORMATION SECURITY AND ASSURANCE, 2008, : 210 - 213
  • [10] ImageDC: Image Data Cleaning Framework Based on Deep Learning
    Zhang, Yun
    Jin, Zongze
    Liu, Fan
    Zhu, Weilin
    Mu, Weimin
    Wang, Weiping
    PROCEEDINGS OF 2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS), 2020, : 748 - 752