Distributed correlation model mining from remote sensing big data based on gene expression programming

被引:0
|
作者
Lechan Yang
Zhihao Qin
机构
[1] Nanjing University,International Institute for Earth System Science
[2] Chinese Academy of Agricultural Sciences,Institute of Agricultural Resources and Regional Planning
关键词
Correlation model mining; Remote sensing; Big data; Gene expression programming;
D O I
暂无
中图分类号
学科分类号
摘要
With the continuous development of remote sensing techniques, an enormous amount of remote sensing data is collected by observing the earth. The method by which researchers mine the relevant knowledge accurately and efficiently from remote sensing big data remains a topic of interest. The existing model mining algorithms usually rely on a priori knowledge, and cannot meet the actual needs of remote sensing data mining. This paper proposes distributed correlation model mining from remote sensing big data based on gene expression programming (DCMM-GEP) combined with cloud computing to find a better model for remote sensing big data using an abnormal value recognition algorithm based on residual sum of residual (AVR-RSR) and a global model generation algorithm for remote sensing big data based on linear least squares (GMGRS-LLS). Comparative experiments show that DCMM-GEP outperforms both distributed correlation model mining based on genetic programming and genetic algorithms, showing better average time-consumption, R-square values and prediction accuracy. The comparative results also show that with an increasing number of computing nodes, DCMM-GEP has a good speed-up ratio and scale-up ratio.
引用
收藏
页码:1000 / 1011
页数:11
相关论文
共 50 条
  • [1] Distributed correlation model mining from remote sensing big data based on gene expression programming
    Yang, Lechan
    Qin, Zhihao
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2018, 11 (05) : 1000 - 1011
  • [2] Hybrid Gene Expression Programming-Based Sensor Data Correlation Mining
    Lechan Yang
    Zhihao Qin
    Kun Wang
    Song Deng
    [J]. China Communications, 2017, 14 (01) : 34 - 49
  • [3] Hybrid Gene Expression Programming-Based Sensor Data Correlation Mining
    Yang, Lechan
    Qin, Zhihao
    Wang, Kun
    Deng, Song
    [J]. CHINA COMMUNICATIONS, 2017, 14 (01) : 34 - 49
  • [4] Distributed Function Mining for Gene Expression Programming Based on Fast Reduction
    Deng, Song
    Yue, Dong
    Yang, Le-chan
    Fu, Xiong
    Feng, Ya-zhou
    [J]. PLOS ONE, 2016, 11 (01):
  • [5] Data mining based on Gene Expression Programming and Clonal Selection
    Karakasis, Vassilios K.
    Stafylopatis, Andreas
    [J]. 2006 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-6, 2006, : 514 - +
  • [6] Research on the Application of Big Data Automatic Search and Data Mining Based on Remote Sensing Technology
    Zeng Degui
    Yu Fei
    [J]. 2020 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD 2020), 2020, : 122 - 127
  • [7] Distributed electricity load forecasting model mining based on hybrid gene expression programming and cloud computing
    Deng, Song
    Yuan, Changan
    Yang, Lechan
    Zhang, Liping
    [J]. PATTERN RECOGNITION LETTERS, 2018, 109 : 72 - 80
  • [8] Big Earth Observation Data Integration in Remote Sensing Based on a Distributed Spatial Framework
    Cheng, Yinyi
    Zhou, Kefa
    Wang, Jinlin
    Yan, Jining
    [J]. REMOTE SENSING, 2020, 12 (06)
  • [9] Hadoop based Mining of Distributed Association Rules from Big Data
    Bouraoui, Marwa
    Bouzouita, Ines
    Touzi, Amel Grissa
    [J]. 2017 18TH INTERNATIONAL CONFERENCE ON SCIENCES AND TECHNIQUES OF AUTOMATIC CONTROL AND COMPUTER ENGINEERING (STA), 2017, : 185 - 190
  • [10] Distributed reflectance model mining of leaf nitrogen content by using gene expression programming
    Yang, Lechan
    Li, Wenjuan
    Qin, Zhihao
    Deng, Song
    Tu, Lili
    [J]. 2016 FIFTH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2016, : 433 - 438