Distributed correlation model mining from remote sensing big data based on gene expression programming

被引:0
|
作者
Lechan Yang
Zhihao Qin
机构
[1] Nanjing University,International Institute for Earth System Science
[2] Chinese Academy of Agricultural Sciences,Institute of Agricultural Resources and Regional Planning
关键词
Correlation model mining; Remote sensing; Big data; Gene expression programming;
D O I
暂无
中图分类号
学科分类号
摘要
With the continuous development of remote sensing techniques, an enormous amount of remote sensing data is collected by observing the earth. The method by which researchers mine the relevant knowledge accurately and efficiently from remote sensing big data remains a topic of interest. The existing model mining algorithms usually rely on a priori knowledge, and cannot meet the actual needs of remote sensing data mining. This paper proposes distributed correlation model mining from remote sensing big data based on gene expression programming (DCMM-GEP) combined with cloud computing to find a better model for remote sensing big data using an abnormal value recognition algorithm based on residual sum of residual (AVR-RSR) and a global model generation algorithm for remote sensing big data based on linear least squares (GMGRS-LLS). Comparative experiments show that DCMM-GEP outperforms both distributed correlation model mining based on genetic programming and genetic algorithms, showing better average time-consumption, R-square values and prediction accuracy. The comparative results also show that with an increasing number of computing nodes, DCMM-GEP has a good speed-up ratio and scale-up ratio.
引用
收藏
页码:1000 / 1011
页数:11
相关论文
共 50 条
  • [21] Mining recursive functions based on gene expression programming
    Wu, Jiang
    Tang, Chang-Jie
    Jiang, Yue
    Ye, Shang-Yu
    Duan, Lei
    Li, Tai-Yong
    [J]. Sichuan Daxue Xuebao (Gongcheng Kexue Ban)/Journal of Sichuan University (Engineering Science Edition), 2007, 39 (05): : 127 - 132
  • [22] Performance evaluation of Gene Expression Programming for hydraulic data mining
    Eldrandaly, Khalid
    Negm, Abdel-Azim
    [J]. INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2008, 5 (02) : 126 - 131
  • [23] Spatially distributed crop model based on remote sensing
    Han, Congying
    Zhang, Baozhong
    Chen, He
    Wei, Zheng
    Liu, Yu
    [J]. AGRICULTURAL WATER MANAGEMENT, 2019, 218 : 165 - 173
  • [24] Accessible Remote Sensing Data Mining Based Dew Estimation
    Suo, Ying
    Wang, Zhongjing
    Zhang, Zixiong
    Fassnacht, Steven R.
    [J]. REMOTE SENSING, 2022, 14 (22)
  • [25] Image retrieval from remote sensing big data: A survey
    Li, Yansheng
    Ma, Jiayi
    Zhang, Yongjun
    [J]. INFORMATION FUSION, 2021, 67 : 94 - 115
  • [26] PROCESSING BIG REMOTE SENSING DATA FOR FAST FLOOD DETECTION IN A DISTRIBUTED COMPUTING ENVIRONMENT
    Olasz, A.
    Kristof, D.
    Nguyen Thai, B.
    Belenyesi, M.
    Giachetta, R.
    [J]. FOSS4G-EUROPE 2017 - ACADEMIC TRACK, 2017, 42-4 (W2):
  • [27] Distributed Deep Learning for Big Remote Sensing Data Processing on Apache Spark: Geological Remote Sensing Interpretation as a Case Study
    Long, Ao
    Han, Wei
    Huang, Xiaohui
    Li, Jiabao
    Wang, Yuewei
    Chen, Jia
    [J]. WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 96 - 110
  • [28] DQPFS: Distributed quadratic programming based feature selection for big data
    Soheili, Majid
    Eftekhari-Moghadam, Amir Masoud
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2020, 138 : 1 - 14
  • [29] Evaluating evapotranspiration using data mining instead of physical-based model in remote sensing
    Neissi, Lamya
    Golabi, Mona
    Albaji, Mohammad
    Naseri, Abd Ali
    [J]. THEORETICAL AND APPLIED CLIMATOLOGY, 2022, 147 (1-2) : 701 - 716
  • [30] Evaluating evapotranspiration using data mining instead of physical-based model in remote sensing
    Lamya Neissi
    Mona Golabi
    Mohammad Albaji
    Abd Ali Naseri
    [J]. Theoretical and Applied Climatology, 2022, 147 : 701 - 716