Distributed correlation model mining from remote sensing big data based on gene expression programming

被引:0
|
作者
Lechan Yang
Zhihao Qin
机构
[1] Nanjing University,International Institute for Earth System Science
[2] Chinese Academy of Agricultural Sciences,Institute of Agricultural Resources and Regional Planning
关键词
Correlation model mining; Remote sensing; Big data; Gene expression programming;
D O I
暂无
中图分类号
学科分类号
摘要
With the continuous development of remote sensing techniques, an enormous amount of remote sensing data is collected by observing the earth. The method by which researchers mine the relevant knowledge accurately and efficiently from remote sensing big data remains a topic of interest. The existing model mining algorithms usually rely on a priori knowledge, and cannot meet the actual needs of remote sensing data mining. This paper proposes distributed correlation model mining from remote sensing big data based on gene expression programming (DCMM-GEP) combined with cloud computing to find a better model for remote sensing big data using an abnormal value recognition algorithm based on residual sum of residual (AVR-RSR) and a global model generation algorithm for remote sensing big data based on linear least squares (GMGRS-LLS). Comparative experiments show that DCMM-GEP outperforms both distributed correlation model mining based on genetic programming and genetic algorithms, showing better average time-consumption, R-square values and prediction accuracy. The comparative results also show that with an increasing number of computing nodes, DCMM-GEP has a good speed-up ratio and scale-up ratio.
引用
收藏
页码:1000 / 1011
页数:11
相关论文
共 50 条
  • [41] A Special Issue on Big Data from Space for Geoscience and Remote Sensing
    Marchetti, Pier Giorgio
    Soille, Pierre
    Bruzzone, Lorenzo
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2016, 4 (03): : 7 - 9
  • [42] A Design of Distributed Data Mining Model Based on Agent
    Xu Hongyan
    Wang Mingyu
    Wang Mu
    Yan Song
    Feng Yong
    [J]. EBM 2010: INTERNATIONAL CONFERENCE ON ENGINEERING AND BUSINESS MANAGEMENT, VOLS 1-8, 2010, : 4972 - +
  • [43] A Spark-Based Big Data Platform for Massive Remote Sensing Data Processing
    Sun, Zhongyi
    Chen, Fengke
    Chi, Mingmin
    Zhu, Yangyong
    [J]. DATA SCIENCE, 2015, 9208 : 120 - 126
  • [44] Hydrological Analysis Using Satellite Remote Sensing Big Data and CREST Model
    Ma, Jun
    Sun, Weiwei
    Yang, Gang
    Zhang, Dianfa
    [J]. IEEE ACCESS, 2018, 6 : 9006 - 9016
  • [45] An In-Memory Data-Cube Aware Distributed Data Discovery Across Clouds for Remote Sensing Big Data
    Song, Jie
    Ma, Yan
    Zhang, Zhixin
    Liu, Peng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4529 - 4548
  • [46] DOUBLE LAYER PROGRAMMING MODEL TO THE SCHEDULING OF REMOTE SENSING DATA PROCESSING TASKS
    He, Min-Fan
    Xing, Li-Ning
    Li, Wen
    Xiang, Shang
    Tan, Xu
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2019, 12 (4-5): : 1515 - 1526
  • [47] Towards Building a Distributed Data Management Architecture to Integrate Multi-sources Remote Sensing Big Data
    Huang, Xiaohui
    Wang, Lizhe
    Yan, Jining
    Deng, Ze
    Wang, Shaoyuan
    Ma, Yan
    [J]. IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 83 - 90
  • [48] ANALYSIS MODEL BASED RECOVERY OF REMOTE SENSING DATA
    Li, Xinghua
    Shen, Huanfeng
    Li, Huifang
    Zhang, Liangpei
    [J]. 2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 2491 - 2494
  • [49] Multi-source remote sensing big data mining reveals cross-regional correlation between aquaculture and Enteromorpha disaster outbreaks
    Fan, Jianchao
    Ma, Yujuan
    Liang, Tingting
    Cui, Guangyan
    [J]. GEO-SPATIAL INFORMATION SCIENCE, 2024,
  • [50] VCCM mining: Mining virtual community core members based on Gene Expression Programming
    Qiao, Shaojie
    Tang, Changjie
    Peng, Jing
    Fan, Hongjian
    Xiang, Yong
    [J]. INTELLIGENCE AND SECURITY INFORMATICS, PROCEEDINGS, 2006, 3917 : 133 - 138