THE DYDAS - "DYNAMIC DATA ANALYTICS SERVICES" PLATFORM FOR HPC BIG DATA ANALYTICS OF EARTH OBSERVATION AND GEOSPATIAL DATA

被引:0
|
作者
Picchiani, M. [1 ]
Maranesi, M. [1 ]
Mastrucci, M. [1 ]
Coltea, I. G. [2 ]
Pompei, G. [2 ]
Di Giacomo, L. [2 ]
机构
[1] GMATICS Srl, Rome, Italy
[2] Key Business Srl, Rome, Italy
关键词
Microwave radiometry; Lidar; Vegetation Optical Depth; Vegetation height;
D O I
10.1109/IGARSS46834.2022.9884375
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
In this work a novel High Performance Computing Platform aimed at streamline the application of demanding Earth Observation algorithms is presented. The platform is today in the operational phase and it is opened to new users. The development of the High Performance Computing (HPC) services has been carried out during the execution of the DYDAS project, that was aimed at developing a collaborative platform for offering data, algorithms, processing and analysis services to a large number of users from different public and private user communities. The platform will also act as an e-marketplace enabling transactions for accessing data and added value services enabled by HPC and based on Big Data technologies, machine learning, AI and advanced data analytics. Such strategy has been implemented with the purpose to match demand and offer among those who own intellectual properties on data/methods for their use and those who need or want to exploit them. In this manuscript, an example of data processing using Copernicus Sentinel-1 and Sentinel-2 data in a supervised classification exercise is presented.
引用
收藏
页码:4011 / 4014
页数:4
相关论文
共 50 条
  • [1] Big Data and HPC collocation: Using HPC idle resources for Big Data Analytics
    Mercier, Michael
    Glesser, David
    Georgiou, Yiannis
    Richard, Olivier
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 347 - 352
  • [2] Geospatial Big Data Analytics Engine for Spark
    Wang, Shaohua
    Zhong, Yang
    Lu, Hao
    Wang, Erqi
    Yun, Weiying
    Cai, Wenwen
    [J]. BIGSPATIAL 2017: PROCEEDINGS OF THE 6TH ACM SIGSPATIAL INTERNATIONAL WORKSHOP ON ANALYTICS FOR BIG GEOSPATIAL DATA (BIGSPATIAL-2017), 2017, : 42 - 45
  • [3] The Stratosphere platform for big data analytics
    Alexander Alexandrov
    Rico Bergmann
    Stephan Ewen
    Johann-Christoph Freytag
    Fabian Hueske
    Arvid Heise
    Odej Kao
    Marcus Leich
    Ulf Leser
    Volker Markl
    Felix Naumann
    Mathias Peters
    Astrid Rheinländer
    Matthias J. Sax
    Sebastian Schelter
    Mareike Höger
    Kostas Tzoumas
    Daniel Warneke
    [J]. The VLDB Journal, 2014, 23 : 939 - 964
  • [4] The Stratosphere platform for big data analytics
    Alexandrov, Alexander
    Bergmann, Rico
    Ewen, Stephan
    Freytag, Johann-Christoph
    Hueske, Fabian
    Heise, Arvid
    Kao, Odej
    Leich, Marcus
    Leser, Ulf
    Markl, Volker
    Naumann, Felix
    Peters, Mathias
    Rheinlaender, Astrid
    Sax, Matthias J.
    Schelter, Sebastian
    Hoeger, Mareike
    Tzoumas, Kostas
    Warneke, Daniel
    [J]. VLDB JOURNAL, 2014, 23 (06): : 939 - 964
  • [5] Big Data Platform for Educational Analytics
    Munshi, Amr A.
    Alhindi, Ahmad
    [J]. IEEE ACCESS, 2021, 9 : 52883 - 52890
  • [6] A Big Data platform for smart meter data analytics
    Wilcox, Tom
    Jin, Nanlin
    Flach, Peter
    Thumim, Joshua
    [J]. COMPUTERS IN INDUSTRY, 2019, 105 : 250 - 259
  • [7] CANDELA: A CLOUD PLATFORM FOR COPERNICUS EARTH OBSERVATION DATA ANALYTICS
    Rolland, Jean-Francois
    Castel, Fabien
    Haugommard, Anne
    Aubrun, Michelle
    Yao, Wei
    Dumitru, Corneliu Octavian
    Datcu, Mihai
    Bylicki, Michal
    Tran, Ba-Huy
    Aussenac-Gillles, Nathalie
    Comparot, Catherine
    Trojahn, Cassia
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 3104 - 3107
  • [8] Big Earth data analytics: a survey
    Yang, Chaowei
    Yu, Manzhu
    Li, Yun
    Hu, Fei
    Jiang, Yongyao
    Liu, Qian
    Sha, Dexuan
    Xu, Mengchao
    Gu, Juan
    [J]. BIG EARTH DATA, 2019, 3 (02) : 83 - 107
  • [9] Monitoring Data Integrity in Big Data Analytics Services
    Mantzoukas, Konstantinos
    Kloukinas, Christos
    Spanoudakis, George
    [J]. PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 904 - 907
  • [10] Using Distributed Data over HBase in Big Data Analytics Platform for Clinical Services
    Chrimes, Dillon
    Zamani, Hamid
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2017, 2017