Processing LIDAR Data with Apache Hadoop

被引:2
|
作者
Ruzicka, Jan [1 ]
Orcik, Lukas [2 ]
Ruzickova, Katerina [1 ]
Kisztner, Juraj [3 ]
机构
[1] VSB Tech Univ Ostrava, Fac Min & Geol, Inst Geoinformat, 17 Listopadu 15-2172, Ostrava 70833, Czech Republic
[2] VSB Tech Univ Ostrava, Fac Elect Engn & Comp Sci, Dept Telecommun, 17 Listopadu 15, Ostrava 70833, Czech Republic
[3] VSB Tech Univ Ostrava, Inst Geol Engn, 17 Listopadu 15, Ostrava 70833, Czech Republic
来源
关键词
LIDAR; MapReduce; GRID; Apache Hadoop; Cloudera;
D O I
10.1007/978-3-319-45123-7_25
中图分类号
P9 [自然地理学]; K9 [地理];
学科分类号
0705 ; 070501 ;
摘要
The paper is focused on research in the area of processing LIDAR data with Apache Hadoop. Our team is managing an information system that is able to calculate probability of existence of different objects in space and time. The system works with a lot of different data sources, including large datasets. We may process LIDAR data in the future as well, so we were interested how to process LIDAR data with Apache Hadoop. Our colleagues from the institute of geology are using LIDAR data and have a lot of problems with their processing. The main problem is time that is necessary to process the data to build simple DEM in GRID format that is commonly used in the geology (geomorphology) area. We were interested if we could help them with processing such kind of data with MapReduce architecture on Apache Hadoop to produce GRID data suitable to their needs. The paper presents results of our research.
引用
收藏
页码:351 / 358
页数:8
相关论文
共 50 条
  • [1] Processing of Big Educational Data in the Cloud Using Apache Hadoop
    Machova, Renata
    Komarkova, Jitka
    Lnenicka, Martin
    [J]. INTERNATIONAL CONFERENCE ON INFORMATION SOCIETY (I-SOCIETY 2016), 2016, : 46 - 49
  • [2] A proposal of a big web data application and archive for the distributed data processing with Apache Hadoop
    University of Pardubice, Faculty of Economics and Administration, Pardubice, Czech Republic
    [J]. Lect. Notes Comput. Sci, (285-294):
  • [3] A Proposal of a Big Web Data Application and Archive for the Distributed Data Processing with Apache Hadoop
    Lnenicka, Martin
    Hovad, Jan
    Komarkova, Jitka
    [J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE (ICCCI 2015), PT II, 2015, 9330 : 285 - 294
  • [4] A Modern Data Architecture with Apache Hadoop
    Singh, Tripty
    Darshan, V. S.
    [J]. 2015 INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT), 2015, : 574 - 579
  • [5] Extensible Video Processing Framework in Apache Hadoop
    Ryu, Chungmo
    Lee, Daecheol
    Jang, Minwook
    Kim, Cheolgi
    Seo, Euiseong
    [J]. 2013 IEEE FIFTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), VOL 2, 2013, : 305 - 308
  • [6] Processing Big Data with Apache Hadoop in the Current Challenging Era of COVID-19
    Azeroual, Otmane
    Fabre, Renaud
    [J]. BIG DATA AND COGNITIVE COMPUTING, 2021, 5 (01)
  • [7] Global expansion of apache hadoop/apache spark activities at NTT DATA
    Ranaweera, Ravindra Sandaruwan
    Ajisaka, Akira
    [J]. NTT Technical Review, 2018, 16 (02):
  • [8] On the Usability of Hadoop MapReduce, Apache Spark & Apache Flink for Data Science
    Akil, Bilal
    Zhou, Ying
    Roehm, Uwe
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 303 - 310
  • [9] Big Data Analysis using Apache Hadoop
    Manikandan, Shankar Ganesh
    Ravi, Siddarth
    [J]. 2014 INTERNATIONAL CONFERENCE ON IT CONVERGENCE AND SECURITY (ICITCS), 2014,
  • [10] Creating Large Size of Data with Apache Hadoop
    Ruzicka, Jan
    Kocich, David
    Orcik, Lukas
    Svozilik, Vladislav
    [J]. RISE OF BIG SPATIAL DATA, 2017, : 307 - 314