Processing LIDAR Data with Apache Hadoop

被引：2

作者：

Ruzicka, Jan ^{[1
]}

Orcik, Lukas ^{[2
]}

Ruzickova, Katerina ^{[1
]}

Kisztner, Juraj ^{[3
]}

机构：

[1] VSB Tech Univ Ostrava, Fac Min & Geol, Inst Geoinformat, 17 Listopadu 15-2172, Ostrava 70833, Czech Republic

[2] VSB Tech Univ Ostrava, Fac Elect Engn & Comp Sci, Dept Telecommun, 17 Listopadu 15, Ostrava 70833, Czech Republic

[3] VSB Tech Univ Ostrava, Inst Geol Engn, 17 Listopadu 15, Ostrava 70833, Czech Republic

来源：

RISE OF BIG SPATIAL DATA | 2017年

关键词：

LIDAR; MapReduce; GRID; Apache Hadoop; Cloudera;

D O I：

10.1007/978-3-319-45123-7_25

中图分类号：

P9 [自然地理学]; K9 [地理];

学科分类号：

0705 ; 070501 ;

摘要：

The paper is focused on research in the area of processing LIDAR data with Apache Hadoop. Our team is managing an information system that is able to calculate probability of existence of different objects in space and time. The system works with a lot of different data sources, including large datasets. We may process LIDAR data in the future as well, so we were interested how to process LIDAR data with Apache Hadoop. Our colleagues from the institute of geology are using LIDAR data and have a lot of problems with their processing. The main problem is time that is necessary to process the data to build simple DEM in GRID format that is commonly used in the geology (geomorphology) area. We were interested if we could help them with processing such kind of data with MapReduce architecture on Apache Hadoop to produce GRID data suitable to their needs. The paper presents results of our research.

引用

页码：351 / 358

页数：8

共 50 条

[31] Processing and Analysis of Seismic data in Hadoop Platform
Chen, Zhuang
Zhang, Ti
[J]. 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE & COMMUNICATION TECHNOLOGY (CICT), 2017,
[32] Telecom data processing and analysis based on hadoop
[J]. Zhang, Qingnian, 1600, Transport and Telecommunication Institute, Lomonosova street 1, Riga, LV-1019, Latvia (18):
[33] Performance Evaluation of Query Plan Recommendation with Apache Hadoop and Apache Spark
Azhir, Elham
Hosseinzadeh, Mehdi
Khan, Faheem
Mosavi, Amir
[J]. MATHEMATICS, 2022, 10 (19)
[34] Apache Spark: A Big Data Processing Engine
Shaikh, Eman
Mohiuddin, Iman
Alufaisan, Yasmeen
Nahvi, Irum
[J]. 2019 2ND IEEE MIDDLE EAST AND NORTH AFRICA COMMUNICATIONS CONFERENCE (IEEEMENACOMM'19), 2019, : 220 - 225
[35] HadoopTrajectory: a Hadoop spatiotemporal data processing extension
Mohamed Bakli
Mahmoud Sakr
Taysir Hassan A. Soliman
[J]. Journal of Geographical Systems, 2019, 21 : 211 - 235
[36] IC-Data: Improving Compressed Data Processing in Hadoop
Haider, Adnan
Yang, Xi
Liu, Ning
Sun, Xian-He
He, Shuibing
[J]. 2015 IEEE 22nd International Conference on High Performance Computing (HiPC), 2015, : 356 - 365
[37] Towards Efficient Big Data: Hadoop Data Placing and Processing
Bahadi, Jihane
El Asri, Bouchra
Courtine, Melanie
Rhanoui, Maryem
Kergosien, Yannick
[J]. 2ND INTERNATIONAL CONFERENCE ON SMART DIGITAL ENVIRONMENT (ICSDE'18), 2018, : 42 - 47
[38] Extensions to the Pig Data Processing Platform for Scalable RDF Data Processing Using Hadoop
Tanimura, Yusuke
Matono, Akiyoshi
Lynden, Steven
Kojima, Isao
[J]. 2010 IEEE 26TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDE 2010), 2010, : 251 - 256
[39] Analysis of Apache Logs Using Hadoop and Hive
Velinov, Aleksandar
Zdravev, Zoran
[J]. TEM JOURNAL-TECHNOLOGY EDUCATION MANAGEMENT INFORMATICS, 2018, 7 (03): : 645 - 650
[40] Hap: Protecting the Apache Hadoop Clusters with Hadoop Authentication Process Using Kerberos
Valliyappan, V.
Singh, Parminder
[J]. PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS (ICACNI 2015), VOL 1, 2016, 43 : 151 - 161

← 1 2 3 4 5 →