Performance Analysis of Machine Learning Techniques on Big Data Using Apache Spark

被引：3

作者：

Mogha, Garima ^{[1
]}

Ahlawat, Khyati ^{[1
]}

Singh, Amit Prakash ^{[1
]}

机构：

[1] Guru Gobind Singh Indraprastha Univ, Univ Sch Informat Commun & Technol, New Delhi, India

来源：

DATA SCIENCE AND ANALYTICS | 2018年 / 799卷

关键词：

Big data; Apache spark; Machine learning; Apache hadoop; DATA ANALYTICS; CLASSIFICATION;

D O I：

10.1007/978-981-10-8527-7_2

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Applying Intelligence to the machines is a need in today's world and this need leads to the evolution of machine learning. The analysis of data using machine learning algorithms is a trending research area and this analysis lead to some problems when the data comes out to be big data. This paper compares various classification based machine learning algorithms namely, Decision Tree Learning, Naive Bayes, Random Forest and Support Vector Machines on big data using Apache Spark. The accuracy is evaluated to find out which classification based algorithm gives fast and better result.

引用

页码：17 / 26

页数：10

共 50 条

[31] Big Data Software Analytics with Apache Spark
Gousios, Georgios
[J]. PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION, 2018, : 542 - 543
[32] Apache Spark: A Big Data Processing Engine
Shaikh, Eman
Mohiuddin, Iman
Alufaisan, Yasmeen
Nahvi, Irum
[J]. 2019 2ND IEEE MIDDLE EAST AND NORTH AFRICA COMMUNICATIONS CONFERENCE (IEEEMENACOMM'19), 2019, : 220 - 225
[33] Performance Evaluation of Machine Learning Algorithms in Apache Spark for Intrusion Detection
Dobson, Anthony
Roy, Kaushik
Yuan, Xiaohong
Xu, Jinsheng
[J]. 2018 28TH INTERNATIONAL TELECOMMUNICATION NETWORKS AND APPLICATIONS CONFERENCE (ITNAC), 2018, : 374 - 379
[34] Understanding and Optimizing the Performance of Distributed Machine Learning Applications on Apache Spark
Dunner, Celestine
Parnell, Thomas
Atasu, Kubilay
Sifalakis, Manolis
Pozidis, Haralampos
[J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 331 - 338
[35] Testing of algorithms for anomaly detection in Big data using apache spark
Lighari, Sheeraz Niaz
Hussain, Dil Muhammad Akbar
[J]. 2017 9TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2017, : 97 - 100
[36] Social Media Data Processing Infrastructure by Using Apache Spark Big Data Platform: Twitter Data Analysis
Podhoranyi, Michal
Vojacek, Lukas
[J]. 2019 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT 2019), 2019, : 1 - 6
[37] A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench
N. Ahmed
Andre L. C. Barczak
Teo Susnjak
Mohammed A. Rashid
[J]. Journal of Big Data, 7
[38] A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench
Ahmed, N.
Barczak, Andre L. C.
Susnjak, Teo
Rashid, Mohammed A.
[J]. JOURNAL OF BIG DATA, 2020, 7 (01)
[39] Query Execution Time Analysis Using Apache Spark Framework for Big Data: A CRM Approach
Yadav, Madan Lal
[J]. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2022, 21 (04)
[40] Apache Spark and Apache Ignite Performance Analysis
Stan, Cristiana-Stefania
Pandelica, Adrian-Eduard
Zamfir, Vlad-Andrei
Stan, Roxana Gabriela
Negru, Catalin
[J]. 2019 22ND INTERNATIONAL CONFERENCE ON CONTROL SYSTEMS AND COMPUTER SCIENCE (CSCS), 2019, : 726 - 733

← 1 2 3 4 5 →