Performance Analysis of Machine Learning Techniques on Big Data Using Apache Spark

被引：3

作者：

Mogha, Garima ^{[1
]}

Ahlawat, Khyati ^{[1
]}

Singh, Amit Prakash ^{[1
]}

机构：

[1] Guru Gobind Singh Indraprastha Univ, Univ Sch Informat Commun & Technol, New Delhi, India

来源：

DATA SCIENCE AND ANALYTICS | 2018年 / 799卷

关键词：

Big data; Apache spark; Machine learning; Apache hadoop; DATA ANALYTICS; CLASSIFICATION;

D O I：

10.1007/978-981-10-8527-7_2

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Applying Intelligence to the machines is a need in today's world and this need leads to the evolution of machine learning. The analysis of data using machine learning algorithms is a trending research area and this analysis lead to some problems when the data comes out to be big data. This paper compares various classification based machine learning algorithms namely, Decision Tree Learning, Naive Bayes, Random Forest and Support Vector Machines on big data using Apache Spark. The accuracy is evaluated to find out which classification based algorithm gives fast and better result.

引用

页码：17 / 26

页数：10

共 50 条

[1] Big Data Machine Learning using Apache Spark MLlib
Assefi, Mehdi
Behravesh, Ehsun
Liu, Guangchi
Tafti, Ahmad P.
[J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 3492 - 3498
[2] An insight into tree based machine learning techniques for big data Analytics using Apache Spark
Sheshasaayee, Ananthi
Lakshmi, J. V. N.
[J]. 2017 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING, INSTRUMENTATION AND CONTROL TECHNOLOGIES (ICICICT), 2017, : 1740 - 1743
[3] Big data Predictive Analytics for Apache Spark using Machine Learning
Junaid, Muhammad
Wagan, Shiraz Ali
Qureshi, Nawab Muhammad Faseeh
Nam, Choon Sung
Shin, Dong Ryeol
[J]. 2020 GLOBAL CONFERENCE ON WIRELESS AND OPTICAL TECHNOLOGIES (GCWOT), 2020,
[4] On Scalability of Distributed Machine Learning with Big Data on Apache Spark
Hai, Ameen Abdel
Forouraghi, Babak
[J]. BIG DATA - BIGDATA 2018, 2018, 10968 : 209 - 219
[5] A Big Data Analysis Framework Using Apache Spark and Deep Learning
Gupta, Anand
Thakur, Hardeo Kumar
Shrivastava, Ritvik
Kumar, Pulkit
Nag, Sreyashi
[J]. 2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2017), 2017, : 9 - 16
[6] Effective Selection of Machine Learning Algorithms for Big Data Analytics Using Apache Spark
Hafez, Manar Mohamed
Shehab, Mohamed Elemam
El Fakharany, Essam
Hegazy, Abd El Ftah Abdel Ghfar
[J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT SYSTEMS AND INFORMATICS 2016, 2017, 533 : 692 - 704
[7] Big data processing with Apache Spark in university institutions: spark streaming and machine learning algorithm
Boachie, Emmanuel
Li, Chunlin
[J]. INTERNATIONAL JOURNAL OF CONTINUING ENGINEERING EDUCATION AND LIFE-LONG LEARNING, 2019, 29 (1-2) : 5 - 20
[8] Performance evaluation of DNN with other machine learning techniques in a cluster using Apache Spark and MLlib
JayaLakshmi, A. N. M.
Kishore, K. V. Krishna
[J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (01) : 1311 - 1319
[9] Performance Analysis of Java']Java Virtual Machine for Machine Learning Workloads using Apache Spark
Hema, N.
Srinivasa, K. G.
Chidambaram, Saravanan
Saraswat, Sandeep
Saraswati, Sujoy
Ramachandra, Ranganath
Huttanagoudar, Jayashree B.
[J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INFORMATICS AND ANALYTICS (ICIA' 16), 2016,
[10] Mobile Big Data Analytics Using Deep Learning and Apache Spark
Abu Alsheikh, Mohammad
Niyato, Dusit
Lin, Shaowei
Tan, Hwee-Pink
Han, Zhu
[J]. IEEE NETWORK, 2016, 30 (03): : 22 - 29

← 1 2 3 4 5 →