Research on the Machine Learning Platform Design Scheme Based on the Spark Platform

被引:0
|
作者
Zhong, Jianxu [1 ]
Yu, Shaofeng [1 ]
Xi, Lingzhi [1 ]
Ma, Yining [1 ]
机构
[1] CSG Power Generat Co Informat Commun Branch, Guangzhou, Guangdong, Peoples R China
关键词
Spark platform; Machine learning; Linear regression; Platform measurement; Clustering algorithm;
D O I
10.1007/978-981-19-7184-6_48
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the continuous innovation of computer technology, artificial intelligence technology has played a positive role in industrial production and daily life. Especially with the advent of the era of big data, cloud computing and Internet of Things technology has attracted people's attention. Using Spark to build a machine learning platform has become the main direction for guests and scholars to explore and analyze. In the study of practical construction, the machine learning platform with Spark as the core should be built with a clear grasp of distributed cluster technology and cloud computing, so as to flexibly use existing computing resources and improve the processing efficiency of practical data. At the same time, experimental comparative analysis should be carried out under the conditions of one-click environment and Hadoop, which proves that the hybrid architecture machine learning platform constructed in this paper has strong application performance.
引用
收藏
页码:579 / 590
页数:12
相关论文
共 50 条
  • [1] An Intelligent DevOps Platform Research and Design Based on Machine Learning
    Wang, Zeqi
    Shi, Minyong
    Li, Chunfang
    [J]. 2020 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD 2020), 2020, : 42 - 47
  • [2] Research on Parallel Support Vector Machine Based on Spark Big Data Platform
    Huimin, Yao
    [J]. SCIENTIFIC PROGRAMMING, 2021, 2021
  • [3] Design of sports multimedia teaching platform based on machine learning
    Luo, Changwei
    [J]. SOFT COMPUTING, 2023,
  • [4] SPARK-A Big Data Processing Platform for Machine Learning
    Fu, Jian
    Sun, Junwei
    Wang, Kaiyuan
    [J]. 2016 2ND INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS - COMPUTING TECHNOLOGY, INTELLIGENT TECHNOLOGY, INDUSTRIAL INFORMATION INTEGRATION (ICIICII), 2016, : 48 - 51
  • [5] Research and Design of Adult Mobile Learning Platform Based on Android
    Zhang, Jian
    Li, Li
    [J]. INTERNATIONAL CONFERENCE ON MODERN EDUCATION AND SOCIAL SCIENCE (MESS 2015), 2015, : 199 - 202
  • [6] Research on a Web-based Learning Platform in Art Design
    Xiong, Mei Ni
    Pan, Bao Quan
    [J]. MANUFACTURING, DESIGN SCIENCE AND INFORMATION ENGINEERING, VOLS I AND II, 2015, : 1643 - 1649
  • [7] HeteroSpark: A Heterogeneous CPU/GPU Spark Platform for Machine Learning Algorithms
    Li, Peilong
    Luo, Yan
    Zhang, Ning
    Cao, Yu
    [J]. PROCEEDINGS OF THE 2015 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE AND STORAGE (NAS), 2015, : 347 - 350
  • [8] A Community Platform for Research on Pricing and Distributed Machine Learning
    Li, Xuanzhe
    Gomena, Samuel
    Ballard, Logan
    Li, Juntao
    Aryafar, Ehsan
    Joe-Wong, Carlee
    [J]. 2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, : 1223 - 1226
  • [9] Machine Learning Based Interactive Drawing Platform
    Kural, Oguz Emre
    Kilic, Erdal
    [J]. 2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [10] Design and research of English listening learning system based on android platform
    [J]. Xinmei, Tang, 1600, Universidad Central de Venezuela (55):