A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [1] Service-Oriented Distributed Energy Data Management Using Big Data Technologies
    Gibadullin, R. F.
    Baimukhametova, G. A.
    Perukhin, M. Yu
    2019 INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING, APPLICATIONS AND MANUFACTURING (ICIEAM), 2019,
  • [2] A service-oriented Grid infrastructure for biomedical data and compute services
    Arbona, Antonio
    Benkner, Siegfried
    Engelbrecht, Gerhard
    Fingberg, Jochen
    Hofmann, Martin
    Kumpf, Kai
    Lonsdale, Guy
    Woehrer, Alexander
    IEEE TRANSACTIONS ON NANOBIOSCIENCE, 2007, 6 (02) : 136 - 141
  • [3] Service-oriented RunTime infrastructure on grid
    Lee, TD
    Yoo, SH
    Jeong, CS
    GRID AND COOPERATIVE COMPUTING GCC 2004 WORKSHOPS, PROCEEDINGS, 2004, 3252 : 736 - 743
  • [4] A service-oriented framework for remote sensing big data processing
    Enayati, Roohollah
    Ravanmehr, Reza
    Aghazarian, Vahe
    EARTH SCIENCE INFORMATICS, 2023, 16 (01) : 591 - 616
  • [5] A service-oriented framework for remote sensing big data processing
    Roohollah Enayati
    Reza Ravanmehr
    Vahe Aghazarian
    Earth Science Informatics, 2023, 16 : 591 - 616
  • [6] Service-Oriented Architecture for Big Data Analytics in Smart Cities
    Al-Jaroodi, Jameela
    Mohamed, Nader
    2018 18TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2018, : 633 - 640
  • [7] A Service-oriented Network Infrastructure for Crossover Service Ecosystems
    Zheng, Bangpeng
    Yin, Jianwei
    Deng, Shuiguang
    Wu, Zhaohui
    Dustdar, Schahram
    IEEE INTERNET COMPUTING, 2020, 24 (01) : 48 - 58
  • [8] Towards a Service-Oriented Architecture for Knowledge Management in Big Data Era
    Thang Le Dinh
    Thuong-Cang Phan
    Trung Bui
    Manh Chien Vu
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2018, 14 (04) : 24 - 38
  • [9] A service-oriented approach for assessing infrastructure security
    Masera, Marcelo
    Fovino, Igor Nai
    CRITICAL INFRASTRUCTURE PROTE CTION, 2008, 253 : 367 - 379
  • [10] Service-Oriented University: Infrastructure for the University of Tomorrow
    Zender, Raphael
    Tavangarian, Djamshid
    INTELLIGENT INTERACTIVE ASSISTANCE AND MOBILE MULTIMEDIA COMPUTING, 2009, 53 : 73 - 84
12345