A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [21] OData for Service-Oriented Business Applications Comparative analysis of communication technologies for flexible Service-Oriented IT Architectures
    Cupek, Rafal
    Huczala, Lukasz
    2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2015, : 1538 - 1543
  • [22] A Service-Oriented Measurement Infrastructure for Cloud Computing Environments
    Hamilton, Gregg
    Pezaros, Dimitrios
    2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 947 - 952
  • [23] On the utilisation of a service-oriented infrastructure to support radiologist training
    Simpson, Andrew
    Slaymaker, Mark
    Power, David
    Russell, Douglas
    Yap, Moi Hoon
    Gale, Alastair
    2009 22ND IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, 2009, : 9 - +
  • [24] A service-oriented grid infrastructure for multimedia management and search
    Mlivoncic, M
    Schuler, C
    Türker, C
    Balko, S
    PEER-TO-PEER, GRID, AND SERVICE -ORIENTATION IN DIGITAL LIBRARY ARCHITECTURES, 2005, 3664 : 167 - 187
  • [25] A service-oriented approach to assessing the infrastructure value index
    Amaral, R.
    Alegre, H.
    Matos, J. S.
    WATER SCIENCE AND TECHNOLOGY, 2016, 74 (02) : 542 - 548
  • [26] Service-oriented Advanced Metering Infrastructure for Smart Grids
    Chen, Shudong
    Johan Lukkien
    Zhang, Liang
    2010 ASIA-PACIFIC POWER AND ENERGY ENGINEERING CONFERENCE (APPEEC), 2010,
  • [27] Advanced Technologies to Support Service Discovery in Service-Oriented Systems
    Azmy, Moh Roufiq
    Suhardi
    Muhamad, Wardani
    2020 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2020, : 300 - 305
  • [28] Grid accounting service infrastructure for service-oriented grid computing systems
    Abawajy, JH
    SCIENTIFIC APPLICATIONS OF GRID COMPUTING, 2004, 3458 : 168 - 175
  • [29] Data cleansing for service-oriented architecture
    Lee, JW
    Moon, E
    Choi, B
    E-COMMERCE AND WEB TECHNOLOGIES, PROCEEDINGS, 2005, 3590 : 87 - 97
  • [30] Integrating service-oriented technologies to support business processes
    Botta, A.
    Lazzerini, B.
    Marcelloni, F.
    Proc. Seventh IEEE Int. Conf. E-Commerce Technol. Workshops, (37-42):
12345