A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [41] Serviter: A service-oriented programmable network platform for shared infrastructure
    Yousef, B
    Hoang, DB
    Rogers, G
    COMPUTER COMMUNICATIONS, 2006, 29 (05) : 642 - 659
  • [42] Reactive/Proactive Connectivity Management in a Tactical Service-Oriented Infrastructure
    Lopes, Roberto Rigolin F.
    Nieminen, Mikko
    Viidanoja, Antti
    Wolthusen, Stephen D.
    2017 INTERNATIONAL CONFERENCE ON MILITARY COMMUNICATIONS AND INFORMATION SYSTEMS (ICMCIS), 2017,
  • [43] Towards a Distributed, Service-Oriented Control Infrastructure for Smart Grid
    Tariq, Muhammad Umer
    Grijalva, Santiago
    Wolf, Marilyn
    2011 ACM/IEEE Second International Conference on Cyber-Physical Systems (ICCPS 2011), 2011, : 35 - 44
  • [44] Connecting the clinical IT infrastructure to a service-oriented architecture of medical devices
    Andersen, Bjoern
    Kasparick, Martin
    Ulrich, Hannes
    Franke, Stefan
    Schlamelcher, Jan
    Rockstroh, Max
    Ingenerf, Josef
    BIOMEDICAL ENGINEERING-BIOMEDIZINISCHE TECHNIK, 2018, 63 (01): : 57 - 68
  • [45] GSiB: PSE infrastructure for dynamic service-oriented Grid applications
    Huang, Y
    FUTURE GENERATION COMPUTER SYSTEMS, 2005, 21 (06) : 868 - 877
  • [46] Service-Oriented Infrastructure to Support the Deployment of Evolvable Production Systems
    Candido, Goncalo
    Colombo, Armando W.
    Barata, Jose
    Jammes, Francois
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2011, 7 (04) : 759 - 767
  • [47] Service-oriented infrastructure for collaborative product design in ETO enterprises
    Wang, Zhongjie
    Zhan, Dechen
    Xu, Xiaofei
    2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 261 - 266
  • [48] A service-oriented infrastructure for collaborative learning in virtual knowledge spaces
    Bopp, Thomas
    Hinn, Robert
    Hampel, Thorsten
    EDUCATION FOR THE 21ST CENTURY - IMPACT OF ICT AND DIGITAL RESOURCES, 2006, 210 : 35 - +
  • [49] aCCountS: A service-oriented architecture for flexible pricing in cloud infrastructure
    Ponte, Nayane
    Trinta, Fernando
    Viana, Ricardo
    Andrade, Rossana
    Garcia, Vinicius
    Assad, Rodrigo
    7TH BRAZILIAN SYMPOSIUM ON SOFTWARE COMPONENTS, ARCHITECTURES AND REUSE (SBCARS 2013), 2013, : 49 - 58
  • [50] A Large-Scale Service-Oriented Sensor Grid Infrastructure
    Lim, Hock Beng
    Iqbal, Mudasser
    Wang, Wenqiang
    Yao, Yuxia
    2009 6TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1 AND 2, 2009, : 38 - 39
12345