M2M: A Simple Matlab-to-MapReduce Translator for Cloud Computing

被引:12
|
作者
Zhang, Junbo [1 ,2 ]
Xiang, Dong [3 ]
Li, Tianrui [1 ]
Pan, Yi [2 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China
[2] Georgia State Univ, Dept Comp Sci, Atlanta, GA 30303 USA
[3] Tsinghua Univ, Sch Software, Beijing 100084, Peoples R China
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
MapReduce; Matlab; translator; cloud computing;
D O I
10.1109/TST.2013.6449402
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
MapReduce is a very popular parallel programming model for cloud computing platforms, and has become an effective method for processing massive data by using a cluster of computers. X-to-MapReduce (X is a program language) translator is a possible solution to help traditional programmers easily deploy an application to cloud systems through translating sequential codes to MapReduce codes. Recently, some SQL-to-MapReduce translators emerge to translate SQL-like queries to MapReduce codes and have good performance in cloud systems. However, SQL-to-MapReduce translators mainly focus on SQL-like queries, but not on numerical computation. Matlab is a high-level language and interactive environment for numerical computation, visualization, and programming, which is very popular in engineering. We propose and develop a simple Matlab-to-MapReduce translator for cloud computing, called M2M, for basic numerical computations. M2M can translate a Matlab code with up to 100 commands to MapReduce code in few seconds, which may cost a proficient Hadoop MapReduce programmer some days on coding so many commands. In addition, M2M can also recognize the dependency between complex commands, which is always confusing during hand coding. We implemented M2M with evaluation for Matlab commands on a cluster. Several common commands are used in our experiments. The results show that M2M is comparable in performance with hand-coded programs.
引用
收藏
页码:1 / 9
页数:9
相关论文
共 50 条
  • [1] M2M:A Simple Matlab-to-MapReduce Translator for Cloud Computing
    Junbo Zhang
    Dong Xiang
    Tianrui Li
    Yi Pan
    [J]. Tsinghua Science and Technology, 2013, 18 (01) : 1 - 9
  • [2] J2M: a Java to MapReduce translator for cloud computing
    Bing Li
    Junbo Zhang
    Ning Yu
    Yi Pan
    [J]. The Journal of Supercomputing, 2016, 72 : 1928 - 1945
  • [3] J2M: a Java']Java to MapReduce translator for cloud computing
    Li, Bing
    Zhang, Junbo
    Yu, Ning
    Pan, Yi
    [J]. JOURNAL OF SUPERCOMPUTING, 2016, 72 (05): : 1928 - 1945
  • [4] Cloud computing for ubiquitous computing on M2M and IoT environment mobile application
    DongBum Seo
    You-Boo Jeon
    Song-Hee Lee
    Keun-Ho Lee
    [J]. Cluster Computing, 2016, 19 : 1001 - 1013
  • [5] Cloud computing for ubiquitous computing on M2M and IoT environment mobile application
    Seo, DongBum
    Jeon, You-Boo
    Lee, Song-Hee
    Lee, Keun-Ho
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2016, 19 (02): : 1001 - 1013
  • [6] Practice of M2M Connecting Real-World Things with Cloud Computing
    Osawa, Tatsuzo
    [J]. FUJITSU SCIENTIFIC & TECHNICAL JOURNAL, 2011, 47 (04): : 401 - 407
  • [7] Servitization in a construction machinery industry by using M2M and cloud computing systems
    Vanzulli, Beatrice
    Kosaka, Michitaka
    Matsuda, Fujio
    [J]. 2014 11TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2014,
  • [8] M2M Communications Meets the Cloud
    Viswanathan, Harish
    Lenney, Mary
    [J]. ENRICHING COMMUNICATIONS, 2011, 5 (02):
  • [9] Cloud Based Service for M2M Communication
    Cackovic, Vanesa
    Popovic, Zeljko
    [J]. 2012 IX INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (BIHTEL), 2012,
  • [10] Migrating legacy M2M systems to the cloud
    Laird Technologies, United States
    [J]. ECN Electron. Compon. News, 2013, 9 (28-30):