An Executable Specification of Map-Join-Reduce Using Haskell

被引:3
|
作者
Ren, Junqi [1 ,2 ]
Liu, Lei [1 ]
Liu, Feng [1 ,2 ]
Zhou, Wenbo [1 ,2 ]
Lu, Shuai [1 ,2 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Jilin, Peoples R China
[2] Jilin Univ, Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun 130012, Jilin, Peoples R China
基金
中国国家自然科学基金;
关键词
Cloud computing; executable specification; programming model; PROGRAMMING-MODEL; HADOOP MAPREDUCE; PERFORMANCE; FRAMEWORK;
D O I
10.1109/ACCESS.2019.2891285
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Map-Join-Reduce programming model effectively supports the join operation among different heterogeneous data sets by adding the Join module and processes the multiway joining directly. In this paper, we propose a rigorous description of the Map-Join-Reduce that performs as an executable specification. First, this paper briefly introduces the differences between the Map-Join-Reduce and the MapReduce. Then, we use Haskell to specify each module of the Map-Join-Reduce programming model and analyze the structure and function of each module. Finally, we test the specification by analyzing an example of the mall sales records. The executable specification contributes to helping the developers to unscramble the relationship between the MapReduce and the Map-Join-Reduce, which may serve as a basis for further development of the theory of related programming model design. Furthermore, the most important function of an executable specification is guaranteeing the target informal or semi-formal model with interesting properties. This paper is a forward step to prepare for verifying related properties and, even, providing verified prototypes.
引用
收藏
页码:10892 / 10904
页数:13
相关论文
共 50 条
  • [1] Data Analyzing Using Map-Join-Reduce in Cloud Storage
    Bhardwaj, Ruchi
    Mishra, Neetesh
    Kumar, Rajiv
    [J]. 2014 INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2014, : 370 - 373
  • [2] MAP-JOIN-REDUCE: Toward Scalable and Efficient Data Analysis on Large Clusters
    Jiang, Dawei
    Tung, Anthony K. H.
    Chen, Gang
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2011, 23 (09) : 1299 - 1311
  • [3] An Abstract Description Method of Map-Reduce-Merge Using Haskell
    Liu, Lei
    Liu, Dongqing
    Lu, Shuai
    Zhang, Peng
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
  • [4] An Efficient Improved Join Algorithm Using Map Reduce in Hadoop
    Patel, Warish D.
    Vaghela, Dineshkumar B.
    [J]. 2014 INTERNATIONAL CONFERENCE ON SIGNAL PROPAGATION AND COMPUTER TECHNOLOGY (ICSPCT 2014), 2014, : 263 - 272
  • [5] The Evaluation of Map-Reduce Join Algorithms
    Penar, Maciej
    Wilczek, Artur
    [J]. BEYOND DATABASES, ARCHITECTURES AND STRUCTURES, BDAS 2016, 2016, 613 : 192 - 203
  • [6] Using Coq in Specification and Program Extraction of Hadoop Map Reduce Applications
    Ono, Kosuke
    Hirai, Yoichi
    Tanabe, Yoshinori
    Noda, Natsuko
    Hagiya, Masami
    [J]. SOFTWARE ENGINEERING AND FORMAL METHODS, 2011, 7041 : 350 - +
  • [7] Design of an Executable Specification Language Using Eye Tracking
    Simhandl, Georg
    Paulweber, Philipp
    Zdun, Uwe
    [J]. 2019 IEEE/ACM 6TH INTERNATIONAL WORKSHOP ON EYE MOVEMENTS IN PROGRAMMING (EMIP 2019), 2019, : 37 - 40
  • [8] Verification of the ROS NavFn planner using executable specification languages
    Martin-Martin, Enrique
    Montenegro, Manuel
    Riesco, Adrian
    Rodriguez-Hortala, Juan
    Rubio, Ruben
    [J]. JOURNAL OF LOGICAL AND ALGEBRAIC METHODS IN PROGRAMMING, 2023, 132
  • [9] The Design of the Efficient Theta-Join in Map-Reduce Environment
    Penar, Maciej
    Wilczek, Artur
    [J]. BEYOND DATABASES, ARCHITECTURES AND STRUCTURES, BDAS 2016, 2016, 613 : 204 - 215
  • [10] CoqJVM: An executable specification of the Java']Java Virtual Machine using dependent types
    Atkey, Robert
    [J]. TYPES FOR PROOFS AND PROGRAMS, 2008, 4941 : 18 - 32