An Overview on the Convergence of High Performance Computing and Big Data Processing

被引:0
|
作者
Mei, Songzhu [1 ,2 ]
Guan, Hongtao [1 ,2 ]
Wang, Qinglin [1 ,2 ]
机构
[1] Natl Univ Def Technol, Sci & Technol Parallel & Distributed Lab, Changsha, Hunan, Peoples R China
[2] Natl Univ Def Technol, Sch Comp, Changsha, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
high performance computing; big data; convergence; high performance data analysis; MAPREDUCE; SYSTEM;
D O I
10.1109/ICPADS.2018.00141
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, with the rapid development of big data processing technology, streaming data processing and real-time data analysis have gradually become new research hotspots. Both the industry and the academia have invested a lot of research into the efficient processing methods of massive data generated in the environment such as the Internet and e-commerce. Meanwhile, high-performance computing technology and supercomputers are also looking for new business growth points. The convergence of big data processing and high performance computing technology is the general trend of big data analysis in the future. This paper will give a brief overview of typical technologies in the fusion process of big data processing and high-performance computing.
引用
收藏
页码:1046 / 1051
页数:6
相关论文
共 50 条
  • [1] High-Performance Computing for Big Data Processing
    Wu, Yulei
    Xiang, Yang
    Ge, Jingguo
    Muller, Peter
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 88 : 693 - 695
  • [2] Optimization and Upgrading of Big Data Processing Techniques in High Performance Computing Environments
    Li, Jianguang
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [3] The Convergence of Big Data and Mobile Computing
    Waluyo, Agustinus Borgy
    Taniar, David
    Srinivasan, Bala
    [J]. 2013 16TH INTERNATIONAL CONFERENCE ON NETWORK-BASED INFORMATION SYSTEMS (NBIS 2013), 2013, : 79 - 84
  • [4] High Performance Computing Cluster System and its Future Aspects in Processing Big Data
    Reddy, Kishor Kumar C.
    Chandrudu, Bala K. E.
    Anisha, P. R.
    Raju, G. V. S.
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 881 - 885
  • [5] pipsCloud: High performance cloud computing for remote sensing big data management and processing
    Wang, Lizhe
    Ma, Yan
    Yan, Jining
    Chang, Victor
    Zomaya, Albert Y.
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 78 : 353 - 368
  • [6] Cloud Computing in Remote Sensing : High Performance Remote Sensing Data Processing in a Big data Environment
    Sabri, Y.
    Aouad, S.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (06)
  • [7] Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing
    Ahmad, Awais
    Paul, Anand
    Din, Sadia
    Rathore, M. Mazhar
    Choi, Gyu Sang
    Jeon, Gwanggil
    [J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2018, 46 (03) : 508 - 527
  • [8] Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing
    Awais Ahmad
    Anand Paul
    Sadia Din
    M. Mazhar Rathore
    Gyu Sang Choi
    Gwanggil Jeon
    [J]. International Journal of Parallel Programming, 2018, 46 : 508 - 527
  • [9] Contributions to High-Performance Big Data Computing
    Fox, Geoffrey
    Qiu, Judy
    Crandall, David
    Von Laszewski, Gregor
    Beckstein, Oliver
    Paden, John
    Paraskevakos, Ioannis
    Jha, Shantenu
    Wang, Fusheng
    Marathe, Madhav
    Vullikanti, Anil
    Cheatham, Thomas
    [J]. FUTURE TRENDS OF HPC IN A DISRUPTIVE SCENARIO, 2019, 34 : 34 - 81
  • [10] Toward High-Performance Computing and Big Data Analytics Convergence: The Case of Spark-DIY
    Caino-Lores, Silvina
    Carretero, Jesus
    Nicolae, Bogdan
    Yildiz, Orcun
    Peterka, Tom
    [J]. IEEE ACCESS, 2019, 7 : 156929 - 156955