Data Optimised Computing for Heterogeneous Big Data Computing Applications

被引:0
|
作者
Yang, Erica [1 ]
Ross, Derek [1 ]
Nagella, Srikanth [1 ]
Turner, Martin [1 ]
Kockelmann, Winfried [2 ]
Burca, Genoveva [2 ]
Pouzols, Federico Montesino [2 ]
机构
[1] Sci & Technol Facil Council, Rutherford Appleton Lab, Dept Comp Sci, Harwell Sci & Innovat Campus, Oxford, Oxon, England
[2] Sci & Technol Facil Council, Rutherford Appleton Lab, ISIS Neutron Facil, Oxford, Oxon, England
关键词
Data Intensive Science; Data Intensive Computing Platform; Facility Science; HPC resource optimisation; Data Analysis Platform;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rise of big science techniques is reshaping the provisioning of computing resources and scientific software in large science facilities. As facilities are gearing up for data intensive computing infrastructure, a wave of facility-based big science computing platforms is emerging. This paper presents a new computing paradigm towards designing HPC data analysis platform, named Data Optimised Computing (DOC). The DOC paradigm leverages the characteristics of science data to optimize HPC resource utilization and to improve users' ability to harness a variety of scientific analysis software frameworks. We present a preliminary architectural design of a software platform that implements this approach and also discuss the future directions of this work.
引用
收藏
页码:2817 / 2819
页数:3
相关论文
共 50 条
  • [1] Network computing and applications for Big Data analytics
    Abawajy, Jemal H.
    Zomaya, Albert Y.
    Stojmenovic, Ivan
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2016, 59 : 361 - 361
  • [2] Big Data: Cloud Computing in Genomics Applications
    Yeo, Hangu
    Crawford, Catherine H.
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 2904 - 2906
  • [3] Cloud computing and big data: Technologies and applications
    Zbakh, Mostapha
    Bakhouya, Mohamed
    Essaaidi, Mohamed
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (11):
  • [4] Parallel and distributed computing for Big Data applications
    Senger, Hermes
    Geyer, Claudio
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2412 - 2415
  • [5] Cloud computing and big data: Technologies and applications
    Zbakh, Mostapha
    Bakhouya, Mohamed
    Essaaidi, Mohamed
    Manneback, Pierre
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (12):
  • [6] Introduction to Big Data Computing for Geospatial Applications
    Li, Zhenlong
    Tang, Wenwu
    Huang, Qunying
    Shook, Eric
    Guan, Qingfeng
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (08)
  • [7] Transformative computing in security, big data analysis, and cloud computing applications
    Ogiela, Lidia
    Leu, Fang-Yie
    Fiore, Ugo
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (23):
  • [8] Big Data Applications Using Workflows for Data Parallel Computing
    Wang, Jianwu
    Crawl, Daniel
    Altintas, Ilkay
    Li, Weizhong
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2014, 16 (04) : 11 - 21
  • [9] Improving Data Fusion in Big Data Stream Computing for Automotive Applications
    Haroun, Amir
    Mostefaoui, Ahmed
    Dessables, Francois
    [J]. 2016 INT IEEE CONFERENCES ON UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING AND COMMUNICATIONS, CLOUD AND BIG DATA COMPUTING, INTERNET OF PEOPLE, AND SMART WORLD CONGRESS (UIC/ATC/SCALCOM/CBDCOM/IOP/SMARTWORLD), 2016, : 106 - 113
  • [10] Special issue on big data computing, analytics and applications
    Chenren Xu
    Zhu Han
    Yanyong Zhang
    Lan Zhang
    [J]. Personal and Ubiquitous Computing, 2017, 21 : 1 - 3