Addressing Big Data Challenges for Scientific Data Infrastructure

被引:0
|
作者
Demchenko, Yuri [1 ]
Zhao, Zhiming [1 ]
Grosso, Paola [1 ]
Wibisono, Adianto [1 ]
de Laat, Cees [1 ]
机构
[1] Univ Amsterdam, Syst & Network Engn Grp, Amsterdam, Netherlands
关键词
Big Data Science; Scientific Data Infrastructure (SDI); Scientific Data Lifecycle Management (SDLM); Cloud Infrastructure Services;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper discusses the challenges that are imposed by Big Data Science on the modern and future Scientific Data Infrastructure (SDI). The paper refers to different scientific communities to define requirements on data management, access control and security. The paper introduces the Scientific Data Lifecycle Management (SDLM) model that includes all the major stages and reflects specifics in data management in modern e-Science. The paper proposes the SDI generic architecture model that provides a basis for building interoperable data or project centric SDI using modern technologies and best practices. The paper explains how, the proposed models SDLM and SDI can be naturally implemented using modern cloud based infrastructure services provisioning model.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Addressing Big Data Issues in Scientific Data Infrastructure
    Demchenko, Yuri
    Grosso, Paola
    de Laat, Cees
    Membrey, Peter
    [J]. PROCEEDINGS OF THE 2013 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2013, : 48 - 55
  • [2] Addressing Big Data Analytics Issues and Challenges Using Cloud Infrastructure
    Moosa, Hanna
    Rana, Muhammad Ehsan
    [J]. 2022 INTERNATIONAL CONFERENCE ON DECISION AID SCIENCES AND APPLICATIONS (DASA), 2022, : 61 - 65
  • [3] Big Data Infrastructure, Data Visualisation and Challenges
    Venkatraman, Ramanathan
    Venkatraman, Sitalakshmi
    [J]. 3RD INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS (BDIOT 2019), 2018, : 13 - 17
  • [4] Hadoop: Addressing Challenges of Big Data
    Singh, Kamalpreet
    Kaur, Ravinder
    [J]. SOUVENIR OF THE 2014 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2014, : 686 - 689
  • [5] Addressing the Policy Challenges and Opportunities of "Big Data"
    Margetts, Helen
    Sutcliffe, David
    [J]. POLICY AND INTERNET, 2013, 5 (02): : 139 - 146
  • [6] Addressing challenges with Big Data for Media Measurement
    Mazumdar, Mainak
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 23 - 23
  • [7] Big Impacts and Big Data: Addressing the Challenges of Managing DebriSat's Characterization Data
    Kleespies, Joseph
    Fitz-Coy, Norman
    [J]. 2016 IEEE AEROSPACE CONFERENCE, 2016,
  • [8] Addressing the Shimming Problem in Big Data Scientific Workflows
    Mohan, Aravind
    Lu, Shiyong
    Kotov, Alexander
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2014), 2014, : 347 - 354
  • [9] Decolonizing big data: addressing data colonialism in social work's grand challenges
    BlackDeer, Autumn Asher
    Beeler, Sara
    [J]. JOURNAL OF ETHNIC & CULTURAL DIVERSITY IN SOCIAL WORK, 2024,
  • [10] Addressing Data Veracity in Big Data Applications
    Aman, Saima
    Chelmis, Charalampos
    Prasanna, Viktor
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014,