Distributed Data Access/Find System with Metadata for Data-Intensive Computing

被引:0
|
作者
Ikebe, Minoru [1 ]
Inomata, Atsuo [1 ]
Fujikawa, Kazutoshi [1 ]
Sunahara, Hideki [1 ]
机构
[1] Nara Inst Sci & Technol, Grad Sch Informat Sci, Nara, Japan
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The data-intensive computing generates a huge number of data in wide area network. The DataGrid technology tries to manage such distributed data on the Internet to provide the quick and efficient data search/access mechanism. The difficulties of the data access on DataGrid systems is caused from the differences in the data management manner and policy among organizations which manage storage resources. In this paper, we propose the new distributed data management scheme and design for data-intensive computing. Especially, we focus on the data attributes. We define the pairs of data attribute and its values as its metadata. In our system, users can be find/access data with the metadata. We have been developing the prototype systems. We show the usage of our system with the applications.
引用
收藏
页码:361 / 366
页数:6
相关论文
共 50 条
  • [1] Data-Intensive Computing Modules for Teaching Parallel and Distributed Computing
    Gowanlock, Michael
    Gallet, Benoit
    [J]. 2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 350 - 357
  • [2] Nebula: Distributed Edge Cloud for Data-Intensive Computing
    Ryden, Mathew
    Oh, Kwangsung
    Chandra, Abhishek
    Weissman, Jon
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2014, : 491 - 492
  • [3] Distributed Data Provenance for Large-Scale Data-Intensive Computing
    Zhao, Dongfang
    Shou, Chen
    Malik, Tanu
    Raicu, Ioan
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2013,
  • [4] A Distributed Data Management System for Data-intensive Radio Astronomy
    Grimstrup, Arne
    Mahadevan, Venkat
    Eymere, Olivier
    Anderson, Ken
    Kiddle, Cameron
    Simmonds, Rob
    Rosolowsky, Erik
    Taylor, Andrew R.
    [J]. SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY II, 2012, 8451
  • [5] Applications in Data-Intensive Computing
    Shah, Anuj R.
    Adkins, Joshua N.
    Baxter, Douglas J.
    Cannon, William R.
    Chavarria-Miranda, Daniel G.
    Choudhury, Sutanay
    Gorton, Ian
    Gracio, Deborah K.
    Halter, Todd D.
    Jaitly, Navdeep D.
    Johnson, John R.
    Kouzes, Richard T.
    Macduff, Matthew C.
    Marquez, Andres
    Monroe, Matthew E.
    Oehmen, Christopher S.
    Pike, William A.
    Scherrer, Chad
    Villa, Oreste
    Webb-Robertson, Bobbie-Jo
    Whitney, Paul D.
    Zuljevic, Nino
    [J]. ADVANCES IN COMPUTERS, VOL 79, 2010, 79 : 1 - 70
  • [6] Location, Location, Location: Data-Intensive Distributed Computing in the Cloud
    Luckeneder, Michael
    Barker, Adam
    [J]. 2013 IEEE FIFTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), VOL 1, 2013, : 647 - 654
  • [7] Data-intensive workflow management: For clouds and data-intensive and scalable computing environments
    De Oliveira, Daniel C.M.
    Liu, Ji
    Pacitti, Esther
    [J]. Synthesis Lectures on Data Management, 2019, 14 (04): : 1 - 179
  • [8] Rethinking Memory System Design for Data-Intensive Computing
    Mutlu, Onur
    [J]. Proceedings International Conference on Embedded Computer Systems - Architectures, Modeling and Simulation (SAMOS XV), 2015, : I - I
  • [9] G-Hadoop: MapReduce across distributed data centers for data-intensive computing
    Wang, Lizhe
    Tao, Jie
    Ranjan, Rajiv
    Marten, Holger
    Streit, Achim
    Chen, Jingying
    Chen, Dan
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (03): : 739 - 750
  • [10] Data-intensive computing and digital libraries
    Moore, R
    Prince, TA
    Ellisman, M
    [J]. COMMUNICATIONS OF THE ACM, 1998, 41 (11) : 56 - 62