A TOOLKIT FOR STORAGE QOS PROVISIONING FOR DATA-INTENSIVE APPLICATIONS

被引:4
|
作者
Slota, Renata [1 ,2 ]
Krol, Dariusz [1 ]
Skalkowski, Kornel [1 ,2 ]
Orzechowski, Michal [1 ]
Nikolow, Darin [1 ,2 ]
Kryza, Bartosz [1 ]
Wrzeszcz, Michal [1 ]
Kitowski, Jacek [1 ,2 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Elect, Dept Comp Sci, Krakow, Poland
[2] AGH Univ Sci & Technol, ACC Cyfronet, AGH, Krakow, Poland
来源
COMPUTER SCIENCE-AGH | 2012年 / 13卷 / 01期
关键词
data-intensive application; storage management; QoS; Grid;
D O I
10.7494/csci.2012.13.1.63
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper describes a programming toolkit developed in the PL-Grid project, named QStorMan, which supports storage QoS provisioning for data-intensive applications in distributed environments. QStorMan exploits knowledge-oriented methods for matching storage resources to non-functional requirements, which are defined for a data-intensive application. In order to support various usage scenarios, QStorMan provides two interfaces, such as programming libraries or a web portal. The interfaces allow to define the requirements either directly in an application source code or by using an intuitive graphical interface. The first way provides finer granularity, e.g., each portion of data processed by an application can define a different set of requirements. The second method is aimed at legacy applications support, which source code can not be modified. The toolkit has been evaluated using synthetic benchmarks and the production infrastructure of PL-Grid, in particular its storage infrastructure, which utilizes the Lustre file system.
引用
收藏
页码:63 / 73
页数:11
相关论文
共 50 条
  • [1] Storage QoS provisioning for execution programming of data-intensive applications
    Slota, Renata
    [J]. SCIENTIFIC PROGRAMMING, 2012, 20 (01) : 69 - 80
  • [2] Provisioning, Placement and Pipelining Strategies for Data-Intensive Applications in Cloud Environments
    Ghoshal, Devarshi
    Ramakrishnan, Lavanya
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E), 2014, : 325 - 330
  • [3] NSM: A distributed storage architecture for data-intensive applications
    Ali, Z
    Malluhi, Q
    [J]. 20TH IEEE/11TH NASA GODDARD CONFERENCE ON MASS STORAGE AND TECHNOLOGIES (MSST 2003), PROCEEDINGS, 2003, : 87 - 91
  • [4] Optimal Resource Provisioning for Data-intensive Microservices
    Erdei, Roland Mark
    Toka, Laszlo
    [J]. PROCEEDINGS OF THE IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM 2022, 2022,
  • [5] FIVO/QSTORMAN SEMANTIC TOOLKIT FOR SUPPORTING DATA-INTENSIVE APPLICATIONS IN DISTRIBUTED ENVIRONMENTS
    Slota, Renata
    Nikolow, Darin
    Kitowski, Jacek
    Krol, Dariusz
    Kryza, Bartosz
    [J]. COMPUTING AND INFORMATICS, 2012, 31 (05) : 1003 - 1024
  • [6] QoS-Aware Data Replication for Data-Intensive Applications in Cloud Computing Systems
    Lin, Jenn-Wei
    Chen, Chien-Hung
    Chang, J. Morris
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2013, 1 (01) : 101 - 115
  • [7] Applications in Data-Intensive Computing
    Shah, Anuj R.
    Adkins, Joshua N.
    Baxter, Douglas J.
    Cannon, William R.
    Chavarria-Miranda, Daniel G.
    Choudhury, Sutanay
    Gorton, Ian
    Gracio, Deborah K.
    Halter, Todd D.
    Jaitly, Navdeep D.
    Johnson, John R.
    Kouzes, Richard T.
    Macduff, Matthew C.
    Marquez, Andres
    Monroe, Matthew E.
    Oehmen, Christopher S.
    Pike, William A.
    Scherrer, Chad
    Villa, Oreste
    Webb-Robertson, Bobbie-Jo
    Whitney, Paul D.
    Zuljevic, Nino
    [J]. ADVANCES IN COMPUTERS, VOL 79, 2010, 79 : 1 - 70
  • [8] Metacomputing and data-intensive applications
    Messina, P
    [J]. WORLDWIDE COMPUTING AND ITS APPLICATIONS, 1997, 1274 : 226 - 236
  • [9] Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka
    Toosi, Adel Nadjaran
    Sinnott, Richard O.
    Buyya, Rajkumar
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 79 : 765 - 775
  • [10] Managing Cloud networking costs for data-intensive applications by provisioning dedicated network links
    Sfiligoi, Igor
    Hare, Michael
    Schultz, David
    Wurthwein, Frank
    Riedel, Benedikt
    Hutton, Tom
    Barnet, Steve
    Brik, Vladimir
    [J]. PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2021, PEARC 2021, 2021,