File System Write-Optimization on High-Performance Computing Support Platform

被引:0
|
作者
Wang, Jiye [1 ]
Zeng, Nan [1 ]
Yu, Jun [2 ]
Zhu, Guangxin [2 ]
Pang, Hengmao [2 ]
Lin, Jian [2 ]
机构
[1] State Grid Corp China, Beijing, Peoples R China
[2] NARI Grp Corp, State Grid Elect Power Res Inst, Wuhan, Hubei, Peoples R China
关键词
Write Optimization; Distributed File System; Write-Ahead Log; HCSP;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The development of energy grid results in explosive data increasing. Handling the large volume of data not only requires vast storage space, but also requires the power to process them. Based on various write-optimization technologies, we proposed the high-performance computing support platform (HCSP) as a demonstration of write-optimization performance. HCSP integrates both hot/cold data layering and full-stack sense optimization, utilizes both SSD and SATA disk to accelerate the data storage and access. The experimental results show that compare to the small servers, HCSP not only provides a high-performance data access but also have a relatively short response time in various typical scenarios.
引用
收藏
页码:156 / 159
页数:4
相关论文
共 50 条
  • [1] BetrFS: Write-Optimization in a Kernel File System
    Jannen, William
    Yuan, Jun
    Zhan, Yang
    Akshintala, Amogh
    Esmet, John
    Jiao, Yizheng
    Mittal, Ankur
    Pandey, Prashant
    Reddy, Phaneendra
    Walsh, Leif
    Bender, Michael A.
    Farach-Colton, Martin
    Johnson, Rob
    Kuszmaul, Bradley C.
    Porter, Donald E.
    [J]. ACM TRANSACTIONS ON STORAGE, 2015, 11 (04)
  • [2] Implementing a global file system for high-performance Grid computing
    Andrews, P
    Kovatch, P
    Jordan, C
    [J]. GCA '05: Proceedings of the 2005 International Conference on Grid Computing and Applications, 2005, : 99 - 105
  • [3] High-Performance Metadata Integrity Protection in the WAFL Copy-on-Write File System
    Kumar, Harendra
    Patel, Yuvraj
    Kesavan, Ram
    Makam, Sumith
    [J]. PROCEEDINGS OF FAST '17: 15TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2017, : 197 - 211
  • [4] On the benefits of a workflow-aware file system in high-performance computing systems
    Wang, Yang
    Lu, Paul
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON HIGH-PERFORMANCE COMPUTING IN ASIA-PACIFIC REGION, PROCEEDINGS, 2005, : 227 - 234
  • [5] Ad Hoc File Systems for High-Performance Computing
    Brinkmann, Andre
    Mohror, Kathryn
    Yu, Weikuan
    Carns, Philip
    Cortes, Toni
    Klasky, Scott A.
    Miranda, Alberto
    Pfreundt, Franz-Josef
    Ross, Robert B.
    Vef, Marc-Andre
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2020, 35 (01) : 4 - 26
  • [6] A HIGH-PERFORMANCE FILE SYSTEM FOR UNIX
    POSTON, A
    [J]. PROCEEDINGS : WORKSHOP ON UNIX AND SUPERCOMPUTERS, 1988, : 215 - 226
  • [7] Ad Hoc File Systems for High-Performance Computing
    André Brinkmann
    Kathryn Mohror
    Weikuan Yu
    Philip Carns
    Toni Cortes
    Scott A. Klasky
    Alberto Miranda
    Franz-Josef Pfreundt
    Robert B. Ross
    Marc-André Vef
    [J]. Journal of Computer Science and Technology, 2020, 35 : 4 - 26
  • [8] Heterogeneous computing system platform for high-performance pattern recognition applications
    Mirzaei, M. Ali
    Voisin, Vincent
    Annovi, Alberto
    Baulieu, Guillaume
    Beretta, Matteo
    Calderini, Giovanni
    Citraro, Saverio
    Crescioli, Francesco
    Galbit, Geoffrey
    Liberali, Valentino
    Shojaii, Seyed Ruhollah
    Stabile, Alberto
    Tromeur, William
    Viret, Sebastien
    [J]. 2017 6TH INTERNATIONAL CONFERENCE ON MODERN CIRCUITS AND SYSTEMS TECHNOLOGIES (MOCAST), 2017,
  • [9] THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING
    Ponnavaikko, Kovendhan
    Janakiram, D.
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2009, 10 (01): : 115 - 130
  • [10] High performance topology optimization computing platform
    Sotiropoulos, Stefanos
    Kazakis, Georgios
    Lagaros, Nikos D.
    [J]. 1ST INTERNATIONAL CONFERENCE ON OPTIMIZATION-DRIVEN ARCHITECTURAL DESIGN (OPTARCH 2019), 2020, 44 : 441 - 448