A High-Speed Asynchronous Data I/O Method for HEPS

被引：0

作者：

Fu, Shiyuan ^{[1
]}

Wang, Lu ^{[2
]}

Cheng, Yaodong ^{[1
,3
,4
]}

Hu, Yu ^{[1
]}

Liu, Rui ^{[1
]}

Wang, Lei ^{[1
]}

Wang, Shuang ^{[1
]}

Liu, Jianli ^{[1
]}

Sun, Haokai ^{[1
]}

Qi, Fazhi ^{[1
]}

机构：

[1] Chinese Acad Sci, Inst High Energy Phys, Beijing 100049, Peoples R China

[2] Chinese Acad Sci, Natl Sci Lib, Beijing 100190, Peoples R China

[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China

[4] TIANFU Cosm Ray Res Ctr, Chengdu 610041, Sichuan, Peoples R China

来源：

26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023 | 2024年 / 295卷

关键词：

D O I：

10.1051/epjconf/202429502001

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

The High Energy Photon Source (HEPS) is expected to produce a substantial volume of data, lead to immense data I/O pressure during computing. Inefficient data I /O can significantly impact computing performance. To address this challenge, firstly, we have developed a data I/O framework for HEPS. This framework consists of three layers: data channel layer, distributed memory management layer, and I/O interface layer. It mask the underlying data di fferences in formats and sources, while implementing efficient I/O methods. Additionally, it supports both stream computing and batch computing. Secondly, we have designed a data processing pipeline scheme aimed at reducing I/O latency and optimizing I/O bandwidth utilization during the processing of high-throughput data. This involves breaking down the computing task into several stages, including data loading, data pre-processing, data processing, and data writing, which are executed asynchronously and in parallel. Finally, we introduce the design of stream data I/O process. The primary objective of stream data I/O is to enable real-time online processing of raw data, avoiding I/O bottlenecks caused by disk storage. This approach ensures the stability of data transmission and integrates distributed memory management to guarantee data integrity in memory.

引用

页数：6

共 50 条

[11] HIGH-SPEED CMOS I/O BUFFER CIRCUITS
ISHIBE, M
OTAKA, S
TAKEDA, J
TANAKA, S
TOYOSHIMA, Y
TAKATSUKA, S
SHIMIZU, S
IEICE TRANSACTIONS ON ELECTRONICS, 1992, E75C (04) : 569 - 571
[12] Power analysis for high-speed I/O transmitters
Hatamkhani, H
Yang, CKK
2004 SYMPOSIUM ON VLSI CIRCUITS, DIGEST OF TECHNICAL PAPERS, 2004, : 142 - 145
[13] Modeling and Analysis of High-Speed I/O Links
Balamurugan, Ganesh
Casper, Bryan
Jaussi, James E.
Mansuri, Mozhgan
O'Mahony, Frank
Kennedy, Joseph
IEEE TRANSACTIONS ON ADVANCED PACKAGING, 2009, 32 (02): : 237 - 247
[14] Forward Error Correction for High-Speed I/O
Narasimha, Rajan Lakshmi
Shanbhag, Naresh
2008 42ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-4, 2008, : 1513 - 1517
[15] Data centre energy efficiency optimisation in high-speed packet I/O frameworks
Trifonov, Hristo
Heffernan, Donal
INTERNATIONAL JOURNAL OF COMMUNICATION NETWORKS AND DISTRIBUTED SYSTEMS, 2022, 28 (03) : 266 - 286
[16] I/O COMPUTERS BOOST HIGH-SPEED ACQUISITION
SONSINO, S
CONTROL AND INSTRUMENTATION, 1987, 19 (04): : 65 - 65
[17] High-Speed Contactless I/O for Computing Devices
Thakkar, C.
Jaussi, J.
Casper, B.
2018 IEEE CUSTOM INTEGRATED CIRCUITS CONFERENCE (CICC), 2018,
[18] Precursor ISI reduction in high-speed I/O
Ren, Jihong
Lee, Haechang
Lin, Q.
Leibowitz, Brian
Chen, E-Hung
Oh, Dan
Lambrecht, Frank
Stojanovic, Vladimir
Yang, Chih-Kong Ken
Zerbe, Jared
2007 Symposium on VLSI Circuits, Digest of Technical Papers, 2007, : 134 - 135
[19] GridFS: Ensuring high-speed data transfer using massively parallel I/O
Bhardwaj, D
Sinha, M
DATABASES IN NETWORKED INFORMATION SYSTEMS, PROCEEDINGS, 2005, 3433 : 280 - 287
[20] OPTICAL I/O FOR HIGH-SPEED CMOS SYSTEMS
FRIED, JA
OPTICAL ENGINEERING, 1986, 25 (10) : 1132 - 1141

← 1 2 3 4 5 →