BESIII physical offline data analysis on virtualization platform

被引:0
|
作者
Huang, Q. [1 ]
Li, H. [1 ]
Kan, B. [1 ]
Shi, J. [1 ]
Lei, X. [1 ,2 ]
机构
[1] IHEP Comp Ctr, POB 918-7,19B Yuquan Rd, Beijing 100049, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
关键词
D O I
10.1088/1742-6596/664/2/022024
中图分类号
O57 [原子核物理学、高能物理学];
学科分类号
070202 ;
摘要
In this contribution, we present an ongoing work, which aims at benefiting BESIII computing system for higher resource utilization and more efficient job operations brought by cloud and virtualization technology with Openstack and KVM. We begin with the architecture of BESIII offline software to understand how it works. We mainly report the KVM performance evaluation and optimization from various factors in hardware and kernel. Experimental results show the CPU performance penalty of KVM can be approximately decreased to 3%. In addition, the performance comparison between KVM and physical machines in aspect of CPU, disk IO and network IO is also presented. Finally, we present our development work, an adaptive cloud scheduler, which allocates and reclaims VMs dynamically according to the status of TORQUE queue and the size of resource pool to improve resource utilization and job processing efficiency.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] BESIII Physical Analysis on Hadoop Platform
    Huo, Jing
    Zang, Dongsong
    Lei, Xiaofeng
    Li, Qiang
    Sun, Gongxing
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [2] The BEPCII data production and BESIII offline analysis software system
    Mao, ZP
    PROCEEDINGS OF CHEP 2001, 2001, : 202 - 204
  • [3] Offline data processing system of the BESIII experiment
    Zou, Jiaheng
    Li, Weidong
    Ma, Qiumei
    You, Zhengyun
    Sun, Shengsen
    Deng, Ziyan
    Ji, Xiaobin
    Zhemchugov, Alexy
    Fang, Wenxing
    Fu, Chengdong
    He, Kanglin
    Huang, Xingtao
    Lin, Tao
    Liu, Chunxiu
    Liu, Huaimin
    Mao, Zepu
    Qiu, Jinfa
    Sun, Yongzhao
    Wen, Shuopin
    Wu, Linghui
    Wang, Liangliang
    Yuan, Ye
    Zhang, Yao
    Zhang, Xiaomei
    Zhao, Guang
    EUROPEAN PHYSICAL JOURNAL C, 2024, 84 (09):
  • [4] The Architecture of BESIII Offline Database
    Chu, Yuanping
    Chen, Xihui
    Chen, Mali
    Ma, Qiumei
    He, Kanglin
    Li, Weidong
    Zhu, Kejun
    Li, Xiaonan
    Ye, Mei
    2009 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2009, : 484 - +
  • [5] Design and performance of the virtualization platform for offline computing on the ATLAS TDAQ Farm
    Ballestrero, S.
    Batraneanu, S. M.
    Brasolin, F.
    Contescu, C.
    Di Girolamo, A.
    Lee, C. J.
    Astigarraga, M. E. Pozo
    Scannicchio, D. A.
    Twomey, M. S.
    Zaytsev, A.
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [6] Study of BESIII MUC offline software with cosmic-ray data
    Liang Yu-Tie
    Mao Ya-Jun
    You Zheng-Yun
    Li Wei-Dong
    Bian Jian-Ming
    Cao Guo-Fu
    Cao Xue-Xiang
    Chen Shen-Jian
    Deng Zi-Yan
    Fu Cheng-Dong
    Gao Yuan-Ning
    Han Lei
    Han Shao-Qing
    He Kang-Lin
    He Miao
    Hu Ji-Feng
    Hu Xiao-Wei
    Huang Bin
    Huang Xing-Tao
    Jia Lu-Kui
    Ji Xiao-Bin
    Li Hai-Bo
    Liu Bei-Jiang
    Liu Chun-Xiu
    Liu Huai-Min
    Liu Ying
    Liu Yong
    Luo Tao
    Lue Qi-Wen
    Ma Qiu-Mei
    Ma Xiang
    Mao Ze-Pu
    Mo Xiao-Hu
    Ning Fei-Peng
    Ping Rong-Gang
    Qiu Jin-Fa
    Song Wen-Bo
    Sun Sheng-Sen
    Sun Xiao-Dong
    Sun Yong-Zhao
    Tian Hao-Lai
    Wang Ji-Ke
    Wang Liang-Liang
    Wen Shuo-Pin
    Wu Ling-Hui
    Wu Zhi
    Xie Yu-Guang
    Xu Min
    Yan Jie
    Yan Liang
    CHINESE PHYSICS C, 2009, 33 (07) : 562 - 566
  • [7] The offline data quality monitoring of the BESIII end cap TOF system
    Ming-Ming Ma
    Jing-Yi Liu
    Shuo-Pin Wen
    Sheng-Sen Sun
    Chun-Xiu Liu
    Yong-Zhao Sun
    Zi-Yan Deng
    Ye Yuan
    Hong-Liang Dai
    Zhi Wu
    Yue-Kun Heng
    Huai-Min Liu
    Radiation Detection Technology and Methods, 2019, 3
  • [8] Offline filter of data with abnormal high voltage at BESIII drift chamber
    Zhang, Ze-Heng
    Ma, Qiu-Mei
    Wu, Ling -Hui
    Wang, Liang-Liang
    Zou, Jia-Heng
    Fang, Wen -Xing
    Liu, Huai -Min
    Sun, Sheng-Sen
    Dong, Liao -Yuan
    Dong, Ming-Yi
    Lu, Ze-Hui
    Rong, Shao-Shi
    Li, Xu
    Zhang, Yao
    JOURNAL OF INSTRUMENTATION, 2024, 19 (06):
  • [9] The offline data quality monitoring of the BESIII end cap TOF system
    Ma, Ming-Ming
    Liu, Jing-Yi
    Wen, Shuo-Pin
    Sun, Sheng-Sen
    Liu, Chun-Xiu
    Sun, Yong-Zhao
    Deng, Zi-Yan
    Yuan, Ye
    Dai, Hong-Liang
    Wu, Zhi
    Heng, Yue-Kun
    Liu, Huai-Min
    RADIATION DETECTION TECHNOLOGY AND METHODS, 2019, 3 (04)
  • [10] The offline data quality monitoring of the BESIII end-cap TOF system
    Ma, Ming-Ming
    Liu, Jing-Yi
    Wen, Shuo-Pin
    Sun, Sheng-Sen
    Liu, Chun-Xiu
    Sun, Yong-Zhao
    Deng, Zi-Yan
    Yuan, Ye
    Dai, Hong-Liang
    Wu, Zhi
    Heng, Yue-Kun
    Liu, Huai-Min
    RADIATION DETECTION TECHNOLOGY AND METHODS, 2021, 5 (02) : 207 - 212