Data race detection via few-shot parameter-efficient fine-tuning

被引:0
|
作者
Shen, Yuanyuan [1 ]
Peng, Manman [2 ]
Zhang, Fan [2 ]
Wu, Qiang [2 ]
机构
[1] North Univ China, Sch Data Sci & Technol, Taiyuan 030051, Peoples R China
[2] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Peoples R China
关键词
Data race detection; Parallelization; Few-shot parameter-efficient fine-tuning; Adapter; Neural architecture search;
D O I
10.1016/j.jss.2024.112289
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The OpenMP programming model is playing an increasing role in parallelization on shared-memory systems owing to its simplicity of operation and portability. OpenMP provides the semantic equivalent of a parallel program for the original sequential program. Though it is easier to write parallel programs using OpenMP, writing them correctly is a challenge. Data race conditions errors can easily occur during the writing process, particularly by inexperienced programmers. Some data race checkers have been developed to help programmers check for data race in parallel programs. However, several of them have constraints on the input and thread configuration, time overhead, and scope of program analysis. In this study, we target data race detection in OpenMP parallel programs to address the issues of constraints from checkers. We propose a few-shot parameter-efficient fine-tuning method using adapter module to address data race detection issue. The proposed method does not require a large labeled dataset, and it makes data efficient. A generic dataset is constructed with a limited number of labeled data, containing diverse OpenMP patterns for data race detection. A neural architecture search approach is employed to improve the performance of detection. The experimental results on the generated and open-source datasets demonstrate that our method is effective and improves race detection compared with traditional methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNs
    Li, Shengrui
    Han, Xueting
    Bai, Jing
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13600 - 13608
  • [32] Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation
    Fabbri, Alexander R.
    Han, Simeng
    Li, Haoyuan
    Li, Haoran
    Ghazvininejad, Marjan
    Joty, Shafiq
    Radev, Dragomir
    Mehdad, Yashar
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 704 - 717
  • [33] Leveraging Parameter-Efficient Fine-Tuning for Multilingual Abstractive Summarization
    Shen, Jialun
    Wang, Yusong
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT III, NLPCC 2024, 2025, 15361 : 293 - 303
  • [34] Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
    Chen, Haolin
    Garner, Philip N.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 4253 - 4262
  • [35] Parameter-efficient fine-tuning for single image snow removal
    Dai, Xinwei
    Zhou, Yuanbo
    Qiu, Xintao
    Tang, Hui
    Tong, Tong
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 265
  • [36] Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks
    Mahabadi, Rabeeh Karimi
    Ruder, Sebastian
    Dehghani, Mostafa
    Henderson, James
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 565 - 576
  • [37] Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
    Zhang, Zhen-Ru
    Tan, Chuanqi
    Xu, Haiyang
    Wang, Chengyu
    Huang, Jun
    Huang, Songfang
    61ST CONFERENCE OF THE THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 2, 2023, : 1239 - 1248
  • [38] Fine-Tuning for Few-Shot Image Classification by Multimodal Prototype Regularization
    Wu, Qianhao
    Qi, Jiaxin
    Zhang, Dong
    Zhang, Hanwang
    Tang, Jinhui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8543 - 8556
  • [39] Enhancing Few-Shot CLIP With Semantic-Aware Fine-Tuning
    Zhu, Yao
    Chen, Yuefeng
    Mao, Xiaofeng
    Yan, Xiu
    Wang, Yue
    Lu, Wang
    Wang, Jindong
    Ji, Xiangyang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [40] Few-Shot Fine-Tuning SOTA Summarization Models for Medical Dialogues
    Navarro, David Fraile
    Dras, Mark
    Berkovsky, Shlomo
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE STUDENT RESEARCH WORKSHOP, 2022, : 254 - 266