Structuring Natural Language Requirements with Large Language Models

被引:0
|
作者
Norheim, Johannes J. [1 ]
Rebentisch, Eric [2 ]
机构
[1] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
[2] MIT, Sociotech Syst Res Ctr, 77 Massachusetts Ave, Cambridge, MA 02139 USA
关键词
Large Language Models; Natural Language Processing; Requirements Translation; Requirements Modeling;
D O I
10.1109/REW61692.2024.00013
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Structured requirements have long been proposed to improve the quality of requirements while facilitating downstream applications like modeling. Nevertheless, in practice, adopting structures such as templates and semi-formal logic imposes additional training and expertise constraints, limiting their wider adoption. In this paper, we investigate the application of natural language processing (NLP) to translate natural language requirements into structured representations. Existing methodologies have been reported for specific formalisms or requirement types. In this research preview, we go beyond the state-of-the-art by generalizing to generic templates and semiformal logic. Specifically, we investigate the application of a state-of-the-art pre-trained large language model (LLM), GPT-4. We show preliminary evidence that this new technology can translate natural language requirements to a target template or semi-formal language based on as little as one translation example, as long as the example captures the same structure as the translated requirement. We observe this behavior across three formalisms: a requirements template structure (EARS), a custom minimalistic requirements modeling language for system performance requirements, and a semi-formal structure for linear temporal logic (LTL). We propose a rigorous way to investigate how well these observations are generalized based on this preliminary evidence.
引用
收藏
页码:68 / 71
页数:4
相关论文
共 50 条
  • [1] Large Language Models are Not Models of Natural Language: They are Corpus Models
    Veres, Csaba
    IEEE ACCESS, 2022, 10 : 61970 - 61979
  • [2] Natural language processing in the era of large language models
    Zubiaga, Arkaitz
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 6
  • [3] Learning from Failures: Translation of Natural Language Requirements into Linear Temporal Logic with Large Language Models
    Xu, Yilongfei
    Feng, Jincao
    Miao, Weikai
    2024 IEEE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY, QRS, 2024, : 204 - 215
  • [4] Structuring Natural Language to Query Language: A Review
    Nethravathi, B.
    Amitha, G.
    Saruka, Anusha
    Bharath, T. P.
    Suyagya, Setu
    ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2020, 10 (06) : 6521 - 6525
  • [5] Using Language Models for Enhancing the Completeness of Natural-Language Requirements
    Luitel, Dipeeka
    Hassani, Shabnam
    Sabetzadeh, Mehrdad
    REQUIREMENTS ENGINEERING: FOUNDATION FOR SOFTWARE QUALITY, REFSQ 2023, 2023, 13975 : 87 - 104
  • [6] Normative Requirements Operationalization with Large Language Models
    Feng, Nick
    Marsso, Lina
    Yaman, Sinem Getir
    Standen, Isobel
    Baatartogtokh, Yesugen
    Ayad, Reem
    de Mello, Victoria Oldemburgo
    Townsend, Beverley
    Bartels, Hanne
    Cavalcanti, Ana
    Calinescu, Radu
    Chechik, Marsha
    32ND IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE, RE 2024, 2024, : 129 - 141
  • [7] Quantifying Uncertainty in Natural Language Explanations of Large Language Models
    Tanneru, Sree Harsha
    Agarwal, Chirag
    Lakkaraju, Himabindu
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [8] Fairness Certification for Natural Language Processing and Large Language Models
    Freiberger, Vincent
    Buchmann, Erik
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, INTELLISYS 2024, 2024, 1065 : 606 - 624
  • [9] Shortcut Learning of Large Language Models in Natural Language Understanding
    Du, Mengnan
    He, Fengxiang
    Zou, Na
    Tao, Dacheng
    Hu, Xia
    COMMUNICATIONS OF THE ACM, 2024, 67 (01) : 110 - 120
  • [10] Applications of natural language processing and large language models in materials discovery
    Jiang, Xue
    Wang, Weiren
    Tian, Shaohan
    Wang, Hao
    Lookman, Turab
    Su, Yanjing
    NPJ COMPUTATIONAL MATERIALS, 2025, 11 (01)