Structuring Natural Language Requirements with Large Language Models

被引:0
|
作者
Norheim, Johannes J. [1 ]
Rebentisch, Eric [2 ]
机构
[1] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
[2] MIT, Sociotech Syst Res Ctr, 77 Massachusetts Ave, Cambridge, MA 02139 USA
关键词
Large Language Models; Natural Language Processing; Requirements Translation; Requirements Modeling;
D O I
10.1109/REW61692.2024.00013
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Structured requirements have long been proposed to improve the quality of requirements while facilitating downstream applications like modeling. Nevertheless, in practice, adopting structures such as templates and semi-formal logic imposes additional training and expertise constraints, limiting their wider adoption. In this paper, we investigate the application of natural language processing (NLP) to translate natural language requirements into structured representations. Existing methodologies have been reported for specific formalisms or requirement types. In this research preview, we go beyond the state-of-the-art by generalizing to generic templates and semiformal logic. Specifically, we investigate the application of a state-of-the-art pre-trained large language model (LLM), GPT-4. We show preliminary evidence that this new technology can translate natural language requirements to a target template or semi-formal language based on as little as one translation example, as long as the example captures the same structure as the translated requirement. We observe this behavior across three formalisms: a requirements template structure (EARS), a custom minimalistic requirements modeling language for system performance requirements, and a semi-formal structure for linear temporal logic (LTL). We propose a rigorous way to investigate how well these observations are generalized based on this preliminary evidence.
引用
收藏
页码:68 / 71
页数:4
相关论文
共 50 条
  • [1] Large Language Models are Not Models of Natural Language: They are Corpus Models
    Veres, Csaba
    [J]. IEEE ACCESS, 2022, 10 : 61970 - 61979
  • [2] Natural language processing in the era of large language models
    Zubiaga, Arkaitz
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 6
  • [3] Structuring Natural Language to Query Language: A Review
    Nethravathi, B.
    Amitha, G.
    Saruka, Anusha
    Bharath, T. P.
    Suyagya, Setu
    [J]. ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2020, 10 (06) : 6521 - 6525
  • [4] Using Language Models for Enhancing the Completeness of Natural-Language Requirements
    Luitel, Dipeeka
    Hassani, Shabnam
    Sabetzadeh, Mehrdad
    [J]. REQUIREMENTS ENGINEERING: FOUNDATION FOR SOFTWARE QUALITY, REFSQ 2023, 2023, 13975 : 87 - 104
  • [5] Normative Requirements Operationalization with Large Language Models
    Feng, Nick
    Marsso, Lina
    Yaman, Sinem Getir
    Standen, Isobel
    Baatartogtokh, Yesugen
    Ayad, Reem
    de Mello, Victoria Oldemburgo
    Townsend, Beverley
    Bartels, Hanne
    Cavalcanti, Ana
    Calinescu, Radu
    Chechik, Marsha
    [J]. 32ND IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE, RE 2024, 2024, : 129 - 141
  • [6] Quantifying Uncertainty in Natural Language Explanations of Large Language Models
    Tanneru, Sree Harsha
    Agarwal, Chirag
    Lakkaraju, Himabindu
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [7] Shortcut Learning of Large Language Models in Natural Language Understanding
    Du, Mengnan
    He, Fengxiang
    Zou, Na
    Tao, Dacheng
    Hu, Xia
    [J]. COMMUNICATIONS OF THE ACM, 2024, 67 (01) : 110 - 120
  • [8] Understanding natural language: Potential application of large language models to ophthalmology
    Yang, Zefeng
    Wang, Deming
    Zhou, Fengqi
    Song, Diping
    Zhang, Yinhang
    Jiang, Jiaxuan
    Kong, Kangjie
    Liu, Xiaoyi
    Qiao, Yu
    Chang, Robert T.
    Han, Ying
    Li, Fei
    Tham, Clement C.
    Zhang, Xiulan
    [J]. ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY, 2024, 13 (04):
  • [9] Robustness of GPT Large Language Models on Natural Language Processing Tasks
    Xuanting, Chen
    Junjie, Ye
    Can, Zu
    Nuo, Xu
    Tao, Gui
    Qi, Zhang
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (05): : 1128 - 1142
  • [10] Visistant: A Conversational Chatbot for Natural Language to Visualizations With Gemini Large Language Models
    Ram, Santhosh
    Muthumanikandan, V.
    [J]. IEEE Access, 2024, 12 : 138547 - 138563