Performance Measurement of a Rule-Based Ontology Framework (ROF) for Auto-Generation of Requirements Specification

Documenting requirements specification requires a lot of effort from stakeholders and developers. Time and knowledge limitations are also obstacles in creating structured requirements documents. Previous works proposed a framework for automated generation of requirements specifications called rule-based ontology framework (ROF). The requirements documentation phase produces two outputs: process modeling according to the business process model and notation (BPMN) standard and software requirements specification (SRS) documents following the ISO/IEC/IEEE 29148:2018 standard. In this paper, the authors do performance measurement of ROF in the IS project case study which includes validating ROF prototype by performing user acceptance test (UAT), measuring effectiveness by calculating notation error and requirements error, and measuring efficiency by calculating the time spent in producing documents. The efficiency and effectiveness of both are measured by comparing BPMN graph and SRS document generated by ROF with BPMN graph and SRS document that are created manually by the stakeholders.