TOWARD A QUALITY ASSESSMENT FRAMEWORK FOR KNOWLEDGE-BASED SYSTEMS

Despite the success of knowledge-based systems in many domains, techniques for ensuring their quality and reliability are still immature. A well-engineered software product is built by use of a process in which quality issues are addressed throughout. Key processes affecting product quality are specification; verification, and validation. The processes are characterized by the production of certain artifacts at certain times. Therefore, by looking at the artifacts produced by a specific process, we can assess the quality of the resulting product, and also we can assess the capability of the developers to produce high-quality software. This article seeks to answer precisely this question: how can the level of capability of a supplier of knowledge-based systems be evaluated! This question is of concern to all customers of knowledge-based systems and, although standards for supplier capability of conventional software have been developed, none addresses the unique characteristics of knowledge-based software. To answer the question, this article describes a set of state-of-the-art techniques for specifying, verifying, and validating knowledge-based systems and highlights the artifacts associated with each. We also assess the state of the practice, indicating the limited extent to which the techniques are in use at the present time. In addition to providing answers to the motivating question the main objective of the article is to recommend ways in which the current state of the practice can be improved.