What is AI Software Testing? and Why

被引:14
|
作者
Gao, Jerry [3 ]
Tao, Chuanqi [1 ,2 ]
Lie, Dou [4 ]
Lu, Shenqiang [4 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Jiangsu, Peoples R China
[3] San Jose State Univ, San Jose, CA 95192 USA
[4] Taiyuan Univ Technol, Taiyuan, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
AI Testing; Testing AI software; AI software quality validation; FAULT-DETECTION;
D O I
10.1109/SOSE.2019.00015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast advance of artificial intelligence technology and data-driven machine learning techniques, building high-quality AI-based software in different application domains is becoming a very hot research topic in both academic and industry communities. Today, many machine learning models and artificial technologies have been developed to build smart application systems based on multimedia inputs to achieve intelligent functional features, such as recommendation, object detection, classification, and prediction, natural language processing and translation, and so on. This brings strong demand in quality validation and assurance for AI software systems. Current research work seldom discusses AI software testing questions, challenges, and validation approaches with clear quality requirements and criteria. This paper focuses on AI software quality validation, including validation focuses, features, and process, and potential testing approaches. Moreover, it presents a test process and a classification-based test modeling for AI classification function testing. Finally, it discusses the challenges, issues, and needs in AI software testing.
引用
收藏
页码:27 / 36
页数:10
相关论文
共 50 条
  • [1] What is software testing? And why is it so hard?
    Whittaker, JA
    [J]. IEEE SOFTWARE, 2000, 17 (01) : 70 - 79
  • [2] WHY ARE THERE NO MEASUREMENT STANDARDS FOR SOFTWARE TESTING
    WICHMANN, BA
    [J]. COMPUTER STANDARDS & INTERFACES, 1993, 15 (04) : 361 - 364
  • [3] Leveraging AI in Cataloging: What Works, and Why?
    Moulaison-Sandy, Heather
    Coble, Zach
    [J]. TECHNICAL SERVICES QUARTERLY, 2024, 41 (04) : 375 - 383
  • [4] SOFTWARE SAFETY - WHY, WHAT, AND HOW
    LEVESON, NG
    [J]. COMPUTING SURVEYS, 1986, 18 (02): : 125 - 163
  • [5] Social software: What, why, and how?
    Thomsett-Scott, Beth
    [J]. ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2006, 231
  • [6] Paths to Testing: Why Women Enter and Remain in Software Testing?
    Silva, Kleice
    Barcomb, Ann
    Santos, Ronnie de Souza
    [J]. COMPANION PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, FSE COMPANION 2024, 2024, : 4 - 9
  • [8] AI-T: Software Testing Ontology for AI-based Systems
    Olszewska, J., I
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT (KEOD), VOL 2, 2020, : 291 - 298
  • [9] DIDACTIC TESTING: WHAT IS IT AND WHY IS IT DONE?
    Balazova, Lucia
    Feszterova, Melania
    [J]. SGEM 2016, BK 1: PSYCHOLOGY AND PSYCHIATRY, SOCIOLOGY AND HEALTHCARE, EDUCATION CONFERENCE PROCEEDINGS, VOL I, 2016, : 685 - 692
  • [10] Software Testing, AI and Robotics (STAIR) Learning Lab
    Haller-Seeber, Simon
    Gatterer, Thomas
    Hofmann, Patrick
    Kelter, Christopher
    Auer, Thomas
    Felderer, Michael
    [J]. ROBOTICS IN EDUCATION, RIE 2022, 2022, 515 : 182 - 189