What is AI Software Testing? and Why

被引:14
|
作者
Gao, Jerry [3 ]
Tao, Chuanqi [1 ,2 ]
Lie, Dou [4 ]
Lu, Shenqiang [4 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Jiangsu, Peoples R China
[3] San Jose State Univ, San Jose, CA 95192 USA
[4] Taiyuan Univ Technol, Taiyuan, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
AI Testing; Testing AI software; AI software quality validation; FAULT-DETECTION;
D O I
10.1109/SOSE.2019.00015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast advance of artificial intelligence technology and data-driven machine learning techniques, building high-quality AI-based software in different application domains is becoming a very hot research topic in both academic and industry communities. Today, many machine learning models and artificial technologies have been developed to build smart application systems based on multimedia inputs to achieve intelligent functional features, such as recommendation, object detection, classification, and prediction, natural language processing and translation, and so on. This brings strong demand in quality validation and assurance for AI software systems. Current research work seldom discusses AI software testing questions, challenges, and validation approaches with clear quality requirements and criteria. This paper focuses on AI software quality validation, including validation focuses, features, and process, and potential testing approaches. Moreover, it presents a test process and a classification-based test modeling for AI classification function testing. Finally, it discusses the challenges, issues, and needs in AI software testing.
引用
收藏
页码:27 / 36
页数:10
相关论文
共 50 条
  • [41] THE SPANISH SOFTWARE MARKET - WHY SIEMENS LIKES WHAT IT SEES
    OBERHAUSER, B
    [J]. SIEMENS REVIEW, 1989, 56 (01): : 26 - 29
  • [42] Software Testing: What Goes Around Comes Around
    Voas, Jeffrey
    Miller, Keith W.
    [J]. IT PROFESSIONAL, 2012, 14 (03) : 4 - 5
  • [43] What We Know about Testing Embedded Software
    Garousi, Vahid
    Felderer, Michael
    Karapicak, Cagri Murat
    Yilmaz, Ugur
    [J]. IEEE SOFTWARE, 2018, 35 (04) : 62 - 69
  • [44] What Language Do You Use to Create Your AI Programs and Why?
    Mandl, Stefan
    Gust, Helmar
    Kitzelmann, Emanuel
    Helmert, Malte
    Buschmeier, Hendrik
    Yaghoubzadeh, Ramin
    Pietsch, Christian
    Kopp, Stefan
    [J]. KUNSTLICHE INTELLIGENZ, 2012, 26 (01): : 99 - 105
  • [45] Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent
    Mickel, Jennifer
    [J]. PROCEEDINGS OF THE 2024 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, ACM FACCT 2024, 2024, : 2484 - 2494
  • [46] Transparent AI Disclosure Obligations: Who, What, When, Where, Why, How
    El Ali, Abdallah
    Venkatraj, Karthikeya Puttur
    Morosoli, Sophie
    Naudts, Laurens
    Helberger, Natali
    Cesar, Pablo
    [J]. EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [47] Advancing AI Research and Applications by Learning from What Went Wrong and Why
    Shapiro, Daniel
    Goeker, Mehmet H.
    [J]. AI MAGAZINE, 2008, 29 (02) : 9 - 10
  • [49] The Approximation Tower in Computational Science: Why Testing Scientific Software Is Difficult
    Hinsen, Konrad
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2015, 17 (04) : 72 - 77
  • [50] What Pakistani Computer Science and Software Engineering Students Think about Software Testing?
    Capretz, Luiz Fernando
    Gilal, Abdul Rehman
    [J]. 2022 29TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, APSEC, 2022, : 574 - 575