Towards a framework for certification of reliable autonomous systems

被引:35
|
作者
Fisher, Michael [1 ]
Mascardi, Viviana [2 ]
Rozier, Kristin Yvonne [3 ]
Schlingloff, Bernd-Holger [4 ]
Winikoff, Michael [5 ]
Yorke-Smith, Neil [6 ]
机构
[1] Univ Manchester, Manchester, Lancs, England
[2] Univ Genoa, Genoa, Italy
[3] Iowa State Univ, Ames, IA USA
[4] Humboldt Univ & Fraunhofer FOKUS, Berlin, Germany
[5] Victoria Univ Wellington, Wellington, New Zealand
[6] Delft Univ Technol, Delft, Netherlands
基金
英国工程与自然科学研究理事会;
关键词
Autonomous systems; Certification; Verification; Artificial intelligence; MODEL CHECKING; FORMAL METHODS; SELF-AWARENESS; VERIFICATION; DESIGN; SPECIFICATION; TESTABILITY; RELIABILITY; ROBOT; SAFE;
D O I
10.1007/s10458-020-09487-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A computational system is called autonomous if it is able to make its own decisions, or take its own actions, without human supervision or control. The capability and spread of such systems have reached the point where they are beginning to touch much of everyday life. However, regulators grapple with how to deal with autonomous systems, for example how could we certify an Unmanned Aerial System for autonomous use in civilian airspace? We here analyse what is needed in order to provide verified reliable behaviour of an autonomous system, analyse what can be done as the state-of-the-art in automated verification, and propose a roadmap towards developing regulatory guidelines, including articulating challenges to researchers, to engineers, and to regulators. Case studies in seven distinct domains illustrate the article.
引用
收藏
页数:65
相关论文
共 50 条
  • [1] Towards a framework for certification of reliable autonomous systems
    Michael Fisher
    Viviana Mascardi
    Kristin Yvonne Rozier
    Bernd-Holger Schlingloff
    Michael Winikoff
    Neil Yorke-Smith
    [J]. Autonomous Agents and Multi-Agent Systems, 2021, 35
  • [2] Towards an Evaluation Framework for Autonomous Systems
    Bombarda, Andrea
    Bonfanti, Silvia
    De Sanctis, Martina
    Gargantini, Angelo
    Pelliccione, Patrizio
    Riccobene, Elvinia
    Scandurra, Patrizia
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING AND SELF-ORGANIZING SYSTEMS COMPANION (ACSOS-C 2022), 2022, : 43 - 48
  • [3] Certification of Medical Information Systems Towards a Foundational Framework and Methodology
    Weber, Jens H.
    Price, Morgan
    [J]. 2016 IEEE 27TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW), 2016, : 241 - 248
  • [4] Dynamic Certification for Autonomous Systems
    Bakirtzis, Georgios
    Carr, Steven
    Danks, David
    Topcu, Ufuk
    [J]. COMMUNICATIONS OF THE ACM, 2023, 66 (09) : 64 - 72
  • [5] Towards a Theoretical Framework of Autonomous Systems Underpinned by Intelligence and Systems Sciences
    Yingxu Wang
    Ming Hou
    Konstantinos N.Plataniotis
    Sam Kwong
    Henry Leung
    Edward Tunstel
    Imre J.Rudas
    Ljiljana Trajkovic
    [J]. IEEE/CAA Journal of Automatica Sinica, 2021, 8 (01) : 52 - 63
  • [6] Towards a theoretical framework of autonomous systems underpinned by intelligence and systems sciences
    Wang, Yingxu
    Hou, Ming
    Plataniotis, Konstantinos N.
    Kwong, Sam
    Leung, Henry
    Tunstel, Edward
    Rudas, Imre J.
    Trajkovic, Ljiljana
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (01) : 52 - 63
  • [7] Towards a framework for assurance of autonomous navigation systems in the maritime industry
    Brandsaeter, A.
    Knutsen, K. E.
    [J]. SAFETY AND RELIABILITY - SAFE SOCIETIES IN A CHANGING WORLD, 2018, : 449 - 457
  • [8] Challenges in Certification of Autonomous Driving Systems
    Falcini, Fabio
    Lami, Giuseppe
    [J]. 2017 IEEE 28TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2017), 2017, : 286 - 293
  • [9] Towards a software component certification framework
    Alvaro, Alexandre
    de Almeida, Eduardo Santana
    Meira, Silvio Lemos
    [J]. USIC 2007: PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON QUALITY SOFTWARE, 2007, : 298 - +
  • [10] From the Autonomy Framework towards Networks and Systems Approaches for 'Autonomous' Weapons Systems
    Liu, Hin-Yan
    [J]. JOURNAL OF INTERNATIONAL HUMANITARIAN LEGAL STUDIES, 2019, 10 (01) : 89 - 110