Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework

被引:2
|
作者
Iglesias, Ana [1 ]
Garcia, Javier [1 ]
Garcia-Olaya, Angel [1 ]
Fuentetaja, Raquel [1 ]
Fernandez, Fernando [1 ]
Romero-Garces, Adrian [2 ]
Marfil, Rebeca [2 ]
Bandera, Antonio [2 ]
Ting, Karine Lan Hing [3 ]
Voilmy, Dimitri [3 ]
Duenas, Alvaro [4 ]
Suarez-Mejias, Cristina [4 ]
机构
[1] Univ Carlos III Madrid, Comp Sci & Engn Dept, Leganes 28911, Spain
[2] Univ Malaga, Dept Elect Technol, Malaga 29016, Spain
[3] Univ Technol Troyes, F-10300 Troyes, France
[4] Hosp Univ Virgen Rocio, Seville 41013, Spain
关键词
Robots; Usability; Software; Guidelines; User experience; Service robots; Faces; Human-robot interaction; robotics and automation; robots; service robots; systems; man; and cybernetics; HEALTH-CARE; DESIGN;
D O I
10.1109/THMS.2021.3112976
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human-robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.
引用
收藏
页码:601 / 612
页数:12
相关论文
共 50 条
  • [1] An Automatic Evaluation Framework for Social Conversations with Robots
    Paetzel-Prusmann, Maike
    Lehman, Jill Fain
    Gomez, Celia J.
    Kennedy, James
    2024 INTERNATIONAL SYMPOSIUM ON TECHNOLOGICAL ADVANCES IN HUMAN-ROBOT INTERACTION, TAHRI 2024, 2024, : 56 - 64
  • [2] Extensive assessment and evaluation methodologies on assistive social robots for modelling human-robot
    Sim, Doreen Ying Ying
    Loo, Chu Kiong
    INFORMATION SCIENCES, 2015, 301 : 305 - 344
  • [3] EVALUATION OF SOCIAL INDICATORS
    PLESSAS, DJ
    FEIN, R
    JOURNAL OF THE AMERICAN INSTITUTE OF PLANNERS, 1972, 88 (01): : 43 - 51
  • [4] Social navigation framework for assistive robots in human inhabited unknown environments
    Kivrak, Hasan
    Cakmak, Furkan
    Kose, Hatice
    Yavuz, Sirma
    ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2021, 24 (02): : 284 - 298
  • [5] Framework for Accessibility Evaluation of Hospital Websites
    Acosta-Vargas, Patricia
    Acosta, Tania
    Lujan-Mora, Sergio
    2018 FIFTH INTERNATIONAL CONFERENCE ON EDEMOCRACY & EGOVERNMENT (ICEDEG), 2018, : 9 - 15
  • [6] The Social Outcomes of Older Adult Learning in Taiwan: Evaluation Framework and Indicators
    Lin, Li-Hui
    EDUCATIONAL GERONTOLOGY, 2015, 41 (04) : 292 - 304
  • [7] Experimental Evaluation of Assistive Behaviors for Man-Portable Robots
    Pierce, C.
    Baran, D.
    Bodt, B.
    UNMANNED SYSTEMS TECHNOLOGY XII, 2010, 7692
  • [8] Towards an Integrated Evaluation of Usability, User Experience and Accessibility in Assistive Technologies
    de Godoi, Tatiany Xavier
    Costa Valentim, Natasha Malveira
    SBQS: PROCEEDINGS OF THE 18TH BRAZILIAN SYMPOSIUM ON SOFTWARE QUALITY, 2019, : 234 - 239
  • [9] KRIEGERS LIFE-CYCLE INDICATORS FRAMEWORK FOR SOCIAL PROGRAM-EVALUATION
    SCHINNAR, AP
    SOCIO-ECONOMIC PLANNING SCIENCES, 1977, 11 (05) : 291 - 292
  • [10] Evaluation of Artificial Mouths in Social Robots
    Castro-Gonzalez, Alvaro
    Alcocer-Luna, Jonatan
    Malfaz, Maria
    Alonso-Martin, Fernando
    Salichs, Miguel A.
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2018, 48 (04) : 369 - 379