A Virtual Conversational Agent for Teens with Autism Spectrum Disorder: Experimental Results and Design Lessons

被引:22
|
作者
Ali, Mohammad Rafayet [1 ]
Razavi, Seyedeh Zahra [1 ]
Langevin, Raina [2 ]
Al Mamun, Abdullah [1 ]
Kane, Benjamin [1 ]
Rawassizadeh, Reza [3 ]
Schubert, Lenhart K. [1 ]
Hoque, Ehsan [1 ]
机构
[1] Univ Rochester, Rochester, NY 14627 USA
[2] Univ Washington, Seattle, WA 98195 USA
[3] Boston Univ, Metropolitan Coll, Boston, MA 02215 USA
关键词
Animated conversational agent design; social skills training; real-time feedback; autism intervention; nonverbal behavior; schema-based dialogue management; CHILDREN;
D O I
10.1145/3383652.3423900
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Programming for Children and Teens with Autism Spectrum Disorder
    Verbeten, Sharon
    [J]. REFERENCE & USER SERVICES QUARTERLY, 2014, 54 (01) : 57 - 57
  • [2] Design of a Serious Game for Enhancing Money Use in Teens with Autism Spectrum Disorder
    Vallefuoco, Ersilia
    Bravaccio, Carmela
    Gison, Giovanna
    Pepino, Alessandro
    [J]. AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, 2021, 12980 : 339 - 347
  • [3] Conversational repair in speakers with autism spectrum disorder
    Volden, J
    [J]. INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2004, 39 (02) : 171 - 189
  • [4] Exploring the Use of a Voice-based Conversational Agent to Empower Adolescents with Autism Spectrum Disorder
    Cha, Inha
    Kim, Sung-In
    Hong, Hwajung
    Yoo, Heejeong
    Lim, Youn-kyung
    [J]. CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2021,
  • [5] A Design of Multipurpose Virtual Reality Game for Children with Autism Spectrum Disorder
    Rahmadiva, Milla
    Arifin, Achmad
    Fatoni, Muhammad Hilman
    Baki, Siti Halimah
    Watanabe, Takashi
    [J]. 2019 INTERNATIONAL BIOMEDICAL INSTRUMENTATION AND TECHNOLOGY CONFERENCE (IBITEC), 2019, : 1 - 6
  • [6] A Survey on Virtual Reality for Individuals with Autism Spectrum Disorder: Design Considerations
    Bozgeyikli, Lal
    Raij, Andrew
    Katkoori, Srinivas
    Alqasemi, Redwan
    [J]. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2018, 11 (02): : 133 - 151
  • [7] Exploring the design space of virtual tutors for children with autism spectrum disorder
    Wu, Jiazhou
    Fan, Min
    Sheng, Liyan
    Sun, Guoyu
    [J]. EDUCATION AND INFORMATION TECHNOLOGIES, 2023, 28 (12) : 16531 - 16560
  • [8] Exploring the design space of virtual tutors for children with autism spectrum disorder
    Jiazhou Wu
    Min Fan
    Liyan Sheng
    Guoyu Sun
    [J]. Education and Information Technologies, 2023, 28 : 16531 - 16560
  • [9] An Experimental Study on a Conversational Agent in Software Testing Lessons
    Paschoal, Leo Natan
    Melo, Silvana Morita
    Neves, Vania de Oliveira
    Conte, Tayana Uchoa
    de Souza, Simone do Rocio Senger
    [J]. INFORMATICS IN EDUCATION, 2023, 22 (01): : 99 - 120
  • [10] Incidental Teaching of Conversational Skills for Students With Autism Spectrum Disorder
    Blackwell, William
    Stockall, Nancy
    [J]. TEACHING EXCEPTIONAL CHILDREN, 2021, 54 (02) : 116 - 123