Access on Demand: Real-time, Multi-modal Accessibility for the Deaf and Hard-of-Hearing based on Augmented Reality

被引:1
|
作者
Mathew, Roshan [1 ]
Mak, Brian [2 ]
Dannels, Wendy [3 ]
机构
[1] Rochester Inst Technol, Sch Informat, Rochester, NY 14623 USA
[2] Rochester Inst Technol, Coll Liberal Arts, Rochester, NY 14623 USA
[3] Rochester Inst Technol, NTID Ctr Culture & Language, Rochester, NY 14623 USA
基金
美国国家科学基金会;
关键词
Augmented Reality; Smart glasses; DHH;
D O I
10.114510.1145/3517428.3551352
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this experience report, two deaf researchers with varying expertise, communication preferences, and technological skills document their experiences using Access on Demand (AoD), an Augmented Reality (AR) based accessibility application that provides on-demand real-time captioning and sign language interpretation services using the Vuzix Blade AR smart glasses. The researchers report their observations regarding using remote real-time American Sign Language (ASL) interpreting, captioning, and auto-captions ofered by the AoD platform. The authors discuss the benefts and limitations of using AoD as an assistive technology device and how it would beneft the deaf community from the perspective of Deaf and Hard-of-Hearing (DHH) users.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Real-Time Augmented Reality Visual-Captions for Deaf and Hard-of-Hearing Children in Classrooms
    Li, Jingya
    [J]. 2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW, 2023, : 641 - 642
  • [2] Multi-modal Spatial Object Localization in Virtual Reality for Deaf and Hard-of-Hearing People
    Mirzaei, Mohammadreza
    Kan, Peter
    Kaufmann, Hannes
    [J]. 2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2021, : 588 - 596
  • [3] Designing a Multi-Modal Communication System for the Deaf and Hard-of-Hearing Users
    Lee, Gi-bbeum
    Jang, Hyuckjin
    Jeong, Hyundeok
    Woo, Woontack
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT PROCEEDINGS (ISMAR-ADJUNCT 2021), 2021, : 429 - 434
  • [4] Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People
    Asakura, Takumi
    [J]. SENSORS, 2023, 23 (17)
  • [5] Improving Accessibility of Lectures for Deaf and Hard-of-Hearing Students Using a Speech Recognition System and a Real-Time Collaborative Editor
    Lathiere, Benoit
    Archambault, Dominique
    [J]. COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, ICCHP 2014, PT II, 2014, 8548 : 490 - 497
  • [6] Avatar Interpreter: Improving Classroom Experiences for Deaf and Hard-of-Hearing People Based on Augmented Reality
    Luo, Le
    Weng, Dongdong
    Guo, Songrui
    Tu, Ziqi
    Hao, Jie
    [J]. EXTENDED ABSTRACTS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2022, 2022,
  • [7] Considering Multi-Modal Speech Visualization for Deaf and Hard of Hearing People
    Toba, Yusuke
    Horiuchi, Hiroyasu
    Matsumoto, Shinsuke
    Saiki, Sachio
    Nakamura, Masahide
    Uchino, Tomohito
    Yokoyama, Tomohiro
    Takebayashi, Yasuhiro
    [J]. 2015 10th Asia-Pacific Symposium on Information and Telecommunication Technologies (APSITT), 2015,
  • [8] Evaluating multi-modal speech visualization application for deaf and hard of hearing people
    Toba, Yusuke
    Matsumoto, Shinsuke
    Saiki, Sachio
    Nakamura, Masahide
    Uchino, Tomohito
    [J]. 2016 4TH INTL CONF ON APPLIED COMPUTING AND INFORMATION TECHNOLOGY/3RD INTL CONF ON COMPUTATIONAL SCIENCE/INTELLIGENCE AND APPLIED INFORMATICS/1ST INTL CONF ON BIG DATA, CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (ACIT-CSII-BCD), 2016, : 202 - 207
  • [9] See-Through Captions: Real-Time Captioning on Transparent Display for Deaf and Hard-of-Hearing People
    Yamamoto, Kenta
    Suzuki, Ippei
    Shitara, Akihisa
    Ochiai, Yoichi
    [J]. 23RD INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, ASSETS 2021, 2021,
  • [10] Live Demonstration: Real-time Multi-modal Hearing Assistive Technology Prototype
    Gogate, Mandar
    Hussain, Adeel
    Dashtipour, Kia
    Hussain, Amir
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,