Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

被引:3
|
作者
Al Amin, Akhter [1 ]
Hassan, Saad [1 ]
Lee, Sooyeon [2 ]
Huenerfauth, Matt [1 ]
机构
[1] Rochester Inst Technol, Rochester, NY 14623 USA
[2] New Jersey Inst Technol, Newark, NJ 07102 USA
基金
美国国家科学基金会;
关键词
Accessibility; Caption; Attention; Area of Interest; EYE-MOVEMENTS;
D O I
10.1145/3587281.3587287
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Captions blocking visual information in live television news leads to dissatisfaction among Deaf and Hard of Hearing (DHH) viewers, who cannot see important information on the screen. Prior work has proposed generic guidelines for caption placement but not specifically for live television news, and important genre of television with dense placement of onscreen information regions, e.g., current news topic, scrolling news, etc. To understand DHH viewers' gaze behavior while watching television news, both spatially and temporally, we conducted an eye-tracking study with 19 DHH participants. Participants' gaze behavior varied over time as measured by their proportional fixation time on information regions on the screen. An analysis of gaze behavior coupled with open-ended feedback revealed four thematic categories of information regions. Our work motivates considering the time dimension when considering caption placement, to avoid blocking information regions, as their importance varies over time.
引用
收藏
页码:54 / 65
页数:12
相关论文
共 50 条
  • [1] Deaf and Hard of Hearing Viewers' Preference for Speaker Identifier Type in Live TV Programming
    Al Amin, Akher
    Mendis, Joseph
    Kushalnagar, Raja
    Vogler, Christian
    Lee, Sooyeon
    Huenerfauth, Matt
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: NOVEL DESIGN APPROACHES AND TECHNOLOGIES, UAHCI 2022, PT I, 2022, 13308 : 200 - 211
  • [2] Effect of Caption Width on the TV User Experience by Deaf and Hard of Hearing Viewers
    Glasser, Abraham
    Garcia, Joseline
    Hwang, Chang
    Vogler, Christian
    Kushalnagar, Raja
    18TH INTERNATIONAL WEB FOR ALL CONFERENCE (W4A '21), 2021,
  • [3] Who is speaking: Unpacking In-text Speaker Identification Preference of Viewers who are Deaf and Hard of Hearing while Watching Live Captioned Television Program
    Al Amin, Akhter
    Mendis, Joseph
    Kushalnagar, Raja
    Vogler, Christian
    Huenerfauth, Matt
    20TH INTERNATIONAL WEB FOR ALL CONFERENCE, W4A 2023, 2023, : 44 - 53
  • [4] Perspectives of Deaf and Hard of Hearing Viewers of Captions
    Butler, Janine
    AMERICAN ANNALS OF THE DEAF, 2019, 163 (05) : 534 - 553
  • [5] The reception of subtitling for the deaf and hard-of-hearing in Spanish Tv news programs
    Tamayo, Ana
    Lozano, Julio De Los Reyes
    Ferriol, Jose Luis Marti
    COMUNICACION Y SOCIEDAD-GUADALAJARA, 2021, 18
  • [6] Preferences of Deaf or Hard of Hearing Users for Live-TV Caption Appearance
    Al Amin, Akhter
    Glasser, Abraham
    Kushalnagar, Raja
    Vogler, Christian
    Huenerfauth, Matt
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION. ACCESS TO MEDIA, LEARNING AND ASSISTIVE ENVIRONMENTS, UAHCI 2021, PT II, 2021, 12769 : 189 - 201
  • [7] ModelingWord Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers
    Al Amin, Akhter
    Hassan, Saad
    Huenerfauth, Matt
    Alm, Cecilia Ovesdotter
    20TH INTERNATIONAL WEB FOR ALL CONFERENCE, W4A 2023, 2023, : 79 - 83
  • [8] Delay and Reading Speed in Subtitling for the Deaf and Hard-of-Hearing of TV News Programmes
    de los Reyes Lozano, Julio
    Mejias-Climent, Laura
    Marti Ferriol, Jose Luis
    SENDEBAR-REVISTA DE TRADUCCION E INTERPRETACION, 2020, (31): : 69 - 86
  • [9] Effect of Occlusion on Deaf and Hard of Hearing Users' Perception of Captioned Video Quality
    Al Amin, Akhter
    Hassan, Saad
    Huenerfauth, Matt
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION. ACCESS TO MEDIA, LEARNING AND ASSISTIVE ENVIRONMENTS, UAHCI 2021, PT II, 2021, 12769 : 202 - 220
  • [10] Visualizing speech styles in captions for deaf and hard-of-hearing viewers
    Ahn, Sooyeon
    Kim, Jooyeong
    Shin, Choonsung
    Hong, Jin-Hyuk
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2025, 194