Speech interaction with graphical user interfaces

被引：0
|
作者：
Olsen, DR [1 ]
Hudson, SE [1 ]
Tam, CM [1 ]
Conaty, G [1 ]
Phelps, M [1 ]
Heiner, JM [1 ]
机构：
[1] Brigham Young Univ, Dept Comp Sci, Provo, UT 84602 USA
来源：
HUMAN-COMPUTER INTERACTION - INTERACT'01 | 2001年
关键词：
spoken language interfaces; user interface toolkits; surface representations; surface-based interaction;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper describes ICIE-Voice, a prototype system for supporting speech-only access to graphical user interfaces. This system is intended to work with a wide range of existing applications, but require only a minimal set of "books" into those applications. To achieve this, the system operates primarily by extracting information from the drawing pipeline of the user interface. This information is then mapped to speech utterances using a translation schema that is external to the application.
引用
收藏
页码：286 / 293
页数：8
相关论文
共 50 条
  • [1] Mixed-initiative Dialog Management for Speech-based Interaction with Graphical User Interfaces
    Loehr, Andreas
    Bruegge, Bernd
    CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2008, : 979 - 988
  • [2] Data entry interaction techniques for graphical user interfaces
    Cuomo, DL
    Jablonka, E
    Mosier, JN
    PROCEEDINGS OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY - 40TH ANNUAL MEETING, VOLS 1 AND 2: HUMAN CENTERED TECHNOLOGY - KEY TO THE FUTURE, 1996, : 370 - 374
  • [3] Emotion recognition in the manual interaction with graphical user interfaces
    Schuller, B
    Rigoll, G
    Lang, M
    2004 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXP (ICME), VOLS 1-3, 2004, : 1215 - 1218
  • [4] Graphical user interfaces
    Martinez, Wendy L.
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2011, 3 (02): : 119 - 133
  • [5] Adaptive interaction methods in speech user interfaces
    Turunen, Markku
    Conference on Human Factors in Computing Systems - Proceedings, 2001, : 91 - 92
  • [6] GRAPHICAL USER INTERFACES
    MAHONEY, K
    BYTE, 1989, 14 (10): : 36 - 36
  • [7] MODELING INTERACTION OF BLIND PEOPLE USING GRAPHICAL USER INTERFACES
    WEBER, G
    IFIP TRANSACTIONS A-COMPUTER SCIENCE AND TECHNOLOGY, 1992, 14 : 39 - 46
  • [8] Graphical user interfaces for bioconductor
    Ophir, R
    BRIEFINGS IN BIOINFORMATICS, 2004, 5 (03) : 297 - 299
  • [9] Graphical User Interfaces for R
    Valero-Mora, Pedro M.
    Ledesma, Ruben D.
    JOURNAL OF STATISTICAL SOFTWARE, 2012, 49 (01): : 1 - 8
  • [10] Differencing Graphical User Interfaces
    Grechanik, Mark
    Mao, Chi Wu
    Baisal, Ankush
    Hossain, B. M. Mainul
    Rosenblum, David S.
    2018 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS 2018), 2018, : 203 - 214
12345