Speech interaction with graphical user interfaces

被引：0
|
作者：
Olsen, DR [1 ]
Hudson, SE [1 ]
Tam, CM [1 ]
Conaty, G [1 ]
Phelps, M [1 ]
Heiner, JM [1 ]
机构：
[1] Brigham Young Univ, Dept Comp Sci, Provo, UT 84602 USA
来源：
HUMAN-COMPUTER INTERACTION - INTERACT'01 | 2001年
关键词：
spoken language interfaces; user interface toolkits; surface representations; surface-based interaction;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper describes ICIE-Voice, a prototype system for supporting speech-only access to graphical user interfaces. This system is intended to work with a wide range of existing applications, but require only a minimal set of "books" into those applications. To achieve this, the system operates primarily by extracting information from the drawing pipeline of the user interface. This information is then mapped to speech utterances using a translation schema that is external to the application.
引用
收藏
页码：286 / 293
页数：8
相关论文
共 50 条
  • [41] A Linguistic Perspective to Develop Graphical User Interfaces
    Khaddam, Iyad
    Mezhoudi, Nesrine
    Vanderdonckt, Jean
    3RD INTERNATIONAL CONFERENCE ON CONTROL, ENGINEERING & INFORMATION TECHNOLOGY (CEIT 2015), 2015,
  • [42] Transparent checkpointing for applications with graphical user interfaces
    Czornack, Jan-Thomas
    Trinitis, Carsten
    Walter, Max
    SERVICE AVAILABILITY, 2006, 4328 : 140 - +
  • [43] Designing Graphical User Interfaces Integrating Gestures
    Beuvens, Francois
    Vanderdonckt, Jean
    SIGDOC '12: PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON DESIGN OF COMMUNICATION, 2012, : 313 - 322
  • [44] A layout inference algorithm for Graphical User Interfaces
    Sanchez Ramon, Oscar
    Sanchez Cuadrado, Jesus
    Garcia Molina, Jesus
    Vanderdonckt, Jean
    INFORMATION AND SOFTWARE TECHNOLOGY, 2016, 70 : 155 - 175
  • [45] Adaptivity in graphical user interfaces: An experimental framework
    Encarnacao, LM
    COMPUTERS & GRAPHICS, 1995, 19 (06) : 873 - 884
  • [46] A novel code generator for graphical user interfaces
    Cai B.
    Luo J.
    Feng Z.
    Scientific Reports, 13 (1)
  • [47] Analyzing stereotypes of creating Graphical User Interfaces
    Bacikova, Michaela
    Poruban, Jaroslav
    OPEN COMPUTER SCIENCE, 2012, 2 (03): : 300 - 315
  • [48] Input Contract Testing of Graphical User Interfaces
    Tuglular, Tugkan
    Belli, Fevzi
    Linschulte, Michael
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2016, 26 (02) : 183 - 215
  • [49] Graphical User Interfaces for Business Information Systems
    Ives, Blake
    MIS QUARTERLY, 1982, 6 (05) : 15 - 47
  • [50] A New Layout Method for Graphical User Interfaces
    Scoditti, Adriano
    Stuerzlinger, Wolfgang
    IEEE TIC-STH 09: 2009 IEEE TORONTO INTERNATIONAL CONFERENCE: SCIENCE AND TECHNOLOGY FOR HUMANITY, 2009, : 642 - 647
12345