An interaction mechanism of multimodal dialogue systems

被引：0
|
作者：
Takahashi, Kazuko [1 ,2 ]
Takezawa, Toshiyuki [1 ,3 ]
机构：
[1] ATR Interpreting Telecommunications Research Laboratories, Kyoto, 619-0288, Japan
[2] School of Science, Kwansei Gakuin University
[3] ATR Spoken Language Translation Research Laboratories
来源：
Systems and Computers in Japan | 2002年 / 33卷 / 11期
关键词：
Database systems - Interactive computer systems - Interfaces (computer) - Optical resolving power;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
We propose a mechanism to handle ellipsis/anaphora resolution effectively for a dialogue system with multimodal interfaces. This mechanism uses a new method of storing/searching through the history of a dialogue. We express the object referred to by the current utterance as the packed data of all the related terms appearing in the preceding utterances. We formalize the mechanism and present an evaluation of a multimodal guidance system that has this mechanism. Experimental results show that this mechanism achieves natural dialogue with high interaction. We also discuss a method of evaluating interactive spoken dialogue systems. © 2002 Wiley Periodicals, Inc. Syst. Comp. Jpn., 33(11).
引用
收藏
页码：70 / 79
相关论文
共 50 条
  • [1] MULTIMODAL DIALOGUE SYSTEMS
    Rudnicky, Alexander I.
    SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE IN MOBILE ENVIRONMENTS, 2005, 28 : 3 - 11
  • [2] Multimodal Adaptive Dialogue Systems and Human Robot Interaction in Assistive Environments
    Tsiakas, Konstantinos
    2014 IEEE INTERNATIONAL SYMPOSIUM ON HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND GAMES (HAVE), 2014,
  • [3] EVALUATING DIALOGUE STRATEGIES IN MULTIMODAL DIALOGUE SYSTEMS
    Whittaker, Steve
    Walker, Marilyn
    SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE IN MOBILE ENVIRONMENTS, 2005, 28 : 247 - 268
  • [4] Evaluation of Multimodal Dialogue Systems
    Bavarian Archive for Speech Signals, c/o Institut für Phonetik und Sprachliche Kommunikation, Ludwig-Maximilians-Universität Münchenn, Germany
    Cogn. Technol., 2006, (617-643):
  • [5] Reliable Evaluation of Multimodal Dialogue Systems
    Metze, Florian
    Wechsung, Ina
    Schaffer, Stefan
    Seebode, Julia
    Moeller, Sebastian
    HUMAN-COMPUTER INTERACTION, PT II: NOVEL INTERACTION METHODS AND TECHNIQUES, 2009, 5611 : 75 - +
  • [6] MATCH: An architecture for multimodal dialogue systems
    Johnston, M
    Bangalore, S
    Vasireddy, G
    Stent, A
    Ehlen, P
    Walker, M
    Whittaker, S
    Maloor, P
    40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2002, : 376 - 383
  • [7] Advances in natural multimodal dialogue systems
    van Kuppevelt, Jan
    Dybkjaer, Laila
    Bernsen, Niels Ole
    COMPUTATIONAL LINGUISTICS, 2007, 33 (04): : 603 - 604
  • [8] InSight Interaction: a multimodal and multifocal dialogue corpus
    Brone, Geert
    Oben, Bert
    LANGUAGE RESOURCES AND EVALUATION, 2015, 49 (01) : 195 - 214
  • [9] Visual Cue Streams for Multimodal Dialogue Interaction
    Koryzis, Dimitris
    Samaras, Christos V.
    Makri, Eleni
    Svolopoulos, Vasilios
    Spiliotopoulos, Dimitris
    ADVANCES IN HUMAN FACTORS, BUSINESS MANAGEMENT, TRAINING AND EDUCATION, 2017, 498 : 541 - 547
  • [10] Multimodal Dialogue Management for Multiparty Interaction with Infants
    Gilani, Setareh Nasihati
    Traum, David
    Merla, Arcangelo
    Hee, Eugenia
    Walker, Zoey
    Manini, Barbara
    Gallagher, Grady
    Petitto, Laura-Ann
    ICMI'18: PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2018, : 5 - 13
12345