Multiuser, multimodal sensemaking cognitive immersive environment with a task-oriented dialog system

被引:0
|
作者
Briggs, Shannon [1 ]
Chabot, Sam [1 ]
Sanders, Abraham [2 ]
Peveler, Matthew [2 ]
Strzalkowski, Tomek [2 ]
Braasch, Jonas [1 ]
机构
[1] Rensselaer Polytech Inst, Cognit Immers Syst Lab, Troy, NY 12181 USA
[2] Rensselaer Polytech Inst, Comp Sci, Troy, NY USA
关键词
immersive interactive systems progressive dialog agent; sensemaking;
D O I
10.1109/HST56032.2022.10025454
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper is a conceptual paper that explores how the sensemaking process by intelligence analysts completed within a cognitive immersive environment might be impacted by the inclusion of a progressive dialog system. The tools enabled in the sensemaking room (a specific instance within the cognitive immersive environment) were informed by tools from the intelligence analysis domain. We explore how a progressive dialog system would impact the use of tools such as the collaborative brainstorming exercise [1]. These structured analytic techniques are well established in intelligence analysis training literature, and act as ways to access the intended users' cognitive schema as they use the cognitive immersive room and move through the sensemaking process. A prior user study determined that the sensemaking room encouraged users to be more concise and representative with information while using the digital brainstorming tool. We anticipate that addition of the progressive dialog function will enable a more cohesive link between information foraging and sensemaking behaviors for analysts.
引用
下载
收藏
页数:3
相关论文
共 50 条
  • [31] More to diverse: Generating diversified responses in a task oriented multimodal dialog system
    Firdaus, Mauajama
    Pratap Shandeelya, Arunav
    Ekbal, Asif
    PLOS ONE, 2020, 15 (11):
  • [32] CONTEXT-AWARE DIALOG RE-RANKING FOR TASK-ORIENTED DIALOG SYSTEMS
    Ohmura, Junki
    Eskenazi, Maxine
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 846 - 853
  • [33] End-to-End Task-oriented Dialog System through Template Slot Value Generation
    Hong, Teakgyu
    Kwon, Oh-Woog
    Kim, Young-Kil
    INTERSPEECH 2020, 2020, : 3900 - 3904
  • [34] Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog
    Mishra, Mayank
    Contractor, Danish
    Raghu, Dinesh
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1778 - 1787
  • [35] Span-based Hierarchical Semantic Parsing for Task-Oriented Dialog
    Pasupae, Panupong
    Gupta, Sonal
    Mandyam, Karishma
    Shah, Rushin
    Lewis, Mike
    Zettlemoyer, Luke
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 1520 - 1526
  • [36] An empirical assessment of deep learning approaches to task-oriented dialog management
    Mateju, Lukas
    Griol, David
    Callejas, Zoraida
    Molina, Jose Manuel
    Sanchis, Araceli
    NEUROCOMPUTING, 2021, 439 : 327 - 339
  • [37] 5.2.1 Task-oriented System Engineering
    Zonnenshain, Avigdor
    Harel, Avi
    INCOSE International Symposium, 2009, 19 (01) : 775 - 787
  • [38] An Incremental Turn-Taking Model For Task-Oriented Dialog Systems
    Coman, Andrei C.
    Yoshino, Koichiro
    Murase, Yukitoshi
    Nakamura, Satoshi
    Riccardi, Giuseppe
    INTERSPEECH 2019, 2019, : 4155 - 4159
  • [39] Contextual Dynamic Prompting for Response Generation in Task-oriented Dialog Systems
    Swamy, Sandesh
    Tabari, Narges
    Chen, Chacha
    Gangadharaiah, Rashmi
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3102 - 3111
  • [40] Actionable conversational quality indicators for improving task-oriented dialog systems
    Higgins, Michael
    Widdows, Dominic
    Hockey, Beth Ann
    Hazare, Akshay
    Howell, Kristen
    Christian, Gwen
    Mathi, Sujit
    Brew, Chris
    Maurer, Andrew
    Bonev, George
    Dunn, Matthew
    Bradley, Joseph
    NATURAL LANGUAGE ENGINEERING, 2024, 30 (06) : 1229 - 1254