MyEachtraX: Lifelog Question Answering on Mobile

被引:0
|
作者
Ly-Duyen Tran [1 ]
Thanh-Binh Nguyen [2 ]
Gurrin, Cathal [1 ]
Zhou, Liting [1 ]
机构
[1] Dublin City Univ, Dublin, Ireland
[2] Ho Chi Minh City Univ Sci, Vietnam Natl Univ Ho Chi Minh City, Ho Chi Minh City, Vietnam
关键词
Lifelog; Mobile; Retrieval; Question Answering;
D O I
10.1145/3643489.3661128
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Your whole life in your pocket. That is the premise of lifelogging, a technology that captures and stores every moment of your life in digital form. Built on top of MyEachtra and the lifelog question-answering pipeline, MyEachtraX is a mobile-based application that addresses the overlook of mobile platforms in the area. Furthermore, leveraging the latest advancements in natural language processing, such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), the system enhances the query-parsing, post-processing, and question-answering processes in lifelog retrieval. Official lifelog questions from the previous Lifelog Search Challenges were used to evaluate the system, which achieved an accuracy of 72.2%. We identify the retrieval component as the main bottleneck of the pipeline and propose future works to improve the system.
引用
收藏
页码:93 / 98
页数:6
相关论文
共 50 条
  • [21] Personalized Question Answering
    Quarteroni, Silvia
    [J]. TRAITEMENT AUTOMATIQUE DES LANGUES, 2010, 51 (01): : 97 - 123
  • [22] A healthcare-oriented mobile question-and-answering system for smart cities
    Xu, Yueshen
    Jiang, Yan
    Li, Rui
    Gao, Honghao
    Guo, Jin
    Liu, Yaning
    Hei, Lei
    Wang, Yihao
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (10)
  • [23] ANSWERING THE CUBAN QUESTION
    COLE, L
    [J]. NATION, 1983, 237 (07) : 194 - 194
  • [25] Embodied Question Answering
    Das, Abhishek
    Datta, Samyak
    Gkioxari, Georgia
    Lee, Stefan
    Parikh, Devi
    Batra, Dhruv
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1 - 10
  • [26] Causality for Question Answering
    Breja, Manvi
    Jain, Sanjay Kumar
    [J]. COMPUTATIONAL LINGUISTICS AND INTELLIGENT SYSTEMS (COLINS 2020), VOL I: MAIN CONFERENCE, 2020, 2604
  • [27] Sponsored Question Answering
    Mordo, Tommy
    Tennenholtz, Moshe
    Kurland, Oren
    [J]. PROCEEDINGS OF THE 2024 ACM SIGIR INTERNATIONAL CONFERENCE ON THE THEORY OF INFORMATION RETRIEVAL, ICTIR 2024, 2024, : 167 - 173
  • [28] Location Aware Question Answering based Product Searching in Mobile Handheld Devices
    Hossain, S. K. Alamgir
    Rahman, A. S. M. Mahfujur
    Tran, Thomas T.
    El Saddik, Abdulmotaleb
    [J]. 14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS (DS-RT 2010), 2010, : 189 - 195
  • [29] ANSWERING A PRACTICAL QUESTION
    Everts, Edgar W.
    [J]. EDUCATION, 1936, 56 (05): : 268 - 271
  • [30] Multimedia Question Answering
    Hong, Richang
    Wang, Meng
    Li, Guangda
    Nie, Liqiang
    Zha, Zheng-Jun
    Chua, Tat-Seng
    [J]. IEEE MULTIMEDIA, 2012, 19 (04) : 72 - 78