MyEachtraX: Lifelog Question Answering on Mobile

被引:0
|
作者
Ly-Duyen Tran [1 ]
Thanh-Binh Nguyen [2 ]
Gurrin, Cathal [1 ]
Zhou, Liting [1 ]
机构
[1] Dublin City Univ, Dublin, Ireland
[2] Ho Chi Minh City Univ Sci, Vietnam Natl Univ Ho Chi Minh City, Ho Chi Minh City, Vietnam
关键词
Lifelog; Mobile; Retrieval; Question Answering;
D O I
10.1145/3643489.3661128
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Your whole life in your pocket. That is the premise of lifelogging, a technology that captures and stores every moment of your life in digital form. Built on top of MyEachtra and the lifelog question-answering pipeline, MyEachtraX is a mobile-based application that addresses the overlook of mobile platforms in the area. Furthermore, leveraging the latest advancements in natural language processing, such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), the system enhances the query-parsing, post-processing, and question-answering processes in lifelog retrieval. Official lifelog questions from the previous Lifelog Search Challenges were used to evaluate the system, which achieved an accuracy of 72.2%. We identify the retrieval component as the main bottleneck of the pipeline and propose future works to improve the system.
引用
收藏
页码:93 / 98
页数:6
相关论文
共 50 条
  • [1] LLQA - Lifelog Question Answering Dataset
    Tran, Ly-Duyen
    Thanh Cong Ho
    Lan Anh Pham
    Binh Nguyen
    Gurrin, Cathal
    Zhou, Liting
    [J]. MULTIMEDIA MODELING (MMM 2022), PT I, 2022, 13141 : 217 - 228
  • [2] Interactive Question Answering for Multimodal Lifelog Retrieval
    Ly-Duyen Tran
    Zhou, Liting
    Binh Nguyen
    Gurrin, Cathal
    [J]. MULTIMEDIA MODELING, MMM 2024, PT V, 2024, 14565 : 68 - 81
  • [3] MemoriQA: A Question-Answering Lifelog Dataset
    Tran, Quang-Linh
    Nguyen, Binh
    Jones, Gareth J. F.
    Gurrin, Cathal
    [J]. PROCEEDINGS OF THE FIRST ACM WORKSHOP ON AI-POWERED QUESTION ANSWERING SYSTEMS FOR MULTIMEDIA, AIQAM 2024, 2024, : 7 - 12
  • [4] Flexible Question Answering System for Mobile Devices
    Ortiz-Arroyo, Daniel
    [J]. 2008 THIRD INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION MANAGEMENT, VOLS 1 AND 2, 2008, : 271 - 276
  • [5] The Design of Mobile Multimedia Question-Answering System
    Li, Jian-wei
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SOFTWARE ENGINEERING (AISE 2014), 2014, : 546 - 551
  • [6] A mobile video question answering system for e-learning
    Huang, Yi-Ting
    Chung, Ching-, I
    Tsai, Chi-Cheng
    Shen, Chia-Hsing
    Wu, Yu-Chieh
    Yang, Jie-Chi
    [J]. 7TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES, PROCEEDINGS, 2007, : 74 - +
  • [7] Mobile System Using Natural Language Annotations for Question Answering
    Khiyal, M. Sikandar Hayat
    Khan, Aihab
    Khalid, Sidra
    [J]. PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON COMPUTER TECHNOLOGY AND DEVELOPMENT, VOL 1, 2009, : 367 - 371
  • [8] Ranking based Question Answering System with a Web and Mobile Application
    Agarwal, Abhishek
    Kumari, Vijay
    Sharma, Yashvardhan
    Goel, Lavika
    [J]. 2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, : 52 - 58
  • [9] Turkish question answering - Question answering for distance education students
    Yurekli, Burcu
    Arslan, Ahmet
    Senel, Hakan G.
    Yilmazel, Ozgur
    [J]. ICSOFT 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON SOFTWARE AND DATA TECHNOLOGIES, VOL ISDM/ABF, 2008, : 320 - +
  • [10] SORT: SOcial HelpeR SelecTion Scheme for Mobile Question Answering Systems
    Ali, Imad
    Chang, Ronald Y.
    Hsu, Cheng-Hsin
    [J]. 2019 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2019, : 647 - 652