OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model

被引:1
|
作者
Zhang, Yu [1 ]
Gao, Peizhong [2 ]
Kang, Fangzhou [3 ]
Li, Jiaxiang [1 ]
Liu, Jiacheng [3 ]
Lu, Qi [4 ]
Xu, Yingqing [4 ]
机构
[1] Tsinghua Univ, Acad Arts & Design, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
[3] Tsinghua Univ, Xinya Coll, Beijing, Peoples R China
[4] Tsinghua Univ, Future Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Human-centered computing-Interaction design-Systems and tools for interaction design;
D O I
10.1109/VR58804.2024.00034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Numerous studies have shown that integrating scents into movies enhances viewer engagement and immersion. However, creating such olfactory experiences often requires professional perfumers to match scents, limiting their widespread use. To address this, we propose OdorAgent which combines a LLM with a text-image model to automate video-odor matching. The generation framework is in four dimensions: subject matter, emotion, space, and time. We applied it to a specific movie and conducted user studies to evaluate and compare the effectiveness of different system elements. The results indicate that OdorAgent possesses significant scene adaptability and enables inexperienced individuals to design odor experiences for video and images.
引用
收藏
页码:105 / 114
页数:10
相关论文
共 50 条
  • [1] Large language models generate functional protein sequences across diverse families
    Ali Madani
    Ben Krause
    Eric R. Greene
    Subu Subramanian
    Benjamin P. Mohr
    James M. Holton
    Jose Luis Olmos
    Caiming Xiong
    Zachary Z. Sun
    Richard Socher
    James S. Fraser
    Nikhil Naik
    Nature Biotechnology, 2023, 41 : 1099 - 1106
  • [2] Large language models generate functional protein sequences across diverse families
    Madani, Ali
    Ben Krause, Ben
    Greene, Eric R.
    Subramanian, Subu
    Mohr, Benjamin P.
    Holton, James M.
    Olmos, Jose Luis
    Xiong, Caiming
    Sun, Zachary Z. Z.
    Socher, Richard
    Fraser, James S.
    Naik, Nikhil
    NATURE BIOTECHNOLOGY, 2023, 41 (08) : 1099 - +
  • [3] An integrated model to generate the assembly sequences
    Zhang, JB
    Wei, SM
    Miao, KJ
    1997 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT PROCESSING SYSTEMS, VOLS 1 & 2, 1997, : 1376 - 1380
  • [4] Llama-TCR: Generate De Novo TCR with Large Language Model
    Zhou, Jun
    Wu, Zhenzhou
    Man, Mengren
    Wu, Yonghui
    Le Dinh Linh
    Dai, Manna
    Liu, Yong
    Goh, Rick
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 845 - 850
  • [5] Leveraging large language model to generate a novel metaheuristic algorithm with CRISPE framework
    Zhong, Rui
    Xu, Yuefeng
    Zhang, Chao
    Yu, Jun
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (10): : 13871 - 13896
  • [6] Constructing a Large Language Model to Generate Impressions from Findings in Radiology Reports
    Zhang, Lu
    Liu, Mingqian
    Wang, Lingyun
    Zhang, Yaping
    Xu, Xiangjun
    Pan, Zhijun
    Feng, Yan
    Zhao, Jue
    Zhang, Lin
    Yao, Gehong
    Chen, Xu
    Xie, Xueqian
    RADIOLOGY, 2024, 312 (03)
  • [7] LANGUAGE AS A MODEL RELATING TO ODOR QUALITY
    BENARIE, MM
    ATMOSPHERIC ENVIRONMENT, 1973, 7 (03) : 369 - 371
  • [8] Enabling Large Language Models to Generate Text with Citations
    Gao, Tianyu
    Yen, Howard
    Yu, Jiatong
    Chen, Danqi
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 6465 - 6488
  • [9] Can large language models generate geospatial code?
    State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China
    不详
    arXiv, 1600,
  • [10] Steel design based on a large language model
    Tian, Shaohan
    Jiang, Xue
    Wang, Weiren
    Jing, Zhihua
    Zhang, Chi
    Zhang, Cheng
    Lookman, Turab
    Su, Yanjing
    ACTA MATERIALIA, 2025, 285