Multi-Modal API Recommendation

被引:1
|
作者
Irsan, Ivana Clairine [1 ]
Zhang, Ting [1 ]
Thung, Ferdian [1 ]
Kim, Kisub [1 ]
Lo, David [1 ]
机构
[1] Singapore Management Univ, Sch Comp & Informat Syst, Singapore, Singapore
关键词
API Recommendation; Multi-modal; Pre-trained Models;
D O I
10.1109/SANER56733.2023.00034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Too many options can be a problem, which is the case for Application Programming Interfaces (APIs). As there are many such APIs, with many more being introduced periodically, it raises the problem of choosing which API to be recommended. Furthermore, numerous APIs are commonly used together with other complementary third-party APIs. It can be challenging for developers to understand how to use each API and to remember all the complementary APIs for the API they want to use. Therefore, an accurate API recommendation approach can improve developers' efficiency in implementing certain functionality. Several approaches have been developed to automatically recommend APIs based on either a natural language query or source code context. However, none of these API recommendation approaches have utilized these two sources of information at the same time (i.e., leveraging natural language query and source code context together). In this work, we propose an approach named MuLAREc, which leverages the information from natural language query (annotation) and source code context. The results confirm that our approach outperforms state-of-the-art API recommendation approaches which only leverage a single type of information as the input. Our work also demonstrates that multi-modal information can boost the performance of API recommendation approaches by 20%-50% better in terms of BLEU-score than the baselines.
引用
收藏
页码:272 / 283
页数:12
相关论文
共 50 条
  • [31] Exploring a large-scale multi-modal transportation recommendation system
    Liu, Yang
    Lyu, Cheng
    Liu, Zhiyuan
    Cao, Jinde
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 126
  • [32] Learning the User's Deeper Preferences for Multi-modal Recommendation Systems
    Lei, Fei
    Cao, Zhongqi
    Yang, Yuning
    Ding, Yibo
    Zhang, Cong
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (03)
  • [33] Multi-modal Graph Contrastive Learning for Micro-video Recommendation
    Yi, Zixuan
    Wang, Xi
    Ounis, Iadh
    Macdonald, Craig
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1807 - 1811
  • [34] Multi-modal information augmented model for micro-video recommendation
    Huo Y.
    Jin B.
    Liao Z.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (06): : 1142 - 1152
  • [35] Principle-to-program: Neural Fashion Recommendation with Multi-modal Input
    Chelliah, Muthusamy
    Biswas, Soma
    Dhakad, Lucky
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2706 - 2708
  • [36] Enhancing Adversarial Robustness of Multi-modal Recommendation via Modality Balancing
    Shang, Yu
    Gao, Chen
    Chen, Jiansheng
    Jin, Depeng
    Ma, Huimin
    Li, Yong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6274 - 6282
  • [37] Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation
    Ji, Wei
    Liu, Xiangyan
    Zhang, An
    Wei, Yinwei
    Ni, Yongxin
    Wang, Xiang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 955 - 965
  • [38] Heterogeneous-Grained Multi-Modal Graph Network for Outfit Recommendation
    Xu, Rucong
    Wang, Jianfeng
    Li, Yun
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1788 - 1799
  • [39] MM-FRec: Multi-Modal Enhanced Fashion Item Recommendation
    Song, Xuemeng
    Wang, Chun
    Sun, Changchang
    Feng, Shanshan
    Zhou, Min
    Nie, Liqiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10072 - 10084
  • [40] Multi-modal Learning for Video Recommendation based on Mobile Application Usage
    Jia, Xiaowei
    Wang, Aosen
    Li, Xiaoyi
    Xun, Guangxu
    Xu, Wenyao
    Zhang, Aidong
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 837 - 842