Attention-based skill translation models for expert finding

被引:13
|
作者
Fallahnejad, Zohreh [1 ]
Beigy, Hamid [1 ]
机构
[1] Sharif Univ Technol, Dept Comp Engn, Tehran, Iran
关键词
Expert finding; Semantic matching; Translation models; StackOverflow; FRAMEWORK;
D O I
10.1016/j.eswa.2021.116433
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The growing popularity of community question answering websites can be seen by the growing number of users. Many methods are proposed to identify talented users in these communities, but many of them suffer from vocabulary mismatches. The solution to this problem can be found in translation approaches. The present paper proposes two translation methods for extracting more relevant translations. The proposed methods rely on the attention mechanism. The methods use multi-label classifiers that take each question as input and predict the skills related to the question. Using the attention mechanism, the model is able to focus on specific parts of the given input and predict the correct labels. The ultimate goal of these networks is to predict skills related to questions. Using word attention scores, we can find out how relevant a single word is to a particular skill. As a result of these attention scores, we obtain more relevant translations for each skill. We then use these translations to bridge the lexical gap and improve expert retrieval results. Extensive experiments on two large sub-collections of the StackOverflow dataset demonstrate that the proposed methods outperform the best baseline method by up to 14.11/% MAP improvement.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Unseen Filler Generalization In Attention-based Natural Language Reasoning Models
    Chen, Chin-Hui
    Fu, Yi-Fu
    Cheng, Hsiao-Hua
    Lin, Shou-De
    [J]. 2020 IEEE SECOND INTERNATIONAL CONFERENCE ON COGNITIVE MACHINE INTELLIGENCE (COGMI 2020), 2020, : 42 - 51
  • [32] Semantic Interpretation and Validation of Graph Attention-based Explanations for GNN Models
    Panagiotaki, Efimia
    De Martini, Daniele
    Kunze, Lars
    [J]. 2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 375 - 380
  • [33] A Visual Analytics System for Improving Attention-based Traffic Forecasting Models
    Jin S.
    Lee H.
    Park C.
    Chu H.
    Tae Y.
    Choo J.
    Ko S.
    [J]. IEEE Transactions on Visualization and Computer Graphics, 2023, 29 (01) : 1102 - 1112
  • [34] FINDING THE RIGHT EXPERT Discriminative Models for Expert Retrieval
    Sorg, Philipp
    Cimiano, Philipp
    [J]. KDIR 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL, 2011, : 190 - 199
  • [35] Software Defect Prediction and Localization with Attention-Based Models and Ensemble Learning
    Zhang, Tianhang
    Du, Qingfeng
    Xu, Jincheng
    Li, Jiechu
    Li, Xiaojun
    [J]. 2020 27TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE (APSEC 2020), 2020, : 81 - 90
  • [36] A Variable Attention-Based Gated GRU Approach for Soft Sensor Models
    Yang, Yinghua
    Yu, Huiyue
    Liu, Xiaozhi
    [J]. 2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 92 - 96
  • [37] Attention-based robot control
    Kasderidis, S
    Taylor, JG
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 2, PROCEEDINGS, 2003, 2774 : 615 - 621
  • [38] CRAN: An Hybrid CNN-RNN Attention-Based Model for Arabic Machine Translation
    Bensalah, Nouhaila
    Ayad, Habib
    Adib, Abdellah
    El Farouk, Abdelhamid Ibn
    [J]. NETWORKING, INTELLIGENT SYSTEMS AND SECURITY, 2022, 237 : 87 - 102
  • [39] Visual Attention-based Watermarking
    Oakes, Matthew
    Bhowmik, Deepayan
    Abhayaratne, Charith
    [J]. 2011 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2011, : 2653 - 2656
  • [40] Attention-Based Graph Evolution
    Fan, Shuangfei
    Huang, Bert
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 436 - 447