ECNU MIV at SemEval-2023 Task 1: CTIM - Contrastive Text-Image Model for Multilingual Visual Word Sense Disambiguation

被引：0

作者：

Li, Zhenghui ^{[1
]}

Zhang, Qi ^{[2
]}

Xia, Xueyin ^{[1
,2
]}

Ye, YinXiang ^{[2
]}

Zhang, Qi ^{[2
]}

Huang, Cong ^{[3
]}

机构：

[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China

[2] East China Normal Univ, Sch Commun & Elect Engn, Shanghai, Peoples R China

[3] JiangXi Agr Univ, Sch Software, Nanchang, Jiangxi, Peoples R China

来源：

17TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2023 | 2023年

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper describes the performance of MIV team in SemEval-2023 Task-1-Visual Word Sense Disambiguation (Visual-WSD). This task is to give a potentially ambiguous word and some limited textual context and select among a set of candidate images the one which corresponds to the intended meaning of the target word, which plays a critical role in human language understanding. Our team focuses on the multimodal domain of images and texts, we propose a model that can learn the matching relationship between text-image pairs by contrastive learning. More specifically, We train the model from the labeled data provided by the official organizer, after pre-training, texts are used to reference learned visual concepts enabling visual word sense disambiguation tasks. In addition, the top results our teams got have been released showing the effectiveness of our solution. We release our code at https://github.com/Insaner1004/VWSD.

引用

页码：101 / 107

页数：7

共 22 条

[21] Augmenters at SemEval-2023 Task 1: Enhancing CLIP in Handling Compositionality and Ambiguity for Zero-Shot Visual WSD through Prompt Augmentation and Text-To-Image Diffusion
Li, Jie S.
Shiue, Yow-Ting
Shih, Yong-Siang
Geiping, Jonas
17TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2023, 2023, : 44 - 49
[22] Mao-Zedong At SemEval-2023 Task 4: Label Represention Multi-Head Attention Model With Contrastive Learning-Enhanced Nearest Neighbor Mechanism For Multi-Label Text Classification
Zhang, Che
Liu, Ping'an
Xiao, Zhenyang
Fei, Haojun
17TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2023, 2023, : 426 - 432

← 1 2 3 →