Automatic Image Annotation using Word Embedding Learning

Automatically annotating words for images is a key to semantic-level image retrieval. Recently, several embedding learning based methods achieve good performance in this task which inspires this paper. Here we propose a novel word embedding model in which both images and words can be represented in the same embedding space. The embedding space is learnt in a discriminative nearest neighbor manner such that the annotation information could be propagated among neighbors. In order to accelerate model learning and testing, approximate-nearest-neighbor search is performed, and word embedding space is learnt in a stochastic manner. The experimental results demonstrate the effectiveness of the proposed method.