• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

KNN-based Image Annotation by Collectively Mining Visual and Semantic Similarities

Vol. 11, No.9, September 30, 2017
10.3837/tiis.2017.09.016, Download Paper (Free):

Abstract

The aim of image annotation is to determine labels that can accurately describe the semantic information of images. Many approaches have been proposed to automate the image annotation task while achieving good performance. However, in most cases, the semantic similarities of images are ignored. Towards this end, we propose a novel Visual-Semantic Nearest Neighbor (VS-KNN) method by collectively exploring visual and semantic similarities for image annotation. First, for each label, visual nearest neighbors of a given test image are constructed from training images associated with this label. Second, each neighboring subset is determined by mining the semantic similarity and the visual similarity. Finally, the relevance between the images and labels is determined based on maximum a posteriori estimation. Extensive experiments were conducted using three widely used image datasets. The experimental results show the effectiveness of the proposed method in comparison with state-of-the-arts methods.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Qian Ji, Liyan Zhang and Zechao Li, "KNN-based Image Annotation by Collectively Mining Visual and Semantic Similarities," KSII Transactions on Internet and Information Systems, vol. 11, no. 9, pp. 4476-4490, 2017. DOI: 10.3837/tiis.2017.09.016

[ACM Style]
Ji, Q., Zhang, L., and Li, Z. 2017. KNN-based Image Annotation by Collectively Mining Visual and Semantic Similarities. KSII Transactions on Internet and Information Systems, 11, 9, (2017), 4476-4490. DOI: 10.3837/tiis.2017.09.016