Coherent image annotation by learning semantic distance

Conventional approaches to automatic image annotation usually suffer from two problems: (1) They cannot guarantee a good semantic coherence of the annotated words for each image, as they treat each word independently without considering the inherent semantic coherence among the words; (2) They heavily rely on visual similarity for judging semantic similarity. To address the above issues, we propose a novel approach to image annotation which simultaneously learns a semantic distance by capturing the prior annotation knowledge and propagates the annotation of an image as a whole entity. Specifically, a semantic distance function (SDF) is learned for each semantic cluster to measure the semantic similarity based on relative comparison relations of prior annotations. To annotate a new image, the training images in each cluster are ranked according to their SDF values with respect to this image and their corresponding annotations are then propagated to this image as a whole entity to ensur...

• Type: Conference
• Year: 2008
• Where: CVPR
• Authors: Tao Mei, Yong Wang, Xian-Sheng Hua, Shaogang Gong, Shipeng Li
• Keywords: Computer Vision, CVPR 2008, Inherent Semantic Coherence, Semantic Cluster, Semantic Coherence, Semantic Distance Function, Semantic Similarity