Integrating visual and semantic contexts for topic network generation and word sense disambiguation

To support more effective searches in large-scale weaklytagged image collections, we have developed a novel algorithm to integrate both the visual similarity contexts between the images and the semantic similarity contexts between their tags for topic network generation and word sense disambiguation. First, a topic network is generated to characterize both the semantic similarity contexts and the visual similarity contexts between the image topics more sufficiently. By organizing large numbers of image topics according to their cross-modal inter-topic similarity contexts, our topic network can make the semantics behind the tag space more explicit, so that users can gain deep insights rapidly and formulate their queries more precisely. Second, our word sense disambiguation algorithm can integrate the topic network to exploit both the visual similarity contexts between the images and the semantic similarity contexts between their tags for addressing the issues of polysemes and synonym...

• Type: Conference
• Year: 2009
• Where: CIVR
• Authors: Jianping Fan, Hangzai Luo, Yi Shen, Chunlei Yang
• Keywords: CIVR 2009, Multimedia, Semantic Similarity Contexts, Similarity Contexts, Visual Similarity Contexts