Visual Synset: Towards a higher-level visual representation

We present a higher-level visual representation, visual synset, for object categorization. The visual synset improves the traditional bag of words representation with better discrimination and invariance power. First, the approach strengthens the inter-class discrimination power by constructing an intermediate visual descriptor, delta visual phrase, from frequently co-occurring visual word-set with similar spatial context. Second, the approach achieves better intra-class invariance power, by clustering delta visual phrases into visual synset, based their probabilistic 'semantics', i.e. class probability distribution. Hence, the resulting visual synset can partially bridge the visual differences of images of same class. The tests on Caltech-101 and PascalVOC 05 dataset demonstrated that the proposed image representation can achieve good accuracies.

• Type: Conference
• Year: 2008
• Where: CVPR
• Authors: Yantao Zheng, Ming Zhao 0003, Shi-Yong Neo, Tat-Seng Chua, Qi Tian
• Keywords: Co-occurring Visual Word-set, Computer Vision, CVPR 2008, Delta Visual Phrase, Delta Visual Phrases, Intermediate Visual Descriptor, Visual Synset