Modeling annotated data

13 years 9 months ago
Modeling annotated data
We consider the problem of modeling annotated data—data with multiple types where the instance of one type (such as a caption) serves as a description of the other type (such as an image). We describe three hierarchical probabilistic mixture models which aim to describe such data, culminating in correspondence latent Dirichlet allocation, a latent variable model that is effective at modeling the joint distribution of both types and the conditional distribution of the annotation given the primary type. We conduct experiments on the Corel database of images and captions, assessing performance in terms of held-out likelihood, automatic annotation, and text-based image retrieval. Categories and Subject Descriptors G.3 [Mathematics of Computing]: Probability and Statistics—statistical computing, multivariate statistics General Terms algorithms, experimentation Keywords probabilistic graphical models, empirical Bayes, variational methods, automatic image annotation, image retrieval
David M. Blei, Michael I. Jordan
Added 05 Jul 2010
Updated 05 Jul 2010
Type Conference
Year 2003
Authors David M. Blei, Michael I. Jordan
Comments (0)