Learning Low-order Models for Enforcing High-order Statistics

8 years 9 months ago
Learning Low-order Models for Enforcing High-order Statistics
Models such as pairwise conditional random fields (CRFs) are extremely popular in computer vision and various other machine learning disciplines. However, they have limited expressive power and often cannot represent the posterior distribution correctly. While learning the parameters of such models which have insufficient expressivity, researchers use loss functions to penalize certain misrepresentations of the solution space. Till now, researchers have used only simplistic loss functions such as the Hamming loss, to enable efficient inference. The paper shows how sophisticated and useful higher order loss functions can be incorporated in the learning process. These loss functions ensure that the MAP solution does not deviate much from the ground truth in terms of certain higher order statistics. We propose a learning algorithm which uses the recently proposed lowerenvelop representation of higher order functions to transform them to pairwise functions, which allow efficient inferenc...
Patrick Pletscher, Pushmeet Kohli
Added 27 Sep 2012
Updated 27 Sep 2012
Type Journal
Year 2012
Where JMLR
Authors Patrick Pletscher, Pushmeet Kohli
Comments (0)