Learning Low-order Models for Enforcing High-order Statistics

11 years 7 months ago

Download jmlr.csail.mit.edu

Models such as pairwise conditional random ﬁelds (CRFs) are extremely popular in computer vision and various other machine learning disciplines. However, they have limited expressive power and often cannot represent the posterior distribution correctly. While learning the parameters of such models which have insuﬃcient expressivity, researchers use loss functions to penalize certain misrepresentations of the solution space. Till now, researchers have used only simplistic loss functions such as the Hamming loss, to enable eﬃcient inference. The paper shows how sophisticated and useful higher order loss functions can be incorporated in the learning process. These loss functions ensure that the MAP solution does not deviate much from the ground truth in terms of certain higher order statistics. We propose a learning algorithm which uses the recently proposed lowerenvelop representation of higher order functions to transform them to pairwise functions, which allow eﬃcient inferenc...

Patrick Pletscher, Pushmeet Kohli

Real-time Traffic