Sciweavers

7 search results - page 1 / 2
» Stochastic Complexity and Generalization Error of a Restrict...
Sort
View
JMLR
2010
125views more  JMLR 2010»
12 years 11 months ago
Stochastic Complexity and Generalization Error of a Restricted Boltzmann Machine in Bayesian Estimation
In this paper, we consider the asymptotic form of the generalization error for the restricted Boltzmann machine in Bayesian estimation. It has been shown that obtaining the maximu...
Miki Aoyagi
ICML
2007
IEEE
14 years 5 months ago
Asymptotic Bayesian generalization error when training and test distributions are different
In supervised learning, we commonly assume that training and test data are sampled from the same distribution. However, this assumption can be violated in practice and then standa...
Keisuke Yamazaki, Klaus-Robert Müller, Masash...
NIPS
2007
13 years 5 months ago
Discovering Weakly-Interacting Factors in a Complex Stochastic Process
Dynamic Bayesian networks are structured representations of stochastic processes. Despite their structure, exact inference in DBNs is generally intractable. One approach to approx...
Charlie Frogner, Avi Pfeffer
FOCI
2007
IEEE
13 years 10 months ago
Almost All Learning Machines are Singular
— A learning machine is called singular if its Fisher information matrix is singular. Almost all learning machines used in information processing are singular, for example, layer...
Sumio Watanabe
IJON
1998
158views more  IJON 1998»
13 years 3 months ago
Bayesian Kullback Ying-Yang dependence reduction theory
Bayesian Kullback Ying—Yang dependence reduction system and theory is presented. Via stochastic approximation, implementable algorithms and criteria are given for parameter lear...
Lei Xu