In the human mind, high-order knowledge is categorically organized, yet the nature of its internal representation system is not well understood. While it has been traditionally con...
Abstract. In this paper we utilize information theory to study the impact in learning performance of various motivation and environmental configurations. This study is done within...
— We present a simple, intuitive argument based on “invariant imbedding” in the spirit of dynamic programming to derive a stagewise second-order backpropagation (BP) algorith...
— We analyze the generalization performance of a student in a model composed of linear perceptrons: a true teacher, ensemble teachers, and the student. Calculating the generaliza...
— In many applications of supervised learning, the conditional average of the target variables is not sufficient for prediction. The dependencies between the explanatory variabl...