Sciweavers

30 search results - page 3 / 6
» Overfitting and Neural Networks: Conjugate Gradient and Back...
Sort
View
NPL
2000
135views more  NPL 2000»
13 years 5 months ago
Towards the Optimal Learning Rate for Backpropagation
A backpropagation learning algorithm for feedforward neural networks with an adaptive learning rate is derived. The algorithm is based upon minimising the instantaneous output erro...
Danilo P. Mandic, Jonathon A. Chambers
ICANN
2007
Springer
13 years 11 months ago
Solving Deep Memory POMDPs with Recurrent Policy Gradients
Abstract. This paper presents Recurrent Policy Gradients, a modelfree reinforcement learning (RL) method creating limited-memory stochastic policies for partially observable Markov...
Daan Wierstra, Alexander Förster, Jan Peters,...
JMLR
2012
11 years 7 months ago
Krylov Subspace Descent for Deep Learning
In this paper, we propose a second order optimization method to learn models where both the dimensionality of the parameter space and the number of training samples is high. In ou...
Oriol Vinyals, Daniel Povey
ML
2006
ACM
110views Machine Learning» more  ML 2006»
13 years 5 months ago
Classification-based objective functions
Backpropagation, similar to most learning algorithms that can form complex decision surfaces, is prone to overfitting. This work presents classification-based objective functions, ...
Michael Rimer, Tony Martinez
ICAISC
2010
Springer
13 years 7 months ago
Computer Assisted Peptide Design and Optimization with Topology Preserving Neural Networks
Abstract. We propose a non-standard neural network called TPNN which offers the direct mapping from a peptide sequence to a property of interest in order to model the quantitative ...
Jörg D. Wichard, Sebastian Bandholtz, Carsten...