Sciweavers

98 search results - page 1 / 20
» Training Recurrent Networks by Evolino
Sort
View
NECO
2007
115views more  NECO 2007»
13 years 4 months ago
Training Recurrent Networks by Evolino
In recent years, gradient-based LSTM recurrent neural networks (RNNs) solved many previously RNN-unlearnable tasks. Sometimes, however, gradient information is of little use for t...
Jürgen Schmidhuber, Daan Wierstra, Matteo Gag...
ESANN
2006
13 years 6 months ago
Evolino for recurrent support vector machines
Abstract. We introduce a new class of recurrent, truly sequential SVM-like devices with internal adaptive states, trained by a novel method called EVOlution of systems with KErnel-...
Jürgen Schmidhuber, Matteo Gagliolo, Daan Wie...
IROS
2006
IEEE
126views Robotics» more  IROS 2006»
13 years 10 months ago
A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks
Abstract— Tying suture knots is a time-consuming task performed frequently during Minimally Invasive Surgery (MIS). Automating this task could greatly reduce total surgery time f...
Hermann Georg Mayer, Faustino J. Gomez, Daan Wiers...
GECCO
2005
Springer
204views Optimization» more  GECCO 2005»
13 years 10 months ago
Modeling systems with internal state using evolino
Existing Recurrent Neural Networks (RNNs) are limited in their ability to model dynamical systems with nonlinearities and hidden internal states. Here we use our general framework...
Daan Wierstra, Faustino J. Gomez, Jürgen Schm...
TNN
1998
89views more  TNN 1998»
13 years 4 months ago
Fast training of recurrent networks based on the EM algorithm
— In this work, a probabilistic model is established for recurrent networks. The EM (expectation-maximization) algorithm is then applied to derive a new fast training algorithm f...
Sheng Ma, Chuanyi Ji