Sciweavers

IJON
2006

Reinforcement learning of a simple control task using the spike response model

13 years 12 months ago
Reinforcement learning of a simple control task using the spike response model
In this work, we propose a variation of a direct reinforcement learning algorithm, suitable for usage with spiking neurons based on the spike response model (SRM). The SRM is a biologically inspired, flexible model of spiking neuron based on kernel functions that describe the effect of spike reception and emission on the membrane potential of the neuron. In our experiments, the spikes emitted by a SRM neuron are used as input signals in a simple control task. The reinforcement signal obtained from the environment is used by the direct reinforcement learning algorithm, that modifies the synaptic weights of the neuron, adjusting the spiking firing times in order to obtain a better performance at the given problem. The obtained results are comparable to those from classic methods based on value function approximation and temporal difference, for simple control tasks. r 2006 Elsevier B.V. All rights reserved.
Murilo Saraiva de Queiroz, Roberto Coelho de Berr&
Added 13 Dec 2010
Updated 13 Dec 2010
Type Journal
Year 2006
Where IJON
Authors Murilo Saraiva de Queiroz, Roberto Coelho de Berrêdo, Antônio de Pádua Braga
Comments (0)