66 search results - page 1 / 14 » Stochastic gradient descent on GPUs |
ALIFE
2002
13 years 4 months ago
2002
In this paper, we study the relationship between the two techniques known as ant colony optimization (aco) and stochastic gradient descent. More precisely, we show that some empir...
ICANN
2001
Springer
13 years 9 months ago
2001
Springer
The method of conjugate gradients provides a very effective way to optimize large, deterministic systems by gradient descent. In its standard form, however, it is not amenable to ...
NIPS
2003
13 years 6 months ago
2003
Gradient-following learning methods can encounter problems of implementation in many applications, and stochastic variants are frequently used to overcome these difficulties. We ...
CEC
2011
IEEE
12 years 4 months ago
2011
IEEE
—Stochastic relaxation aims at finding the minimum of a fitness function by identifying a proper sequence of distributions, in a given model, that minimize the expected value o...
ICDM
2010
IEEE
13 years 2 months ago
2010
IEEE
On large datasets, the popular training approach has been stochastic gradient descent (SGD). This paper proposes a modification of SGD, called averaged SGD with feedback (ASF), tha...