Sciweavers

Share
TNN
2010

On the selection of weight decay parameter for faulty networks

8 years 6 months ago
On the selection of weight decay parameter for faulty networks
The weight-decay technique is an effective approach to handle overfitting and weight fault. For fault-free networks, without an appropriate value of decay parameter, the trained network is either overfitted or underfitted. However, many existing results on the selection of decay parameter focus on fault-free networks only. It is well known that the weight-decay method can also suppress the effect of weight fault. For the faulty case, using a test set to select the decay parameter is not practice because there are huge number of possible faulty networks for a trained network. This paper develops two mean prediction error (MPE) formulae for predicting the performance of faulty radial basis function (RBF) networks. Two fault models, multiplicative weight noise and open weight fault, are considered. Our MPE formulae involve the training error and trained weights only. Besides, in our method, we do not need to generate a huge number of faulty networks to measure the test error for the fault...
Andrew Chi-Sing Leung, Hongjiang Wang, John Sum
Added 22 May 2011
Updated 22 May 2011
Type Journal
Year 2010
Where TNN
Authors Andrew Chi-Sing Leung, Hongjiang Wang, John Sum
Comments (0)
books