VC Dimension Bounds for Product Unit Networks

A product unit is a formal neuron that multiplies its input values instead of summingthem. Furthermore, it has weights acting as exponents instead of being factors. We investigate the complexity of learning for networks containing product units. We establish bounds on the Vapnik-Chervonenkis (VC) dimension that can be used to assess the generalization capabilities of these networks. In particular, we show that the VC dimension for these networks is not larger than the best known bound for sigmoidal networks. For higher-order networks we derive upper bounds that are independent of the degree of these networks. We also contrast these results with lower bounds.

• Type: Conference
• Year: 2000
• Where: IJCNN
• Authors: Michael Schmitt
• Keywords: Formal Neuron, IJCNN 2000, Networks Containing Product, Neural Networks, Product Units