Learning Neural Networks with Respect to Tolerances to Weight Errors

0504647 - ÚI 2020 US eng J - Článek v odborném periodiku
Růžička, Pavel
Learning Neural Networks with Respect to Tolerances to Weight Errors.
IEEE Transaction on Circuits and Systems. Roč. 40, č. 5 (1993), s. 331-342. ISSN 1057-7122
Klíčová slova: tolerances * weight errors * neural network learning * synaptic weights * formal neurons * cumulative loss function * mathematical formalism * stochastic optimization * stochastic constraints * three-layer feedforward network
Impakt faktor: 1.378, rok: 1993
Způsob publikování: Omezený přístup

The problem of neural network learning to get the most convenient configuration, i.e., the vector of synaptic weights and thresholds of formal neurons creating the network, is treated. The possible errors in keeping precise the designed configuration during the realization as well as fluctuations of the configuration during the net exploitation are taken into account using the theory of tolerances. A cumulative loss function that expresses the loss evoked by imprecise learning is introduced, allowing the mathematical formalism used in the theory of tolerances and sensitivity to be applied. Learning is expressed as the problem of maximization of the volume of the area in the configuration space where the neural network exhibits small values of the cumulative loss function. The general task of synthesizing the parameters and their tolerances is shown to be a nonconvex problem of stochastic optimization with stochastic constraints, and a stochastic approximation algorithm for solving this problem is given. Results of teaching a three-layer feedforward network are given.
Trvalý link: http://hdl.handle.net/11104/0296224