On Robust Training of Regression Neural Networks

0544178 - ÚI 2022 RIV CZ eng A - Abstrakt
Kalina, Jan - Vidnerová, Petra
On Robust Training of Regression Neural Networks.
IWFOS 2021. Book of Abstracts. Brno: MUNI Faculty of Science, 2021. s. 35-35.
[IWFOS 2020/2021: International Workshop on Functional and Operatorial Statistics /5./. 23.06.2021-25.06.2021, Online]
Grant CEP: GA ČR(CZ) GA19-05704S; GA ČR(CZ) GA18-23827S
Institucionální podpora: RVO:67985807
Klíčová slova: neural networks * robustness * nonlinear regression quantiles
Obor OECD: Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
https://iwfos2021.sci.muni.cz/media/3326670/iwfos2021-book-of-abstracts.pdf

Estimation, prediction or smoothing of curves represents a fundamental task of functional data analysis. Nonlinear regression methods allow to search for the best-fit curves explaining the dependence of a response variable on available independent variables. Neural networks, commonly used for the task of nonlinear regression, are however highly vulnerable to the presence of outlying measurements in the data. New robust versions of common types of neural networks, namely multilayer perceptrons and radial basis function networks, are proposed here based on nonlinear regression quantiles or highly robust loss functions. Three datasets are analyzed to illustrate the performance of the novel robust approaches, which turn out to outperform standard neural networks or other competing regression tools over contaminated data.
Trvalý link: http://hdl.handle.net/11104/0321234