On the Bayesian Interpretation of Penalized Statistical Estimators

0579680 - ÚI 2024 RIV CH eng C - Conference Paper (international conference)
Kalina, Jan - Peštová, Barbora
On the Bayesian Interpretation of Penalized Statistical Estimators.
Artificial Intelligence and Soft Computing. 22nd International Conference, ICAISC 2023, Proceedings, Part 2. Cham: Springer, 2023 - (Rutkowski, L.; Scherer, R.; Korytkowski, M.; Pedrycz, W.; Tadeusiewicz, R.; Zurada, J.), s. 343-352. Lecture Notes in Computer Science, 14126. ISBN 978-3-031-42507-3.
[ICAISC 2023: International Conference on Artificial Intelligence and Soft Computing /22./. Zakopane (PL), 18.07.2023-22.07.2023]
R&D Projects: GA ČR GA21-05325S
Institutional support: RVO:67985807
Keywords : Bayesian estimation * regularization * penalization * robustness * regression
OECD category: Statistics and probability
https://doi.org/10.1007/978-3-031-42508-0_31

The aim of this work is to search for intuitive interpretations of penalized statistical estimators. Penalized estimates of the parameters of three models obtained by Bayesian reasoning are explained here to correspond to the intuition. First, the paper considers Bayesian estimates of the mean and covariance matrix for the multivariate normal distribution. Second, a connection of a robust regularized version of Mahalanobis distance with Bayesian estimation is discussed. Third, regularization networks, which represent a common nonparametric tool for regression modeling, are presented as Bayesian methods as well. On the whole, selected important multivariate and/or regression models are considered and novel interpretations are formulated.
Permanent Link: https://hdl.handle.net/11104/0348492