Pattern Recognition by Probabilistic Neural Networks - Mixtures of Product Components versus Mixtures of Dependence Trees

0434119 - ÚTIA 2015 RIV PT eng C - Conference Paper (international conference)
Grim, Jiří - Pudil, P.
Pattern Recognition by Probabilistic Neural Networks - Mixtures of Product Components versus Mixtures of Dependence Trees.
NCTA2014 - International Conference on Neural Computation Theory and Applications. Rome: SCITEPRESS, 2014, s. 65-75. ISBN 978-989-758-054-3.
[6-th International Conference on Neural Computation Theory and Applications. Rome (IT), 22.10.2014-24.10.2014]
R&D Projects: GA ČR(CZ) GA14-02652S
Grant - others:GA ČR(CZ) GAP403/12/1557
Institutional support: RVO:67985556
Keywords : Probabilistic Neural Networks * Product Mixtures * Mixtures of Dependence Trees * EM Algorithm
Subject RIV: IN - Informatics, Computer Science
http://library.utia.cas.cz/separaty/2014/RO/grim-0434119.pdf

We compare two probabilistic approaches to neural networks - the first one based on the mixtures of product components and the second one using the mixtures of dependence-tree distributions. The product mixture models can be efficiently estimated from data by means of EM algorithm and have some practically important properties. However, in some cases the simplicity of product components could appear too restrictive and a natural idea is to use a more complex mixture of dependence-tree distributions. By considering the concept of dependence tree we can explicitly describe the statistical relationships between pairs of variables at the level of individual components and therefore the approximation power of the resulting mixture may essentially increase. Nonetheless, in application to classification of numerals we have found that both models perform comparably and the contribution of the dependence-tree structures decreases in the course of EM iterations. Thus the optimal estimate of the dependence-tree mixture tends to converge to a simple product mixture model.
Permanent Link: http://hdl.handle.net/11104/0238366