Partitioned Alternating Least Squares Technique for Canonical Polyadic Tensor Decomposition

0460710 - ÚTIA 2017 RIV US eng J - Journal Article
Tichavský, Petr - Phan, A. H. - Cichocki, A.
Partitioned Alternating Least Squares Technique for Canonical Polyadic Tensor Decomposition.
IEEE Signal Processing Letters. Roč. 23, č. 7 (2016), s. 993-997. ISSN 1070-9908. E-ISSN 1558-2361
R&D Projects: GA ČR(CZ) GA14-13713S
Institutional support: RVO:67985556
Keywords : canonical polyadic decomposition * PARAFAC * tensor decomposition
Subject RIV: BB - Applied Statistics, Operational Research
Impact factor: 2.528, year: 2016
http://library.utia.cas.cz/separaty/2016/SI/tichavsky-0460710.pdf

Canonical polyadic decomposition (CPD), also known as parallel factor analysis, is a representation of a given tensor as a sum of rank-one components. Traditional method for accomplishing CPD is the alternating least squares (ALS) algorithm. Convergence of ALS is known to be slow, especially when some factor matrices of the tensor contain nearly collinear columns. We propose a novel variant of this technique, in which the factor matrices are partitioned into blocks, and each iteration jointly updates blocks of different factor matrices. Each partial optimization is quadratic and can be done in closed form. The algorithm alternates between different random partitionings of the matrices. As a result, a faster convergence is achieved. Another improvement can be obtained when the method is combined with the enhanced line search of Rajih et al. Complexity per iteration is between those of the ALS and the Levenberg–Marquardt (damped Gauss–Newton) method.
Permanent Link: http://hdl.handle.net/11104/0261531