Back to Search Start Over

A Doubly Enhanced EM Algorithm for Model-Based Tensor Clustering.

Authors :
Mai, Qing
Zhang, Xin
Pan, Yuqing
Deng, Kai
Source :
Journal of the American Statistical Association. Dec2022, Vol. 117 Issue 540, p2120-2134. 15p.
Publication Year :
2022

Abstract

Modern scientific studies often collect datasets in the form of tensors. These datasets call for innovative statistical analysis methods. In particular, there is a pressing need for tensor clustering methods to understand the heterogeneity in the data. We propose a tensor normal mixture model approach to enable probabilistic interpretation and computational tractability. Our statistical model leverages the tensor covariance structure to reduce the number of parameters for parsimonious modeling, and at the same time explicitly exploits the correlations for better variable selection and clustering. We propose a doubly enhanced expectation–maximization (DEEM) algorithm to perform clustering under this model. Both the expectation-step and the maximization-step are carefully tailored for tensor data in order to maximize statistical accuracy and minimize computational costs in high dimensions. Theoretical studies confirm that DEEM achieves consistent clustering even when the dimension of each mode of the tensors grows at an exponential rate of the sample size. Numerical studies demonstrate favorable performance of DEEM in comparison to existing methods. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01621459
Volume :
117
Issue :
540
Database :
Academic Search Index
Journal :
Journal of the American Statistical Association
Publication Type :
Academic Journal
Accession number :
161160696
Full Text :
https://doi.org/10.1080/01621459.2021.1904959