Select Lab Publications


A Unified View of Matrix Factorization Models (2008)

By: Ajit P. Singh and Geoff J. Gordon

Abstract: We present a unified view of matrix factorization that frames the differences among popular methods, such as NMF, Weighted SVD, E-PCA, MMMF, pLSI, pLSI-pHITS, Bregman co-clustering, and many others, in terms of a small number of modeling choices. Many of these approaches can be viewed as minimizing a generalized Bregman divergence, and we show that (i) a straightforward alternating projection algorithm can be applied to almost any model in our unified view; (ii) the Hessian for each projection has special structure that makes a Newton projection feasible, even when there are equality constraints on the factors, which allows for matrix co-clustering; and (iii) alternating projections can be generalized to simultaneously factor a set of matrices that share dimensions. These observations immediately yield new optimization algorithms for the above factorization methods, and suggest novel generalizations of these methods such as incorporating row and column biases, and adding or relaxing clustering constraints.

Download Information
Ajit P. Singh and Geoff J. Gordon (2008). "A Unified View of Matrix Factorization Models." Machine Learning and Knowledge Discovery in Databases, European Conference (ECML/PKDD). pdf            
BibTeX citation

@inproceedings{Singh+Gordon:ecml08unified,
author = {Ajit P. Singh and Geoff J. Gordon},
title = {A Unified View of Matrix Factorization Models},
booktitle = {Machine Learning and Knowledge Discovery in Databases, European Conference (ECML/PKDD)},
year = 2008,
wwwfilebase = {ecml2008-singh-gordon},
wwwtopic = {Matrix Factorization}
}



full list