Statements in which the resource exists as a subject.
PredicateObject
rdf:type
lifeskim:mentions
pubmed:issue
2
pubmed:dateCreated
1999-3-29
pubmed:abstractText
Factor analysis, principal component analysis, mixtures of gaussian clusters, vector quantization, Kalman filter models, and hidden Markov models can all be unified as variations of unsupervised learning under a single basic generative model. This is achieved by collecting together disparate observations and derivations made by many previous authors and introducing a new way of linking discrete and continuous state models using a simple nonlinearity. Through the use of other nonlinearities, we show how independent component analysis is also a variation of the same basic generative model. We show that factor analysis and mixtures of gaussians can be implemented in autoencoder neural networks and learned using squared error plus the same regularization term. We introduce a new model for static data, known as sensible principal component analysis, as well as a novel concept of spatially adaptive observation noise. We also review some of the literature involving global and local mixtures of the basic models and provide pseudocode for inference and learning for all the basic models.
pubmed:language
eng
pubmed:journal
pubmed:citationSubset
IM
pubmed:status
MEDLINE
pubmed:month
Feb
pubmed:issn
0899-7667
pubmed:author
pubmed:issnType
Print
pubmed:day
15
pubmed:volume
11
pubmed:owner
NLM
pubmed:authorsComplete
Y
pubmed:pagination
305-45
pubmed:dateRevised
2006-11-15
pubmed:meshHeading
pubmed:year
1999
pubmed:articleTitle
A unifying review of linear gaussian models.
pubmed:affiliation
Department of Molecular Biology, Princeton University, Princeton, NJ 08544, USA. roweis@gatsby.ucl.ac.uk
pubmed:publicationType
Journal Article, Research Support, U.S. Gov't, Non-P.H.S., Review, Research Support, Non-U.S. Gov't