EM for a normal mixture

Definition taught in Mixtures and the EM algorithm, part of Statistical learning

EM for a normal mixture

Type Definition
Taught in Mixtures and the EM algorithm
Part Statistical learning

Choose initial values \Psi^{(0)}. For k=0,1,2,\ldots:

  1. E step: compute \tau_{ih}=\tau_h(\mathbf{x}_i;\Psi^{(k)}) for all i,h.
  2. M step: compute \pi_h^{(k+1)}, \boldsymbol\mu_h^{(k+1)}, and \Sigma_h^{(k+1)} from the three updates above.
  3. Stop when the change in \ell(\Psi^{(k)};X_{\mathrm{all}}) is smaller than a threshold.

Used in

See also

EM algorithm · Monotonicity of EM · Complete-data likelihood · E step · M step · Finite mixture model · Posterior membership · Likelihood of a normal mixture

Glossary and index