Graphical lasso

Definition taught in Graphical models, part of Statistical learning

Graphical lasso

Type Definition
Taught in Graphical models
Part Statistical learning
Questions using it 2
  1. Initialise W=S+\lambda I.
  2. Repeat for j=1,\ldots,p until convergence:
    1. Partition W into part A, all but the jth row and column, and part B, the jth row and column.
    2. Solve W_{AA}\beta-s_{AB}+\lambda z=0, where z_k=\operatorname{sign}(\beta_k) for \beta_k\neq 0 and z_k\in[-1,1] for \beta_k=0, using cyclic coordinate descent.
    3. Update w_{AB}=W_{AA}\hat\beta and the corresponding row w_{BA}=w_{AB}^\top.
  3. In the final cycle for each j, solve \hat\theta_{AB}=-\hat\beta\,\hat\theta_{BB} with 1/\hat\theta_{BB}=w_{BB}-w_{AB}^\top\hat\beta.

Used in

See also

Sparsity · Undirected graph · Hammersley–Clifford · A zero precision entry is conditional independence · Maximum likelihood for a known graph · Markov graphs · Graph terminology · Conditional independence

Glossary and index