C1. Likelihood, prior and posterior
What are a likelihood, a prior and a posterior? Which variable is the likelihood a function of after observing the data?
Worked answer (click to show)
Definitions/notation. For observed data x and parameter \theta, the likelihood L(\theta;x)=p(x\mid\theta) is a function of \theta, the prior p(\theta) describes parameter uncertainty before these data, and the posterior p(\theta\mid x)\propto L(\theta;x)p(\theta) describes it after observing them. The likelihood need not integrate to one over \theta.