Raghuram Shankar
← Diffusion Language Models

Part 3 of 8

The Maths I: Continuous Diffusion

The pictures so far are honest, but they hide the machinery. This section makes the continuous (image) case precise; the next one carries the same skeleton over to text. The only prerequisites are Gaussians, expectations, and a tolerance for subscripts.

  1. The forward process
  2. The reverse process and the ELBO
  3. DDIM: same training, a fraction of the steps
  4. Quiz: 5 questions