Part 2 of 8
Intuition
The core idea that makes diffusion work for text is almost embarrassingly simple once you see it: for discrete tokens, the analogue of noise is masking.
Part 2 of 8
The core idea that makes diffusion work for text is almost embarrassingly simple once you see it: for discrete tokens, the analogue of noise is masking.