Tag: diffusion-language-models

All the articles with the tag "diffusion-language-models".

• Diffusion, for Images and for Text: Learn to Undo a Little Noise

  Updated:19 Oct, 2026

  Corrupt data a little at a time until it is pure noise, and train a network to undo one step. For images the corruption is Gaussian noise; for text it is masking. The forward process and its closed form, the noise schedule worked numerically, the ε-prediction loss derived from the ELBO of VAEs and GANs, DDPM and DDIM sampling, classifier-free guidance, and latent diffusion; a diffusion model trained on the eight-mode test of VAEs and GANs, with step counts and guidance measured; then masked diffusion for text, where a toy language shows exactly what decoding many tokens in parallel gets wrong, and the FLOPs and latency arithmetic against autoregressive decoding.