We had Image Gen copying LLM... and now the REVERSE?? [DiffusionLM]

To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/bycloud/ . You’ll also get 20% off an annual premium subscription.

In 2023, image generation adopted LLMs' transformer architecture to improve generation quality. Now, in 2024, the Diffusion Language Model, also known as DiffusionLM, is taking a step towards using diffusion for language modeling. Look how the turn tables...


my newsletter
https://mail.bycloud.ai

Check out my Patreon for the latest diffusionLM papers mapped out
https://www.patreon.com/bycloud


Structured Denoising Diffusion Models in Discrete State-Spaces
[Paper] https://arxiv.org/abs/2107.03006

Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
[Paper] https://arxiv.org/abs/2310.16834

Scaling up Masked Diffusion Models on Text
[Paper] https://arxiv.org/abs/2410.18514

Discrete Diffusion for Complex Reasoning and Planning
[Paper] https://arxiv.org/abs/2410.14157

Simplified and Generalized Masked Diffusion for Discrete Data
[Paper] https://arxiv.org/abs/2406.04329

Speculative Diffusion Decoding
[Paper] https://arxiv.org/abs/2408.05636

Energy-Based Diffusion Language Models for Text Generation
[Paper] https://arxiv.org/abs/2410.21357


This video is supported by the kind Patrons & YouTube Members:
????Andrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Raffay Rana

[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud

[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Askejm

[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai