diffusion LLMs. Text diffusion is still a very young field. As I covered in my previous video, there are many formulations, some more math heavy than others. And while there isn't a de facto standard yet, two things are clear. One is that all diffusion MLMs under one form or another are using the transformer. and two is that there's a clear convergence towards masked diffusion models, the ones inspired by BERT. Most likely, it's because they're easier to understand and easier to implement. To make it