Google's Gemini Diffusion: A Blazing-Fast Diffusion LLM

Google I/O unveiled Gemini Diffusion, its first LLM to leverage diffusion models (akin to Imagen and Stable Diffusion) instead of transformers. Unlike traditional word-by-word generation, Gemini Diffusion refines noise iteratively, resulting in impressive speed. Tests showed generation speeds of 857 tokens/second, producing interactive HTML+JavaScript pages within seconds. While independent benchmarks are pending, Google claims it's 5x faster than Gemini 2.0 Flash-Lite, suggesting comparable performance. This marks a significant advancement in commercially available diffusion models.