Inception launches Mercury 3, a diffusion-based LLM it claims is "comparable to Luna and Haiku models" but 4x to 8x faster, generating ~1,000 tokens per second (Jason Hiner/The Deep View)

Posted

Jason Hiner / The Deep View:
Inception launches Mercury 3, a diffusion-based LLM it claims is “comparable to Luna and Haiku models” but 4x to 8x faster, generating ~1,000 tokens per second  —  W  —  hile the AI industry has bet heavily on LLMs and the massive data centers needed to scale them …



Continue reading at Techmeme »