Llama 4: Natively Multimodal AI Innovation

Meta AI has introduced its Llama 4 family of large language models, highlighting two new open-weight models: Llama 4 Scout and Llama 4 Maverick, along with a powerful, still-training model called Llama 4 Behemoth. These multimodal models feature innovations like Mixture-of-Experts architecture and significantly expanded context windows, outperforming previous Llama iterations and competing with or exceeding the capabilities of other leading models on various benchmarks. The release emphasizes open access, with the new models available for download and integration, aiming to foster innovation and the development of personalized AI experiences. Meta also details their approach to pre-training, post-training, and safety measures implemented in the Llama 4 series, underscoring their commitment to responsible AI development.