Question 1

What is Llama 3.1 405B?

Accepted Answer

Llama 3.1 405B is Meta's largest open-weight language model and one of the most capable openly available models in the world. With 405 billion parameters, it achieves performance competitive with GPT-4 and Claude Opus across benchmarks spanning general knowledge, mathematics, coding, and multilingual tasks. Llama 3.1 405B is released under Meta's custom commercial license, supporting broad use cases including deployment via major cloud providers (AWS, GCP, Azure) and self-hosted inference with multi-GPU configurations.

Question 2

How much does Llama 3.1 405B cost?

Accepted Answer

Llama 3.1 405B is priced at $0.80 per million input tokens and $0.80 per million output tokens.

Question 3

What is Llama 3.1 405B's context window?

Accepted Answer

Llama 3.1 405B supports a context window of 131,072 tokens, allowing it to process approximately 175 words in a single request.

Question 4

Is Llama 3.1 405B available via API?

Accepted Answer

Yes, Llama 3.1 405B is available via API. Developers can integrate it directly into their applications through Meta's API platform.

Llama 3.1 405B

Model Overview

Vetted Benchmarks

How does this model compare?