Llama 3.1 405B Instruct

The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs.

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Share

Model details

Context window130,815 tokens
Max completion size17 tokens
Prompt cost / 1K tokens$0.0000035
Completion cost / 1K tokens$0.0000035
Accepts
Produces

Benchmark performance

Overall

58
score
26th
placement

Cost

75
score
16th
placement

Logic

7
score
22nd
placement

Speed

86
score
14th
placement

Scoring

65
score
1st
placement

Tool Use

19
score
9th
placement

Hallucination

80
score
8th
placement

Classification

39
score
2nd
placement

Structured Output

8
score
10th
placement

Pricing

Usage pricing
Prompt
$0.0000035
Completion
$0.0000035
Request
FREE
Image
FREE
Web Search
FREE
Internal Reasoning
FREE

Best Overall scoring LLMs

88
score
1st
placement
86
score
2nd
placement
84
score
3rd
placement
82
score
4th
placement
82
score
4th
placement
80
score
5th
placement