GeekRadar / The comparison desk
COMPARE.
AI models
meta

Llama 3.1 405B Instruct (BF16)

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Llama 3.1 405B Instruct (BF16) 1283.7 Llama 3.1 405B Instruct (BF16) · 95% interval 1280.0–1287.4 · 41,375 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,241.81 rating

Confidence interval: 1,230.76 – 1,252.86

3105 votes

Category
chinese
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,291.04 rating

Confidence interval: 1,283.57 – 1,298.51

6249 votes

Category
coding
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,259.41 rating

Confidence interval: 1,251.78 – 1,267.05

6512 votes

Category
creative_writing
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,311.81 rating

Confidence interval: 1,307.21 – 1,316.41

23318 votes

Category
english
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,213.34 rating

Confidence interval: 1,207.77 – 1,218.91

27059 votes

Category
exclude_ties
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,228.76 rating

Confidence interval: 1,215.91 – 1,241.61

2128 votes

Category
expert
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,279.00 rating

Confidence interval: 1,248.35 – 1,309.65

364 votes

Category
french
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,252.33 rating

Confidence interval: 1,232.87 – 1,271.79

894 votes

Category
german
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,269.27 rating

Confidence interval: 1,263.33 – 1,275.21

10652 votes

Category
hard_prompts
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,291.34 rating

Confidence interval: 1,284.08 – 1,298.61

6791 votes

Category
hard_prompts_english
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,244.84 rating

Confidence interval: 1,235.73 – 1,253.96

4512 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,240.86 rating

Confidence interval: 1,233.58 – 1,248.13

7230 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,301.87 rating

Confidence interval: 1,289.04 – 1,314.69

2330 votes

Category
industry_legal_and_government
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,295.08 rating

Confidence interval: 1,287.74 – 1,302.43

7177 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,275.63 rating

Confidence interval: 1,266.93 – 1,284.33

4366 votes

Category
industry_mathematical
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,286.31 rating

Confidence interval: 1,272.29 – 1,300.32

1899 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,290.41 rating

Confidence interval: 1,284.20 – 1,296.61

10298 votes

Category
industry_software_and_it_services
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,270.45 rating

Confidence interval: 1,264.32 – 1,276.58

11150 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,258.46 rating

Confidence interval: 1,253.21 – 1,263.70

16174 votes

Category
instruction_following
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,208.03 rating

Confidence interval: 1,187.37 – 1,228.70

846 votes

Category
japanese
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,172.33 rating

Confidence interval: 1,146.35 – 1,198.30

586 votes

Category
korean
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,265.42 rating

Confidence interval: 1,257.43 – 1,273.41

5486 votes

Category
longer_query
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,278.23 rating

Confidence interval: 1,270.20 – 1,286.27

5215 votes

Category
math
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,296.85 rating

Confidence interval: 1,289.20 – 1,304.50

6797 votes

Category
multi_turn
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,246.72 rating

Confidence interval: 1,241.67 – 1,251.78

18057 votes

Category
non_english
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,283.66 rating

Confidence interval: 1,279.97 – 1,287.36

41375 votes

Category
overall
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,255.96 rating

Confidence interval: 1,247.28 – 1,264.64

4863 votes

Category
russian
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-10-28 · rating

Llama 3.1 405B Instruct (BF16)

1,259.83 rating

Confidence interval: 1,229.47 – 1,290.18

348 votes

Category
spanish
Evaluated configuration
Llama 3.1 405B Instruct (BF16)
Evaluation type
human preference

Run it locally

Inference · memory estimate

Llama 3.1 405B Instruct (BF16)

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Llama 3.1 Community