GeekRadar / The comparison desk
COMPARE.
AI models
meta

llama-3.1-405b-instruct-fp8

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

llama-3.1-405b-instruct-fp8 1281.8 llama-3.1-405b-instruct-fp8 · 95% interval 1278.2–1285.3 · 59,656 votes · 2026-10-15

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,234.41 rating

Confidence interval: 1,224.70 – 1,244.12

5226 votes

Category
chinese
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,283.33 rating

Confidence interval: 1,276.25 – 1,290.42

9714 votes

Category
coding
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,261.81 rating

Confidence interval: 1,254.13 – 1,269.49

8948 votes

Category
creative_writing
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,307.84 rating

Confidence interval: 1,303.08 – 1,312.59

32442 votes

Category
english
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,208.80 rating

Confidence interval: 1,203.07 – 1,214.52

38128 votes

Category
exclude_ties
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,242.81 rating

Confidence interval: 1,231.43 – 1,254.19

3123 votes

Category
expert
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,271.02 rating

Confidence interval: 1,243.38 – 1,298.67

545 votes

Category
french
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,250.51 rating

Confidence interval: 1,234.25 – 1,266.77

1587 votes

Category
german
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,263.30 rating

Confidence interval: 1,257.51 – 1,269.10

16228 votes

Category
hard_prompts
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,283.02 rating

Confidence interval: 1,275.99 – 1,290.05

9964 votes

Category
hard_prompts_english
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,247.48 rating

Confidence interval: 1,239.02 – 1,255.94

6667 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,250.02 rating

Confidence interval: 1,242.74 – 1,257.30

9523 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,303.12 rating

Confidence interval: 1,291.56 – 1,314.69

3383 votes

Category
industry_legal_and_government
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,284.24 rating

Confidence interval: 1,276.95 – 1,291.53

10001 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,275.98 rating

Confidence interval: 1,267.99 – 1,283.97

7242 votes

Category
industry_mathematical
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,270.57 rating

Confidence interval: 1,258.32 – 1,282.83

3064 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,280.82 rating

Confidence interval: 1,274.79 – 1,286.84

15817 votes

Category
industry_software_and_it_services
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,274.19 rating

Confidence interval: 1,268.03 – 1,280.34

15999 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,258.45 rating

Confidence interval: 1,253.19 – 1,263.71

23585 votes

Category
instruction_following
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,171.30 rating

Confidence interval: 1,154.55 – 1,188.04

1606 votes

Category
japanese
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,183.99 rating

Confidence interval: 1,161.85 – 1,206.13

924 votes

Category
korean
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,259.27 rating

Confidence interval: 1,251.74 – 1,266.81

8047 votes

Category
longer_query
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,281.27 rating

Confidence interval: 1,273.72 – 1,288.82

8482 votes

Category
math
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,287.26 rating

Confidence interval: 1,280.06 – 1,294.46

11136 votes

Category
multi_turn
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,247.80 rating

Confidence interval: 1,242.86 – 1,252.75

27214 votes

Category
non_english
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,281.76 rating

Confidence interval: 1,278.19 – 1,285.33

59656 votes

Category
overall
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,265.24 rating

Confidence interval: 1,257.32 – 1,273.16

7673 votes

Category
russian
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-10-15 · rating

llama-3.1-405b-instruct-fp8

1,252.97 rating

Confidence interval: 1,227.70 – 1,278.25

652 votes

Category
spanish
Evaluated configuration
llama-3.1-405b-instruct-fp8
Evaluation type
human preference

Run it locally

Inference · memory estimate

llama-3.1-405b-instruct-fp8

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Llama 3.1 Community