GeekRadar / The comparison desk

COMPARE.

AI models

Llama-4-Scout-17B-16E-Instruct

AI model

Open weights: Yes

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Llama-4-Scout-17B-16E-Instruct 1279.1 Llama 4 Scout 17B 16E Instruct · 95% interval 1274.4–1283.9 · 29,823 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Test version

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,254.07 rating

Confidence interval: 1,240.12 – 1,268.03

2081 votes

Oct 28, 2026

Category: chinese
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.72 rating

Confidence interval: 1,277.20 – 1,294.24

5229 votes

Oct 28, 2026

Category: coding
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,248.58 rating

Confidence interval: 1,238.57 – 1,258.58

3759 votes

Oct 28, 2026

Category: creative_writing
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,304.22 rating

Confidence interval: 1,298.17 – 1,310.26

13039 votes

Oct 28, 2026

Category: english
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,207.84 rating

Confidence interval: 1,201.24 – 1,214.44

21403 votes

Oct 28, 2026

Category: exclude_ties
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,235.03 rating

Confidence interval: 1,219.41 – 1,250.65

1535 votes

Oct 28, 2026

Category: expert
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,282.78 rating

Confidence interval: 1,253.16 – 1,312.40

427 votes

Oct 28, 2026

Category: french
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,272.08 rating

Confidence interval: 1,250.42 – 1,293.75

800 votes

Oct 28, 2026

Category: german
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,266.03 rating

Confidence interval: 1,259.87 – 1,272.18

12905 votes

Oct 28, 2026

Category: hard_prompts
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,292.96 rating

Confidence interval: 1,284.79 – 1,301.13

5736 votes

Oct 28, 2026

Category: hard_prompts_english
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,256.60 rating

Confidence interval: 1,247.59 – 1,265.61

4924 votes

Oct 28, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,242.09 rating

Confidence interval: 1,233.60 – 1,250.59

5281 votes

Oct 28, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,284.71 rating

Confidence interval: 1,270.89 – 1,298.53

1977 votes

Oct 28, 2026

Category: industry_legal_and_government
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,277.88 rating

Confidence interval: 1,268.91 – 1,286.85

4980 votes

Oct 28, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.63 rating

Confidence interval: 1,271.89 – 1,299.36

1802 votes

Oct 28, 2026

Category: industry_mathematical
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,275.13 rating

Confidence interval: 1,260.42 – 1,289.85

1818 votes

Oct 28, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.58 rating

Confidence interval: 1,278.77 – 1,292.39

9505 votes

Oct 28, 2026

Category: industry_software_and_it_services
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,268.46 rating

Confidence interval: 1,260.76 – 1,276.16

6703 votes

Oct 28, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,247.62 rating

Confidence interval: 1,240.31 – 1,254.93

7480 votes

Oct 28, 2026

Category: instruction_following
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,206.52 rating

Confidence interval: 1,184.21 – 1,228.83

764 votes

Oct 28, 2026

Category: japanese
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,206.83 rating

Confidence interval: 1,181.66 – 1,232.01

650 votes

Oct 28, 2026

Category: korean
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,264.82 rating

Confidence interval: 1,256.52 – 1,273.12

5811 votes

Oct 28, 2026

Category: longer_query
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,286.82 rating

Confidence interval: 1,273.60 – 1,300.04

1942 votes

Oct 28, 2026

Category: math
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,279.88 rating

Confidence interval: 1,271.16 – 1,288.60

5231 votes

Oct 28, 2026

Category: multi_turn
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,252.21 rating

Confidence interval: 1,246.50 – 1,257.92

16773 votes

Oct 28, 2026

Category: non_english
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,279.14 rating

Confidence interval: 1,274.43 – 1,283.85

29823 votes

Oct 28, 2026

Category: overall
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / polishhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,264.80 rating

Confidence interval: 1,251.84 – 1,277.77

2468 votes

Oct 28, 2026

Category: polish
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,262.70 rating

Confidence interval: 1,250.39 – 1,275.02

2273 votes

Oct 28, 2026

Category: russian
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-28 · rating

Llama-4-Scout-17B-16E-Instruct

1,277.85 rating

Confidence interval: 1,254.05 – 1,301.65

710 votes

Oct 28, 2026

Category: spanish
Evaluated configuration: Llama 4 Scout 17B 16E Instruct
Evaluation type: human preference

Arena text preference / chinesehuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,254.46 rating

Confidence interval: 1,240.51 – 1,268.41

2082 votes

Oct 15, 2026

Category: chinese
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.86 rating

Confidence interval: 1,277.34 – 1,294.39

5227 votes

Oct 15, 2026

Category: coding
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,248.66 rating

Confidence interval: 1,238.66 – 1,258.66

3760 votes

Oct 15, 2026

Category: creative_writing
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,304.23 rating

Confidence interval: 1,298.19 – 1,310.27

13040 votes

Oct 15, 2026

Category: english
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,207.91 rating

Confidence interval: 1,201.31 – 1,214.51

21405 votes

Oct 15, 2026

Category: exclude_ties
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,235.07 rating

Confidence interval: 1,219.46 – 1,250.69

1535 votes

Oct 15, 2026

Category: expert
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,282.37 rating

Confidence interval: 1,252.74 – 1,311.99

427 votes

Oct 15, 2026

Category: french
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,272.65 rating

Confidence interval: 1,250.95 – 1,294.34

797 votes

Oct 15, 2026

Category: german
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,266.03 rating

Confidence interval: 1,259.88 – 1,272.19

12901 votes

Oct 15, 2026

Category: hard_prompts
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,292.95 rating

Confidence interval: 1,284.77 – 1,301.12

5735 votes

Oct 15, 2026

Category: hard_prompts_english
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,256.77 rating

Confidence interval: 1,247.76 – 1,265.79

4922 votes

Oct 15, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,242.08 rating

Confidence interval: 1,233.58 – 1,250.57

5278 votes

Oct 15, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,284.35 rating

Confidence interval: 1,270.53 – 1,298.18

1978 votes

Oct 15, 2026

Category: industry_legal_and_government
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,277.94 rating

Confidence interval: 1,268.97 – 1,286.91

4979 votes

Oct 15, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.54 rating

Confidence interval: 1,271.81 – 1,299.26

1804 votes

Oct 15, 2026

Category: industry_mathematical
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,275.05 rating

Confidence interval: 1,260.33 – 1,289.78

1816 votes

Oct 15, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,285.68 rating

Confidence interval: 1,278.86 – 1,292.49

9503 votes

Oct 15, 2026

Category: industry_software_and_it_services
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,268.59 rating

Confidence interval: 1,260.89 – 1,276.29

6706 votes

Oct 15, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,247.62 rating

Confidence interval: 1,240.31 – 1,254.93

7477 votes

Oct 15, 2026

Category: instruction_following
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,206.35 rating

Confidence interval: 1,184.06 – 1,228.64

764 votes

Oct 15, 2026

Category: japanese
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,206.93 rating

Confidence interval: 1,181.75 – 1,232.11

650 votes

Oct 15, 2026

Category: korean
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,264.85 rating

Confidence interval: 1,256.54 – 1,273.15

5809 votes

Oct 15, 2026

Category: longer_query
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,286.85 rating

Confidence interval: 1,273.63 – 1,300.07

1942 votes

Oct 15, 2026

Category: math
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,280.28 rating

Confidence interval: 1,271.56 – 1,289.00

5230 votes

Oct 15, 2026

Category: multi_turn
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,252.29 rating

Confidence interval: 1,246.58 – 1,257.99

16775 votes

Oct 15, 2026

Category: non_english
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,279.16 rating

Confidence interval: 1,274.45 – 1,283.87

29826 votes

Oct 15, 2026

Category: overall
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / polishhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,264.88 rating

Confidence interval: 1,251.92 – 1,277.85

2468 votes

Oct 15, 2026

Category: polish
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,262.87 rating

Confidence interval: 1,250.56 – 1,275.18

2274 votes

Oct 15, 2026

Category: russian
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-15 · rating

Llama-4-Scout-17B-16E-Instruct

1,277.76 rating

Confidence interval: 1,253.95 – 1,301.57

710 votes

Oct 15, 2026

Category: spanish
Evaluated configuration: llama-4-scout-17b-16e-instruct
Evaluation type: human preference

Run it locally

Inference · memory estimate

Llama-4-Scout-17B-16E-Instruct

202.4 GiB checkpoint tensor payload · 108.64 B stored tensor elements · BF16

Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.

Capabilities

Open weights: Yes
Model license: other
Checkpoint tensor payload: 202.36 GiB

Input modalities

text
image

Output modalities

text