GeekRadar / The comparison desk

COMPARE.

AI models

microsoft

Phi-3-medium-4k-instruct

AI model

Context window: 4,096 tokens
Open weights: Yes

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Phi-3-medium-4k-instruct 1137.5 Phi-3 Medium 4K Instruct · 95% interval 1132.4–1142.6 · 25,055 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Test version

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,108.06 rating

Confidence interval: 1,095.21 – 1,120.90

2819 votes

Oct 28, 2026

Category: chinese
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,129.84 rating

Confidence interval: 1,119.67 – 1,140.02

3973 votes

Oct 28, 2026

Category: coding
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,106.17 rating

Confidence interval: 1,095.41 – 1,116.93

3735 votes

Oct 28, 2026

Category: creative_writing
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,169.26 rating

Confidence interval: 1,162.67 – 1,175.85

13283 votes

Oct 28, 2026

Category: english
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

978.43 rating

Confidence interval: 969.92 – 986.95

15851 votes

Oct 28, 2026

Category: exclude_ties
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,107.92 rating

Confidence interval: 1,090.14 – 1,125.69

1091 votes

Oct 28, 2026

Category: expert
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,110.78 rating

Confidence interval: 1,076.45 – 1,145.12

350 votes

Oct 28, 2026

Category: french
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,100.76 rating

Confidence interval: 1,079.32 – 1,122.20

851 votes

Oct 28, 2026

Category: german
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,126.44 rating

Confidence interval: 1,118.40 – 1,134.49

6823 votes

Oct 28, 2026

Category: hard_prompts
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,142.42 rating

Confidence interval: 1,132.63 – 1,152.21

4087 votes

Oct 28, 2026

Category: hard_prompts_english
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,098.68 rating

Confidence interval: 1,086.54 – 1,110.83

2847 votes

Oct 28, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,081.11 rating

Confidence interval: 1,070.66 – 1,091.56

3888 votes

Oct 28, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,130.81 rating

Confidence interval: 1,114.48 – 1,147.14

1474 votes

Oct 28, 2026

Category: industry_legal_and_government
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,137.88 rating

Confidence interval: 1,127.28 – 1,148.48

4186 votes

Oct 28, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,175.78 rating

Confidence interval: 1,164.57 – 1,186.98

2729 votes

Oct 28, 2026

Category: industry_mathematical
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,118.68 rating

Confidence interval: 1,101.48 – 1,135.88

1320 votes

Oct 28, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,133.27 rating

Confidence interval: 1,124.82 – 1,141.73

6654 votes

Oct 28, 2026

Category: industry_software_and_it_services
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,126.32 rating

Confidence interval: 1,117.73 – 1,134.91

6655 votes

Oct 28, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,113.28 rating

Confidence interval: 1,105.96 – 1,120.60

9385 votes

Oct 28, 2026

Category: instruction_following
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,042.53 rating

Confidence interval: 1,018.25 – 1,066.80

683 votes

Oct 28, 2026

Category: japanese
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

953.99 rating

Confidence interval: 928.65 – 979.33

732 votes

Oct 28, 2026

Category: korean
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,119.81 rating

Confidence interval: 1,106.89 – 1,132.74

2150 votes

Oct 28, 2026

Category: longer_query
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,173.39 rating

Confidence interval: 1,162.84 – 1,183.94

3238 votes

Oct 28, 2026

Category: math
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,087.97 rating

Confidence interval: 1,077.03 – 1,098.91

3824 votes

Oct 28, 2026

Category: multi_turn
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,093.78 rating

Confidence interval: 1,086.90 – 1,100.66

11772 votes

Oct 28, 2026

Category: non_english
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,137.53 rating

Confidence interval: 1,132.41 – 1,142.64

25055 votes

Oct 28, 2026

Category: overall
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,144.78 rating

Confidence interval: 1,133.36 – 1,156.19

2964 votes

Oct 28, 2026

Category: russian
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-28 · rating

Phi-3-medium-4k-instruct

1,095.04 rating

Confidence interval: 1,064.15 – 1,125.93

419 votes

Oct 28, 2026

Category: spanish
Evaluated configuration: Phi-3 Medium 4K Instruct
Evaluation type: human preference

Arena text preference / chinesehuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,108.10 rating

Confidence interval: 1,095.26 – 1,120.95

2819 votes

Oct 15, 2026

Category: chinese
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,129.94 rating

Confidence interval: 1,119.76 – 1,140.12

3973 votes

Oct 15, 2026

Category: coding
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,106.32 rating

Confidence interval: 1,095.56 – 1,117.08

3735 votes

Oct 15, 2026

Category: creative_writing
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,169.21 rating

Confidence interval: 1,162.62 – 1,175.80

13283 votes

Oct 15, 2026

Category: english
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

978.45 rating

Confidence interval: 969.93 – 986.96

15851 votes

Oct 15, 2026

Category: exclude_ties
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,107.96 rating

Confidence interval: 1,090.18 – 1,125.74

1091 votes

Oct 15, 2026

Category: expert
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,110.47 rating

Confidence interval: 1,076.11 – 1,144.82

350 votes

Oct 15, 2026

Category: french
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,100.76 rating

Confidence interval: 1,079.36 – 1,122.16

851 votes

Oct 15, 2026

Category: german
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,126.43 rating

Confidence interval: 1,118.39 – 1,134.48

6823 votes

Oct 15, 2026

Category: hard_prompts
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,142.31 rating

Confidence interval: 1,132.51 – 1,152.10

4087 votes

Oct 15, 2026

Category: hard_prompts_english
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,098.72 rating

Confidence interval: 1,086.57 – 1,110.87

2847 votes

Oct 15, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,081.17 rating

Confidence interval: 1,070.72 – 1,091.62

3888 votes

Oct 15, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,130.55 rating

Confidence interval: 1,114.22 – 1,146.89

1474 votes

Oct 15, 2026

Category: industry_legal_and_government
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,137.86 rating

Confidence interval: 1,127.26 – 1,148.46

4186 votes

Oct 15, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,175.77 rating

Confidence interval: 1,164.57 – 1,186.97

2729 votes

Oct 15, 2026

Category: industry_mathematical
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,118.74 rating

Confidence interval: 1,101.54 – 1,135.95

1320 votes

Oct 15, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,133.36 rating

Confidence interval: 1,124.90 – 1,141.81

6654 votes

Oct 15, 2026

Category: industry_software_and_it_services
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,126.38 rating

Confidence interval: 1,117.79 – 1,134.98

6655 votes

Oct 15, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,113.29 rating

Confidence interval: 1,105.97 – 1,120.62

9385 votes

Oct 15, 2026

Category: instruction_following
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,042.36 rating

Confidence interval: 1,018.14 – 1,066.58

683 votes

Oct 15, 2026

Category: japanese
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

954.03 rating

Confidence interval: 928.71 – 979.35

732 votes

Oct 15, 2026

Category: korean
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,119.86 rating

Confidence interval: 1,106.93 – 1,132.79

2150 votes

Oct 15, 2026

Category: longer_query
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,173.35 rating

Confidence interval: 1,162.80 – 1,183.90

3238 votes

Oct 15, 2026

Category: math
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,087.97 rating

Confidence interval: 1,077.02 – 1,098.91

3824 votes

Oct 15, 2026

Category: multi_turn
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,093.87 rating

Confidence interval: 1,086.99 – 1,100.75

11772 votes

Oct 15, 2026

Category: non_english
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,137.51 rating

Confidence interval: 1,132.39 – 1,142.63

25055 votes

Oct 15, 2026

Category: overall
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,144.93 rating

Confidence interval: 1,133.51 – 1,156.35

2964 votes

Oct 15, 2026

Category: russian
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-15 · rating

Phi-3-medium-4k-instruct

1,094.97 rating

Confidence interval: 1,064.05 – 1,125.88

419 votes

Oct 15, 2026

Category: spanish
Evaluated configuration: phi-3-medium-4k-instruct
Evaluation type: human preference

Run it locally

Inference · memory estimate

Phi-3-medium-4k-instruct

26.0 GiB checkpoint tensor payload · 13.96 B stored tensor elements · BF16

Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.

Capabilities

Context window: 4,096 tokens
Open weights: Yes
Model license: mit
Checkpoint tensor payload: 26.00 GiB

Input modalities

text

Output modalities

text

Processing & platform

Architecture: phi3