GeekRadar / The comparison desk
COMPARE.
AI models
Not reported

Tulu 2 DPO 70B

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Tulu 2 DPO 70B 1121.0 Tulu 2 DPO 70B · 95% interval 1111.3–1130.7 · 6,535 votes · 2026-11-06

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,013.56 rating

Confidence interval: 978.10 – 1,049.03

274 votes

Category
chinese
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,115.92 rating

Confidence interval: 1,095.00 – 1,136.83

805 votes

Category
coding
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,104.66 rating

Confidence interval: 1,085.48 – 1,123.84

1126 votes

Category
creative_writing
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,149.97 rating

Confidence interval: 1,139.24 – 1,160.69

5039 votes

Category
english
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

962.66 rating

Confidence interval: 948.86 – 976.45

4397 votes

Category
exclude_ties
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,104.18 rating

Confidence interval: 1,088.10 – 1,120.26

1419 votes

Category
hard_prompts
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,124.12 rating

Confidence interval: 1,106.79 – 1,141.46

1200 votes

Category
hard_prompts_english
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,077.23 rating

Confidence interval: 1,052.03 – 1,102.42

540 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,115.52 rating

Confidence interval: 1,095.62 – 1,135.43

989 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,135.69 rating

Confidence interval: 1,105.63 – 1,165.74

377 votes

Category
industry_legal_and_government
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,104.84 rating

Confidence interval: 1,086.23 – 1,123.45

1112 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,099.01 rating

Confidence interval: 1,078.61 – 1,119.42

751 votes

Category
industry_mathematical
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,059.86 rating

Confidence interval: 1,028.40 – 1,091.32

348 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,109.97 rating

Confidence interval: 1,093.51 – 1,126.43

1495 votes

Category
industry_software_and_it_services
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,123.25 rating

Confidence interval: 1,106.59 – 1,139.91

1547 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,110.21 rating

Confidence interval: 1,095.68 – 1,124.73

2008 votes

Category
instruction_following
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,105.63 rating

Confidence interval: 1,073.09 – 1,138.17

280 votes

Category
longer_query
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,107.25 rating

Confidence interval: 1,088.36 – 1,126.14

888 votes

Category
math
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,085.36 rating

Confidence interval: 1,064.25 – 1,106.47

827 votes

Category
multi_turn
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,067.77 rating

Confidence interval: 1,051.61 – 1,083.93

1496 votes

Category
non_english
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-11-06 · rating

Tulu 2 DPO 70B

1,121.00 rating

Confidence interval: 1,111.31 – 1,130.68

6535 votes

Category
overall
Evaluated configuration
Tulu 2 DPO 70B
Evaluation type
human preference

Run it locally

Inference · memory estimate

Tulu 2 DPO 70B

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
AI2 ImpACT Low-risk