GeekRadar / The comparison desk

COMPARE.

AI models

Not reported

Yi Lightning

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Yi Lightning 1301.5 Yi Lightning · 95% interval 1296.6–1306.4 · 27,332 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Yi Lightning

1,319.80 rating

Confidence interval: 1,307.45 – 1,332.14

2736 votes

Oct 28, 2026

Category: chinese
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-28 · rating

Yi Lightning

1,312.08 rating

Confidence interval: 1,302.47 – 1,321.69

4316 votes

Oct 28, 2026

Category: coding
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Yi Lightning

1,279.78 rating

Confidence interval: 1,269.40 – 1,290.16

3781 votes

Oct 28, 2026

Category: creative_writing
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-28 · rating

Yi Lightning

1,329.74 rating

Confidence interval: 1,323.22 – 1,336.26

13650 votes

Oct 28, 2026

Category: english
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Yi Lightning

1,241.14 rating

Confidence interval: 1,233.60 – 1,248.68

17462 votes

Oct 28, 2026

Category: exclude_ties
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-28 · rating

Yi Lightning

1,285.29 rating

Confidence interval: 1,270.70 – 1,299.87

1533 votes

Oct 28, 2026

Category: expert
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-28 · rating

Yi Lightning

1,305.64 rating

Confidence interval: 1,268.76 – 1,342.52

270 votes

Oct 28, 2026

Category: french
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-28 · rating

Yi Lightning

1,266.74 rating

Confidence interval: 1,244.83 – 1,288.65

700 votes

Oct 28, 2026

Category: german
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Yi Lightning

1,302.01 rating

Confidence interval: 1,294.09 – 1,309.93

6961 votes

Oct 28, 2026

Category: hard_prompts
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Yi Lightning

1,322.03 rating

Confidence interval: 1,312.25 – 1,331.82

3939 votes

Oct 28, 2026

Category: hard_prompts_english
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Yi Lightning

1,271.09 rating

Confidence interval: 1,260.06 – 1,282.12

3420 votes

Oct 28, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Yi Lightning

1,272.13 rating

Confidence interval: 1,262.03 – 1,282.23

3980 votes

Oct 28, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Yi Lightning

1,327.86 rating

Confidence interval: 1,312.98 – 1,342.75

1697 votes

Oct 28, 2026

Category: industry_legal_and_government
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Yi Lightning

1,315.46 rating

Confidence interval: 1,305.85 – 1,325.08

4822 votes

Oct 28, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Yi Lightning

1,306.37 rating

Confidence interval: 1,295.83 – 1,316.92

3206 votes

Oct 28, 2026

Category: industry_mathematical
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Yi Lightning

1,306.00 rating

Confidence interval: 1,289.88 – 1,322.13

1451 votes

Oct 28, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Yi Lightning

1,313.80 rating

Confidence interval: 1,305.61 – 1,321.98

7070 votes

Oct 28, 2026

Category: industry_software_and_it_services
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Yi Lightning

1,276.24 rating

Confidence interval: 1,268.05 – 1,284.43

7632 votes

Oct 28, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Yi Lightning

1,278.15 rating

Confidence interval: 1,271.25 – 1,285.04

10932 votes

Oct 28, 2026

Category: instruction_following
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-28 · rating

Yi Lightning

1,228.15 rating

Confidence interval: 1,203.79 – 1,252.51

565 votes

Oct 28, 2026

Category: japanese
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-28 · rating

Yi Lightning

1,192.38 rating

Confidence interval: 1,161.29 – 1,223.46

425 votes

Oct 28, 2026

Category: korean
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Yi Lightning

1,296.58 rating

Confidence interval: 1,286.09 – 1,307.07

3634 votes

Oct 28, 2026

Category: longer_query
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-28 · rating

Yi Lightning

1,299.64 rating

Confidence interval: 1,289.82 – 1,309.45

3921 votes

Oct 28, 2026

Category: math
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Yi Lightning

1,311.10 rating

Confidence interval: 1,301.22 – 1,320.98

4748 votes

Oct 28, 2026

Category: multi_turn
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Yi Lightning

1,268.92 rating

Confidence interval: 1,262.47 – 1,275.36

13682 votes

Oct 28, 2026

Category: non_english
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-28 · rating

Yi Lightning

1,301.51 rating

Confidence interval: 1,296.61 – 1,306.41

27332 votes

Oct 28, 2026

Category: overall
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-28 · rating

Yi Lightning

1,254.93 rating

Confidence interval: 1,244.97 – 1,264.89

4189 votes

Oct 28, 2026

Category: russian
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-28 · rating

Yi Lightning

1,315.41 rating

Confidence interval: 1,283.55 – 1,347.28

341 votes

Oct 28, 2026

Category: spanish
Evaluated configuration: Yi Lightning
Evaluation type: human preference

Run it locally

Inference · memory estimate

Yi Lightning

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license: Proprietary