LLM Stats leaderboard
111 scores · 111 models · first recorded Oct 3, 2026
higher is better · scale 0–1 · record SWE-Bench Verified
Best reported score
95%Claude Fable 5 · LLM Stats leaderboard
117 models tested · 2 sources · 20 source documents · latest report Aug 11, 2026
SWE-bench: Can Language Models Resolve Real-world Github Issues?
Scores stay separate per source — never merged into one cross-source ranking.
111 scores · 111 models · first recorded Oct 3, 2026
higher is better · scale 0–1 · record SWE-Bench Verified
Showing the top 50 of 111 standings — the complete set ships through the public API.
| Model | Value (%) | Reported | Score type | Recorded |
|---|---|---|---|---|
| MAI-Code-1.1-Flash | 72.6% | Aug 11, 2026 | unspecified | Oct 3, 2026 |
| Nemotron 3.5 Lightning (30B A3B) | 51.6% | Aug 11, 2026 | unspecified | Oct 3, 2026 |
| Muse Glimmer-30B | 76% | Aug 10, 2026 | unspecified | Oct 3, 2026 |
| Solar Pro 4 | 70.6% | Aug 6, 2026 | unspecified | Oct 3, 2026 |
| Inkling-Small | 80.2% | Jul 30, 2026 | unspecified | Oct 3, 2026 |
| Hy3 | 78% | Jul 6, 2026 | unspecified | Oct 3, 2026 |
| Laguna XS 2.1 | 70.9% | Jul 2, 2026 | unspecified | Oct 3, 2026 |
| Claude Sonnet 5 | 85.2% | Jun 30, 2026 | unspecified | Oct 3, 2026 |
| Claude Fable 5 | 95% | Jun 9, 2026 | unspecified | Oct 3, 2026 |
| North Mini Code 1.0 | 67.6% | Jun 9, 2026 | unspecified | Oct 3, 2026 |
| Nemotron 3 Ultra (550B A55B) | 70.7% | Jun 4, 2026 | unspecified | Oct 3, 2026 |
| MAI-Thinking-1 | 73.5% | Jun 2, 2026 | unspecified | Oct 3, 2026 |
| MAI-Code-1-Flash | 71.6% | Jun 2, 2026 | unspecified | Oct 3, 2026 |
| MiniMax M3 | 80.5% | Jun 1, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.7-Plus | 77.7% | May 31, 2026 | unspecified | Oct 3, 2026 |
| Claude Opus 4.8 | 88.6% | May 28, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.7 Max | 80.4% | May 19, 2026 | unspecified | Oct 3, 2026 |
| Mistral Medium 3.5 | 77.6% | Apr 29, 2026 | unspecified | Oct 3, 2026 |
| MiMo-V2.5-Pro | 78.9% | Apr 27, 2026 | unspecified | Oct 3, 2026 |
| DeepSeek-V4-Pro-Max | 80.6% | Apr 23, 2026 | unspecified | Oct 3, 2026 |
| DeepSeek-V4-Flash-Max | 79% | Apr 23, 2026 | unspecified | Oct 3, 2026 |
| DeepSeek-V4-Flash-0423 | 78.6% | Apr 23, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.6-27B | 77.2% | Apr 21, 2026 | unspecified | Oct 3, 2026 |
| Kimi K2.6 | 80.2% | Apr 20, 2026 | unspecified | Oct 3, 2026 |
| Claude Opus 4.7 | 87.6% | Apr 16, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.6-35B-A3B | 73.4% | Apr 16, 2026 | unspecified | Oct 3, 2026 |
| Muse Spark | 77.4% | Apr 8, 2026 | unspecified | Oct 3, 2026 |
| Claude Mythos Preview | 93.9% | Apr 7, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.6 Plus | 78.8% | Apr 2, 2026 | unspecified | Oct 3, 2026 |
| MiMo-V2-Pro | 78% | Mar 18, 2026 | unspecified | Oct 3, 2026 |
| MiMo-V2-Omni | 74.8% | Mar 18, 2026 | unspecified | Oct 3, 2026 |
| Nemotron 3 Super (120B A12B) | 53.7% | Mar 11, 2026 | unspecified | Oct 3, 2026 |
| Sarvam-105B | 45% | Mar 6, 2026 | unspecified | Oct 3, 2026 |
| Sarvam-30B | 34% | Mar 6, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.5-27B | 72.4% | Feb 24, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.5-122B-A10B | 72% | Feb 24, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.5-35B-A3B | 69.2% | Feb 24, 2026 | unspecified | Oct 3, 2026 |
| Gemini 3.1 Pro | 80.6% | Feb 19, 2026 | unspecified | Oct 3, 2026 |
| Claude Sonnet 4.6 | 79.6% | Feb 17, 2026 | unspecified | Oct 3, 2026 |
| Qwen3.5-397B-A17B | 76.4% | Feb 16, 2026 | unspecified | Oct 3, 2026 |
| Seed 2.0 Pro | 76.5% | Feb 14, 2026 | unspecified | Oct 3, 2026 |
| Seed 2.0 Lite | 73.5% | Feb 14, 2026 | unspecified | Oct 3, 2026 |
| MiniMax M2.5 | 80.2% | Feb 12, 2026 | unspecified | Oct 3, 2026 |
| GLM-5 | 77.8% | Feb 11, 2026 | unspecified | Oct 3, 2026 |
| Claude Opus 4.6 | 80.8% | Feb 5, 2026 | unspecified | Oct 3, 2026 |
| LongCat-Flash-Lite | 54.4% | Feb 5, 2026 | unspecified | Oct 3, 2026 |
| Step-3.5-Flash | 74.4% | Feb 2, 2026 | unspecified | Oct 3, 2026 |
| Kimi K2.5 | 76.8% | Jan 27, 2026 | unspecified | Oct 3, 2026 |
| GLM-4.7-Flash | 59.2% | Jan 19, 2026 | unspecified | Oct 3, 2026 |
| LongCat-Flash-Thinking-2601 | 70% | Jan 14, 2026 | unspecified | Oct 3, 2026 |
| MiniMax M2.1 | 67% | Dec 23, 2025 | unspecified | Oct 3, 2026 |
| GLM-4.7 | 73.8% | Dec 22, 2025 | unspecified | Oct 3, 2026 |
| Gemini 3 Flash | 78% | Dec 17, 2025 | unspecified | Oct 3, 2026 |
| MiMo-V2-Flash | 73.4% | Dec 16, 2025 | unspecified | Oct 3, 2026 |
| Qwen3 Max | 69.6% | Dec 15, 2025 | unspecified | Oct 3, 2026 |
| Nemotron 3 Nano (30B A3B) | 38.8% | Dec 15, 2025 | unspecified | Oct 3, 2026 |
| GPT-5.2 | 80% | Dec 11, 2025 | unspecified | Oct 3, 2026 |
| Nova 2 Pro | 70% | Dec 2, 2025 | unspecified | Oct 3, 2026 |
| Nova 2 Lite | 64.5% | Dec 2, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3.2-Speciale | 73.1% | Dec 1, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3.2 | 73.1% | Dec 1, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3.2 (Thinking) | 73.1% | Dec 1, 2025 | unspecified | Oct 3, 2026 |
| Claude Opus 4.5 | 80.9% | Nov 24, 2025 | unspecified | Oct 3, 2026 |
| GPT-5.1 Codex | 73.7% | Nov 19, 2025 | unspecified | Oct 3, 2026 |
| Gemini 3 Pro | 76.2% | Nov 18, 2025 | unspecified | Oct 3, 2026 |
| GPT-5.1 | 76.3% | Nov 13, 2025 | unspecified | Oct 3, 2026 |
| GPT-5.1 Instant | 76.3% | Nov 12, 2025 | unspecified | Oct 3, 2026 |
| GPT-5.1 Thinking | 76.3% | Nov 12, 2025 | unspecified | Oct 3, 2026 |
| MiniMax M2 | 69.4% | Oct 27, 2025 | unspecified | Oct 3, 2026 |
| Claude Haiku 4.5 | 73.3% | Oct 15, 2025 | unspecified | Oct 3, 2026 |
| GLM-4.6 | 68% | Sep 30, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3.2-Exp | 67.8% | Sep 29, 2025 | unspecified | Oct 3, 2026 |
| LongCat-Flash-Thinking | 59.4% | Sep 22, 2025 | unspecified | Oct 3, 2026 |
| GPT-5 Codex | 74.5% | Sep 15, 2025 | unspecified | Oct 3, 2026 |
| Kimi K2-Thinking-0905 | 71.3% | Sep 5, 2025 | unspecified | Oct 3, 2026 |
| Kimi K2-Instruct-0905 | 65.8% | Sep 5, 2025 | unspecified | Oct 3, 2026 |
| LongCat-Flash-Chat | 60.4% | Aug 29, 2025 | unspecified | Oct 3, 2026 |
| Grok Code Fast 1 | 70.8% | Aug 28, 2025 | unspecified | Oct 3, 2026 |
| GPT-5 | 74.9% | Aug 7, 2025 | unspecified | Oct 3, 2026 |
| Claude Opus 4.1 | 74.5% | Aug 5, 2025 | unspecified | Oct 3, 2026 |
| GLM-4.5 | 64.2% | Jul 28, 2025 | unspecified | Oct 3, 2026 |
| GLM-4.5-Air | 57.6% | Jul 28, 2025 | unspecified | Oct 3, 2026 |
| Devstral Small 1.1 | 53.6% | Jul 11, 2025 | unspecified | Oct 3, 2026 |
| Devstral Medium | 61.6% | Jul 10, 2025 | unspecified | Oct 3, 2026 |
| Gemini 2.5 Flash-Lite | 31.6% | Jun 17, 2025 | unspecified | Oct 3, 2026 |
| MiniMax M1 80K | 56.0% | Jun 16, 2025 | unspecified | Oct 3, 2026 |
| MiniMax M1 40K | 55.6% | Jun 16, 2025 | unspecified | Oct 3, 2026 |
| Gemini 2.5 Pro Preview 06-05 | 67.2% | Jun 5, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-R1-0528 | 44.6% | May 28, 2025 | unspecified | Oct 3, 2026 |
| Claude Sonnet 4 | 72.7% | May 22, 2025 | unspecified | Oct 3, 2026 |
| Claude Opus 4 | 72.5% | May 22, 2025 | unspecified | Oct 3, 2026 |
| Gemini 2.5 Pro | 63.2% | May 20, 2025 | unspecified | Oct 3, 2026 |
| Gemini 2.5 Flash | 60.4% | May 20, 2025 | unspecified | Oct 3, 2026 |
| Gemini Diffusion | 22.9% | May 20, 2025 | unspecified | Oct 3, 2026 |
| o3 | 69.1% | Apr 16, 2025 | unspecified | Oct 3, 2026 |
| o4-mini | 68.1% | Apr 16, 2025 | unspecified | Oct 3, 2026 |
| GPT-4.1 | 54.6% | Apr 14, 2025 | unspecified | Oct 3, 2026 |
| GPT-4.1 mini | 23.6% | Apr 14, 2025 | unspecified | Oct 3, 2026 |
| GPT-4.5 | 38% | Feb 27, 2025 | unspecified | Oct 3, 2026 |
| Claude 3.7 Sonnet | 70.3% | Feb 24, 2025 | unspecified | Oct 3, 2026 |
| Qwen3-Coder 480B A35B Instruct | 69.6% | Jan 31, 2025 | unspecified | Oct 3, 2026 |
| o3-mini | 49.3% | Jan 30, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3.1 | 66% | Jan 10, 2025 | unspecified | Oct 3, 2026 |
| DeepSeek-V3 | 42% | Dec 25, 2024 | unspecified | Oct 3, 2026 |
| o1 | 41% | Dec 17, 2024 | unspecified | Oct 3, 2026 |
| Claude 3.5 Sonnet | 49% | Oct 22, 2024 | unspecified | Oct 3, 2026 |
| Claude 3.5 Haiku | 40.6% | Oct 22, 2024 | unspecified | Oct 3, 2026 |
| o1-preview | 41.3% | Sep 12, 2024 | unspecified | Oct 3, 2026 |
| GPT-4o | 33.2% | Aug 6, 2024 | unspecified | Oct 3, 2026 |
| GPT-4o mini | 8.70% | Jul 18, 2024 | unspecified | Oct 3, 2026 |
| DeepSeek-V2.5 | 16.8% | May 8, 2024 | unspecified | Oct 3, 2026 |
18 scores · 14 models · first recorded Oct 3, 2026
higher is better · resolved · scale 0–100 · record SWE-bench Verified
| Model | Value (%) | Subset / variant | Test conditions | Reported by | Reported | Document |
|---|---|---|---|---|---|---|
| Claude Opus 5 | 96% | swe_bench_verified | adaptive thinking, max effort, averaged over 5 trials | Anthropic | Jul 24, 2026 | anthropic_claude_opus_5_system_card |
| DeepSeek-V4-Pro | 80.6% | swe_bench_verified | think max, resolved | DeepSeek | Apr 22, 2026 | deepseek_v4_model_card |
| Gemini 3.1 Pro | 80.6% | swe_bench_verified | Thinking (High), Single attempt | Feb 19, 2026 | google_gemini_3_1_pro_model_card | |
| DeepSeek-V4-Flash | 79% | swe_bench_verified | think max, resolved | DeepSeek | Jun 25, 2026 | deepseek_v4_technical_report |
| GLM-5 | 77.8% | swe_bench_verified | OpenHands, tailored instruction prompt, temp 0.7, top_p 0.95, 200K context | Z.ai | Feb 11, 2026 | zai_glm_5_model_card |
| Seed2.0 Pro | 76.5% | swe_bench_verified | as printed in Table 11 (Large Models) | ByteDance | Feb 14, 2026 | bytedance_seed2_0_model_card |
| Qwen3.5-397B-A17B | 76.4% | swe_bench_verified | thinking (temp 0.6, top_p 0.95, top_k 20) | Qwen | Feb 16, 2026 | qwen3_5_model_card |
| Seed2.0 Lite | 73.5% | swe_bench_verified | as printed in Table 12 (Efficient Models) | ByteDance | Feb 14, 2026 | bytedance_seed2_0_model_card |
| Claude Sonnet 4 | 72.7% | swe_bench_verified | no extended thinking | Anthropic | May 22, 2025 | anthropic_claude_4_system_card |
| Claude Opus 4 | 72.5% | swe_bench_verified | no extended thinking | Anthropic | May 22, 2025 | anthropic_claude_4_system_card |
| Model | Value (%) | Reported | Score type | Recorded |
|---|---|---|---|---|
| Claude Opus 5 | 96% | Jul 24, 2026 | self-reported | Oct 3, 2026 |
| DeepSeek-V4-Flash | 79% | Jun 25, 2026 | self-reported | Oct 3, 2026 |
| DeepSeek-V4-Pro | 73.6% | Apr 22, 2026 | self-reported | Oct 3, 2026 |
| DeepSeek-V4-Pro | 79.4% | Apr 22, 2026 |
every document that defines or reports scores
| tech report | DeepSeek | DeepSeek-V3Dec 27, 2024 |
| other | Z.ai | GLM-5Feb 11, 2026 |
| system card | Anthropic | Claude 3.7 SonnetFeb 24, 2025 |
| tech report | Z.ai | GLM-5Feb 11, 2026 |
| system card | Anthropic | Claude Opus 4 and Sonnet 4May 22, 2025 |
| system card | Anthropic | Claude Opus 5Jul 24, 2026 |
| other | ByteDance | Seed2.0 (Pro / Lite / Mini)Feb 14, 2026 |
| other | DeepSeek | DeepSeek-V4-ProApr 22, 2026 |
| tech report | DeepSeek | DeepSeek-V4Jun 25, 2026 |
| tech report | Gemini 2.5 ProJun 17, 2025 | |
| other | Gemini 3.1 ProFeb 19, 2026 | |
| release post | OpenAI | GPT-4.1Apr 14, 2025 |
| release post | OpenAI | GPT-5.6Jun 26, 2026 |
| system card | OpenAI | GPT-5Aug 7, 2025 |
| other | – | SWE-Bench Verified– |
| system card | OpenAI | o3 and o4-miniApr 16, 2025 |
| tech report | DeepSeek | DeepSeek-R1Jan 22, 2025 |
| other | Qwen | Qwen3.5-397B-A17BFeb 16, 2026 |
| other | xAI | Grok 4Jul 9, 2025 |
| other | Moonshot AI | Kimi K3Jun 13, 2026 |
Records are located via the tracking corpus (ktwu01/benchmark-radar live dataset). Every row cites its source document.
| self-reported |
| Oct 3, 2026 |
| DeepSeek-V4-Pro | 80.6% | Apr 22, 2026 | self-reported | Oct 3, 2026 |
| Gemini 3.1 Pro | 80.6% | Feb 19, 2026 | self-reported | Oct 3, 2026 |
| Qwen3.5-397B-A17B | 76.4% | Feb 16, 2026 | self-reported | Oct 3, 2026 |
| Seed2.0 Pro | 76.5% | Feb 14, 2026 | self-reported | Oct 3, 2026 |
| Seed2.0 Lite | 73.5% | Feb 14, 2026 | self-reported | Oct 3, 2026 |
| GLM-5 | 77.8% | Feb 11, 2026 | self-reported | Oct 3, 2026 |
| Gemini 2.5 Pro | 67.2% | Jun 17, 2025 | self-reported | Oct 3, 2026 |
| Gemini 2.5 Pro | 59.6% | Jun 17, 2025 | self-reported | Oct 3, 2026 |
| Claude Opus 4 | 72.5% | May 22, 2025 | self-reported | Oct 3, 2026 |
| Claude Sonnet 4 | 72.7% | May 22, 2025 | self-reported | Oct 3, 2026 |
| Claude 3.7 Sonnet | 70.3% | Feb 24, 2025 | self-reported | Oct 3, 2026 |
| Claude 3.7 Sonnet | 63.7% | Feb 24, 2025 | self-reported | Oct 3, 2026 |
| DeepSeek-R1 | 49.2% | Jan 22, 2025 | self-reported | Oct 3, 2026 |
| DeepSeek-V3 | 42% | Dec 27, 2024 | self-reported | Oct 3, 2026 |