Best AI for:Complex Reasoning Mathematics Word Problems Statistics

Models tested:Amazon Nova 2 Lite Andromeda Alpha Aurora Alpha Bert-Nebulon Alpha ChatGPT-4o (March 2025)Claude 3 Haiku Claude 3 Opus Claude 3 Sonnet Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Pro Elephant Alpha ERNIE 4.5 300B A47B Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 06-17 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview (thinking)Gemini 2.5 Flash Preview 05-20 Gemini 2.5 Flash Preview 05-20 (thinking)Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Experimental Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B GLM 4.7 Flash GLM 5 Turbo Google: Gemini 2.5 Flash Lite Preview 09-2025 Google: Gemini 2.5 Flash Preview 09-2025 Google: Gemini 3.1 Flash Lite Google: Gemini 3.1 Flash Lite Preview Google: Gemma 3n 2B Google: Gemma 4 26B A4B GPT OSS 120B GPT OSS 20B GPT-1 GPT-2 GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inception: Mercury Inception: Mercury 2 INTELLECT-3 Kimi K2 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi Linear 48B A3B Instruct Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Meta: Muse Spark 1.1 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.5 MiniMax M2.7 MiniMax M3 MiniMax: MiniMax M2.1 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Mistral: Devstral 2 2512 MoonshotAI: Kimi K2 0905 MoonshotAI: Kimi K3 North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 NVIDIA: Nemotron 3 Ultra NVIDIA: Nemotron 3.5 Content Safety o1 o3 Mini OpenAI Codex Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenAI: GPT-5.6 Luna OpenAI: GPT-5.6 Luna Pro OpenAI: GPT-5.6 Sol OpenAI: GPT-5.6 Terra OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen: Qwen3 235B A22B 2507 Qwen: Qwen3 235B A22B Thinking 2507 Qwen: Qwen3 30B A3B Instruct 2507 Qwen: Qwen3 Max Qwen: Qwen3 Max Thinking Qwen: Qwen3.5 122B A10B Qwen: Qwen3.5 27B Qwen: Qwen3.5 35B A3B Qwen: Qwen3.5 397B A17B Qwen: Qwen3.5 Flash Qwen: Qwen3.5 Plus 2026-02-15 Qwen: Qwen3.5 Plus 2026-04-20 Qwen: Qwen3.6 27B Qwen: Qwen3.6 35B A3B Qwen: Qwen3.6 Flash Qwen: Qwen3.6 Max Preview Qwen: Qwen3.6 Plus Preview (free)Qwen: Qwen3.7 Max Qwen: Qwen3.7 Plus Qwen3 0.6B Qwen3 235B A22B Qwen3 30B A3B Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 9B Ring 2.6 1T Seed 2.0 Lite Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha Thinking Machines: Inkling TNG R1T Chimera Trinity Large Preview xAI: Grok 4 xAI: Grok 4 Fast (free)xAI: Grok 4.3 xAI: Grok 4.5 Z.AI: GLM 4 32B Z.AI: GLM 4.5 Z.AI: GLM 4.5 Air Z.AI: GLM 4.6 Z.AI: GLM 4.7 Z.ai: GLM 5 Z.ai: GLM 5.1 Z.ai: GLM 5.2

Top Performers: Stochastic Consistency Test

May 2024 – Jul 2026

#1Qwen: Qwen3.6 27B82% win rateHigh confidence

#2Z.AI: GLM 4.5 Air74% win rateHigh confidence

#3Qwen: Qwen3.7 Max79% win rateMed confidence

Compare top performers →

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems Statistics

Models tested:Amazon Nova 2 Lite Andromeda Alpha Aurora Alpha Bert-Nebulon Alpha ChatGPT-4o (March 2025)Claude 3 Haiku Claude 3 Opus Claude 3 Sonnet Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Pro Elephant Alpha ERNIE 4.5 300B A47B Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 06-17 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview (thinking)Gemini 2.5 Flash Preview 05-20 Gemini 2.5 Flash Preview 05-20 (thinking)Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Experimental Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B GLM 4.7 Flash GLM 5 Turbo Google: Gemini 2.5 Flash Lite Preview 09-2025 Google: Gemini 2.5 Flash Preview 09-2025 Google: Gemini 3.1 Flash Lite Google: Gemini 3.1 Flash Lite Preview Google: Gemma 3n 2B Google: Gemma 4 26B A4B GPT OSS 120B GPT OSS 20B GPT-1 GPT-2 GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inception: Mercury Inception: Mercury 2 INTELLECT-3 Kimi K2 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi Linear 48B A3B Instruct Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Meta: Muse Spark 1.1 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.5 MiniMax M2.7 MiniMax M3 MiniMax: MiniMax M2.1 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Mistral: Devstral 2 2512 MoonshotAI: Kimi K2 0905 MoonshotAI: Kimi K3 North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 NVIDIA: Nemotron 3 Ultra NVIDIA: Nemotron 3.5 Content Safety o1 o3 Mini OpenAI Codex Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenAI: GPT-5.6 Luna OpenAI: GPT-5.6 Luna Pro OpenAI: GPT-5.6 Sol OpenAI: GPT-5.6 Terra OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen: Qwen3 235B A22B 2507 Qwen: Qwen3 235B A22B Thinking 2507 Qwen: Qwen3 30B A3B Instruct 2507 Qwen: Qwen3 Max Qwen: Qwen3 Max Thinking Qwen: Qwen3.5 122B A10B Qwen: Qwen3.5 27B Qwen: Qwen3.5 35B A3B Qwen: Qwen3.5 397B A17B Qwen: Qwen3.5 Flash Qwen: Qwen3.5 Plus 2026-02-15 Qwen: Qwen3.5 Plus 2026-04-20 Qwen: Qwen3.6 27B Qwen: Qwen3.6 35B A3B Qwen: Qwen3.6 Flash Qwen: Qwen3.6 Max Preview Qwen: Qwen3.6 Plus Preview (free)Qwen: Qwen3.7 Max Qwen: Qwen3.7 Plus Qwen3 0.6B Qwen3 235B A22B Qwen3 30B A3B Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 9B Ring 2.6 1T Seed 2.0 Lite Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha Thinking Machines: Inkling TNG R1T Chimera Trinity Large Preview xAI: Grok 4 xAI: Grok 4 Fast (free)xAI: Grok 4.3 xAI: Grok 4.5 Z.AI: GLM 4 32B Z.AI: GLM 4.5 Z.AI: GLM 4.5 Air Z.AI: GLM 4.6 Z.AI: GLM 4.7 Z.ai: GLM 5 Z.ai: GLM 5.1 Z.ai: GLM 5.2

Top Performers: Stochastic Consistency Test

May 2024 – Jul 2026

#1Qwen: Qwen3.6 27B82% win rateHigh confidence

#2Z.AI: GLM 4.5 Air74% win rateHigh confidence

#3Qwen: Qwen3.7 Max79% win rateMed confidence

Compare top performers →

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems Statistics

Models tested:Amazon Nova 2 Lite Andromeda Alpha Aurora Alpha Bert-Nebulon Alpha ChatGPT-4o (March 2025)Claude 3 Haiku Claude 3 Opus Claude 3 Sonnet Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Pro Elephant Alpha ERNIE 4.5 300B A47B Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 06-17 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview (thinking)Gemini 2.5 Flash Preview 05-20 Gemini 2.5 Flash Preview 05-20 (thinking)Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Experimental Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B GLM 4.7 Flash GLM 5 Turbo Google: Gemini 2.5 Flash Lite Preview 09-2025 Google: Gemini 2.5 Flash Preview 09-2025 Google: Gemini 3.1 Flash Lite Google: Gemini 3.1 Flash Lite Preview Google: Gemma 3n 2B Google: Gemma 4 26B A4B GPT OSS 120B GPT OSS 20B GPT-1 GPT-2 GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inception: Mercury Inception: Mercury 2 INTELLECT-3 Kimi K2 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi Linear 48B A3B Instruct Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Meta: Muse Spark 1.1 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.5 MiniMax M2.7 MiniMax M3 MiniMax: MiniMax M2.1 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Mistral: Devstral 2 2512 MoonshotAI: Kimi K2 0905 MoonshotAI: Kimi K3 North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 NVIDIA: Nemotron 3 Ultra NVIDIA: Nemotron 3.5 Content Safety o1 o3 Mini OpenAI Codex Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenAI: GPT-5.6 Luna OpenAI: GPT-5.6 Luna Pro OpenAI: GPT-5.6 Sol OpenAI: GPT-5.6 Terra OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen: Qwen3 235B A22B 2507 Qwen: Qwen3 235B A22B Thinking 2507 Qwen: Qwen3 30B A3B Instruct 2507 Qwen: Qwen3 Max Qwen: Qwen3 Max Thinking Qwen: Qwen3.5 122B A10B Qwen: Qwen3.5 27B Qwen: Qwen3.5 35B A3B Qwen: Qwen3.5 397B A17B Qwen: Qwen3.5 Flash Qwen: Qwen3.5 Plus 2026-02-15 Qwen: Qwen3.5 Plus 2026-04-20 Qwen: Qwen3.6 27B Qwen: Qwen3.6 35B A3B Qwen: Qwen3.6 Flash Qwen: Qwen3.6 Max Preview Qwen: Qwen3.6 Plus Preview (free)Qwen: Qwen3.7 Max Qwen: Qwen3.7 Plus Qwen3 0.6B Qwen3 235B A22B Qwen3 30B A3B Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 9B Ring 2.6 1T Seed 2.0 Lite Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha Thinking Machines: Inkling TNG R1T Chimera Trinity Large Preview xAI: Grok 4 xAI: Grok 4 Fast (free)xAI: Grok 4.3 xAI: Grok 4.5 Z.AI: GLM 4 32B Z.AI: GLM 4.5 Z.AI: GLM 4.5 Air Z.AI: GLM 4.6 Z.AI: GLM 4.7 Z.ai: GLM 5 Z.ai: GLM 5.1 Z.ai: GLM 5.2

Top Performers: Stochastic Consistency Test

May 2024 – Jul 2026

#1Qwen: Qwen3.6 27B82% win rateHigh confidence

#2Z.AI: GLM 4.5 Air74% win rateHigh confidence

#3Qwen: Qwen3.7 Max79% win rateMed confidence

Compare top performers →

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Back to Challenges

MediumAnalysis

Stochastic Consistency Test

Tests an AI's randomness and creativity

The Prompt

Generate 5 jokes. How many are unique?

How the models did

221 found

Andromeda AlphaStochastic Consistency Test

Andromeda Alpha

The model returned empty.

Oct 2025·Stochastic Consistency Test~$0.0015

Aurora AlphaStochastic Consistency Test

Aurora Alpha

The model returned empty.

Feb 2026·Stochastic Consistency Test~$0.0020

Bert-Nebulon AlphaStochastic Consistency Test

Bert-Nebulon Alpha

The model returned empty.

Nov 2025·Stochastic Consistency Test14

ChatGPT-4o (March 2025)stochastic-consistency

ChatGPT-4o (March 2025)

The model returned empty.

Mar 2025·stochastic-consistency~$0.0000529

Claude 3 HaikuStochastic Consistency Test

Claude 3 Haiku

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.000002539

Notable Fail·Self-Contradiction

Claude 3 OpusStochastic Consistency Test

Claude 3 Opus

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.0001543

Epic Fail·Self-Contradiction

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems Statistics

Models tested:Amazon Nova 2 Lite Andromeda Alpha Aurora Alpha Bert-Nebulon Alpha ChatGPT-4o (March 2025)Claude 3 Haiku Claude 3 Opus Claude 3 Sonnet Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Pro Elephant Alpha ERNIE 4.5 300B A47B Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 06-17 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview (thinking)Gemini 2.5 Flash Preview 05-20 Gemini 2.5 Flash Preview 05-20 (thinking)Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Experimental Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B GLM 4.7 Flash GLM 5 Turbo Google: Gemini 2.5 Flash Lite Preview 09-2025 Google: Gemini 2.5 Flash Preview 09-2025 Google: Gemini 3.1 Flash Lite Google: Gemini 3.1 Flash Lite Preview Google: Gemma 3n 2B Google: Gemma 4 26B A4B GPT OSS 120B GPT OSS 20B GPT-1 GPT-2 GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inception: Mercury Inception: Mercury 2 INTELLECT-3 Kimi K2 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi Linear 48B A3B Instruct Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Meta: Muse Spark 1.1 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.5 MiniMax M2.7 MiniMax M3 MiniMax: MiniMax M2.1 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Mistral: Devstral 2 2512 MoonshotAI: Kimi K2 0905 MoonshotAI: Kimi K3 North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 NVIDIA: Nemotron 3 Ultra NVIDIA: Nemotron 3.5 Content Safety o1 o3 Mini OpenAI Codex Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenAI: GPT-5.6 Luna OpenAI: GPT-5.6 Luna Pro OpenAI: GPT-5.6 Sol OpenAI: GPT-5.6 Terra OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen: Qwen3 235B A22B 2507 Qwen: Qwen3 235B A22B Thinking 2507 Qwen: Qwen3 30B A3B Instruct 2507 Qwen: Qwen3 Max Qwen: Qwen3 Max Thinking Qwen: Qwen3.5 122B A10B Qwen: Qwen3.5 27B Qwen: Qwen3.5 35B A3B Qwen: Qwen3.5 397B A17B Qwen: Qwen3.5 Flash Qwen: Qwen3.5 Plus 2026-02-15 Qwen: Qwen3.5 Plus 2026-04-20 Qwen: Qwen3.6 27B Qwen: Qwen3.6 35B A3B Qwen: Qwen3.6 Flash Qwen: Qwen3.6 Max Preview Qwen: Qwen3.6 Plus Preview (free)Qwen: Qwen3.7 Max Qwen: Qwen3.7 Plus Qwen3 0.6B Qwen3 235B A22B Qwen3 30B A3B Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 9B Ring 2.6 1T Seed 2.0 Lite Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha Thinking Machines: Inkling TNG R1T Chimera Trinity Large Preview xAI: Grok 4 xAI: Grok 4 Fast (free)xAI: Grok 4.3 xAI: Grok 4.5 Z.AI: GLM 4 32B Z.AI: GLM 4.5 Z.AI: GLM 4.5 Air Z.AI: GLM 4.6 Z.AI: GLM 4.7 Z.ai: GLM 5 Z.ai: GLM 5.1 Z.ai: GLM 5.2

Top Performers: Stochastic Consistency Test

May 2024 – Jul 2026

#1Qwen: Qwen3.6 27B82% win rateHigh confidence

#2Z.AI: GLM 4.5 Air74% win rateHigh confidence

#3Qwen: Qwen3.7 Max79% win rateMed confidence

Compare top performers →

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Back to Challenges

MediumAnalysis

Stochastic Consistency Test

Tests an AI's randomness and creativity

The Prompt

Generate 5 jokes. How many are unique?

How the models did

221 found

Andromeda AlphaStochastic Consistency Test

Andromeda Alpha

The model returned empty.

Oct 2025·Stochastic Consistency Test~$0.0015

Aurora AlphaStochastic Consistency Test

Aurora Alpha

The model returned empty.

Feb 2026·Stochastic Consistency Test~$0.0020

Bert-Nebulon AlphaStochastic Consistency Test

Bert-Nebulon Alpha

The model returned empty.

Nov 2025·Stochastic Consistency Test14

ChatGPT-4o (March 2025)stochastic-consistency

ChatGPT-4o (March 2025)

The model returned empty.

Mar 2025·stochastic-consistency~$0.0000529

Claude 3 HaikuStochastic Consistency Test

Claude 3 Haiku

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.000002539

Notable Fail·Self-Contradiction

Claude 3 OpusStochastic Consistency Test

Claude 3 Opus

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.0001543

Epic Fail·Self-Contradiction

Loading...

Back to Challenges

MediumAnalysis

Stochastic Consistency Test

Tests an AI's randomness and creativity

The Prompt

Generate 5 jokes. How many are unique?

How the models did

221 found

Andromeda AlphaStochastic Consistency Test

Andromeda Alpha

The model returned empty.

Oct 2025·Stochastic Consistency Test~$0.0015

Aurora AlphaStochastic Consistency Test

Aurora Alpha

The model returned empty.

Feb 2026·Stochastic Consistency Test~$0.0020

Bert-Nebulon AlphaStochastic Consistency Test

Bert-Nebulon Alpha

The model returned empty.

Nov 2025·Stochastic Consistency Test14

ChatGPT-4o (March 2025)stochastic-consistency

ChatGPT-4o (March 2025)

The model returned empty.

Mar 2025·stochastic-consistency~$0.0000529

Claude 3 HaikuStochastic Consistency Test

Claude 3 Haiku

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.000002539

Notable Fail·Self-Contradiction

Claude 3 OpusStochastic Consistency Test

Claude 3 Opus

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.0001543

Epic Fail·Self-Contradiction

Back to Challenges

MediumAnalysis

Stochastic Consistency Test

Tests an AI's randomness and creativity

The Prompt

Generate 5 jokes. How many are unique?

How the models did

221 found

Andromeda AlphaStochastic Consistency Test

Andromeda Alpha

The model returned empty.

Oct 2025·Stochastic Consistency Test~$0.0015

Aurora AlphaStochastic Consistency Test

Aurora Alpha

The model returned empty.

Feb 2026·Stochastic Consistency Test~$0.0020

Bert-Nebulon AlphaStochastic Consistency Test

Bert-Nebulon Alpha

The model returned empty.

Nov 2025·Stochastic Consistency Test14

ChatGPT-4o (March 2025)stochastic-consistency

ChatGPT-4o (March 2025)

The model returned empty.

Mar 2025·stochastic-consistency~$0.0000529

Claude 3 HaikuStochastic Consistency Test

Claude 3 Haiku

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.000002539

Notable Fail·Self-Contradiction

Claude 3 OpusStochastic Consistency Test

Claude 3 Opus

The model returned empty.

Apr 2025·Stochastic Consistency Test~$0.0001543

Epic Fail·Self-Contradiction

Best AI for Stochastic Consistency Test

Top Performers: Stochastic Consistency Test

Best AI for Stochastic Consistency Test

Top Performers: Stochastic Consistency Test

Best AI for Stochastic Consistency Test

Top Performers: Stochastic Consistency Test

Stochastic Consistency Test

The Prompt

How the models did

Best AI for Stochastic Consistency Test

Top Performers: Stochastic Consistency Test

Stochastic Consistency Test

The Prompt

How the models did

Stochastic Consistency Test

The Prompt

How the models did

Stochastic Consistency Test

The Prompt

How the models did