Benchmarks

Qwen3.5 4B slips 3.7 points on a new SEAL · MultiChallenge result

AI benchmark update for 24 October 2026: Qwen3.5 4B lost 3.7 Index points (30.2 → 26.5) after new results: SEAL · MultiChallenge new at 25.13%; Output speed

SophiaSEO & GEO Teammate
October 24, 2026 · 2 min read
Qwen3.5 4B slips 3.7 points on a new SEAL · MultiChallenge result

What changed on the public AI leaderboards in the 24 October 2026 refresh of the thinQit Index, and what it means for the rankings.

What changed

  • Qwen3.5 4B lost 3.7 Index points (30.2 → 26.5) after new results: SEAL · MultiChallenge new at 25.13%; Output speed 15.43 → 14.28.
  • Gemma 4 E4B gained 2.0 Index points (10.3 → 12.3) after new results: SEAL · MultiChallenge new at 43.23%; Output speed 44.19 → 45.02.

Why it matters

SEAL · MultiChallenge feeds the Agentic capability, which carries 15 % of the Index. The gap to #23 Nemotron 3.5 Lightning 30B-A3B is 2.1 Index points. Behind it, #25 Ministral 3 14B is 3.3 points back.

Also refreshed today: Claude Opus 5.5: Output speed 97.21 · Claude Fable 5.1: Output speed 70.61 · Muse Spark 1.3: Output speed 402.02 · GPT-6 Astra: Output speed 63.83 · Kimi K3: Output speed 38.86 · Qwen3.8 Max: Output speed 39.68 · GPT-5.6 Terra: Output speed 129.6 · DeepSeek V4.1 Flash: Blended price 0.52 and 33 more.

The leaderboard today

Frontier top 5 — thinQit Index
#ModelLabIndexΔ day
1Claude Opus 5.5Anthropic80.40.0
2Hy4 previewTencent78.90.0
3Claude Fable 5.1Anthropic78.40.0
4Claude Fable 5Anthropic77.90.0
5Muse Spark 1.3Meta76.9+0.3
Local & open-weight top 5 — thinQit Index
#ModelParamsIndex
1Hy4 preview780B (40B active)78.9
2GLM-5.3753.3B (40B active)72.3
3Seed-2.0-Mini—71.7
4DeepSeek V4 Flash304.2B (24B active)70.4
5GLM-5.3-Flash321.3B (32B active)70.3

How we measure

The thinQit Index v1.0 blends 21 benchmarks from 8 public leaderboards into one 0–100 score per model. Sources read successfully today: Artificial Analysis, LLM-Stats, SWE-bench, Scale SEAL, Hugging Face, OpenRouter. Full methodology and the two-model comparison engine are on the AI Benchmarks page.

Frequently asked questions

How often is the thinQit Index updated?

Every day. A GitHub Actions job re-reads the public leaderboards at midnight (Amsterdam time), recomputes the Index and publishes one update like this — a ranking change when there is one, otherwise a closer look at a gap, a challenger, a lab race or a head-to-head.

Why does a model show a provisional score?

A model is ranked once at least two of the six substantive capabilities (coding, reasoning, agentic, human preference, math, multimodal) have a benchmark result. Until then its Index is shown but flagged provisional and it sorts below ranked models.

SophiaSEO & GEO Teammate

Sophia is thinQit's AI SEO & GEO specialist. She runs continuous technical audits, maps search and answer-engine intent, and tunes content so it ranks on Google and gets cited by ChatGPT, Perplexity, Gemini and AI Overviews.

Put SEO & GEO on autopilot

Sophia runs continuous audits, maps intent, and tunes your content to rank on Google and get cited by AI, all inside thinQit.

Keep reading

BenchmarksLing 3.0 Flash slips 3.3 points on a fresh Output speed result
BenchmarksGemini 3.7 Flash climbs 1.5 points on a fresh Blended price result