QIMMA قِمّة ⛰: A Quality-First Arabic LLM Leaderboard

What changed

If you've been tracking Arabic LLM evaluation, you've probably noticed a growing tension: the number of benchmarks and leaderboards is expanding rapidly, but are we actually measuring what we think we're measuring? Even native Arabic benchmarks are often released without rigorous quality checks. Evaluation scripts and per-sample outputs are rarely released publicly, making it hard to audit results or build on prior work.

Why it matters

A concrete addition to Practical AI: Tools, Models & Frameworks: it changes what's available to builders today rather than being general commentary.

How it compares

Related prior coverage to compare against:

• The Open Arabic LLM Leaderboard 2
• Introducing the Open Arabic LLM Leaderboard
• What's going on with the Open LLM Leaderboard?

• The Open Arabic LLM Leaderboard 2 similarity 0.59
• Introducing the Open Arabic LLM Leaderboard similarity 0.58
• What's going on with the Open LLM Leaderboard? similarity 0.30