AI SEO Benchmark
Digital marketing is being impacted by AI in everyday workflows. But is it good enough to be trusted for your business? We've designed a benchmark for the SEO industry to do just that.
The LLM Leaderboard
Updated April 18, 2024
| Language Model | Score (out of 100) |
|---|---|
| Claude Sonnet 3.7 | 83% |
| Perplexity | 83% |
| Gemini 2.5 | 82% |
| ChatGPT 4o | 79% |
| ChatGPT o3-mini | 75% |
| Copilot | 77% |
| Deepseek | 77% |
| Llama 4 | 75% |
| Gemini 2.0 Flash | 74% |
| Grok 3 | 71% |
How We Test AI SEO Performance
- Expert-level SEO questions updated regularly focused on in-the-field experience to understand how useful LLMs are at understanding SEO problems.
- The questions are multiple choice and verified by a panel of SEOs.
- Based on our testing of a sampling of questions with SEOs, an expert-level SEO would be expected to be at 89%+ considering that SEOs typically specialize in one field.
- Sample question - Instead of manually penalizing sites that are breaking Google's linking policies, Google has started: (select all that apply)
a. Deindexing sites
b. Not passing their authority to linked sites
c. Quietly Dropping their overall ranking
d. Changing the SERP to show more ads
-
-
- Answer - B & C
-
Have questions on what this data means to your business? Check out our blog where we will regularly post updates about the progress of LLMs and how it's impacting digital marketing.
