Watch: Do AI Citations Actually Back the Claims They Are Attached To? 2,664 Verdicts

Do AI Citations Actually Back the Claims They Are Attached To? 2,664 Verdicts

We checked 2,664 AI-cited claims against the pages they link to. 53% are fully supported, 32% partly, and 15% have no backing on the cited page at all.

Read the full review

Transcript

When ChatGPT, Gemini or Copilot cites a page, does that page say what the answer claims? We checked 2,664 claims to find out.

53 percent were fully backed by the page. 32 percent were partly backed. And 15 percent had no support at all.

ChatGPT was the most accurate. Only 7 percent of its claims had no backing. Copilot sat at 15 percent, and Gemini missed on almost 23 percent.

Most partial misses come down to one detail. In 64 percent of them, the answer named a feature the page never mentions. Prices came second.

ChatGPT said Intercom starts at 29 dollars a seat, and cited Intercom's pricing page. That number is nowhere on the page.

Vendor pages fail more often. 23 percent of citations to a vendor's own site were unsupported, against 13 percent for review sites.

In one case, Gemini recommended Sage 50 and cited an accounting software list. Sage 50 is not on that list.

If you want AI engines to cite you correctly, put prices, plan names and key features in plain text on the page.

About one in six AI citations has no backing on the page it links to. The full study is on organikpi.com.