How to tell if an AI SEO agency's claims are real

The short answer

An AI SEO agency's claims are real when its work is verifiable through sources it does not control: access logs, Search Console data, and third-party citation trackers.

An AI SEO agency refers to a firm that optimizes content for citation by AI search engines - ChatGPT, Perplexity, and Google AI Overviews - rather than traditional organic rankings. According to practitioner accounts in r/SEO, the distinguishing test is whether the agency can demonstrate its work through data sources it does not itself produce. Most agencies cannot meet that standard on demand.

In my experience, buyers who apply that test before signing a contract avoid the failure mode entirely. Three specific instruments make independent verification possible without relying on anything the agency provides.

Why does evaluating an AI SEO agency's claims feel so difficult?

A buyer with 10 years of paid media experience recently discovered that the agency charging him $1,000 a month had produced exactly one AI-generated blog post over that period. No keyword research. No technical audit. No strategy. Just a single article and a monthly invoice.

An analysis of 16 practitioner accounts and community threads from 2025 and 2026 shows this is a recurring structural pattern, not a collection of isolated bad actors. According to discussions in r/SEO, agencies billing $1,000 a month for a single AI-generated post while describing the service as full SEO management are recognized as a documented pattern across multiple independent accounts. A separate case documents $60,000 spent across 12 months of a conventional SEO engagement with no measurable traffic return and no ranking improvement - a result the agency disputed even after the buyer published a negative review, as of June 2026.

AI branding has made this harder to detect, not easier. I call this the verification gap - the distance between what an agency claims to accomplish and what a buyer can independently confirm. Traditional keyword rankings are publicly checkable in Google Search Console. AI citations are not. There is no equivalent of an organic rankings report for Perplexity appearances. Nothing in Search Console tells you whether your page appeared in a ChatGPT answer last month.

The recurring pattern has three consistent features: reports the buyer cannot independently verify, deliverables described in terms the buyer cannot evaluate, and retainer fees collected well past the point at which the agency stopped performing meaningful work. One Shopify store owner only discovered the agency had never once logged into her platform after she checked the admin access logs herself.

The failure mode is structural. The fix is specific.

What does it actually mean for an AI SEO agency's claims to be legitimate?

Legitimate means verifiable: the agency's claimed work can be confirmed by sources the agency does not control - platform access logs, Google Search Console data, and third-party AI citation trackers.

It would be straightforward to dismiss AI SEO agencies as a category. However, the measurement problem is real, and that is what makes blanket skepticism inadequate. According to a practitioner discussion in r/seogrowth, the operative test is not whether an agency uses AI but whether the AI-assisted work produces something a reader could not find elsewhere: "What unique information is in this article that isn't already on the first page of Google? If they can't answer, don't hire them." That question applies equally to traditional SEO and to AI SEO. The distinction worth drawing is sharper: agencies that use AI to accelerate expert judgment produce different output than agencies that sell AI-generated content as the deliverable itself.

According to Whatagraph's research published in June 2026, Semrush projects that AI search visitors could surpass traditional search visitors for digital marketing topics by early 2028. In practice, this means the question of which AI engines are citing your site is no longer theoretical. The takeaway is straightforward: AI search visibility is now a deliverable worth measuring, which means it is also a deliverable worth faking.

The framing I find useful is the AI-augmented versus AI-substituted distinction. An AI-augmented agency uses language models to speed up keyword clustering, technical auditing, and brief generation, while human practitioners make the strategic and editorial decisions. An AI-substituted agency replaces those human decisions with model output - and sells the output volume as the service. The second type is easier to scale and far cheaper to operate. It is also the type most buyers encounter when they search for AI SEO services.

Skepticism alone does not solve this. The answer is a short list of concrete verification tests.

How do you verify that an AI SEO agency's claims are real?

Demand three data sources the agency cannot fabricate on your behalf: platform access logs confirming actual login activity, Google Search Console keyword reports showing measurable impression and click changes, and AI citation data from a third-party tracking tool.

The third item is the one most buyers have not yet asked for, and it is where legitimate agencies separate themselves. According to Rankability's tracking platform, AI visibility now covers 9 distinct engines - ChatGPT, Perplexity, Google AI Overviews, Google AI Mode, Gemini, Claude, Grok, Microsoft Copilot, Brave AI, and DeepSeek - and can be measured independently of anything the agency reports. Rankability describes AI visibility as tracking "whether the AI actually named your brand in its answer, whether it linked to your site as a source, and whether it spoke about you positively, neutrally, or negatively." In practice, this means a buyer can verify AI citation claims the same way they verify organic ranking claims: by looking at data from a platform the agency does not control.

I recommend the three-demand checklist as a pre-contract and ongoing verification tool:

• Access log verification - Grant access to your CMS, Google Analytics, and Search Console on day one, then confirm in the platform admin panel that the agency has actually logged in within the first two weeks.
• Search Console baseline report - Request a keyword-level impressions and clicks report for the month before the engagement starts. This is your baseline. Compare it monthly without relying on the agency's own export.
• Third-party AI citation tracking - Set up or request tracking on at least two AI engines (ChatGPT and Google AI Overviews are the highest-priority starting points). If the agency cannot name the tool they use for this, that is a material gap.

No legitimate agency can guarantee specific rankings. Any agency that does is, at minimum, demonstrating it does not understand how AI engines select citations. A great agency, by contrast, can explain precisely what it does, how it prioritizes, and how it responds when results are not tracking as expected. Asking those questions in the first call is the most efficient use of 30 minutes you have.

For timelines: work evidence should appear within 30 to 60 days. Traffic movement takes 3 to 6 months in most cases, with compounding gains arriving after the 6-month mark. If no page-level changes are demonstrable at 60 days, the engagement warrants a direct conversation.

What will matter most for AI SEO buyers in the next 12-24 months?

Three structural shifts will define the market: milestone-gated contract structures, third-party performance dashboards, and the persistent failure of price as a quality proxy in search marketing services.

What most buyers miss is that this market's self-correction is slow by design. Agencies that resist independent verification will continue attracting clients who have not applied the three-demand checklist - not because those clients are uninformed, but because verification is not yet the default expectation at contract signing. The buyers who establish it now have a structural advantage over those who wait for the market to require it.

What should you do before signing with an AI SEO agency?

Request three items before the contract is signed: platform access credentials, a baseline Google Search Console export, and the name of the third-party AI citation tracker the agency uses.

According to practitioner discussions in r/SEO, agencies that resist this request are already providing the answer. I would treat that resistance as a direct signal worth acting on before the engagement begins.

The verification gap is structural. The fix does not require legal review or technical expertise. It requires three specific data requests - made before the first invoice arrives.