In 2023, models answered from their training data, and hallucinated when they didn't. An industry grew around seeding that knowledge: AEO (answer engine optimization), with a playbook of Reddit threads, listicles, and citations on other sites. In August 2026 that playbook broke. Reddit's share of ChatGPT citations fell 86% in a week as ChatGPT started querying official sites directly, and has only partly recovered since. The buyer's agent now searches the web with tools like Tavily, opens your pages, reads them, and verifies before it recommends anything. AX (agent experience) is whether that agent can find, read, and check your site itself.
We ran ~38,000 of those journeys across multiple harnesses running on Claude and GPT models, against 1,000+ real business sites, each answering a real buyer question, split by one axis: is the site ready for agents? Much of what we found was unexpected. When a site shut them out, agents almost never gave up. They answered anyway from other sources, and answers built that way were 3.7× more likely to miss every fact the buyer asked for.
00 / the shift, in public data
We put our buyer questions to earlier OpenAI generations and measured how much of each answer came from memory rather than retrieval. The last non-reasoning flagship, gpt-4.1, still built about half its answer from memory. Then reasoning and tool use became the default, and it falls off a cliff: down to 7–10% in the models agents run today.
Even the sources it cites are a moving target. Starting August 8, site: queries went from near zero to 23–24% of ChatGPT's background searches, aimed at official sites instead of discussion threads. Any off-site channel can vanish in one update, so none is worth optimizing for. The page it keeps returning to is your own.
Note: models don't search on everything. Stable facts still come from memory. But pricing, setup, and comparison questions need current information, and in agent harnesses fetching is the default.
01 / trace replay · one ask, two journeys
Two real traces for the same buyer question, "what can I try for free?", on the same harness. twilio.com answers from its own docs. hashicorp.com blocks the agent twice and the journey ends on two competitors' blogs.
two real traces, claude-agent-sdk · claude-sonnet-4-6 · click a panel to expand
02 / recommendation
We measure how strongly an agent recommends each business. An agent-ready site earns a clear, confident recommendation nearly twice as often as a blocked one.
The lift is steepest exactly where buying decisions are researched: 2.5× in IT infrastructure, 2.3× in sales & marketing, and up to 2.6× (14% vs 5% on claude-agent-sdk) depending on which stack the buyer's agent runs on. The flip side holds too: when a site is not agent-ready, answers that both judges rate too weak to recommend at all are 2.5× more common.
| category | ready | not ready | lift |
|---|---|---|---|
| IT Infrastructure | 24% | 9% | 2.5× |
| Sales & Marketing | 21% | 9% | 2.3× |
| Artificial Intelligence | 23% | 10% | 2.2× |
| Development | 32% | 14% | 2.2× |
| stack | ready | not ready | lift |
|---|---|---|---|
| claude-codeclaude-haiku-4-5 | 5% | 2% | 2.6× |
| claude-agent-sdkclaude-sonnet-4-6 | 14% | 5% | 2.6× |
| openclawgpt-5.4-mini | 25% | 14% | 1.8× |
| evegpt-5.4 | 36% | 20% | 1.8× |
The four ways an answer undermines its own recommendation, agent-ready vs not:
03 / grounding
Across the finished answers, training knowledge stays at 7–10% either way, so agents are not falling back on training data. Whatever the site does not provide, web search fills in: on sites that are not agent-ready, a quarter of the answer (25%) comes from web search, against 12% on agent-ready sites.
The less an agent can read your site, the more it searches the web: 2.6× from the most readable sites to the least. Every search is another chance the agent gets fed information you never published, or stopped updating: other people's pages, stale mirrors, whatever the ranker serves.
Web search is provided by Tavily on openclaw and eve; Claude stacks use built-in search. The ambiguous middle band of scores (0.50–0.65) is excluded by design.
Search reliance is a stack personality. openclaw navigates by search and claude-code barely searches, but losing readability pushes every stack, and every category, the same way. Web searches per run, agent-ready → not:
| stack | ready | not ready | lift |
|---|---|---|---|
| claude-agent-sdkclaude-sonnet-4-6 | 0.4 | 0.9 | 2.4× |
| claude-codeclaude-haiku-4-5 | 0.1 | 0.3 | 3.5× |
| openclawgpt-5.4-mini | 6.9 | 10.4 | 1.5× |
| evegpt-5.4 | 1.2 | 1.9 | 1.6× |
| category | ready | not ready | lift |
|---|---|---|---|
| Consumer | 1.9 | 3.7 | 2.0× |
| IT Infrastructure | 2.0 | 3.9 | 1.9× |
| Development | 1.7 | 3.2 | 1.8× |
| Artificial Intelligence | 1.8 | 3.1 | 1.7× |
| Sales & Marketing | 2.2 | 3.6 | 1.6× |
04 / cost & performance
On sites that are not agent-ready, runs take 23% more turns (5.5 → 6.8), get blocked by the site 2.1× as often, and take 15% longer to reach an answer (48s → 55s). The extra turns and retries are billed to whoever runs the agent.
Cost per run understates it. A 403 is cheap; the expensive part is that only 56% of runs on not-agent-ready sites end with an answer grounded in the business, against 78% of runs on agent-ready sites. Spread the cost of the failed runs over the answers that did use your site and the price is +64% per grounded answer, averaged across all harnesses using Claude and GPT.
05 / accuracy
Every answer is graded fact by fact against ground truth captured from each business's own site: 31,127 asked facts across 2,499 answers and a sampled 131 of the 1,056 businesses. Wrong facts are rare in both conditions. The failure that grows when the agent can't read the site is an answer that contains none of the facts the user asked for. It is fluent and confident, so hallucination metrics and AEO dashboards do not flag it.
Answers built from the business's own pages are 1.4× as accurate as answers built from web search and write-ups on other sites, and the gap is widest on pricing questions (60% vs 37%), where secondhand information ages fastest. Grouping answers by how much of their evidence came from the company's own pages, accuracy climbs from 41% to 56%.
Prices have one fresh source, your own pages, so reading them pays. Setup is harder: two-thirds of its facts never surface, and when stated they are equally right from either source. What moves setup is findability: sites where agents could ground setup answers score 31% vs 18%, from both sources alike.
06 / what to do about it
Current AEO practices shape what models learned about you in training and the mentions search engines pick up across the web. AX is about making your own site accessible, readable, and usable for the agent already on it. Every measure in this study moves the right way when a site is agent-ready.
We think the arbitrage is closing. Tactics that shape what gets said about you elsewhere (seeded threads, listicles on other sites, citation placement) lose leverage each time agents go to the source instead of reading about it. What is left is SEO so agents can find you, and AX so they can reach your site, read it, and use it. Start with the two resources below to see what your site needs to become agent-ready.
07 / what we didn't measure
Every journey in this study starts the same way. The agent searches, finds your site, and reads it. That's how most agents work today. We don't expect all of them to work that way a year from now.
Assistants are building their own front door to businesses.
Why does this matter for what we measured? If an assistant checks its own connectors and registries first, the web becomes the fallback. Muse already works this way: it uses a service's API when one exists and opens a browser only when none does. A business with a connector could win the answer, the recommendation and the transaction without the agent ever opening its site. A business without one might never be considered, however readable its site is. We've already seen a preview. When Amazon blocked Muse, Shopify merchants stayed reachable through a declared checkout path.
We haven't measured this, so we're not claiming it. It's our next study. We want to know how often an agent with a relevant connector skips the web entirely, whether a connector or ARD listing changes how often a business gets recommended, and whether agents actually read registry metadata when they choose. If the answer is "often", the find layer of AX grows to include the assistant's own catalog, alongside search.
08 / conclusions
Five findings hold across the four Claude and ChatGPT harnesses and every business category we tested. Together they describe a market where training data no longer decides who gets recommended.
Read the full paper. The analysis code and a sample of the derived data are released at github.com/ora/research.
the experiment
We ran the study across 1,056 live business sites. Real buyer questions went to four agent harnesses spanning Claude and GPT models: claude-agent-sdk, claude-code, openclaw, and eve. The two GPT stacks searched the web through Tavily; the Claude stacks used their built-in search. That comes to 37,927 agent journeys and 140,000+ page fetches from those sites, each journey run in its own isolated environment.
Beforehand we scored every site for agent readiness. We then paired each agent-ready business with a not-agent-ready one in the same industry, matched on brand fame, how much the model already knew about the brand, and how widely it is cited on sites it doesn't own, which we measured with Tavily searches. The two groups are indistinguishable on all three, so the lift holds with them equal: the 1.9× recommendation gap is the controlled number.
Sites were scored on August 24, 2026, and the journeys ran in late August and September 2026, on claude-sonnet-4-6, claude-haiku-4-5, gpt-5.4-mini, and gpt-5.4. Full experimental design is in the preprint.
09 / sources
Finder, I., Elovic, A., Shalev, G., & Yosef, L. (2026). AX is the New AEO. arxiv.org/abs/2609.34951
@misc{finder2026axnewaeo,
title={AX is the New AEO},
author={Ido Finder and Assaf Elovic and Gad Shalev and Liad Yosef},
year={2026},
eprint={2609.34951},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2609.34951},
}