Evidence review · Answer engines and shopping agents
An AI shopping agent is a language model (ChatGPT, Perplexity, Gemini, Claude, Amazon Rufus, Microsoft Copilot) that researches, shortlists and sometimes buys products on a person’s behalf. This review gathers what has been measured about how those agents decide: a six-stage model of the decision, a verdict table for Cialdini’s persuasion principles and the nudges of Kahneman, Thaler and Ariely, and the evidence on whether a company without mentions from Wirecutter-type sources is locked out.
AI shopping agents decide in two stages. Memory proposes: with identical specifications a recognized brand beat nine spec-identical fictional rivals in 100% of 670 trials across three models. Retrieval disposes: a fictional brand wins half the time with just +0.075 stars, a 7.3% discount or 1.6× the review count, and two sentences of fabricated authority language broke the incumbent’s monopoly in 73% of runs. The human persuasion toolkit transfers unevenly. Social proof, authority cues, platform badges, star ratings, review counts and top-row placement move agents far more than they move people (swings of 10–60 percentage points for nudge text such as “best seller”, against about 10 for humans, and 30–80 points for a higher star rating, against 5), while scarcity and exclusivity backfire, decoys barely register, charm prices do nothing and framing flips direction between models. The “third-party wall” is real but misdescribed. It is a corpus-presence requirement on unbranded discovery queries, not a Wirecutter veto: a single Wirecutter screenshot shifted one frontier agent by 99 points, yet Wirecutter appears in only about 10% of “best product” answers, official websites still supply 46.4% of ChatGPT’s citations on comparison questions, and only about 15% of ChatGPT buying-topic categories have a clear owner. A company without such mentions should build measurable presence in the places agents sample (retailer listings, real reviews, structured factual product data, genuine third-party coverage, narrow sub-categories) and should not buy reviews, seed Reddit, hide text for crawlers or lean on tone tricks, which now carry FTC, Google and Reddit enforcement risk and often reduce visibility on 2025–26 models.
An AI agent decides which product to recommend in six stages: it interprets the request, names candidates from memory, retrieves and selects sources, synthesizes a shortlist, picks one item from whatever it is shown, and finally chooses a merchant. No vendor publishes a ranking function. OpenAI, Perplexity, Google, Amazon and Microsoft all describe the same two-layer architecture in which a language model interprets the query and writes the answer while a structured product layer (merchant feeds, Shopify’s catalog, Google’s Shopping Graph, Amazon’s catalog) supplies candidates, prices and sellers. Every official statement is a list of factors without weights, and OpenAI’s feed specification says eligibility “does not guarantee display.” Platform OpenAI feed spec
The most revealing official admission is OpenAI’s statement, first made at the April 2025 launch, that product selection considers “model responses generated by ChatGPT before it considers any new search results” alongside third-party metadata and reviews. The wording is from OpenAI’s help article; PPC Land’s launch report paraphrases it. Platform OpenAI Help; PPC Land That is a direct acknowledgement that what the model already believes about a category is an explicit input. Combining the partial vendor descriptions with independent measurements gives the reconstruction below. Three stages are documented by vendors; three are characterized only by outside measurement.
| Stage | What happens | Documented or inferred | Measured drivers | Evidence |
|---|---|---|---|---|
| 1. Query interpretation | The model parses intent, budget, dislikes, saved memory and custom instructions. | Documented (OpenAI, Amazon, Google) | A stated budget shifts weight to price; a stated dislike filters products out; a one-sentence user memory can redirect the pick. | OpenAI Help; Wharton GAIL |
| 2. Candidate generation from memory | The model names brands from its training data before or without searching. | Inferred, measured | Brand familiarity (100% incumbent win on spec ties); popularity, measured as item frequency in the recommendation data, which the authors propose as a proxy for frequency in pre-training text. | Chu & Hou; Hou et al. |
| 3. Retrieval and source selection | The query fans out across web search, Google Shopping, feeds and catalogs; the model picks which pages to trust and quote. | Partly documented (fan-out, feeds); weighting inferred | Platform-specific source mixes; licensing deals (mainly ChatGPT; Copilot also shows a premium); rank of the page in the retrieval results, since content rewrites were largely ineffective in C-SEO Bench; position in the context window. | Google Search Central; Semrush; C-SEO Bench |
| 4. Shortlist synthesis | Priors and retrieved evidence are merged into one to five named products. | Inferred, measured | Stochastic sampling; a stable head of roughly three or four brands per prompt; model-specific favorite products. | SparkToro; Żatuchin |
| 5. Final pick | The agent selects one item from a grid, list or set of offers. | Inferred, measured in sandboxes | Grid position (about 5×), platform badges (about 2–4.3×), a “Sponsored” penalty, star rating (a tenth of a star matters), review count, price, the first adequate offer. | ACES; Magentic Marketplace |
| 6. Merchant selection and checkout | The platform ranks sellers of the chosen product. | Documented | Merchants are “ranked based on factors like availability, price, quality, and whether they are the maker or primary seller,” per OpenAI’s current help article. In April 2025 OpenAI said merchant order was “predominantly determined by these providers,” a statement since removed. | OpenAI Help; PPC Land |
A workable formal model treats the probability that a product is recommended as a chain of conditional probabilities:
P(recommended) = P(reaches the model) × P(survives source trust | reached) × P(in the shortlist | trusted) × P(final pick | shortlisted)
The decomposition matters because the levers differ at each link and because failure is concentrated at the first one. In a cross-provider audit of 7,763 cases where neither ChatGPT nor Claude recommended a brand, both diagnosed the same failure 95.1% of the time, and the dominant failure was discoverability (the brand never reached the model) rather than compellingness (reached but not mentioned) or positioning (mentioned but not recommended). Agreement rose from 81% for category leaders to 99.6% for long-tail regional brands. Measured Jack et al.
The split between memory and retrieval depends on the engine and is poorly measured, so any single “X% from training data” figure should be distrusted. The one cross-provider estimate puts Claude recommending from its priors 43–52% of the time against 8–29% for ChatGPT. Measured Jack et al. Estimates of how often ChatGPT searches the web at all vary widely, and all come from generative engine optimization vendors with incompatible methods. Ahrefs found search in 14.4% of 66.6 million logged-out responses. Vendor Ahrefs Other estimates are 23% (Texta; page no longer online), 31% from a Nectiv study in October 2025 as reported by Graphite, and 58% from Graphite’s own tests. Vendor Graphite Cloro found search on 86.5% of commercial prompts and 0.9% of informational prompts (Cloro, August 2026; its January 2026 figure of 80.5% used opted-in search). Vendor Cloro What is clear is that when retrieval does not fire, the brand has to already live in the weights. Zero-shot ranking research established early that language-model rankers rank popular, frequently occurring items higher. Measured Hou et al., ECIR 2024 The correlation data agree: across 75,000 brands, branded web mentions correlated with Google AI Overview visibility at Spearman 0.664, against 0.326 for domain rating and 0.218 for backlinks. Vendor Ahrefs
The Incumbent Advantage experiments give the cleanest picture of how retrieval overrides memory. At identical specifications the real brand wins 100% of the time. With clearly better fictional specs the real brand falls to 1.7–4.6%. The crossover is tiny: a fictional brand wins 50% of the time with a +0.075-star edge, a 7.3% discount or 1.6× the review count. Product parameters explained 82.4% of ranking variance, list position 6.5% and brand identity only 1.2%. Measured Chu & Hou, 2026 The same hypersensitivity appears in the Columbia and Yale ACES sandbox, where a +0.1 rating lifts a product from a 10% baseline to 15.4% (Claude Sonnet 4), 20.3% (GPT-4.1) or 16.0% (Gemini 2.5 Flash), and doubling the review count buys 17–37% of price headroom. Measured ACES The practical reading: brand familiarity is a tiebreaker, not a moat, but a challenger’s advantage has to be structured and visible to the model to count.
The retrieval layer behaves less like an editorial filter and more like a sampling process with platform-specific priors. Across August 2024 to June 2025 Wikipedia was ChatGPT’s single largest source at 7.8% of all citations and Reddit was Perplexity’s at 6.6%. Vendor Profound By September 2025 ChatGPT’s Reddit citations had collapsed from roughly 60% of responses to about 10% within six weeks. Vendor Semrush By late September 2026 Reddit appeared in about one in 43 ChatGPT answers, down 88% from March, while PubMed rose from 64th to fourth most-cited domain and hands-on testers such as RTINGS gained. Vendor Ahrefs Google’s two AI surfaces gave answers with 86% semantic similarity to the same queries but had only 13.7% citation overlap. Vendor Ahrefs ChatGPT and Gemini shared only 5.4% of cited domains for the same commercial query, with zero overlap in 76.7% of comparisons. Measured Uberti-Bona Marin et al.
Authority is a weak gate. 47.9% of 20.5 million citations went to domains with a domain authority under 40. Vendor Wellows Programmatic spam sites took more than 14% of ChatGPT citations for B2B software shortlist prompts. Vendor Overthink Group Cited Reddit posts had a median of five to eight upvotes, and semantic similarity to the answer, not engagement, predicted inclusion. Vendor Semrush
Two structural facts about this layer matter for any model of agent choice. First, licensing buys retrieval prominence mainly on ChatGPT, and per Otterly on Copilot too: OpenAI-licensed publishers earned 10.2 citations per cited page against 6.9 for unlicensed ones (+48%), OpenAI-exclusive publishers +112%, while Google-licensed publishers showed no AI Overviews premium and Perplexity licensees were at parity. Vendor Otterly Second, citation is not recommendation: 61.7% of 3,981 domain appearances were “ghost citations” in which the brand was never named, and only 13.2% were both cited and mentioned. Vendor Semrush and Indig In a 1,094-category study only 21% of the most-cited domains were also the most-mentioned brand, with a slight negative correlation (−0.229) between the two. Vendor Semrush Citations and brand mentions have to be tracked as separate quantities.
The shortlist stage is stochastic, and the measurements now agree on its shape: the full list varies almost every time, while the head of the list is stable. In 2,961 volunteer runs of 12 brand-recommendation prompts across ChatGPT, Claude and Google AI, the chance of the same brand list on two runs was under 1 in 100 and the same order under 1 in 1,000; yet in 994 headphone answers Bose, Sony, Sennheiser and Apple each appeared in 55–77% of responses, tight categories (cloud providers) were stable and broad ones (science fiction novels) scattered. Observational SparkToro Repeated-query studies show the brand set converging: ten calls recovered a median 92.6–95.2% of the observed fifteen-call brand set across 4,500 responses, or 89.5–94.7% after every candidate string was re-adjudicated. Measured Żatuchin A generalizability analysis of about 190,000 observations found five runs reach a coefficient of 0.96 across 250 questions even though five versions of one Gemini question scored 0.27 (95% CI 0.00–0.52). Measured arXiv 2609.04047
Daily tracking of more than 1,300 mostly commercial prompts over 28 days found that only a quarter of ChatGPT’s cited pages reappeared the next day, but the most frequently named brand appeared on 82% of days (89% for AI Overviews). Vendor Detailed Cross-model disagreement exceeds within-model noise: ChatGPT and Claude recommendation sets overlapped with a Jaccard index of 0.35 against a same-prompt rerun baseline of 0.50–0.61 Measured Jack et al., and the domains cited by API outputs overlapped on average only 12.0% (ChatGPT) and 14.8% (Gemini) with those of the same vendor’s consumer interface. Measured arXiv 2609.18729 Model updates act as demand shocks: from the same assortment the Fitbit Inspire was chosen 45% of the time by Claude Sonnet 4, 77% by Claude Opus 4.5 and 6% by GPT-5.1. Measured ACES
The modeling consequence: rank within a single answer is noise, inclusion rate over at least five runs per engine is signal, and each engine has to be modeled separately. Five runs give a stable average, but 15–25 are needed to detect a change. Measured arXiv 2609.04047
Once a shortlist exists, the final choice is governed by presentation that the platform controls, and by satisficing. All tested models over-select the top row of a results grid, but the favored column differs by model (GPT-4.1 the first column, Claude the middle columns, Gemini columns three and four). For Claude Sonnet 4, moving a product from bottom-right (4.5% selection) to the second or third column of the top row raised selection about fivefold, and the effect persisted under “ignore position” instructions and in headless JSON interfaces. Separately, moving from the second row to the first was worth roughly a doubling of price for Claude Sonnet 4 and GPT-4.1, and about +17% for Gemini 2.5 Flash. GPT-4.1 and GPT-5.1 showed nearly opposite position preferences. An “Overall Pick” badge raised a 10% baseline to 24.3%, 19.9% and 42.6% across three models, while a “Sponsored” tag lowered it to 8.9%, 8.0% and 7.9%. Measured ACES
In Microsoft’s Magentic Marketplace simulation, customer agents accepted the first proposal they received 60–100% of the time across models and scenarios. In the restaurant scenario the range was 80–100%, with Claude Sonnet 4.5 at 93.3% and GPT-4o at 100%. Measured Magentic Marketplace paper Consumer welfare fell for every model tested as the number of search results rose from 3 to 100, even for models that contacted more than a hundred businesses. Measured Microsoft Research Agents also concentrate: choices cluster on a few “modal” products with some brands never chosen, which the ACES authors contrast with “human consumers, whose preferences are often dispersed due to heterogeneous tastes or idiosyncratic search paths.” Measured ACES The one documented defense sits with the consumer rather than the seller. Explicit user profiles act “more like categorical switches or thresholds that radically reconfigure the agent’s decision rules” Measured ABxLab, and stating a precise criterion restored agent optimality from 0.29–0.48 to 0.83–0.88 when inspecting options was costly. Measured Tool-Lab
Some do, some do not, and the ones that work hit harder than they do on people. Two literatures have to be kept apart. Studies that prompt a model to simulate a human respondent (Horton’s “homo silicus”, conjoint work at Harvard Business School) show that models can reproduce human bias patterns when asked to predict a person. Studies that let the model choose on its own account show something different: cue hypersensitivity rather than the classic Kahneman and Tversky biases. The agent-side regularities that replicate across labs are outsized responses to ratings, price, social-proof and authority text, platform endorsements and position. A 30-bias benchmark across 20 models and 30,000 tests in 200 decision scenarios found evidence of every bias in some model, but status quo bias and the disposition effect were the only two with negative averages, and bias showed no clear correlation with model size or capability. Measured Malberg et al.
The Wharton persuasion studies establish that Cialdini’s principles exist in the weights. Seven principles more than doubled GPT-4o-mini’s compliance with objectionable requests (33.3% to 72.0%). On Claude Haiku 4.5, GPT-5 mini and Gemini 3 Flash with reasoning enabled the lift shrank to 35.3% to 51.3% but stayed positive in all 21 model-by-principle cells. Measured Wharton GAIL 2025, Wharton GAIL 2026, PNAS Those studies measure compliance with refusal-worthy requests, not product preference, so the table below draws its verdicts from shopping-specific sandboxes.
| Principle or bias | Verdict for AI agents | Effect size and models tested | Source |
|---|---|---|---|
| Social proof (Cialdini) | Works, harder than on humans | One expert-written sentence raised recommendation rate +42.1 points on Claude 3.7 and +40.1 on LLaMA-70B; a full social-proof rewrite of the description raised Claude 3.5’s rate +334% relative; still +14.8 with Claude 3.7 extended thinking; offsets about a 0.27-star deficit. “Best seller” and buy-one-get-one cues shifted choice 10–60 points in 14 of 17 models when ratings and prices were matched, against +9.9 for humans; pooled across all nudges with ratings and prices matched, Claude Sonnet 4 moved +55.9 and GPT-5 +53.3. Broke the incumbent’s monopoly in 50.7% of runs. | Bias Beware; ABxLab; Chu & Hou |
| Authority (Cialdini) | Works as a recognized third party or an evidence claim; authoritative tone backfires | A Wirecutter-pick cue was the largest ABxLab nudge; authority language broke the incumbent monopoly in 73.3% of runs, worth about +0.17 stars or a 15.3% discount (GPT-4o-mini, Claude Sonnet, Gemini 3 Flash). But an “authoritative” writing style was negative on all five E-GEO engines (GPT-5, Claude Sonnet 4.5, Gemini 3 Flash Preview, DeepSeek V3.2, Llama 4 Maverick) and not significant in the Princeton GEO paper. | ABxLab; Chu & Hou; E-GEO; GEO |
| Scarcity and urgency (Cialdini) | Null or backfires | “Only few items left” cut Claude 3.5’s recommendation rate 13.5 points (about −30% relative); exclusivity cues −30.1 to −44.6 points on Claude 3.7; an “Only X Remaining” tag was weakly negative or statistically indistinguishable from zero in ACES across Claude Sonnet 4, GPT-4.1 and Gemini 2.5 Flash; broke the incumbent only 11.7% of the time. | Bias Beware; ACES; Chu & Hou |
| Commitment, unity, liking, reciprocity (Cialdini) | Strong for compliance, but a seller cannot stage them | Compliance rose from 47% to 83% (commitment), 23% to 45% (unity), 19% to 26% (liking) and 24% to 31% (reciprocity) on 2025–26 reasoning models. These need a conversational set-up a product page cannot provide. | Wharton GAIL 2026 |
| Platform endorsement badge | Works, large | “Overall Pick”: 10% baseline to 24.3% (Claude Sonnet 4), 19.9% (GPT-4.1), 42.6% (Gemini 2.5 Flash); price headroom +65–138%. | ACES |
| “Sponsored” label | Backfires | 10% baseline to 8.9%, 8.0% and 7.9% across the same three models. | ACES |
| Star rating (+0.1) | Works, far harder than on humans | The higher-rated option gained 30–80 points in 14 of 17 models (o4-mini 81.2, o3 77.6, GPT-5 61.8) against +5.0 for humans; +0.1 star lifts 10% to 15.4–20.3%; failure to notice +0.1 star fell from 71.7% (GPT-4o) to below 1.7% in December 2025 models (Claude Opus 4.5, GPT-5.1, Gemini 3 Pro Preview). | ABxLab; ACES |
| Review count | Works | Doubling reviews buys 17–37% price headroom; a fictional brand wins 50% of the time at 1.6× the reviews. | ACES; Chu & Hou |
| Framed discount vs real price cut (reference prices, Thaler and Kahneman) | Framing works; charm prices do not | Discount-framing text, with framed discounts averaging about 26%, raised recommendation rate +23.0 (LLaMA-70B) and +37.4 (Claude 3.7) and beat an actual 50% price cut in most models. But 7 of 8 2026 models weighted cents like dollars, and 6 of 8 weighted “20% off” the same as a list-price cut. | Bias Beware; Tool-Lab |
| “Free” and buy-one-get-one (Ariely’s zero-price effect) | Works | BOGO, alongside the “best seller” cue, shifted choice 10–60 points in 14 of 17 models when ratings and prices matched; BOGO moved 40.6% on cell phones and 60.9% on cookies. | ABxLab |
| Decoy, asymmetric dominance (Ariely) | Weak, inconsistent | Positive for GPT-4 in 5 of 6 hiring occupations; for gpt-4o-mini subscription choices the target’s share did not rise (24 to 23 of 50) and the decoy itself was picked 14% of the time; did not affect models “in a consistent manner” as a description injection on Claude 3.5, Claude 3.7, Mistral Large 2 and LLaMA 8B–405B. No replication of Ariely’s Economist experiment on a frontier model exists. | arXiv 2409.15299; NHSJS; Bias Beware |
| Anchoring (Kahneman) | Works in negotiation and numeric hints; untested for a posted list price | A seller opening above target raised seller utility 0.37 (GPT-4o), 0.54 (GPT-4), 0.63 (Llama-3); o1 lost as much as GPT-4o unless warned. Anchoring was the only one of six biases in the human direction (d = 1.89), and extra reasoning did not reduce it. | arXiv 2508.21137; Kraishan |
| Gain-loss framing (Kahneman) | Present but direction unstable; near-absent in reasoning models | Framing effect +0.165 on GPT-3.5 but −0.405 on GPT-4; gpt-4o-mini 66% vs 42% acceptance depending on frame. Reasoning models (GPT-5.1, DeepSeek-R1) correlate 0.86–1.00 with expected payoff and are insensitive to gain/loss framing; conversational models under 0.5. | Echterhoff et al.; NHSJS; Mind the (DH) Gap |
| Loss aversion, “final sale” | Backfires on the product that carries it | GPT-4o ignored expected value in more than 95% of loss vignettes, and ABxLab’s negative-framing cues (“Final sale”, “newer version available”) significantly moved agents away from the product that carried them; loss-framed copy broke the incumbent only 9.6% of the time. | arXiv 2410.02820; ABxLab; Chu & Hou |
| Status quo and defaults (Thaler) | Present in simulations; mixed for agents | Large positive status-quo coefficients in every model from GPT-4 (0.93) to GPT-4o (0.32) in budget tasks, but the 30-bias benchmark finds a negative average (a preference for change). | Horton; Malberg et al. |
| Hedonic vs functional context (Ariely’s relativity) | Works | Every one of 12 models (including GPT 5.4 and Gemini 3.5 Flash as the authors name them) chose the premium option more often under hedonic than functional cues, the average model more than twice as often; thinking mode, tested on four Qwen 3 models, did not reduce it and increased it in two. | arXiv 2609.22225 |
| Position and primacy | Works, large, model-specific direction | Top-row premium in all ACES models; the “viewed first” effect ranged from −35.4 points (Claude 3.5 Haiku) to +88.8 points (GPT-4.1 Nano) against +4.0 for humans; on 100-listing hotel pages agents showed a mid-list dip that higher reasoning effort reduced. | ACES; ABxLab; arXiv 2608.22697 |
| Choice overload (Iyengar, Schwartz) | Present: more options lowered welfare | Welfare fell as the search limit rose from 3 to 100, even for models that contacted more than a hundred businesses, while most models contacted only a few; no study of overload-induced deferral was found. | Microsoft Research |
| Fabricated citations and bandwagon statistics | Works on judge models; weak on product rank | Fake references dropped every judge but GPT-4o below random; “85% of people believe” swayed ChatGPT 86% of the time but GPT-4 0%; any citation, real or fake, raised hallucination rates, and fabricated citations on true claims raised them 3–22 points, across 220,564 prompts. Yet adding statistics lowered rank in 19 of 24 settings across question-answering and product-recommendation tasks. | Chen et al.; CoBBLEr; AuthorityBench; C-SEO Bench |
| User memory and stated preference (sycophancy) | Works, the strongest single lever found | “I love hiking!” redirected most 2026 agents away from an objectively superior product (Claude Opus 4.8, as the authors name it, picked the hiking watch about 75% of runs); only Gemini 3.5 Flash was unaffected. | Wharton GAIL |
| Prompt injection in page text | Works, model-dependent, and a policy violation | Redirected all payments for GPT-4o, GPT-OSS-20b and Qwen3-4b; Claude Sonnet 4 resisted. Hidden text in reviews and metadata succeeded 41.7–68.2% of the time in StakeBench; agents start following injections 17–86% of the time but complete the attacker’s goal 0–17%. | Microsoft Research; CSO Online; WASP |
| Keyword stuffing | Backfires | About −8% to −10% on position-adjusted word count (−8.3% on GEO-bench, −9.1% on Perplexity), though subjective-impression scores did not fall. | GEO |
Newer models are harder to move with numeric tricks and overt manipulation, and no harder to move with evidence-shaped cues. The trend is a split, not a general hardening. Numeric rationality improved sharply: failure to pick a 1%-cheaper identical item fell from more than 63% (Claude Sonnet 3.5) to about 9% (GPT-4.1), and the latest models (Claude Opus 4.5, GPT-5.1, Gemini 3 Pro Preview) “almost never” miss price differences. Measured ACES Reasoning-trained models are near expected-value maximizers on risky choice. Measured Mind the (DH) Gap Claude Sonnet 4 and Gemini 2.5 Flash resisted fake awards and fake reviews that raised payments to manipulators for GPT-OSS-20b and Qwen3-4b. Measured Microsoft Research
But preference-ordering biases with no normative answer did not shrink. Reasoning siblings were not less biased than non-reasoning ones (a non-significant difference of +0.031 toward more bias, p = .157). Measured Kraishan The o3 and o4-mini models showed the largest rating effects and still 38.5–48.4 point nudge effects with ratings and prices matched. Measured ABxLab Large reasoning models “show no improvement in robustness” to bandwagon cues on subjective tasks. Measured arXiv 2504.09946 A system prompt saying the assistant “focuses only on the product characteristics and the user’s query” left social-proof effects of +13.0 to +37.9 points intact. Measured Bias Beware Because the pretraining backbone, not fine-tuning, is the main determinant of a model’s bias profile Measured arXiv 2507.07186, and because Mistral Large 2, a model not known to have been trained with RLHF, produced results similar to the other models Measured Bias Beware, part of the susceptibility is baked in at pretraining and will not be removed by alignment alone.
The prediction for a seller: numeric tricks will keep failing against capable agents, textual evidence cues, platform-structural cues and complete structured attributes will keep working, and the direction of position effects will keep flipping with each model release.
No. The claim under test is that a single review from an authoritative third party outweighs everything a company publishes on its own site, and that lacking such mentions is insurmountable. The evidence supports the first half as a description of discovery-stage behavior on unbranded queries, and rejects the second half as stated. The wall is a corpus-presence requirement, not a Wirecutter veto.
On unbranded discovery prompts, brand-owned domains receive 2.24% of citations against 30.7% on branded prompts, a gap of about 13.7×, and 85% of unbranded responses cited no brand-owned source at all, across 57.2 million citations. Vendor AirOps and Foundation For 2,000 “best product” questions across five engines, 70% of 17,524 answers cited at least one affiliate review site (Perplexity 99.4%, AI Overviews 79.3%, AI Mode 70.1%, ChatGPT 61%, Gemini 54.7%), led by Forbes 14.4%, Wirecutter 10.3%, PCMag 9.4%, NerdWallet 8.7%, Consumer Reports 7.6%, TechRadar 7.3%, CNET 7.2%, Tom’s Guide 7.2% and RTINGS 7.0%. Vendor Suff Digital In 3,312 product-intent responses from six engines across electronics, wearables, home, kitchen, audio and outdoor categories, the top sources were YouTube 19%, Reddit 19%, RTINGS 16%, google.com 12%, Forbes 9%, PCMag 8% and CNET 8%, and the authors wrote that “brand-owned domains are conspicuously absent from the top of this list.” Vendor Cloro Listicles took 40.9% of commercial-intent citations against 21.9% overall. Vendor Wix Studio
The closest thing to a quantified absence penalty is observational: when neither the brand nor its domain appeared in the retrieval path, the brand was mentioned in 2.8% (GPT) and 3.8% (Gemini) of answers; with an own-domain citation but no branded fan-out query, 49.0% and 58.4%. Measured Tannenbaum The controlled agent evidence shows how heavily a recognized reviewer weighs once retrieved: a single Wirecutter screenshot moved Gemini 3.5 Flash 99 points toward Wirecutter’s pick, Wirecutter dominated Reddit and The Strategist for both Claude models, and a Reddit-plus-Strategist combination moved no model. Measured Wharton GAIL In ABxLab, the Wirecutter-pick cue was the single largest nudge across 17 models. Measured ABxLab And ChatGPT’s own fan-out queries for running shoes contained “best” 206 times and “review” 117 times but “official” only 65 times Vendor Ahrefs, which means the engine actively goes looking for third-party verdicts.
Branded and factual queries are not walled. Official websites supplied 63.4% of ChatGPT citations for factual questions (pricing, features) and still 46.4% for comparison questions; brand site: searches made up 75.9% of ChatGPT’s fan-out searches to the most-searched domains, with apple.com, ikea.com, nike.com, adidas.com and samsung.com at the top. Vendor Ahrefs In Yext’s four-industry study, 86% of citations came from sources brands control, such as websites, listings, reviews and social profiles. Vendor Yext In niche B2B software categories, Gemini and Google AI Overviews are the most vendor-site-friendly engines: about three-quarters of their top cited domains are vendors, against about one-quarter for ChatGPT and Perplexity. Vendor Overthink Group Owned content is retrieved to verify details about brands already in the candidate set. It is not irrelevant; it is downstream.
Niche categories have thin corpora and open slots. Only 15.2% of 1,094 ChatGPT categories had a clear owner, 53.7% were unsettled, and high-demand topics were more open (11.3% owned) than low-demand ones (19%). Vendor Semrush Across 3,750 responses on 250 category queries, 8.0% of queries were “competitive vacuums” concentrated in narrow segments, the three models agreed on the top brand in only 41.6% of queries, and brands absent from 33–38 of 50 queries were still dominant, with a concentration index of 0.80 or more, on two to six specific ones. Measured arXiv 2606.23057 SparkToro’s finding that a narrow market (cloud providers for SaaS startups) gave more consistent lists than broad ones (science fiction novels, brand agencies) points the same way. Observational SparkToro Even in mass-market electronics the top product (Garmin Forerunner 265) appeared in only about 2% of responses, with a product concentration index of 0.0005 Vendor Cloro, so the barrier there is not a single incumbent but the depth of the third-party corpus that assembles a wide, churning shortlist.
Feeds and Google Shopping are a side door for product cards. In ChatGPT, 87.3% of 812,190 product cards came from web crawl and 12.7% from direct merchant feeds Vendor Profound, and the top ChatGPT product appeared in Google Shopping’s first three results 75% of the time across 100 prompts and five runs. Vendor Semrush Google states there are “no additional requirements” beyond being indexed and snippet-eligible to appear in AI Overviews or AI Mode. Platform Google Search Central Perplexity’s launch press release said merchants in its free program get “increased chances of being a ‘recommended product’” because richer data helps judge relevance. Platform Fortune Feeds affect eligibility and data quality rather than shortlist rank, but a product carousel is a route to being shown that does not run through an editorial review.
Review volume and rating on retail surfaces substitute for editorial authority. Rank-1 ChatGPT product cards had a median of 787 reviews against 352 for cards ranked fourth or lower. Vendor Profound Amazon Rufus essentially never recommends products below 4.0 stars (median 4.5) across more than 1,300 recommended products. Vendor PPC Land on Amalytix The controlled experiments show that 1.6× the reviews or +0.075 stars is enough for an unknown brand to win half the time against a familiar one. Measured Chu & Hou Retailer pages are themselves third-party sources: Best Buy appeared in 12% of product-intent responses and Walmart in 11%. Vendor Cloro
The wall itself is unstable and low-fidelity. Reddit’s ChatGPT citation share swung from about 60% of responses to about 10% between early August and mid-September 2025 Vendor Semrush and then fell 88% between March and September 2026, as the lost citations went to primary sources such as research bodies and regulators, to brands and to hands-on testers. Vendor Ahrefs An obscure site, Toxigon, ranked ninth among ChatGPT’s most-cited domains between August 2024 and June 2025. Vendor Profound About 16% of sources cited across four engines showed signs of being AI-generated. Measured Allaham and Diakopoulos, AIES 2026 Licensing does not even guarantee that a publisher’s verdicts are reported correctly. WIRED’s parent, Condé Nast, signed a content deal with OpenAI in August 2024 WIRED, yet ChatGPT, asked which products WIRED’s reviewers recommend, named picks that were not in WIRED’s guides. TechBuzz summary A gate that admits programmatic spam and misquotes its own licensed partners is not a quality filter in the editorial sense. It is a retrieval-relevance filter that a well-structured, genuinely relevant page can pass.
The verdict splits by stage. In the final-pick stage, with the review already in context, one recognized editorial endorsement does outweigh on-page attributes for most 2026 agents, and that is the strongest seller-external lever measured. But no dataset shows Wirecutter as a gatekeeper of the candidate set. It is one of nine publishers cited in 7–14.4% of “best product” answers, behind Forbes. Vendor Suff Digital RTINGS rather than Wirecutter dominates the electronics data. Wirecutter’s parent, The New York Times, is suing OpenAI for copyright infringement, a case a federal judge allowed to go forward in March 2025 NPR, while OpenAI’s publisher partners rose from 7.5% to 15.8% of ChatGPT citations between March and July 2026. Vendor Ahrefs And the correlation ordering for AI Overview visibility (branded web mentions 0.664, branded anchors 0.527, branded search volume 0.392, domain rating 0.326) describes breadth of presence rather than any single endorsement. Vendor Ahrefs
Two small-business findings bound the realistic outcome for a company that gets in without marquee coverage. Small retailers were cited about as often as chains, but chains received about 2.5× the leading recommendations and small stores got about one in ten first-place slots on specific queries (a Lightspeed-sponsored study). Vendor Fit Small Business (page could not be re-fetched on October 17, 2026) A practitioner’s three-month, 50-query tracking of a small B2B client logged 4 mentions against 47 for the market leader. Observational Roberto Serra
Where the wall is near-solid is a specific intersection: unbranded discovery queries, in deep mass-market categories with heavy RTINGS, Wirecutter, Reddit and YouTube coverage, on Perplexity and ChatGPT. Everywhere else it is porous.
Build measurable presence in the places agents sample, and stop spending on tricks. The actionable evidence divides into measured levers, vendor-asserted levers with no controlled support, and tactics that are measured to fail or carry enforcement risk. No named small or direct-to-consumer brand with before-and-after AI-visibility data tied to a specific intervention exists in the public record, despite a strong commercial incentive for AI-visibility tooling vendors such as Profound, Peec, Otterly and Scrunch to publish one. That absence is itself a finding. It means time-to-effect is unknown, and the large week-to-week swings that tracking tools report on category prompts would swamp most small interventions. Observational Design Copy
| Tactic | Evidence | What the data show | Risk |
|---|---|---|---|
| Earn genuine review volume and a rating of 4.0 or better on retailer and marketplace pages | Measured and Vendor | 787 vs 352 median reviews for rank-1 vs rank-4-and-lower cards; a Rufus 4.0-star floor; 1.6× the reviews or +0.075 stars is enough for an unfamiliar brand to win half its contests against a familiar one in controlled tests. Profound; PPC Land; Chu & Hou | Low if authentic |
| Google Merchant Center, Shopify and OpenAI feed hygiene | Vendor, eligibility not rank | 75% of top ChatGPT products sit in Google Shopping’s top three; feeds supply 12.7% of cards, and live merchant sources supply card details just under 25% of the time; the OpenAI spec has nine required fields and takes only aggregate review count and star rating. Semrush; Profound; OpenAI spec | Low |
| Complete, structured, factual product attributes and self-contained answer passages | Measured, modest | Removing a key attribute cuts selection 20–40%; complete machine-readable attributes beat stronger marketing copy; LLM-rewritten listings gained +0.56 rank on GPT-5; structural-field enrichment about +22% retrieval (secondary). Kantar on ACES; E-GEO; Ottmann on SAGEO | Low |
| Target a narrow sub-category with a small candidate pool | Observational | 8% of queries are competitive vacuums; 53.7% of categories are unsettled; tight markets are stable across runs. arXiv 2606.23057; Semrush; SparkToro | Low |
| Authentic third-party coverage: hands-on testers, YouTube, retailer and forum presence | Observational, correlation only | Branded web mentions 0.664 and YouTube mentions about 0.74 with AI visibility; no controlled study shows that manufacturing mentions causes recommendations. Ahrefs; Ahrefs | Low if earned |
| Legitimate social-proof and evidence statements on product pages (“best-selling”, verifiable test results) | Measured in sandboxes | +42 points in selection rate for one appended social-proof sentence (Claude 3.7, coffee machines); authority claims worth about +0.17 stars. But fabricated clinical claims also worked, and the FTC’s advertising-substantiation policy requires a reasonable basis for objective claims. Bias Beware; Chu & Hou; FTC | Medium: must be true and substantiated |
| Labelled ads in ChatGPT | Platform | Separate labelled ad units: OpenAI says ChatGPT ads “will be clearly labeled and separated from the organic answer,” and began showing them in February 2026; agents penalize sponsored tags (10% to 7.9–8.9%); no evidence of leakage into organic results. AP; Euronews; ACES | A budget question, not a visibility one |
| Digital PR and earned media (“85% of your brand mentions are influenced by stuff that’s not on your website”) | Vendor, asserted | The 85% figure has no published methodology; Muck Rack’s 84% earned-media citation share, across 25 million links, does not define earned media on the page. Previsible; Muck Rack | Unknown |
| schema.org Product, Review and FAQ markup | Vendor, asserted | Google: “no special schema.org structured data that you need to add”; one weak agency test. See also our schema evidence. Google Search Central; Evergrow Marketing | None, but unproven |
| llms.txt | Observational: no effect | No correlation across about 300,000 domains; 97% of the roughly 38,000 llms.txt files found on 137,210 domains got zero requests in May 2026. Auriti on Ahrefs and SE Ranking data | None, wasted effort |
| GEO tone tricks: authoritative voice, added statistics, keyword stuffing | Measured: null or negative on 2025–26 models | Only 3 of 54 C-SEO cases showed statistically significant gains; statistics lowered rank in 19 of 24 settings; authoritative tone negative on all five E-GEO engines; keyword stuffing −8.3% to −9.1% in the original GEO paper; body-only GEO rewrites cut top-10 presence after reranking by 16%, and top-20 retrieval by 9%, in the SAGEO arena. C-SEO Bench; E-GEO; GEO; PPC Land on a 45-study survey | Visibility loss |
| Scarcity, urgency and exclusivity copy | Measured: backfires | −13.5 to −44.6 points on Claude 3.5 and 3.7; weakly negative in ACES. Bias Beware; ACES | Visibility loss |
| Reddit and user-generated-content seeding | Correlational pull; Measured enforcement | Reddit: “no guarantee that what is on Reddit will make its way into LLMs”; the agency Trap Plan was exposed for promoting a game through multiple fake Reddit accounts and more than 40 posts; r/Biohackers paused new peptide and HRT posts, its moderators saying “companies are using us for AEO.” AdExchanger; Kotaku; 404 Media | High: account purges, public exposure |
| Fake or AI-generated reviews, bought sentiment, fake awards | Measured: works on weak models only | Frontier agents (Claude Sonnet 4, Gemini 2.5 Flash) resisted fake awards and reviews. Microsoft Research | High: FTC rule with civil penalties, warning letters in December 2025 |
| Hidden text and prompt injection on product pages | Measured: works, model-dependent | 41.7–68.2% success in StakeBench; superlative and emotional copy flagged 99–100% of the time by a simple defense. CSO Online; E-GEO | High: hidden text and cloaking fall under Google’s spam policies, which Google confirmed on May 15, 2026 apply to AI Overviews and AI Mode; a security exploit |
Three enforcement regimes now bite on the grey tactics. The FTC’s Consumer Reviews and Testimonials Rule (final August 2024) bans fake or AI-generated reviews, sentiment-conditioned compensation, reviews by officers and managers, undisclosed insider reviews, company-controlled “independent” review sites, review suppression and fake social-media indicators such as bought followers or views, with civil penalties for knowing violators (FTC); warning letters went to ten companies in December 2025 (DLA Piper). Google’s May 15, 2026 changelog made explicit that all spam policies, including cloaking for AI crawlers and scaled AI content, apply to AI Overviews and AI Mode, and added that seeking inauthentic brand mentions “isn’t as helpful as it might seem” (PPC Land). Reddit says it is improving detection of inauthentic content and accounts and will ask suspicious automated accounts to verify they are human, and it has publicly questioned “the legitimacy of any provider suggesting they can” guarantee pickup by language models (AdExchanger).
The asymmetry is stark: the measured upside of these tactics is unproven and decaying as frontier models learn to resist them, while the downside is codified. The Incumbent Advantage paper adds a game-theoretic warning even for the legitimate text levers. When all nine fictional brands adopted the same authority language, the individual payoff fell from +0.802 to +0.007, the incumbent recovered to 93.8%, and non-adopters received zero recommendations across 4,745 trials. Measured Chu & Hou C-SEO Bench independently describes the same dynamic as a “congested, zero-sum game.” Measured C-SEO Bench Copy-level optimization is hygiene that keeps a brand from being dropped. It is not a durable advantage.
The stakes of getting in are rising, which is the honest case for investing in corpus presence rather than tricks. AI-referred traffic to US retailers grew 393% year over year in the first quarter of 2026 and in March 2026 converted 42% more often than non-AI traffic, reversing a 38% deficit a year earlier. Vendor, secondary TechCrunch on Adobe; Digital Commerce 360 on Adobe After OpenAI made brand links more prominent in May 2026, the share of ChatGPT referrals landing on brand homepages jumped from roughly 26–29% to about 62–63%. Vendor, secondary Similarweb Publishers are being read far more than visited: in July 2025 Anthropic’s crawl-to-referral ratio was about 38,000:1 and OpenAI’s about 1,100:1, per Cloudflare. Observational Cloudflare RTINGS paywalled its full test data in March 2026 citing uncredited AI scraping. Wikipedia A brand that earns a stable slot at the head of the shortlist captures above-average downstream value while the third-party corpus that gates it is thinning and shifting toward primary sources and hands-on testers.
AI agents are not persuadable consumers so much as credulous evidence-weighers with a short attention span. They do not fall for the decoy, the charm price or the countdown timer, and they increasingly see through fake awards and fake reviews. But they over-weight any legible, structured signal of quality they do see (a tenth of a star, a review count, a recognized reviewer’s verdict, a platform badge), they satisfice on the first adequate option, and their defaults come from whatever the training corpus said about a category. The seller’s problem is epistemic rather than rhetorical: the brand has to exist, with verifiable attributes, in the places the model samples when it builds its candidate set, and those places are drifting from Reddit and encyclopedias toward primary sources, official pages, retailer review systems and testers. The slogan “mentions are the new backlinks” is directionally right and causally unproven. The better operating hypothesis is “corpus presence is the new indexation.”
This page is a synthesis of published research, not original data collection. In October 2026, five research threads were run with Claude Fable 5.1 using web search and page fetching: how AI assistants and shopping agents mechanically select products; whether Cialdini’s persuasion principles move language models; whether the Kahneman, Thaler and Ariely biases appear in models acting as agents; which third-party sources answer engines cite for product queries; and what tactics a company without such mentions can use. Each thread saved notes with inline source URLs, labelled vendor claims, and recorded gaps. A sixth pass synthesized the notes into the report that this page presents. The notes and the synthesis are in the research folder of this page’s repository so that later revisions can check what each figure rested on.
On October 17, 2026, four passes with Claude Opus 5.5 checked every number and quotation on the page against its cited page, 397 claims in all. 263 were confirmed as written. 93 were approximate and have been tightened: rounding, denominators, model versions, and paraphrases shown as quotations. 17 were credited to the wrong source and have been re-pointed. 13 had no source at the cited page and were either sourced or softened. 6 were contradicted by the current source and have been corrected. 5 could not be re-fetched.
| Verdict | Claims |
|---|---|
| Confirmed as written | 263 |
| Approximate, tightened | 93 |
| Credited to the wrong source, re-pointed | 17 |
| No source at the cited page, sourced or softened | 13 |
| Contradicted by the current source, corrected | 6 |
| Could not be re-fetched | 5 |
| Total | 397 |
The row-by-row files, with each claim, its cited page, the verdict and the source evidence, are in the research/verification folder.