Skip to content

AI Crawlers

OAI-SearchBot vs GPTBot vs ChatGPT-User on Shopify

Published

The three OpenAI bots that visit Shopify stores

OpenAI runs three crawlers. GPTBot collects training data for future model versions. OAI-SearchBot powers ChatGPT search citations — the live web index ChatGPT references for answers that cite sources. ChatGPT-User handles on-demand URL fetches when a user references a link in a ChatGPT conversation. Three bots, three roles. Blocking the wrong one in robots.txt.liquid erases the store from a specific surface; getting them confused is the #1 mistake in 2024-era 'block AI bots' templates.

OpenAI's bot documentation1 names all three explicitly and clarifies their roles. Shopify's editing-robots help page2 documents the robots.txt.liquid syntax for controlling each.

The role matrix

Each bot affects a different surface. GPTBot affects future model training. OAI-SearchBot affects today's ChatGPT search citations. ChatGPT-User affects mid-conversation page fetches. Getting these straight is the difference between a deliberate training opt-out and an accidental erasure from ChatGPT search.

BotWhat it affectsBlock cost
GPTBotFuture OpenAI model trainingSlow, long-term: next-gen GPT may not know your brand
OAI-SearchBotChatGPT search live citationsImmediate, severe: ChatGPT search stops citing you
ChatGPT-UserOn-demand fetches when users reference URLsModerate: ChatGPT can't fetch your URLs mid-conversation

The common 2024 mistake

In 2024, agency blog posts widely recommended blocking 'AI bots' via a wildcard or via blocking GPTBot specifically. Many of those templates blocked GPTBot and OAI-SearchBot together, sometimes via a User-agent: * Disallow that affected all OpenAI bots. Stores that pasted these templates in 2024 found themselves erased from ChatGPT search by mid-2025 — exactly when ChatGPT search became a meaningful traffic source.

Per-bot decision tree

Three decisions, one per bot. Most stores want allow on all three. Stores opting out of training only block GPTBot. Stores opting out of all OpenAI products block all three — a defensible but rare choice.

  1. GPTBot: Allow for inclusion in future model training; Disallow for training opt-out.
  2. OAI-SearchBot: Always allow if you want ChatGPT search citations. Disallowing erases you from ChatGPT search.
  3. ChatGPT-User: Always allow if you want ChatGPT to fetch your URLs when users reference them in chat.

OpenAI bot audit checklist

Six checks. Walk these on every Shopify store before any other AI-visibility work — the bot-block trap is the highest-impact, fastest-fix gap in 2026 audits.

  1. Open theme code editor. Look for templates/robots.txt.liquid.
  2. Search for 'GPTBot' (case-sensitive). Note any Disallow rules.
  3. Search for 'OAI-SearchBot'. Confirm NOT blocked unless deliberate.
  4. Search for 'ChatGPT-User'. Confirm NOT blocked unless deliberate.
  5. Look for wildcard User-agent: * blocks that may inadvertently catch OpenAI bots.
  6. Verify live: curl https://yourstore.com/robots.txt and confirm the rules match intent.

Keep reading