Skip to content
Published Authored byBilly Reiner

Glossary · Defined term

robots.txt.liquid

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file2. It is the only way to customise robots rules on a Shopify store. Shopify Support warns it can take down all traffic if edited incorrectly: "Incorrect use of the feature can result in loss of all traffic" — verbatim warning from the Shopify Help Center1.

The file lives at theme/templates/robots.txt.liquid. It must remain a Liquid template — it cannot be a JSON template — and it is not included in themes by default. Shopify Support's other verbatim warning: "Shopify Support can't help with edits to the robots.txt.liquid file"1. The merchant edits it; the merchant owns the consequences.

Definition

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file. It is the only way to customise robots rules on a Shopify store, and Shopify Support warns it can take down all traffic if edited incorrectly.

Per Shopify's dev docs2: robots.txt.liquid "renders the robots.txt file, which is hosted at the /robots.txt URL." The file has three components — user agent, rules, and an optional sitemap URL — rendered through the robots.default_groups Liquid object3. Changes take effect instantly when saved; crawlers may lag.

What the default rules look like

Shopify's default robots.txt disallows /admin, /cart, /checkout, /collections/*+* (filtered duplicates), /search (internal search results), and /policies/. Those defaults are emitted by the robots.default_groups Liquid object even when no robots.txt.liquid template exists in the theme — the platform serves a sensible default.

Shopify's dev docs explicitly state it is "strongly recommended to use the provided Liquid objects whenever possible" because "The default rules are updated regularly to ensure that SEO best practices are always applied"2. Translation: don't replace the Liquid with plain text; you'll lock yourself out of Shopify's future defaults.

Where the file lives

The editable file lives in the theme's templates folder, at theme/templates/robots.txt.liquid. It is created through the theme code editor. Shopify serves it at the store's root: example.com/robots.txt. The file is not in the theme by default — merchants who want to customise must manually add it.

The Liquid objects exposed to the template3: robots.default_groups, group.user_agent, group.rules, group.sitemap. The sitemap object additionally exposes directive (which returns Sitemap) and value (the sitemap URL). Together these objects let merchants extend, override, or add to Shopify's default rules without losing the platform-side updates.

Customisations Shopify allows

Per Shopify Help: merchants can allow/disallow specific URLs, add crawl-delay rules, add sitemap URLs, and block specific crawlers. The platform supports the standard robots.txt grammar — User-agent, Allow, Disallow, Crawl-delay, Sitemap — and exposes Liquid object hooks to layer custom rules on top of the defaults rather than replacing them.

The most common 2026 customisation is adding AI bot user agents to the allow list so AI engines can fetch product and policy pages at answer time — the per-bot matrix is in AI bots in Shopify's robots.txt. Less common but important: disallowing app-leftover routes when a merchant uninstalls a Shopify app whose proxy URLs Google has already indexed. One deployment detail is worth knowing before you edit anything — ThemeKit deployments preserve robots.txt.liquid across theme updates and admin theme uploads do not1, which is covered in ThemeKit and robots.txt.liquid.

The warning Shopify ships and what you should do about it

The two Shopify Support warnings quoted at the top of this page are the whole risk profile of this file: the merchant edits it at the merchant's own risk, and Shopify's support team will not unwind a bad edit.

The full install lives in robots.txt.liquid on Shopify, which covers default rules, AI bot allow lists, app-route disallows, sitemap directives, and the ThemeKit-vs-admin upload distinction. If you'd rather not edit Liquid yourself, ShopifyRanked does it in 7 days for $499.

robots.txt.liquid is the canonical Shopify SEO mechanic.

Keep reading