← Fix-it library

Unblock GPTBot so ChatGPT can see your site

Published· by

Your robots.txt currently blocks GPTBot, OpenAI’s crawler. That makes your site invisible to the models behind ChatGPT - the most-used AI assistant in the world. Whatever ChatGPT tells users about your business, it’s building it from everyone’s content except yours.

Why is GPTBot blocked?

Usually by accident. Common causes: a copied “block all AI scrapers” robots.txt from 2023, a security plugin’s bot list, or a blanket Disallow: / under User-agent: * that GPTBot inherits because it has no group of its own.

How do you unblock GPTBot?

Open your robots.txt and look for either User-agent: GPTBot followed by a Disallow: /, or a User-agent: * group whose disallow rules GPTBot is inheriting. Remove the blocking rule, or override it with an explicit group:

User-agent: GPTBot
Allow: /

A named group takes precedence over * for that bot, so this one block is enough even if broader rules stay. Blocks tend to travel in packs, so check ClaudeBot next while you have the file open.

Anything else blocking ChatGPT?

Check your CDN or firewall (Cloudflare’s “Block AI bots” toggle is a frequent culprit) - robots.txt permission means nothing if the request gets a 403. Our scanner tests that separately: see the firewall check. After deploying, rescan your site to confirm both pass.

See where your site stands. The free scan takes about fifteen seconds and shows every fix.

Run a free AI visibility scan

Written by

Abdul Jaafar is the founder of AIOScan and runs Mason, a marketing agency focused on search and AI visibility for local businesses. He built AIOScan because most AI visibility scores are made up, and he wanted one that isn't. More on the about page.