ChatGPT-User, the agent that fetches pages for ChatGPT users
ChatGPT-User is the agent ChatGPT uses to visit a page when a user's question calls for it. OpenAI says it doesn't crawl the web automatically and that, because a user starts each visit, robots.txt rules may not apply to it.
Checked against OpenAI's own documentation on October 13, 2026.
What ChatGPT-User is for.
OpenAI says it uses ChatGPT-User for certain user actions in ChatGPT and Custom GPTs: when a user asks a question, ChatGPT may visit a web page with a ChatGPT-User agent. It is not used for crawling the web in an automatic fashion, and not used to determine whether content may appear in search.[1]
Run by
OpenAI
Its job
A person's request. It visits a page when someone asks the assistant about it, and doesn't crawl on its own.
Its name in robots.txt
ChatGPT-UserDoes it follow robots.txt?
Not always, by its operator's account. OpenAI says that because ChatGPT-User's actions are initiated by a user, robots.txt rules may not apply.[1]
Its IP ranges
OpenAI publishes ChatGPT-User's IP addresses as a JSON file.[1] openai.com/chatgpt-user.json
It also runs GPT Actions
OpenAI says ChatGPT users may also interact with external applications through GPT Actions, under the same agent.[1]
It doesn't decide search
OpenAI says ChatGPT-User is not used to determine whether content may appear in search, and points to OAI-SearchBot for that.[1]
Full string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
The lines that allow and block ChatGPT-User.
Each pair of lines is a group of its own in robots.txt. The robots.txt generator writes the whole file, and the robots.txt checker reads what yours says to ChatGPT-User now.
Allow ChatGPT-User
With no robots.txt, or one that doesn't disallow it, ChatGPT-User is allowed already. These lines say so by name: a crawler that finds a group with its own name follows that group, and follows the
User-agent: *group only when it finds none.[2]User-agent: ChatGPT-User Allow: /
Block ChatGPT-User
A Disallow line may not stop it. OpenAI says that because a user starts these actions, robots.txt rules may not apply. To manage search opt outs and automatic crawling, OpenAI says to use OAI-SearchBot in robots.txt.[1]
User-agent: ChatGPT-User Disallow: /
How many cited sites block ChatGPT-User.
We read the robots.txt of the 1,605 sites our recorded AI answers cited, for the 13 crawlers the X-ray reads for.
of cited sites close their homepage to ChatGPT-User in robots.txt: 20 of 1,529.
Blue: ChatGPT-User. Gray: the other 12 crawlers the X-ray reads for.
OpenAI's other crawlers.
OpenAI gives each job its own name in robots.txt, so one can be allowed and another blocked.[1]
Questions about ChatGPT-User.
What is ChatGPT-User?
ChatGPT-User is the agent OpenAI uses for certain user actions in ChatGPT and Custom GPTs. When a user asks a question, ChatGPT may visit a web page with it. OpenAI says it is not used for crawling the web in an automatic fashion.
Does ChatGPT-User obey robots.txt?
Not always. OpenAI says that because ChatGPT-User's actions are initiated by a user, robots.txt rules may not apply. Only a firewall rule stops an agent that doesn't follow robots.txt, and OpenAI publishes the IP addresses to match. Firewalls and AI crawlers
What is the ChatGPT-User user agent string?
OpenAI gives the full string as: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot.
Is ChatGPT-User the same as GPTBot?
No. ChatGPT-User fetches a page when a ChatGPT user asks for it. GPTBot crawls content that may be used to train OpenAI's models, and OAI-SearchBot crawls for ChatGPT's search results. Each has its own name in robots.txt and its own published IP list.
How many sites block ChatGPT-User?
In our study, 20 of 1,529 sites (1.3%) close their homepage to ChatGPT-User in robots.txt. The base is the sites cited in AI answers about AI visibility tools and web analytics whose robots.txt we could read, or that have none, so other fields may differ. What the cited sites allow
Where each fact comes from.
Each numbered source is the page a fact comes from, most of them OpenAI's own documentation, read on October 13, 2026. The answers above repeat facts marked on the page. Vendors change these pages, so check them before you act.
- 1OpenAI: Overview of OpenAI Crawlersdevelopers.openai.com/api/docs/bots
- 2IETF: RFC 9309: Robots Exclusion Protocolrfc-editor.org/rfc/rfc9309.html
Keep reading
- The free AI crawler checkerTest your robots.txt against every crawler here, and fetch your homepage as the ones that answer questions.
- The free robots.txt checkerSee what your robots.txt tells each AI crawler, page by page.
- The free robots.txt generatorPick the crawlers to allow and block, and copy the file.
- Which AI crawlers to allowThe crawlers by the job each does, and what the sites AI cites allow.
- robots.txt for AI crawlersHow crawlers read the file, with rules to copy.
- OAI-SearchBotFinds pages for ChatGPT's search results.
- GPTBotCollects content that may train OpenAI's models.
- AI crawlers listThe 13 crawlers the X-ray reads for, by the company that runs them: user agents, robots.txt names and what blocking each does.
Find out what AI says about your site.
Paste your URL and leave with a ranked list of what to fix, with steps and code.
- Free
- No account