prerender[ OBSERVATORY ]
[ Machine ] [ AI training ]

GPTBot

OpenAI's training crawler. It collects public pages that OpenAI may use to train its models. It is one of three OpenAI machines, and each one answers to its own robots.txt rules.

OperatorOpenAI
What it's forTraining data
Renders JavaScriptNot yet observed
Verify byIP list

Who runs it

OpenAI. It names itself with the token GPTBot.

User agent, as OpenAI documents it
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot

What it does

It collects pages for model training. It doesn't decide whether ChatGPT can find you: that's OAI-SearchBot, which builds ChatGPT's search index. And when someone asks ChatGPT to open a page, ChatGPT-User fetches it.

Renders JavaScript

Not yet observed. OpenAI doesn't say whether GPTBot runs scripts, and this site hasn't recorded a verified visit yet. A page that needs JavaScript to show its content is a risk for any machine that doesn't say.

How to verify it

Match the visiting address against OpenAI's published list. OpenAI documents no reverse DNS check.

gptbot.json, OpenAI's IP list

robots.txt

Rules under User-agent: GPTBot apply to it. OpenAI says disallowing it indicates a site's content should not be used to train its models, and leaves ChatGPT search untouched.

Block training, keep ChatGPT search
User-agent: GPTBot
Disallow: /

User-agent: OAI-SearchBot
Allow: /

Questions

If I block GPTBot, will ChatGPT stop citing me?

No. Citations in ChatGPT search come from OAI-SearchBot's index and from ChatGPT-User's live fetches.

Does ChatGPT-User follow robots.txt?

OpenAI says robots.txt rules may not apply to it, because a person asked for the page.

Last checked against OpenAI's documentation: 31 Oct 2026Verified visits recorded here: shown once the site is live