prerender[ OBSERVATORY ]
[ Machines ]

18 machines, and how each one reads your site

Search engines, AI answer engines and link previews each send their own. Each row links to a page on how to verify that machine and what it honors in robots.txt.

MachineOperatorWhat it's forRenders JavaScriptVerify by
GooglebotGoogleSearch indexYesReverse DNS, IP list
Google-InspectionToolGoogleSearch Console live testsNot yet observedReverse DNS, IP list
BingbotMicrosoftSearch indexYesReverse DNS, IP list
GPTBotOpenAITraining dataNot yet observedIP list
OAI-SearchBotOpenAIChatGPT search indexNot yet observedIP list
ChatGPT-UserOpenAIFetches a page when someone asks ChatGPTNot yet observedIP list
ClaudeBotAnthropicTraining dataNot yet observedIP list
Claude-SearchBotAnthropicSearch index for Claude's answersNot yet observedIP list
Claude-UserAnthropicFetches a page when someone asks ClaudeNot yet observedIP list
PerplexityBotPerplexityPerplexity's search indexNot yet observedIP list
Perplexity-UserPerplexityFetches a page when someone asks PerplexityNot yet observedIP list
ApplebotAppleSearch features across Apple productsMay renderReverse DNS, IP list
AmazonbotAmazonImproves Amazon's products and servicesNot yet observedIP list
DuckDuckBotDuckDuckGoSearch indexNot yet observedIP list
CCBotCommon CrawlOpen web archiveNoReverse DNS, IP list
LinkedInBotLinkedInLink previewsNot yet observedThe operator doesn't say
SlackbotSlackLink previewsNot yet observedNo published check
facebookexternalhitMetaLink previews on Facebook and WhatsAppNot yet observedNot yet observed

Not yet observed means the operator doesn't say and this site hasn't recorded a verified visit yet. Download the table as CSV. Large file test: about 5 MB of padding, no observations.