Free AI crawler check, no signup
Can ChatGPT read your website?
Every website can have a robots.txt file that tells robots what they may read. Type your website address to see which AI assistants it lets in: ChatGPT, Perplexity, Claude and Gemini.
Where this comes from
What each robot does, in its maker’s own words.
Each AI company documents its robots. The check reads your file the way the robots.txt standard (RFC 9309) describes: the rules written for a robot, or the rules for all robots, with the longest matching rule winning.
OpenAI (ChatGPT)
OAI-SearchBotChatGPT-UserGPTBot
OpenAI says each of these settings is independent: a site can allow search and block training.
Read the official pagePerplexity
PerplexityBotPerplexity-User
PerplexityBot shows and links sites in answers and isn’t used to train AI models.
Read the official pageAnthropic (Claude)
Claude-SearchBotClaude-UserClaudeBot
Anthropic says blocking Claude-SearchBot or Claude-User may reduce a site’s visibility in Claude’s search results.
Read the official pageGoogle (Gemini)
GooglebotGoogle-Extended
Google-Extended isn’t a separate robot. It’s a name in robots.txt that tells Google whether Gemini may use what Google crawls.
Read the official pageThe standard itself: RFC 9309, Robots Exclusion Protocol.
If something is blocked
The fix is usually a few lines in one file.
Whoever manages your website can edit robots.txt. For ChatGPT and Claude, the robots that collect pages for model training are separate from the ones that find sites for answers, so a site can block one and allow the other.
Being readable doesn’t mean being named. To see what an assistant actually answers when a customer asks for your line of work in your city, run the free check.
See what ChatGPT answers about your business
One real question, asked live, with your business highlighted if it’s named. It’s free.
Check your business