The websites GPTBot crawls may be used to improve future OpenAI models. Sources that require paywall access or collect personally identifiable information are filtered. By allowing GPTBot on your site, you help AI models become more accurate and ensure that your information appears there. At the same time, you also provide your content for free to train ChatGPT.
Do you want to block GPTBot?
If you want to deny GPTBot access to your site, you can add it to your site's robots.txt as follows:
User-agent: GPTBot
Disallow: /
Do you want to customize GPTBot access?
If you only want to allow GPTBot to access certain parts france number dataset of your site, you can add this to your site's robots.txt file like this:
The ChatGPT user agent is used by plugins in ChatGPT . This user agent is only used to perform direct actions on behalf of ChatGPT users and does not automatically crawl the web.
User-Agent-Token: ChatGPT-User
Vollständiger User-Agent-String: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible;
To allow plugins to access your website, you can explicitly add the ChatGPT user agent in your site's robots.txt:
User-agent: ChatGPT-User
Disallow:
Allow the ChatGPT user agent for specific directories
If you only want to allow plugins to access certain parts of your website, you can add the ChatGPT user agent to your site's robots.txt as follows:
User-agent: ChatGPT-User
Disallow:
Allow: /verzeichnis-1/
Allow: /verzeichnis-2/
Block the ChatGPT user agent in robots.txt