Variant

bot-category

Categories of detected bots.

variant bot-category {
  none,
  suspected,
  accessibility,
  ai-crawler,
  ai-fetcher,
  content-fetcher,
  monitoring-site-tools,
  online-marketing,
  page-preview,
  platform-integrations,
  research,
  search-engine-crawler,
  search-engine-optimization,
  security-tools,
  extra(extra-bot-category),
}

Cases

Case	Payload	Description
none	—	No bot was detected.
suspected	—	A suspected bot.
accessibility	—	Tools that make content accessible (e.g., screen readers).
ai-crawler	—	Crawlers used for training AIs and LLMs, generally used for building AI models or indexes.
ai-fetcher	—	Fetchers used by AIs and LLMs for enriching results in response to a user query.
content-fetcher	—	Tools that extract content from websites to be used elsewhere.
monitoring-site-tools	—	Tools that access your website to monitor things like performance, uptime, and proving domain control.
online-marketing	—	Crawlers from online marketing platforms (e.g., Facebook, Pinterest).
page-preview	—	Tools that access your website to show a preview of the page in other online services and social media platforms.
platform-integrations	—	Integration with other platforms by accessing the website's API, notably Webhooks.
research	—	Commercial and academic tools that collect and analyze data for research purposes.
search-engine-crawler	—	Crawlers that index your website for search engines.
search-engine-optimization	—	Tools that support search engine optimization tasks (e.g., link analysis, ranking).
security-tools	—	Security analysis tools that inspect your website for vulnerabilities, misconfigurations and other security features.
extra	extra-bot-category	Additional bot kinds may be added in the future via this resource type.