About
Cohere's web crawler for training their enterprise AI models. Cohere focuses on business-oriented AI and uses crawled data to train language models for enterprise search and generation.
Purpose
Enterprise AI model training
User Agent String
cohere-ai
How to Control in robots.txt
🚫 Block cohere-ai
User-agent: cohere-ai Disallow: /
✅ Allow cohere-ai
User-agent: cohere-ai Allow: /
Complete Guide: How to Block cohere-ai
Server-level blocking, nginx configs, Cloudflare rules, Next.js middleware, and more →
Is cohere-ai crawling your site?
Run a free scan to check if Cohere's crawler is accessing your website.
Check if cohere-ai is crawling YOUR site →