About
Exa.ai (formerly Metaphor) is a neural search engine built for AI applications. ExaBot crawls the web to power Exa's semantic search API, which is used by thousands of AI agents and LLM-powered products to fetch relevant, up-to-date web content.
Purpose
Neural search indexing for AI applications
User Agent String
Mozilla/5.0 (compatible; Exa-Search/1.0; +https://exa.ai)
How to Control in robots.txt
🚫 Block ExaBot
User-agent: ExaBot Disallow: /
✅ Allow ExaBot
User-agent: ExaBot Allow: /
Is ExaBot crawling your site?
Enter your URL below — scan takes under 5 seconds.
Free · No signup · Instant results