About
The Information and Communication Crawler operated by Japan's National Institute of Information and Communications Technology. Collects multilingual web data for AI research and translation models.
Purpose
Multilingual AI research and translation training
User Agent String
Mozilla/5.0 (compatible; ICC-Crawler/2.0; +http://nict.go.jp/)
How to Control in robots.txt
🚫 Block ICC-Crawler
User-agent: ICC-Crawler Disallow: /
✅ Allow ICC-Crawler
User-agent: ICC-Crawler Allow: /
Is ICC-Crawler crawling your site?
Enter your URL below — scan takes under 5 seconds.
Free · No signup · Instant results