About
Alibaba's web crawler associated with the Qwen family of large language models. Qwen is one of the leading LLMs out of China, developed by Alibaba Cloud. QwenBot crawls international websites to improve Qwen's multilingual knowledge.
Purpose
AI model training data collection
User Agent String
Mozilla/5.0 (compatible; QwenBot/1.0; +https://qwenlm.github.io)
How to Control in robots.txt
🚫 Block QwenBot
User-agent: QwenBot Disallow: /
✅ Allow QwenBot
User-agent: QwenBot Allow: /
Is QwenBot crawling your site?
Run a free scan to check if Alibaba Cloud's crawler is accessing your website.
Check if QwenBot is crawling YOUR site →