← AI crawler directory
Search
YisouSpider
UCWeb / Alibaba (Shenma)Honours robots.txt
Crawls to build the index for Shenma (SM.CN), the mobile search engine from UCWeb and Alibaba. Relevant to Shenma search visibility on Chinese mobile. No confirmed link to Qwen's retrieval.
User-agent string
Mozilla/5.0 (compatible; YisouSpider/5.0; +http://www.yisou.com/help/help_faq.html)
How to verify it
Alibaba ASN verification.
What blocking costs
Relevant to Shenma search visibility on Chinese mobile. No confirmed link to Qwen's retrieval.
robots.txt rule
# Block YisouSpider
User-agent: YisouSpider
Disallow: /
# Allow everything else
User-agent: *
Allow: /Robots.txt is enough
UCWeb / Alibaba (Shenma) documents YisouSpider as honouring robots.txt. Verify with your logs after deploying — a spoofed agent will keep coming.
Generate a full robots.txt
Pick which AI crawlers to allow or block across all 42 agents and copy the file out.
Open the generator →