← AI crawler directory
Search
PetalBot
HuaweiHonours robots.txt
Crawls for Petal Search and Huawei assistant features. Matters mainly for Huawei-device markets.
User-agent string
Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
How to verify it
Reverse DNS to petalsearch.com.
What blocking costs
Matters mainly for Huawei-device markets.
robots.txt rule
# Block PetalBot
User-agent: PetalBot
Disallow: /
# Allow everything else
User-agent: *
Allow: /Robots.txt is enough
Huawei documents PetalBot as honouring robots.txt. Verify with your logs after deploying — a spoofed agent will keep coming.
Generate a full robots.txt
Pick which AI crawlers to allow or block across all 42 agents and copy the file out.
Open the generator →