Skip to content

What is Baiduspider?

Baiduspider is Baidu's search crawler. Baidu uses separate user agents for some products, such as Baiduspider-image for image search, so you can set rules per product.

Operator
Baidu
Purpose
Crawls pages for Baidu search.
robots.txt token
Baiduspider
Example user agent
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
How to verify
Run a reverse DNS lookup and check that the name ends in baidu.com or baidu.jp, then confirm with a forward lookup.
Reverse DNS
baidu.com, baidu.jp
Last verified

How often is Baiduspider impersonated?

For the median organisation, 2% of requests claiming to be Baiduspider failed verification.

Measured between 14 July 2026 and 10 October 2026 across organisations protected by Centinel. We only publish a share when at least five organisations each saw enough of these requests. Pooled across all of their requests, the share was 1%: a few large organisations carry most of the traffic, so the median organisation is the better guide to what yours will see.

This directory measures requests between 14 July 2026 and 10 October 2026. The fake crawler report covers its own, earlier window (late June to 21 September 2026), so its figures differ from the ones here. Read it for the method.

Have a request that claims to be Baiduspider? Check its IP address.

Should you block Baiduspider?

Allow it if
you have visitors who search with Baidu.
Block it if
you have no audience on Baidu and the crawl adds load.
What blocking changes
Baidu says your pages can then no longer be found in Baidu search or in the search engines Baidu powers.

To block it, add this group to your robots.txt. Baidu says Baiduspider obeys robots.txt.

User-agent: Baiduspider
Disallow: /

robots.txt only asks. It does nothing against a client that ignores it or only pretends to be Baiduspider. Stopping those takes verification at your edge.

Related bots

  • 360Spider (360 Search): Crawls pages for the web search of 360 Search (so.com).
  • Applebot (Apple): Crawls pages for Spotlight, Siri and Safari search features.
  • Bingbot (Microsoft): Crawls pages for Bing search.
  • Diffbot (Diffbot): Crawls the web for the Diffbot Knowledge Graph and Diffbot's web search services.
  • DuckDuckBot (DuckDuckGo): Crawls pages for DuckDuckGo search.
  • Googlebot-Image (Google): Crawls images for Google Images and image features in Search.

See which bots reach your site, and which of them are who they claim to be.

Request a site audit