Skip to content
SEO and link-index crawlers

What is DataForSeoBot?

DataForSeoBot is DataForSEO's backlink crawler. It crawls pages and adds the links it finds to the database behind its Backlinks API.

Last verified 2026-09-30 against the operator's documentation. All bots

DataForSeoBot at a glance

Operator
DataForSEO
Type
SEO and link-index crawlers
Purpose
Adds links to DataForSEO's backlink database.
robots.txt token
DataForSeoBot
Example user agent
Mozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot)
How to verify
DataForSEO lists its subnets and a reverse DNS check on its bot page.

How often is DataForSeoBot impersonated?

For the median organisation, under 1% of requests claiming to be DataForSeoBot failed verification.

Measured between 3 July 2026 and 28 September 2026 across organisations protected by Centinel. We only publish a share when at least five organisations each saw enough of these requests. Pooled across all of their requests, the share was under 1%: a few large organisations carry most of the traffic, so the median organisation is the better guide to what yours will see.

This directory measures requests between 3 July 2026 and 28 September 2026. The fake crawler report covers its own, earlier window (late June to 21 September 2026), so its figures differ from the ones here. Read it for the method.

Have a request that claims to be DataForSeoBot? Check its IP address.

Should you block DataForSeoBot?

Allow it if
you or your partners use this tool's backlink or audit data, or the crawl load is not a concern.
Block it if
the crawl load is noticeable and you have no use for the tool's data. Blocking it does not affect search rankings.
What blocking changes
DataForSEO stops adding your links to its backlink database.

To block it, add this group to your robots.txt. DataForSEO says the bot obeys robots.txt and Crawl-delay.

User-agent: DataForSeoBot
Disallow: /

robots.txt only asks. It does nothing against a client that ignores it or only pretends to be DataForSeoBot. Stopping those takes verification at your edge.

Questions

DataForSeoBot: common questions

See which bots reach your site, and which of them are who they claim to be.

What is DataForSeoBot?

DataForSeoBot is DataForSEO's backlink crawler. It crawls pages and adds the links it finds to the database behind its Backlinks API.

How do I verify that a request is really DataForSeoBot?

DataForSEO lists its subnets and a reverse DNS check on its bot page. The user agent alone proves nothing: any client can send it.

How do I block DataForSeoBot in robots.txt?

Add a group for User-agent: DataForSeoBot with Disallow: /. DataForSEO says the bot obeys robots.txt and Crawl-delay. robots.txt only asks. A client that ignores it, or pretends to be DataForSeoBot, has to be stopped at your edge.

What happens if I block DataForSeoBot?

DataForSEO stops adding your links to its backlink database.

Related bots

  • AhrefsBot (Ahrefs): Builds the link database behind Ahrefs and the Yep search engine.
  • SemrushBot (Semrush): Collects web data for Semrush's SEO tools.
  • MJ12bot (Majestic): Maps links between websites for Majestic's link index.
  • DotBot (Moz): Gathers data for the Moz Link Index.
  • Barkrowler (Babbar): Collects links and page metadata for Babbar.