Skip to content
SEO and link-index crawlers

What is Barkrowler?

Barkrowler is Babbar's crawler. Babbar says it keeps the links and page metadata it finds, not the crawled content itself.

Last verified 2026-09-30 against the operator's documentation. All bots

Barkrowler at a glance

Operator
Babbar
Type
SEO and link-index crawlers
Purpose
Collects links and page metadata for Babbar.
robots.txt token
barkrowler
How to verify
Check that the reverse DNS name ends in babbar.eu, or check the source IP against Babbar's published ranges.
Reverse DNS
babbar.eu
Operator documentation
https://www.babbar.tech/crawler

How often is Barkrowler impersonated?

For the median organisation, under 1% of requests claiming to be Barkrowler failed verification.

Measured between 3 July 2026 and 28 September 2026 across organisations protected by Centinel. We only publish a share when at least five organisations each saw enough of these requests. Pooled across all of their requests, the share was under 1%: a few large organisations carry most of the traffic, so the median organisation is the better guide to what yours will see.

This directory measures requests between 3 July 2026 and 28 September 2026. The fake crawler report covers its own, earlier window (late June to 21 September 2026), so its figures differ from the ones here. Read it for the method.

Have a request that claims to be Barkrowler? Check its IP address.

Should you block Barkrowler?

Allow it if
you or your partners use this tool's backlink or audit data, or the crawl load is not a concern.
Block it if
the crawl load is noticeable and you have no use for the tool's data. Blocking it does not affect search rankings.
What blocking changes
Babbar stops crawling your site.

To block it, add this group to your robots.txt. Babbar says Barkrowler respects robots.txt and Crawl-delay, and by default waits 5 seconds between requests to the same host.

User-agent: barkrowler
Disallow: /

robots.txt only asks. It does nothing against a client that ignores it or only pretends to be Barkrowler. Stopping those takes verification at your edge.

Questions

Barkrowler: common questions

See which bots reach your site, and which of them are who they claim to be.

What is Barkrowler?

Barkrowler is Babbar's crawler. Babbar says it keeps the links and page metadata it finds, not the crawled content itself.

How do I verify that a request is really Barkrowler?

Check that the reverse DNS name ends in babbar.eu, or check the source IP against Babbar's published ranges. The user agent alone proves nothing: any client can send it.

How do I block Barkrowler in robots.txt?

Add a group for User-agent: barkrowler with Disallow: /. Babbar says Barkrowler respects robots.txt and Crawl-delay, and by default waits 5 seconds between requests to the same host. robots.txt only asks. A client that ignores it, or pretends to be Barkrowler, has to be stopped at your edge.

What happens if I block Barkrowler?

Babbar stops crawling your site.

Related bots

  • AhrefsBot (Ahrefs): Builds the link database behind Ahrefs and the Yep search engine.
  • SemrushBot (Semrush): Collects web data for Semrush's SEO tools.
  • MJ12bot (Majestic): Maps links between websites for Majestic's link index.
  • DotBot (Moz): Gathers data for the Moz Link Index.
  • DataForSeoBot (DataForSEO): Adds links to DataForSEO's backlink database.