See every bot on your site.
Decide which ones stay.
Centinel unmasks stealth crawlers hiding as humans and catalogues every declared bot — search engines, AI agents, scrapers and more — so you allowlist who you want and block the rest.
- Stealth + identifying
- two-mode detection
- <2ms
- verdict on every request
- One dashboard
- manage every bot from one place
Online newspapers & digital magazines
AI companies scrape your articles, bypass your paywall, and train models on your journalism — without paying a cent.
Two modes. One dashboard.
Catch the ones pretending to be human.
Headless browsers, residential-proxy traffic, fingerprint-spoofing scrapers — they don't behave like real visitors, and we see it. Every request gets a verdict in milliseconds.
- Multi-signal verification, not user-agent guessing
- Behavioural and traffic-pattern analysis
- Catches the traffic other tools miss
Sort the ones that announce themselves.
Bots that identify honestly get filed by category — search engines, AI agents, research crawlers, archivers, scrapers, and more — so you choose your policy per category or per agent.
- GPTBot
- ClaudeBot
- PerplexityBot
- GoogleBot
- Bingbot
- Applebot
- Amazonbot
- Meta-ExternalAgent
- GoogleOther
- Bytespider
- CCBot
- YandexBot
1,600+ identifying crawlers in the management dashboard, sorted by category and updated continuously. Browse the catalogue
Live in three steps. No IT ticket needed.
Most customers are fully protected the same day they sign up.
Add the browser script
A lightweight script loads on protected pages and sets a session cookie. Pre-built for Cloudflare Workers, CloudFront, Fastly, and 12 more.
We validate every request
Your infrastructure calls our validation API. In under 2ms, Centinel returns a decision: allow, block, or challenge, with full crawler metadata.
You control the outcome
Allow, block, or watchlist. Your dashboard shows who's crawling, how often, and what they're after.
What we're not.
Not a WAF
Web application firewalls catch volumetric attacks. We catch the bots they miss.
Centinel vs. CloudflareWhat companies ask before signing up
We already use Cloudflare — why do we need Centinel?
Cloudflare uses static IP-based rules and generic WAF signatures. Sophisticated AI crawlers bypass them easily. Centinel uses behavioral fingerprinting tuned specifically to content scrapers, combining a browser script with server-side validation to detect new agents within hours.
Will it block real users or search engines?
No. Centinel distinguishes between automated bots and human visitors with high accuracy. Verified crawlers like Googlebot are automatically allowlisted.
How does the integration work?
A lightweight browser script sets a tracking cookie on protected pages. Your infrastructure calls our validation API for real-time decisions. Pre-built integrations for 16+ platforms including Cloudflare Workers, CloudFront, Fastly, WordPress, and more.
Does it work for industries beyond publishing?
Yes. Centinel protects any site with high-value data — retail, travel, finance, streaming.
What decisions can I make per crawler?
Allow, block, or add to your watchlist. The dashboard shows real-time metadata including company, category, and access frequency.
Can we trial it before committing?
Yes — we offer up to 1-month discounted pilots for qualifying companies.
Contact us
Questions about AI crawler detection? We'll reply within 24 hours.
Pick the next step that fits where you are
Demo, self-serve check, pricing, or a quiet email. Whichever maps to your stage.