Centinel surfaces free self-serve crawler check on every page
The /tools/robots-txt-analyzer now appears as a hero-level CTA on the home page and as the first link in the standardized bottom-of-page CTA block. Pattern borrowed from the self-serve checks DataDome and Kasada ship on their marketing sites.
What the tool does
The analyzer at /tools/robots-txt-analyzer takes any domain, fetches its robots.txt, and parses which AI crawlers the policy addresses. It flags three things on the result page: which major named agents the site has rules for, which agents the site is silently open to, and which rules are likely to be honored versus ignored based on published crawler behavior. No account, no credit card, no sales follow-up gate. The result page links out to the relevant /crawlers profile for each named agent.
Why the placement changed
Curious visitors do not book demos. The previous placement, buried two clicks deep under a Tools nav item, was treating the analyzer like a feature page. DataDome runs a Test your site button above the fold. Kasada runs a Check my site link in the hero. Both vendors surface the self-serve path as a primary CTA on every page of the marketing site, not a secondary utility. Centinel now does the same.
What the standardized bottom block looks like
A five-link row appears below every page: the analyzer, the free audit, the pricing page, the compare pages, and the press hub. The row repeats in identical order on every page. The pattern is lifted directly from DataDome's landing pages, which ship the same block on every marketing URL, with the single difference that Centinel's primary self-serve link is the analyzer instead of an email-gated demo form.
What the pilot showed
During a two-week internal test before the site-wide launch, the analyzer ran against domains the team entered manually. The pattern held: visitors who used the tool first were more likely to schedule a call later, compared to visitors who never touched it. Numbers were small and qualitative at that sample size, so no percentage is published here. A larger data release will follow once the feature has run for a full quarter.