Centinel featured in Deutschlandfunk

In a recent interview with Deutschlandfunk, our co-founder Frederick Jahn spoke about the growing impact of AI-driven crawlers and automated agents on publisher websites and digital infrastructure.

During the conversation, he explained how rapidly increasing volumes of non-human traffic are placing measurable strain on websites, driving up hosting and CDN costs and, in some cases, affecting performance and reliability for human users. A key challenge, he noted, is that much of this traffic remains opaque, making it difficult for publishers to understand who is accessing their content and at what scale.

Frederick also addressed the limitations of traditional tools such as robots.txt, emphasizing that these mechanisms were never designed to enforce rules against modern AI systems and largely rely on voluntary compliance. As AI usage accelerates, he argued, publishers need more robust, technical ways to gain transparency and exert control over automated access.

The interview situates the issue in a broader context of digital sovereignty and sustainability for publishers, highlighting why managing AI crawler traffic is becoming a strategic priority comparable to earlier challenges like ad fraud or infrastructure security.