1592+ Crawler profiliert
Crawler-Verzeichnis
Alle Web-Crawler und KI-Bots, die wir verfolgen. Was sie tun, wer sie betreibt und wie Sie Ihre Inhalte davor schützen.
Cocolyzebot — What It Is and How to Handle It
Cocolyzebot analyzes websites for the Cocolyze SEO platform, providing keyword tracking, site audits, and competitor analysis.
SEO ToolSEO Tool
coccocbot-web — What It Is and How to Handle It
coccocbot-web is Cốc Cốc's web crawler for indexing Vietnamese and international content for Vietnam's major search engine.
Search EngineSearch Engine
coccocbot-image — What It Is and How to Handle It
coccocbot-image is the image crawler for Cốc Cốc, a Vietnamese search engine and web browser. This bot crawls and indexes images from websites to populate image search results for Cốc Cốc users.
Search EngineSearch Engine
coccocbot — What It Is and How to Handle It
coccocbot is the web crawler for Coc Coc, a Vietnamese search engine and browser. It indexes websites to provide search results for Vietnamese users.
Search EngineSearch Engine
coccoc — What It Is and How to Handle It
CocCoc is the web crawler for Cốc Cốc, Vietnam's second largest search engine with over 30 million users, focused on Vietnamese-language content.
Search EngineSearch Engine
Cốc Cốc — What It Is and How to Handle It
Cốc Cốc is a search engine crawler. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Search EngineSearch Engine
CMS-Checker — What It Is and How to Handle It
CMS-Checker is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
cludo.com bot — What It Is and How to Handle It
cludo.com bot is a crawler operated by Cludo, a site search platform that provides search and discovery solutions for websites. The bot likely crawls and indexes website content to power Cludo's internal site search functionality for their customers.
Search EngineSearch Engine
cludo.com — What It Is and How to Handle It
cludo.com is the web crawler bot that indexes and analyzes website content to provide AI-driven site search solutions, search analytics, and content optimization for over 1000+ websites globally.
Search EngineSearch Engine
CloudVertexBot — What It Is and How to Handle It
CloudVertexBot is a Google-operated crawler available to site owners to request targeted crawls of their own sites for AI training purposes on the Vertex AI platform.
AI CrawlerAI Training
CloudflareDiagnostics — What It Is and How to Handle It
CloudflareDiagnostics is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
cloudflare-csup — What It Is and How to Handle It
cloudflare-csup is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
Cloudflare-AutoRAG — What It Is and How to Handle It
Cloudflare-AutoRAG is Cloudflare's web crawler that indexes websites for AI Search (formerly AutoRAG), a managed retrieval-augmented generation service. The crawler automatically ingests and continuously indexes website content to enable natural language search and AI-powered applications without requiring manual reprocessing.
AI SearchAI Search
CloudFlare-AlwaysOnline — What It Is and How to Handle It
CloudFlare-AlwaysOnline is Cloudflare's caching crawler that stores static versions of websites to serve when origin servers are unavailable, integrating with Internet Archive.
ArchiverArchiver
Cloudflare SpeedTest — What It Is and How to Handle It
Cloudflare SpeedTest is a bot operated by Cloudflare that performs speed tests to measure website performance and connectivity. It may visit websites to test network latency, bandwidth, and overall loading times as part of Cloudflare's performance monitoring services.
OtherOther
Cliqzbot — What It Is and How to Handle It
Cliqzbot was the crawler for Cliqz, a German privacy-focused search engine and browser. Cliqz shut down in 2020.
Search EngineSearch Engine
ClickUpLinkUnfurler — What It Is and How to Handle It
ClickUpLinkUnfurler is a bot operated by ClickUp, a project management and productivity platform. It fetches webpage content to generate link previews when users paste URLs into ClickUp conversations or tasks.
OtherOther
Clickagy Intelligence Bot v2 — What It Is and How to Handle It
Clickagy Intelligence Bot v2 performs advanced ad verification, privacy compliance tracking, and digital advertising intelligence gathering across websites for market analysis and optimization.
MonitoringMonitoring
Clickagy Intelligence Bot — What It Is and How to Handle It
Clickagy Intelligence Bot is a web crawler operated by Clickagy, a company that gathers intelligence and data from websites. This bot is classified as an Intelligence Gatherer and likely collects information for business intelligence, marketing analytics, or audience insight purposes.
ResearchResearch
ClarityBot — What It Is and How to Handle It
ClarityBot is Microsoft Clarity's web analytics crawler that collects user behavior data for heatmaps and session recordings.
MonitoringMonitoring
Clarity-Bot — What It Is and How to Handle It
Clarity-Bot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
citoid — What It Is and How to Handle It
citoid is Wikimedia's citation generation service that fetches metadata from URLs, DOIs, and ISBNs to automatically create formatted citations in Wikipedia and other wikis, using Zotero's translation server for accurate bibliographic data.
ResearchResearch
citeseerxbot — What It Is and How to Handle It
citeseerxbot is the crawler for CiteSeerX, a scientific literature digital library and search engine focused on computer and information science.
ResearchResearch
CISPA Webcrawler — What It Is and How to Handle It
CISPA Webcrawler is a research crawler operated by CISPA Helmholtz Center for Information Security in Germany.
ResearchResearch
Cision — What It Is and How to Handle It
Cision is a PR and media monitoring crawler that tracks news coverage and brand mentions for communications professionals.
MonitoringMonitoring
Cincraw — What It Is and How to Handle It
Cincraw is a monitoring and analytics crawler that collects web data for business intelligence and competitive analysis.
MonitoringMonitoring
Chirp — What It Is and How to Handle It
Chirp is a crawler, possibly related to Twitter/X integrations or bird-watching data collection.
OtherOther
CherryPickerSE — What It Is and How to Handle It
CherryPicker/CherryPickerElite/CherryPickerSE are web scraping tools that selectively extract content from websites.
ScraperScraper
CherryPickerElite — What It Is and How to Handle It
CherryPicker/CherryPickerElite/CherryPickerSE are web scraping tools that selectively extract content from websites.
ScraperScraper
CherryPicker — What It Is and How to Handle It
CherryPicker/CherryPickerElite/CherryPickerSE are web scraping tools that selectively extract content from websites.
ScraperScraper