Crawler-Verzeichnis

AddThis.com is a bot operated by Oracle that fetches web content for their social sharing and website tools service. This bot visits websites to gather preview information such as titles, descriptions, and images to generate share buttons and content recommendations.

AddSearchBot is a web crawler that indexes website content for AddSearch's AI-powered site search solution, collecting data to provide fast and accurate search results.

AdBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

adbeat-check-access-script is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

adbeat_bot collects advertising intelligence data for Adbeat, a competitive intelligence platform that tracks display ad campaigns, creatives, and media buying strategies.

Adagiobot is a web crawler that analyzes websites for advertising demand optimization, helping publishers maximize revenue through real-time bidding analysis and performance insights.

Acunetix Web Vulnerability Scanner audits web applications for security vulnerabilities with 99.98% accuracy, detecting over 12,000 vulnerability types.

Acunetix Security Scanner is an automated web application security testing tool that scans for exploitable vulnerabilities including SQL injection and XSS.

ActiveComply is a compliance monitoring crawler that systematically scans social media platforms and websites to identify regulatory compliance violations for businesses in regulated industries like finance.

Acquia Optimize (Monsido) scans websites for accessibility issues (WCAG 2.2, ADA compliance), broken links, SEO problems, and content quality issues.

acoonbot was a German search engine crawler. The Acoon search engine is no longer operational.

AccessibleWebBot is a web crawler that scans customer websites to monitor accessibility violations and ensure WCAG compliance as part of Accessible Web's RAMP monitoring service.

acapbot is a web crawler. Its specific purpose and operator are not publicly documented.

AcademicBotRTU is an academic research crawler operated by Riga Technical University for scholarly research purposes.

absearch-crawler is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Aboundex was a search engine crawler. The service is no longer operational.

ABEvalBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

AASA-Bot is Apple's crawler that fetches Apple App Site Association files to support Universal Links functionality, allowing iOS apps to handle specific URL patterns.

aa is a web crawler used by Agency Analytics for collecting SEO data and analyzing website performance to help marketing agencies generate client reports.

A6-Indexer is a search indexing crawler. Limited public documentation available about its operator.

A360-Search is a web crawler used by Area360 for collecting and analyzing property information and real estate data from websites.

A Patent Crawler is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

7Siters is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

5erue is a web crawler. Its specific purpose and operator are not publicly documented.

5emeRue is a web crawler. Its specific purpose and operator are not publicly documented.

360Spider-Video is Qihoo 360's specialized video crawler for indexing video content on China's second largest search engine.

360Spider-Image is Qihoo 360's specialized image crawler for indexing images on China's second largest search engine.

360Spider is Qihoo 360's main search engine crawler, indexing web content for China's second largest search engine (so.com) with over 500 million users.

2ip.ru is a Russian web service that provides IP address information, website analysis, and monitoring tools.

2ip bot is a crawler for 2ip.ru, a Russian web service providing IP address lookup, website analysis, speed tests, and various network diagnostic tools.