1592+ Crawler profiliert
Crawler-Verzeichnis
Alle Web-Crawler und KI-Bots, die wir verfolgen. Was sie tun, wer sie betreibt und wie Sie Ihre Inhalte davor schützen.
SiteSucker — What It Is and How to Handle It
SiteSucker is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SitesOverPagesBot — What It Is and How to Handle It
SitesOverPagesBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
SiteSnagger — What It Is and How to Handle It
SiteSnagger is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SiteLockSpider — What It Is and How to Handle It
SiteLockSpider is SiteLock's web scanning service that crawls websites to detect malware, malicious code, and security vulnerabilities for website protection.
SecuritySecurity
Siteimprove.com — What It Is and How to Handle It
Siteimprove.com is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
siteimprove-lookup — What It Is and How to Handle It
siteimprove-lookup is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
siteimprove — What It Is and How to Handle It
siteimprove is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
siteexplorer.info — What It Is and How to Handle It
siteexplorer.info is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SiteCheckerBotCrawler — What It Is and How to Handle It
SiteCheckerBotCrawler audits websites for Sitechecker, an SEO platform providing on-page and technical SEO analysis.
SEO ToolSEO Tool
sitecheck.internetseer.com — What It Is and How to Handle It
sitecheck.internetseer.com is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SiteCheck-sitecrawl — What It Is and How to Handle It
SiteCheck-sitecrawl is Siteimprove's crawler that performs comprehensive website audits for their content intelligence platform, scanning sites for accessibility, SEO, quality assurance, and digital governance compliance.
SEO ToolSEO Tool
Sitebulb — What It Is and How to Handle It
Sitebulb is a website crawler used for conducting technical SEO audits, available in both desktop and cloud versions. It crawls websites to analyze their structure and provide prioritized insights and recommendations for search engine optimization.
SEO ToolSEO Tool
SiteBot — What It Is and How to Handle It
SiteBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
sistrix crawler — What It Is and How to Handle It
sistrix crawler is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SirdataBot — What It Is and How to Handle It
Sirdata data collection bot
ScraperScraper
Sindup — What It Is and How to Handle It
Sindup is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
SimpleScraper — What It Is and How to Handle It
SimpleScraper is a web scraper. Its data collection purposes are not publicly documented.
ScraperScraper
SimplePie — What It Is and How to Handle It
SimplePie is a feed reader that fetches and processes RSS, Atom, and other content feeds.
Feed ReaderFeed Reader
simplecrawler — What It Is and How to Handle It
simplecrawler is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Silktide — What It Is and How to Handle It
Silktide is a website quality management platform bot that automatically scans and monitors websites for accessibility, content quality, SEO, user experience, and data privacy issues.
MonitoringMonitoring
Sidetrade indexer bot — What It Is and How to Handle It
Sidetrade B2B indexer bot
OtherOther
ShortPixel — What It Is and How to Handle It
ShortPixel is a bot from an image optimization service that compresses and converts images to formats like WebP and AVIF. It visits websites to fetch and optimize images to reduce file sizes and improve page loading speeds.
OtherOther
ShellBot — What It Is and How to Handle It
ShellBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
ShapBot — What It Is and How to Handle It
ShapBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
SFDC-Callout — What It Is and How to Handle It
SFDC-Callout is the user agent used by Salesforce when making HTTP callouts and API requests from Apex code, workflow rules, and other Salesforce automated processes to external services.
Feed ReaderFeed Reader
SeznamBot — What It Is and How to Handle It
SeznamBot is Seznam's web crawler that indexes websites for their Czech search engine, providing localized search results primarily for Czech and Slovak users.
Search EngineSearch Engine
Server Density Service Monitoring — What It Is and How to Handle It
Server Density Service Monitoring is an uptime and performance monitoring service operated by StackPath that checks websites and servers for availability and response times.
OtherOther
Server Density — What It Is and How to Handle It
Server Density monitoring bot performs proactive health checks on infrastructure including cloud services, servers, containers, and websites for performance and availability monitoring.
MonitoringMonitoring
serpstatbot — What It Is and How to Handle It
serpstatbot crawls websites for Serpstat, an all-in-one SEO platform offering keyword research, site audits, and rank tracking.
SEO ToolSEO Tool
serendeputybot — What It Is and How to Handle It
serendeputybot is a feed reader that fetches and processes RSS, Atom, and other content feeds.
Feed ReaderFeed Reader