1592+ Crawler profiliert
Crawler-Verzeichnis
Alle Web-Crawler und KI-Bots, die wir verfolgen. Was sie tun, wer sie betreibt und wie Sie Ihre Inhalte davor schützen.
Zealbot — What It Is and How to Handle It
Zealbot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Zao — What It Is and How to Handle It
Zao is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
ZanistaBot — What It Is and How to Handle It
ZanistaBot crawls websites for Zanista AI, an AI-powered search and content analysis platform.
AI CrawlerAI Assistant
Zabbix — What It Is and How to Handle It
Zabbix is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Youmag — What It Is and How to Handle It
Youmag is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YoudaoBot — What It Is and How to Handle It
YoudaoBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YouBot — What It Is and How to Handle It
YouBot is a web crawler used by You.com to index search results that allow their AI Assistant to answer user questions. The assistant's answers normally contain references to the website as inline sources.
Search EngineSearch Engine
yoozBot — What It Is and How to Handle It
yoozBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YisouSpider — What It Is and How to Handle It
YisouSpider is the crawler for Yisou (Alibaba's former mobile search engine), now integrated into Quark browser.
Search EngineSearch Engine
YextBot — What It Is and How to Handle It
YextBot is a web crawler operated by Yext that helps customers retrieve and organize content from their websites to maintain consistent brand information across digital channels, directories, and search platforms.
MonitoringMonitoring
Yeti by Naver — What It Is and How to Handle It
Yeti is the web crawler for Naver, South Korea's dominant search engine with 70%+ market share.
Search EngineSearch Engine
YelpBot — What It Is and How to Handle It
YelpBot is a web crawler operated by Yelp, the popular business review and local search service. This bot fetches content from business websites to gather information such as hours, menus, contact details, and other business data that helps keep Yelp's business listings accurate and up-to-date.
OtherOther
Yellowbrandprotectionbot — What It Is and How to Handle It
Yellowbrandprotectionbot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
yanga — What It Is and How to Handle It
yanga is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YandoriRSSBot — What It Is and How to Handle It
YandoriRSSBot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
YandexVideo — What It Is and How to Handle It
YandexVideo is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YandexVertis — What It Is and How to Handle It
YandexVertis is a web crawler operated by Yandex, Russia's largest search engine. This bot discovers and indexes web content as part of Yandex's search infrastructure to provide search results to users.
Search EngineSearch Engine
YandexRenderResourcesBot — What It Is and How to Handle It
YandexRenderResourcesBot fetches JavaScript, CSS, and other resources to render pages for Yandex search indexing.
Search EngineSearch Engine
YandexMobileBot — What It Is and How to Handle It
YandexMobileBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YandexImages — What It Is and How to Handle It
YandexImages indexes images for Yandex Image Search, Russia's largest image search service.
Search EngineSearch Engine
yandex — What It Is and How to Handle It
yandex is the main crawler for Yandex, Russia's largest search engine serving Russian-speaking users worldwide.
Search EngineSearch Engine
YaK — What It Is and How to Handle It
YaK is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
YahooCacheSystem — What It Is and How to Handle It
YahooCacheSystem is a web caching component that stores website content snapshots as part of Yahoo's search infrastructure, working alongside Yahoo Slurp crawler to improve search result delivery.
Search EngineSearch Engine
Yahoo Pipes 1.0 — What It Is and How to Handle It
Yahoo Pipes 1.0 is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Yahoo Japan — What It Is and How to Handle It
Yahoo Japan is an intelligence gatherer operated by Yahoo. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
ResearchResearch
YaDirectFetcher — What It Is and How to Handle It
YaDirectFetcher is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
yacybot — What It Is and How to Handle It
yacybot is the crawler for YaCy, an open-source decentralized peer-to-peer search engine.
Search EngineSearch Engine
Y!J-DLC — What It Is and How to Handle It
Y!J-DLC is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
Y!J-BRZ/YATSHA crawler — What It Is and How to Handle It
Y!J-BRZ/YATSHA crawler is a search engine crawler operated by Yahoo Japan that indexes web pages for inclusion in Yahoo Japan's search results. This bot visits websites to discover and analyze content as part of Yahoo Japan's web crawling operations.
Search EngineSearch Engine
Y!J-BRW — What It Is and How to Handle It
Y!J-BRW is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther