1592+ crawlers perfilados
Directorio de Crawlers
Todos los crawlers web y bots de IA que rastreamos. Qué hace cada uno, quién lo opera y cómo proteger su contenido.
Mavifinds — What It Is and How to Handle It
Mavifinds is an uncategorized agent operated by Brandimi. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
MauiBot — What It Is and How to Handle It
MauiBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
MatchorySearch — What It Is and How to Handle It
MatchorySearch is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
Mata Hari — What It Is and How to Handle It
Mata Hari is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
MastodonInstances — What It Is and How to Handle It
MastodonInstances is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
Mastodon — What It Is and How to Handle It
Mastodon is a feed reader that fetches and processes RSS, Atom, and other content feeds.
Feed ReaderFeed Reader
mappydata — What It Is and How to Handle It
mappydata is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Manus-User — What It Is and How to Handle It
Manus-User is a browser-enabled AI agent operated by Butterfly Effect, a company based in China. It autonomously navigates websites, interprets content, and carries out multi-step tasks for human users.
AI AgentAI Agent
MakeMerryBot — What It Is and How to Handle It
MakeMerryBot is an uncategorized agent operated by Make Merry. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
MailChimp — What It Is and How to Handle It
MailChimp is a bot associated with the Mailchimp email marketing and automation platform. This bot fetches web content that may be linked to or referenced within email campaigns created by Mailchimp users.
OtherOther
Mail.RU_Bot — What It Is and How to Handle It
Mail.RU_Bot fetches web content and metadata for email previews and link processing on behalf of the Mail.ru email service for Russian users.
PreviewPreview
Magus Bot — What It Is and How to Handle It
Magus Bot is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
MagpieRSS — What It Is and How to Handle It
MagpieRSS is an RSS feed parser written in PHP that fetches and parses RSS and Atom feeds. This bot visits websites to retrieve RSS feed content, parsing feeds from RSS 0.9 through RSS 2.0 and Atom formats for syndication purposes.
OtherOther
magpie-crawler — What It Is and How to Handle It
magpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.
MonitoringMonitoring
Magnet.me-web — What It Is and How to Handle It
Magnet.me-web crawler monitors customer company websites to automatically synchronize and update job opening listings for the Magnet.me recruitment platform.
Feed ReaderFeed Reader
MagiBot — What It Is and How to Handle It
MagiBot is a web crawler operated by Peak Labs that focuses on information extraction and retrieval technology, collecting web content to transform natural language knowledge into structured data.
Search EngineSearch Engine
MaCoCu — What It Is and How to Handle It
MaCoCu is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
lwp-trivial — What It Is and How to Handle It
lwp-trivial is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
Luminator-robots — What It Is and How to Handle It
Luminator-robots is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
ltx71 — What It Is and How to Handle It
ltx71 is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
lssrocketcrawler — What It Is and How to Handle It
lssrocketcrawler is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
lssbot — What It Is and How to Handle It
lssbot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
LogicMonitor SiteMonitor — What It Is and How to Handle It
LogicMonitor SiteMonitor is a synthetic monitoring bot that performs automated availability and performance checks on websites and online services to ensure proper functionality and uptime.
MonitoringMonitoring
LNSpiderguy — What It Is and How to Handle It
LNSpiderguy is a search engine crawler that indexes web content for search results.
Search EngineSearch Engine
LMArenaUnfurlBot — What It Is and How to Handle It
LMArenaUnfurlBot is a fetcher. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
OtherOther
lkxscan — What It Is and How to Handle It
lkxscan is a security scanner that checks websites for vulnerabilities, misconfigurations, and security issues.
SecuritySecurity
Lizard — What It Is and How to Handle It
Lizard web crawler
OtherOther
LivelapBot — What It Is and How to Handle It
LivelapBot is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
lipperhey — What It Is and How to Handle It
lipperhey is a web crawler. Its specific purpose and operator are not publicly documented.
OtherOther
LinkWalker — What It Is and How to Handle It
LinkWalker is a monitoring and analytics crawler that collects web data for business intelligence and competitive analysis.
MonitoringMonitoring