Blog

Use Magento 2 connector for AfterShip to track your orders and get delivery

MagnetmeBot is the crawler for Magnet.me, a career platform that matches professionals with companies.

Tumblr is Automattic's link unfurling bot that fetches URL content to create rich Link Blocks in Tumblr posts, parsing responses to display titles, descriptions, and preview images for shared links.

WPMU DEV Broken Link Checker is a WordPress plugin crawler that performs comprehensive site scans to identify and report broken links, helping developers maintain site quality and user experience.

seo-audit-check-bot is a web crawler used by SEO audit platforms like SEO Audit Check and WebCEO to perform comprehensive SEO analysis and audits on websites for optimization insights.

upday crawls news websites and sources to aggregate articles for its news app platform, collecting and indexing content to provide personalized news recommendations.

WebsitePulseBot is a monitoring crawler that checks website availability, performance, and health.

Watchbot is a monitoring service that performs automated checks on website availability and SSL certificate expiration dates, alerting users to potential downtime or security certificate issues before they affect end users.

ActiveComply Bot is a crawler for a service that monitors social media for regulatory compliance. It scans for specific keywords and content for businesses in regulated industries.

NewsBlur is a web crawler that fetches RSS feeds and web content for its personal news reader service, collecting articles from subscribed websites and blogs to deliver real-time updates to users' newsfeeds.

Service to manage WordPress websites via the WP JSON API.

Bot for checking omnisend integration in woocommerce shops and shopify

Drata Autopilot is a security scanner that checks websites for vulnerabilities, misconfigurations, and security issues.

Sentry is a security scanner that checks websites for vulnerabilities, misconfigurations, and security issues.

PingPing Bot is a monitoring crawler that checks website availability, performance, and health.

This is for the official public hosting of the open-source project https://github.com/synzen/MonitoRSS so that the bot may poll for RSS feeds of Cloudflare-protected sites to deliver news articles. Feeds are chosen by paid users, and the bot adds them to a schedule to be polled at a regular interval of 2-10 minutes.

LinkChecker Bot validates links and finds broken URLs across websites for link auditing and SEO analysis.

SecurityHeaders is a free security scanning service that analyzes HTTP security headers on websites, providing grades and recommendations to improve web security posture and protect against common vulnerabilities.

Instapaper is a content fetcher that crawls and downloads web articles to make them available for offline reading. It processes and parses web pages to extract readable text content for the Instapaper read-later service.

Jumio provides AI-driven digital identity verification and fraud detection services with biometric technology, document verification, and liveness detection for secure user onboarding and compliance.