Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Website Crawler

websitecrawler.org

  • Free plan
  • Web
  • API

What Website Crawler is

Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. For JavaScript-heavy sites it offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. Custom extraction can use CSS or XPath selectors and JavaScript snippets. Results can be exported as CSV, Markdown, or JSON, and its API retrieves structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 pages per day and one project. Paid options include Starter at $10 a month for 2,000 pages monthly and Growth at $20 a month for 10,000 pages monthly. Crawls cover publicly available HTML-page information and do not automatically fill in or submit forms.

Who it suits

Website Crawler suits site owners, people analyzing CMS or custom-built sites, and researchers or students collecting web datasets for AI projects.

Good to know, and what to watch

  • Flags a range of on-page SEO issues
  • Supports custom CSS and XPath extraction
  • Exports CSV, Markdown, and JSON
  • Includes uptime and SSL expiry alerts
  • Free plan allows 10 pages per day
  • HTML mode processes raw HTML only
  • Does not automatically fill in or submit forms

Basic

Free

Starter

$10/mo

Growth

$20/mo

Enterprise

—

Free plan

The verdict

Website Crawler combines site audits, extraction, exports, and monitoring in one service. Consider its crawl limits and form-handling boundary when planning a project.

What the maker publishes

API access
Yes source
Crawl scope limit
The service works with publicly available information on HTML pages and does not automatically fill in or submit forms. source
Custom extraction
Users can configure extraction with CSS or XPath selectors and JavaScript snippets. source
Exports and API
Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data. source
Free plan
Yes source
Free-plan limits
The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings. source
Integrations
The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel. source
Intended users
The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects. source
JavaScript crawling
It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. source
Monitoring
The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute. source
Product
Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. source
Security and privacy
The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted. source
SEO audits
The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. source
Paid from
20 source
Support
The maker says it provides email support on weekdays and weekends and replies within two to three hours. source

Checked against the maker's pages on 29 Sept 2026.