Website Crawler
websitecrawler.org
- Free plan
- Web
- API
What Website Crawler is
Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. For JavaScript-heavy sites it offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. Custom extraction can use CSS or XPath selectors and JavaScript snippets. Results can be exported as CSV, Markdown, or JSON, and its API retrieves structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 pages per day and one project. Paid options include Starter at $10 a month for 2,000 pages monthly and Growth at $20 a month for 10,000 pages monthly. Crawls cover publicly available HTML-page information and do not automatically fill in or submit forms.
Who it suits
Website Crawler suits site owners, people analyzing CMS or custom-built sites, and researchers or students collecting web datasets for AI projects.
Good to know, and what to watch
- Flags a range of on-page SEO issues
- Supports custom CSS and XPath extraction
- Exports CSV, Markdown, and JSON
- Includes uptime and SSL expiry alerts
- Free plan allows 10 pages per day
- HTML mode processes raw HTML only
- Does not automatically fill in or submit forms
Plans
Every plan and priceBasic
Starter
Growth
Enterprise
Free plan
The verdict
Website Crawler combines site audits, extraction, exports, and monitoring in one service. Consider its crawl limits and form-handling boundary when planning a project.
What the maker publishes
- API access
- Yes source
- Crawl scope limit
- The service works with publicly available information on HTML pages and does not automatically fill in or submit forms. source
- Custom extraction
- Users can configure extraction with CSS or XPath selectors and JavaScript snippets. source
- Exports and API
- Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data. source
- Free plan
- Yes source
- Free-plan limits
- The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings. source
- Integrations
- The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel. source
- Intended users
- The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects. source
- JavaScript crawling
- It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. source
- Monitoring
- The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute. source
- Product
- Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. source
- Security and privacy
- The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted. source
- SEO audits
- The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. source
- Paid from
- 20 source
- Support
- The maker says it provides email support on weekdays and weekends and replies within two to three hours. source
Checked against the maker's pages on 29 Sept 2026.