Brozzler
github.com
- Free plan
- macOS
- Linux
- Self-hosted
6.6 Club score Visit github.com
What the maker publishes
- Archiving integration
- Brozzler is designed to work with warcprox for web archiving. source
- Browser capture
- It uses Chrome or Chromium to fetch pages and embedded URLs and extract links. source
- Crawl-state integration
- RethinkDB manages crawl state. source
- Dashboard
- It includes a rudimentary web application for viewing crawl job status, accessible by default at localhost port 8000. source
- Distributed operation
- Local use demonstrates the archival crawl workflow but does not use Brozzler's distributed nature. source
- Job configuration
- Crawl jobs are defined in YAML and require at least one seed URL. source
- License
- The repository licenses Brozzler under Apache License 2.0 and states that it is provided "AS IS." source
- Media capture
- It uses yt-dlp to enhance media capture capabilities. source
- Purpose
- Brozzler is a distributed browser-based web crawler for web archiving. source
- Requirements
- The README lists Python 3.9 or later, a RethinkDB deployment, and Chromium or Google Chrome version 64 or later as requirements. source
- Server limitation
- The browser requires a graphical environment; server use may require additional infrastructure such as X11. source
- Single-page use
- The brozzle-page command-line utility can crawl one URL. source
Checked against the maker's pages on 14 Nov 2026.