Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Brozzler

github.com

  • Free plan
  • macOS
  • Linux
  • Self-hosted
6.6 Club score Visit github.com

What the maker publishes

Archiving integration
Brozzler is designed to work with warcprox for web archiving. source
Browser capture
It uses Chrome or Chromium to fetch pages and embedded URLs and extract links. source
Crawl-state integration
RethinkDB manages crawl state. source
Dashboard
It includes a rudimentary web application for viewing crawl job status, accessible by default at localhost port 8000. source
Distributed operation
Local use demonstrates the archival crawl workflow but does not use Brozzler's distributed nature. source
Job configuration
Crawl jobs are defined in YAML and require at least one seed URL. source
License
The repository licenses Brozzler under Apache License 2.0 and states that it is provided "AS IS." source
Media capture
It uses yt-dlp to enhance media capture capabilities. source
Purpose
Brozzler is a distributed browser-based web crawler for web archiving. source
Requirements
The README lists Python 3.9 or later, a RethinkDB deployment, and Chromium or Google Chrome version 64 or later as requirements. source
Server limitation
The browser requires a graphical environment; server use may require additional infrastructure such as X11. source
Single-page use
The brozzle-page command-line utility can crawl one URL. source

Checked against the maker's pages on 14 Nov 2026.