Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Apache Heron

heron.apache.org

  • Free plan
  • Linux
  • Self-hosted
6.9 Club score Visit heron.apache.org

What Apache Heron is

Apache Heron is a distributed engine for processing live data streams with fault-tolerant operation. Twitter developed it and donated it to the Apache Incubator in 2018. The project was designed for compatibility with Apache Storm’s ecosystem and topology API, using a process-based architecture written in Java, C++, and Python. Heron provides Java and Python Streamlets APIs, a Python API similar to Storm’s, and YAML-based ECO topology stitching. It supports backpressure, task isolation, stateful effectively-once processing, and configurations aimed at latency-sensitive or throughput-sensitive workloads. Adaptors are described for Hadoop, BookKeeper, and the local file system. Dhalion is intended to tune, heal, and stabilize topologies. Deployment options include Kubernetes, DC/OS, Nomad, SLURM, and standalone. Heron is open source under Apache License 2.0 and free for self-hosted Linux use. The project retired on January 18, 2023, and its GitHub repository is archived read-only.

Who it suits

Heron is relevant to teams maintaining self-hosted Linux stream-processing systems, especially those using Storm-compatible topologies. Its retired and archived status matters for any new deployment decision.

Good to know, and what to watch

  • Storm ecosystem and topology API compatibility
  • Process-based topology isolation
  • Backpressure and task isolation
  • Stateful, effectively-once processing
  • Multiple scheduler deployment options
  • Project retired on January 18, 2023
  • GitHub repository is archived read-only
  • Self-hosted Linux deployment required

The verdict

Apache Heron offers a broad stream-processing architecture and Storm compatibility, but it is no longer an active project. Treat the retirement and read-only repository as central factors before adopting or continuing it.

What the maker publishes

APIs
The project describes Java and Python Streamlets APIs, a Python API similar to Storm’s, and YAML-based ECO topology stitching. source
Architecture
Heron uses a process-based computing model with topology isolation. source
Archive
The Apache Heron GitHub repository was archived on March 3, 2023 and is read-only. source
Build requirements
The repository README lists Java 11, Python 3.6, and Bazel 6.0.0 as requirements. source
Community support
The repository lists user and developer mailing lists, a Slack channel and a meetup group as community contact options. source
Community support
The README lists user and development mailing lists and a Heron Slack workspace. source
Deployment integrations
Twitter’s project announcement describes integration with Apache Mesos, Apache Aurora, Apache REEF, and Slurm. source
Features
Heron supports backpressure, task isolation for troubleshooting, and configuring topologies for latency-sensitive or throughput-sensitive workloads. source
Intended use
The repository describes Heron as a real-time stream processing engine developed at Twitter. source
Languages and architecture
Heron uses a process-based architecture and is written in Java, C++ and Python. source
License
Heron was open sourced under the Apache License, Version 2.0. source
License
The project is licensed under the Apache License, Version 2.0. source
Origin
Twitter developed Heron as a distributed streaming engine and donated it to the Apache Incubator in 2018. source
Project status
The Apache Incubator page says the Heron podling retired on 2023-01-18. source
Purpose
Heron is a real-time, distributed, fault-tolerant stream processing engine. source
Schedulers
The project lists Kubernetes, DC/OS, Nomad, SLURM and standalone as scheduler deployment options. source
Security
The GitHub repository page links to a security policy. source
Self-management
Dhalion is described as enabling Heron to self-tune, self-heal and self-stabilize when topologies encounter unexpected behavior. source
State and processing
The project describes stateful and effectively-once processing, with adaptors for Apache Hadoop, Apache BookKeeper and the local file system. source
Stateful processing
Twitter’s donation announcement describes stateful, exactly-once processing with adaptors for Apache Hadoop, Apache BookKeeper, and the local file system. source
Status
Apache Heron retired on 2023-01-18. source
Storm compatibility
Heron was built to be backwards compatible with the Apache Storm ecosystem and topology API. source
Storm compatibility
Heron was designed to retain compatibility with Apache Storm’s data model and topology API. source
Typical workloads
Twitter listed ETL, model enhancement, anomaly and fraud detection, IoT, embedded systems, VR/AR, ad bidding, financial, security and social media use cases. source

Checked against the maker's pages on 9 Oct 2026.