Apache Heron
heron.apache.org
- Free plan
- Linux
- Self-hosted
What Apache Heron is
Apache Heron is a distributed engine for processing live data streams with fault-tolerant operation. Twitter developed it and donated it to the Apache Incubator in 2018. The project was designed for compatibility with Apache Storm’s ecosystem and topology API, using a process-based architecture written in Java, C++, and Python. Heron provides Java and Python Streamlets APIs, a Python API similar to Storm’s, and YAML-based ECO topology stitching. It supports backpressure, task isolation, stateful effectively-once processing, and configurations aimed at latency-sensitive or throughput-sensitive workloads. Adaptors are described for Hadoop, BookKeeper, and the local file system. Dhalion is intended to tune, heal, and stabilize topologies. Deployment options include Kubernetes, DC/OS, Nomad, SLURM, and standalone. Heron is open source under Apache License 2.0 and free for self-hosted Linux use. The project retired on January 18, 2023, and its GitHub repository is archived read-only.
Who it suits
Heron is relevant to teams maintaining self-hosted Linux stream-processing systems, especially those using Storm-compatible topologies. Its retired and archived status matters for any new deployment decision.
Good to know, and what to watch
- Storm ecosystem and topology API compatibility
- Process-based topology isolation
- Backpressure and task isolation
- Stateful, effectively-once processing
- Multiple scheduler deployment options
- Project retired on January 18, 2023
- GitHub repository is archived read-only
- Self-hosted Linux deployment required
The verdict
Apache Heron offers a broad stream-processing architecture and Storm compatibility, but it is no longer an active project. Treat the retirement and read-only repository as central factors before adopting or continuing it.
What the maker publishes
- APIs
- The project describes Java and Python Streamlets APIs, a Python API similar to Storm’s, and YAML-based ECO topology stitching. source
- Architecture
- Heron uses a process-based computing model with topology isolation. source
- Archive
- The Apache Heron GitHub repository was archived on March 3, 2023 and is read-only. source
- Build requirements
- The repository README lists Java 11, Python 3.6, and Bazel 6.0.0 as requirements. source
- Community support
- The repository lists user and developer mailing lists, a Slack channel and a meetup group as community contact options. source
- Community support
- The README lists user and development mailing lists and a Heron Slack workspace. source
- Deployment integrations
- Twitter’s project announcement describes integration with Apache Mesos, Apache Aurora, Apache REEF, and Slurm. source
- Features
- Heron supports backpressure, task isolation for troubleshooting, and configuring topologies for latency-sensitive or throughput-sensitive workloads. source
- Intended use
- The repository describes Heron as a real-time stream processing engine developed at Twitter. source
- Languages and architecture
- Heron uses a process-based architecture and is written in Java, C++ and Python. source
- License
- Heron was open sourced under the Apache License, Version 2.0. source
- License
- The project is licensed under the Apache License, Version 2.0. source
- Origin
- Twitter developed Heron as a distributed streaming engine and donated it to the Apache Incubator in 2018. source
- Project status
- The Apache Incubator page says the Heron podling retired on 2023-01-18. source
- Purpose
- Heron is a real-time, distributed, fault-tolerant stream processing engine. source
- Schedulers
- The project lists Kubernetes, DC/OS, Nomad, SLURM and standalone as scheduler deployment options. source
- Security
- The GitHub repository page links to a security policy. source
- Self-management
- Dhalion is described as enabling Heron to self-tune, self-heal and self-stabilize when topologies encounter unexpected behavior. source
- State and processing
- The project describes stateful and effectively-once processing, with adaptors for Apache Hadoop, Apache BookKeeper and the local file system. source
- Stateful processing
- Twitter’s donation announcement describes stateful, exactly-once processing with adaptors for Apache Hadoop, Apache BookKeeper, and the local file system. source
- Status
- Apache Heron retired on 2023-01-18. source
- Storm compatibility
- Heron was built to be backwards compatible with the Apache Storm ecosystem and topology API. source
- Storm compatibility
- Heron was designed to retain compatibility with Apache Storm’s data model and topology API. source
- Typical workloads
- Twitter listed ETL, model enhancement, anomaly and fraud detection, IoT, embedded systems, VR/AR, ad bidding, financial, security and social media use cases. source
Checked against the maker's pages on 9 Oct 2026.