Arroyo
arroyo.dev
- Free plan
- Open source
- macOS
- Linux
- Web
- API
- Self-hosted
What Arroyo is
Arroyo is an open-source engine for processing data streams and producing results in under a second. It lets users build stateful pipelines with analytical SQL, including complex queries, windows, and joins. The engine supports event-time windows, exactly-once processing, and checkpointing for recovery. Arroyo says it can handle millions of events per second and supports horizontal and vertical scaling. Its connectors cover systems such as Kafka, Kinesis, MQTT, MySQL, Postgres, Redis, and Delta Lake, among others. It reads and writes JSON, Avro, Parquet, text, and binary, with more than 300 SQL functions; Rust functions can extend SQL. A web interface supports connection management, query development and testing, and pipeline monitoring, with a REST API also available. The single-node setup is for development and testing; production deployments use a distributed cluster with Arroyo’s scheduler or Kubernetes. The engine is Apache 2.0 licensed, free, and self-hostable.
Who it suits
Arroyo suits teams building stateful stream-processing pipelines in SQL, including those that need custom Rust functions or multiple data connectors. Development can start on a single node, while production deployment uses a distributed cluster.
Good to know, and what to watch
- Supports exactly-once processing and checkpoint-based recovery.
- Includes more than 300 SQL functions.
- Offers connectors for a broad range of data systems.
- Provides a web UI and REST API for pipeline management.
- Free, Apache 2.0 licensed, and self-hostable.
- Single-node deployment is intended only for development and testing.
- Production requires a distributed cluster.
Plans
Every plan and priceArroyo open-source
Open-source Arroyo Engine
Cloudflare Workers Paid with Pipelines
Open source
Getting started
- Visit https://www.arroyo.dev/ to access the open-source engine.
- Use the single-node cluster for testing and development.
- For production, deploy a distributed cluster with Arroyo’s scheduler or Kubernetes.
- Configure checkpoint and artifact storage using a supported storage option.
- Manage connections and pipelines in the web UI or use the REST API.
Limits to check
The single-node cluster is intended for testing and development; production deployments use a distributed cluster with Arroyo’s scheduler or Kubernetes.
The verdict
Arroyo combines SQL-based stream processing with checkpointing, a wide connector list, and Rust extensibility. Plan for a distributed deployment when moving beyond development and testing.
Questions people ask
Is Arroyo free?
Yes. The Open-source Arroyo Engine plan costs nothing and is Apache 2.0 licensed.
Can Arroyo be self-hosted?
Yes. Arroyo is self-hostable. Its single-node cluster is intended for testing and development, while production uses a distributed cluster.
Which platforms does Arroyo support?
Listed platforms are API, Linux, macOS, self-hosted and web.
What languages can I use with Arroyo?
Users define pipelines with SQL and can extend SQL with Rust scalar, aggregate and asynchronous user-defined functions.
What integrations does Arroyo support?
Connectors include Kafka, Confluent Cloud, Kinesis, MQTT, NATS, MySQL, Postgres, Redis, Redpanda, Delta Lake, Iceberg, HTTP, WebSocket and Webhooks.
Who acquired Arroyo?
Arroyo announced its acquisition by Cloudflare in April 2025 and said the engine would remain open-source and self-hostable.
What the maker publishes
- Acquisition
- Arroyo announced its acquisition by Cloudflare in April 2025 and said the engine would remain open-source and self-hostable. source
- Acquisition
- Cloudflare announced on April 10, 2025 that it acquired Arroyo and would integrate its engine into Cloudflare Pipelines, Queues, Workers and R2. source
- Async UDF limits
- Async Rust UDFs have configurable concurrency and timeout settings; Python UDFs do not support async functions. source
- Checkpoint storage
- Production deployments can store checkpoints in S3, Google Cloud Storage, Azure Blob Storage or compatible stores such as Minio, R2 and Backblaze B2. source
- Cloudflare managed limits
- Cloudflare's current Pipelines pricing page lists unlimited stream ingress, 50 GB/month included SQL transforms and 50 GB/month included sink delivery on Workers Paid. source
- Company history
- Arroyo’s founders say they started the company in 2022 and open-sourced the engine in 2023. source
- Company legal name
- Crunchbase identifies the company legal name as Arroyo Systems, Inc. source
- Company location and investors
- Crunchbase lists Berkeley, California as headquarters and Y Combinator as the investor in its pre-seed round. source
- Connectors
- Listed integrations include Kafka, Confluent Cloud, Kinesis, MQTT, NATS, MySQL, Postgres, Redis, Redpanda, Delta Lake, Iceberg, HTTP, WebSocket, and Webhooks. source
- Connectors
- Documented connectors include Kafka, Confluent Cloud, Kinesis, MySQL, Postgres, MQTT, NATS, Redis, Redpanda, Fluvio, Filesystem, Iceberg, WebSocket, SSE, Webhook and HTTP polling. source
- Data formats
- Native formats include JSON, Avro, Parquet, raw text and raw binary, with custom formats possible through UDFs. source
- Deployment
- The single-node cluster is intended for testing and development; production deployments use a distributed cluster with Arroyo’s built-in scheduler or Kubernetes. source
- Deployment
- Arroyo can run as a single binary, Docker container or Kubernetes deployment, with SQLite for local use and Postgres recommended for distributed production. source
- Exactly-once processing
- Arroyo advertises exactly-once processing across out-of-order data and machine failures, using checkpointed state. source
- Fault tolerance
- The engine supports state checkpointing for fault tolerance and pipeline recovery, and exactly-once processing. source
- Formats and functions
- Arroyo natively reads and writes JSON, Avro, Parquet, text, and binary, and includes over 300 SQL functions. source
- Founded
- 2022 source
- Founder and launch
- Y Combinator lists Arroyo as a Winter 2023 company founded in 2022 with founders Micah Wylde and Jackson Newhouse. source
- GitHub project
- The public repository describes Arroyo as a Rust distributed stream-processing engine and showed about 5.1k stars and 379 forks when opened. source
- Helm packaging
- Artifact Hub lists an official Arroyo Helm chart for Kubernetes and showed chart/application version 0.15.0. source
- Joins
- Arroyo SQL supports stream joins including inner, left, right and full joins, plus windowed and updating-data joins. source
- Kafka integration
- Kafka sources and sinks support self-hosted Kafka, Amazon MSK and Confluent Cloud, with exactly-once or at-least-once sink modes. source
- Licence
- The official documentation states that Arroyo is fully open source under the Apache 2.0 licence. source
- Limit: late events
- Events arriving after a watermark has passed are dropped according to the documented watermark semantics. source
Checked against the maker's pages on 15 Oct 2026.