Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Arroyo

arroyo.dev

  • Free plan
  • Open source
  • macOS
  • Linux
  • Web
  • API
  • Self-hosted
8.4 Club score Visit arroyo.dev

What Arroyo is

Arroyo is an open-source engine for processing data streams and producing results in under a second. It lets users build stateful pipelines with analytical SQL, including complex queries, windows, and joins. The engine supports event-time windows, exactly-once processing, and checkpointing for recovery. Arroyo says it can handle millions of events per second and supports horizontal and vertical scaling. Its connectors cover systems such as Kafka, Kinesis, MQTT, MySQL, Postgres, Redis, and Delta Lake, among others. It reads and writes JSON, Avro, Parquet, text, and binary, with more than 300 SQL functions; Rust functions can extend SQL. A web interface supports connection management, query development and testing, and pipeline monitoring, with a REST API also available. The single-node setup is for development and testing; production deployments use a distributed cluster with Arroyo’s scheduler or Kubernetes. The engine is Apache 2.0 licensed, free, and self-hostable.

Who it suits

Arroyo suits teams building stateful stream-processing pipelines in SQL, including those that need custom Rust functions or multiple data connectors. Development can start on a single node, while production deployment uses a distributed cluster.

Good to know, and what to watch

  • Supports exactly-once processing and checkpoint-based recovery.
  • Includes more than 300 SQL functions.
  • Offers connectors for a broad range of data systems.
  • Provides a web UI and REST API for pipeline management.
  • Free, Apache 2.0 licensed, and self-hostable.
  • Single-node deployment is intended only for development and testing.
  • Production requires a distributed cluster.

Arroyo open-source

Free

Open-source Arroyo Engine

Free

Cloudflare Workers Paid with Pipelines

$5/mo

Open source

Getting started

  1. Visit https://www.arroyo.dev/ to access the open-source engine.
  2. Use the single-node cluster for testing and development.
  3. For production, deploy a distributed cluster with Arroyo’s scheduler or Kubernetes.
  4. Configure checkpoint and artifact storage using a supported storage option.
  5. Manage connections and pipelines in the web UI or use the REST API.

Limits to check

The single-node cluster is intended for testing and development; production deployments use a distributed cluster with Arroyo’s scheduler or Kubernetes.

The verdict

Arroyo combines SQL-based stream processing with checkpointing, a wide connector list, and Rust extensibility. Plan for a distributed deployment when moving beyond development and testing.

Questions people ask

Is Arroyo free?

Yes. The Open-source Arroyo Engine plan costs nothing and is Apache 2.0 licensed.

Can Arroyo be self-hosted?

Yes. Arroyo is self-hostable. Its single-node cluster is intended for testing and development, while production uses a distributed cluster.

Which platforms does Arroyo support?

Listed platforms are API, Linux, macOS, self-hosted and web.

What languages can I use with Arroyo?

Users define pipelines with SQL and can extend SQL with Rust scalar, aggregate and asynchronous user-defined functions.

What integrations does Arroyo support?

Connectors include Kafka, Confluent Cloud, Kinesis, MQTT, NATS, MySQL, Postgres, Redis, Redpanda, Delta Lake, Iceberg, HTTP, WebSocket and Webhooks.

Who acquired Arroyo?

Arroyo announced its acquisition by Cloudflare in April 2025 and said the engine would remain open-source and self-hostable.

What the maker publishes

Acquisition
Arroyo announced its acquisition by Cloudflare in April 2025 and said the engine would remain open-source and self-hostable. source
Acquisition
Cloudflare announced on April 10, 2025 that it acquired Arroyo and would integrate its engine into Cloudflare Pipelines, Queues, Workers and R2. source
Async UDF limits
Async Rust UDFs have configurable concurrency and timeout settings; Python UDFs do not support async functions. source
Checkpoint storage
Production deployments can store checkpoints in S3, Google Cloud Storage, Azure Blob Storage or compatible stores such as Minio, R2 and Backblaze B2. source
Cloudflare managed limits
Cloudflare's current Pipelines pricing page lists unlimited stream ingress, 50 GB/month included SQL transforms and 50 GB/month included sink delivery on Workers Paid. source
Company history
Arroyo’s founders say they started the company in 2022 and open-sourced the engine in 2023. source
Company legal name
Crunchbase identifies the company legal name as Arroyo Systems, Inc. source
Company location and investors
Crunchbase lists Berkeley, California as headquarters and Y Combinator as the investor in its pre-seed round. source
Connectors
Listed integrations include Kafka, Confluent Cloud, Kinesis, MQTT, NATS, MySQL, Postgres, Redis, Redpanda, Delta Lake, Iceberg, HTTP, WebSocket, and Webhooks. source
Connectors
Documented connectors include Kafka, Confluent Cloud, Kinesis, MySQL, Postgres, MQTT, NATS, Redis, Redpanda, Fluvio, Filesystem, Iceberg, WebSocket, SSE, Webhook and HTTP polling. source
Data formats
Native formats include JSON, Avro, Parquet, raw text and raw binary, with custom formats possible through UDFs. source
Deployment
The single-node cluster is intended for testing and development; production deployments use a distributed cluster with Arroyo’s built-in scheduler or Kubernetes. source
Deployment
Arroyo can run as a single binary, Docker container or Kubernetes deployment, with SQLite for local use and Postgres recommended for distributed production. source
Exactly-once processing
Arroyo advertises exactly-once processing across out-of-order data and machine failures, using checkpointed state. source
Fault tolerance
The engine supports state checkpointing for fault tolerance and pipeline recovery, and exactly-once processing. source
Formats and functions
Arroyo natively reads and writes JSON, Avro, Parquet, text, and binary, and includes over 300 SQL functions. source
Founded
2022 source
Founder and launch
Y Combinator lists Arroyo as a Winter 2023 company founded in 2022 with founders Micah Wylde and Jackson Newhouse. source
GitHub project
The public repository describes Arroyo as a Rust distributed stream-processing engine and showed about 5.1k stars and 379 forks when opened. source
Helm packaging
Artifact Hub lists an official Arroyo Helm chart for Kubernetes and showed chart/application version 0.15.0. source
Joins
Arroyo SQL supports stream joins including inner, left, right and full joins, plus windowed and updating-data joins. source
Kafka integration
Kafka sources and sinks support self-hosted Kafka, Amazon MSK and Confluent Cloud, with exactly-once or at-least-once sink modes. source
Licence
The official documentation states that Arroyo is fully open source under the Apache 2.0 licence. source
Limit: late events
Events arriving after a watermark has passed are dropped according to the documented watermark semantics. source

Checked against the maker's pages on 15 Oct 2026.