Pathway Live Data Framework
pathway.com
- Free plan
- API
- Self-hosted
What Pathway Live Data Framework is
Pathway Live Data Framework is a Python framework for analytics and AI pipelines over stored data and live streams. It supports streaming ETL and retrieval-augmented generation workflows, while the same pipeline can process batch and streaming inputs. A Rust engine runs Python with multithreading and multiprocessing, and Differential Dataflow handles out-of-order data in real time. AI tooling includes online machine learning, RAG pipelines, and vector indexes for fresh data. Documentation lists more than 350 connectors, including SharePoint, and allows custom connectors. Python and SQL programming APIs are available, along with a REST endpoint for serving queries, answers, and real-time features. Deployments can use Docker or Kubernetes and are compatible with OpenTelemetry. Pathway saves computation state so processing can resume after a failure or pipeline update. Community is free, self-hosted, and limited to 8 GB RAM and four cores. Scale is self-hosted, needs a license key, and supports 16 GB RAM and four cores; Enterprise adds larger capacity and listed support options.
Who it suits
It suits developers building streaming analytics, ETL, or AI pipelines in Python or SQL. Self-hosted deployment supports teams that can operate Docker or Kubernetes.
Good to know, and what to watch
- One pipeline handles batch and live data
- More than 350 documented connectors
- RAG, online ML, and vector indexes
- State persistence supports recovery
- Python, SQL, and REST interfaces
- Community limited to 8 GB RAM and four cores
- Scale requires a license key
- Scale telemetry sends anonymized usage data
Plans
Every plan and priceEnterprise
Community
Scale
Free plan
The verdict
Pathway combines streaming computation, AI data tooling, connectors, and recovery features in a self-hosted framework. Capacity limits, licensing, and telemetry should be reviewed before selecting a tier.
What the maker publishes
- AI features
- Its LLM tooling includes online ML, RAG pipelines, and vector indexes for working with fresh data. source
- API
- The pricing page lists Python and SQL programming APIs and a REST API endpoint for serving queries, answers, and real-time features. source
- Batch and streaming
- The same pipeline can process static data and live data streams. source
- Community limits
- The Community tier is free under BSL 1.1, self-hosted, and supported up to 8 GB RAM and 4 cores. source
- Deployment
- Pathway supports deployment with Docker or Kubernetes and is compatible with OpenTelemetry. source
- Enterprise support
- Enterprise features listed include a multi-zone SLA and 24/7 phone support. source
- Headquarters
- Palo Alto, California, USA source
- Incremental computation
- Pathway uses Differential Dataflow to handle out-of-order data points in real time. source
- Integrations
- The documentation says Pathway includes 350+ connectors, including SharePoint, and lets users implement their own connectors. source
- License telemetry
- The licensing guide says Scale license keys send anonymized product usage data to Pathway via an OpenTelemetry collector. source
- Persistence
- Pathway can save computation state to resume after a failure or pipeline update. source
- Processing engine
- Its Rust engine runs Python code with multithreading and multiprocessing. source
- Purpose
- Pathway is a Python data processing framework for analytics and AI pipelines over data streams, including streaming ETL and RAG pipelines. source
- Scale limits
- The Scale tier is self-hosted, requires a license key, and is supported up to 16 GB RAM and 4 cores; the page says it can be free or paid. source
- Support response
- The pricing page lists ticket-based business support with a one-business-day reply time for paid-tier customers. source
Checked against the maker's pages on 4 Oct 2026.