Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Pathway Live Data Framework

pathway.com

  • Free plan
  • API
  • Self-hosted
6.7 Club score Visit pathway.com

What Pathway Live Data Framework is

Pathway Live Data Framework is a Python framework for analytics and AI pipelines over stored data and live streams. It supports streaming ETL and retrieval-augmented generation workflows, while the same pipeline can process batch and streaming inputs. A Rust engine runs Python with multithreading and multiprocessing, and Differential Dataflow handles out-of-order data in real time. AI tooling includes online machine learning, RAG pipelines, and vector indexes for fresh data. Documentation lists more than 350 connectors, including SharePoint, and allows custom connectors. Python and SQL programming APIs are available, along with a REST endpoint for serving queries, answers, and real-time features. Deployments can use Docker or Kubernetes and are compatible with OpenTelemetry. Pathway saves computation state so processing can resume after a failure or pipeline update. Community is free, self-hosted, and limited to 8 GB RAM and four cores. Scale is self-hosted, needs a license key, and supports 16 GB RAM and four cores; Enterprise adds larger capacity and listed support options.

Who it suits

It suits developers building streaming analytics, ETL, or AI pipelines in Python or SQL. Self-hosted deployment supports teams that can operate Docker or Kubernetes.

Good to know, and what to watch

  • One pipeline handles batch and live data
  • More than 350 documented connectors
  • RAG, online ML, and vector indexes
  • State persistence supports recovery
  • Python, SQL, and REST interfaces
  • Community limited to 8 GB RAM and four cores
  • Scale requires a license key
  • Scale telemetry sends anonymized usage data

Enterprise

—

Community

Free

Scale

Free

Free plan

The verdict

Pathway combines streaming computation, AI data tooling, connectors, and recovery features in a self-hosted framework. Capacity limits, licensing, and telemetry should be reviewed before selecting a tier.

What the maker publishes

AI features
Its LLM tooling includes online ML, RAG pipelines, and vector indexes for working with fresh data. source
API
The pricing page lists Python and SQL programming APIs and a REST API endpoint for serving queries, answers, and real-time features. source
Batch and streaming
The same pipeline can process static data and live data streams. source
Community limits
The Community tier is free under BSL 1.1, self-hosted, and supported up to 8 GB RAM and 4 cores. source
Deployment
Pathway supports deployment with Docker or Kubernetes and is compatible with OpenTelemetry. source
Enterprise support
Enterprise features listed include a multi-zone SLA and 24/7 phone support. source
Headquarters
Palo Alto, California, USA source
Incremental computation
Pathway uses Differential Dataflow to handle out-of-order data points in real time. source
Integrations
The documentation says Pathway includes 350+ connectors, including SharePoint, and lets users implement their own connectors. source
License telemetry
The licensing guide says Scale license keys send anonymized product usage data to Pathway via an OpenTelemetry collector. source
Persistence
Pathway can save computation state to resume after a failure or pipeline update. source
Processing engine
Its Rust engine runs Python code with multithreading and multiprocessing. source
Purpose
Pathway is a Python data processing framework for analytics and AI pipelines over data streams, including streaming ETL and RAG pipelines. source
Scale limits
The Scale tier is self-hosted, requires a license key, and is supported up to 16 GB RAM and 4 cores; the page says it can be free or paid. source
Support response
The pricing page lists ticket-based business support with a one-business-day reply time for paid-tier customers. source

Checked against the maker's pages on 4 Oct 2026.