HPCC Systems
hpccsystems.com
- Free plan
- Open source
- Windows
- macOS
- Linux
- Web
- Browser extension
- API
- Self-hosted
What HPCC Systems is
HPCC Systems is a free, open-source platform for enterprise data processing and data-lake management. Its core components are ECL, a declarative and modular programming language; Thor, which handles data ingestion, transformation, linking, and indexing; and Roxie, which serves concurrent queries. ECL's compiler optimizes programs for parallel processing and compiles them into C++. Clusters can range from two computers to more than a thousand commodity-hardware nodes. The cloud-native platform runs on Kubernetes and supports Azure Kubernetes Service and Amazon Elastic Kubernetes Service. Storage options include AWS S3, Azure Blob Storage, AWS Elastic Block Store, Azure Files, and Azure Disks. Security features include end-to-end encryption, service meshes, OAuth 2.0 with Azure AD support, JWT, and configurable controls for data areas and services. Its Machine Learning Library offers ECL-accessible algorithms for building and testing prediction models. Integrations include Spark, Kafka, Couchbase, Redis, Memcached, Pentaho, R, JDBC, Java APIs, and Tableau data connectors. The Apache 2.0-licensed platform is self-hosted. A current supported Linux system is required for a single-node cluster; the ECL IDE is available for Windows, while Apple OSX has client tools only.
Who it suits
HPCC Systems suits organizations with enterprise-scale data workloads that can manage a self-hosted platform. It may appeal to teams seeking data-lake tooling, parallel processing, and integration with listed data and analytics technologies.
Good to know, and what to watch
- Free to use under the Apache 2.0 license
- Thor and Roxie cover data refinement and query delivery
- Clusters can scale beyond a thousand commodity-hardware nodes
- Includes ECL-accessible machine-learning algorithms
- Supports multiple cloud storage services
- Self-hosted deployment is required
- Single-node clusters require a supported Linux system
- Apple OSX support is limited to client tools
Plans
Every plan and priceEnterprise subscription
Community Edition
Open source
Free plan
Getting started
- Open the HPCC Systems platform website
- Prepare a supported Linux system for a single-node cluster
- Install the self-hosted open-source platform
- Use ECL IDE on Windows or client tools on Apple OSX
- Deploy on Kubernetes, Azure Kubernetes Service or Amazon Elastic Kubernetes Service
- Connect storage, integrations or ESP query interfaces
Limits to check
The Open source plan is self-hosted, while the platform also supports cloud-native Kubernetes deployment. A current supported Linux system is required for a single-node cluster. On Apple OSX, only client tools are supported, while the ECL IDE is available for Windows.
The Club's review
Overview
HPCC Systems is an open-source platform for managing data lakes and running large-scale data processing and query workloads. It is best suited to organizations with the Linux and infrastructure expertise to operate their own clusters; its breadth is useful, but self-hosting is a real commitment.
Its ECL language, Thor processing engine and Roxie query engine cover distinct stages of working with mixed-schema data, from ingestion and refinement to concurrent query delivery. Teams looking for a programming-led platform they can deploy across commodity hardware or Kubernetes should consider it; teams seeking a managed service or a no-operations setup should look elsewhere.
For more options, browse our Data Lake Software directory.
Key features
ECL for parallel data work
ECL is declarative and modular. Its compiler optimizes programs for parallel processing and compiles them into C++, making it a strong fit for teams that want to express data workflows as code. It is less suitable for readers who need a platform that avoids specialized programming.
Thor and Roxie split the workload
Thor handles ingestion, transformation, linking and indexing, while Roxie serves high-performance concurrent queries. Keeping preparation and delivery in separate engines gives teams a single platform for these workloads, though it also means operating a multi-component system.
Cluster and Kubernetes deployment
Clusters can scale from two computers to more than a thousand commodity-hardware nodes. The cloud-native platform runs on Kubernetes, including Azure Kubernetes Service and Amazon Elastic Kubernetes Service, and supports storage across AWS S3, Azure Blob Storage, AWS Elastic Block Store, Azure Files and Azure Disks. This deployment range suits teams building around their own infrastructure; it does not remove the responsibility to deploy and run the platform.
Security and governance
Cloud-native security includes end-to-end encryption, Linkerd or Istio service meshes, OAuth 2.0 with Azure AD support, and JWT. Configurable security managers can protect landing zones, file scopes, recordset data, workunit execution and ESP services. A metadata catalog, governance controls and data sharing add useful lake-management capabilities for teams that need to control data access as well as process it.
Queries, integrations and machine learning
ESP exposes ECL queries through XML, HTTP, SOAP and REST interfaces, and deployed queries can be called with REST/JSON. Official integrations include Spark, Kafka, Couchbase, Redis, Memcached, Pentaho, R, JDBC, Java APIs and Tableau data connectors. The Machine Learning Library provides ECL-accessible algorithms for building and testing qualitative or quantitative prediction models. These options broaden the platform’s role, particularly for teams already working with those tools and interfaces.
Pricing
HPCC Systems is free to use under the Apache 2.0 license. Its Open source plan costs nothing and is self-hosted, so there is no software charge but teams must take responsibility for deployment and operation. Public Stack Overflow community support, free online tutorials and free online training provide ways to get help and build skills.
Platforms
HPCC Systems supports Linux, Windows, macOS, web, API, extensions and self-hosted deployment. A single-node cluster requires a current supported Linux system. ECL IDE is available for Windows, while Apple OSX supports client tools only; those distinctions matter for teams choosing where to host the platform and which development tools users can run.
Who it's for
HPCC Systems is a strong candidate for organizations managing mixed-schema data lakes that need large-scale ingestion, transformation and query delivery, and have people to run a self-hosted system. Its cluster scale, Kubernetes deployment, security controls and integrations make it relevant to infrastructure and data teams with established platforms to connect.
It is a weaker fit for small teams seeking a managed service, or for users who need to avoid Linux and cluster administration. ECL is central to its processing model, so teams that do not want to develop data workflows in a specialized language should weigh that requirement carefully.
Pros and cons
- Pros: Free and Apache 2.0 licensed, with self-hosted deployment that avoids a software subscription charge.
- Pros: Thor and Roxie cover both data refinement and concurrent query serving, while clusters can scale from two to more than a thousand nodes.
- Pros: Kubernetes support, multiple cloud storage options, security controls and a broad set of official integrations give infrastructure teams room to fit the platform into their environment.
- Cons: Self-hosting places deployment and operations on the adopting organization.
- Cons: A single-node cluster requires current supported Linux; Windows has the ECL IDE, while macOS is limited to client tools.
- Cons: ECL’s specialized, code-based workflow is not the right fit for teams seeking to avoid programming their data work.
Alternatives
Choose AWS Lake Formation if you want a paid data-lake option with a free permissions plan: creating permissions and using them through integrated services are free, while integrated services such as Amazon S3 carry standard usage rates.
HPE Ezmeral Data Fabric is another option if you want a product with a free trial and reseller-based pricing; the Canada store shows a starting price of C$500.00 for the software, with one- to five-year E-LTU offerings.
Consider lakeFS if you want a freemium alternative with a free trial and a choice of managed lakeFS Cloud or self-managed deployment, including on-premises, in your own cloud or air-gapped environments.
Apache Hadoop HDFS is a free, open-source alternative for readers comparing self-hosted storage projects.
Apache Ozone is another free, Apache License 2.0 option for readers considering open-source alternatives.
Oracle Big Data Service is a paid alternative with a free trial; its service fee is $0.02 per contact, billed per OCPU per hour, with compute shapes and Oracle Cloud SQL priced separately.
Qubole may suit teams seeking a paid platform with a full-featured 30-day free trial that connects to their own data and cloud of choice; its Enterprise Edition is $0.17 per contact.
Huawei Cloud Machine Translation is another alternative.
Verdict
Choose HPCC Systems if your organization needs an open-source platform for end-to-end data-lake work, has the expertise to operate it, and values a clear path from large-scale refinement to concurrent queries. Its strongest case is the combination of free licensing, scalable clusters and broad deployment and integration support. Look elsewhere if you need a managed service or want to avoid Linux, cluster operations and ECL-based development.
The verdict
HPCC Systems combines data-lake management, large-scale processing, and query delivery in a free, self-hosted platform. Teams should review its operating-system requirements and deployment responsibilities before adopting it.
Questions people ask
How much does HPCC Systems cost?
The Open source plan costs nothing. It is free to use and Apache 2.0 licensed.
Which operating systems are supported?
Platforms include Linux, Windows, macOS, web, API, extension and self-hosted deployments. A current supported Linux system is required for a single-node cluster; Apple OSX has client tools only.
Is HPCC Systems open source?
Yes. The Open source plan is self-hosted and licensed under Apache 2.0.
What cloud environments can it run on?
The cloud-native platform runs on Kubernetes and supports Azure Kubernetes Service and Amazon Elastic Kubernetes Service.
Which storage services are supported?
Supported storage includes AWS S3, Azure Blob Storage, AWS Elastic Block Store, Azure Files and Azure Disks.
What interfaces are available for queries?
ESP exposes ECL queries through XML, HTTP, SOAP and REST. Deployed queries can be called with REST/JSON.
What the maker publishes
- APIs
- ESP exposes ECL queries through XML, HTTP, SOAP and REST interfaces, and deployed queries can be called with REST/JSON. source
- Architecture
- The platform includes the ECL programming language, Thor data-refinery engine, and Roxie data-delivery engine. source
- Client operating systems
- The ECL IDE runs on Windows, while client tools are available for Windows, Linux and macOS and container setup can be initiated from Windows, Mac or Linux terminals. source
- Cloud deployment
- The cloud-native platform runs on Kubernetes and supports Azure Kubernetes Service and Amazon Elastic Kubernetes Service. source
- Cloud storage integrations
- Cloud-native deployments support AWS S3, Azure Blob Storage, AWS EBS and Azure storage options. source
- Company headquarters
- LinkedIn lists HPCC Systems headquarters at Alpharetta, Georgia and identifies the organization as founded in 2011. source
- Company origin
- The independent ODBMS.org interview says development began in 1999 as an internal LexisNexis Risk Solutions system and the platform was open-sourced in 2011. source
- Company ownership
- HPCC Systems is presented as a LexisNexis Risk Solutions project and is used as the foundation for many LexisNexis data products. source
- Current release
- The download page identifies version 10.6 as the latest platform release. source
- Data lake
- HPCC Systems is a dedicated end-to-end data-lake management platform for combining mixed-schema data. source
- Documentation depth
- Documentation includes administrator, programmer, installation, containerized-platform, WsSQL, configuration and release-note materials. source
- ECL
- ECL is a declarative, modular language whose compiler optimizes code for parallel processing and compiles it into C++. source
- ECL language
- ECL is a declarative, data-oriented language that lets developers describe computations while the platform determines execution details. source
- Encryption
- ECL can encrypt output data with 256-bit AES and compress it with LZW before serialization. source
- Founded
- 2000 source
- Headquarters
- Atlanta metropolitan area, Georgia, United States source
- Independent feature coverage
- Business-Software.com lists LDAP or Active Directory integration, thousands of nodes, high availability, monitoring, graphical configuration and collaborative source control. source
- Independent pricing finding
- Business-Software.com reports that pricing requires contacting the vendor directly. source
- Integrations
- Official integrations include Spark, Kafka, Couchbase, Redis, Memcached, Pentaho, R, JDBC, Java APIs and Tableau data connectors. source
- JDBC support
- The platform offers an HPCC JDBC driver and WsSQL as SQL access options, each supporting a subset of SQL. source
- Known output limit
- The ECL Programmer's Guide documents a deliberate failure when returning more than 10 MB of result data directly to a workunit. source
- Kubernetes deployment
- The containerized edition runs on Kubernetes and supports Helm, Terraform, Amazon EKS and Azure AKS deployments. source
- Language extensibility
- ECL can embed or call Java, JavaScript, Python, R, C++, MySQL, SOAP services, command-line programs and external plugins. source
- License
- The Community Edition is licensed under the Apache License 2.0. source
Checked against the maker's pages on 15 Oct 2026.