HPCC Systems

HPCC Systems offers an open source cluster computing platform used to solve Big Data problems. Its unique architecture and simple yet powerful data programming language (ECL) makes it a compelling solution to solve data intensive computing needs.

The HPCC Systems architecture incorporates the Thor (Data Refinery) and Roxie (Query) clusters as well as common middleware components, an external communications layer, client interfaces which provide both end-user services and system management tools, and auxiliary components to support monitoring and to facilitate loading and storing of filesystem data from external sources. An HPCC environment can include only Thor clusters, or both Thor and Roxie clusters.

Thor is responsible for consuming vast amounts of data, transforming, linking and indexing that data. It functions as a distributed file system with parallel processing power spread across the nodes. A cluster can scale from a single node to thousands of nodes.

Roxie provides separate high-performance online query processing and data warehouse capabilities.

ECL (Enterprise Control Language) is the powerful programming language that is ideally suited for the manipulation of Big Data.

ECL IDE is a modern IDE used to code, debug and monitor ECL programs.

ESP (Enterprise Services Platform) provides an easy to use interface to access ECL queries using XML, HTTP, SOAP and REST.