Distributed Computing Library (dislib)

dislib wraps classical machine learning and deep learning algorithms in a distributed array abstraction; at runtime, PyCOMPSs partitions data and dispatches tasks over heterogeneous HPC or cloud resources, transparently handling datasets that exceed per-node memory budgets. This delivers the “write once, run anywhere” portability highlighted by the programming-model trend of HPC.

Astrophysics analytics, molecular-dynamics workflows, urgent-computing for natural hazards, manufacturing digital-twins, large-scale feature engineering, distributed neural-network training.

National & regional super-computing centres needing user-friendly ML stacks; Cloud-HPC providers bundling managed data-science services; Industrial R&D (automative, pharma, energy) building AI+simulation pipelines; Independent Software Vendors adding distributed ML to existing products.