Slurm Python Packages

submitit

Python 3.8+ toolbox for submitting jobs to Slurm

2M 2K 148

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

1.9M 10K 1K

clusterscope

Clusterscope is a CLI and python library to extract information from HPC Clusters and Jobs.

597K 23 5

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

487K 10K 1K

torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

263K 422 152

dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

174K 2K 224

hydra-submitit-launcher

Python 3.8+ toolbox for submitting jobs to Slurm

93K 2K 148

torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

86K 422 152

slurm-usage

🖥 Command to list the current cluster usage per user

58K 11 4

toil

A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).

33K 929 244

foamlib

✨ A modern Python package for interacting with OpenFOAM

20K 202 27

trainy-skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

17K 10K 1K

executorlib

Up-scale python functions for high-performance computing (HPC)

12K 72 6

adaptive-scheduler

Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. :tada:

12K 30 14

pysqa

Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.

11K 34 8

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

11K 462 19

pympipool

Up-scale python functions for high-performance computing (HPC)

8K 72 6

dpdispatcher

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

6K 57 61

arvak

Rust-native quantum compilation stack with CUDA-Q, IQM, IBM Quantum & QDMI backends. Deep framework interop with Qiskit, Cirq, Qrisp & PennyLane. First-class SLURM/PBS and European HPC support.

6K 1 0