Cluster Python Packages

hdijupyterutils

Jupyter magics and kernels for working with remote Spark clusters

autovizwidget

Jupyter magics and kernels for working with remote Spark clusters

spottedpy

Spatial hotspot analysis

skein

A tool and library for easily deploying applications on Apache YARN

pepperize-cdk-serverless-cluster-from-snapshot

Deprecated: Use https://docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_rds.ServerlessClusterFromSnapshot.html

sparkmagic

Jupyter magics and kernels for working with remote Spark clusters

openquake-engine

OpenQuake Engine: a software for Seismic Hazard and Risk Analysis

tensorflowonspark

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

casty

A minimalist, type-safe actor framework for Python 3.12+ with built-in distributed clustering

aioredis-cluster

Redis Cluster support extension for aioredis

libgossip

A C++17 implementation of the Gossip protocol, designed for decentralized distributed systems.

rediscluster

a Python interface to a Cluster of Redis key-value store

gap-stat

Python implementation of the gap statistic with optional Rust optimizations.

classicml

简单易用的经典机器学习框架

bexhoma

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.

sonar

Tool to profile usage of HPC resources by regularly probing processes.

hipart

Hierarchical divisive clustering algorithm execution, visualization and Interactive visualization.

laniakea

Laniakea is a utility for managing instances at various cloud providers and aids in setting up a fuzzing cluster.

runjob

runjob is a program for managing a group of related jobs running on a compute cluster

arvados-tools

A single package to install all Arvados client tools

pixel-clusterizer

A fast, generic, and easy to use clusterizer to cluster hits of a pixel matrix in Python.

slurmgen

SlurmGen - Simple Manager for Slurm Jobs

hyper-shell

A cross-platform, high-throughput computing utility for processing shell commands over a distributed, asynchronous queue.

classicml-python

简单易用的经典机器学习框架