Workflow Management Python Packages

hera

Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

doit

CLI task management & automation tool

dirac

DIRAC Grid

snakemake

This is the development home of the workflow management system Snakemake. For general information, see

hera-workflows

Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

diraccommon

DIRAC Grid

cylc-flow

Cylc: a general purpose workflow engine with a gift for cycling

datajoint

Relational data pipelines for the science lab

pyiron-base

Core components of the pyiron integrated development environment (IDE) for computational materials science

calkit-python

Research project management and automation.

proxystore

Advanced data flow management for distributed Python applications

stimela

Containerized radio interferometry scripting framework -- NB: Classic version is no longer in active development, use stimela 2! See README for details.

covalent

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

calk9

Research project management and automation.

checklistfabrik

Python tool that generates interactive HTML checklists from YAML templates. Jinja conditionals, reusable includes, pluggable modules, built-in web server. Ideal for SOPs, deployments & recurring ops.

iotaa

It's One Thing After Another: A Simple Workflow Engine

cova

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

selinon

An advanced distributed task flow management on top of Celery

buildpy

Make in Python

ilus

A lightweight and handy variant calling pipeline generator for whole-genome sequencing (WGS) and whole exom sequencing data (WES) analysis by using GATK and Sentieon. 一个基于 GATK 和 Sentieon 的简易且全面的 WGS/WES 分析流程生成器.

n8n-deploy

Python CLI tool for n8n workflow deployment and management. Uses local SQLite database, supports remote deployment of n8n workflows without web UI. Features minimalist setup, backup/restore, n8n API key management, and flexible configuration.

gird

Make-like build tool & task runner for Python

wmcoredb

WMCore database schema used for WMAgent

pyodin

A programmable, observable and distributed job orchestration system.