Job Queue Python Packages

rq

Simple job queues for Python

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

django-rq

A simple app that provides django integration for RQ (Redis Queue)

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

quebec

Quebec - Solid Queue for Python, a DB-backed job queue written in Rust

trainy-skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

python-pq

Job queue for Python backed by Postgres. Process-per-task fork isolation, transactional enqueueing, periodic tasks, priority queues. No broker required.

xqute

A job management system for python

django-tasks-scheduler

Schedule async tasks using redis protocol. Redis/ValKey/Dragonfly or any broker using the redis protocol can be used.

wakaq

Background task queue for Python backed by Redis, a super minimal Celery

apipod

Create web-APIs for long-running tasks. Job based task handling. Get the result with the job id later. FastTaskAPI creates threaded jobs and job queues on the fly. Router functionality for Runpod. Run services anywhere, be it local, hosted or serverless.

longbow

Longbow is a tool for automating simulations on a remote HPC machine. Longbow is designed to mimic the normal way an application is run locally but allows simulations to be sent to powerful machines.

raquel

Simple Job Queues using SQL

triage-runner

Script running tool for optimizing GPU memory utilization

kq

Kafka-based Job Queue for Python

rqmonitor

Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿‍💻 http://python-rq.org

fastq-redis

Python bindings for FastQ — high-performance Redis job queue written in C

nextai-prism

Prism: An intercloud broker for the clouds

gigq

A lightweight job queue system with SQLite backend and zero dependencies

aqworker

Async Redis-backed job runner for Python apps. AQWorker orchestrates workers, handlers, and queues with auto-discovery, retries, CLI tooling, and FastAPI-friendly async processing while staying framework agnostic.

ac-scheduler

SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper. (Fork by Jason-AC)

tinyq

A tiny job queue framework

skypilot-mithril

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

unix-at

Talk to the at(1) daemon, to schedule jobs for later