Multiprocessing Python Packages

joblib

Computing with Python functions.

195.9M 4K 452

billiard

Multiprocessing Pool Extensions

46.3M 431 257

multitasking

Non-blocking Python methods using decorators

11.9M 234 46

aiomultiprocess

Take a modern Python codebase to the next level of performance.

4.8M 2K 108

trailrunner

Walk paths and run things

2.5M 18 8

pebble

Multi threading and processing eye-candy.

1.4M 647 57

wrapt-timeout-decorator

Python Powerful Timeout Decorator that can be used safely on classes, methods, class methods

759K 165 16

multiprocessing-logging

Handler for logging from multiple processes

334K 395 59

vermin

Concurrently detect the minimum Python versions needed to run code

268K 515 28

aioprocessing

A Python 3.5+ library that integrates the multiprocessing module with asyncio

161K 661 37

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

151K 364 121

schwimmbad

A common interface to processing pools.

21K 121 20

aioextensions

High performance functions to work with the async IO.

14K 14 1

atpbar

Progress bars for threading and multiprocessing tasks on terminal and Jupyter Notebook

14K 98 9

executorlib

Up-scale python functions for high-performance computing (HPC)

12K 72 6

thread

A Python threading library extension

12K 18 5

py-sharedmemory

Optimized Python IPC: Uses shared memory to bypass multiprocessing queue I/O bottlenecks, ideal for large data (1MB+) in scientific computing, RL, etc. Reduces system load and improves latency

11K 3 0

funboost

pip install funboost，python全功能分布式函数调度框架,funboost的功能是全面性重量级，用户能想得到的功能99%全都有;funboost的使用方式是轻量级，只有@boost一行代码需要写。支持python所有类型的并发模式和一切知名消息队列中间件，支持如 celery dramatiq等框架整体作为funboost中间件，python函数加速器，框架包罗万象，用户能想到的控制功能全都有。一统编程思维，兼容50% python业务场景，适用范围广。只需要一行代码即可分布式执行python一切函数，99%用过funboost的pythoner 感受是　简易方便自由强大，相见恨晚。

10K 884 165