Pipeline Framework Python Packages

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

combo

(AAAI' 20) A Python Toolbox for Machine Learning Model Combination

mediapipe-nightly

Cross-platform, customizable ML solutions for live and streaming media.

mediapipe-model-maker

Cross-platform, customizable ML solutions for live and streaming media.

pipen

A pipeline framework for python

gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

pyppl

A pipeline framework for python

pipen-filters

Add a set of useful filters for pipen templates.

py-turbo

Pyturbo package: A pipeline system for efficient concurrent execution

torchline

A framework for easy to use Pytorch

pycompss

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

informatics

Framework of fast implementation data processing and operating pipelines

surround

Surround is a framework for serving machine learning pipelines in Python.

streamlined

Making running scripts more streamlined!

pipen-diagram

Draw pipeline diagrams for pipen.

vent

A library that includes a CLI designed to serve as a platform to collect and analyze data across a flexible set of tools and technologies.

lightflow

A lightweight, distributed workflow system

pipeless-ai

An open-source computer vision framework to create and deploy computer vision applications that scale in minutes

amqpipe

Twisted based pipeline framework for AMQP

steppy-toolkit

Curated set of transformers that make your work with steppy faster and more effective :telescope:

pipeless-ai-cli

An open-source computer vision framework to build and deploy apps in minutes

neuraxle

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.

smartpipeline

A framework for rapid development of robust data pipelines following a simple design pattern