Machine Learning Python Packages

huggingface-hub

The official Python client for the Hugging Face Hub.

scikit-learn

scikit-learn: machine learning in Python

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

torch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

nltk

NLTK Source

modal

SDK libraries for Modal

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

apache-airflow-providers-common-sql

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

mlflow-skinny

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

torchvision

Datasets, Transforms and Models specific to Computer Vision

apache-airflow-providers-fab

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

streamlit

Streamlit — A faster way to build and share data apps.

wandb

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

realtime

Python Client for Supabase. Query Postgres from Flask, Django, FastAPI. Python user authentication, security policies, edge functions, file storage, and realtime data streaming. Good first issue.

thinc

🔮 A refreshing functional take on deep learning, compatible with your favorite libraries

apache-airflow-providers-http

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

tensorflow

An Open Source Machine Learning Framework for Everyone

sagemaker

A library for training and deploying machine learning models on Amazon SageMaker

apache-airflow-providers-common-compat

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

spacy

💫 Industrial-strength Natural Language Processing (NLP) in Python