Huggingface Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

sagemaker

A library for training and deploying machine learning models on Amazon SageMaker

skops

skops is a Python library helping you share your scikit-learn based models and put them in production

sagemaker-core

A library for training and deploying machine learning models on Amazon SageMaker

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

sagemaker-train

A library for training and deploying machine learning models on Amazon SageMaker

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

sahi

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

kubeflow

Universal Python SDK to run AI workloads on Kubernetes

detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

swarms

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

mflux

MLX native implementations of state-of-the-art generative image models

autotrain-advanced

🤗 AutoTrain Advanced

kubeflow-training

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust

lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

llmx

An API for Chat Fine-Tuned Large Language Models (llm)

hf-mem

A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

kubeflow-trainer-api

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

span-marker

SpanMarker for Named Entity Recognition