Training Python Packages

swesmith

[NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents

torchao

PyTorch native quantization and sparsity for training and inference

optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

sagemaker-training

Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

torchft-nightly

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

swanlab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

split-folders

🗂 Split folders with files (i.e. images) into training, validation and test (dataset) folders

kubetorch

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

runhouse

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

tokenicer

A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

tensorbored-nightly

TensorBored: Fixing TensorBoard's deficiencies

avalanche-lib

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

pytorch-accelerated

A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop which is flexible enough to handle the majority of use cases, and capable of utilizing different hardware options with no code changes required. Docs: https://pytorch-accelerated.readthedocs.io/en/latest/

deepepochs

Pytorch模型训练工具

awex

A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from training to inference in RL workflows

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

neptune-sklearn

Experiment tracking for scikit-learn. 🧩 Log, organize, visualize and compare model metrics, parameters, dataset versions, and more.

torchtraining-nightly

Functional & flexible neural network training with PyTorch.

mlx-lm-lora

Train LLMs on Apple silicon with MLX and the Hugging Face Hub

neptune-tensorflow-keras

💡 Experiment tracking for TensorFlow/Keras. Log, organize, and compare model metrics, learning curves, hyperparameters, dataset versions, and more.

mlpug

MLPug is a library for training and evaluating Machine Learning (ML) models, able to use different ML libraries as backends

neptune-lightgbm

Experiment tracking for LightGBM. 🧩 Log, organize, visualize and compare model metrics, parameters, dataset versions, and more.