Vision Transformer Python Packages

mmdet

OpenMMLab Detection Toolbox and Benchmark

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

mmcls

OpenMMLab Pre-training Toolbox and Benchmark

mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark

pix2tex

pix2tex: Using a ViT to convert images of equations into LaTeX code.

thepipe-api

Get clean data from tricky documents, powered by vision-language models ⚡

mambavision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

fastervit

FasterViT: Fast Vision Transformers with Hierarchical Attention

garmentiq

Free & Open Source. Precise and flexible garment measurements from images - no tape measures, no delays, just fashion - forward automation.

pai-easycv

An all-in-one toolkit for computer vision

attention-and-transformers

Transformers goes brrr... Attention and Transformers from scratch in TensorFlow. Currently contains Vision transformers, MobileViT-v1, MobileViT-v2, MobileViT-v3

clipq

A simple implementation of a CLIP that splits up an image into quandrants and then gets the embeddings for each quandrant

towhee-models

Towhee is a framework that helps you encode your unstructured data into embeddings.

vision-transformers

Vision Transformers for image classification, image segmentation, and object detection.

efficientvit-gml

open-set object detector

conformal-clip

Few-shot CLIP classification with conformal prediction, probability calibration, and reliability metrics.

tfimm

TensorFlow port of PyTorch Image Models (timm) - image models with pretrained weights.

image-classification-jax

Image classification in JAX with ViT, resnet, cifar10, cifar100, imagenette, and imagenet

deepvision-toolkit

PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/implementations - Vision Transformer (ViT), ResNetV2, EfficientNetV2, NeRF, SegFormer, MixTransformer, (planned...) DeepLabV3+, ConvNeXtV2, YOLO, etc.

mmdet-taeuk4958

OpenMMLab Detection Toolbox and Benchmark

seq2seqsharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, MacOS), multimodal model for text and images and so on.

clipcap

Using pretrained encoder and language models to generate captions from multimedia inputs.

vitaminp

VitaminP: a vision transformer-assisted multimodal integration network for pathology cell segmentation