Transformer Architecture Python Packages

zetascale

Build high-performance AI models with modular building blocks

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

gptmed

pip install gptmed

joeynmt

Minimalist NMT for educational purposes

gpt3-torch

GPT3 - Pytorch

swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

triformer

Transformers components but in Triton

ernie

An Accessible Python Library for State-of-the-art Natural Language Processing. Built with HuggingFace's Transformers.

seq2seqsharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, MacOS), multimodal model for text and images and so on.

transformer-builder

This package provides builder-like API to create really flexible transformers using PyTorch

padie-extended

An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.

gpt4-torch

GPT4 - Pytorch

mmm-zeta

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

free-transformer

Free Transformer Architecture - an extension of the decoder Transformer that conditions its generative process on random latent variables which are learned without supervision

bangla-ocr

Implementation of the paper 'Towards Full page Offline Bangla Handwritten Text Recognition using Image-to-Sequence Architecture'. For details, please read the README section.

gptgpt

A lightweight GPT-based language model framework for training custom question-answering models on any domain

z-transformers

z-transformers

aot-x

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

minimal-slt

A minimal Sign Language Translation package