Multi Modality Python Packages

bert-serving-client

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

bert-serving-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-client

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

open-gpt-torch

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

gemini-torch

Gemini - Pytorch

llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

visionzip

Official repository for VisionZip (CVPR 2025)

sophia-optimizer

Sophia Optimizer ULTRA FAST

andromeda-llm

andromeda - Pytorch

andromeda-torch

Andromeda - Pytorch

otter-ai

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

tiny-gptv

Simple Implementation of TinyGPTV in super simple Zeta lego blocks

hsss

Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling"

mm1-torch

MM1 - Pytorch

the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

hrtx

Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2

qformer

Implementation of Qformer from BLIP2 in Zeta Lego blocks.

rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

thebestllmever

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

andromeda-transformer

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

v-clip-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP