Multimodal Python Packages

pyod

A Python library for anomaly detection across tabular, time series, graph, text, and image data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.

2.7M 10K 1K

mteb

MTEB: Massive Text Embedding Benchmark

2.7M 3K 608

rerun-sdk

An open source SDK for logging, storing, querying, and visualizing multimodal and multi-rate data

2.2M 11K 720

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

833K 5K 457

vllm-omni

A framework for efficient model inference with omni-modality models

476K 5K 867

vortex-data

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

289K 3K 149

deeplake

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

228K 9K 709

bentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

197K 9K 959

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

176K 14K 1K

vlmrun-hub

A hub for various industry-specific schemas to be used with VLMs.

173K 543 24

jina

☁️ Build multimodal AI applications with cloud-native stack

154K 22K 2K

docarray

Represent, send, store and search multimodal data

144K 3K 241

mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

87K 7K 578