Retrieval Augmented Generation Python Packages

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

flagembedding

Retrieval and Retrieval-augmented LLMs

flashrank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

needle-python

Needle simplifies building RAG pipelines.

langchain-graph-retriever

Graph traversal for improved RAG

graph-retriever

Graph traversal for improved RAG

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

clarifai

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

colpali-engine

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

farm-haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

mlx-embeddings

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

cognitx-codegraph

🕸️ Code knowledge graph for Claude Code & AI coding agents — index TypeScript, NestJS, React into Neo4j and query architecture in Cypher

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

pageindex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

raganything

"RAG-Anything: All-in-One RAG Framework"

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

fastembed-gpu

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

local-deep-research

Local Deep Research achieves ~95% on SimpleQA benchmark (tested with Qwen 3.6). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local & Encrypted.

nvidia-rag

This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.

enterprise-rag-patterns

Cross-industry compliance patterns for RAG pipelines: FERPA, HIPAA, GDPR, NIST AI RMF, OWASP LLM Top 10, and more. Vector store adapters, framework integrations, and audit logging.

neuro-cortex-memory

Persistent memory for Claude Code — 41 neuroscience papers, 20 biological mechanisms. 97.8% R@10 LongMemEval | 92.6% R@10 LoCoMo | +33.4% BEAM-10M over flat retrieval (0.471 vs 0.353). Stage-Aware Context Assembly. PostgreSQL + pgvector.