PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Large Language Models Python Packages

Python packages with the GitHub topic large-language-models. Sorted by relevance, with stars and monthly downloads.
ray-project
ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

52.9M 42K 8K
mlc-ai
xgrammar

Fast, Flexible and Portable Structured Generation

6.5M 2K 146
onnx
onnx-ir

Efficient in-memory representation for ONNX, in Python

2.7M 44 20
redis
redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

2M 399 77
amazon-science
chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

901K 5K 625
deepset-ai
haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

772K 25K 3K
urchade
gliner

Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)

557K 3K 271
vndee
llm-sandbox

Lightweight and portable LLM sandbox runtime (code interpreter) Python library.

514K 1K 99
fla-org
fla-core

🚀 Efficient implementations for emerging model architectures

428K 5K 518
fla-org
flash-linear-attention

🚀 Efficient implementations for emerging model architectures

404K 5K 518
AgentOps-AI
tokencost

Easy token price estimates for 400+ LLMs. TokenOps.

387K 2K 104
protectai
llm-guard

The Security Toolkit for LLM Interactions

310K 3K 384
NVIDIA
megatron-core

Ongoing research training transformer models at scale

257K 16K 4K
activeloopai
deeplake

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

228K 9K 709
google
langextract

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

216K 36K 3K
agentscope-ai
agentscope

Build and run agents you can see, understand and trust.

206K 25K 3K
HKUDS
lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

200K 35K 5K
open-thought
reasoning-gym

[NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards

173K 1K 118
camel-ai
camel-ai

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

135K 17K 2K
langflow-ai
langflow

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

117K 148K 9K
langflow-ai
langflow-base

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

98K 148K 9K
microsoft
multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

95K 572 104
tensorzero
tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

78K 11K 821
upgini
upgini

Intelligent data search & enrichment for Machine Learning

77K 347 27
    • Data from PyPI, GitHub, ClickHouse, and BigQuery