Gpt Python Packages

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

e2b

Open-source, secure environment with real-world tools for enterprise-grade agents.

openhands-ai

🙌 OpenHands: AI-Driven Development

e2b-code-interpreter

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

promptflow-core

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-tracing

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-devkit

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

g4f

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

ghostos-container

the ioc container useful for Interface oriented programming

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

promptflow-tools

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

text-generation

Large Language Model Text Generation Inference

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

nixtla

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.

ghostos

A framework offers an OS simulator within a Python Code Interface for AI Agents

e2b-desktop

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

promptflow-azure

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

arxiv-mcp-server

A Model Context Protocol server for searching and analyzing arXiv papers