Large Language Model Python Packages

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

atomic-agents

Building AI agents, atomically

intel-extension-for-transformers

Repository of Intel® Intel Extension for Transformers

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

streaming-json-parser

A streaming JSON parser that processes JSON data incrementally, handling partial states. Useful for incrementally parsing partial responses from streaming outputs of Large Language Models (LLMs).

nvim-mcp

MCP server that connects AI agents to your running Neovim instance via msgpack-RPC — no plugins required.

novelai-python

✨ NovelAI api python sdk, easy to use, modern and user-friendly.

bintensors

Another file format for storing your models in a binary encoded format.

llmgraph

Create knowledge graphs with LLMs

uralicnlp

An NLP library for Uralic languages such as Finnish and Sami. Also supports Spanish, Arabic, Russian etc.

gpt-multi-atomic-agents

Combine multiple graphql-based or function-based agents with dynamic routing - based on atomic-agents.

nerif

LLM powered Python

badam

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

arcshiftwrap

End-to-end pipeline for collecting, labeling, and analyzing metaphor framing and stance in Reddit and news discourse using LLMs.

picollm

On-device LLM Inference Powered by X-Bit Quantization

sagify

LLMs and Machine Learning done easily

elscirl

Apply language solutions to Reinforcement Learning problems.

openai-batch

Make OpenAI batch easy to use.

framescope

End-to-end pipeline for collecting, labeling, and analyzing metaphor framing and stance in Reddit and news discourse using LLMs.

sec-summary-llm

packages extracts structured summaries from security and government texts using LLM

clearflow

Correctness-first orchestration for emergent AI. Type-safe, deeply immutable, 100% code coverage.

easyjailbreak

Easy Jailbreak toolkit

agent-function-tool

Universal wrapper for Python functions to be used with LLM function calling