PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
ggml-org
gguf

LLM inference in C/C++

6.2M 108K 18K
xorbitsai
xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

43K 9K 824
shakfu
cyllama

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

35K 25 19
shakfu
cyllama-rocm

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

15K 25 19
shakfu
cyllama-cuda12

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

15K 25 19
shakfu
cyllama-vulkan

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

14K 25 19
shakfu
cyllama-sycl

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

13K 25 19
william-murray1204
stable-diffusion-cpp-python

stable-diffusion.cpp bindings for python

3K 112 16
monatis
clip-cpp

CLIP inference in plain C/C++ with no extra dependencies

2K 557 53
LexicHQ
smartloop

AI orchestration on your device

851 4 0
yaphott
grammatica

Grammatica is a GBNF (GGML BNF) grammar builder that exposes the full richness of the GBNF notation system using a syntax that reflects the resulting grammar.

132 3 0
ggml-org
pyllama-server

Python wrapper for llama.cpp server - OpenAI API compatible backend with auto device detection

123 108K 18K
    • Data from PyPI, GitHub, ClickHouse, and BigQuery