PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Llama2 Python Packages

Python packages with the GitHub topic llama2. Sorted by relevance, with stars and monthly downloads.
bentoml
openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

17K 12K 807
ludwig-ai
ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

6K 12K 1K
bentoml
openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

6K 12K 807
open-compass
opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

5K 7K 774
friendliai
friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

5K 50 7
google
google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

4K 432 64
AI-Hypercomputer
maxtext

MaxText is a simple, performant and scalable Jax LLM!

4K 2K 509
bentoml
openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

4K 12K 807
Simatwa
python-tgpt

AI Chat in Terminal + Package + REST-API

4K 177 28
verifai
multillm

🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐

3K 83 9
vietanhdev
anyrobo

A local-first voice AI assistant framework. Create your own JARVIS.

2K 2 0
dylanhogg
llmgraph

Create knowledge graphs with LLMs

2K 507 32
kyegomez
exxa

Exa - Pytorch

2K 26 4
safevideo
autollm

Ship RAG based LLM web apps in seconds.

2K 1K 99
minggnim
nlp-models

Transformers based NLP models

1K 2 1
jpmanson
llm-templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

1K 33 1
minggnim
bert-classifier

A repository for training transformer based models

1K 2 1
meta-llama
llama-recipes

This is a compatibility package to keep projects build on llama-recipes compatible with the new name llama-cookbook. If you're updating your project or starting a new one please use llama-cookbook package

1K 18K 3K
Picovoice
picollm

On-device LLM Inference Powered by X-Bit Quantization

1K 311 25
laelhalawani
gguf-modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

874 13 3
haotian-liu
llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

858 25K 3K
meta-llama
llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

806 18K 3K
laelhalawani
gguf-llama

Wrapper for simplified use of Llama2 GGUF quantized models.

771 7 1
liltom-eth
llama2-wrapper

Use llama2-wrapper as your local llama2 backend for Generative Agents / Apps

751 2K 202
    • Data from PyPI, GitHub, ClickHouse, and BigQuery