Agent Evaluation Python Packages

trulens-core

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-otel-semconv

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-feedback

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-eval

Evaluation and Tracking for LLM Experiments and AI Agents

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

trulens-connectors-snowflake

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-cortex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-openai

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-litellm

Evaluation and Tracking for LLM Experiments and AI Agents

etzchaim

A diagnosable brain for your LLM. Cognitive architecture in the SOAR/ACT-R/CLARION/LIDA lineage, for the LLM era. Apache 2.0.

trulens-apps-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

any-agent

A single interface to use and evaluate different agent frameworks

trulens-apps-llamaindex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-bedrock

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langgraph

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-huggingface

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-nemo

Evaluation and Tracking for LLM Experiments and AI Agents

evalview

Open-source testing and regression detection framework for AI agents. Golden baseline diffing, CI/CD integration, works with LangGraph, CrewAI, OpenAI, Anthropic Claude, HuggingFace, Ollama, and MCP.

trulens-benchmark

Evaluation and Tracking for LLM Experiments and AI Agents

volnix

A living world where agents exist as participants alongside NPCs, internal actors, real service APIs, budgets, policies, and consequences.

agentassay

Token-efficient stochastic testing for AI agents. 5-20x cost reduction. 10 framework adapters. Paper: arXiv:2603.02601