Hallucination Detection Python Packages

styxx

Cognitive observability for LLM agents. Nine calibrated cognometric instruments — pure-Python, MIT, no LLM required. 9-for-9 on K=1 phase transition. Every Mind Leaves Vitals (DOI 10.5281/zenodo.19777921).

gauntlet-cli

Behavioral reliability under pressure. Test how LLMs behave when things get hard.

uqlm

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

insa-its

Runtime Security for Multi-Agent AI — Website & Documentation

lettucedetect

Lightweight hallucination detection framework for RAG applications

yuragi

yuragi — LLM Confidence Fragility Analyzer. Perturbation-driven hallucination detection with workshop-grade real benchmarks (TruthfulQA n=412 ensemble AUC 0.73, TriviaQA n=200 confidence-inversion AUC 0.75).

uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

sovereign-shield

AI security framework: deterministic Immutable input filtering, adaptive rule learning, optional LLM veto verification. Zero dependencies. Works without an LLM. Patent Pending.

director-ai

Real-time LLM hallucination guardrail — NLI + RAG fact-checking with token-level streaming halt

dingo-python

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

longtracer

RAG verification guardrails — detect hallucinations in LLM responses using hybrid STS + NLI.

qwed

The Deterministic Verification Protocol for AI - 11 verification engines for math, logic, code, SQL, facts, images, and more. Now with Agentic Security Guards.

langchain-agentoracle

Trust layer for AI agents. Verify before you act. Per-claim verification via 4 independent sources. x402-native on Base, SKALE, Stellar.

hdm2

HalluciNot: Hallucination Detection Through Context and Common Knowledge Verification

certainlogic-guard

Linguistic confidence gate for AI responses. Catches hedging words (maybe, I think). Not fact verification. Zero dependencies.

sovereign-shield-adaptive

AI security framework: deterministic Immutable input filtering, adaptive rule learning, optional LLM veto verification. Zero dependencies. Works without an LLM. Patent Pending.

sovereign-mcp

Deterministic MCP Security Architecture. FrozenNamespace as Root of Trust for Model Context Protocol tool verification

backfire-kernel

Director-Class AI — Rust Backfire Kernel (50ms safety gate)

trusteval-ai

Enterprise LLM Evaluation & Responsible AI Framework — Benchmark bias, hallucination, PII leakage, and toxicity across Healthcare, BFSI, Retail & Legal industries. Supports OpenAI, Anthropic, Gemini & HuggingFace. Python SDK + CLI + Web Dashboard. 191 tests. Compliance-ready reports.

dep-hallucinator

Advanced security scanner for detecting AI-generated dependency confusion vulnerabilities with signature verification support

wraith

Catches what your AI forgot to check. Deterministic linter for AI-generated Python code — hallucinated APIs, phantom packages, hardcoded secrets, taint analysis. 20 rules, zero config.

hallucinationbench

Detect hallucinations in your RAG pipeline output — in two lines of Python.

syncreus-eval

Evaluate your LLM apps with one function call. Hallucination detection, RAG scoring, and agent evals for OpenAI, Anthropic, and more. 14 evaluators, pytest plugin, composite trust scores.

medguard-llm

Healthcare-specific LLM guardrails middleware for clinical safety