Responsible Ai Python Packages

fairlearn

A Python package to assess and improve fairness of machine learning models.

raiutils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

dalex

moDel Agnostic Language for Exploration and eXplanation

erroranalysis

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

responsibleai

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

raiwidgets

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

regulated-ai-governance

Policy enforcement for AI agents in regulated environments (FERPA, HIPAA, GLBA, GDPR): framework adapters for CrewAI, AutoGen, LangChain, Semantic Kernel, Haystack

axonflow

Official Python SDK for AxonFlow — runtime control, MCP policy enforcement, approvals, and audit trails for production AI

ethicml

Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency

encypher-ai

Embed invisible metadata in AI-generated text using zero-width characters.

infairness

PyTorch package to train and audit ML models for Individual Fairness

holisticai

This is an open-source tool to assess and improve the trustworthiness of AI systems.

langtest

Pacific AI provides a library for delivering safe & effective NLP models.

rai-test-utils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

rhesis-sdk

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

raitap

Fully integrated pipeline to assess the transparency & robustness of AI models

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

nlptest

Deliver safe & effective language models

riskforge

RiskForge — EU AI Act Article 9 Risk Management File generator. 8-dimension assessment, hash-chained audit trail, 30-min CLI workflow. Apache 2.0.

aisploit

🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.

responsibleai-vision

SDK API to assess image Machine Learning models.

llama-stack-provider-trustyai-garak

Out-Of-Tree Llama Stack Eval Provider for Red Teaming LLM Systems with Garak

rhesis

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.