UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
👽 Out-of-Distribution Detection with PyTorch
Python framework for high quality confidence estimation of deep neural networks, providing methods such as confidence calibration and ordinal ranking
Calculating exact and approximate confidence and information metrics for differentiable functions.
Reliable Statistics
Model Agnostic Confidence Estimator (MACEST) - A Python library for calibrating Machine Learning models' confidence scores