Fast computation of Krippendorff's alpha agreement measure in Python.
Disagreement based metrics for the processing and evaluation of crowdsourced annotations
CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems
Inter-annotator agreement for Brat annotation projects
