Disagreement based metrics for the processing and evaluation of crowdsourced annotations
CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems
Utilities for lark's ambiguous trees