Search Packages

weblate

Web based localization tool with tight version control integration.

crowd-kit

Control the quality of your labeled data with the Python tools you already know.

toloka-kit

Toloka-Kit is a Python library for working with Toloka API.

wq

📱🌐📋 wq: a modular framework supporting web / native apps for mobile surveys and geospatial data collection. Powered by Django REST Framework, Redux, React, and Material UI.

crowdtruth

Disagreement based metrics for the processing and evaluation of crowdsourced annotations

crowdnalysis

Library to help analyze crowdsourcing results

crowdtruth-fork

CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems

weblate-a1az

A web-based continuous localization system with tight version control integration

weblate-em0t

Web based localization tool with tight version control integration.

turkle

Django-based clone of Amazon's Mechanical Turk service running in your local environment.

garner

A library containing all you need to easily integrate with the Garner data crowdsourcing system

crowded

🤖 Guideline for designing optimal crowdsourcing experiments

slopit

Tools for detecting the use of AI assistance in crowd-sourced data collection