Search Packages

recordlinkage

A powerful and modular toolkit for record linkage and duplicate detection in Python

dedupe

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

django-super-deduper

Utilities for de-duping Django model instances

zingg

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

mail-deduplicate

📧 CLI to deduplicate mails from mail boxes

imgdupes

Identifying and removing near-duplicate images using perceptual hashing.

maildir-deduplicate

Deduplicate mails from a set of maildir folders.

dedupe-fork-eccovia

A python library for accurate and scaleable data deduplication and entity-resolution

superdeduper

A simple interface to datamade/dedupe to make probabilistic record linkage easy.

chkbit

Check your files for data corruption and run quick file deduplication

yadupe

Recursively scan one or more given directories for duplicate files.

oagdedupe

oagdedupe is a Python library for scalable entity resolution, using active learning to learn blocking configurations, generate comparison pairs, then clasify matches.

pgdedupe

A simple command line interface to the datamade/dedupe library.

dedupe-fh

A python library for accurate and scaleable data deduplication and entity-resolution