Record Linkage Python Packages

recordlinkage

A powerful and modular toolkit for record linkage and duplicate detection in Python

4.6M 1K 153

splink

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

740K 2K 234

dedupe

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

100K 4K 569

csvmatch

🔎 Finds fuzzy matches between CSV files

8K 191 21

anonlink

Python implementation of anonymous linkage using cryptographic linkage keys

7K 74 8

goldenmatch

🟡 Golden Suite — polyglot data-quality + entity-resolution toolkit. GoldenCheck profiles → GoldenFlow standardizes → GoldenMatch dedupes → GoldenPipe orchestrates. Zero-config defaults, 97% F1, MCP server per package + one master, multi-arch container images, drop-in Airflow DAGs.

5K 36 5

floof

Fuzzymatching made easy

5K 5 0

clkhash

CLK hash: hash pii for entity matching

3K 47 7

deduplipy

Python package for deduplication/entity resolution using active learning

2K 82 8

whereabouts

Fast, accurate open source geocoding in Python

2K 71 11

splink-graph

pyspark-parallelised functions producing graph-theoretical metrics in connected component clusters for use in record-linkage (or other domains)

1K 10 5

easylink

A tool that allows users to build and run highly configurable record linkage/entity resolution pipelines.

1K 11 0

blocklib

Python implementations of record linkage blocking techniques.

1K 21 4

gecko-syndata

Python library for the generation and mutation of realistic personal identification data at scale

1K 6 2

mismo

The SQL/Ibis powered sklearn of record linkage

1K 23 4

anonlink-client

Client side tool for clkhash and blocklib

869 6 2

blockingpy

Blocking records for record linkage and data deduplication based on ANN algorithms in Python.

712 20 2

rltk

Record Linkage ToolKit (Find and link entities)

679 111 22

hlink

Hierarchical record linkage at scale

648 13 2

pprl-model

Collection of software packages for performing privacy-preserving record linkage based on Bloom filters

640 1 0

splinkclickhouse

Allows Clickhouse to be used as the execution engine for Splink

613 6 0

entity-embed

PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

470 161 16

dedupe-fork-eccovia

A python library for accurate and scaleable data deduplication and entity-resolution

387 4K 569

deduper

OneFlorida De-duplication Software

345 12 4