Nlp Library Python Packages

spacy

💫 Industrial-strength Natural Language Processing (NLP) in Python

pythainlp

Thai natural language processing in Python

tika

Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.

cn2an

📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）

janome

Japanese morphological analysis engine written in pure Python

nagisa

A Japanese tokenizer based on recurrent neural networks

urduhack

An NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.

unitxt

🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking

camel-tools

A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.

botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python

laonlp

Lao language Natural Language Processing toolkit

spaczz

Fuzzy matching and more functionality for spaCy.

medspacy

Library for clinical NLP with spaCy.

breame

Lightweight utility tools for the detection of multiple spellings, meanings, and language-specific terminology in British and American English

khmer-nltk

Khmer natural language processing toolkit

simstring-pure

A Python implementation of the SimString, a simple and efficient algorithm for approximate string matching.

pynlpl

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

fern2

A model development structure control for NLP

python-ucto

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

soe-vinorm

Soe Vinorm: An Effective Text Normalization Toolkit for converting Vietnamese text to its spoken form.

mlconjug3

A Python library to conjugate verbs in French, English, Spanish, Italian, Portuguese and Romanian (more soon) using Machine Learning techniques.

spacy-udpipe

spaCy + UDPipe

farm

Framework for finetuning and evaluating transformer based language models

contextualized-topic-models

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).