Computational Linguistics Python Packages

pythainlp

Thai natural language processing in Python

botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python

pycantonese

Cantonese Linguistics and NLP

rustling

A high-performance library for computational linguistics

pylangacq

Language Acquisition Research Tools

wordseg

Word segmentation models

arpa

:snake: Python library for n-gram models in ARPA format

pynlpl

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

python-ucto

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

linguaf

python package for calculating famous measures in computational linguistics

finntk

Some simple high level tools for processing Finnish text

morphseg

An efficient and easy-to-use morpheme segmentation library

folia

An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic annotation finding application in Natural Language Processing (NLP). This library was formerly part of PyNLPl.

pybo

🦜 NLP for Tibetan, in Python.

folia-linguistic-annotation-tool

FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. Flat allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm.

calamancy

NLP pipelines for Tagalog using spaCy

wikipron

Scraping grapheme-to-phoneme data from Wiktionary

fonetika

Russian/English/Estonian/Finnish/Swedish phonetic algorithm based on Soundex and Metaphone

ramonak

Універсальная бібліятэка па працы з тэкстам на беларускай мове для Python

glazing

Unified data models and interfaces for syntactic and semantic frame ontologies.

pystylometry

Comprehensive Python toolkit for stylometry

bllipparser

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

ruts

Библиотека для извлечения статистик из текстов на русском языке.

docria

Semi-structured Document Model (Next-generation)