Sentence Segmentation Python Packages

sentencex

A sentence segmentation library with wide language support optimized for speed and utility.

razdel

Rule-based token, sentence segmentation for Russian language

natasha

Solves basic Russian NLP tasks, API for lower level Natasha projects

wtpsplit

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

wtpsplit-lite

✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models

nlptoolkit-corpus

Corpus processing library

sentsplit

A flexible sentence segmentation library using CRF model and regex rules

fast-sentence-segment

Fast and Efficient Sentence Segmentation

trankit

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

hasami

A tool to perform sentence segmentation on Japanese text

nlptoolkit-corpus-cy

Corpus Processing Library

hellonlp

NLP tools, word segmentation, sentence segmentation， New-Word-Discovery，新词发现

prose-tokenizer

High-precision prose and Markdown tokenization for natural language processing.

mawo-razdel

Продвинутая токенизация для русского языка с SynTagRus паттернами

b-labs-models

Pre-trained models for tokenization, sentence segmentation and so on

meitei-senter

Neural sentence boundary detection for Meitei Mayek (Manipuri) using SentencePiece tokenization and a CNN-based spaCy pipeline.

khmerpunctuate

Punctuation Restoration for Khmer language

spacyss

sentence segmenters for spacy2.0+

py-hasami

Sentence segmentation for japanese text

wtpsplit-triton

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

syntaxcomp

A package for extracting syntactic complexity measures from CoNLL-U annotations.