Chinese Nlp Python Packages

rouge-chinese

Python ROUGE Score Implementation for Chinese Language Task (official rouge score)

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

airllm

AirLLM 70B inference with single 4GB GPU

ltp-extension

Language Technology Platform

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

ltp

Language Technology Platform

ltp-core

Language Technology Platform

pyltp

pyltp: the python extension for LTP 3

microtokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

thulac

An Efficient Lexical Analyzer for Chinese

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

synth-wiki

LLM-wiki: drop in papers/articles/notes, get a structured, interlinked, searchable wiki knowledge base. LLM-wiki：扔论文、丢笔记，自动生成交互链接、可搜索的个人wiki知识库。

plane

A text processing tool including tag(HTML, URL, Email) extraction and removing, punctuation normalization, simple segmentation, and so on.

pnlp

NLP预/后处理工具。

distilbert-punctuator

A small seq2seq punctuator tool based on DistilBERT

easy-zh-bert

easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习

ddparser

A chinese dependency parser tool by Baidu NLP.

muldichinese

An open-source library in Python for analysing Chinese registers

fancy-nlp

NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.

g2pc

g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese

hanlperceptron

Native Python HanLP Perceptron Model: HanLPerceptron 中文斷詞 詞性標註 命名實體識別

chop

Chinese Tokenizer module for Python

trad-zh-search

Traditional Chinese text preprocessing for search engines — CKIP segmentation + bigram indexing with pluggable domain dictionaries

thulac-test

An Efficient Lexical Analyzer for Chinese