Speech Processing Python Packages

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

torchscale

Foundation Architecture for (M)LLMs

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

indic-num2words

Python library for converting numbers to words for all Indian Languages.

spafe

:sound: spafe: Simplified Python Audio Features Extraction

pysptk

A python wrapper for Speech Signal Processing Toolkit (SPTK).

swift-f0

Fast and accurate fundamental frequency (F0) detector using convolutional neural networks

resemble-enhance

AI powered speech denoising and enhancement

silero-vad-lite

Lightweight wrapper for Silero VAD using internal ONNX Runtime and with no python package dependencies

voicefixer

General Speech Restoration

diarize

Speaker diarization for Python — "who spoke when?" CPU-only, no API keys, Apache 2.0. ~10.8% DER on VoxConverse, 8x faster than real-time.

nnmnkwii

Library to build speech synthesis systems designed for easy and fast prototyping.

vak

A neural network framework for researchers studying acoustic communication

bournemouth-forced-aligner

Extract phoneme-level timestamps from speeh audio.

deepaudio-x

A python library to train Deep Neural Networks on various audio tasks using Self-Supervised backbones.

signal-transformation

Widely used signal transformation using TensorFlow API.

everyvoice

The EveryVoice TTS Toolkit - Text To Speech for your language

polyglotdb

PolyglotDB is a package for phonetic corpus storage and analysis

lfeats

A unified interface to extract hidden representations from speech foundation models

vistec-ser

Speech Emotion Recognition using PyTorch sponsored by AIS and VISTEC-DEPA AIResearch Institute Thailand.

scoreq

SCOREQ: Speech COntrastive REgression for Quality Assessment (NeurIPS 2024)

fastwer

A PyPI package for fast word/character error rate (WER/CER) calculation

zpe-prosody

ZPE-Prosody V0.0: DETERMINISTIC SPEECH PROSODY CODEC: Intonation | Rhythm | Stress | Emotional Contour | Pitch Transport | Duration Encoding

stark-engine

S.T.A.R.K - Speech and Text Algorithmic Recognition Kit. Modern framework for creating powerfull voice assistants.