Speech Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

torchaudio

Data manipulation and transformation for audio signal processing, powered by PyTorch

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

gtts

Python library and CLI tool to interface with Google Translate's text-to-speech API

whisperx

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

tts

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

monotonic-alignment-search

Monotonically align text and speech

silero

Silero Models: pre-trained text-to-speech models made embarrassingly simple

voxcpm

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

hume

Python client for Hume AI

deepfilternet

Noise supression using deep filtering

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

penn

Pitch Estimating Neural Networks (PENN)

senselab

senselab is a Python package that simplifies building pipelines for biometric (e.g. speech, voice, video, etc) analysis.

achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.

pysptk

A python wrapper for Speech Signal Processing Toolkit (SPTK).

sinapsis

Modular and Universal AI

allosaurus

Allosaurus is a pretrained universal phone recognizer for more than 2000 languages

nkululeko

Machine learning audio prediction experiments based on templates

pycodec2

Python's interface to codec 2

nlp

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

clearvoice

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

inaspeechsegmenter

CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.