Question Answering Python Packages

spark-nlp

State of the Art Natural Language Processing

haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

simpletransformers

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

farm-haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

paddlenlp

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

adalflow

AdalFlow: The library to build & auto-optimize LLM applications.

nlpcloud

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, code generation, and more...

tool-helpers

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

fast-dataindex

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

vectorless

Knowing by reasoning, not vectors. ⭐ Star this repo if you find it useful.

deeppavlov

An open source library for deep learning end-to-end dialog systems and chatbots.

lightrag

AdalFlow: The library to build & auto-optimize LLM applications.

ai2-scholar-qa

Repo housing the open sourced code for the ai2 scholar qa app and also the corresponding library

nanoindex

Agentic RAG Harness for long documents, Tree and Graph based reasoning. Cited answers down to the pixel

wdoc

A perfect AI powered RAG for document query and summary. Supports ~all LLM and ~all filetypes (url, pdf, epub, youtube (incl playlist), audio, anki, md, docx, pptx, oe any combination!)

farm

Framework for finetuning and evaluating transformer based language models

mzutils

Mohan Zhang's toolkit

happytransformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

tevatron

Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.

doctoolsllm

Summarize and query from a lot of heterogeneous documents. Any LLM provider, any filetype, advanced RAG, advanced summaries, scriptable, etc

transformers-keras

Transformer-based models implemented in tensorflow 2.x(Keras)

kiri

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

fast-tokenizer-python

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

fastt5

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.