Roberta Python Packages

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

news-please

news-please - an integrated web crawler and information extractor for news that just works

adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

bertviz

BertViz: Visualize Attention in Transformer Models

farm

Framework for finetuning and evaluating transformer based language models

happytransformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

langformers

🚀 Unified NLP Pipelines for Language Models

texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

embedding-as-service

embedding-as-service: one-stop solution to encode sentence to vectors using various embedding methods

bert-seq2seq

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

belt-nlp

BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.

bert-seq2seq-ddp

bert_seq2seq的DDP版本，支持bert、roberta、nezha、t5、gpt2等模型，支持seq2seq、ner、关系抽取等任务，无需添加额外代码，轻松启动DDP多卡训练。

deberta

The implementation of DeBERTa

ernie

An Accessible Python Library for State-of-the-art Natural Language Processing. Built with HuggingFace's Transformers.

adamix-gpt2

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

smaberta

Wrapper for stable version of RoBERTa language models

embedding-as-service-client

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

fastc

Unattended Lightweight Text Classifiers with State-of-the-Art LLM Embeddings

nlp-lmd

Language Model Decomposition

sam-lora-lib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"