Search Packages

switch-transformers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

vllm-sr-sim

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

mixturelib

The implementation of mixtures for different tasks.

vllm-semantic-router-bench

Comprehensive benchmark suite for semantic router vs direct vLLM evaluation across multiple reasoning datasets