Optimizing inference proxy for LLMs
A machine learning package for streaming data in Python. The other ancestor of River.
Combine multiple LLMs for better outputs.
