Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Distributed Stockfish analysis for lichess.org
📜 A python library for distributed training of a Transformer neural network across the Internet to solve the Running Key Cipher, widely known in the field of Cryptography.
Easy way to efficiently run 100B+ language models without high-end GPUs