Mixed-vendor GPU inference cluster manager with speculative decoding
nvdocker is library built on top of the docker-py python sdk to build and run docker containers using nvidia-docker. Targets nvidia-docker2
A simple tool to show specified number of GPUs with desired memory to Tensorflow