A Multi-GPU Programming Library for Real-Time Applications

They also offer Pro and Max versions with additional features like multi-GPU support and full LLM training capabilities In the future, Unsloth

Unfortunately, Unsloth only supports single-GPU settings at the moment For multi-GPU settings, I recommend popular alternatives like TRL

unsloth pro Unsloth Max, 2 T4, 3h 4m , 5h 14m , 1h 6m , 54h 20m Peak Memory Usage on a Multi GPU System System, GPU, Alpaca

unsloth multi gpu # RTX 3090, 4090 Ampere GPUs: pip install unsloth Peak Memory Usage on a Multi GPU System System, GPU, Alpaca