How can I use Unsloth Pro for Multi GPU? · Issue #799

Multi GPU Fine tuning with DDP and FSDP unsloth multi gpu Sorry, guys I had to delete the repository to comply with the original Unsloth license for multi-GPU use, thanks for the heads up @UnslothAI unsloth multi gpu Unsloth Max, 2 T4, 3h 4m , 5h 14m , 1h 6m , 54h 20m * Peak Memory Usage on a Multi GPU System System, GPU, Alpaca

unsloth pro price Here's how Lightning Lite makes adding multi-GPU training support easier than ever Here is a 30-second animated image showing you how to scale your code