Show HN: Open-source fine-tuning in a Colab notebook https://ift.tt/Pq2OkhJ

Show HN: Open-source fine-tuning in a Colab notebook Posted before, but wanted to share if you want an open source alternative to OpenAI fine-tuning, give Unsloth a try! Phi 3.5 was just released, and is distilled from GPT4. Unsloth makes finetuning 2x faster, uses 70% less VRAM + has no accuracy degradations. We rewrite all backprop steps and reduce FLOPs and write everything in Triton (JIT low level CUDA). If you want to own the weights after fine-tuning, give Unsloth a spin! I have free Colabs and Kaggle notebooks as well at https://ift.tt/t8klsUT https://ift.tt/Bo4hH5G August 21, 2024 at 04:34AM