March 8, 2025
Unsloth – Getting Started
Unsloth has become synonymous with easy fine-tuning and faster inference of LLMs with fewer hardware requirements. From training LLMs to converting them into various formats, Unsloth offers a host of functionalities. Figure 1. Unsloth text streaming demo. This article will cover some of the most important aspects of starting with Unsloth. What will we cover while getting started with Unsloth? What is Unsloth? Why do we need Unsloth? How to install Unsloth on Ubuntu? How to we run inference with various LLMs? What is the ShareGPT chat template format and why do we need it? How to figure out chat