# LLM Fine-Tuning with LoRA

> Language models adapted to your terms, formats and tasks with LoRA and QLoRA, at a fraction of the cost of full training.

Some tasks need a model that knows your vocabulary, your document formats or your way of answering. We fine-tune open language models with LoRA and QLoRA, which train small adapter layers instead of the whole model. That needs far less GPU memory and time. The result can run on your own hardware.

- Area: AI Solutions
- Type: Solution package
- Category: AI Agent
- Tags: fine-tuning, LoRA, QLoRA, open models
- Source: https://www.sus-tech.com/en/solutions/llm-fine-tuning

## When fine-tuning is the right tool

Fine-tuning changes how a model writes and decides. It fits when the model should follow a fixed format, use your terminology or handle a narrow task very reliably, such as classifying tickets or extracting fields from documents. When the model mainly needs current facts from your documents, a [RAG knowledge base](/en/solutions/rag-knowledge-base) is usually the better choice.

## How a project runs

1. We define the task and how success is measured.
2. We prepare training data from your examples and check it for quality and personal data.
3. We train a LoRA or QLoRA adapter on an open model such as Llama, Mistral or Qwen, with open tools like Hugging Face PEFT or Unsloth.
4. We compare the result with the base model on your own test cases.
5. The model goes into your workflows, on your own hardware or in an EU data centre. vLLM serves the adapter together with its base model; several adapters can share one base model.

## Why LoRA and QLoRA

LoRA trains a few million parameters instead of billions. QLoRA also loads the base model in 4-bit precision, so larger models fit on a single GPU. Our post [LLM fine-tuning with LoRA and QLoRA](/en/blog/llm-finetuning-lora-and-qlora) explains both methods.

## Related blog posts

- [LLM Finetuning: LoRA and QLoRA](https://www.sus-tech.com/en/blog/llm-finetuning-lora-and-qlora.md)
- [RAG vs. Finetuning: Choosing the Right Strategy for your LLMs](https://www.sus-tech.com/en/blog/rag-vs-finetuning.md)

## Contact

Consulting and implementation: https://www.sus-tech.com/en/contact