Contents
A recurring question is whether fine-tuning is necessary. Most of the time the answer is no. Here is how to know when you actually need it.
The four levers
Prompting, RAG, tool use, then fine-tuning. The first three are reversible and cheap — exhaust them first.
When fine-tuning is right
Consistent style, ultra-strict format, latency-critical, massive recurring cost, proprietary domain knowledge.
When it is a mistake
To teach new knowledge (use RAG), to patch occasional errors, without clean eval set.
