#Self-Hosted LLM

Black card: Retrieve for facts. Fine-tune for behaviour. Two lanes into one model: retrieved documents and a fine-tune lane into the weights. Looping GIF.

Self-Hosted AIAbdullah Chaudary19 October 202612 min read

Fine-Tuning vs RAG for a Self-Hosted LLM: Facts or Behaviour

Retrieve for facts, fine-tune for behaviour. In a Qwen3 demo, retrieval took a changed fact in 0.014 s while LoRA missed 3 of 8 facts, yet LoRA got a JSON contract right 10 of 10.

Posts

Fine-Tuning vs RAG for a Self-Hosted LLM: Facts or Behaviour