Local LLM vs Cloud: Idle RAM Is Not Waste
Sam Altman calls RAM in personal computers wasteful at 5% use and wants maximum cloud utilization. In local LLM vs cloud, utilization is the landlord's metric.
#Self-Hosted LLM
Posts tagged Self-Hosted LLM on abchaudary.me.
Posts
Fine-Tuning vs RAG for a Self-Hosted LLM: Facts or Behaviour
Retrieve for facts, fine-tune for behaviour. In a Qwen3 demo, retrieval took a changed fact in 0.014 s while LoRA missed 3 of 8 facts, yet LoRA got a JSON contract right 10 of 10.