Local LLM vs Cloud: Idle RAM Is Not Waste
Sam Altman calls RAM in personal computers wasteful at 5% use and wants maximum cloud utilization. In local LLM vs cloud, utilization is the landlord's metric.
#RAG
Posts tagged RAG on abchaudary.me.
Posts
Fine-Tuning vs RAG for a Self-Hosted LLM: Facts or Behaviour
Retrieve for facts, fine-tune for behaviour. In a Qwen3 demo, retrieval took a changed fact in 0.014 s while LoRA missed 3 of 8 facts, yet LoRA got a JSON contract right 10 of 10.
Qdrant and BGE-M3: Hybrid Search Without a Second Model
BGE-M3 produces dense and sparse vectors from one pass, so Qdrant can run hybrid search for production RAG without a second embedding model: prefetch both, fuse with RRF, filter early.