Articles, guides, and insights on local artificial intelligence
1 article found per "vram"
Fine-tuning with LoRA and QLoRA: when it's truly needed, how to prepare 100-500 quality examples, how much VRAM it takes (8-12 GB in QLoRA for a 7B), and which local tools to use: LLaMA-Factory, Unsloth, MLX.