Naphula-Archives 's Collections

Low VRAM Top Models

Ideal models for under 8GB GPU


  • Note Great for producing unhinged output, especially when combined with Fallen Command. It suffers from context degradation like other smaller models but is smarter than other 8Bs. For those with weaker PCs it should be used in conjunction with Tiger Gemma 9B, as system prompt adherence is its biggest flaw.


  • Note Mostly obsolete now except for low VRAM agentic use. Better than Gemma 3 12B in my tests. IQ3_S fits entirely on 3060 ti. Tiger 9B works well for system prompts. Has briefer outputs. Recommend settings for 8GB VRAM Tiger-Gemma-9B-v3.i1-IQ3_S.gguf --flashattention --contextsize 8192 --gpulayers 45 (use higher quality if possible)