| # | model | KAI | arm | total/active B | precision | weights GB | KV GB | +overhead | VRAM GB | headroom |
|---|
VRAM = weights + KV + 2.5 GB overhead. Weights measured, KV estimated. MoE loads every expert (total), runs like its active size. ctx! = beyond the model’s own maximum context.