教程 / 实战普通
I Cut Dedicated GPU Memory to 4GB, and a Local LLM Still Ran at 90% Speed
内容摘要
On a Surface Laptop Ultra (RTX Spark, unified memory), I measured local LLM speed and Windows' free memory with the GPU's dedicated memory set to 4, 64, 82 and 96GB. Speed barely moved; memory left for Windows did.