GGUF vs safetensors — the runtime decides, not the format
信息来源:DEV Community·
内容摘要
The same model in three containers: 397 MB of Q4_K_M GGUF, 1.20 GB of BF16 GGUF, 1.50 GB of BF16 safetensors. The bytes are the record's honest numbers — the runtime decides.