AI圈报
教程 / 实战普通

A weekend with TensorFold on a MacBook: the engine mattered, the quant did not

信息来源:DEV Community·

内容摘要

A 27B dense model on my MacBook decodes at about 26 tokens a second. That is fine for chat and...
内容分类AI 教程与实战
内容层级普通情报
发布时间(北京时间)
本站收录时间(北京时间)
信息来源DEV Community
站内情报编号intel-9b82e551894e28e3883e5533