AI圈报
教程 / 实战普通

On-Policy Distillation Works Better Without the Teacher

信息来源:DEV Community·

内容摘要

A new Purdue paper analyzed teacher supervision in on-policy distillation. The teacher scores are mostly noise, and a fixed negative penalty beats a full teacher model on AIME24.
内容分类AI 教程与实战
内容层级普通情报
发布时间(北京时间)
本站收录时间(北京时间)
信息来源DEV Community
站内情报编号intel-759428d96c8310e0e9ed46bc