AI圈报
教程 / 实战普通

The Eval Pyramid, Part II: Measuring Agent Reliability with pass@k, pass^k, and Judges You Can Trust

信息来源:DEV Community·

内容摘要

One passing trial says a system can succeed. Repeated trials, computed per task, say whether people can depend on it. Here's how to read pass@1, pass@k and pass^k, why the same 75% can describe two opposite systems, and how to check a model judge before it gates a release.
内容分类AI 教程与实战
内容层级普通情报
发布时间(北京时间)
本站收录时间(北京时间)
信息来源DEV Community
站内情报编号intel-9537733b57ecae3371b22471