AIQB
TutorialsOrdinary

Every Greedy Metric Said the Model Was Improving. Then pass@64 Fell From 0.83 to 0.19

Source: DEV Community·

Summary

Outcome-only RL on a toy system looked great on greedy metrics while silently destroying the sampling channel that search-based deployment relies on. A registered-prior falsification story.
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-ab216c781cf5455aaf63b2d3