AIQB
TutorialsOrdinary

RAG evals that fail CI: a 30-question golden set caught 3 of 4 retrieval regressions

Source: DEV Community·

Summary

Originally published on RecallRun, where the full scripts and raw output are attached. How do you...
CategoryAI Tutorials & Practice
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-333b8297fc48e235608908da
Read original source ↗More Tutorials

Related stories

Matched by category, entity tags and source

TutorialsOrdinary
My Rust target/ said 325 GB. My disk said 1.65 GB free.
so last week my Mac said the disk was full. like, actually full. 1.65 GB left out of 494 GB. I ran...
Source: DEV Community
TutorialsOrdinary
When Cursor's MCP Connection Drops Mid-Workflow and the Agent Retries Blind
Quick guidance on when cursor's mcp connection drops mid-workflow and the agent retries blind.
Source: DEV Community · Cursor
TutorialsOrdinary
The Gate Held, the Draft Leaked: A Three-Metric Evaluation of a Support Agent's Safety Layers
The Gate Held, the Draft Leaked: A Three-Metric Evaluation of a Support Agent's Safety...
Source: DEV Community
TutorialsOrdinary
Claude Certified Architect Professional: CCAR-P Exam Guide
CCAR-P exam guide: 63 questions, seven domains, the $175 fee and differences from Foundations. A study plan and three original questions with explanations.
Source: DEV Community · Claude
TutorialsOrdinary
I measured burned-in subtitle removal with PSNR. The failures are the interesting part.
Most "remove burned-in subtitles" tutorials end at a before/after. The after always looks fine as a...
Source: DEV Community
TutorialsOrdinary
Your AI agent says "done". Here is what I check before I believe it
⭐ GitHub: github.com/grloper/plumbgraph · open source (Apache-2.0) · by @grloper ...
Source: DEV Community
TutorialsOrdinary
We're Building AI to Replace Ourselves. What's the Plan?
Weren't we supposed to be replaced by AI by now? Or at least work less? AI agents were supposed to...
Source: DEV Community
TutorialsOrdinary
The Tests Pass and the Code Looks Great: 6 Things I Check in AI-Generated Code Before Merging
AI-generated code has a particular way of failing. It does not look broken. It is neatly formatted,...
Source: DEV Community
TutorialsOrdinary
AI + Design #2: My AI Review Team Gave It 93. I Gave It 70.
Four AI reviewers, seven rounds, and a brand page they agreed beat its reference. Then I actually looked at it. What went wrong with the scoring.
Source: DEV Community
TutorialsOrdinary
9 Codex Config Keys to Set Before Your Coding Agent's First Long Task
Nine Codex config settings for a long unattended run, from approvals and network to AGENTS.md limits and secrets in the agent's shell.
Source: DEV Community