AIQB
TutorialsOrdinary

I gave 9 free AI coding models the same real bug. Here is what happened.

Source: DEV Community·

Summary

Same open source bug, same brief, hidden tests the models never saw. 8 of 9 free models fixed it, the fastest in 84 seconds. The interesting part was how the others went wrong.
CategoryAI Tutorials & Practice
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-43a729940690965989cb5c3d
Read original source ↗More Tutorials

Related stories

Matched by category, entity tags and source

TutorialsOrdinary
The Tools That Got Replaced
A @tool function is twelve lines. What the model receives is a contract written in your docstring — and 38 of the 46 built-in tools are being replaced.
Source: DEV Community
TutorialsOrdinary
948 Linux Root Exploits in One Run: What OpenAI's Kernel Pipeline Actually Proves — and What It Doesn't
OpenAI's November 4 research post, "A thousand fewer paths to root," reports a striking result: a...
Source: DEV Community · OpenAI
TutorialsOrdinary
A web page can drop AGENTS.md or CLAUDE.md into ~/Downloads. Codex obeyed in over 90% of tries, Claude Code in about half
According to Forever Security, a web page can save a file into ~/Downloads without a click, and a...
Source: DEV Community · Claude
TutorialsOrdinary
Vector search: HotKV vs Redis 8 vector sets, from 1 to 100 clients
Vector search sits underneath many AI features: retrieval for RAG, semantic caching, agent memory....
Source: DEV Community
TutorialsOrdinary
The model page said 8-bit. The checkpoint is 4.49 bits per parameter.
I was working out how much disk Kimi K3.1 Pro would need, and the model page gave me two numbers that...
Source: DEV Community · Kimi
TutorialsOrdinary
That HS code from your supplier (or ChatGPT) might not exist: validating US HTS codes in Python
How the US tariff schedule is structured, why copied codes go stale, and a small offline package (with an MCP server) that checks them against the official USITC data.
Source: DEV Community · ChatGPT
TutorialsOrdinary
Stop putting TODO comments in sample code
Reaching for `TODO` comments in code samples is an easy habit, but it creates broken execution paths and causes AI agents to generate incomplete code. Here is why we need to move toward **Executable Contracts** and how we can fix our sampl…
Source: DEV Community
TutorialsOrdinary
Your Claude Code Subagents Inherit Your Effort Level. 2.1.316 Lets You Set Them Lower
CLAUDE_CODE_SUBAGENT_EFFORT sets the effort subagents use when nothing else names one. Run one task twice in two worktrees and compare cost on your own repo.
Source: DEV Community · Claude
TutorialsOrdinary
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows
Audit of the 78-row SWE-bench Verified board on Hugging Face: 0 verified, 51 open PRs, 9 rows above swebench.com's best, one repo spanning 23 points.
Source: DEV Community · Hugging Face
TutorialsOrdinary
A test that fails when your docs lie
Five days after I published the docs for my app, 36 of its 37 pages described code that had changed...
Source: DEV Community