Speculative Decoding for Coding Agents Was Indexing the Wrong Format
信息来源:DEV Community·
内容摘要
Why retrieval speculative decoding falls flat in agent pipelines, and how indexing files in emission format gives a 4.7x throughput boost without a draft model.