Why Token-Level LLM Routers Spend 95% of Their Time on Cache Bookkeeping

Routing 5% of hard tokens to a 32B model and keeping the rest on a 0.6B model looks great on paper, until standard serving engines spend 95.8% of the step redoing prefix matching. TokenRouter fixes the scheduler and hits up to 64x higher throughput.