AIQB
TutorialsOrdinary

What is disaggregated prefill and decode in LLM inference?

Source: DEV Community·

Summary

What is disaggregated prefill and decode in LLM inference? Prefill is compute-bound, decode is...
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-7a8be50f69e2e1ec7b4ef342