AIQB
TutorialsOrdinary

LoRA & DoRA: The Math, Memory, and Trade-offs

Source: DEV Community·

Summary

LoRA and DoRA explained: matrix shapes, the geometry of weight decomposition, exact memory math for a 27B model, and what the DoRA benchmarks support.
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-868a6dc5e8b81774de886015