AIQBTutorialsOrdinary
Serving WeVisOne-VL-4B: two engines, two copies of the weights, one chess piece apart
Summary
The fast vLLM path holds the weights twice, needs tuned limits on 24 GB and once miscounted. The reference path ran every task on 16 GB.
CategoryAI Tutorials & Practice
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-5fe9c4677c2b9d2e66a18634