AIQB
TutorialsOrdinary

Ming-3.0-tts on a 16 GB card: the GPU sat mostly idle, and why a bigger one barely helps

Source: DEV Community·

Summary

Ming-3.0-tts-0.5B peaked at 2.9 GB and ran at about 0.65x real time. The Python decode loop sets the pace, not the card. What to measure first.
TierOrdinary
Published
Indexed by AIQB
SourceDEV Community
AIQB record IDintel-43363130ac91c01dd6cc9f91