Always Prompts Insufficient Video Memory (whole all Unable to allocate)
Video memory is full. Use a smaller model, such as medium or small instead of large-v3. The minimum video memory requirement for large-v3 is 8G, but this doesn't guarantee smooth operation with an 8G graphics card. Other software will also occupy video memory simultaneously, and larger videos will require more video memory. When this error occurs, please try:
- Use a smaller model, such as
small/medium/base - If you still want to use a large model, choose to use "Pre-segmentation" or "Equal segmentation"
- Modify Menu Bar -- Tools/Options -- Advanced Options
CUDA Data Type = Change float32 to int8. If an error occurs, change it to int16.
beam_size = 5 Change 5 to 1
best_of = 5 Change 5 to 1
Context Change true to false