Always Prompts Insufficient Video Memory (whole all Unable to allocate)
- Use a Smaller Model: Change the recognition model from
large-v3tomedium,small, orbase. Thelarge-v3model requires at least 10GB of video memory. - Try disabling the Secondary Recognition option in the top-right corner of the main interface. This is especially important when translating multiple videos simultaneously, as the secondary recognition of an earlier video may run concurrently with the first transcription of a later video, requiring 2-3 times the video memory. This could cause an error if the available video memory is insufficient.
- Adjust Advanced Settings: Make the following changes in the menu bar
Tools/Options->Advanced Optionsto sacrifice some accuracy for lower video memory usage:CUDA Data Type: Changefloat32tofloat16orint8.beam_size: Change5to1.best_of: Change5to1.Context: Changetruetofalse.
