pyVideoTrans

Appearance

Video Translation Software Version 2.04 and later now supports using the Fish tts API for dubbing.

Deploying fish tts and Starting the API Service ​

First, you need to deploy fish tts and start the API service. Note that you must start the API service. Simply starting the web UI (opening the browser webpage) is insufficient. The default API address is http://127.0.0.1:8000/v1/invoke

Please refer to the relevant documentation for specific deployment and API startup instructions.

fish tts project open-source address https://github.com/fishaudio/fish-speech

Documentation address https://speech.fish.audio

Filling in the API in the Video Translation Software ​

After deployment and startup, confirm that the API is running. Then, open the video translation software, go to the settings menu in the upper left corner - Fish TTS, and enter the corresponding API address for fish tts. If you haven't modified it, the default is http://127.0.0.1:8000/v1/invoke

Next, fill in the reference audio and reference text.

The reference audio is the audio file containing the voice you want to use. For specifics on what this is and how to use it, please see the fish tts documentation.

The optimal duration for reference audio is 10-20 seconds, clear and without background noise

Suppose you want to use the voice tone from 1.wav, and the corresponding text for 1.wav is "Hello, my dear friends".

Then you need to fill in

1.wav#你好啊，我亲爱的朋友们

If you also want to use 2.wav, and its corresponding text is "The weather is nice today, let's go swimming", then fill in

1.wav#你好啊，我亲爱的朋友们
2.wav#今天天气不错哦，我们去游泳吧

After filling this in, click Save. On the main interface, select FishTTS under "Dubbing Channel", and you will see the added reference audio in "Dubbing Roles".

Notes ​

  1. Fish TTS only supports Chinese dubbing. This means that in video translation dubbing, the "target language" must be Chinese, otherwise it cannot be used.
  2. If you have added reference audio in the settings, but the corresponding role is not displayed on the main interface, please switch the dubbing channel to edgeTTS first, and then switch back to FishTTS.