How to Dub a Video into Another Language
A step-by-step tutorial for dubbing a video into another language, with every speaker's voice cloned automatically, lip sync, and styled subtitles.
Dub a Video
In this tutorial you will take a video and produce a dubbed version in another language, where every speaker keeps their own voice. By the end you will have a finished video with styled subtitles, and lip sync if you want it.
For a full reference on every part of the pipeline, see the Video Dubbing docs.
Prerequisites
- Voice Creator Pro, running either as the desktop app on your machine, or in your browser with VCP Cloud
- A video file with clear speech
Step-by-Step Walkthrough
Step 1: Open Dubbing and Add Your Video
Open Dubbing from the sidebar and click New project. Drop in your video, or click to choose one. MP4, MOV, MKV and WebM files work.
Cleaner source audio produces a better dub. If your video has heavy background music or noise over the speech, expect to fix more lines later.
Step 2: Select Your Languages
Choose the Source language (the language your video is in now) or leave it on Auto-detect. Then choose the Target language you want to dub into. You can dub into 21 languages, including Spanish, French, German, Japanese, Korean, Chinese, Hindi, and Arabic.
Step 3: Tell It About the Speakers
If you know how many people speak, set Number of speakers. It makes speaker detection much more accurate. If the Speaker detection menu is there, pick Nemotron for videos with quick back-and-forth and short replies.
Step 4: Check the Voices
Clone voices from the video is on by default, so everyone keeps their own voice in the dub. Untick it if you want to pick a Default voice instead. You can change any speaker's voice after the dub is done.
Step 5: Check Advanced Settings
Open Advanced settings to pick the Voice model and Transcription model, choose how lines fit the original Timing, and decide whether to Keep background music / SFX. Tick Lip sync after dubbing to lip-sync the video as soon as the dub is done. Lip sync works on videos up to 60 seconds long.
Step 6: Start Dubbing
Click Start dubbing. Voice Creator Pro transcribes the original speech, detects the speakers, translates the lines, and generates the dub in each speaker's cloned voice. Lines are fitted to the original timing, pauses stay where the speaker paused, and the original background music and sound stay under the new dialogue. You can switch to another part of the app while it runs.
Step 7: Fix Any Lines That Need It
When the editor opens, play through the dub. Hover a segment to fix it:
- Click the pencil icon to change the translation, then click Regenerate.
- Click Regenerate to generate a line again in the same voice.
- Click the speaker name to move a line to another speaker.
- Use Split when one line has two speakers, or Merge next to join two lines.
- Click Delete to remove a line from the dub.
If a segment shows No voice, open Speakers and pick a voice for that speaker, then regenerate the line. If a cloned voice sounds off, use the Speakers panel to trim its reference clip or pick a cleaner one.
Made a mistake? Click Undo, or press Ctrl+Z.
Step 8: Add Lip Sync
If you didn't turn on lip sync before the dub, click Lip sync in the editor. When it's done, switch to the Lip-synced tab above the video to watch it.
Step 9: Style Your Subtitles
Click Subtitles on the video and pick a style. Hover over a style to preview it on your video. To change it, click Customize and use the Text, Layout, Box and Motion tabs. When you like the look, click Save style to reuse it on other videos.
See Subtitle Styles for every option.
Step 10: Export
Click Export video and choose:
- Download video for the finished dub, with your subtitles burned in
- Download audio only (.wav) to upload the dub as an extra language track on YouTube
- Download subtitles for an SRT, WebVTT or JSON file, or a transparent subtitle video
The export keeps going if you leave the screen.
Tips for Best Results
- Start with clean speech. The clearer the original audio, the better the transcription, translation, and cloned voices.
- Set the number of speakers. It is the easiest way to get each line on the right speaker.
- Check the translation first. Fixing a line before you regenerate saves time.
- Fix lines one at a time. Don't run the whole video again for one bad line. Regenerate just that segment.
- Use the glossary for names. Add product names and other fixed terms under Glossary so they translate the same way every time.
- Save a subtitle style. Once you have a look you like, save it and reuse it across videos.
Next Steps
- Video Dubbing reference - Full details on the dubbing pipeline and editor
- Subtitle Styles - Every style and setting for your captions
- Voice Changer - Re-voice a single recording into one target voice
- Voice Cloning - Clone a voice yourself to assign to a speaker
Change a Voice
A step-by-step tutorial for converting an existing recording into a different voice while keeping the original words, timing, and emotion.
Generate an Audiobook
A step-by-step walkthrough for turning a book file into a finished M4B audiobook with chapter markers, a voice for every character, and consistent pronunciations.