Introducing Song Creator Pro — create music with AI, locally on your device. Try it now →

How to Dub a Video into Another Language

A step-by-step tutorial for dubbing a video into another language, with every speaker's voice cloned automatically, lip sync, and styled subtitles.

Dub a Video

In this tutorial you will take a video and produce a dubbed version in another language, where every speaker keeps their own voice. By the end you will have a finished video with styled subtitles, and lip sync if you want it.

For a full reference on every part of the pipeline, see the Video Dubbing docs.


Prerequisites

  • Voice Creator Pro, running either as the desktop app on your machine, or in your browser with VCP Cloud
  • A video file with clear speech

Step-by-Step Walkthrough

Step 1: Open Dubbing and Add Your Video

Open Dubbing from the sidebar and click New project. Drop in your video, or click to choose one. MP4, MOV, MKV and WebM files work.

Cleaner source audio produces a better dub. If your video has heavy background music or noise over the speech, expect to fix more lines later.

Step 2: Select Your Languages

Choose the Source language (the language your video is in now) or leave it on Auto-detect. Then choose the Target language you want to dub into. You can dub into 21 languages, including Spanish, French, German, Japanese, Korean, Chinese, Hindi, and Arabic.

Step 3: Tell It About the Speakers

If you know how many people speak, set Number of speakers. It makes speaker detection much more accurate. If the Speaker detection menu is there, pick Nemotron for videos with quick back-and-forth and short replies.

Step 4: Check the Voices

Clone voices from the video is on by default, so everyone keeps their own voice in the dub. Untick it if you want to pick a Default voice instead. You can change any speaker's voice after the dub is done.

Step 5: Check Advanced Settings

Open Advanced settings to pick the Voice model and Transcription model, choose how lines fit the original Timing, and decide whether to Keep background music / SFX. Tick Lip sync after dubbing to lip-sync the video as soon as the dub is done. Lip sync works on videos up to 60 seconds long.

Step 6: Start Dubbing

Click Start dubbing. Voice Creator Pro transcribes the original speech, detects the speakers, translates the lines, and generates the dub in each speaker's cloned voice. Lines are fitted to the original timing, pauses stay where the speaker paused, and the original background music and sound stay under the new dialogue. You can switch to another part of the app while it runs.

Step 7: Fix Any Lines That Need It

When the editor opens, play through the dub. Hover a segment to fix it:

  • Click the pencil icon to change the translation, then click Regenerate.
  • Click Regenerate to generate a line again in the same voice.
  • Click the speaker name to move a line to another speaker.
  • Use Split when one line has two speakers, or Merge next to join two lines.
  • Click Delete to remove a line from the dub.

If a segment shows No voice, open Speakers and pick a voice for that speaker, then regenerate the line. If a cloned voice sounds off, use the Speakers panel to trim its reference clip or pick a cleaner one.

Made a mistake? Click Undo, or press Ctrl+Z.

Step 8: Add Lip Sync

If you didn't turn on lip sync before the dub, click Lip sync in the editor. When it's done, switch to the Lip-synced tab above the video to watch it.

Step 9: Style Your Subtitles

Click Subtitles on the video and pick a style. Hover over a style to preview it on your video. To change it, click Customize and use the Text, Layout, Box and Motion tabs. When you like the look, click Save style to reuse it on other videos.

See Subtitle Styles for every option.

Step 10: Export

Click Export video and choose:

  • Download video for the finished dub, with your subtitles burned in
  • Download audio only (.wav) to upload the dub as an extra language track on YouTube
  • Download subtitles for an SRT, WebVTT or JSON file, or a transparent subtitle video

The export keeps going if you leave the screen.


Tips for Best Results

  • Start with clean speech. The clearer the original audio, the better the transcription, translation, and cloned voices.
  • Set the number of speakers. It is the easiest way to get each line on the right speaker.
  • Check the translation first. Fixing a line before you regenerate saves time.
  • Fix lines one at a time. Don't run the whole video again for one bad line. Regenerate just that segment.
  • Use the glossary for names. Add product names and other fixed terms under Glossary so they translate the same way every time.
  • Save a subtitle style. Once you have a look you like, save it and reuse it across videos.

Next Steps