Kijai

/

LTX2.3_comfy

like 242

GERMAN DUBBING

SPANISH DUBBING

EDITED DIALOG

V2V Dub It - lip-synced dubbing in multiple languages

Inspired by the Just Dub It lora that currently is not available for LTX-2.3 (only works in LTX-2.0)
Since LTX already have built-in dubbing capabilities, the workflow masks the mouth area of the speaker, and you simply prompt a new language to speak.
LTX supports well over 100++ languages.

The workflow also does a voice conversion (clone) of the LTX dubbed audio to match the tone of the original input. As well as using MelBandRoformer to keep some of the ambient background ambient etc.

Can either be used for dubbing same dialog into another language, or entirely edit the dialog to something new.
Highly experimental workflow ;-) Currently only tested on 1 speaker. And due to the nature of how it works (masking), it might introduce changes.
But stays somewhat faithful to the input video.

An alternative way would be to use the other workflow available with either Fish Audio Pro or Qwen TTS and clone the voice that way to a new language.
(might do a quick variant where this is used instead, but since LTX seems to have quite a capable "TTS" built in, maybe thats plenty)

Feel free to try it out ;-) https://huggingface.co/RuneXX/LTX-2.3-Workflows