Video Respeaking 3.0 | OmniNFT Relay Distillation 1.1 | Lip-Sync with Word Replacement

This is a video re-speaking application based on LTX2.3 Dev-Dare TIES Distilled 1.1 + LipDub IC LoRA + OmniNFT Enhancement + VBVR Temporal Stability + Motion Track Control + PromptRelay Smart Segmented Script + AudioRefTokens + Third-Order Rendering. After uploading an original video, users can fill in new global visual rules and segmented dialogue scripts, allowing the character to deliver new content while maintaining the original video's identity, scene, camera angles, background, and body movements as much as possible, generating natural new lip syncs.

The core advantage of this workflow is: Instead of regenerating a digital human from scratch, it "swaps words and syncs lips" based on the original video. It is suitable for rewriting video talking heads, foreign/Chinese redubbing, celebrity-style greeting videos, characters delivering new lines, short drama dialogue patching, product talking head re-recording, secondary copywriting of old footage, AI video rescue, and multilingual localized content. Compared to ordinary image-to-video or single-image digital humans, it emphasizes original video preservation + new dialogue lip synchronization: the original video provides the character, scene, motion, and camera, while the new dialogue / new audio provides the lip sync rhythm, with LipDub IC LoRA and AudioRefTokens responsible for realigning mouth movements. When using, it is recommended to focus on controlling four items: input video determines the original image, new dialogue script determines what to say, audio / AudioRefTokens determines the lip sync rhythm, and LipSync Guide strength determines the degree of original video retention.
🎁Claim RH Coins first, then experience the workflow! Avatar in the upper right corner → Invitation Code → Enter [rh-v1111] to instantly receive 1000 RH Coins, and log in daily to claim another 100 RH Coins~ For more ComfyUI workflows, tutorials, and gameplay, welcome to follow our WeChat Official Account (AIKSK), with simultaneous updates on Douyin / Bilibili / Xiaohongshu / YouTube (AI-KSK) ✨