Wan VACE Controlnet Video

Utilize depth or pose maps to control video generation

Usage 1:
1. Load video
2. Enable control function
3. Enter prompts
4. Generate

Usage 2:
1. Load video
2. Load reference image
3. Enable control function
4. Enter prompts
5. Generate

Features:
1. Pose control: Convert video into openpose human pose maps to control video, suitable for portraits
8. Depth control: Convert video into depth maps to control video, suitable for scenes

Parameters:
1. Random seed: Changing the random seed will alter the generated result
2. Resolution limit: The maximum width and height of the image/video will not exceed the set value, and the other side will scale proportionally

3. Skip the first few frames of the video: Control based on the original video frame count. For example, if the original video has 30 frames per second, setting this to 30 will skip the first second
4. Generated video duration: Set according to the video model. For example, the official wan2.1 example generates 81 frames with 16 frames per second, resulting in a 5-second video
6. Positive prompts: Control the generated image/video based on the uploaded image with appropriate descriptions



Note:

1. The force_rate parameter in the **Load video** node determines the frame rate per second. Entering 16 means 16 frames per second

1. The frame_load_cap and skip_first_frames parameters in the **Load video** node are only for preview reference
The final decision for skipping frames and video generation frames is made via the green parameter button

1. Save location

Videos will be saved in the "output/video" folder

2. Video acceleration

If your comfyui does not have triton and sageattn installed, please delete
WanVideo Torch Compile Settings for wan2.1 image-to-video
Change WanVideo Model Loader's attention_mode to sdpa
Otherwise, errors may occur

If you have low VRAM and cannot generate, you can set blocks_to_swap in WanVideo BlockSwap to 30~40. Although slower, it will at least generate

You can also join Ashuo's membership group via WeChat: yumengashuo

The community offers:
1. Exclusive advanced workflows for comfyui
2. Solutions to various problems
3. Ashuo's integration package to resolve environment conflicts, 100 original workflows
4. Latest international AI news
5. Community Q&A support