SCAIL-2 Motion Transfer

SCAIL-2 is an open-source model for end-to-end controlled character animation. It uses a driving video to animate a reference character, supporting character replacement and multi-character scenes without relying on intermediate pose representations.

🔎 Overview

Previous character animation methods relied heavily on intermediate representations such as skeleton maps or inpainting masks. These intermediate representations suffer from ambiguity under complex motions, restrict driving sources to human actions, and hinder the development of character replacement and multi-character animation.

SCAIL-2 eliminates this dependency, enabling end-to-end driving. By utilizing multiple off-the-shelf models (SCAIL-Preview, Wan-Animate, MoCha), 60,000 pairs of motion data were synthesized and trained through a unified motion transfer interface (featuring a dedicated mask channel and RoPE design). Combined with a reverse-driving training strategy and a unified architecture, the model learns capabilities that surpass its teacher models, giving rise to the following features:

• Cross-identity character replacement
• Animal-driven scenes
• Zero-shot support for high-level control intermediate representations (such as SAM3D-Body mesh rendering)

📦 Models

Downloaded file structure:

SCAIL-2/
├── Wan2.1_VAE.pth
├── model
│   ├── 1
│   │   └── fsdp2_rank_0000_Checkpoint.pt
│   └── latest
└── umt5-xxl
    └── ...