Animate Anyone 2: Character Animation with Environmental Affordances

2025-02-20
Animate Anyone 2:  Character Animation with Environmental Affordances

Building upon previous diffusion model-based character animation methods like Animate Anyone, Animate Anyone 2 introduces environmental awareness. Instead of solely focusing on character motion, it incorporates environmental representations as conditional inputs, generating animations that better align with the surrounding context. A shape-agnostic masking strategy and an object guider improve interaction fidelity between characters, objects, and the environment. A pose modulation strategy enhances the model's ability to handle diverse motion patterns. Experiments showcase the significant improvements achieved by this approach.