Does anyone know if it can be used to generate accurate frame-by-frame sprite sequences? I found that no image model can do this well (with sufficient fidelity) - neither with one shot (full spritesheet), nor single frame conditioning. It would be great if an imagegen model could do this. What I do now (I use my own tool <a href="https://github.com/acatovic/ai-game-studio" rel="nofollow">https://github.com/acatovic/ai-game-studio) is basically generate a reference image, then condition on that image to generate a very short video, then extract and prune frames. Then I get indie-level sprite fidelity about 90% of the time.
I've stumbled upon a reliablish pipeline you create a reference sheet and a single image pose then trellis v2 for the body and unirig for tigging, then you generate the poses you need in a sheet and send the pose sheet plus the reference images, and use these as 2d anymation cycles and you compose on top of the scene with lanes, this focus all attention of the model to fidelity instead of background integration
armcat · · focus · HN ↗
avereveard · · focus · HN ↗