Does anyone know if it can be used to generate accurate frame-by-frame sprite sequences? I found that no image model can do this well (with sufficient fidelity) - neither with one shot (full spritesheet), nor single frame conditioning. It would be great if an imagegen model could do this. What I do now (I use my own tool <a href="https://github.com/acatovic/ai-game-studio" rel="nofollow">https://github.com/acatovic/ai-game-studio) is basically generate a reference image, then condition on that image to generate a very short video, then extract and prune frames. Then I get indie-level sprite fidelity about 90% of the time.
An (apparently, as I haven't tried it) ready-to-go ComfyUI graph for the above. In theory you should be able to drop these into ComfyUI and have it work:
armcat · · focus · HN ↗
nicerice · · focus · HN ↗
<a href="https://media.discordapp.net/attachments/1401891025970008154/1552060356220686336/2511_vs_21.mp4?ex=6ac16b58&is=6ac019d8&hm=bb259d2b5e1ce5169721568ddff15ba227685d639660b21c1a111b3afdcf0794" rel="nofollow">https://media.discordapp.net/attachments/1401891025970008154...
I don't know what went into making it, but their twitter is @araminta_k if you're curious
justinclift · · focus · HN ↗
* <a href="https://alvdansen.github.io/animating-on-twos/" rel="nofollow">https://alvdansen.github.io/animating-on-twos/
* <a href="https://github.com/alvdansen/animating-on-twos" rel="nofollow">https://github.com/alvdansen/animating-on-twos
* <a href="https://huggingface.co/alvdansen/h3-keyframe-animation" rel="nofollow">https://huggingface.co/alvdansen/h3-keyframe-animation
## Quick Start
An (apparently, as I haven't tried it) ready-to-go ComfyUI graph for the above. In theory you should be able to drop these into ComfyUI and have it work:
<a href="https://huggingface.co/alvdansen/h3-keyframe-animation#quick-start" rel="nofollow">https://huggingface.co/alvdansen/h3-keyframe-animation#quick...
[deleted] · · focus · HN ↗
[deleted]