Video to Motiona project by kyon |
|||
i was working on oai-waifu and needed animations.
hand animations are out of the scope of indie studios and i’m not an animator. mocap gear avgs around $6,000 and that’s just one suit.
so what about just downloading preset animations?
turns out there aren’t a lot of great anim libraries on the internet.
sure, mixamo is nice but it’s geared for gaming. log in, search “idle” or “walking” and see how many results you get.
this sucks because basic animations like these are what we need the most. so my thought process on this was quite simple: - the internet has billions of videos - why not just extract motion out of those?
there are a few startups and corpos that offfer this service, but that’s not how we do things around here.
so lets build.
SMPL -> VRM bones: - axis-angle based rotations extracted per quaternion - new animation file format (streaming support)
will open src when after cleanup
will be adding facial expressions + hand (fingers) next
added hands, still needs lots of refinement will post vid soon
hand + fingers have been implemented, a lot more work to be done.
next: facial expressions
(this is me procrastinating from genshin shader work)
note: fps on source vid is synced to match waifu’s superior fps
took me longer to crop, edit, add music to this than to generate this output btw
(perfecting hand pos next)
no figma just rawdog design, i just place everything first and then try to figure out if it makes sense. pixel perfect alignment once i’m happy with the vibe
