Home
Artists
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register
Partychan Telegram Find&Fuck Waifus ThePornDude
Home Artists Posts Import Register

Retargeting Mocap (and lil' dude) (Patreon)

Published:
2020-07-16 23:00:22
Imported:
2021-03

Content

Woooo!!!! I wish I had this thing months ago!

Here's a link to the free Rokoko retargeting addon.

The bit about how to use it to apply Mixamo (or other) data to the characters is at 4:40 (and for more info, check out Sam's video explaining it better).

Mostly I can't wait till quarantine's a bit more lax and I can scan a wider variety of people using the stuff I've learned! I have it down to a bit more of a solid workflow now, and I'm excited to make more of these guys.

Here's an FBX of the rigged Browncoat Nate guy (tier 7 folks, you already have him)
Here's a collection of mocap data of folks at a cafe (some good idling animations). Going to be uploading more of this soon, I promise! 

Files

Retargeting Mocap

Comments

Anonymous

Yes! Cont wait to see the nextDynamo.

Anonymous

Came for the tutorial, stayed for the guitar solo

Anonymous

T his is amazing! Photoscan tutorials pls!

IanHubert
>>40491622

hey!! So, I covered a lot of it in this video here: https://www.patreon.com/posts/turning-people-36836508 But I learned a bit since then, so I'll definitely try to create an updated version at some point soon, here!

Anonymous

Just what I needed, thanks Ian!

Alex Doyi

I'm not sure if you have tried the NLA editor yet, but it might be helpful for you if you've got a large amount of characters. It's basically a more robust method of when you duplicated the conversing animation and offsetted it. It allows you to save animations as "actions" then you are able to loop them, stack them (ex. add an idle animation + a smoking animation, so your character can chat and smoke), or transition them.

Anonymous

album when?

Kai Christensen

Very cool. You're adding so much production value to so many of the community's renders by doing all this!

Anonymous

Thank god it's there!

IanHubert
>>40495626

Ah yeah!!! I poked around with that like literally 12 years ago or something, but that would be great to look into! Especially if it lets you "fade" between actions- that could be really cool. Thanks for the tip!!

Anonymous

Fascinating as this was, the highlight for me was the impromptu performance at the end. :) Maybe keyframe decimation would be handy on that mocap data...

Anonymous

I'm having trouble installing the add on.. Blender is not letting me check the box to enable it. Any help?

IanHubert
>>40507378

Huh- interesting. I had a bit of trouble originally, but did a complete uninstall/reinstall and it's worked for me since. Which version of blender are you using?

Jan van den Hemel

That's a life-changing add-on, can't believe it's free. If I can give a Mixamo tip (I'm sure you know, but for other people): in the import screen where you check "auto orient bones" and stuff for the Mixamo animations, you also have to enter a different scale (don't leave it at 1), I don't remember the correct scale off the top of my head but I think it was like 0.1 or 0.05 or something...? But anyway this add-on solves a lot of problems!!! I thought it was part of buying the suit, which would have been fair enough. But free!! Whoa

Anonymous

Super cool tut, Ian. Unrelated - but could you lay down some info on combining camera tracked shots with manually animated camera movement - like the shot in your drips/steam tutorial? That'd be killer.

IanHubert
>>40509333

Oh interesting!!! So- I could have sworn in my experiments it turned out that if you hit "Alt+S" it always defaulted to the same size, and the FBX import scale was just a transform- but there's a 99% chance I was in a State of Ultimate Chaos, haha, yeah man- FBX scaling was the hardest part of this whole thing, for me! Thanks for the heads up on that; I suspect we'll all have to battle FBX scaling at some point in the future. And yeah! Pretty delighted they went the free route, actually! With any luck it's going to save a lot of headaches.

IanHubert
>>40510996

AH! Yeah! I have two that I think are about exactly that. Maybe you've already seen them? I still want to get more in depth at some point. https://www.patreon.com/posts/re-animating-in-36909454 https://www.patreon.com/posts/making-shot-in-37501621 Here's another where I talk about the same sort of thing but from more of an after-effects perspective (at least in terms of tracking): https://www.patreon.com/posts/ae-to-blender-3d-34871595 It sounds like you've already dug through a lot of the tutorials, so maybe you've already seen these, but hopefully they help??

IanHubert
>>40503456

Oooo- that probably WOULD be useful. Just a bit of smoothing to get rid of any jitter (or stylistically, for controlling quasi-animated characters, maybe)

Anonymous

Ahaa! I thought I had searched through them all - must have glazed over that first one. From the first couple minutes, it looks like it's exactly what I was looking for! Cheers man. Also, isn't it like 4am in WA state? Quite the night owl.

Anonymous

Wow, this looks amazingly quick! As far as Photogrammetry is concerned for people, is this May 7th tutorial still your preferred workflow for the scan? https://www.patreon.com/posts/turning-people-36836508

Anonymous

This looks so exciting, gotta give it a try! By the way, I recently discovered your music is SO GOOD!. I can't stop watching "Everybody loves pasta" over and over.

Anonymous

hey ian, thanks so much! On the topic of mocap... do you have any recommendations for people who'd want to get mocap gear (suits, equipment, etc) for filmmakers on a budget? (I always imagine you have to spend quite alot to get anything relatively decent). Again- thanks for being so charitable with your stuff!

Anonymous

It is a very interesting addon !! thanks. I'm also having problems installing the addon I have blender version 2.83 installed

Anonymous

I have blender version 2.83 installed

Anonymous
>>40536833

I already made it work. There was only some remnant of another old uninstalled addon that had left garbage, now if it works

Darren Penuliar

Holy crap the transition from pure chaos to an actual bop at 6:26

Anonymous
>>40507378

I have the same issue; valueerror: _type_ 'v' not supported - are you on a MacBook, Tyler Babb?

Anonymous
>>40536833

I'm having troubles installing, whenever I try to tick the box to enable the addon valueerror: _type_ 'v' not supported Was this similar to your issue? If so what was the solution?

Anonymous
>>40536833

I had problems installing it too, I got several messages, I do not remember if the one you are telling me also came out the solutions going to the directory where the message marked me and check if there was something that was not correct, I discovered the rest of an addon that I had installed and uninstalled days before and that left traces, I deleted it and then the installation worked

Anonymous
>>40536833

Okay, thanks - I found out that the addon doesn't support mac osx yet. Hopefully, an update will come soon

Anonymous
>>40507378

Apparently OSX isn't supported yet, but they're working on it. Heh

IanHubert
>>40536833

Oh it doesn't? Dang, I didn't know that. Maybe I should have held off on talking about it, I was just really excited to finally have something that fixed so many issues I'd been having.

Daniel

How do I super like this, had a client that needed simple mixamo animations retargeted to a rig with a tight turnaround and I thought I was going crazy, every single solution was so backwards and so time consuming. THANK YOU SO MUCH, this is literally going to change my life.

IanHubert
>>40528904

Hey Mark! So- suit wise, I THINK the cheapest practical option is what I've currently got, a Rokoko suit. I absolutely love it- it's all accelerometer based, so you don't need external sensors or anything, just some wifi and the suit. Around 2,500 or so? That said, can you get cheaper?? I think so... I've seen some really cool demos of AI based skeleton extrapolation from video (the Kinect was doing stuff like that 10 years ago), and I suspect the technology is going to be to some level of production-ready fairly soon here. I haven't actually seen it used in anything yet, though, that I recall.

IanHubert
>>40597149

AH! That's awesome to hear! I hope it works! Apparently a few folks have had trouble installing the addon.

Anonymous

Hey Ian, excellent video! I'm not quite sure but did you end up showing us the process of rigging the figures? Was it manual or automatic?

Anonymous

That's soo cool, thanks ! Yeah I guess right now at least all the mac / linux users won't be able to install this addon, as it's Windows only. I actually pushed an issue on their github for this and I got feedbacks from rokoko devs, the good news is that it's completely the plan for them to support those OS'es as well for the final version, it's just that they first released the beta version on one OS only to get feedbacks first. At least I saw they pushed for now a fix to warn people that it won't work when you are not on Windows, should clear up some misunderstanding up front ;)

Anonymous

I found this video while i was in the middle of trying to retarget some borked mixamo data and the addon really helped. Actually it didnt help at all, it gave me exactly the same issue, but it tried, and that made me feel much better and less annoyed, which really helped (the w quaternion rotation on the shoulders gets +90 degrees for no reason?? but if i retarget the same animation from mixamo downloaded with the skin its fine?) anyway awesome video, really relevant and helpful to me rn, and youre a good singer

Anonymous

This is amazing. To hopefully save somebody else some time: this is Windows only for the moment. It installs on the Mac but then doesn't work and I ended up filing a ticket with the amazing Rokoko people. They told me that they have yet to add Mac OS support, and don't currently have an ETA for that. [Update just saw that someone commented on this being Windows already before]

Anonymous

Excellent work... and singing.

Anonymous

im confused about the work flow between different types of rigs. how does the rokoko rig differ to other rigs such as rigs from make human or mixamo. does the re-targeting feature of the rokoko add on simply allow you to translate animation data between them all? what if the rigs are different? thank you!