Home Artists Posts Import Register
Patreon importer is back online! Tell your friends ✅

Downloads

Content

AI movies are finally controllable! I'll show you how to combine my consistent and poseable character workflow with a new tool called Tooncrafter to create completely consistent and controllable AI animations.

I'll also show you how to use mid-journey and real-life photos as the basis for your own AI anime! As always, I'm just scratching the surface of what's possible with these workflows. I can't wait to see how you make them your own and what you create with them!

Here is the installation guide: https://docs.google.com/document/d/1R7eONw5aiAvhifUVb9DK433obnVX9rUGyVZWJvr1pyU/edit

You can download the workflows below. This image gives a quick overview of the workflows:

Please give me some time to prepare the supporter exclusive advanced workflows and guide. Once it is done you will find it here:

Files

Make your own ANIME with this new mind-blowing AI TOOL! (ComfyUI Tutorial + FREE Workflows!)

AI movies are finally controllable! I show you how to combine my consistent & poseable character workflow with a new tool called tooncrafter to create completely consistent AI animation. If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz Follow me on Twitter: https://twitter.com/mickmumpitz You can find the FREE WORKFLOWS & INSTALLATION GUIDE here: https://www.patreon.com/posts/new-video-make-106483196?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link You can find my PATREON EXCLUSIVE advanced guide, example files and poses here: [coming very soon!] Check out my last video on this subject: https://youtu.be/849xBkgpF3E?si=ohbXy_M5dA-6KJhq Tools used: ComfyUI https://github.com/comfyanonymous/ComfyUI midjourney https://www.midjourney.com tooncrafter (huggingface demo) https://huggingface.co/spaces/Doubiiu/tooncrafter tooncrafter in ComfyUI Chapters: 00:00 Intro & Overview 01:00 The Tool 02:00 midjourney 02:37 Tooncrafter on Huggingface 03:04 Using Photoshop 03:37 Create a model sheet in ComfyUI 04:19 Posing the Character 06:34 Animating the character 08:02 CleanUp & Upscale 09:05 Reference to Anime

Comments

HG

I joined your membership only to find the pose png are not here as you mentioned them in your YT video.

Mickmumpitz

It's there now. I'm also in the process of putting together a few example poses for the Controllable Character Workflow.

John Brennan

Hey mick ! Why do you bother to generate these large character model sheets but never use them in a workflow? I would expect to see one such sheet being used by an ipadapter node but instead I notice it’s just a single shot of face or body

Mickmumpitz

The model sheets were originally intended for a completely different workflow, which I'll be making a video about soon! But having all these different poses also helps with the ipAdapter workflow. For example, you could load the side view of your character if you want to generate one in side view. Or you could load in a different emotion from the close ups if you can't get far enough with the prompt. I also like the idea of having lots of different images to train Loras with and it looks cool ;)

John Brennan

Would I mistaken for thinking that ipadapter could just take a very robust and thorough model sheet as an input and ‘know the character’ and its many angles just from that image?:) we currently have to pick one angle at a time? I was hoping for the former for some of my animation tests! ‘and thank you🙏

John Brennan

I think I’m mistaken. Apparently clip vision might just see model sheet or contact sheet lacking the right resolution to go further and we have to control the turn around reference ourselves:(

Amanueal Hailu

Hey bro, I just joined but can’t seem to find the discord link And also why is the path for some of the models missing like the folder location for “ComfyUI-AnimateDiff-Evolved\models” In the ai render workflow is missing on my comfy ui I created the missing folders my self but it seems it doesn’t work

Oded Farber

hi while folowing the tutorial and WF's, I'm running into an error `decoderF` is not supported because: xFormers wasn't build with CUDA support attn_bias type is operator wasn't built - see `python -m xformers.info` for more info what should I do? (reinstalled xformers and even pytorch)

OctonionPrime

it completely ignores any pose I upload and just goes with the one from the initial character input, no matter what I do

Tom Suski

in comfy ui update folder - click update_comfyui_and_python_dependencies.bat that fixed it for me. Also it is good to have nvidia cuda installed on your system

Tom Saloschnig

Hey I have a problem with the pose workflow, I get this error: Error occurred when executing IPAdapterUnifiedLoader: ClipVision model not found. File "D:\Comfy\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Comfy\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Comfy\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Comfy\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 511, in load_models raise Exception("ClipVision model not found.")

Mickmumpitz

Can you try installing "ComfyUI Essentials" via the ComfyUI manager and testing it again?

Bladimir Salazar

Hello, is it possible to install Xformers on a M1 Mac?

trav land

After reading the install for comfyui, I got stuck on the 2nd step for Tooncrafter "Paste in python_embeded\python.exe -m pip install xformers --no-deps and hit enter. Wait until it's done. " I am running Windows 11... I kept getting an error saying it could not find Python.h file... and yes it is not there... the workaround I found was from here: https://github.com/comfyanonymous/ComfyUI/issues/4870 so instead of the above I used the command: python_embeded\python.exe -m pip install -U xformers --index-url https://download.pytorch.org/whl/cu124 Havent gotten all the way through the setup yet but it appears to load xformers when I start up ComfyUI so I wanted to share ....

Justin Kelly

From some reason I'm unable to get past the Upscale Face+Pix section. Anyone else having the same issue?