Home Artists Posts Import Register
Patreon importer is back online! Tell your friends ✅

Downloads

Content

AI is the future of VFX! In this deep dive, I'll show you a free workflow for compositing any video on any background for your movie projects.

Easily composite any video on any background with one click! I developed a free AI-powered ComfyUI workflow to automatically cut out the subject, match lighting, fix edges, and add additional VFX. Just import video and background, wait a few minutes, and get your final shot. 

Fine-tune and control the result further with traditional VFX tools like Blender and After Effects, and other mind-blowing AI tools. Whether you're creating a music video or sci-fi short, this workflow can transform the way you make movies!

Download the FREE version of this workflow below.

You can find the INSTALLATION GUIDE here: https://docs.google.com/document/d/1jErR3WXj-iLhyQuA4XBPmvvRxo_MQ8x6oU7twTSzOhE/edit?usp=sharing

You can find the exclusive ADVANCED workflow here: [Already uploaded, Link coming soon]

This is the first version of the workflow and I have lots of ideas about what I want to add.

So please let me know what features you would like to see or if you have any ideas!

Recommended Edge Fix / BG Fix Settings

For Edge Fix, light Diffusion: 

Use this to keep the subject and background image as close as possible to the original and only correct the edges and reduce flickering.

steps: 6

cfg: 1.5-2

sampler: dpmpp2m

scheduler: sgm_uniform

denoise: 0.65

Animate Diff Model: v3_sd15_mm

ControlNet: v11f1e_sd15_tile

strength: 0.65

For BG Fix, higher Diffusion: 

This allows you to integrate your subject more seamlessly into the image. This changes the style and makes it more AI-like. But it can look really cool! Use the BG mask to apply it to the background only, or use the Reactor Face Swap to correct your face if your subject looks too different.

steps: 8

cfg: 1.5-2

sampler: lcm

scheduler: sgm_uniform

denoise: 0.65

Animate Diff Model: AnimateLCM_sd15_t2v

ControlNet: v11f1e_sd15_tile

strength: 0.45-0.8 (Lower values will give your shot a more abstract AI look)

Files

This MIND BLOWING Workflow Just Changed Filmmaking

AI is the future of VFX! In this deep dive, I'll show you a free workflow for compositing any video on any background for your movie projects. If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz Follow me on Twitter: https://twitter.com/mickmumpitz You can find the FREE WORKFLOWS & INSTALLATION GUIDE here: You can find my PATREON EXCLUSIVE advanced workflow here: Easily composite any video on any background with one click! I developed a free AI-powered ComfyUI workflow to automatically cut out the subject, match the lighting, fix edges, and add additional VFX. Just import video and background, wait a few minutes, and get your final shot. Fine-tune and control the result further with traditional VFX tools like Blender and After Effects, and other mind-blowing AI tools. Whether you're creating a music video or sci-fi short, this workflow can transform the way you make movies! Tools used: ComfyUI BlenderAfter Effects Chapters:

Comments

John Nguyen

Good headline...it really is insane. Soooo good!

Daria Yudina

Hi Mick, I would like to try what goes out on the XL models, but can't find the model anywhere IC-Light XL model. Can you tell me if it even exists?

Zs Studio

hello, i can't see any image preview when I choose the path to image sequences and BG video

Jared Saunders

having an issue with this workflow, the GroundingDinoSegment module is throwing the error "Sam' object has no attribute 'image_size', not sure why, any help?

Mickmumpitz

https://github.com/storyicon/comfyui_segment_anything/issues/83 I just found this relatively new thread about this. Maybe you have these conflicting nodes installed?

Terry Astrial

how do i fit the foreground video image (eg. person at 9:16) to be proportionate and centered in the background video image (16:9)?

Ranska_ X

Hi, I got this message IC-Light: Could not patch calculate_weight - IC-Light: The 'calculate_weight' function does not exist in 'lora' what should I do ? [ok update comfyUI fix it] thanks for this workflow :)

Josua Santosa Tjenra

Hi broth i got this message -import failed was node suite -import failed Reactor Node for comfyUI -import failed ComfyUI-Image Filter do you know how to fixed ?

Soul Merge

Hi everyone. Any ideas how to solve: Error occurred when executing MaskBlur+: sigma values should be positive and of the form (min, max). Got [0.0, 0.0]

Soul Merge

Resolved it by replacing MaskBlur+ Node with a fresh one and assigned a new value.

Denis

Hey Mickmumpitz, can you please make the advanced workflow available? 🙂 You wrote the workflow is already uploaded, and the link is coming soon, but it's already been a while. 😉 Thanks / Danke!

Scott Ownbey

Denis I just discovered it had been posted directly above this post whole time.

Denis

Thank you Scott, it was not shown by default, I had to search for it but found it thanks to your advice! :-)