[v3.0] BG Changer with IP Adaptor + Masks [ Breakdown Tutorial ] (Patreon)

New!! - 2 More Files, BG changer (Simpler with Mask) and BG change with IP Apdator has been added to the Drive folder :

https://drive.google.com/drive/folders/1HoZxKUX7WAg7ObqP00R4oIv48sXCEryQ

.
Now you can have consistent custom Background throughout the animation.

Prerequisites

1) If you are new to this workflow, Watch these Video and tutorial first to get how things work:

• https://youtu.be/qczh3caLZ8o

• https://www.patreon.com/posts/update-v2-1-lcm-95056616

2) Controlnet - SoftedgePlus and AutoMask from this workflow:  https://www.patreon.com/posts/update-v3-0-lcm-96482739

Background Change + IP Adaptor

You can now change background with one Simple image or use a Sequence of Images (Same number as of controlnet images) to change the background.

It uses line art controlnet for the background and generates a consistent background for every frame of the animation.

_________________________________________________________________

Breakdown - 1 ( #2_4 BG Change with IP) Imp and Mistoon Anime

The Above render was made with AutoMasks and Controlnets generated from Here.

- SoftedgePlus (ControlNet Strength - 0.8, Start - 0, End - 0.95)
- OpenPose (ControlNet Strenth - 0.8, Start - 0, End - 0.8)
- AutoMask (Mask)

These 3 were only used in from the source video.

• IP and Background

Following Images were used for IP

IP settings, Low weights (0.4 - 0.6 )  creates more appealing and better results.

Single image with Strength (0.8) and End percent (0.65) was used.

• Models and Loras

IMP Model was used make the Raw Images : https://civitai.com/models/56680/imp?modelVersionId=61106

With The Following Loras were used:

- CyberpunkAI : https://civitai.com/models/77121?modelVersionId=81907

- V_O: Imperial Guard Combat Uniform Swimsuit | 近衛師団戦闘服 - V2 | Stable Diffusion LoRA | Civitai

• Prompts and Settings

Rest Every other settings was set to default.

• Refining

Mistoon Anime Model - https://civitai.com/models/24149?modelVersionId=108545 
was used to refine and uspcale the raw images to give a "Cartoon look" to the final Images.

This Refiner file was used with the default settings for upscaling and refining.

and then old v2.1 Face Fixer was used to fix the faces.

Render Video : https://youtube.com/shorts/58jCMwSytvg

______________________________________________________________________

Breakdown - 2 ( #2_3 BG Change without IP) - EpicRealism

Same Controlnets and settings from above was used

• Model

EpicRealism Model was used to render this realistic style : https://civitai.com/models/25694/epicrealism

No Loras were used in this.

• Background Settings

Same settings as before just different image,

To demonstrate the workflow has also has a normal version of the workflow without IP.

• Model and Prompts

Same Refiner file was used with the default settings for upscaling and refining.

and then old v2.1 Face Fixer was used to fix the faces.

Render Video 2 : https://youtube.com/shorts/FAT0kqyfDSU

___________________________________________________

The Above Workflow Files are also Uploaded in the "Prompts and Settings" Folder (Drag and Drop in comfy to see them)

Google Drive Download Link:

https://drive.google.com/drive/folders/1HoZxKUX7WAg7ObqP00R4oIv48sXCEryQ

.
.
Now I'll try to focus on making more tutorials on how you can use these workflows creatively, also will share my resources which I find useful along the way.

Byeeeee :D

My Discord Server : https://discord.gg/z9rgJyfPWJ

- Jerry Davos  ❤️