Home
Artists
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register
Partychan Telegram ThePornDude
Home Artists Posts Import Register

[v3.0] QR Code Experiments - Abstract Animation [Breakdown] (Patreon)

Published:
2024-01-24 18:11:44
Edited:
2024-05-03 15:35:47
Imported:
2024-05

Downloads

Content


A New Folder "Experiments" Has been added to the google drive where I will be putting all experiments files with Render Videos.
To give more clarity, Raw, refined and Face Fix steps files are organized to give you a flow of the process.
The v3 workflows used which are tweaked a little according to my needs.
Link : https://drive.google.com/drive/folders/1HoZxKUX7WAg7ObqP00R4oIv48sXCEryQ
__________________________________________________________________________

I have done 2 Experiments with ORcode monster Controlnet, and came with the following Observations : 

Normal vs QRcode 

- Images produced with QRcode are brighter, more appealing.
- Loras blend better with the Subject, See feet and chest area, Loras have affected those areas more than without QRcode

QR Code Theory 

QR Code focuses on White Areas as Fore Ground and Black Areas as Background. So Using this theory and putting the Auto mask generated from here as the input images for the Qrcode Controlnet gave the above results.
QRCodeMonster Controlnet Model Link : https://civitai.com/models/111006/qr-code-monster

BREAKDOWN [Without LCM] : 

1) Without LCM Render - https://youtube.com/shorts/kC0WeYx9vXA
2) With LCM Render - https://youtube.com/shorts/zsgmvIKXh6w 


The Above Render is achieved without using the LCM. It is observed not using LCM here has produced more better Effects with Loras and Prompts. 

- Epic Realism was used for Raw Animation, then Animerge model was used for 2x Refiner passes to get minute Details in the image.

- Then 2.1 Face Fix file

All Workflows can be downloaded from the Experiments folder.

Models, Prompts and Loras 

*Important - Negative Prompts were kept to minimum and not using  embeddings, they pushed the generations from being abstract...

Below are the models and Loras used for the LCM and No LCM workflows

Models List: 

Lora List: 

(PS: I renamed some of them due to other languages) 

QRCODE CONTROLNET

AutoMask images are used for QrCode controlnet model with 1.5 weight. 

also same AutoMask images are used as Masks:


Background: 

Green Screen images of Fire has been used as background images to get a upward flowing water motion in the Segment 1 of the Without LCM Render ...
As an experiment to control water like motion ...like waves going upwards I used fire ... It will anyways be converted to line art so it didn't mater whatever we use here.

I'll Try to control background motion in my next Experiment :D


_________________________________________________________________________

Conclusion 

It seems without LCM file performs better in producing minute elements details. So I've added 2 more files in the v3 folder which are without LCM.


1) Main Drive Link : https://drive.google.com/drive/folders/1HoZxKUX7WAg7ObqP00R4oIv48sXCEryQ

2) Experiments Folder : https://drive.google.com/drive/folders/1TP7NdslT1-TfxbkeeDP72xE-fJyKjePH 

_________________________

My Discord Server : https://discord.gg/z9rgJyfPWJ

Comments

Amit Khadse

how can i create the BG sequence for this workflow

Jerry Davos
>>129234806

Download a video you want as sequence, import it in after effects, crop it if you want, then export as images sequence in a folder and then copy this folder path in he BG Sequence node

Amit Khadse

thnx for relay, i didnt expected you will replay this fast, you mean to say BG video extract in sequence ?? eg take fire video and extract as a frames and put in path ??