Home Artists Posts Import Register

Downloads

Content

Sort of a disclaimer: only nvidia gpu with 8gb+ or hosted env

don't dive headfirst into a nightly build if you're planning to use it for your currect project, which is already past its deadline - you'll have a bad day. This is not a production-ready user-friendly software :D

Make sure you've tried awesome free solutions like Deforum or TemporalKit before subscribing and submitting yourself to the warp.

Hope you like the current development shpeed. You can't stop me now :D

New:

  • add alpha masked diffusion
  • add inverse alpha mask diffusion
  • save settings to exif
  • backup existing settings on resume run
  • load settings from png exif
  • add beep
  • move consistency mask dilation to render settings
  • hide edge width/dilation from generate flow cell

upd 8.6.23 v0.15.1:

  • add pattern replacement (filtering) for prompt
  • fix constant bitrate error during video export causing noise in high-res videos

v0.15.2:

  • fix typo in cell 1.5

v0.15.3:

  • fix full-screen consistency mask error (also bumped missed consistency dilation to 2)

12.06.2023: bumped to nightly.

v0.15.4:

  • fix keep_audio not working for relative video path thanks to louis.jeck#2502

26.6.2023

  • fix consistency error between identical frames

More about that bug here - https://discord.com/channels/973802253204996116/1122765734532087889

5.7.2023

  • fix torchmetrics version thx to tomatoslasher

this one - ImportError: cannot import name '_compare_version' from 'torchmetrics.utilities.imports' (/usr/local/lib/python3.10/dist-packages/torchmetrics/utilities/imports.py)

13.08.2023:
Moved to M tier


Alpha masked diffusion

Same as masked diffusion, which was using consistency mask before, but this time it uses alpha mask. masked_diffusion has been renamed to cc_masked_diffusion.

It works this way:

if current diffusion step is before the masked_diffusion values, both masks are used, and their masked areas (black) are being diffused, unmasked (white) are being fixed.

if current diffusion step is between the masked_diffusion values, the rightmost mask (the one with the higher masked_diffusion value) is used.

if current diffusion step is above the masked_diffusion values, the whole frame is diffused.

Beep

Check Beep to beep. Useful to signal when the render is over.

Save & load settings update

Settings are now saved to frame exif data. You can load them from the frame by specifying a path to it instead of a txt file.

If you are changing your settings during resume run, it will backup existing settings.txt, which were lost before.

Pattern replacement (prompt filter)

You can now automatically replace certain word or phrases.

For example, you can have a lot of animated scene descriptions across numerous frames but want to test different styles. You can set a keyword {style} smewhere in your prompt and replace it with the whole new style without touching your prompts at all to iterate quickly.

It works like this:
go to GUI - Replace patterns and use the following notation:
{0: {"keyword or phrase": "replacement"}}

it can also be scheduled:
{0: {"keyword or phrase": "replacement"}, 10:{"another keyword or phrase": "another replacement"}}

This will replace "keyword or phrase" with "replacement" at frame 0 and "another keyword or phrase" with "another replacement" at frame 10.

You can use multiple filters per frame:

{0: {"keyword or phrase": "replacement", "another keyword or phrase": "another replacement"}


This is applied after captions, so you can use that to filter unnecessary words, for example "cat" if you already have that in your prompt, or want to replace "cat" with "dog" in your captions.

Comments

Tyler Bernabe

Much excite. Many warp.

gary chan

yes please don't stop lol

Diego Mellado Alarcon

much better VRAM usage for me, but unestable, crash easily

Mike King

Lets go!

Ronny Khalil

can't stop, won't stop! (don't)

Prompt Muse

sheeeesh nice work, stopping is for the dead

vijay sri

sir now i am using Stable WarpFusion v0.15 . I am not technically strong.i am beginner.how to fix ModuleNotFoundError: No module named 'guided_diffusion',thanks

vijay sri

all the error happen at install import dependancies segment

vijay sri

---> 28 from guided_diffusion.script_util import create_model_and_diffusion, model_and_diffusion_defaults error here

Leandro Dreger

hello friends, I'm still a beginner, how do I use another prompt? in this stable_warpfusion_v0_15_4.ipynb only comes with cyberpunk 2077. can someone help me choose another theme? excuse the ignorance.

Leandro Dreger

I saw the prompt in the gui itself, can you point me to a site where I can get the prompt ready? I tried to change it in the gui, but the image came out bad.

tommaso_

ciao! 'm running into several error installing on local. (total noob here) - tryed several fesh installation on win 11. now I'm stuck in "Video Input Settings:" get this:NameError Traceback (most recent call last) Cell In[8], line 84 81 recNoiseCacheFolder = f'{root_dir}/recNoiseCache' 83 if not is_colab: ---> 84 videoFramesFolder = f'{batchFolder}/videoFrames/{postfix}' 85 flowVideoFramesFolder = f'{batchFolder}/flowVideoFrames/{flow_postfix}' if flow_video_init_path else videoFramesFolder 86 condVideoFramesFolder = f'{batchFolder}/condVideoFrames' NameError: name 'batchFolder' is not defined

sxela

Hi, you need to run all cells

sxela

Can you please post that as a screenshot on discord (or dm me there) I will delete that message here as it takes 5 screens to scroll 😅

sxela

Can you please post that as a screenshot on discord (or dm me there) I will delete that message here as it takes 5 screens to scroll 😅

Rastislav Píš

Hello, i run to error : OpenposeDetector.__Call__() got an unexpected keyword argument ’hand_and_Face’ ... how can i fix this ?

Kerry Panchoo

@slexa bwaahaha-- time to setup some free chatbot that comes back with that reply to all these questions :)

Shivam Warthi

Giving this error in :567 │ │ in do_run:1059 NameError: name 'reference_source' is not defined What could be the problem?

Mikita Madridiani

you forgot to run this setting "Reference controlnet (attention injection)" it goes after GUI

sxela

hi, if you are already using the latest version available to your tier, then try running all cells, you've seem to miss the reference controlnet cell.

Mahmood Al-haddad

I dont why but my videos dont uplad to google colab they are marked red and dont upload

sxela

Hi, upload them to Google drive and then paste their path into the notebook

Mahmood Al-haddad

hey alex thanks for the reply, i tried that as well, Idk exactly know why it is not reconising it although it is a mp4. is there a limitation of the video duration or what would you recommend as length?

sxela

Have you uploaded it to the drive? You need to copy the full path to it like /content/drive/MyDrive/ and so on. Also you need to wait a bit after upload for it to be available

Аnna Baum

Hello, is it any chance to use it locally with 8Gb Nvidia? getting OutOfMemoryError: CUDA out of memory Please help :(

sxela

Yes, there is a whole thread on discord dedicated to solving oom errors, don't hesitate to jump in!

153 PICTURE PRODUCTION

ImportError: cannot import name '_compare_version' from 'torchmetrics.utilities.imports' (D:\code\WarpFusion\v0_15_5\env\lib\site-packages\torchmetrics\utilities\imports.py)

zhouhang liao

same error, I tried to update the latest torchmetrics and pytorch_lightning, but it didn't work.

zhouhang liao

ImportError: cannot import name '_TunerExitException' from 'pytorch_lightning.utilities.exceptions' (/usr/local/lib/python3.10/dist-packages/pytorch_lightning/utilities/exceptions.py) help!!

Jesse C

I'm getting the same errors, has this been fixed yet? Have you tried # out the line of code?

Jesse C

Ever since today this has been happening to me as well : ImportError: cannot import name '_compare_version' from 'torchmetrics.utilities.imports' (/usr/local/lib/python3.10/dist-packages/torchmetrics/utilities/imports.py) either there was an update on Python libraries or there was something changed in the code, missing an import or missing a !pip install xxx Im not a coder, but if someone is I would definitely appreciate it! P.S. There were other errors on running the new masked version V0.16 as well. Google Colab charges you even if you don't execute the program and get the picture files...sooooo

Ali Kadhim

Add to the end of section 1.3: pip install torchmetrics==0.11.4 There seems to be a recent bug: https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/11648

Jatinder singh

15.4 file link,15.6 out of mmry problem,reclnty deleted evrything

Jatinder singh

❤️❤️❤️❤️thanks sir for 15.4 version

Almila Duru Kavak

hi, can you share settings txt file for gui? I need to set more settings for prompt.

sxela

Hi, you can open any video on my YouTube and check its settings in the description

su jackson

Hi, I encounter some issue and I tried install, !python -m pip -q install guided_diffusion ERROR: Could not find a version that satisfies the requirement guided_diffusion (from versions: none) ERROR: No matching distribution found for guided_diffusion

Felipe Mandiola

I have encountered an issue. When trying to run the file following a tutorial a "ModuleNotFoundError: No module named 'timm'" keeps popping up.

Arthur Valter

Hi, I followed all the steps carefully but the render stops at 1.4 / -> 12 import timm, I can’t find any solution to my problem, I've tried again but I have the same problem, can someone help me about it ?

sxela

Hi, please check this post - https://www.patreon.com/posts/if-youre-getting-86836721

Thinh Nguyen

KeyboardInterrupt Traceback (most recent call last) in () 19 output.eval_js('new Audio("https://upload.wikimedia.org/wikipedia/commons/0/05/Beep-09.ogg").play()') 20 ---> 21 raise KeyboardInterrupt KeyboardInterrupt:

Abhishek Bera

I am using windows but have 4 gigs of CUDA, i have a pickle file for my model, is there anyway to get rid of memory error even if it is slower to render?

sxela

4gb is below the recommended 8gb amount, you can try 512x512 with v1

Matt Jenkins

Any ideas what to do about this Runtimerror I'm getting? RuntimeError Traceback (most recent call last) in () 492 smallpath = None 493 config = OmegaConf.load(f"{root_dir}/ControlNet/models/cldm_v15.yaml") --> 494 sd_model = load_model_from_config(config=config, 495 ckpt=model_path, vae_ckpt=vae_ckpt, #controlnet=smallpath, 496 verbose=True) 1 frames /usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py in load_state_dict(self, state_dict, strict) 2039 2040 if len(error_msgs) > 0: -> 2041 raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( 2042 self.__class__.__name__, "\n\t".join(error_msgs))) 2043 return _IncompatibleKeys(missing_keys, unexpected_keys) RuntimeError: Error(s) in loading state_dict for ControlLDM: size mismatch for model.diffusion_model.input_blocks.1.1.proj_in.weight: copying a param with shape

sxela

Hi, make sure model_version/model checkpoint are compatible i.e. you use v1 file for v1 version and so on

Kyle Towb

Fellow derp here, thank you for all this incredible work! Could you please help me resolve this error, see below, I need more practice derping but am committed to the process. Thank you! OutOfMemoryError: CUDA out of memory. Tried to allocate 1.88 GiB. GPU 0 has a total capacty of 14.75 GiB of which 1.81 GiB is free. Process 2373 has 12.93 GiB memory in use. Of the allocated memory 6.15 GiB is allocated by PyTorch, and 6.65 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Oleg Pylypenko

Hi, awesome stuff. I tried to render a video on Colab with A100 acceleration option. It took about two hours to generate 10 seconds. Is there any setup that could render 1-minute video within 15 minutes or so? Is it possible at all?

sxela

30 sec per frame is a lot, you can get at least 15 sec per frame, but no, rendering 60sec*30fps=1800 frames in 900 sec is not possible right now. You can look at streamdiffusion, they have about 30fps or higher, maybe that will work for you

Oleg Pylypenko

thanks , Alex. will try them out.