Stable WarpFusion v0.17 - Multi mask tracking - Nightly - Download (Patreon)

Sort of a disclaimer: only nvidia gpu with 8gb+ or hosted env

don't dive headfirst into a nightly build if you're planning to use it for your currect project, which is already past its deadline - you'll have a bad day. This is not a production-ready user-friendly software :D

Make sure you've tried awesome free solutions like Deforum or TemporalKit before subscribing and submitting yourself to the warp.

Changelog:

• add SAMTrack from https://github.com/z-x-yang/Segment-and-Track-Anything
• fix bug with 2+ masks
• print error when reloading gui fails
• renamed default_settings_path to settings_path and load_default_settings to load_settings_from_file

Upd 10.07.2023:

• fix default_settings_path error by #sozeditit

Upd 15.07.2023:
Added first community contributions by sozeditit and kytr.ai as a separate community file (for compatibility reasons)

Changelog by sozeditit and kytr.ai:

• Added execution checks and user-friendly error messages when Notebook sections are run out of order or without a Run All
• Added noncolab_root_path variable in Prepare Folders to allow changing the root path used by Warp Fusion
• Added package gpustat
• Added GPU Statistic sections in Notebook to allow monitoring of VRAM as the Notebook executes
• Added GPU Statistics to Diffusion section to monitor VRAM usage and temperature as a Warp renders
• Added automatic saving of time coded backup settings files to settingsBackup on GUI execution to prevent GUI changes lost when loading new settings file
• Added -2 as an option in GUI settings_path to load the newest backup settings file for the batch
• Added Kytra's Super Special ControlNet Annotator Preview Module
• Added check to validate Lora and Embeddings paths are directories and not files

Upd 16.07.2023:

0.17.2-community-f:

• fix to load last settings by sozeditit

0.17.3:

• add lycoris
• add lycoris/lora selector

0.17.4 17.07.2023:

• fix SAMTrack ckpt folder error ty to laplaceswzz
• fix SAMTrack video export error

20.07.2023:

• Seems to work ok, moved to nightly (L)

27.07.2023:

• fix pillow error

27.08.2023:

• move to M tier

Segment and track anything

Made a CLI wrapper around https://github.com/z-x-yang/Segment-and-Track-Anything to export separate alpha masks for each object.

Only tested to run in colab/docker, may require extra steps to build and install Segment-and-Track-Anything on windows.

Scroll down to Extras - Masking and tracking. Run the install cell. Wait for it to finish, then restart the notebook and run the next cell - Detection setup.
This cell is used to tweak detection on a single frame.
After you're satisfied with detection results run the next cell to track the whole video. Outputs will be saved to root dir / videoFrames / <videohash>_masks /

You can restart runtime after that and use masks as usual.

LyCORIS

Can be used the same way as LORAs, using the <lora:loraname:lowareight> syntax.

You can put them in the same folder. Can't be mixed together with loras, so you'll need to switch to either lora os lycoris and only use one type of them in your prompts.

Local install guide:
https://github.com/Sxela/WarpFusion/blob/main/README.md

Tutorials:
https://youtu.be/HkM-7wxtkGA
https://www.youtube.com/watch?v=FxRTEILPCQQ
https://www.youtube.com/watch?v=wqXy_r_9qw8
https://www.youtube.com/watch?v=VMF7L0czyIg
https://www.youtube.com/watch?v=m8xaPnaooyg

Youtube playlist with settings:
https://www.youtube.com/watch?v=wvvcWm4Snmc&list=PL2cEnissQhlCUgjnGrdvYMwUaDkGemLGq

For tech support and other questions please join our discord server:
https://discord.gg/YrpJRgVcax

Discord is the preferred method, because it is nearly impossible to provide any decent help or tech support via Patreon due its limited text formatting and inability to add screenshots or videos to comments or DMs.
Error reports in comments will be deleted and reposted in discord.