StreamDiffusionTD 0.1.11 🚀🎮🖼️ [ Changelog] (Patreon)

Get the TOX here >>> www.patreon.com/posts/104339390

Enables ControlNet via TOP in2

• New 'ControlNet' parameter page

• ControlNet active (Usecontrolnet) must be On when starting stream, but can be toggled when streaming to control if used during generation.

• Weight parameter (Cnweight) will update the strength of controlnet when streaming

• Model dropdown based on folder (hint: comfyui controlnet folder) + option to load from file path directly (last option in dropdown)

• Limitations: ControlNet only works with 1.5 models for now and doesn't support tensorrt

• NO preprocessors are included. You can create edge, depth, normal, canny, or other type of input images inside TouchDesigner network and connect to the second input of StreamDiffusionTD operator.

TensorRT non 512x512 resolution supported

•  supported range is 256 - 1024 per side)

• previous 512 engines should still work

• Limitations: Windows only + tensorrt does not work with SDXL based model

Added Model Preset Config system

• Easy way to save / switch between setups

• Find the options at bottom of Models parameter page.

• Each preset will save Main SD, ControlNet, LCM, VAE, LoRA models, and acceleration mode (tensorrt).

• Saved/synced with your install at "..\StreamDiffusion\streamdiffusionTD\model_presets.json").

Improved Model Loading / Print outs

• Improved logic to load local files

• Easier to read command window that lists the models being loaded much more clearly