Home Artists Posts Import Register

Downloads

Content

Hey! In this tutorial, we'll go over how to use Stable Diffusion with a custom component to generate audio-reactive animations in TouchDesigner.

Project File attached

Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR...

Link to the API: https://computerender.com/

Prompt Engineering with Lexica: https://lexica.art/

Opt out of Ai Training: https://haveibeentrained.com/

Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!!


Files

Audio Reactive Animations with Stable Diffusion and TouchDesigner - Tutorial 3

Hey! In this tutorial, we'll go over how to use Stable Diffusion with a custom component to generate images in TouchDesigner. We'll go over how to make audio-reactive animations using this network. Project File: https://drive.google.com/drive/folders/1mUU5ApNJXAQPCrKVuc-8sUNkizdVH7JP?usp=sharing Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR9vcHAs Link to the API: https://computerender.com/ Link to my Patreon: https://patreon.com/tblankensmith Prompt Engineering with Lexica: https://lexica.art/ Opt out of Ai Training: https://haveibeentrained.com/ Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!! 0:00 Overview and Examples 2:42 Prompt Selection with Lexica 4:46 Setting up the Component 6:53 Creating a Zoom Effect 8:28: Creating a Distortion / Warble Effect 11:09 Breakdown of Displace TOP 16:38 Creating a Perfect Loop 17:50 Overview of Animation Recording Network 20:29 Bringing in the Zoom, Rotation, and Displacement Effects 21:20 Bringing in the Rotation Effect 23:21 Adding New Prompts 24:40 Making a Perfect Loop 27:20 Adding Audio Reactivity

Comments

Jana Spacelight

Hey! Thanks sooo much for bringing me back to touchdesigner! am experimenting with Auto1111 deforum, and now I'm looking for a way to use it in TD. basically your workflow except the API. Thought I could combine yours and that one - or the next version with imgtoimg, but I'm stuck here :) https://www.youtube.com/c/VJSCHOOL?app=desktop Can you lead me in any direction?

David Fong

@Jana I've just started looking into that as well- I know Auto1111 can expose a local API, I just need to figure out how that API call differs from the Computerender setup