Home
Artists
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register
Partychan Telegram ThePornDude
Home Artists Posts Import Register

Video to Video AI Style Transfer with Stable Diffusion and Keyframing in TouchDesigner - Tutorial (Patreon)

Published:
2023-02-19 01:04:37
Imported:
2023-04

Downloads

Content

Hey! In this tutorial, we'll go over how how to do video to video style transfer with Stable Diffusion using a custom component in TouchDesigner. We'll cover how to keyframe in animations so you can drive your AI style generation with audio reactivity and swap out your model parameters at exact times in your video.  

Link to early SD Tutorials: https://www.youtube.com/watch?v=mRXTR9vcHAs
Link to the Computerender API: https://computerender.com/
Prompt Engineering with Lexica: https://lexica.art/
Opt out of Ai Training: https://haveibeentrained.com/

Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!

Files

Video to Video AI Style Transfer with Stable Diffusion and Keyframing in TouchDesigner - Tutorial

Hey! In this tutorial, we'll go over how how to do video to video style transfer with Stable Diffusion using a custom component in TouchDesigner. We'll cover how to keyframe in animations so you can drive your AI style generation with audio reactivity. Link to the Project File is on my Patreon: https://patreon.com/tblankensmith Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR9vcHAs Link to the Computerender API: https://computerender.com/ Prompt Engineering with Lexica: https://lexica.art/ Opt out of Ai Training: https://haveibeentrained.com/ Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!! 0:00 Overview and Examples 1:56 Recommendations for Vid to Vid 2:43 Using the Existing Network for Rendering 7:38 Recreating the Keyframe Animation 17:13 Overview of Negative Prompts 17:41 Wrap up

Comments

Daniel

would love to see this work with the automatica 1111 api, could be a game changer

James Clarke

Would love to see something like this with stable diffusion running locally. I know it will be a lot slower ( I can do about 1 image per second right now with RTX 3080 and automatic1111) but it would be so powerful in an installation where theres no internet connection. I've been trying to figure out ways to speed it up by using very low res image generation for example, but so far havent been able to make anything too great.