Home Artists Posts Import Register
Patreon importer is back online! Tell your friends ✅

Content

Dear supporters, the new video is finally here! We'll take a closer look at the topic of AI-generated music videos. I'll show you how to use Stable Diffusion to generate music videos based on Windows Media Player visuals or completely self-created visuals in After Effects.

We are also doing a little side quest on #controllism. This topic fascinated me and I would like to make a more detailed video about it, as my head is bursting with ideas.

Originally intended as a small experiment for in between, the project has grown bigger and bigger and my PC has been rendering non-stop for the last three weeks to create the numerous tests.

I learned a lot about the topic of AI video generation and already have sooo many ideas that I will show you in the next weeks! But the next tutorial will probably be a "classic" Ai Filmmaking tutorial. ;)

I hope you like it! I'll finalize the workflow sheet and the project files this week.

And thanks again to you for making such large projects possible! ❤️

Files

Generate AI MUSIC VIDEOS based on your music!

Today I'll show you how to generate music videos with Stable Diffusion based on Windows Media Player or completely custom visuals made in After Effects. If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz And follow me on Twitter: https://twitter.com/mickmumpitz Tools used in this video: - Windows Media Player LegacyOBS Studio https://obsproject.com/Stable Diffusion WebUI https://github.com/AUTOMATIC1111/stable-diffusion-webui - Control net https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/7784 - Splitter AI https://vocalremover.org/splitter-ai - Adobe After Effects My settings file: COMING SOON! Rotation Expression: COMING SOON! LINKS: - Spiral Animation Tutorial: https://www.youtube.com/watch?v=5Es5MRSe_V0- - How to Install Stable Diffusion - automatic1111: https://www.youtube.com/watch?v=kqXpAKVQDNU&list=PLXS4AwfYDUi5sbsxZmDQWxOQTml9Uqyd2- - Stable Diffusion for Beginners: https://www.youtube.com/watch?v=nJlHJZo66UA CHAPTERS: 00:00 Intro 01:28 The Process 02:22 Finding the right song 03:42 Setting up Deforum 06:16 Prompting08:44 Control Net 09:26 Optical Flow 10:16 Visualization After Effects 11:49 controllism 14:30 Final Results

Comments

Kevin Alexander

This was awesome. Talk about limitless Fun!!!

Emily Nilsen

Looking forward to seeing the full workflow sheet and the project files for this project. After watching your video, I started using Stable Diffusion for the first time, and now I'd love to know how to make an AI music video like yours.

Mickmumpitz

Oh, thanks for reminding me to update this! I'll send you the files as soon as I can.

Emily Nilsen

Thank you so much! And now I'm going to attempt to set up ComfyUI using your workflow.

Samuel Barbot

Yes super cool effect and good idea to work and deforum used.