Home Artists Posts Import Register

Downloads

Content

Patreon exclusive posts index

Join discord and tell me your discord username to get a special rank : SECourses Discord

15 February 2024 Update :

  • Install script updated according to latest libraries
  • When installing please wait fully otherwise you will get errors
  • When installing it will download a lot of models so if you don't want models to be download edit install2 .py file before starting install and delete the models you don't want
  • The models it will download are : Realistic_Vision_V5.1, Flat_2D_Animerge, ReV_Animated_122 & Stable_Diffusion_1.5
  • Please download latest installer all_files_V2.zip file and extract into a folder named such as c:/rerender_v2
  • Do not use spaces or special characters in your folder names or in your video names 
  • To see all process edit video_blend .py file and set OPEN_EBSYNTH_LOG = True
  • Triton library added for Windows 
  • You need to have installed Python 3.10.x - it can be like 3.10.6 or 3.10.9 or 3.10.11 etc
  • Here a full tutorial for how to install FFmpeg and Python properly : https://youtu.be/-NjNy7afOQ0

19 October 2023 Update :

EXAMPLE VIDEO : https://twitter.com/GozukaraFurkan/status/1703797121126662602

Please read carefully and upvote this Reddit thread if possible

The original GitHub repo to read and learn more : https://github.com/williamyang1991/Rerender_A_Video

My installers will make a new VENV and install everything there. So this will not affect your other applications such as Automatic1111 Web UI

You also need to install ffmpeg and set its environment path. Shown in this video (2:56) : https://youtu.be/OI1LEN-SgLM

You need to have installed git

install_large_vram .bat will install Torch 2.0.1, Cuda 11.8, and xFormers 0.0.22

install_low_vram .bat will install Torch 1.13.1, Cuda 11.7 and xFormers 0.0.16 - will be probably slower i am yet to test

After install run .bat

The starting URL will be : http://127.0.0.1:7860

Before installing everything there are several crucial issues

Edit install2 .py and comment out the models that you don't want to download or you can even add new models for download. Auto download included models are Realistic_Vision_V5_1, Stable_Diffusion_1_5, Flat_2D_Animerge (which i used in example video), ReV_Animated_122

If you add new models edit sd_model_cfg .py and add them to the model dictionary list with same format. So easy to edit both of the files they are very clear

Most importantly if you don't compile ebsynth yourself please download and extract ebsynth .zip into the same folder. I compiled it with using Microsoft Visual Studio Community Edition 2022 and CUDA 12 library. Compiling it really hard. For those who wants I can connect your PC and help you if you become my Level 50 patreon subscriber (only 1 time)

Moreover, put all of these files into a folder with specific path. Do not use spaces in folder path. Do not use non english characters in folder path. Example correct folder path is

G:\render_v2

Here how your folder should look like before install

The install will take some time since it will download models which are total 32.2 GB

After all installation has been completed double click run .bat file and it will start the Web UI interface

Usage is intuitive

I made this video with default settings, flat2DAnimerge_v30 model and just a man in a room prompt

Processing is taking a lot of time

You can follow the process from CMD window

The starting URL will : http://127.0.0.1:7860

If you get ffprobe error that means it doesn't see your FFMPEG

So download ffmpeg from here : https://ffmpeg.org/download.html

Extract downloaded ffmpeg into the scripts folder (..\Rerender_A_Video\venv\Scripts) like below

Upload your video and set settings and then click Run 1st Key Frame

This will display first frame

After that click Run All Frames once you are okay with first frame

You will see the results inside Rerender_A_Video\result folder with the name of your input video file name

Make your video filename also specific easy like test_video.mp4 - dont use spaces or non-english characters

The final and most time consuming part will generate images under blend folder

It will generate number of frames equal to the number of frames in your original video

Finally it will not copy the sound of the original video

  • Put output render video and initial original video into the same folder and run below command.
  • Don't forget to change file names. Also you need to have installed (add system path) or downloaded ffmpeg into the same folder
  • ffmpeg -i blend.mp4 -i source_video.mp4 -c:v copy -c:a copy -map 0:v:0 -map 1:a:0 output.mp4

Hopefully I will make a detailed tutorial video for this amazing tool

all_files_V2.zip contains all of the files including ebsynth .zip extracted

Comments

OctonionPrime

hey thank you for this script. Will 8 gb be enough?

Anonymous

Well, I look forward to it with great interest, I find all this related to video rotoscoping by AI very interesting.

Anonymous

Hi I'm having an issue, it generates keyframes fine but when it gets to run propogation, I get the "unrecognised arguments" and "no such directory" errors usage: video_blend.py [-h] [--output OUTPUT] [--fps FPS] [--beg BEG] [--end END] [--itv ITV] [--key KEY] [--n_proc N_PROC] [-ps] [-ne] [-tmp] name video_blend.py: error: unrecognized arguments: of lint 220533882 FB of lint 220533882 FB\blend.mp4 Traceback (most recent call last): File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\components\video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\components\video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\components\base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "C:\Users\TAW\Documents\OtherPrograms\Render_A_Video\Rerender_A_Video\venv\lib\site-packages\gradio\components\base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result\\calling of lint 220533882 FB\\blend.mp4'

Furkan Gözükara

hello please uıninstall your all python and install as shown in this video into your C drive : https://youtu.be/B5U7LJOvH6g - also install Rerender_A_Video into your C or main drive not documents. also do not have any space in your folders or in your video file. let me know after this please

Anonymous

Hi. This is the error show when I click on the run file: Traceback (most recent call last): File "C:\Users\hunte\Downloads\all_files\Rerender_A_Video\webUI.py", line 5, in import cv2 ModuleNotFoundError: No module named 'cv2' Press any key to continue . . .

Haifeng Liao

Traceback (most recent call last): File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\gradio\blocks.py", line 1437, in process_api result = await self.call_function( File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\gradio\blocks.py", line 1109, in call_function prediction = await anyio.to_thread.run_sync( File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync return await get_async_backend().run_sync_in_worker_thread( File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 2144, in run_sync_in_worker_thread return await future File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run result = context.run(func, *args) File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\gradio\utils.py", line 641, in wrapper response = f(*args, **kwargs) File "C:\rerender_v2\all_files_V2\Rerender_A_Video\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "C:\rerender_v2\all_files_V2\Rerender_A_Video\webUI.py", line 264, in process1 cfg = create_cfg(global_video_path, *args) File "C:\rerender_v2\all_files_V2\Rerender_A_Video\webUI.py", line 168, in create_cfg input_name = os.path.split(input_path)[-1].split('.')[0] File "C:\Python31011\lib\ntpath.py", line 211, in split p = os.fspath(p) TypeError: expected str, bytes or os.PathLike object, not NoneType

Haifeng Liao

I would like to know the minimum computer configuration