JoyCaption : Amazing Image Captioner - Batch Processing Included - Windows, RunPod, Massed Compute 1-Click Install (Patreon)

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

I have been requested to make a Gradio APP for this captioner.

It uses a clip siglip-so400m-patch14-384 and Meta-Llama-3.1-8B-Instruct as model and a fine tuned checkpoint for better captioning

Windows Requirements

• Python 3.10, FFmpeg, Cuda 11.8, C++ tools and Git

• If it doesn't work make sure to below tutorial and install everything exactly as shown in this below tutorial

• https://youtu.be/-NjNy7afOQ0

How to Install and Use on Windows

• Extract the attached into a folder like c:/joyv1

• Then double click and install with Windows_Install.bat file

• It will generate an isolated virtual environment venv folder and install requirements

• Then double click and start the Gradio App with Windows_Start_App.bat file

• When first time running it will download models into your Hugging Face cache folder

• Hugging Face cache folder setup explained below

• https://www.patreon.com/posts/108419878

• It will by default save every caption with options as you set

• However for single files sadly Gradio can't read the folder accurately

• So use batch folder processing

How to Install and Use on Cloud

• Follow Massed Compute and RunPod instructions

• Usage is same as on Windows

App Screenshots and Examples