JoyCaption : Amazing Image Captioner - Batch Processing Included - Windows, RunPod, Massed Compute 1-Click Install (Patreon)
Downloads
Content
Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.
Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord
Please also Star, Watch and Fork our Stable Diffusion & Generative AI GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)
I have been requested to make a Gradio APP for this captioner.
It uses a clip siglip-so400m-patch14-384 and Meta-Llama-3.1-8B-Instruct as model and a fine tuned checkpoint for better captioning
Windows Requirements
Python 3.10, FFmpeg, Cuda 11.8, C++ tools and Git
If it doesn't work make sure to below tutorial and install everything exactly as shown in this below tutorial
How to Install and Use on Windows
Extract the attached into a folder like c:/joyv1
Then double click and install with Windows_Install.bat file
It will generate an isolated virtual environment venv folder and install requirements
Then double click and start the Gradio App with Windows_Start_App.bat file
When first time running it will download models into your Hugging Face cache folder
Hugging Face cache folder setup explained below
It will by default save every caption with options as you set
However for single files sadly Gradio can't read the folder accurately
So use batch folder processing
How to Install and Use on Cloud
Follow Massed Compute and RunPod instructions
Usage is same as on Windows
App Screenshots and Examples