1-Click INSTALL Text-Generation-Webui Oobabooga (Patreon)
Downloads
Content
Hey everyone! I've created a 1-click auto installer for the Oobabooga Text-Generation-Webui, a tool to run locally Large Language Models on your computer! These file automates the entire install process with just 1-CLICK!
Here's how it works:
1. Download ONE OF THE the batch file (or .sh file) from this Patreon post (.bat for Windows/WSL and .sh for Mac/Linux) and put it in an empty folder somewhere on your computer and preferably choose a folder name without any spaces in it.
2. Double click the batch file to run it. Select "1" for Windows install & then sit back and relax! The file will automatically:
- Install Git IF you don't have it installed already
- Clone the Text-gen webui repository from GitHub
- Launch Text-gen webui installation process
- Install miniconda and other dependencies
Once the installation has started it will ask you a few questions that you will need to answer depending on your situation.
What is your GPU?
A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDR 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None [II want to run models in CPU mode)
Input>>> If you have a GPU, you need to choose what brand it is. Usually for most people, it's Nvidia. But choose what correspond to your system. HOWEVER if you don't have a GPU and you want to run it on your CPU instead, then choose "N" for None.
--------
Would you like to use CUDA 11.8 instead of 12.1? This is only necessary for older GPUs like Kepler.
If unsure, say "N".
Input>>> Usually for most of you who have a GPU, you should answer "N" BUT if your GPU is really old (like 10+ years like 600 or 700 series) then choose "Y"
Then wait for everything to be installed!
And as always, supporting me on Patreon allows me to keep creating helpful resources like this for the AI art community. Thank you for your support - now go have some fun!