Home
Artists
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register
Partychan Telegram ThePornDude
Home Artists Posts Import Register

WIP: AI chat in VAM (Patreon)

Published:
2023-02-28 19:08:59
Imported:
2023-03

Content

Experimenting with AI chatbots in VAM by popular request. The UI works as a standalone thing too that works without VAM, as a sort of alternative to TavernAI for people familiar with that. 



Files

WIP: VAM + KoboldAI + ElevenLabs AI voices

Comments

Anonymous

Oh, nice! I thought you were going to give up within a week, you scared me there..! Please don't give up lol, I just upgraded my membership even though I'm just a single plebeian citizen with very few asses and the scant denarii to spare.

Jonathon Barton

Man, you are just a **few** days ahead of me on this... =) I keep getting distracted by having some *shockingly* good conversations with a local install - I sprang for some additional RAM and I can actually get the GPT-NeoX-20B models loaded and running with reasonably short response times. Adding ElevenLabs voices are on my ToDo list this week. :D

SPQRAeternum
>>102965888

thanks, I appreciate that! No promises on not giving up, some of those dudes take the fun out of it and it becomes a sad chore. I can do sad chores at work and get paid better and won't have to deal with weird dudes calling me trash, stealing my work, etc. Adult game modding ain't it

SPQRAeternum
>>102969336

don't worry about it, just do your thing, plenty of AI for everyone for days to come! it's crazy that you got that 20B one running locally, I can't get even the 6 billion ones running. In the video I had pygmalion-6B on colab. I imagine the 20B model is pretty crazy. Can it do basic math? ElevenLabs api is very easy & straight-forward, probably just 2 calls. One to get the list of voices and then the tts call that returns the file

Dakoto

Wow that's impressive, if we can do a local install without using chatgpt or something else online it s big + I did not try to get something working on my computer atm, i did it with stable diffusion, but if you get this out i m going to try :) (And that s precisely exactly what i was wishing for !)

BlackstarGuard

Can't wait until my EDI Look starts talking about world domination after asking if she prefers coffee over tea.

Anonymous
>>102965888

I hear ya, time = money, hobbies don't pay the bills, put gas in the car, or pay the outrageous rent or mortgage... I guess DRM as a last resort before quitting maybe..? Just know that there's lots of "weird" dudes that fully support your endeavor to make our characters come alive and appreciate everything you've done. I'll try and keep paying even if I end up nexum to some patricians for the coinage.

Jonathon Barton
>>102984969

KoboldAI. Easy to set up, but (like VaM itself) the really good stuff is going to make you want to throw $1700 at a GPU with 24GB of VRAM and another $300 at 128GB RAM so you can use the larger, more consistent models...and still have some room left for VaM. 😹 Alternately, you could do what SPQR did, and run Kobold in the cloud (Google Colab) - or vast.ai (where a lot of people with laptops wind up running StableDiffusion), While it's cheaper than fully kitting out a PC, it's neither local nor (for long term regular use) free.

Jonathon Barton
>>102969336

My first mistake was checking how much DRAM my motherboard can handle - then price checking it. When I bought the 32GB I have today, it was "peak pandemic, and $179. 128GB is...just $299. So I did a thing, and now I've got (yikes) 24GB VRAM and an additional 128GB DRAM that Kobold can use... 20B and can still run VaM at the same time. And no, no math. 34 + 43 got me quite a silly answer about figuring it out with pieces of clothing. 😹 "Okay. Well how about this: Let's say that each number represents a different piece of clothing. Then, let's see...if I take off my shirt, then I'll be wearing 34 pieces of clothing. If I add another layer by taking off my vest, I'll be wearing 43 more."

SPQRAeternum
>>102965888

yeah, I have solutions for stuff like that but I don't like them and it's not why I started making and sharing plugins. if the cost is having to deal with constant weird dudes that have nothing to do in their lives but be madly obsessesed with me, I'd rather just not be around here tbh, money or no money

SPQRAeternum
>>102969336

It blows my mind that you can get it to run and have vam too, I thought the 6B ones are a stretch already for local usage. I have to upgrade my pc one of these days hopefully. I totally get why you got distracted! I only recently started playing with pygmalion 6B and i'm still very impressed by that model and how much smarter it is compared to 2.7B. 20B must be pretty crazy

Dakoto
>>102984969

Thanks for all the informations :) Is the KoboldAI got some locks like the others or the NSFW and others topics are doable ?

SPQRAeternum
>>102984969

No nsfw filter. Kobold AI is like an interface that lets you interact with text AI models that you can download. There are multiple models around, some smarter, some NSFW. In the video I was using the Pygmalion-6B model which in adult-content oriented https://www.reddit.com/r/PygmalionAI/

Jonathon Barton
>>102969336

I kept pushing on the math question this morning and....ALMOST... "Jon: Yep. Can you do 34 plus 43? It's an easy calculation. Tryxy: Sure. 344377. Cue Agent 86 voice: "Missed it by....that much!"

Jonathon Barton
>>102984969

FWIW this is probably the most advanced model you can run inside KoboldAI, and it does take an ungodly beast of a machine to get it to run - but this is anexample of what's possible with a 20B NSFW model. https://www.reddit.com/r/AnimaAI/comments/11f7ypj/disappointed_any_ideas_on_helping_me_train_the_ai/jaipcwo/

Anonymous

Super cool for perfect immersion!

Anonymous

Yes, Rebecca, I do have a question for you... Can you show your work on how 2 + 3 is equal to 4... You can use fingers, or pennies, or ex boyfriends... But seriously, this is a very good start of the experiment - it will go well with alive

Dakoto

Is it possible to share this version if you're not interested in working more on it for the moment ?

SPQRAeternum
>>106911344

I still try to do this but differently, directly in vam through Alive. This in the demo is super messy, you have to install a lot of stuff, run exe files, this besides all the headaches AI already brings. I don't want to put it out there if it sucks and have people be mad at me and complain about it. But I know many people are excited about stuff like this so I'll see what I can do