AI Voice Cloning still in early stages causing difficulty (Patreon)

I've been experimenting with AI Voice cloning over the past two months. One that was recently released was called Eleven Labs which I'm sure those of you who follow AI closely know about it. It produces insanely high quality Voice cloning results BUT there's a MAJOR problem. It does not clone unique voices like for example Lois and Chris. It does a great job with Meg a lot of the times enough for me to use it for Meg but other characters do not clone well. Due to that one problem I've been forced to go back to working on my own solution using Text-to-Speech open source AI that is available and this has proven to be very difficult to get results I want. Stable Diffusion and ChatGPT have had great success due to their development while Voice Cloning AI is still behind in terms of User friendliness and quality of output for custom trained models. I know I will be able to be successful in time once I get a firm understanding of the Synthesizers. I already have decent sized training data for all the main characters but they don't produce great results due to the AI synthesizers not being that advanced. I'm determined to get good results.