Be the first to try the new Sugoi Japanese Translator server (Patreon)

Hello fellow translator,

Here is the prototype of the new Sugoi Japanese Translator server.

I have tested the new Sugoi Translator Server extensively. And the results are very satisfying.

CPU processing can be boosted up to 4 times compared to the previous version.

GPU processing can be boosted up to ... I don't know... perhaps tenfold compared to the previous version? It was crazy fast!!

Red reported that he can achieve these numbers by using CUDA:

[RedTranslatorEngine] Batch took: 0.8 seconds, which was about 4212.5 characters per second!

[RedTranslatorEngine] Batch took: 1 seconds, which was about 10796 characters per second!

[RedTranslatorEngine] Batch took: 1.2 seconds, which was about 8754.2 characters per second!

[RedTranslatorEngine] Batch took: 1 seconds, which was about 10396 characters per second!

[RedTranslatorEngine] Batch took: 1.4 seconds, which was about 7773.6 characters per second!

[RedTranslatorEngine] Batch took: 1 seconds, which was about 10605 characters per second!

[RedTranslatorEngine] Batch took: 2.3 seconds, which was about 4611.3 characters per second!

Elapsed time : 18025ms

Update 2.22/04/05
We released the updated version of the server. We call it CT2 Sugoi Translator.

The CUDA is already included with the new package. So, additional steps to enable CUDA aren't needed anymore. (You don't have to install NVIDIA Cuda too)

Please install the server from your Server Manager. Here is how to do that :

https://www.youtube.com/watch?v=2ZzKcHuTk1g

How to set up the new Sugoi Japanese Translator Server

1. Download the package from here :
   https://mega.nz/file/2oF32SBI#B3FcbuILHV8W7Cmu0mhBsn31bd1wuBCGqF6H7pb3yhw  
2. Extract the package on your computer.
   Password for the package is: &ka,#aDD45.]asdf&*8mm3
   Please remember that the best practice is not to put Sugoi Translator Server in a folder path that is too deep.
3. Run INSTALL.bat
   Just double click the INSTALL.bat and the script will do the task for you.
   Please wait until the process is completed.
   You will see a single error about the TORCH package. Just ignore it. We don’t need the TORCH package on this new server.
4. Voila! the server is ready to use.

You can start the server by running the startServer-CPU.bat or startServer-CUDA.bat to run the server in GPU mode.

You can also use Translator++’s Sugoi Translator Server Manager to run multiple instances of the server.

PLEASE DON’T SHARE THE LINK TO ANYONE!!!! As it would hinder the development of both Mr. Shiba’s Sugoi Translator and Translator++

This release is highly monitored, because it is still in the development phase.

Setting up CUDA

There are additional steps to run the server in GPU mode. Don’t worry. This time CUDA installation is easier than the previous version.

1. Download NVIDIA CUDA version 11 installer from this page:
   Don't forget to select version 11.
   https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64&target_version=11&target_type=exe_network
   
   Or you can directly download from this  link below:
   https://developer.download.nvidia.com/compute/cuda/11.6.1/network_installers/cuda_11.6.1_windows_network.exe
   
   You also have the option to download the offline installer. But it is humongous (around 2.5 ~ 3 GB)
2. Run the installer 
3. On the Installation options, select “Custom (Advanced)”
4. On the Custom installation options, deselect everything except CUDA>Runtime
   You only need the Runtime to make it work. If you also install the other components, you might be prompted to install additional prerequisites which is troublesome.
5. Click all the Next button and wait until the installation procedure is completed.
6. Now you’re ready to use those startServer-CUDA.bat to run the server in GPU mode! 

Please contact me on Discord if you have any problem regarding the installation.

Dreamsavior