Home Artists Posts Import Register

Downloads

Content

You can embed these and create a db. 

I have included code files for web crawling and token counting and other tools.

I included documentation for the crawler script

I also included a csv file with all file names and their token counts along with a txt table.

explanation video: https://youtu.be/fGmOiJD65dw

Please check ahead of time if the website allows for crawling and scraping. You can check the robots.txt file in the url for that or their terms and conditions.

Let me know what you think

Code files for AUTO AGI: https://www.patreon.com/posts/code-files-for-87530987

Files

Entire Langchain documentation scraped into txt files url by url

Entire documentation and code files: https://www.patreon.com/posts/87755536 sample files are available at discord: https://discord.com/channels/1066570466602532907/1066570467185528974/1141141377451819068 Code files for AUTO AGI: https://www.patreon.com/posts/code-review-for-87606896 Search and find code download links to all my videos: https://www.echohive.live/

Comments

No comments found for this post.