blunttastic

joined 1 year ago
sorted by: new top controversial old
9
LocalGPT Web crawler? (lemmy.fmhy.ml)
 

I've tried a few localGPT frameworks like LocalAI, Text-UI, and AutoGPT and none of them seem to have a decent web-crawler, as far as i could tell. Does anyone have a good recommendation for a localGPT setup that does that? Thanks!

7
Difference between GGML & GPTQ (lemmy.fmhy.ml)
 

Apologies for the basic question, but what's the difference between GGML and GPTQ? Do these just refer to different compression methods? Which would you choose if you're using a 3090ti GPU?

Update to my text-generation-webui docker image - now with ExLlama support! in c/localllama
[–] [email protected] 1 points 1 year ago

Thank you so much! I’d be happy to test it out.

Update to my text-generation-webui docker image - now with ExLlama support! in c/localllama
[–] [email protected] 1 points 1 year ago (1 children)

Hi there. I'd love to try your docker images. I just tried your latest image on my M2 MacbookPro but I don't know what to do next. I created a folder and typed the following in the terminal: docker pull noneabove1182/text-gen-ui-gpu:latest

But I don't know what to do next to launch it. Sorry for the basic question, but how do I run it? Thanks!