LocalLLaMA

2268 readers

3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup

pax

noneabove1182

Text Generation Web-UI has been updated to CUDA 12.1, and with it new docker images are needed (self.localllama)

submitted 1 year ago by noneabove1182 to c/localllama

0 comments fedilink hide all child comments

For anyone who happens to be using my docker images or Dockerfiles for their text-gen-webui, it all started breaking this week when Oobabooga's work was updated to support 12.1

As such, I have updated my docker images and fixed a bunch of issues in the build process. Also been awhile since I posted it here.

You can find all the details here:

https://github.com/noneabove1182/text-generation-webui-docker

It requires driver version 535.113.01

Happy LLMing!

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here