LocalLLaMA

2179 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup

pax

noneabove1182

ExUI - a lightweight web UI for ExLlamaV2 by turboderp (github.com)

submitted 9 months ago* (last edited 9 months ago) by noneabove1182 to c/localllama

0 comments fedilink hide all child comments

The creator of ExLlamaV2 (turboderp) has released a lightweight web UI for running exllamav2, it's quite nice! Missing some stuff from text-generation-webui, but makes up for it by being very streamlined and clean

I've made a docker image for it for anyone who may want to try it out, GitHub repo here:

https://github.com/noneabove1182/exui-docker

And for finding models to run with exllamav2 I've been uploading several here:

https://huggingface.co/bartowski

Enjoy!

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here