this post was submitted on 08 Jun 2023
25 points (100.0% liked)

LocalLLaMA

2871 readers
33 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago
MODERATORS
MonsterBug
[email protected]
SkySyrup
pax
noneabove1182
25
Hello World (self.localllama)
submitted 2 years ago by SkySyrup to c/localllama
17 comments fedilink hide all child comments
 

Hi, you've found this ~~subreddit~~ Community, welcome!

This Community is intended to be a replacement for r/LocalLLaMA, because I think that we need to move beyond centralized Reddit in general (although obviously also the API thing).

I will moderate this Community for now, but if you want to help, you are very welcome, just contact me!

I will mirror or rewrite posts from r/LocalLLama for this Community for now, but maybe we could eventually all move to this Community (or any Community on Lemmy, seriously, I don't care about being mod or "owning" it).

you are viewing a single comment's thread
view the rest of the comments
[–] pax 1 points 2 years ago (1 children)

llama cpp is crashy on my computer, it even didn't compiled.

[–] SkySyrup 1 points 2 years ago (1 children)

Huh, that's interesting. If llama.cpp doesn't work, try https://github.com/oobabooga/text-generation-webui which (tries to) provides a user-friendly(-ier) experience.

[–] pax 1 points 2 years ago (1 children)

it launches just fine, but when loading a model it says something like: successfully loaded none

[–] SkySyrup 1 points 2 years ago (1 children)

Have you put your model in the "models" folder in the "text-generation-webui" folder? If you have, then navigate over to the "Model" section (button for the menu should be at the top of the page) and select your model using the box below the menu.

[–] pax 1 points 2 years ago (1 children)

I tried to download an example one, cus I don't have any model, failed.