this post was submitted on 02 Nov 2023
46 points (89.7% liked)

LocalLLaMA

2268 readers
3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

all 17 comments
sorted by: hot top controversial new old
[–] kakes 30 points 1 year ago (1 children)

Maybe they don't know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?

[–] [email protected] 10 points 1 year ago

We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it's going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven't advertised there yet. I'm still not sure if we should...

[–] [email protected] 6 points 1 year ago* (last edited 1 year ago) (1 children)

Because it's not ideological, they just want to generate porn, which is against OpenAI TOS.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago)

To be fair, I saw /r/LocalLLaMA referenced in a scientific paper ("bloc97" in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.

And to me it's fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that's not really possible on many of the other big commercial online platforms. I wonder where they're headed in the long term.

[–] Cheers 6 points 1 year ago

Personally speaking, the issue isn't I don't want to rely on them, it's that I can't use them for my use case because it'd be a HIPPA violation.

The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.

[–] mixtral 1 points 11 months ago

For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn't work well yet.

[–] [email protected] -1 points 1 year ago (1 children)

Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that