this post was submitted on 14 Sep 2024
603 points (97.8% liked)

Technology

59598 readers
3477 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
603
OpenAI is reportedly going all-in as a for-profit company (mashable.com)
submitted 2 months ago* (last edited 2 months ago) by RmDebArc_5 to c/[email protected]
121 comments fedilink hide all child comments
 

Surprised pikachu face

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 10 points 2 months ago (1 children)

I like Ollama, and recommend it to tinker, but I admit this "LLM Explorer" is quite neat thanks to sections like "LLMs Fit 16GB VRAM"

Ollama just works but it doesn't help to pick which model best fits your needs.

[–] [email protected] 2 points 2 months ago (2 children)

pick which model best fits your needs.

What is the need I have to put the effort in to install all this locally. Websites win in terms of convenience.

[–] [email protected] 2 points 2 months ago (1 children)

I don't think I understand your point, are you saying there is no benefit in running locally and that Websites or APIs are more convenient?

[–] [email protected] 1 points 2 months ago

I already have stable diffusion on a local machine. I was trying to find motivation to install a LLM locally. You answered my question in a different response

use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

[–] [email protected] 2 points 2 months ago (1 children)

I want to work on my stuff in peace and in private without worrying about a company grabbing my stuff and using it for themselves and to give/sell it to other outfits, including the government. "If you have nothing to hide..." is bullshit and needs to die.

[–] [email protected] 1 points 2 months ago

Good point. Everything you feed into chatgpt is stored for future reference.