Ollama - Local LLMs for everyone!

181 readers

10 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 4 days ago

MODERATORS

[email protected]

Recommended Hardware (feddit.org)

submitted 23 hours ago by [email protected] to c/[email protected]

2 comments fedilink

What hardware is recommended for adequate performance and low power consumption. I've seen the Mac mini recommended a few times. Would the 16 GB model be enough? Or do I need the 24 gig model? What about this framework desktop thingy? It should be very good as well, but what will it consume at idle?

What do you mostly use ollama for? (lemmy.world)

submitted 4 days ago by [email protected] to c/[email protected]

25 comments fedilink

Do you use it to help with schoolwork / work? Maybe to help you code projects, or to help teach you how to do something?

What are your preferred models and why?