Ollama - Local LLMs for everyone!

187 readers

1 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 5 days ago

MODERATORS

[email protected]

What do you mostly use ollama for? (lemmy.world)

submitted 5 days ago by [email protected] to c/[email protected]

25 comments fedilink hide all child comments

Do you use it to help with schoolwork / work? Maybe to help you code projects, or to help teach you how to do something?

What are your preferred models and why?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 4 days ago

I've been experimenting with it for different use cases:

Standard chat style interface with open-webui. I use it to ask things that people would normally ask ChatGPT. Researching things, vacation plans, etc. I take it all with a grain of salt and also still use search engines
Parts of different software projects I have using ollama-python. For example, I tried using it to auto summarize transaction data
Home Assistant voice assistants for my own voice activated smart home
Trying out code completion using TabbyML

I only have a GeForce 1080 Ti in it, so some projects are a bit slow and I don't have the biggest models, but what really matters is the self-satisfaction I get by not using somebody else's model, or that's what I try to tell myself while I'm waiting for responses.