this post was submitted on 28 Jan 2025
187 points (96.1% liked)

World News

39988 readers
2080 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News [email protected]

Politics [email protected]

World Politics [email protected]


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 day ago* (last edited 1 day ago) (1 children)

Thanks

Any recommendations for communities to learn more?

Frustratingly Their setup guide is terrible. Eventually managed to get it running. Downloaded a model and only after it download did it inform me I didn't have enough RAM to run it. Something it could have known before the slow download process. Then discovered my GPU isn't supported. And running it on a CPU is painfully slow. I'm using an AMD 6700 XT and the minimum listed is 6800 https://github.com/ollama/ollama/blob/main/docs/gpu.md#amd-radeon

[–] [email protected] 3 points 1 day ago* (last edited 1 day ago) (1 children)

If you're setting up from scratch I recommend using open webui, you can install it with GPU support onto docker/podman in a single command then you can quickly add any of the ollama models through its UI.

[–] [email protected] 0 points 1 day ago (1 children)

Thanks, I did get both setup with Docker, my frustration was neither ollama or open-webui included instructions on how to setup both together.

In my opinion setup instructions should guide you to a usable setup. It's a missed opportunity not to include a docker-compose.yml connecting the two. Is anyone really using ollama without a UI?

[–] [email protected] 1 points 1 day ago* (last edited 1 day ago)

The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/