Selfhosted

39980 readers

661 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago

MODERATORS

[email protected]

Uses for local AI? (lemmy.mtate.me.uk)

submitted 3 months ago by [email protected] to c/[email protected]

55 comments fedilink hide all child comments

Im using Ollama on my server with the WebUI. It has no GPU so its not quick to reply but not too slow either.

Im thinking about removing the VM as i just dont use it, are there any good uses or integrations into other apps that might convince me to keep it?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 25 points 3 months ago (3 children)

Think of LLMs like a stupid office worker. You wouldn't rely on them to make critical decisions, but they're valuable for tedious stuff.

For example, my calendar changed the way to enter new events breaking my workflow. Now I just type out a skeletal schedule and have LLM convert that into a .csv that I import.

I'm thinking of Ripping my CD collection again. I'm researching a way to use a LLM to tidy up the metadata.

I had a folder full of random stuff I've saved for years. Had a LLM organize and categorize it for me. I had to tweak the prompt enough that this was a medium difficulty task, but still way easier than doing it manually.

[–] [email protected] 3 points 3 months ago (1 children)

I'm thinking of Ripping my CD collection again. I'm researching a way to use a LLM to tidy up the metadata.

If you ever figure out how to use AI to determine the genre(s) of a song, let me know. Have been looking for something like that for quite a while.

[–] [email protected] 3 points 3 months ago (1 children)

Nextcloud Recognize is supposed to do that, but I haven't tried it. You might try looking down that road.

[–] [email protected] 3 points 3 months ago

Thanks for the tip! I took a look and it seems like Recognize uses this: https://github.com/jordipons/musicnn

Last update was 4 years ago but will give it a try this weekend.

[–] [email protected] 3 points 3 months ago

for the metadata, LLMs may not prove so great. Use MusicBrainz Picard or Beets

[–] [email protected] 2 points 3 months ago

Can you share some info on how you did that folder organization? Did you provide the AI with a list of files?