[question] Alt-text service, self hosted (social.graves.cl)

submitted 6 months ago by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

[question] Alt-text service, self hosted

Is there a service that I could plug into my misskey/firefish/whatev that provides an alt-text for an image I'm posting. I don't post images that often, so the few times, it would be nice to have an automatic OCR or LLM/Stable Diffusion description of a picture attached to it.

Of course, without depending on Google or similars.

Any ideas? cc @[email protected] @[email protected]

top 3 comments

sorted by: hot top controversial new old

[-] [email protected] 2 points 6 months ago

I feel that auto-generated descriptions are going to generally be terrible, even with the new GPT AIs. There's too much context needed to do a good job to be able to just feed an image into some code and get something useful.

On the other hand, transcriptions should be able to be done more accurately, particularly with a bit of extra logic to recognise forms like Twitter posts.

Some database of alt-texts might be possible by scraping for alt-texts and transcriptions from the fediverse, reddit, etc, but a quick search didn't come up with anything.

[-] [email protected] 1 points 6 months ago

@[email protected] maybe just OCR would be enough for a lot of cases

[-] [email protected] 2 points 6 months ago

Yeah, that's what I mean by transcriptions; if you're mostly posting screenshots of social media posts then it'd probably work quite well, but if it's photos you're definitely going to need something more complicated.

this post was submitted on 16 Jan 2024

2 points (66.7% liked)

Self Hosted - Self-hosting your services.

10941 readers

1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules

No harassment
crossposts from c/Open Source & c/docker & related may be allowed, depending on context
Video Promoting is allowed if is within the topic.
No spamming.
Stay friendly.
Follow the lemmy.ml instance rules.
Tag your post. (Read under)

Important

Beginning of January 1st 2024 this rule WILL be enforced. Posts that are not tagged will be warned and if not fixed within 24h then removed!

Lemmy doesn't have tags yet, so mark it with [Question], [Help], [Project], [Other], [Promoting] or other you may think is appropriate.

Cross-posting

[email protected] is allowed!
[email protected] is allowed!
[email protected] is allowed!
[email protected] is allowed if topic has to do with selfhosting.
[email protected] is allowed!

If you see a rule-breaker please DM the mods!

founded 3 years ago

MODERATORS

[email protected]