this post was submitted on 21 Apr 2024
127 points (93.8% liked)

Showerthoughts

28967 readers
534 users here now

A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. The best ones are thoughts that many people can relate to and they find something funny or interesting in regular stuff.

Rules

founded 1 year ago
MODERATORS
 

without you ever knowing about it, as well as (perhaps) swapping in a cheaper-to-operate model some percentage of the time, perhaps as request loads peak, hoping you'll just roll the dice and try again.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 11 points 4 months ago (1 children)

GPU limiting and a general lack of either knowledge or wanting to put in the effort to do it themselves. Even just going into Github in the first place is enough of a barrier for a lot of people, unfortunately

[โ€“] [email protected] 7 points 4 months ago

Yep, I've a mobile 3070 in my laptop, and whilst I feasibly could run some of the smallest models around, paying on a per-use basis gets me way better quality results for relatively cheaply.

Besides, running it locally isn't free either. Your hardware deprecates and depreciates over time, in addition to non-negligible power costs.