this post was submitted on 01 Dec 2024
46 points (88.3% liked)

Futurology

1886 readers
54 users here now

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
46
Multiple LLMs voting together on content validation catch each other’s mistakes to achieve 95.6% accuracy. (arxiv.org)
submitted 1 month ago by [email protected] to c/[email protected]
27 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 1 month ago (1 children)

Wouldn't running on a CPU (while possible) make it less energy efficient, though?

[–] [email protected] 3 points 1 month ago

It depends. A lot of LLMs are memory-constrained. If you’re constantly thrashing the GPU memory it can be both slower and less efficient.