this post was submitted on 11 Jun 2023
27 points (100.0% liked)
Technology
1928 readers
7 users here now
Rumors, happenings, and innovations in the technology sphere. If it's technological news, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Wow this is eye opening I had no idea the open source stuff was so good.
It's not, this method of analysis is terrible, they're just asking gpt4 to grade the responses, not actually testing anything beyond that.
That doesn't necessarily invalidate the point they're making. Other forms of analysis, strikingly, provide pretty much completely equivalent results.
I know I personally like open assistant more just because you get less blocks