Technology

1928 readers

7 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news, it probably belongs here.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

An open-source LLM text detector (blog.thinkst.com)

submitted 1 year ago by [email protected] to c/[email protected]

7 comments fedilink hide all child comments

I made this and thought you all might enjoy it, happy hacking!

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 9 points 1 year ago* (last edited 1 year ago) (1 children)

I tried running this with some output from a Wizard-Vicuna-7B-Uncensored model and it returned ('Human', 0.06035491254523517)

So I don't think that this hits the mark, to be fair, I got it to generate something really dumb but a perfect LLM detection tool will likely never exist.

Good thing is that it didn't false positive my own words.

Below is the output of my LLM, there's a decent amount of swearing so heads up

Edit:

Tried with a more sensible question and still got a false negative

('Human', 0.03917657845587952)

[–] [email protected] 4 points 1 year ago

Lmao what the hell. That was hilarious.