this post was submitted on 24 Jun 2024
433 points (98.0% liked)

Asklemmy

43963 readers
1304 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 6 points 5 months ago (1 children)

I bet AI detection is going to get a lot better over time.

I doubt it. ChatGPT 3.5 is good enough to rewrite small snippets of text with better phrasing, ChatGPT 4.0 can write a paragraph if given enough support. Good enough as in "the output is indistinguishable from what a human would have written.

Of course you can do even more with the currently available tools - and get found out.

There is a way to make AI generated text detectable: by slightly pushing the output towards a consistent pattern a detector can reliably judge long pieces of text as AI generated.
Imagine if the AI is biased towards consecutive words starting with consecutive letters of the alphabet (e.g. "a blue car" instead of "a navy vehicle".). Not strongly biased, but enough so that when there are 1000 words you can look at the probability of consecutive words starting with consecutive letters of the alphabet and get a clear result.

There are two problems though: this only works with proprietary systems and only with long texts.

[โ€“] [email protected] 1 points 5 months ago* (last edited 5 months ago) (1 children)

If something was written by V3 and then published, that text doesn't get updated every time a new version of chatGPT comes out.

The text isn't dynamic.

[โ€“] [email protected] 1 points 5 months ago

Yes, but at some point it doesn't matter. The AI is trained to replicate human writing. There will be a point where it becomes so good that the result is a perfect replica, where it is indistinguishable from human text. I.e. even a perfect detector will not be able to confidently declare it as AI written, not ever. Because there is no difference.