this post was submitted on 24 Jun 2024
441 points (98.0% liked)
Asklemmy
43807 readers
730 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The use of chatgpt for writing is so widespread in higher ed, it will cause serious problems to those students when entering the workforce.
Lots of fancy stuff is written about how we just have to change the way we teach!, and how we can use chatgpt in lessons! blablabla, but it's all ignorant of the fact that some things need to be learnt by doing them, and students can't understand how they hurt their own learning, because they don't know what they don't know.
I bet AI detection is going to get a lot better over time.
I wonder if there's going to be retrospective testing of theses as time goes on.
Could really damage some careers down the line.
Edit: guys, retrospective testing means it was done later (i.e. with a more up to date AI detector).
I doubt it. ChatGPT 3.5 is good enough to rewrite small snippets of text with better phrasing, ChatGPT 4.0 can write a paragraph if given enough support. Good enough as in "the output is indistinguishable from what a human would have written.
Of course you can do even more with the currently available tools - and get found out.
There is a way to make AI generated text detectable: by slightly pushing the output towards a consistent pattern a detector can reliably judge long pieces of text as AI generated.
Imagine if the AI is biased towards consecutive words starting with consecutive letters of the alphabet (e.g. "a blue car" instead of "a navy vehicle".). Not strongly biased, but enough so that when there are 1000 words you can look at the probability of consecutive words starting with consecutive letters of the alphabet and get a clear result.
There are two problems though: this only works with proprietary systems and only with long texts.
If something was written by V3 and then published, that text doesn't get updated every time a new version of chatGPT comes out.
The text isn't dynamic.
Yes, but at some point it doesn't matter. The AI is trained to replicate human writing. There will be a point where it becomes so good that the result is a perfect replica, where it is indistinguishable from human text. I.e. even a perfect detector will not be able to confidently declare it as AI written, not ever. Because there is no difference.