I thought of sharing some issues that preoccupy me here, because of how active piefed development is. Btw thank you all for your hard work!
I have noticed that more and more articles are created with LLMs without disclosing it. So, it seems to me that if someone wants to avoid posting this sort of content, one needs to at least:
- check how many articles the author posts per day in the specific site,
- then if the author really exist and
- finally copy-paste part of the text in a couple of ai-detector sites.
Initially, I thought of making a post for a feature request like the one that detects AI generated images, but for text. But I can’t because if I got this right, the ai-detectors may flag an article as ai generated when the author is not a native english speaker [1].
Of course the feature that allows us to label ai-generated content ourselves before posting it is very important. In a way my questions are related to something else: what to do before that. As briefly as I can, here they are:
- does the process mentioned above seem adequate?
- if yes, what else can someone do to check an article before posting, and are there any alternatives/variations to this process?
- if no, what would you suggest?
This won’t be reliable at all, those kind of sites give false positives all the time since you use AI to “detect” AI.
I guess checking for em-dashes and common sentences like “why this works” can sometimes be an indication, but I don’t think there is an easy way to reliably automate a process like that.
Yes, the em-dashes, are very typical. There’s a relevant wiki page (Signs of AI writing) that has a whole section about the overuse of em dashes.
In relation to common sentences tho, I find it to be quite tricky. Still, that’s a good point too. And the language and grammar section of the same article has some tips that can really help even non-native english speakers, like myself.
why this works —–— people are too lazy to proofread LLM slop