Submitted by YoutubeStruggle t3_10ofcis in MachineLearning
royalemate357 t1_j6eq454 wrote
I tried it with chatgpt, and it correctly identified the text as ai generated when i used the output exactly. but then when i changed the capitalization of the first letter in the sentence and removed a few commas, it changed to human generated (84%). it seems to me its kind of a superficial detector, and is quite easy to fool. also, what is the false positive rate? if this tool or others are used to flag students for plagiarism, it had better be pretty close to zero.
JaCraig t1_j6fws2x wrote
Just adding on that I used ChatGPT and adding any sort of "write it in the style of X" to the end fools it. Tell it to do some run on sentences, etc. same thing.
YoutubeStruggle OP t1_j6ezvnk wrote
I see, will look into it more and come back with a solution
Viewing a single comment thread. View all comments