Wired falls for bogus claims of AI writing detector startups
Wired is pushing the false idea that AI writing detectors actually work.
Latest overblown AI claim: GPT-4 achieves a perfect score on questions representing the entire MIT Math, EE, and CS curriculum
The paper, released on arXiv two days ago, is getting a lot of attention. Some issues with it were immediately apparent. Then three MIT students dug up the study’s test set, and discovered things were much worse than they initially appeared.
Hype alert: new AI writing detector claims 99% accuracy
Multiple media outlets are reporting on a recent study published by University of Kansas researchers. Per these reports, the KU researchers have achieved near-perfect accuracy at detecting AI use in “scientific writing” or “academic writing.” But let’s take a look at what this study actually did.