how AI detectors work is something I get asked about constantly by students and I realise I don’t have a great answer. I can explain that they look for patterns but I can’t explain what patterns specifically or why the same text scores differently on different tools. anyone who knows the actual mechanics want to help me explain this better?
the practical implication of the perplexity approach is that it’s measuring ‘how surprising is this text to a model’ rather than ‘was this written by a human.’ those aren’t the same thing. highly formulaic human writing, literature reviews, legal documents, technical summaries, scores low perplexity too. that’s where most false positives come from. the tools are doing what they were designed to do, the design just doesn’t map cleanly onto what people want to know.