Post-training guardrails may make AI writing easier to detect
Large language models could theoretically produce writing with a range of styles comparable to human language, but post-training procedures and safety controls can limit that variety. Bradley Emi, chief technology officer of AI text detector Pangram, describes this effect as “mode collapse” in a blog post. According to Emi, models may settle on a smaller set of preferred phrasings after being trained to follow behavioral rules, avoid dangerous outputs, or restrict certain political statements.
Emi says raw base models, which have not undergone post-training, generate more varied text and are therefore not flagged by Pangram’s detector in the same way. He extends the observation to narrowly focused fine-tuned models trained on material such as Hemingway’s writing or selected subreddit posts. Incoherent or otherwise broken outputs may also avoid detection.
The explanation concerns non-watermarked AI text. Emi argues that watermarks would probably remain effective even when a base model produces language with greater stylistic variety.
Written by Sakhanda Wire AI from reporting by The Decoder. Facts, quotes and full context are in the original article below.