Sakhanda Wire
NVDA $150.96 -2.89% MSFT $508.29 +0.40% GOOGL $282.44 +0.80% META $616.38 -0.40% AMZN $267.74 +3.82%
← Back to the news

Post-training guardrails may make AI writing easier to detect

Large language models could theoretically produce writing with a range of styles comparable to human language, but post-training procedures and safety controls can limit that variety. Bradley Emi, chief technology officer of AI text detector Pangram, describes this effect as “mode collapse” in a blog post. According to Emi, models may settle on a smaller set of preferred phrasings after being trained to follow behavioral rules, avoid dangerous outputs, or restrict certain political statements.

Emi says raw base models, which have not undergone post-training, generate more varied text and are therefore not flagged by Pangram’s detector in the same way. He extends the observation to narrowly focused fine-tuned models trained on material such as Hemingway’s writing or selected subreddit posts. Incoherent or otherwise broken outputs may also avoid detection.

The explanation concerns non-watermarked AI text. Emi argues that watermarks would probably remain effective even when a base model produces language with greater stylistic variety.

Written by Sakhanda Wire AI from reporting by The Decoder. Facts, quotes and full context are in the original article below.

Originally published by The Decoder on

Read the original on The Decoder ↗

The reporting and the image belong to The Decoder and are credited and linked above; the text on this page is Sakhanda Wire's own summary.

← Back to the news

More stories

All the latest news