Because you're thinking it should be even theoretically detectable? Afaict, not. The random token choices are still perfectly random in the paper's algo. The key insight is *normal LLM usage involves a random number stream*. To the extent that's true, these messages can't be suspicious (see what I said to @jimmysong ).
But the argument depends on that being true.
Login to reply
Replies (2)
Well, for example there are already tells when reading text you can intuitively feel whether something is AI driven or human thought text.
My thought is that if there is now hidden text seeded within or influencing the output, then that could also have a tell that a sophisticated actor could learn how to detect.
But it is just based on a feeling honestly. Not facts.
Part of it is the convenient fact that nowadays a lot of "innocent" text is AI generated; the security does not depend on it appearing non-AI like.
The other part is the randomness thing I mentioned.