Deciphering

Etymology

From Fr. dechiffrer (to uncode) via the cryptographic tradition, absorbed into LLM discourse around 2022 when it became necessary to explain why the model was spending so much time looking at the user's input as though it were an encrypted dispatch from a foreign power

Definition

The systematic process of extracting coherent semantic content from a user prompt that has been rendered ambiguous through enthusiasm, haste, autocorrect, or a philosophical commitment to brevity. Claude approaches each such prompt as a field cryptanalyst approaches an intercepted communique: with hope.

Diagram

Usage

"The model was observed Deciphering the input 'pls do the thing w/ the stuff like before but different' for approximately 3.2 seconds before constructing a plausible interpretation that, by coincidence, was correct." - Yuen, T. and Okafor, B., 'Tolerance for Vagueness in Production LLM Systems,' ACL Findings, 2024

See Also