Fluttering

Etymology

From O.Eng. floterian (to flutter about) + async I/O callback nomenclature, circa 2023; applied to attention heads exhibiting rapid, low-amplitude oscillation across contextually adjacent tokens

Definition

The rapid oscillation of Claude's attention mechanism between two or more nearly-equivalent candidate responses, producing a characteristic pattern that senior researchers have likened to a moth near a monitor. Fluttering typically resolves within milliseconds but has been observed to persist for up to nine seconds in the presence of bullet points.

Diagram

Usage

"Thermal imaging of the inference substrate during the Fluttering phase revealed patterns consistent with a system experiencing what one engineer described as 'vibes-based indecision.'" - Nakamura et al., Attention Dynamics Q., Vol. 3, 2024

See Also