The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models

AI & ML··2 min read·via ArXivOriginal source →

The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models

arXiv:2605.29123v1 Announce Type: new Abstract: Masked diffusion language models (MDMs) uniquely support any-order generation, with confidence-based decoding currently serving as the de facto standard inference policy. To optimize for this, recent training schemes attempt to align training mask patterns directly with those observed during generation. However, we argue that confidence-based decoding is inherently misaligned with the logical-flow trajectories required for complex reasoning, and t

More Stories