HuskyDoge
  • About
  • Research
  • Blogs
  • Misc
Xiaohongshu

Exact Input Writes Improve Stable Looped Language Models

Posted: Apr 29th 2026
TL;DR

Parcae stabilizes loop models with an exact exponential decay for its recurrent state, while its input branch uses an Euler gain. Replacing that gain with exact zero-order hold (ZOH) improves validation loss in matched 140M controls and a 370M follow-up; downstream readout remains mixed.

Exact Input Writes Improve Stable Looped Language Models