Exact Input Writes Improve Stable Looped Language Models
Posted: Apr 29th 2026
Parcae stabilizes loop models with an exact exponential decay for its recurrent state, while its input branch uses an Euler gain. Replacing that gain with exact zero-order hold (ZOH) improves validation loss in matched 140M controls and a 370M follow-up; downstream readout remains mixed.