Towards Looped Models Done Right
Loop language models reuse physical Transformer blocks across logical depth, but established architectures entangle recurrence placement, input injection, and recurrent-state organization. This article isolates those axes under matched controls and tests whether the resulting design principles transfer to Mixture-of-Experts models.