Paper Reading | Reasoning with Power Sampling
This reading note focuses on sampling methods. I read three recent papers as a progression: Reasoning with Sampling uses direct Metropolis-Hastings on a sequence-level power distribution, Scalable Power Sampling introduces a rollout-based tokenwise approximation, and Power-SMC reframes the same target through sequential importance resampling with particles. The goal is to make the incremental improvements explicit.