VASPO: Self-Distillation with Privileged Value Estimation

Đoạn trích bài viết

On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than the expected return of an unguided student continuation. Recent methods combine this signal with GRPO.