Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why

Published in arXiv, 2026

Recommended citation: Mohammadreza Armandpour, Fatih Ilhan, David Harrison, Ajay Jaiswal, Duc N. M. Hoang, Fartash Faghri, Yizhe Zhang, Minsik Cho, Mehrdad Farajtabar https://arxiv.org/abs/2605.10889