Distilled Reinforcement Learning for LLM Post-training
This paper proposes a new method called Distilled Reinforcement Learning that improves large language model post-training by providing fine-grained guidance to transfer new knowledge from a teacher model to a student model. Practitioners might care because it outperforms standard reinforcement learning and on-policy distillation methods in terms of knowledge transfer and model performance.