Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
Policy-shift distillation reuses the difference between a teacher's log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories. However, this endpoint policy shift cannot reveal whether local action preferences evolved consistently during teacher training. The same endpoint shift can result from early and late shifts that reinforce or partially cancel each other. We investigate whether agreement between early and late teacher policy shifts can guide selective transfer. We introduce Waypoint-guided On-Policy Distillation (Waypoint-OPD)…
8.36
| corroboration | +0.00 |
| kaynak | +2.00 |
| eksen | +1.76 |
| sinyal | +1.15 |
| tazelik | +0.07 |
| capraz_kaynak | +0.00 |
| gurultu_cezasi | +0.00 |
| hype | +3.38 |