SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding
SpecOPD trains speculative decoding drafters on their own sampled histories while parallelizing target supervision, improving acceptance length and training throughput.
ls ./papers | grep "#Acceptance length"
Trending AI research papers from Hugging Face, summarized in plain language: what each paper does, why it matters and where to read more.
1 paper · #Acceptance length
SpecOPD trains speculative decoding drafters on their own sampled histories while parallelizing target supervision, improving acceptance length and training throughput.