Multi-Token Prediction Done Right
Soft-MTP removes a noisy component of standard multi-token prediction, improving model training, speculative decoding, and downstream math and code results without added parameters.
ls ./papers | grep "#Soft-MTP"
Trending AI research papers from Hugging Face, summarized in plain language: what each paper does, why it matters and where to read more.
1 paper · #Soft-MTP
Soft-MTP removes a noisy component of standard multi-token prediction, improving model training, speculative decoding, and downstream math and code results without added parameters.