Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data
Channel selection in Mixture-of-Experts models traditionally relies on calibration data, but new research shows top-k selection without calibration matches or beats thresholds, improving accuracy and speed.