Unveiling Super Experts in Mixture-of-Experts Large Language Models

A presentation about unveiling Super Experts in Mixture-of-Experts Large Language Models.

Open resource Open resource