Related articles

capacity-aware routing

Routing algorithm that distributes retained token-expert pairs among eligible instances of their original experts under capacity limits.

• LRMoE Introduces Demand-Side Load Re-Calibration for Efficient MoE Training on Memory-Constrained Nodes