Related articles

expert placement

Placement of MoE experts across instances, planned by LRMoE during the forward pass to manage memory and communication.

• LRMoE Introduces Demand-Side Load Re-Calibration for Efficient MoE Training on Memory-Constrained Nodes