Related articles

load recalibration metric

Metric used during backpropagation to estimate each token-expert pair's contribution to the expert update before selecting retained pairs.

• LRMoE Introduces Demand-Side Load Re-Calibration for Efficient MoE Training on Memory-Constrained Nodes