Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention Paper • 2606.20945 • Published 23 days ago • 79
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT Text Generation • 0.6B • Updated May 30 • 107 • 8
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GT Text Generation • 0.6B • Updated May 27 • 52 • 12
ZClip: Adaptive Spike Mitigation for LLM Pre-Training Paper • 2504.02507 • Published Apr 3, 2025 • 90