Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention Paper • 2606.20945 • Published 7 days ago • 59
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT Text Generation • 0.6B • Updated 25 days ago • 320 • 8
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GT Text Generation • 0.6B • Updated 28 days ago • 518 • 11
view article Article Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance tiiuae • May 21, 2025 • 39
ZClip: Adaptive Spike Mitigation for LLM Pre-Training Paper • 2504.02507 • Published Apr 3, 2025 • 90