mlx-community/gemma-4-31B-it-qat-mxfp8 Image-Text-to-Text β’ 9B β’ Updated 6 days ago β’ 1.18k β’ 2
view post Post 3881 Google releases Gemma 4 QAT. β¨You can now run Gemma 4 at 3x less memory with near original performance.QAT makes it possible to run Gemma 4 26B-A4B on 16GB RAM.GGUFs: https://huggingface.co/collections/unsloth/gemma-4-qatQAT Guide: https://unsloth.ai/docs/models/gemma-4/qat See translation 1 reply Β· π 17 17 π 4 4 π€ 1 1 π 1 1 + Reply
melcheikh/gemma-4-31B-it-qat-NVFP4-Blackwell Text Generation β’ 17B β’ Updated 3 days ago β’ 2.76k β’ 3
JetBrains/Mellum2-12B-A2.5B-Instruct Text Generation β’ 12B β’ Updated 10 days ago β’ 2.33k β’ 64
JetBrains/Mellum2-12B-A2.5B-Thinking Text Generation β’ 12B β’ Updated 10 days ago β’ 18.3k β’ 283
GestaltLabs/Ornstein-Hermes-3.6-27b-GGUF Image-Text-to-Text β’ 27B β’ Updated Apr 26 β’ 1.16k β’ 11
AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-BF16 Text Generation β’ 12B β’ Updated 4 days ago β’ 2k β’ 24
jcbtc/qwen3.6-35b-a3b-crown-halo-mtp-dynamic Text Generation β’ 36B β’ Updated 8 days ago β’ 761 β’ 12
GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF Image-Text-to-Text β’ 27B β’ Updated 28 days ago β’ 5.62k β’ 12