view post Post 6032 DeepSeek-V4 can now run locally with Unsloth GGUFs! 🐳Run lossless DeepSeek-V4-Flash on 168GB RAM or3-bit works on 110GB Mac, RAM, VRAM setups.Run via Unsloth Studio or llama.cpp.GGUF: unsloth/DeepSeek-V4-Flash-GGUFGuide: https://unsloth.ai/docs/models/deepseek-v4 See translation 🔥 20 20 🚀 5 5 👍 3 3 🤗 2 2 + Reply
Nemotron Speech Collection Open, state-of-the-art, production‑ready enterprise speech models from the NVIDIA Speech research team for ASR, TTS, Speaker Diarization and S2S • 13 items • Updated 7 days ago • 59
Unsloth Dynamic 2.0 Quants Collection New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance. • 109 items • Updated 6 days ago • 771