google/diffusiongemma-26B-A4B-it Image-Text-to-Text ⢠26B ⢠Updated 8 days ago ⢠1.68M ⢠1.14k
view post Post 6653 Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!đGGUFs: unsloth/DeepSeek-V3.1-GGUFThe 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.Guide: https://docs.unsloth.ai/basics/deepseek-v3.1 See translation â¤ď¸ 19 19 đĽ 9 9 đ 5 5 + Reply