Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,493

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 3 days ago • 339k • • 843

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 3 days ago • 1.26M • 535

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 54.5k • 109

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 23.2k • 755

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 6 days ago • 12.8k • 63

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 34.7k • 123

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 4.32k • 35

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 7 days ago • 1.74k • 9

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 5.22k • 27

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 19.4k • 104

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 23 days ago • 35.1k • 44

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 11.3k • 80

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated about 9 hours ago • 4

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.98k • 9

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated Jun 18 • 5.35k • 6

Jiunsong/SuperHY3-abliterated-gguf

Text Generation • 299B • Updated 7 days ago • 397 • 5

giladgd/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

Text Generation • 31B • Updated Aug 8, 2025 • 4.76k • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 8.25k • 321

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 10.2k • 52

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 18.6k • 57

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 57

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 4.62k • 19

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated Jun 16 • 32.8k • 71

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 2 days ago • 36.8k • 15

GZGavinZhao/Leanstral-1.5-119B-A6B-GGUF

119B • Updated 14 days ago • 3.42k • 6

Bahushruth/Qwen3.6-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 9 days ago • 4.45k • 4

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated 4 days ago • 211 • 2

codegood/gemma-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 15, 2024 • 1.33k • 6

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 22, 2024 • 5.04k • 3

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 94 • 1