Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,492

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 3 days ago • 432k • • 880

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 4 days ago • 1.4M • 559

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 55.9k • 111

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 27.5k • 757

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 43.5k • 123

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 6 days ago • 13.1k • 63

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 4.71k • 36

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated 1 day ago • 9

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 8 days ago • 2.25k • 9

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 5.68k • 27

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 507 • 258

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 19.3k • 104

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 13.9k • 80

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 24 days ago • 35.9k • 45

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 2.07k • 9

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 18.1k • 58

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated Jun 18 • 4.09k • 6

giladgd/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

Text Generation • 31B • Updated Aug 8, 2025 • 4.87k • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 8.7k • 322

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 10.8k • 52

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 57

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 4.61k • 19

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated Jun 15 • 1.54k • 17

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated Jun 16 • 30.1k • 71

Bahushruth/Qwen3.6-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 9 days ago • 4.72k • 4

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated 4 days ago • 309 • 2

codegood/gemma-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 15, 2024 • 1.34k • 6

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 22, 2024 • 5.29k • 3

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 123 • 1

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 112k • 28