Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,568

Base only

Active filters: quantization

Reza2kn/LocateAnything-3B-ONNX-WebGPU-INT4

Object Detection • Updated 7 days ago • 154 • 10

TheStageAI/gemma-4-E4B-it

Image-Text-to-Text • Updated 2 days ago • 401 • 7

Abiray/Gemma-4-12B-it-AEON-Abliterated-K4-GGUF

Text Generation • 12B • Updated about 8 hours ago • 7

w-ahmad/Qwen3.5-9B-GGUF-MoQ

Text Generation • 9B • Updated about 22 hours ago • 51.6k • 14

mlx-community/MiniCPM5-1B-OptiQ-4bit

Text Generation • 0.2B • Updated 5 days ago • 513 • 4

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated 5 days ago • 858 • 4

TheStageAI/gemma-4-E2B-it

Image-Text-to-Text • Updated 2 days ago • 547 • 3

embedl/sam3

Updated 10 days ago • 35 • 5

tonera/FLUX.2-klein-9B-Nunchaku

Image-to-Image • Updated 22 days ago • 2.26k • 15

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 1.19M • 109

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 3.31k • 7

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated 23 days ago • 41.6k • 8

ISTA-DASLab/Qwen3-8B-GGUF-GSQ

Text Generation • 8B • Updated 17 days ago • 221 • 3

k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF

Text Generation • 27B • Updated 14 days ago • 946 • 5

tsolful/Z-Image-L2P-INT8

Text-to-Image • Updated 10 days ago • 13

w-ahmad/Qwen3.5-9B-GGUF-MoQ-MTP

Text Generation • 9B • Updated about 9 hours ago • 14.4k • 3

Reza2kn/Cosmos3-Nano-INT4-AWQ

Text-to-Image • Updated 3 days ago • 50 • 2

legraphista/DeepSeek-V2-Lite-IMat-GGUF

Text Generation • 16B • Updated May 26, 2024 • 1.41k • 2

legraphista/Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 1.06k • 2

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 1.5k • 1

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Tacoin/openpi-pi0.5-libero-onnx

Robotics • Updated Jan 19 • 1

tonera/waiNSFWIllustrious_v150

Text-to-Image • Updated Jan 23 • 65 • 2

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated Feb 3 • 2.17k • 24

ApacheOne/ZImageTurbo-nvfp4_mixed

Updated Apr 8 • 6 • 1

Ccre/Z-Image-Turbo-MXFP8

Text-to-Image • Updated Mar 25 • 98 • 5

vrfai/Qwen3-ASR-1.7B-nvfp4

Automatic Speech Recognition • 1B • Updated Apr 10 • 1.7k • 5

YakovSava/RouWei-08-gguf

3B • Updated Apr 1 • 32 • 1

ebircak/gemma-4-31B-it-4bit-W4A16-AWQ

Text Generation • 32B • Updated Apr 7 • 40.1k • 2

fno2010/MiniMax-M2.7-TQ3

88B • Updated Apr 12 • 9.39k • 14