Red Hat AI

company

Verified

https://www.redhat.com/en/products/ai

AI & ML interests

OpenSource and AI

Recent Activity

kylesayrs updated a model about 2 hours ago

RedHatAI/GLM-5.2-NVFP4-FP8

kylesayrs new activity about 6 hours ago

RedHatAI/GLM-5.2-NVFP4:Safetensors File Size < 50 GB?

kylesayrs updated a model about 8 hours ago

RedHatAI/Hy3-NVFP4-FP8

View all activity

Papers

SNLP: Layer-Parallel Inference via Structured Newton Corrections

S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation

View all Papers

RedHatAI 's models 711

RedHatAI/SmolLM-135M-Instruct-quantized.w8a16

Text Generation • 0.2B • Updated Oct 9, 2024 • 284

RedHatAI/gemma-2-27b-it-quantized.w8a16

Text Generation • 28B • Updated Oct 9, 2024 • 4

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • 406B • Updated Oct 9, 2024 • 8 • 1

RedHatAI/gemma-2-2b-it-quantized.w8a8

Text Generation • 3B • Updated Oct 9, 2024 • 29

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16

Text Generation • 12B • Updated Oct 9, 2024 • 4.62k • 4

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • 2B • Updated Oct 9, 2024 • 4

RedHatAI/gemma-2-2b-it-quantized.w4a16

Text Generation • 3B • Updated Oct 9, 2024 • 361 • 1

RedHatAI/gemma-2-9b-it-quantized.w4a16

Text Generation • 10B • Updated Oct 9, 2024 • 897 • 2

RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16

Text Generation • 8B • Updated Oct 9, 2024 • 8

RedHatAI/gemma-2-2b-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 7

RedHatAI/gemma-2-2b-it-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 6 • 1

RedHatAI/gemma-2-9b-it-quantized.w8a16

Text Generation • 10B • Updated Oct 9, 2024 • 87 • 1

RedHatAI/gemma-2-2b-it-FP8

3B • Updated Oct 9, 2024 • 801 • 1

RedHatAI/starcoder2-15b-quantized.w8a8

Text Generation • 16B • Updated Oct 9, 2024 • 13

RedHatAI/starcoder2-7b-quantized.w8a8

Text Generation • 7B • Updated Oct 9, 2024 • 6

RedHatAI/starcoder2-3b-quantized.w8a8

Text Generation • 3B • Updated Oct 9, 2024 • 32

RedHatAI/starcoder2-7b-quantized.w8a16

Text Generation • 7B • Updated Oct 9, 2024 • 6

RedHatAI/starcoder2-3b-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 8

RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8

Text Generation • 71B • Updated Oct 9, 2024 • 5

RedHatAI/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Oct 9, 2024 • 2.79k

RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16

Text Generation • 71B • Updated Oct 9, 2024 • 6

RedHatAI/starcoder2-3b-FP8

Text Generation • 3B • Updated Oct 9, 2024 • 4

RedHatAI/starcoder2-7b-FP8

Text Generation • 7B • Updated Oct 9, 2024 • 9

RedHatAI/starcoder2-15b-FP8

Text Generation • 16B • Updated Oct 9, 2024 • 14

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16

Text Generation • 12B • Updated Oct 9, 2024 • 6

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • 8B • Updated Oct 9, 2024 • 5 • 1

RedHatAI/Meta-Llama-3.1-70B-FP8

Text Generation • 71B • Updated Oct 9, 2024 • 303 • 3

RedHatAI/Mistral-Large-Instruct-2407-FP8

Text Generation • 123B • Updated Oct 9, 2024 • 76

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • 71B • Updated Oct 9, 2024 • 18 • 5

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Oct 9, 2024 • 547k • 44