RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8
3B • Updated • 11
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8
2B • Updated • 5
RedHatAI/SparseLlama-3-8B-pruned_50.2of4
Text Generation • 8B • Updated • 26 •
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Text Generation • 89B • Updated • 159 • 11
RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Text Generation • 4B • Updated • 8 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16
Text Generation • 71B • Updated • 22 • 2
RedHatAI/SmolLM-135M-q
Updated
RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation • 141B • Updated • 4 • 3
RedHatAI/DeepSeek-Coder-V2-Base-FP8
Text Generation • 236B • Updated • 8
RedHatAI/DeepSeek-Coder-V2-Instruct-FP8
Text Generation • 236B • Updated • 3.66k • 7
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
Text Generation • 12B • Updated • 1.3k • 19
RedHatAI/Qwen2-57B-A14B-Instruct-FP8
Text Generation • 57B • Updated • 473 • 1
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation • 7B • Updated • 57
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation • 7B • Updated • 3.07k • 3
RedHatAI/Qwen2-0.5B-Instruct-FP8
Text Generation • 0.5B • Updated • 1.45k • 3
RedHatAI/Qwen2-1.5B-Instruct-FP8
Text Generation • 2B • Updated • 40.3k
RedHatAI/Qwen2-7B-Instruct-FP8
Text Generation • 8B • Updated • 993 • 2
RedHatAI/Qwen2-72B-Instruct-FP8
Text Generation • 73B • Updated • 911 • 16
RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8
Text Generation • 47B • Updated • 14 • 3
RedHatAI/Meta-Llama-3-70B-Instruct-FP8
Text Generation • 71B • Updated • 860 • 13
RedHatAI/Meta-Llama-3-8B-Instruct-FP8
Text Generation • 8B • Updated • 2.99k • • 24
RedHatAI/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation • 16B • Updated • 5
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation • 16B • Updated • 249k • 14
RedHatAI/Qwen2-7B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 85
RedHatAI/Qwen2-72B-Instruct-quantized.w4a16
Text Generation • 73B • Updated • 18 • 4
RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation • 2B • Updated • 18
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation • 0.6B • Updated • 106
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation • 73B • Updated • 15 • 1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 10
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 6