Optimizing GLM4-MoE for Production: 65% Faster TTFT with SGLang
• 10
Inference Provider
VERIFIED
11,735,281 monthly requests
AI & ML interests
AI inference, open-source model APIs, serverless GPUs, and on-demand GPU instances.
Recent Activity
View all activity
Articles
novita/kimi-k2.7-code-eagle3-mla
Text Generation • 2B • Updated • 333 • 2
novita/Behemoth-123B-v1.2-FP8
123B • Updated • 6
novita/Cydonia-24B-v3-FP8
24B • Updated • 3
novita/NemoMix-Unleashed-12B-FP8
12B • Updated • 4 • 1
novita/MN-12B-Mag-Mell-R1-FP8
12B • Updated • 2
novita/Deepseek-R1-0528-W4AFP8
349B • Updated • 6 • 1
novita/Deepseek-V3.1-W4AFP8
349B • Updated • 2
novita/Deepseek-R1-W4AFP8
349B • Updated • 9
novita/Deepseek-V3-0324-W4AFP8
349B • Updated • 81 • 1
novita/Sao10K-L3-8B-Stheno-v3.2-AWQ-FP8
8B • Updated • 1
novita/inflatebot-MN-12B-Mag-Mell-R1-AWQ-FP8
12B • Updated
novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888
71B • Updated • 41 • 2