inference-optimization/llama3_8b_7.0_bits_mode_noise_stiched
7B • Updated • 5
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
inference-optimization/llama3_8b_7.0_bits_mode_hybrid_stiched
7B • Updated • 6
inference-optimization/llama3_8b_7.0_bits_mode_heuristic_stiched
7B • Updated • 5
inference-optimization/llama3_8b_6.5_bits_mode_noise_stiched
7B • Updated • 4
inference-optimization/llama3_8b_6.5_bits_mode_hybrid_stiched
7B • Updated • 7
inference-optimization/llama3_8b_6.5_bits_mode_heuristic_stiched
7B • Updated • 5
inference-optimization/llama3_8b_6.0_bits_mode_noise_stiched
6B • Updated • 5
inference-optimization/llama3_8b_6.0_bits_mode_heuristic_stiched
6B • Updated • 4
inference-optimization/llama3_8b_5.5_bits_mode_noise_stiched
6B • Updated • 4
inference-optimization/llama3_8b_5.5_bits_mode_hybrid_stiched
6B • Updated • 4
inference-optimization/llama3_8b_5.5_bits_mode_heuristic_stiched
6B • Updated • 5
inference-optimization/llama3_8b_5.0_bits_mode_noise_stiched
5B • Updated • 5
inference-optimization/llama3_8b_5.0_bits_mode_hybrid_stiched
5B • Updated • 3
inference-optimization/llama3_8b_5.0_bits_mode_heuristic_stiched
5B • Updated • 5
inference-optimization/llama3_8b_6.0_bits_mode_hybrid_stiched
6B • Updated • 6
inference-optimization/qwen3-8b-peagle-speculators
Updated
inference-optimization/peagle-gemma4
2B • Updated • 4
inference-optimization/ctest-Qwen3.5-9B-speculator.dflash
2B • Updated • 7
inference-optimization/MiniMax-M2.5-BF16
Text Generation • 229B • Updated • 106
inference-optimization/ctest-Qwen3-8B-speculator.dflash
2B • Updated • 3
inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK
Updated
inference-optimization/DeepSeek-V4-Flash-bf16
Updated
inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe
20B • Updated • 5
inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers
34B • Updated • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor
26B • Updated • 5
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor
27B • Updated • 6
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor
27B • Updated • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor
25B • Updated • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 4