Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a collection about 4 hours ago

nm-research updated a model about 19 hours ago

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-500k-ckpt2

ChibuUkachi updated a dataset about 20 hours ago

inference-optimization/every-eval-ever-demo

View all activity

inference-optimization 's models 379

inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic

15B • Updated Mar 17 • 7

inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0

2B • Updated Mar 17 • 1

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3

0.9B • Updated Mar 16 • 3

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3

0.9B • Updated Mar 15 • 2

inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3

0.9B • Updated Mar 12 • 2

inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3

0.9B • Updated Mar 12 • 2

inference-optimization/Qwen3-Coder-Next.w4a16

Text Generation • 12B • Updated Mar 12 • 89 • 1

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid

3B • Updated Mar 12 • 5

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic

1B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid

1B • Updated Mar 12 • 1