Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

nm-research updated a model about 3 hours ago

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-500k-ckpt1-20260609-0052

nm-research published a model about 3 hours ago

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-500k-ckpt1-20260609-0052

nm-research updated a model about 4 hours ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.non-qwen3-ep0p11

View all activity

inference-optimization 's models 376

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq

5B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq

2B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod

2B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod

5B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq

5B • Updated Apr 22 • 1

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

2B • Updated Apr 20 • 1

inference-optimization/llama3-8b-sharegpt-5k-gen

inference-optimization/Llama-3.2-3B-Instruct-NVFP4

2B • Updated Apr 7 • 180

inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic

3B • Updated Apr 7 • 3

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

3B • Updated Apr 7 • 4

inference-optimization/Llama-3.2-1B-Instruct-NVFP4

0.8B • Updated Apr 7 • 86

inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic

1B • Updated Apr 7 • 5

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

1B • Updated Apr 7 • 3

inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_heuristic

22B • Updated Apr 2 • 1

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_heuristic

27B • Updated Apr 2 • 2

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_noise

27B • Updated Apr 2 • 1

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_hybrid

25B • Updated Apr 2 • 3

inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_heuristic

25B • Updated Apr 2 • 3

inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_noise

25B • Updated Apr 2 • 2

inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_hybrid

24B • Updated Apr 1 • 1

inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_heuristic

23B • Updated Apr 1 • 2

inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_noise

24B • Updated Apr 1 • 3

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3

0.9B • Updated Apr 1 • 5

inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_hybrid

23B • Updated Apr 1 • 1

inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_noise

22B • Updated Apr 1 • 1

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt4-speculator.eagle3

0.9B • Updated Apr 1 • 5 • 1

inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_hybrid

22B • Updated Apr 1 • 2

inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_heuristic

20B • Updated Apr 1 • 2

inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_noise

20B • Updated Mar 31 • 2

inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_hybrid

20B • Updated Mar 31