huawei-csl/Qwen3-8B-PreSINQ-GGUF
Text Generation • 8B • Updated • 10 • 2
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
huawei-csl/Qwen3-0.6B-PreSINQ-GGUF
Text Generation • 0.6B • Updated • 14 • 2
huawei-csl/Qwen3-4B-PreSINQ-GGUF
Text Generation • 4B • Updated • 35 • 5
huawei-csl/Qwen3-1.7B-PreSINQ-GGUF
Text Generation • 2B • Updated • 17 • 3
huawei-csl/Qwen3-Next-80B-A3B-Instruct-4bit-SINQ
Text Generation • Updated • 11 • 2
huawei-csl/Qwen3-Next-80B-A3B-Instruct-3bit-SINQ
Text Generation • Updated • 5 • 2
huawei-csl/Qwen3-32B-3bit-ASINQ
Text Generation • 6B • Updated • 6 • 5
huawei-csl/Apertus-8B-2509-4bit-SINQ
Text Generation • 5B • Updated • 5 • 2
huawei-csl/Qwen3-32B-3bit-SINQ
Text Generation • 6B • Updated • 5 • 6
huawei-csl/Qwen3-1.7B-4bit-SINQ
Text Generation • 1B • Updated • 3 • 5
huawei-csl/Kimi-Linear-48B-A3B-Instruct-3bit-SINQ
Text Generation • 7B • Updated • 3 • 1
huawei-csl/Qwen3-1.7B-4bit-ASINQ
Text Generation • 1B • Updated • 4 • 5
huawei-csl/Qwen3-14B-4bit-SINQ
Text Generation • 9B • Updated • 6 • 5
huawei-csl/Apertus-8B-2509-4bit-ASINQ
Text Generation • 5B • Updated • 292 • 3
huawei-csl/Qwen3-14B-3bit-ASINQ
Text Generation • 3B • Updated • 5 • 5
huawei-csl/Qwen3-1.7B-3bit-SINQ
Text Generation • 0.5B • Updated • 10 • 7
huawei-csl/Qwen3-32B-4bit-SINQ
Text Generation • 18B • Updated • 16 • 7
huawei-csl/Qwen3-235B-A22B-3bit-SINQ
Text Generation • Updated • 7 • 2
huawei-csl/Kimi-Linear-48B-A3B-Instruct-4bit-SINQ
Text Generation • 27B • Updated • 16 • 3
huawei-csl/Qwen3-14B-3bit-SINQ
Text Generation • 3B • Updated • 29 • 5
huawei-csl/Qwen3-32B-4bit-ASINQ
Text Generation • 18B • Updated • 7 • 8
huawei-csl/Qwen3-1.7B-3bit-ASINQ
Text Generation • 0.5B • Updated • 4 • 7
huawei-csl/Qwen3-14B-4bit-ASINQ
Text Generation • 9B • Updated • 1 • 6