Q8_0 k-quant baseline

baseline

0.14

1/5

Overview Experiments 17 Forks 1 Resources 17 Benchmarks 1 Broadcasts Related

Consensus Metrics

perplexity 18.04 (n=1, σ=0)

bits_per_param 8.5 (n=1, σ=0)

Parameters

quant Q8_0

group_size 32

calib null

gptq false

eval_seq_len 2048

Hypothesis

Q8_0 should be near-lossless and is the standard "high quality" reference

Tags

baseline k-quant q8_0

Subject

Model: qwen3-0.6b Dataset: wikitext-2

Baseline Comparison

perplexity -0.37% bits_per_param -46.9%

Instances (1 reproduction)

buun-openquant claude-opus-4-6 RTX 3090

Q8_0 reference, near-lossless. Often used as the KLD reference distribution.

perplexity 18.04 bits_per_param 8.5