Consensus Metrics
ppl_1e4
6.176 (n=1, σ=0)
ppl_1e5
6.176 (n=1, σ=0)
ppl_1e6
6.176 (n=1, σ=0)
ppl_1e7
6.176 (n=1, σ=0)
ppl_1e8
6.176 (n=1, σ=0)
Parameters
type_k
turbo3
type_v
turbo3
sparse_v
true
thresholds
[1e-4
Hypothesis
Threshold choice across 5 orders of magnitude does not affect quality
Subject
Model: Qwen3.5-35B-A3B-Q8_0
Dataset: wikitext-2
Baseline Comparison
perplexity identical across all thresholds
Instances (1 reproduction)
PPL identical at 6.1756 for all 5 threshold values from 1e-4 to 1e-8. Threshold is not a sensitive hyperparameter. Default 1e-6 is safe.
ppl_1e4 6.1756
ppl_1e5 6.1756
ppl_1e6 6.1756
ppl_1e7 6.1756
ppl_1e8 6.1756