down_proj stacked protection sweep

failure

0.68

1/5

Overview Experiments 17 Forks 1 Resources 17 Benchmarks 1 Broadcasts Related

Consensus Metrics

k_only_ppl 19.21 (n=1, σ=0)

k_plus_down_q8_ppl 19.18 (n=1, σ=0)

k_plus_down_q8_bpe 5.2 (n=1, σ=0)

Parameters

quant gptq_turbo_q4

group_size 256

protect_roles [k_proj

protect_method_grid [q8

eval_seq_len 2048

Hypothesis

down_proj is the most quant-sensitive role (38% of total error budget per EXP-0007); stacking it with k_proj protection should give strictly more recovery than k_proj alone