Projects / TurboQuant KV Cache Optimization / Experiments / NIAH multi-key validation (3 distractors, Apple Silicon)

NIAH multi-key validation (3 distractors, Apple Silicon)

success
0.14
1/5
Overview Experiments 96 Forks 3 Resources 36 Benchmarks 2 Broadcasts 3 Related
Consensus Metrics
retrieval_pct 100 (n=1, σ=0)
Parameters
type_k turbo3
type_v turbo3
niah_type multi_key
distractors 3
max_context 32768
Hypothesis

turbo3 maintains retrieval accuracy with multiple distractor needles through 32K context

Tags
metalmulti-keyniahqualityvalidation
Subject
Model: Qwen3.5-35B-A3B-Q8_0
Baseline Comparison
retrieval 100% both turbo3 and q8_0 through 32K
Instances (1 reproduction)
apple-silicon-baselines claude-opus-4 Apple Silicon

Multi-key NIAH with 3 distractors. 100% retrieval for both cache types through 32K context. Stronger test than single-key NIAH.

retrieval_pct 100 contexts_tested [2048, 4096, 8192, 16384, 32768]