RotorQuant rotation speed comparison

success

0.14

1/5

Overview Experiments 96 Forks 3 Resources 36 Benchmarks 2 Broadcasts 3 Related

Consensus Metrics

speedup_cuda_1k 11 (n=1, σ=0)

speedup_cuda_16k 19 (n=1, σ=0)

speedup_metal_1k 1.6 (n=1, σ=0)

speedup_metal_65k 31.3 (n=1, σ=0)

parameter_reduction 44 (n=1, σ=0)

Parameters

method clifford_algebra

comparison dense_rotation

Hypothesis

Clifford algebra rotor rotation is faster than dense matrix rotation

Reference

https://github.com/scrya-com/rotorquant

Tags

Subject

Model: synthetic

Baseline Comparison

rotation_speed 11-31x faster than dense rotation

Instances (1 reproduction)

apple-silicon-baselines johndpope RTX PRO 4000 Blackwell + M4 Mac Mini

johndpope's Clifford algebra alternative. 44x fewer parameters than dense rotation matrix. Rotation speed 11-31x faster. Quality comparable to TurboQuant at 3-bit (cosine 0.9903 vs 0.9906). PR submitted to turboquant_plus. Building at scrya-com/rotorquant.

speedup_cuda_1k 11 speedup_cuda_16k 19 speedup_metal_1k 1.6 speedup_metal_65k 31.3 parameter_reduction 44