Reference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)
attention symmetric-tensors self-attention linear-attention taylor-approximation symmetry-aware-taylor-approximation
-
Updated
Feb 21, 2026 - Python