Stiefel Attention: When the Geometry of Transformer Projection Matrices Dominates Optimizer Choice---and When It Does Not

Computer Science > Machine Learning arXiv:2609.19363 (cs) [Submitted on 16 Sep 2026] Title: Stiefel Attention: When the Geometry of Transformer Projection Matrices Dominates Optimizer Choice---and When It Does Not Authors: Rubén Darío Guerrero View a PDF of the paper titled Stiefel Attention: When t