Low-Rank Friction for Memory-Efficient Transformer Pretraining
Low-Rank Friction for Memory-Efficient Transformer Pretraining
Deep Dive
Statistics > Machine Learning arXiv:2609.30342 (stat) [Submitted on 24 Sep 2026] Title: Low-Rank Friction for Memory-Efficient Transformer Pretraining Authors: Rajit Rajpal , Benedict Leimkuhler View a PDF of the paper titled Low-Rank Friction for Memory-Efficient Transformer Pretraining, by Rajit R