New method makes AI data processing much faster on graphics cards

A new system called FlashSketch makes a core AI math operation, called sparse sketching, run 1.7 times faster on average on modern GPUs. The breakthrough comes from co-designing a new sketching algorithm with a custom software kernel to overcome inefficient memory access. This pushes the frontier of speed versus accuracy for tasks like data attribution in machine learning, offering a tunable trade-off between computational efficiency and result quality.