Qualcomm's New Chip Trick Makes AI Run Faster on Your Phone
This could mean quicker AI apps and longer battery life on your next phone.
Deep Dive
A new commit adds support for hadamard MUL_MAT and GET_ROW for flat and tiled Q1_0 and Q2_0 under hexagon (#30627). The change also adds support for hadamard ops, reduces packet counts in the q8_1 quantizer and vec_dot_q1, and adds support for flat and tiled GET_ROWS for Q1_0 and Q2_0. Co-authored by Max Krasnyansky.
Key Points
- Qualcomm added new math operations to its phone chips to speed up AI.
- Faster AI means apps like photo editors and voice assistants could work quicker and use less battery.
- Only newer Qualcomm chips will benefit, and apps need to be updated to use the new features.
Why It Matters
Quicker AI apps and longer battery life on your phone, but only if you have a newer Qualcomm chip.