Image & Video

New mixed-precision codec enables cross-platform neural video streaming

IEEE GLOBECOM paper solves GPU floating-point crashes in neural video codecs

Deep Dive

Neural video codecs (NVCs) deliver impressive rate-distortion performance, making them ideal for bandwidth-constrained 5G and satellite direct-to-cell links. But real-world deployment has been blocked by cross-platform floating-point non-determinism—identical bitstreams can crash or desync when decoded on different GPU architectures. Prior integer-based fixes (INT8, INT16) either gut compression efficiency or destroy hardware acceleration. Now, researchers Kasidis Arunruangsirilert, Heming Sun, and Jiro Katto propose a mixed precision strategy: P-frames run in hardware-accelerated FP16 for real-time throughput, while I-frames and periodic feature-adapter resets are forced to IEEE-754-compliant FP32, creating deterministic synchronization boundaries that guarantee decoders stay aligned across systems.

The team validated the approach across 12 GPUs spanning four architectural generations, and report elimination of intra-generation fragmentation with substantially broader cross-die interoperability—achieving seamless cross-generation decodability at 1080p with negligible impact on compression efficiency. They also tested end-to-end latency over real-world networks including Wi-Fi 6, 5G NR (FDD/TDD), and Starlink direct-to-cell links, proving the practical viability of streamable learned video compression while documenting unique challenges in non-terrestrial networks. The paper is set for presentation at IEEE GLOBECOM 2026 in Macau.

Key Points
  • Mixed precision (FP16/FP32) solves GPU non-determinism without INT8 quality loss or INT16 speed penalty
  • Validated on 12 GPUs across 4 architecture generations with seamless 1080p cross-generation decoding
  • End-to-end tested over Wi-Fi 6, 5G NR, and Starlink D2C, addressing non-terrestrial network challenges

Why It Matters

This could finally make neural video codecs practical across heterogeneous devices and cellular/satellite networks, unlocking major bandwidth savings.

📬 Get the top 10 AI stories daily