MiLSD detects line segments under 1MB memory for MCU vision
Boosts accuracy 2.3x on ShanghaiTech Wireframe from 0.25MB baseline
Line segment detection is critical for visual SLAM, 3D reconstruction, and industrial inspection, but existing deep learning models require several megabytes of memory—far exceeding the capacity of low-cost microcontrollers (MCUs). In a new arXiv preprint, researchers introduce MiLSD (Micro Line-Segment Detector), purpose-built for sub-megabyte memory budgets. The team systematically compared three output representations within a compact fully-convolutional backbone and found that their proposed F-Clip (center-with-length-and-angle) formulation learns most effectively at small model sizes. With 8-bit quantization, MiLSD preserves full-precision performance, while 4-bit quantization causes significant degradation—especially in angle regression—that quantization-aware training only partially recovers.
Operating under a 1MB activation budget, MiLSD improves the ShanghaiTech Wireframe sAP10 metric from 10.6 (using a 25k-parameter, 0.25MB baseline) to 24.1. The full pipeline includes inference enhancements such as sub-pixel decoding, test-time augmentation, and a lightweight verifier. Rather than competing with GPU-scale parsers, the work maps the accuracy-memory trade-off across representations, bit-widths, network capacities, and post-processing strategies for embedded vision systems. This enables advanced computer vision capabilities on cost-constrained devices like drones, robots, and smart cameras.
- MiLSD achieves 24.1 sAP10 on ShanghaiTech Wireframe within 1MB, vs. 10.6 at 0.25MB (2.3x improvement).
- Uses novel F-Clip center-with-length-and-angle output representation optimized for tiny fully-convolutional backbones.
- 8-bit quantization preserves full-precision accuracy; 4-bit causes 10-15% degradation in angle regression even with QAT.
Why It Matters
Brings robust line segment detection to low-cost MCUs, unlocking visual SLAM and 3D reconstruction on edge devices.