GeoISF boosts LiDAR-to-satellite localization 13x with semantic forest
New method uses WordNet-inspired trees to match LiDAR scans to satellite imagery with 13x better recall.
Cross-view geo-localization—matching a ground LiDAR scan to an aerial satellite image—remains a key challenge for autonomous vehicles and robotics, especially at city scale. Existing methods struggle with the deep modality gap between sparse 3D point clouds and dense 2D satellite imagery, and often fail to capture long-term temporal semantics. In a new paper, Di Hu, Xia Yuan, and Chunxia Zhao present GeoISF (Instance Semantic Forest), a pipeline that leverages a hierarchical semantic forest constructed from WordNet. By integrating semantic trees from multiple frames, GeoISF enriches temporal representation and discriminative power, enabling more robust alignment across modalities.
Extensive experiments on the KITTI dataset show a dramatic improvement: GeoISF achieves 13.22x higher recall at Rank-1 (R@10) compared to the previous state-of-the-art LiDAR-to-image method. The approach effectively bridges the semantic gap by using environmental semantics as a shared medium, and handles large-scale scenarios without the computational explosion typical of brute-force retrieval. The authors plan to release the code as open source, which could accelerate development of practical localization systems for autonomous driving, drone navigation, and urban mapping where GPS is unreliable or denied.
- GeoISF introduces an instance semantic forest from WordNet to enhance temporal semantic representation and discriminative power across multiple LiDAR frames.
- On the KITTI dataset, GeoISF achieves 13.22x better R@10 than the best parallel LiDAR-to-image method, setting a new state-of-the-art for large-scale cross-view localization.
- The method uses environmental semantics as a shared medium to bridge the modality gap between ground point clouds and satellite images, and will be released as open-source code.
Why It Matters
Enables robust, large-scale geo-localization for autonomous vehicles in GPS-denied environments, improving safety and navigation accuracy.