Image & Video

DINOv3 ViT-L backbone wins ICRA 2026 GOOSE segmentation challenge

First-place solution achieves 76.57% composite score on 64-class off-road imagery.

Deep Dive

Winning the ICRA 2026 GOOSE challenge required parsing outdoor field-robot imagery into 64 fine-grained classes (11 non-void coarse categories). The first-place team (Park et al.) leveraged a self-supervised DINOv3 ViT-L/16 backbone coupled with a ViT-Adapter and a Mask2Former mask-classification decoder. They introduced a coarse-category auxiliary loss on the global [CLS] token to improve hierarchical understanding. At inference, they employed multi-scale and horizontal-flip test-time augmentation and an ensemble of their top-3 checkpoints (selected via Codabench scores).

The final submission achieved a composite score of 76.57% (69.32% fine-class mIoU, 83.81% category-level mIoU), securing first place on the final leaderboard. The work demonstrates that self-supervised vision transformers combined with modern segmentation decoders and strategic ensembling can robustly handle complex outdoor scenes. The approach is particularly relevant for field robotics applications such as autonomous navigation in unstructured environments.

Key Points
  • First-place solution in ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge (64 classes, 11 coarse categories)
  • Architecture: DINOv3 ViT-L/16 backbone + ViT-Adapter + Mask2Former decoder with coarse-category auxiliary loss
  • Achieved 76.57% composite score: 69.32% fine-class mIoU and 83.81% category-level mIoU

Why It Matters

Robust outdoor scene understanding is critical for autonomous field robots; this winning method shows a practical path forward.

📬 Get the top 10 AI stories daily