AI Robotics Challenge bug: Trajectory efficiency always scores max with 0m path
Participants discover teleportation-like anomaly in plug insertion scoring.
Deep Dive
A participant in the AI for Industry Challenge reported that in all trials where the task was completed, the trajectory efficiency score was always the full 6 points, with the end-effector path length recorded as 0.00 m—as if the robot teleported. In one trial where the task was not completed, the efficiency score was 0. The participant suspects a bug in the scoring evaluation and asks if others have experienced the same issue.
Key Points
- Trajectory efficiency always reports 0.00m end-effector path length, granting full 6 points regardless of actual robot movement.
- Multiple trials show valid durations (25–45s) and varying smoothness scores, but path length is always zero—suggesting a calculation bug.
- The bug affects the UR5e robot arm in the AI for Industry Challenge, where plug insertion tasks require centimeter-level precision.
Why It Matters
This bug invalidates a key competition metric and highlights scoring errors in robotics benchmarks.