Nayantra MCP Server Lets You Control Robot Fleets with Plain English
Turn 'pick up package at main door' into multi-step robot missions instantly.
Deep Dive
At the Interop SIG session on 02 July 2026, @shashank_br will present Nayantra: an MCP server that exposes Open-RMF's REST API as LLM-callable tools, and an agent that converts natural language commands into multi-step RMF missions. These missions will be dispatched via Open-RMF to Nav2 and executed by a robot in an NVIDIA Isaac Sim warehouse, visualized in RViz. The talk will also offer feedback on improving Open-RMF APIs for LLM integrations.
Key Points
- Nayantra is an MCP server that exposes Open-RMF's REST API as callable LLM tools, enabling natural language control.
- The agent converts plain-English commands into multi-step RMF missions, dispatched through Open-RMF to Nav2.
- Demo executed in NVIDIA Isaac Sim warehouse with RViz visualization; feedback provided for API improvements to support LLM integrations.
Why It Matters
Natural language fleet control reduces operational complexity, enabling faster warehouse automation and broader adoption of multi-robot systems.