Isaac Sim MCP server

This is a helper that lets your AI assistant control NVIDIA Isaac Sim, a program used to build and run robot simulations. Instead of clicking through menus or writing code, you just describe what you want in plain English. It is handy for people who work with robots, simulations, or 3D scenes and want a faster, more conversational way to set things up.

What this MCP server does

You type a request in plain English, like asking for three robots in a row or more light in the scene. Your AI reads that and uses this helper to send the right commands to Isaac Sim. The helper talks to the Isaac Sim extension running on your computer, which then creates the robots, moves them, or changes the lighting. You see the result appear in your simulation window, and the AI tells you what it did.

Click to zoom

What you can do with it

• Create robots like Franka, Jetbot, Carter, G1, or Go1 at specific positions
• Move robots around the scene by describing where they should go
• Add or adjust lighting in your simulation
• Build a physics scene with a floor and gravity
• Run custom Python code inside Isaac Sim through a simple request
• Search for 3D objects like a rusty desk and place them in the scene
• Generate 3D objects from images using Beaver3D and place them in a grid

Try asking your AI

• “Create 3x3 franka robots in the current stage across location [3, 0, 0] and [6, 3, 0]”
• “Add more light in the stage”
• “Create a g1 robot at [3, 9, 0] and move it to [1, 1, 0]”
• “Search a rusty desk and place it at [0, 5, 0] with scale [3, 3, 3]”

What it gives back to you

You get a confirmation in the chat that the action was done, like robots created or lighting updated. The AI may also show you a preview of the code it is about to run before it runs it. The actual visual change happens in your Isaac Sim window, not in the chat. If something goes wrong, the AI will tell you it could not connect or the command failed.

Before you start

Who it's for

Robotics engineers, simulation developers, and anyone who uses NVIDIA Isaac Sim and wants to control it with natural language instead of manual scripting.