This is a central repository for tools, tutorials, resources, and documentation for robotic simulation in Unity.
The contents of this repository are in active development. Its features and API are subject to significant change as development progresses.
Simulation plays an important role in robotics development, and we’re here to ensure that roboticists can use Unity for these simulations. We're starting off with a set of tools to make it easier to use Unity with existing ROS-based workflows. Try out some of our samples below to get started quickly.
Brief steps on installing the Unity Robotics packages.
A complete end-to-end demonstration, including how to set up the Unity environment, how to import a robot from URDF, and how to set up two-way communication with ROS for control.
[New!] Object Pose Estimation Demo
A complete end-to-end demonstration in which we collect training data in Unity and use that data to train a deep neural network to predict the pose of a cube. This model is then deployed in a simulated robotic pick-and-place task.
A robot simulation demonstrating Unity's new physics solver (no ROS dependency).
| Tutorial | Description |
|---|---|
| ROS–Unity Integration | A set of component-level tutorials showing how to set up communication between ROS and Unity |
| URDF Importer | Steps on using the Unity package for loading URDF files |
| Repo | Functionality |
|---|---|
| ROS TCP Endpoint | ROS node for sending/receiving messages from Unity |
| ROS TCP Connector | Unity package for sending/receiving messages from ROS |
| URDF Importer | Unity package for loading URDF files |
- [New!] (March 2, 2021) Teaching robots to see with Unity blog post
- (November 19, 2020) Robotics simulation in Unity is as easy as 1, 2, 3! blog post
- (November 12, 2020) Unite Now 2020: Simulating Robots with ROS and Unity video
- (August 26, 2020) Announcing Unity Robotic Simulation blog post
- (May 20, 2020) Use articulation bodies to easily prototype industrial designs with realistic motion and behavior blog post
Here’s a peek into what our Physics Team is hard at work on…
- Contact Modification API. This API will allow users to define custom contact reactions, such as ignoring subsets of contact points, in order to help simulate holes, slippery surfaces, soft contacts, and more. Read more about the new Contact Modification API.
- Wheel Collider shapes. This feature will allow the user to specify the shape of the collider to be used for collision detection. Currently the collider shape is fixed to a cylinder, and collision detection is performed by casting a ray from the center of the cylinder. Custom shapes will improve the accuracy of simulating wheels over rough terrains, holes, etc. Read more about Wheel Collider.
- Collision detection modes exposed for ArticulationBody: discrete, sweep-based ccd, and speculative ccd. New continuous collision detection (ccd) modes will ensure that fast-moving objects collide with objects, instead of tunneling or passing through those objects, which can happen in the default “discrete” mode. Read more about continuous collision detection.
- Force/Torque Sensor API. This API will allow users to get the force and torque acting on an articulation body (useful for simulating a force/torque sensor!), as well as to get the motor torque applied by an articulation drive.
- Query primitives. These simple, GameObject-less shapes allow for collision detection without requiring simulation (i.e., without calling Physics.Simulate). This feature will allow users to initialize objects in feasible locations, and can also be used for motion planning.
Interested in early access to ROS 2 integration? Email [email protected] to join our alpha program.
For general questions, feedback, or feature requests, connect directly with the Robotics team at [email protected].
For bugs or other issues, please file a GitHub issue and the Robotics team will investigate the issue as soon as possible.
To get notified about new updates and features, sign up for our newsletter!