p71924506
/
carla
mirror of https://github.com/carla-simulator/carla.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Tidy up of SimReady docs after release (#6910) 

* added simready instructions

* tidied up SimReady instructions

* typos
This commit is contained in:
MattRoweEAIF 2023-11-14 13:02:28 +01:00 committed by GitHub
parent 2e5039636a
commit 603633c08f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 44 additions and 42 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

86
Docs/ecosys_simready.md
View File

@ -1,64 +1,66 @@
# SimReady content with NVIDIA Omnivers # SimReady content with NVIDIA Omniverse
NVIDIA's [__SimReady__](#simready-content-from-nvidias-omniverse) specification supports the preparation of 3D content that is purpose-built for simulation to help streamline content creation pipelines for simulating 3D virtual environments for machine learning purposes in robotics and autonomous driving. Through the Omniverse Unreal Engine plugin now integrated into CARLA users can import, in just a few clicks, SimReady content such as vehicles already configured with working lights, doors and wheels and props ready for use instantaneously to decorate CARLA maps. CARLA's Omniverse integration boasts to significantly accelerate your environment building pipeline and opens the door to a whole world of applications in the [__Omniverse ecosystem__](https://www.nvidia.com/en-us/omniverse/ecosystem/). NVIDIA's [__SimReady__](https://developer.nvidia.com/omniverse/simready-assets) specification supports the preparation of __3D content that is purpose-built for simulation__ to help streamline content creation pipelines for simulating 3D virtual environments for machine learning purposes in robotics and autonomous driving. Through the Omniverse Unreal Engine plugin now integrated into CARLA users can import, in just a few clicks, SimReady content such as vehicles already configured with working lights, doors and wheels and props ready for use instantaneously to decorate CARLA maps. CARLA's Omniverse integration boasts to significantly accelerate your environment building pipeline and opens the door to a whole world of applications in the [__Omniverse ecosystem__](https://www.nvidia.com/en-us/omniverse/ecosystem/).
The Omniverse Unreal Engine Connector is currently only available in Windows. !!! note
The Omniverse Unreal Engine Connector is currently only available in Windows.
Follow these stesps to start using Omniverse and using SimReady content in CARLA: Follow these steps to start using Omniverse and using SimReady content in CARLA:
Before anything else, you should first [install NVIDIA Omniverse](https://docs.omniverse.nvidia.com/install-guide/latest/index.html) Before anything else, you should first [install NVIDIA Omniverse](https://docs.omniverse.nvidia.com/install-guide/latest/index.html)
### 1. Installing the Unreal Engine Omniverse Connector ### 1. Installing the Unreal Engine Omniverse Connector
1. Launch the NVIDIA Omniverse Launcher. 1. Launch the NVIDIA Omniverse Launcher
2. Navigate to the Exchange tab. 2. Navigate to the **Exchange** tab
3. Locate the Epic Games Unreal Engine 4.26 Omniverse Connector. 3. Locate the __Epic Games Unreal Engine 4.26 Omniverse Connector__
4. Ensure the Install version is Release 105.1.578 4. Ensure the install version is **Release 105.1.578**
5. Click *Install*. 5. Click *Install*
6. Omniverse will not find Unreal Engine, click OK. 6. Omniverse will not be able to find Unreal Engine, click **OK**.
7. It will prompt you to find your Unreal Engine installation, Select this path: {UE4_ROOT}\Engine\Plugins\Marketplace\NVIDIA 7. It will prompt you to find your Unreal Engine installation, select this path: {UE4_ROOT}\Engine\Plugins\Marketplace\NVIDIA
8. Press *Install*. 8. Press *Install*.
### 2. Set Up Local Omniverse Server ### 2. Set Up Local Omniverse Server
1. Launch the NVIDIA Omniverse Launcher. 1. Open NVIDIA Omniverse with the launcher
2. Navigate to the Nucleus tab. 2. Navigate to the *Nucleus* tab
3. Click on create Local Server. 3. Click on *Create Local Server*
4. Add administrator details (any). 4. Create administrator details
5. Select on the folder icon next to Local Nucleus Service, this should open your localhost server navigator. 5. Select the folder icon next to *Local Nucleus Service*, this should open your localhost server in your web browser
### 3. Connecting to CARLA Simulator ### 3. Connecting to CARLA Simulator
1. Launch CARLA using `make launch` from the command line ine the CARLA root folder. 1. Launch CARLA using `make launch` from the command line the CARLA root folder
2. If an existing server is active, and you want to restart the setup, click on Clean Local Assets. (Optional) 2. If an existing server is active and you want to restart the setup, click on *Clean Local Assets* (optional)
3. Select the Omniverse icon and click on *Add Server*. 3. Select the *Omniverse* icon and click on *Add Server*
4. Name the server and click *Add to Content Browser*. 4. Name the server and click *Add to Content Browser*
5. A login form should launch in your browser, click *Create Account*. 5. A login form should launch in your browser, click *Create Account*
6. Add administrator details(any). 6. Create administrator details
7. Omniverse folders should have appeared in your Content/Omniverse folder within the Engine. 7. Omniverse folders should now be visible in your Content/Omniverse folder in the Unreal Engine content browser
8. Go to your local host browser Navigator 8. Go to your web browser again
9. Click on *Connect to a Server*. 9. Click on *Connect to a Server*
10. Authenticate using the server name you set for the CARLA server. 10. Authenticate using the server name you set for the CARLA server
11. Use administrator details you set for the CARLA server. 11. Use the administrator details that you set for the CARLA server
12. The server folders should now show up in your browser navigator. 12. The server folders should now show up in your browser
### 4. Importing the SimReady Car Asset ### 4. Importing a SimReady asset
1. Navigate to the Projects folder within the browser navigator. 1. Navigate to the Projects folder within the browser navigator
2. Right click, and select Upload Folder. 2. Right click, and select *Upload Folder*
3. Select your SimReady folders. 3. Select your SimReady folders
4. Upload the files. 4. Upload the files
### 5. Using the Omniverse Connector to Load the Vehicle to CARLA ### 5. Using the Omniverse Connector to Load the Vehicle to CARLA
1. Open the CARLA project in Unreal Engine. 1. Open the CARLA project in Unreal Engine
2. Navigate to CarlaTools Content\USDImporter. 2. Navigate to `CarlaTools/Content/USDImporter`
3. Right click on *UW_USDVehicleImporterEditorWidget*. 3. Right click on *UW_USDVehicleImporterEditorWidget*
4. Select *Run Editor Utility Widget*. 4. Select *Run Editor Utility Widget*
5. Find the Vehicle within your Omniverse browser navigator 5. Find the Vehicle within your Omniverse browser navigator
6. Copy the path (should look something like: omniverse://localhost/Projects/SimReadyUSD.../vehicle.usd) 6. Copy the path (should look something like: omniverse://localhost/Projects/SimReadyUSD.../vehicle.usd)
7. Paste it inside the Omiverse URL tab within the Widget. 7. Paste it inside the Omiverse URL tab within the Widget
8. Select Import Asset. 8. Select *Import Asset*
9. You should see the vehicle show up in the engine, within Content/OmniverseImports. 9. You should see the vehicle show up in the engine within the folder that you specified in the *Import destination* field
10. Open another map scene since it opened a new scene with the imported data, a *Save Content* prompt should appear. Uncheck the *Untitled* scene, and click on *Save selected* to save new content. 10. Open another map scene (it may have opened a new scene with the imported data) a *Save Content* prompt should appear. Uncheck the *Untitled* scene, and click on *Save selected* to save new content
11. The vehicle is now usable within CARLA. 11. The vehicle is now usable within CARLA and will be available through the Python API