carla/Docs/build_windows.md

284 lines
16 KiB
Markdown
Raw Permalink Normal View History

2020-03-02 21:35:50 +08:00
# Windows build
2021-01-22 23:13:32 +08:00
This guide details how to build CARLA from source on Windows. There are two parts. Part one details system requirements and installations of required software, and part two details how to actually build and run CARLA.
2020-03-02 21:35:50 +08:00
2021-01-22 23:13:32 +08:00
The build process is long (4 hours or more) and involves several kinds of software. It is highly recommended to read through the guide fully before starting.
If you come across errors or difficulties then have a look at the **[F.A.Q.](build_faq.md)** page which offers solutions for the most common complications. Alternatively, use the [CARLA forum](https://github.com/carla-simulator/carla/discussions) to post any queries you may have.
2021-01-22 23:13:32 +08:00
- [__Part One: Prerequisites__](#part-one-prerequisites)
2021-01-22 23:13:32 +08:00
- [System requirements](#system-requirements)
- [Software requirements](#software-requirements)
- [Minor installations](#minor-installations)
- [Python dependencies](#python-dependencies)
- [Major installations](#major-installations)
- [Visual Studio 2019](#visual-studio-2019)
2021-01-22 23:13:32 +08:00
- [Unreal Engine](#unreal-engine)
- [__Part Two: Build CARLA__](#part-two-build-carla)
2021-01-22 23:13:32 +08:00
- [Clone the CARLA repository](#clone-the-carla-repository)
- [Get assets](#get-assets)
- [Set Unreal Engine environment variable](#set-unreal-engine-environment-variable)
- [Build CARLA](#build-carla)
- [Other make commands](#other-make-commands)
2018-08-24 22:53:21 +08:00
---
2021-01-22 23:13:32 +08:00
## Part One: Prerequisites
2018-07-24 23:38:46 +08:00
2021-01-22 23:13:32 +08:00
In this section you will find details of system requirements, minor and major software installations and Python dependencies that are required before you can begin to build CARLA.
### System requirements
* __x64 system.__ The simulator should run in any 64 bits Windows system.
2021-01-22 23:13:32 +08:00
* __165 GB disk space.__ CARLA itself will take around 32 GB and the related major software installations (including Unreal Engine) will take around 133 GB.
* __An adequate GPU.__ CARLA aims for realistic simulations, so the server needs at least a 6 GB GPU although 8 GB is recommended. A dedicated GPU is highly recommended for machine learning.
2021-01-22 23:13:32 +08:00
* __Two TCP ports and good internet connection.__ 2000 and 2001 by default. Make sure that these ports are not blocked by firewalls or any other applications.
2020-03-02 21:35:50 +08:00
!!! Warning
2021-11-19 18:57:58 +08:00
__If you are upgrading from CARLA 0.9.12 to 0.9.13__: you must first upgrade the CARLA fork of the UE4 engine to the latest version. See the [__Unreal Engine__](#unreal-engine) section for details on upgrading UE4
2021-01-22 23:13:32 +08:00
### Software requirements
#### Minor installations
2020-03-02 21:35:50 +08:00
* [__CMake__](https://cmake.org/download/) generates standard build files from simple configuration files. __We recommend you use version 3.15+__.
* [__Git__](https://git-scm.com/downloads) is a version control system to manage CARLA repositories.
* [__Make__](http://gnuwin32.sourceforge.net/packages/make.htm) generates the executables. It is necessary to use __Make version 3.81__, otherwise the build may fail. If you have multiple versions of Make installed, check that you are using version 3.81 in your PATH when building CARLA. You can check your default version of Make by running `make --version`.
* [__7Zip__](https://www.7-zip.org/) is a file compression software. This is required for automatic decompression of asset files and prevents errors during build time due to large files being extracted incorrectly or partially.
2021-01-22 23:13:32 +08:00
* [__Python3 x64__](https://www.python.org/downloads/) is the main scripting language in CARLA. Having a x32 version installed may cause conflict, so it is highly advisable to have it uninstalled.
2018-04-19 00:34:09 +08:00
2020-02-10 17:20:37 +08:00
!!! Important
2021-01-22 23:13:32 +08:00
Be sure that the above programs are added to the [environment path](https://www.java.com/en/download/help/path.xml). Remember that the path added should correspond to the progam's `bin` directory.
#### Python dependencies
Starting with CARLA 0.9.12, users have the option to install the CARLA Python API using `pip3`. Version 20.3 or higher is required. To check if you have a suitable version, run the following command:
```sh
pip3 -V
```
If you need to upgrade:
```sh
pip3 install --upgrade pip
```
You must install the following Python dependencies:
```sh
pip3 install --user setuptools
pip3 install --user wheel
```
2018-04-19 00:34:09 +08:00
2021-01-22 23:13:32 +08:00
#### Major installations
##### Visual Studio 2019
2018-04-19 00:34:09 +08:00
Get the 2019 version of Visual Studio from [here](https://developerinsider.co/download-visual-studio-2019-web-installer-iso-community-professional-enterprise/). Choose __Community__ for the free version. Use the _Visual Studio Installer_ to install three additional elements:
* __Windows 8.1 SDK.__ Select it in the _Installation details_ section on the right or go to the _Indivdual Components_ tab and look under the _SDKs, libraries, and frameworks_ heading.
2021-01-22 23:13:32 +08:00
* __x64 Visual C++ Toolset.__ In the _Workloads_ section, choose __Desktop development with C++__. This will enable a x64 command prompt that will be used for the build. Check that it has been installed correctly by pressing the `Windows` button and searching for `x64`. Be careful __not to open a `x86_x64` prompt__.
* __.NET framework 4.6.2__. In the _Workloads_ section, choose __.NET desktop development__ and then in the _Installation details_ panel on the right, select `.NET Framework 4.6.2 development tools`. This is required to build Unreal Engine.
2020-02-10 17:20:37 +08:00
!!! Important
Other Visual Studio versions may cause conflict. Even if these have been uninstalled, some registers may persist. To completely clean Visual Studio from the computer, go to `Program Files (x86)\Microsoft Visual Studio\Installer\resources\app\layout` and run `.\InstallCleanup.exe -full`
!!! Note
It is also possible to use Visual Studio 2022 using the above steps and substituting the Windows 8.1 SDK for the Windows 11/10 SDK. To override the default Visual Studio 2019 Generator in CMake, specify GENERATOR="Visual Studio 17 2022" when using the makefile commands (see [table](build_windows.md#other-make-commands)). You may specify any generator that works with the build commands as specific in the build scripts, for a full list run `cmake -G` (Ninja has been tested to work for building LibCarla so far).
2021-01-22 23:13:32 +08:00
##### Unreal Engine
2018-04-19 00:34:09 +08:00
Starting with version 0.9.12, CARLA uses a modified fork of Unreal Engine 4.26. This fork contains patches specific to CARLA.
Be aware that to download this fork of Unreal Engine, __you need to have a GitHub account linked to Unreal Engine's account__. If you don't have this set up, please follow [this guide](https://www.unrealengine.com/en-US/ue4-on-github) before going any further.
2021-01-22 23:13:32 +08:00
To build the modified version of Unreal Engine:
__1.__ In a terminal, navigate to the location you want to save Unreal Engine and clone the _carla_ branch:
```sh
git clone --depth 1 -b carla https://github.com/CarlaUnreal/UnrealEngine.git .
```
2021-01-22 23:13:32 +08:00
!!! Note
Keep the Unreal Engine folder as close as `C:\\` as you can because if the path exceeds a certain length then `Setup.bat` will return errors in step 3.
2021-01-22 23:13:32 +08:00
__2.__ Run the configuration scripts:
2021-01-22 23:13:32 +08:00
```sh
Setup.bat
GenerateProjectFiles.bat
```
2021-01-22 23:13:32 +08:00
__3.__ Compile the modified engine:
2021-01-22 23:13:32 +08:00
>1. Open the `UE4.sln` file inside the source folder with Visual Studio 2019.
2021-01-22 23:13:32 +08:00
>2. In the build bar ensure that you have selected 'Development Editor', 'Win64' and 'UnrealBuildTool' options. Check [this guide](https://docs.unrealengine.com/en-US/ProductionPipelines/DevelopmentSetup/BuildingUnrealEngine/index.html) if you need any help.
2021-01-22 23:13:32 +08:00
>3. In the solution explorer, right-click `UE4` and select `Build`.
2021-01-22 23:13:32 +08:00
__4.__ Once the solution is compiled you can open the engine to check that everything was installed correctly by launching the executable `Engine\Binaries\Win64\UE4Editor.exe`.
2021-01-22 23:13:32 +08:00
!!! Note
If the installation was successful, this should be recognised by Unreal Engine's version selector. You can check this by right-clicking on any `.uproject` file and selecting `Switch Unreal Engine version`. You should see a pop-up showing `Source Build at PATH` where PATH is the installation path that you have chosen. If you can not see this selector or the `Generate Visual Studio project files` when you right-click on `.uproject` files, something went wrong with the Unreal Engine installation and you will likely need to reinstall it correctly.
2018-04-19 00:34:09 +08:00
2020-02-10 17:20:37 +08:00
!!! Important
2021-01-22 23:13:32 +08:00
A lot has happened so far. It is highly advisable to restart the computer before continuing.
2018-06-11 23:47:45 +08:00
2021-01-22 23:13:32 +08:00
---
## Part Two: Build CARLA
### Clone the CARLA repository
2018-06-11 23:47:45 +08:00
2020-02-10 17:20:37 +08:00
<div class="build-buttons">
<p>
<a href="https://github.com/carla-simulator/carla" target="_blank" class="btn btn-neutral" title="Go to the CARLA repository">
2020-02-10 17:20:37 +08:00
<span class="icon icon-github"></span> CARLA repository</a>
</p>
</div>
The button above will take you to the official repository of the project. Either download from there and extract it locally or clone it using the following command:
2018-06-11 23:47:45 +08:00
```sh
git clone https://github.com/carla-simulator/carla
```
2018-06-11 23:47:45 +08:00
2020-02-10 17:20:37 +08:00
!!! Note
The `master` branch contains the current release of CARLA with the latest fixes and features. Previous CARLA versions are tagged with the version name. Always remember to check the current branch in git with the command `git branch`.
### Get assets
2018-06-11 23:47:45 +08:00
Download the __latest__ assets to work with the current version of CARLA by running the following command in the CARLA root folder:
```sh
Update.bat
```
The assets will be downloaded and extracted to the appropriate location if have 7zip installed. If you do not have this software installed, you will need to manually extract the file contents to `Unreal\CarlaUE4\Content\Carla`.
To download the assets for a __specific version__ of CARLA:
2021-01-22 23:13:32 +08:00
1. From the root CARLA directory, navigate to `\Util\ContentVersions.txt`. This document contains the links to the assets for all CARLA releases.
2. Extract the assets in `Unreal\CarlaUE4\Content\Carla`. If the path doesn't exist, create it.
3. Extract the file with a command similar to the following:
```sh
tar -xvzf <assets_file_name>.tar.gz.tar -C C:\path\to\carla\Unreal\CarlaUE4\Content\Carla
```
2021-01-22 23:13:32 +08:00
### Set Unreal Engine environment variable
It is necessary to set an environment variable so that CARLA can find the Unreal Engine installation folder. This allows users to choose which specific version of Unreal Engine is to be used. If no environment variable is specified, then CARLA will search for Unreal Engine in the windows registry and use the first version it finds there.
To set the environment variable:
1. Open Windows Control Panel and go to `Advanced System Settings` or search for `Advanced System Settings` in the Windows search bar.
2. On the `Advanced` panel open `Environment Variables...`.
3. Click `New...` to create the variable.
4. Name the variable `UE4_ROOT` and choose the path to the installation folder of the desired Unreal Engine installation.
2018-06-11 23:47:45 +08:00
2021-01-22 23:13:32 +08:00
### Build CARLA
2020-04-30 23:43:58 +08:00
2021-01-22 23:13:32 +08:00
This section outlines the commands to build CARLA.
2020-04-30 23:43:58 +08:00
2021-01-22 23:13:32 +08:00
- All commands should be run in the root CARLA folder.
- Commands should be executed via the __x64 Native Tools Command Prompt for VS 2019__. Open this by clicking the `Windows` key and searching for `x64`.
2020-04-30 23:43:58 +08:00
2021-01-22 23:13:32 +08:00
There are two parts to the build process for CARLA, compiling the client and compiling the server.
2020-09-17 18:10:51 +08:00
__1.__ __Compile the Python API client__:
2018-04-19 00:34:09 +08:00
The Python API client grants control over the simulation. Compilation of the Python API client is required the first time you build CARLA and again after you perform any updates. After the client is compiled, you will be able to run scripts to interact with the simulation.
2018-04-19 00:34:09 +08:00
The following command compiles the Python API client:
2020-09-17 18:10:51 +08:00
```sh
make PythonAPI
```
2020-02-10 17:20:37 +08:00
The CARLA client library will be built in two distinct, mutually exclusive forms. This gives users the freedom to choose which form they prefer to run the CARLA client code. The two forms include `.egg` files and `.whl` files. Choose __one__ of the following options below to use the client library:
__A. `.egg` file__
>The `.egg` file does not need to be installed. All of CARLA's example scripts automatically [look for this file](build_system.md#versions-prior-to-0912) when importing CARLA.
>If you previously installed a CARLA `.whl`, the `.whl` will take precedence over an `.egg` file.
__B. `.whl` file__
>The `.whl` file should be installed using `pip3`:
2020-02-10 17:20:37 +08:00
```sh
pip3 install <path/to/wheel>.whl
```
2020-09-17 18:10:51 +08:00
>This `.whl` file cannot be distributed as it is built specifically for your OS.
!!! Warning
Issues can arise through the use of different methods to install the CARLA client library and having different versions of CARLA on your system. It is recommended to use virtual environments when installing the `.whl` and to [uninstall](build_faq.md#how-do-i-uninstall-the-carla-client-library) any previously installed client libraries before installing new ones.
2021-01-22 23:13:32 +08:00
__2.__ __Compile the server__:
2021-01-22 23:13:32 +08:00
The following command compiles and launches Unreal Engine. Run this command each time you want to launch the server or use the Unreal Engine editor:
2021-01-22 23:13:32 +08:00
```sh
make launch
```
2021-01-22 23:13:32 +08:00
The project may ask to build other instances such as `UE4Editor-Carla.dll` the first time. Agree in order to open the project. During the first launch, the editor may show warnings regarding shaders and mesh distance fields. These take some time to be loaded and the map will not show properly until then.
2021-01-22 23:13:32 +08:00
__3.__ __Start the simulation__:
2021-01-22 23:13:32 +08:00
Press **Play** to start the server simulation. The camera can be moved with `WASD` keys and rotated by clicking the scene while moving the mouse around.
2021-01-22 23:13:32 +08:00
Test the simulator using the example scripts inside `PythonAPI\examples`. With the simulator running, open a new terminal for each script and run the following commands to spawn some life into the town and create a weather cycle:
2021-01-22 23:13:32 +08:00
```sh
2021-01-22 23:13:32 +08:00
# Terminal A
cd PythonAPI\examples
pip3 install -r requirements.txt
python3 generate_traffic.py
2021-01-22 23:13:32 +08:00
# Terminal B
cd PythonAPI\examples
python3 dynamic_weather.py
```
2021-01-22 23:13:32 +08:00
!!! Important
2021-01-22 23:13:32 +08:00
If the simulation is running at a very low FPS rate, go to `Edit -> Editor preferences -> Performance` in the Unreal Engine editor and disable `Use less CPU when in background`.
2021-01-22 23:13:32 +08:00
### Other make commands
There are more `make` commands that you may find useful. Find them in the table below:
| Command | Description |
| ------- | ------- |
| `make help` | Prints all available commands. |
| `make launch` | Launches CARLA server in Editor window. |
| `make PythonAPI` | Builds the CARLA client. |
2021-01-22 23:13:32 +08:00
| `make LibCarla` | Prepares the CARLA library to be imported anywhere. |
| `make package` | Builds CARLA and creates a packaged version for distribution. |
| `make clean` | Deletes all the binaries and temporals generated by the build system. |
| `make rebuild` | `make clean` and `make launch` both in one command. |
2021-01-22 23:13:32 +08:00
---
2021-01-22 23:13:32 +08:00
Read the **[F.A.Q.](build_faq.md)** page or post in the [CARLA forum](https://github.com/carla-simulator/carla/discussions) for any issues regarding this guide.
2020-09-17 18:10:51 +08:00
2021-01-22 23:13:32 +08:00
Now that you have built CARLA, learn how to update the CARLA build or take your first steps in the simulation, and learn some core concepts.
2020-02-10 17:20:37 +08:00
<div class="build-buttons">
<p>
<a href="../build_update" target="_blank" class="btn btn-neutral" title="Learn how to update the build">
Update CARLA</a>
2020-02-10 17:20:37 +08:00
</p>
2020-09-17 18:10:51 +08:00
<p>
<a href="../core_concepts" target="_blank" class="btn btn-neutral" title="Learn about CARLA core concepts">
First steps</a>
</p>
</div>