carla/Docs/benchmark_basic_results_tow...

6.6 KiB

We show the results for test and train weathers when running the simple example for Town02. The following result should print on the screen after running the example.

----- Printing results for training weathers (Seen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.8118712628185436
    Task: 1  ->  0.10663609976621982
    Task: 2  ->  -0.20449201041073187
    Task: 3  ->  -0.20447646890991833
  Average Between Weathers
    Task  0  ->  0.8118712628185436
    Task  1  ->  0.10663609976621982
    Task  2  ->  -0.20449201041073187
    Task  3  ->  -0.20447646890991833

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  -> more than 0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    More than  3  ->  0.03941736123307525

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  -> more than 0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    More than  3  ->  0.03941736123307525

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  ->  0.019708680616537626
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    Task  3  ->  0.019708680616537626

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525





----- Printing results for test weathers (Unseen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.8118712628185436
    Task: 1  ->  0.10663609976621982
    Task: 2  ->  -0.20449201041073187
    Task: 3  ->  -0.20447646890991833
  Average Between Weathers
    Task  0  ->  0.8118712628185436
    Task  1  ->  0.10663609976621982
    Task  2  ->  -0.20449201041073187
    Task  3  ->  -0.20447646890991833

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  -> more than 0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    More than  3  ->  0.03941736123307525

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  -> more than 0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    More than  3  ->  0.03941736123307525

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  -> more than 0.038524663402911156
    Task  2  -> more than 0.039421759075344356
    Task  3  ->  0.019708680616537626
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    More than  1  ->  0.038524663402911156
    More than  2  ->  0.039421759075344356
    Task  3  ->  0.019708680616537626

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525
  Average Between Weathers
    More than  0  ->  0.007091656691537298
    Task  1  ->  0.038524663402911156
    Task  2  ->  0.039421759075344356
    Task  3  ->  0.03941736123307525