carla/Docs/benchmark_basic_results_tow...

6.7 KiB

We show the results for test and train weathers when running the simple example for Town01. The following result should print on the screen after running the example.

----- Printing results for training weathers (Seen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.9643630125892909
    Task: 1  ->  0.6794216252808839
    Task: 2  ->  0.6593855166486696
    Task: 3  ->  0.6646695325122313
  Average Between Weathers
    Task  0  ->  0.9643630125892909
    Task  1  ->  0.6794216252808839
    Task  2  ->  0.6593855166486696
    Task  3  ->  0.6646695325122313

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  -> more than  0.22983408429063365

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  ->  0.11491704214531683
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  ->  0.11491704214531683

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  ->  0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  ->  0.22983408429063365

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  ->  0.12350085985904342
    Task  2  ->  0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  ->  0.12350085985904342
    Task  2  ->  0.2400373917146113
    Task  3  -> more than  0.22983408429063365

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  -> more than  0.22983408429063365





----- Printing results for test weathers (Unseen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.9643630125892909
    Task: 1  ->  0.6794216252808839
    Task: 2  ->  0.6593855166486696
    Task: 3  ->  0.6646695325122313
  Average Between Weathers
    Task  0  ->  0.9643630125892909
    Task  1  ->  0.6794216252808839
    Task  2  ->  0.6593855166486696
    Task  3  ->  0.6646695325122313

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  -> more than  0.22983408429063365

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  ->  0.11491704214531683
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  ->  0.11491704214531683

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  ->  0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  ->  0.22983408429063365

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  ->  0.12350085985904342
    Task  2  ->  0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  ->  0.12350085985904342
    Task  2  ->  0.2400373917146113
    Task  3  -> more than  0.22983408429063365

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.04316352371637994
    Task  1  -> more than 0.12350085985904342
    Task  2  -> more than 0.2400373917146113
    Task  3  -> more than 0.22983408429063365
  Average Between Weathers
    Task  0  -> more than  0.04316352371637994
    Task  1  -> more than  0.12350085985904342
    Task  2  -> more than  0.2400373917146113
    Task  3  -> more than  0.22983408429063365