carla/Docs/benchmark_basic_results_tow...

6.8 KiB

We show the results for test and train weathers when running the simple example for Town02. The following result should print on the screen after running the example.

----- Printing results for training weathers (Seen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.8127653637426329
    Task: 1  ->  0.10658303206448155
    Task: 2  ->  -0.20448736444348714
    Task: 3  ->  -0.20446966646041384
  Average Between Weathers
    Task  0  ->  0.8127653637426329
    Task  1  ->  0.10658303206448155
    Task  2  ->  -0.20448736444348714
    Task  3  ->  -0.20446966646041384

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  ->  0.019641485501456352
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  ->  0.019641485501456352

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  ->  0.03856641710143665
    Task  2  ->  0.03928511962584409
    Task  3  ->  0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  ->  0.03856641710143665
    Task  2  ->  0.03928511962584409
    Task  3  ->  0.039282971002912705

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705





----- Printing results for test weathers (Unseen in Training) -----


Percentage of Successful Episodes

  Weather:  Clear Noon
    Task: 0  ->  1.0
    Task: 1  ->  0.0
    Task: 2  ->  0.0
    Task: 3  ->  0.0
  Average Between Weathers
    Task  0  ->  1.0
    Task  1  ->  0.0
    Task  2  ->  0.0
    Task  3  ->  0.0

Average Percentage of Distance to Goal Travelled

  Weather:  Clear Noon
    Task: 0  ->  0.8127653637426329
    Task: 1  ->  0.10658303206448155
    Task: 2  ->  -0.20448736444348714
    Task: 3  ->  -0.20446966646041384
  Average Between Weathers
    Task  0  ->  0.8127653637426329
    Task  1  ->  0.10658303206448155
    Task  2  ->  -0.20448736444348714
    Task  3  ->  -0.20446966646041384

Avg. Kilometers driven before a collision to a PEDESTRIAN
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705

Avg. Kilometers driven before a collision to a VEHICLE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705

Avg. Kilometers driven before a collision to a STATIC OBSTACLE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  ->  0.019641485501456352
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  ->  0.019641485501456352

Avg. Kilometers driven before going OUTSIDE OF THE ROAD
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  ->  0.03856641710143665
    Task  2  ->  0.03928511962584409
    Task  3  ->  0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  ->  0.03856641710143665
    Task  2  ->  0.03928511962584409
    Task  3  ->  0.039282971002912705

Avg. Kilometers driven before invading the OPPOSITE LANE
  Weather:  Clear Noon
    Task  0  -> more than 0.0071004936693366055
    Task  1  -> more than 0.03856641710143665
    Task  2  -> more than 0.03928511962584409
    Task  3  -> more than 0.039282971002912705
  Average Between Weathers
    Task  0  -> more than  0.0071004936693366055
    Task  1  -> more than  0.03856641710143665
    Task  2  -> more than  0.03928511962584409
    Task  3  -> more than  0.039282971002912705