2018-04-17 18:22:07 +08:00
|
|
|
We show the results for test and train weathers when
|
2018-04-17 20:54:18 +08:00
|
|
|
[running the simple example](benchmark_creating/#expected-results) for Town01.
|
2018-04-17 18:22:07 +08:00
|
|
|
The following result should print on the screen after running the
|
|
|
|
|
example.
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-17 23:43:49 +08:00
|
|
|
----- Printing results for training weathers (Seen in Training) -----
|
|
|
|
|
|
|
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Percentage of Successful Episodes
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Weather: Clear Noon
|
|
|
|
|
Task: 0 -> 1.0
|
|
|
|
|
Task: 1 -> 0.0
|
|
|
|
|
Task: 2 -> 0.0
|
|
|
|
|
Task: 3 -> 0.0
|
|
|
|
|
Average Between Weathers
|
|
|
|
|
Task 0 -> 1.0
|
|
|
|
|
Task 1 -> 0.0
|
|
|
|
|
Task 2 -> 0.0
|
|
|
|
|
Task 3 -> 0.0
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Percentage of Distance to Goal Travelled
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task: 0 -> 0.9643630125892909
|
|
|
|
|
Task: 1 -> 0.6794216252808839
|
|
|
|
|
Task: 2 -> 0.6593855166486696
|
|
|
|
|
Task: 3 -> 0.6646695325122313
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> 0.9643630125892909
|
|
|
|
|
Task 1 -> 0.6794216252808839
|
|
|
|
|
Task 2 -> 0.6593855166486696
|
|
|
|
|
Task 3 -> 0.6646695325122313
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Avg. Kilometers driven before a collision to a PEDESTRIAN
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Avg. Kilometers driven before a collision to a VEHICLE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.11491704214531683
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.11491704214531683
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Avg. Kilometers driven before a collision to a STATIC OBSTACLE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.22983408429063365
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.22983408429063365
|
2018-04-10 01:42:06 +08:00
|
|
|
|
2018-04-13 01:43:54 +08:00
|
|
|
Avg. Kilometers driven before going OUTSIDE OF THE ROAD
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> 0.12350085985904342
|
|
|
|
|
Task 2 -> 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> 0.12350085985904342
|
|
|
|
|
Task 2 -> 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-13 01:43:54 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before invading the OPPOSITE LANE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-13 01:43:54 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
----- Printing results for test weathers (Unseen in Training) -----
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Percentage of Successful Episodes
|
|
|
|
|
|
|
|
|
|
Weather: Clear Noon
|
|
|
|
|
Task: 0 -> 1.0
|
|
|
|
|
Task: 1 -> 0.0
|
|
|
|
|
Task: 2 -> 0.0
|
|
|
|
|
Task: 3 -> 0.0
|
|
|
|
|
Average Between Weathers
|
|
|
|
|
Task 0 -> 1.0
|
|
|
|
|
Task 1 -> 0.0
|
|
|
|
|
Task 2 -> 0.0
|
|
|
|
|
Task 3 -> 0.0
|
|
|
|
|
|
|
|
|
|
Average Percentage of Distance to Goal Travelled
|
|
|
|
|
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task: 0 -> 0.9643630125892909
|
|
|
|
|
Task: 1 -> 0.6794216252808839
|
|
|
|
|
Task: 2 -> 0.6593855166486696
|
|
|
|
|
Task: 3 -> 0.6646695325122313
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> 0.9643630125892909
|
|
|
|
|
Task 1 -> 0.6794216252808839
|
|
|
|
|
Task 2 -> 0.6593855166486696
|
|
|
|
|
Task 3 -> 0.6646695325122313
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before a collision to a PEDESTRIAN
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before a collision to a VEHICLE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.11491704214531683
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.11491704214531683
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before a collision to a STATIC OBSTACLE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before going OUTSIDE OF THE ROAD
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> 0.12350085985904342
|
|
|
|
|
Task 2 -> 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> 0.12350085985904342
|
|
|
|
|
Task 2 -> 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
Avg. Kilometers driven before invading the OPPOSITE LANE
|
|
|
|
|
Weather: Clear Noon
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
Average Between Weathers
|
2018-04-19 21:11:29 +08:00
|
|
|
Task 0 -> more than 0.04316352371637994
|
|
|
|
|
Task 1 -> more than 0.12350085985904342
|
|
|
|
|
Task 2 -> more than 0.2400373917146113
|
|
|
|
|
Task 3 -> more than 0.22983408429063365
|
2018-04-17 23:43:49 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
