I set the planner to dfs and max_tree_depth to 10000000 in the configuration file.
When running the planner on all 500 scenarios I get
Total number of scenarios: 500
Solution found: 322
Solution found but invalid: 0
Solution not found: 151
Exception occurred: 0
Time out: 25
How is it possible that 151 solutions were not found? Did DFS really search all trees up to a depth of 10000000 and determine that there is no solution? 
I wouldn’t mind getting timeouts, but no solution found seems suspicious.