Submitted solution states not feasible

Hi,
I have generated some solutions which are computed as feasible when I check locally using

feasible, _ = feasibility_checker.trajectory_feasibility(trajectory,
                                                         VehicleDynamics.KS(VehicleType.FORD_ESCORT),
                                                         0.1)

But when I upload the same solution, it gives an error stating Solution is not feasible! Feasibility by planning problem id: {30274: 'Not Feasible!'}. What could be the possible issues?

Regards
Shivesh

Hi Shivesh, the vehicle might also collide with obstacles or leave the road. All of these checks are performed in commonroad_dc.feasibility.solution_checker.valid_solution().

Hi Moritz,
Thank you for the reply. I assumed that Solution is not feasible only comes up when the solution trajectory does not comply with the car kinematic/dynamics model. Because collision with obstacles show There is a collision between the scenario obstacles and the ego vehicle in planning problem solution and laneboundary violation shows There is a collision between lanelet boundaries and the ego vehicle in planning problem solution.

Regards
Shivesh

On the website, there is only a single type of error message currently for the validity checks. We might improve this soon.

I do get different messages for different errors.

So Solution is not feasible can mean any of the possible errors?

You’re actually right, there are already different error messages and this error actually means the kinematic feasibility. Could you send the solution file to moritz.klischat@tum.de?

It might be that you have another version of scipy than the one which is installed on the server. What is your scipy version? Check with pip show scipy.

Hi,
We just got the same problem. We generated some solutions which are locally checked to be valid but fail after uploading to the web. We also checked the video and it seems the solution is ok. Here is the video link: https://tongjieducn-my.sharepoint.com/:v:/g/personal/zhaoxc_tongji_edu_cn/EYzwjv3FOwxIjkpeB99RcqkB1atX_NxMXoVYxdn-33tMhA?e=0j7Ysn

My scipy version is 1.6.3, is that where the problem from?

Hello, Shivesh sent me his solution yesterday and I didn’t find the problem yet.
If it’s related to a problem on the server, we will re-run the feasibility check on the failed solutions.
I will keep you updated here.

Best,
Moritz

At the end of the lane change at about 0:06, the motion seems a bit abrupt which could be the reason for the failure.

However, that doesn’t explain why there are different results on the server. It could be related to numerical problems with the solver that is involved in the feasibility check on different machines. We adjusted the solver settings on the server and re-evaluated the solutions. Perhaps you can check if your affected solutions are rated as feasible now?

I’m afraid not.
I tried different settings to generate solutions for DEU_Frankfurt-95_6_I-1,which were similar to

They all passed the local checker but still failed on the website.

I checked your submissions: In this case the error message was not related the kinematic feasibility, but indicates a collision with other vehicles. That might be related to an older version of the sumo interface you are using to create the solution. This can result in slightly different trajectories of other vehicles. So when replaying your solution on the server, it could result in a collision. Are you using the latest version? https://pypi.org/project/sumocr/

Thank you a lot!
I updated my sumocr and I guess the local collision-checker is currently congruent with that on the website. But mismatches still exist in the results of feasibility check :sob:. My latest two submissions are locally checked to be feasible but failed on the website.

In that case you can send me the code and the scenarios you use for the check and I can take a look.

I am getting the same problem, although my sumocr is up to date.

Can you send some solution files where the problem occurs and the code you’re using for the check?