Program crashed while executing batch_processing

When I was executing tutorial_batch_processing.ipynb, the program first ran well, and quickly gave out the senarios solved and unsolved. However, this program seemed to be unstopable even after it already gave out all the solutions. It used up all the memory of my DDR and made the jupyter notebook website crashed. Even when I closed all the terminal and internet browser, the python program still keept runnig (there were more than four python progresses running together, each taking few gigabytes of RAM) , and I was not able to kill them.

The operating system I’m using is Ubuntu 20.04.5 LTS, RAM:46.8 GiB, CPU:12th Gen Intel® Core™ i9-12900K × 24, GPU: NVIDIA GeForce RTX 3080 Ti, archtecture: x86_64

Hi ge86sam,

Thank you for reporting this.

Could you tell me which function in the tutorial (run_parallel_processing or run_seqential_processing) with which planner in SMP/batch_processing/batch_processing_config.yaml are you executing when program crashed?

Please note that basicly run_parallel_processing is the one you need. run_seqential_processing is only for debugging scenario and currently does not work good with some classes of search algorithm (should only not work with some depth-limited search I think).

Best,
Mingxuan

run_parallel_processing crashed, it is viewed in the system monitor that the 6 python progress took altogether 33.5GB of RAM. It’s unbelieveble.

Hi,

thanks for bring this to our attention. We will work on it.
Could you also please provide a screenshot or list of pip list when the commonroad-py37 env is activated. Thus we could check whether it is a issue related with wrong version of packages.

Best,
Mingxuan

Package Version


actionlib 1.13.2
alabaster 0.7.12
angles 1.9.13
antlr4-python3-runtime 4.9.3
anyio 3.5.0
argon2-cffi 21.3.0
argon2-cffi-bindings 21.2.0
attrs 22.1.0
Babel 2.9.1
backcall 0.2.0
beautifulsoup4 4.11.1
bleach 4.1.0
bondpy 1.8.6
brotlipy 0.7.0
camera-calibration 1.17.0
camera-calibration-parsers 1.12.0
catkin 0.8.10
certifi 2022.9.24
cffi 1.15.1
charset-normalizer 2.0.4
colorama 0.4.5
commonroad-drivability-checker 2022.2.1
commonroad-io 2022.3
commonroad-route-planner 2022.3
commonroad-vehicle-models 3.0.2
controller-manager 0.19.6
controller-manager-msgs 0.19.6
cryptography 38.0.1
cv-bridge 1.16.2
cycler 0.11.0
debugpy 1.5.1
decorator 5.1.1
defusedxml 0.7.1
diagnostic-analysis 1.11.0
diagnostic-common-diagnostics 1.11.0
diagnostic-updater 1.11.0
docutils 0.18.1
dynamic-reconfigure 1.7.3
entrypoints 0.4
fastjsonschema 2.16.2
flit_core 3.6.0
gazebo_plugins 2.9.2
gazebo_ros 2.9.2
gencpp 0.7.0
geneus 3.0.0
genlisp 0.4.18
genmsg 0.6.0
gennodejs 2.0.2
genpy 0.6.15
idna 3.4
image-geometry 1.16.2
imageio 2.9.0
imagesize 1.4.1
importlib-metadata 4.11.3
importlib-resources 5.2.0
interactive-markers 1.12.0
ipykernel 5.5.6
ipython 7.18.1
ipython-autotime 0.3.1
ipython-genutils 0.2.0
ipywidgets 7.5.1
iso3166 2.1.1
jedi 0.18.1
Jinja2 3.1.2
joint-state-publisher 1.15.1
joint-state-publisher-gui 1.15.1
json5 0.9.6
jsonschema 4.16.0
jupyter 1.0.0
jupyter_client 7.4.7
jupyter-console 6.4.3
jupyter_core 4.11.2
jupyter-server 1.18.1
jupyterlab 3.5.0
jupyterlab-pygments 0.1.2
jupyterlab_server 2.16.3
jupyterlab-widgets 1.0.0
kiwisolver 1.4.4
laser_geometry 1.6.7
lxml 4.9.1
MarkupSafe 2.1.1
matplotlib 3.3.4
matplotlib-inline 0.1.6
message-filters 1.15.15
mistune 0.8.4
mkl-fft 1.3.1
mkl-random 1.2.2
mkl-service 2.4.0
nbclassic 0.4.8
nbclient 0.5.13
nbconvert 6.5.4
nbformat 5.7.0
nest-asyncio 1.5.5
networkx 2.6.3
notebook 6.5.2
notebook_shim 0.2.2
numpy 1.21.6
omegaconf 2.2.3
packaging 21.3
pandocfilters 1.5.0
parso 0.8.3
pexpect 4.8.0
pickleshare 0.7.5
Pillow 9.3.0
pip 22.2.2
pkgutil_resolve_name 1.3.10
ply 3.11
Polygon3 3.0.9.1
prometheus-client 0.14.1
prompt-toolkit 3.0.20
protobuf 3.20.1
psutil 5.9.0
ptyprocess 0.7.0
pycparser 2.21
Pygments 2.11.2
pyOpenSSL 22.0.0
pyparsing 3.0.9
PyQt5-sip 12.11.0
pyrsistent 0.18.0
PySocks 1.7.1
python-dateutil 2.8.2
python-qt-binding 0.4.4
pytz 2022.1
PyYAML 5.3.1
pyzmq 23.2.0
qt-dotgraph 0.4.2
qt-gui 0.4.2
qt-gui-cpp 0.4.2
qt-gui-py-common 0.4.2
qtconsole 5.3.2
QtPy 2.2.0
requests 2.28.1
resource_retriever 1.12.7
rosbag 1.15.15
rosboost-cfg 1.15.8
rosclean 1.15.8
roscreate 1.15.8
rosgraph 1.15.15
roslaunch 1.15.15
roslib 1.15.8
roslint 0.12.0
roslz4 1.15.15
rosmake 1.15.8
rosmaster 1.15.15
rosmsg 1.15.15
rosnode 1.15.15
rosparam 1.15.15
rospy 1.15.15
rosservice 1.15.15
rostest 1.15.15
rostopic 1.15.15
rosunit 1.15.8
roswtf 1.15.15
rqt_action 0.4.9
rqt_bag 0.5.1
rqt_bag_plugins 0.5.1
rqt_console 0.4.11
rqt_dep 0.4.12
rqt_graph 0.4.14
rqt_gui 0.5.3
rqt_gui_py 0.5.3
rqt_image_view 0.4.16
rqt_launch 0.4.9
rqt_logger_level 0.4.11
rqt-moveit 0.5.10
rqt_msg 0.4.10
rqt_nav_view 0.5.7
rqt_plot 0.4.13
rqt_pose_view 0.5.11
rqt_publisher 0.4.10
rqt_py_common 0.5.3
rqt_py_console 0.4.10
rqt-reconfigure 0.5.5
rqt-robot-dashboard 0.5.8
rqt-robot-monitor 0.5.14
rqt_robot_steering 0.5.12
rqt_runtime_monitor 0.5.9
rqt-rviz 0.7.0
rqt_service_caller 0.4.10
rqt_shell 0.4.11
rqt_srv 0.4.9
rqt_tf_tree 0.6.3
rqt_top 0.4.10
rqt_topic 0.4.13
rqt_web 0.4.10
Rtree 1.0.1
rviz 1.14.19
scipy 1.7.3
Send2Trash 1.8.0
sensor-msgs 1.13.1
setuptools 65.5.0
Shapely 1.8.5.post1
sip 6.6.2
six 1.16.0
smach 2.5.0
smach-ros 2.5.0
smclib 1.8.6
sniffio 1.2.0
snowballstemmer 2.2.0
soupsieve 2.3.2.post1
Sphinx 5.0.2
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
terminado 0.13.1
tf 1.13.2
tf-conversions 1.13.2
tf2-geometry-msgs 0.7.6
tf2-kdl 0.7.6
tf2-py 0.7.6
tf2-ros 0.7.6
tinycss2 1.2.1
toml 0.10.2
tomli 2.0.1
topic-tools 1.15.15
tornado 6.2
tqdm 4.64.1
traitlets 5.1.1
triangle 20220202
typing_extensions 4.4.0
urllib3 1.26.12
wcwidth 0.2.5
webencodings 0.5.1
websocket-client 0.58.0
wheel 0.37.1
widgetsnbextension 3.5.2
xacro 1.14.14
zipp 3.8.0

Hi ge86sam,

Sorry for replying late.

According to your pip list, the packages you installed for this exercise look correct. But several other stuff are also installed in the same environment, for example, ROS-related packages. I would recommand you to set up a fresh conda env for this exercise. You can follow the README in repository to create a new env.

When you set up a new env, please verify the package version of Shapely according to this thread.

Your further quesions are always welcomed.

Best,
Mingxuan