Running WarpX on DGX A100 GPUs about warpx HOT 5 OPEN

Hi @ax3l ! After discussing my issue with the HPC administrator, we tried recompiling from the environmental setup twice with their assistance, yet the error still occurred. Therefore, I would like to ask if there are any specific installation steps for clusters not mentioned in the official documentation. I am willing to install all dependencies myself. Are there any recommended versions of compilers, as well as recommended versions of CUDA and other related recommendations? Once I succeed, I would be very eager to share my installation process, as I believe it could help others who are new to the installation.

from warpx.

After efforts with the HPC administrator today, we have successfully installed Warpx, but we encountered new problems: 1. Running most of the Input Files is successful, but when running the example Input File for 'Laser-Ion Acceleration with a Planar Target,' it errors out and fails to run. 2. We are unable to run Python scripts. After opening the Python interface, no executable file is generated, and when the input file is a Python script, it results in errors. The command I used is :

mpirun -np 4 /public/home/ljz_gpu/sw/hpc3/gpu/venvs/warpx-gpu/bin/python3 /public/home/ljz_gpu/warpx/Examples/Tests/ohm_solver_magnetic_reconnection/PICMI_inputs.py > output.txt."

The error file is below：
WarpX.e103203.txt
Backtrace.0.txt
Backtrace.1.txt
Backtrace.2.txt
Backtrace.3.txt

Looking forward to your reply!

from warpx.

What I would start with: Note that WarpX uses 1 MPI rank per GPU. So for your job script above, where you use 1 node, this should read:

mpirun -np 8  /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d PICMI_inputs.py > output.txt

Do not oversubscribe, we do not support that.

If this still segfaults, then please repeat with a single MPI rank and also post the backtrace files.

from warpx.

Another point to check: in your backtrace, I see mpi4py issues. This might be from the oversubscription or another issue. Double check that the compilers and MPI used to build WarpX are the same as used to build mpi4py.

from warpx.

Hi, @ax3l ！
Based on your advice, I am now able to successfully run the Python script for the "Parallel propagating waves" section in Ohm solver: Electromagnetic modes. However, when attempting to run the Python script for "Perpendicular propagating waves," I encounter an error. I used the submission command:

mpirun -np 8  /public/home/ljz_gpu/sw/hpc3/gpu/venvs/warpx-gpu/bin/python3 /public/home/ljz_gpu/src/warpx/Examples/Tests/ohm_solver_EM_modes/PICMI_inputs.py -d 3 --bdir x > output.txt

The error file reads:
output.txt
Warpx.e105046.txt
Backtrace.0.txt

When running other input files or Python scripts, similar errors occur. After checking, the compilers are consistent. This confuses me.

from warpx.