stackhpc / hpc-tests Goto Github PK

All OSU test fails for alaska:ib-gcc9-impi-verbs and alaska:roce-gcc9-impi-verbs partitions.

The Intel MPI library emits the following to stdout, which is not handled by OMB output parser modules/omb.py:read_omb_out()

WARNING: release_mt library was used but no multi-ep feature was enabled. Please use release library instead.

IMB Biband times-out on alaska:ib-openmpi3-openib for all numbers of processes:

Time limit (secs_per_sample * msg_sizes_list_len) is over; use "-time X" or SECS_PER_SAMPLE=X (IMB_settings.h) to increase time limit.

IMB PingPong tests show 1/2 bandwidth for alaska:ib-gcc9-impi-verbs and alaska:roce-gcc9-impi-verbs partitions. Note that IMB Biband and Uniband tests show less impact at larger message sizes, although still not ideal.

Potentially the mlx OFI provider should be used instead of default verbs provider. Gudance on installing here, may require Mellanox HPC-X if UCX version referenced there is vendor-specific (not clear).