From ab0f1afc484bdd5fc656c0757c86dae8cd55863c Mon Sep 17 00:00:00 2001 From: Matthieu Schaller <schaller@strw.leidenuniv.nl> Date: Thu, 7 May 2020 21:39:15 +0200 Subject: [PATCH] Added some limited hints about OpenMPI from the GADI system --- README-mpi-hints.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/README-mpi-hints.md b/README-mpi-hints.md index eef9967638..94c3948c3e 100644 --- a/README-mpi-hints.md +++ b/README-mpi-hints.md @@ -35,3 +35,16 @@ using the asynchronous progression settings: ## OpenMPI +_Open MPI_ comes in many flavours with many combinations of underlying +transport libraries and running on many different fabrics. A complete +description of all combinations is beyond the scope of this guide. + +On Mellanox hardware, we have had success running version 4.0 with the +UCX layer version 1.6 and using the following settings: + +``` +-mca coll_hcoll_enable 0 +UCX_TLS=ud_x,shm,self +UCX_RC_MLX5_TM_ENABLE=n +UCX_DC_MLX5_TM_ENABLE=n +``` -- GitLab