EAGLE_50 Crash with MPI
EAGLE_50 crashes on Cosma7 when running 4 MPI ranks:
mpirun -np 4 ../swift_mpi -a -t 28 -c -s -G -S eagle_50.yml
Revision: v0.7.0-1225-gdfed1bca, Branch: master, Date: 2018-09-02 17:44:25 +0200
Config. options: '--with-tbbmalloc --with-metis --enable-ipo CFLAGS=-qopt-zmm-usage=high --enable-debugging-checks'
Compiler: ICC, Version: 18.0.20180210
HDF5 library version: 1.8.20
FFTW library version: 3.x (details not available)
GSL library version: 2.4
MPI library: Intel(R) MPI Library 2018 Update 2 for Linux* OS (MPI std v3.1)
METIS library version: 5.1.0Output:
409 1.276545e-02 9.094122e-01 0.09961 1.022499e-08 39 40 705 705 0 846.292 0
410 1.276546e-02 9.094129e-01 0.09961 1.022499e-08 39 39 48 48 0 362.033 0
411 1.276547e-02 9.094136e-01 0.09961 1.022499e-08 39 42 76626 76626 0 1412.215 0
412 1.276548e-02 9.094142e-01 0.09961 1.022499e-08 39 39 48 48 0 365.426 0
413 1.276549e-02 9.094149e-01 0.09961 1.022499e-08 39 40 717 717 0 785.601 0
414 1.276550e-02 9.094155e-01 0.09961 1.022499e-08 39 39 48 48 0 362.373 0
415 1.276552e-02 9.094162e-01 0.09961 1.022499e-08 39 41 12681 12681 0 987.569 0
416 1.276553e-02 9.094169e-01 0.09961 1.022499e-08 39 39 48 48 0 365.164 0
417 1.276554e-02 9.094175e-01 0.09960 1.022499e-08 39 40 729 729 0 766.384 0
418 1.276555e-02 9.094182e-01 0.09960 1.022499e-08 39 39 48 48 0 369.402 0
419 1.276556e-02 9.094188e-01 0.09960 1.022499e-08 39 43 248109 248109 0 2404.556 0
420 1.276557e-02 9.094195e-01 0.09960 1.022499e-08 39 39 48 48 0 366.579 0
421 1.276558e-02 9.094202e-01 0.09960 1.022499e-08 39 40 718 718 0 742.365 0
422 1.276559e-02 9.094208e-01 0.09960 1.022504e-08 39 39 48 48 0 368.151 0
423 1.276560e-02 9.094215e-01 0.09960 1.022505e-08 39 41 12787 12787 0 1059.428 0
424 1.276561e-02 9.094221e-01 0.09960 1.022505e-08 39 39 48 48 0 364.118 0
425 1.276562e-02 9.094228e-01 0.09960 1.022505e-08 39 40 733 733 0 887.619 0
426 1.276563e-02 9.094235e-01 0.09960 1.022505e-08 39 39 49 49 0 363.104 0
427 1.276564e-02 9.094241e-01 0.09960 1.022505e-08 39 42 77183 77183 0 1390.315 0
428 1.276565e-02 9.094248e-01 0.09960 1.022505e-08 39 39 49 49 0 361.932 0
429 1.276566e-02 9.094255e-01 0.09960 1.022505e-08 39 40 747 747 0 917.277 0
430 1.276567e-02 9.094261e-01 0.09959 1.022505e-08 39 39 49 49 0 366.029 0
431 1.276568e-02 9.094268e-01 0.09959 1.022505e-08 39 41 12883 12883 0 982.903 0
432 1.276569e-02 9.094274e-01 0.09959 1.022505e-08 39 39 49 49 0 367.123 0
433 1.276570e-02 9.094281e-01 0.09959 1.022505e-08 39 40 756 756 0 864.630 0
434 1.276571e-02 9.094288e-01 0.09959 1.022505e-08 39 39 49 49 0 369.992 0
435 1.276572e-02 9.094294e-01 0.09959 1.022509e-08 39 48 48097551 178408245 20342069 259983.844 0
[0000] [04717.6] engine_drift_all: Drifting all to a=9.094294e-01
[0000] [04720.7] space_rebuild: (re)building space
[0001] [04952.9] runner.c:runner_do_end_force():1818: g-particle (id=7264671882086, type=DM) did not interact gravitationally with all other gparts gp->num_interacted=1700933470, total_gparts=850466735 (local num_gparts=455385470)
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 1