Sedov blast crash over MPI with vectorization
I have a problem when running the Sedov blast case over MPI with vectorization and debugging checks on. Could you have a look?
mpirun -np 4 ../swift_mpi -s -t 4 sedov.yml
[0000] [00000.0] main: MPI is up and running with 4 node(s).
Welcome to the cosmological hydrodynamical code
______ _________________
/ ___/ | / / _/ ___/_ __/
\__ \| | /| / // // /_ / /
___/ /| |/ |/ // // __/ / /
/____/ |__/|__/___/_/ /_/
SPH With Inter-dependent Fine-grained Tasking
Version : 0.6.0
Revision: v0.6.0-669-g2e33483d-dirty, Branch: io_particle_wrapping, Date: 2017-11-21 13:05:41 +0000
Webpage : www.swiftsim.com
Config. options: '--enable-debugging-checks --enable-parallel-hdf5 --with-metis'
Compiler: ICC, Version: 16.0.20160415
CFLAGS : '-idirafter /usr/include/linux -O3 -ansi_alias -xAVX -pthread -w2 -Wunused-variable -Wshadow -Werror'
HDF5 library version: 1.8.14
FFTW library version: 3.x (details not available)
MPI library: Intel(R) MPI Library 5.1.3 for Linux* OS (MPI std v3.0)
METIS library version: 5.1.0
<SNIP>
96 3.222656e-03 4.882813e-05 262144 0 0 268.584 7
[0000] [00008.8] engine_drift_all: Drifting all
97 3.271484e-03 4.882813e-05 1145 0 0 7.350 0
[0000] [00008.9] engine_repartition: repartitioning space
[0000] [00008.9] space_parts_sort: Sorting succeeded.
[0000] [00008.9] space_rebuild: (re)building space
[0000] [00008.9] space_regrid: (re)griding space cdim=(10 10 10)
[0001] [00008.9] space_regrid: (re)griding space cdim=(10 10 10)
[0002] [00008.9] space_regrid: (re)griding space cdim=(10 10 10)
[0003] [00008.9] space_regrid: (re)griding space cdim=(10 10 10)
[0000] [00008.9] space_regrid: basic cell dimensions have increased - recalculating the global partition.
[0000] [00008.9] space_parts_sort: Sorting succeeded.
[0000] [00009.0] space_parts_sort: Sorting succeeded.
98 3.320313e-03 4.882813e-05 262144 0 0 348.219 7
[0000] [00009.2] engine_drift_all: Drifting all
99 3.369141e-03 4.882813e-05 1111 0 0 8.869 0
[0000] [00009.2] engine_repartition: repartitioning space
[0000] [00009.3] space_parts_sort: Sorting succeeded.
[0000] [00009.3] space_rebuild: (re)building space
[0000] [00009.3] space_parts_sort: Sorting succeeded.
[0003] [00009.3] cache.h:cache_read_two_partial_cells_sorted():383: Error: ci->loc[0.500000,0.400000,0.400000], cj->loc[0.600000,0.300000,0.400000] Particle 20 y pos is not within [-4*ci->width*(1 + 2*space_maxreldx), 4*ci->width*(1 + 2*space_maxreldx)]. y=0.200105, ci->width[1]=0.100000
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 3