Skip to content

SedovBlast MPI bug?

When running the following test:

mpirun -np 12 ./test_mindt_mpi -r 10000 -t 2 -f SedovBlast/sedov.hdf5 -m 0.02 -w 5000 -d 5e-5 -g "2 3 2"

Using the modules:

  • module load swift
  • module load swift/c4/gcc/intelmpi

Configured using:

  • ./configure --enable-debug --enable-sanitizer --disable-optimization --with-metis

The following is usually reported:

[000] main: MPI is up and running with 12 nodes.
[000] main: This is SWIFT version: 0.1.0, at revision: 842eeb1c-dirty

[000] main: maximum h set to 2.000000e-02.
[000] main: sub size set to 5000.
[000] main: dt set to 5.000000e-05.
[000] main: grid set to [ 2 3 2 ].
[000] main: sizeof(struct part) is 128 bytes.
[000] main: sizeof(struct gpart) is 64 bytes.
[000] main: Unit system: U_M = 1.000000e+00 g.
[000] main: Unit system: U_L = 1.000000e+00 cm.
[000] main: Unit system: U_t = 1.000000e+00 s.
[000] main: Unit system: U_I = 1.000000e+00 A.
[000] main: Unit system: U_T = 1.000000e+00 K.
[000] main: Density units: 1.000000e+00 a^-3.000000 h^2.000000.
[000] main: Entropy units: 1.000000e+00 a^4.000000 h^-1.333333.
[000] main: reading particle properties took 555.263 ms.
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: h_max is 8.793e-02 (cell_max=2.000e-02).
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] main: space_init took 30.689 ms.
[000] main: dt_max is 5.000000e-05.
[000] main: space dimensions are [ 5.000 5.000 5.000 ].
[000] main: space is periodic.
[000] main: highest-level cell dimensions are [ 25 25 25 ].
[000] main: 87381 parts in 15625 cells.
[000] main: maximum depth is 0.
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] main: nr_nodes is 12.
[005] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[000] main: map_cellcheck picked up 0 parts.
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] main: nr_nodes is 12.
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] main: nr_nodes is 12.
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[003] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 [000] space_regrid: set cell dimensions to [ 25 25 25 ].
88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] main: nr of cells at depth 0 is 15625.
[000] main: nr_nodes is 12.
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] space_regrid: set cell dimensions to [ 25 25 25 ].
[000] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[000] main: nr_nodes is 12.
[011] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[000] main: nr_nodes is 12.
[002] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[004] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[009] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[008] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 [001] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 17 19 21 23 25 27 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 125 127 ].
71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 [007] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 119 121 123 125 127 ].
124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 [010] engine_init: cpu map is [ 0 64 32 96 16 48 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 [006] engine_init: cpu map is [ 0 64 32 96 16 48 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 80 112 8 24 40 56 72 88 104 120 4 12 20 28 36 44 52 60 68 76 84 92 100 108 116 124 2 6 10 14 18 22 26 30 34 38 42 46 50 54 58 62 66 70 74 ].
19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 78 82 86 90 94 98 102 106 110 114 118 122 126 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 ].
49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 127 ].
[000] main: engine_init took 16.647 ms.
[009] engine_redistribute: node 9 now has 76281 parts in 1152 cells.
[009] main: Before write !
[007] engine_redistribute: node 7 now has 85583 parts in 1296 cells.
[007] main: Before write !
[011] engine_redistribute: node 11 now has 76280 parts in 1152 cells.
[011] main: Before write !
[005] engine_redistribute: node 5 now has 83784 parts in 1248 cells.
[005] main: Before write !
[003] engine_redistribute: node 3 now has 83783 parts in 1248 cells.
[003] main: Before write !
[001] engine_redistribute: node 1 now has 94001 parts in 1404 cells.
[001] main: Before write !
[002] engine_redistribute: node 2 now has 92025 parts in 1352 cells.
[002] main: Before write !
[006] engine_redistribute: node 6 now has 94001 parts in 1404 cells.
[006] main: Before write !
[010] engine_redistribute: node 10 now has 83784 parts in 1248 cells.
[010] main: Before write !
[004] engine_redistribute: node 4 now has 92024 parts in 1352 cells.
[004] main: Before write !
[000] engine_redistribute: node 0 now has 103247 parts in 1521 cells.
[000] main: Before write !
[008] engine_redistribute: node 8 now has 83783 parts in 1248 cells.
[008] main: Before write !
[000] main: writing particle properties took 842.525 ms.
[000] main: starting for 10000 steps with 2 threads and 2 queues...
# step time e_tot e_kin e_temp dt dt_step count dt_min dt_max
[001] main: writing particle properties took 845.608 ms.
[001] main: starting for 10000 steps with 2 threads and 2 queues...
[002] main: writing particle properties took 845.504 ms.
[002] main: starting for 10000 steps with 2 threads and 2 queues...
[003] main: writing particle properties took 845.704 ms.
[003] main: starting for 10000 steps with 2 threads and 2 queues...
[004] main: writing particle properties took 843.659 ms.
[004] main: starting for 10000 steps with 2 threads and 2 queues...
[005] main: writing particle properties took 846.277 ms.
[005] main: starting for 10000 steps with 2 threads and 2 queues...
[006] main: writing particle properties took 844.806 ms.
[006] main: starting for 10000 steps with 2 threads and 2 queues...
[007] main: writing particle properties took 848.541 ms.
[007] main: starting for 10000 steps with 2 threads and 2 queues...
[008] main: writing particle properties took 842.478 ms.
[008] main: starting for 10000 steps with 2 threads and 2 queues...
[009] main: writing particle properties took 848.887 ms.
[009] main: starting for 10000 steps with 2 threads and 2 queues...
[010] main: writing particle properties took 843.905 ms.
[010] main: starting for 10000 steps with 2 threads and 2 queues...
[011] main: writing particle properties took 847.487 ms.
[011] main: starting for 10000 steps with 2 threads and 2 queues...
[000] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[001] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[002] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[003] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[004] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[005] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[006] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[007] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[008] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[009] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[010] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[011] space_regrid: h_max is 9.091e-03 (cell_max=0.000e+00).
[005] engine_rebuild: task counts are [ none=0 sort=2100 self=2496 pair=38468 sub=0 ghost=1248 kick1=1248 kick2=1248 send=1704 recv=1704 link=2504 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[005] engine_rebuild: nr_parts = 83784.
[011] engine_rebuild: task counts are [ none=0 sort=1960 self=2304 pair=35624 sub=0 ghost=1152 kick1=1152 kick2=1152 send=1616 recv=1616 link=2312 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[011] engine_rebuild: nr_parts = 76280.
[000] engine_rebuild: task counts are [ none=0 sort=2475 self=3042 pair=46388 sub=0 ghost=1521 kick1=1521 kick2=1521 send=1908 recv=1908 link=3050 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[000] engine_rebuild: nr_parts = 103247.
[008] engine_rebuild: task counts are [ none=0 sort=2100 self=2496 pair=38468 sub=0 ghost=1248 kick1=1248 kick2=1248 send=1704 recv=1704 link=2504 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[008] engine_rebuild: nr_parts = 83783.
[009] engine_rebuild: task counts are [ none=0 sort=1960 self=2304 pair=35624 sub=0 ghost=1152 kick1=1152 kick2=1152 send=1616 recv=1616 link=2312 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[009] engine_rebuild: nr_parts = 76281.
[010] engine_rebuild: task counts are [ none=0 sort=2100 self=2496 pair=38468 sub=0 ghost=1248 kick1=1248 kick2=1248 send=1704 recv=1704 link=2504 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[010] engine_rebuild: nr_parts = 83784.
[003] engine_rebuild: task counts are [ none=0 sort=2100 self=2496 pair=38468 sub=0 ghost=1248 kick1=1248 kick2=1248 send=1704 recv=1704 link=2504 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[003] engine_rebuild: nr_parts = 83783.
[007] engine_rebuild: task counts are [ none=0 sort=2156 self=2592 pair=39788 sub=0 ghost=1296 kick1=1296 kick2=1296 send=1720 recv=1720 link=2600 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[007] engine_rebuild: nr_parts = 85583.
[004] engine_rebuild: task counts are [ none=0 sort=2250 self=2704 pair=41538 sub=0 ghost=1352 kick1=1352 kick2=1352 send=1796 recv=1796 link=2712 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[004] engine_rebuild: nr_parts = 92024.
[006] engine_rebuild: task counts are [ none=0 sort=2310 self=2808 pair=42962 sub=0 ghost=1404 kick1=1404 kick2=1404 send=1812 recv=1812 link=2816 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[006] engine_rebuild: nr_parts = 94001.
[002] engine_rebuild: task counts are [ none=0 sort=2250 self=2704 pair=41538 sub=0 ghost=1352 kick1=1352 kick2=1352 send=1796 recv=1796 link=2712 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[002] engine_rebuild: nr_parts = 92025.
[001] engine_rebuild: task counts are [ none=0 sort=2310 self=2808 pair=42962 sub=0 ghost=1404 kick1=1404 kick2=1404 send=1812 recv=1812 link=2816 grav_pp=0 grav_mm=0 grav_up=0 grav_down=0 skipped=0 ]
[001] engine_rebuild: nr_parts = 94001.
0 0.000000e+00 1.0000187399621593e+02 0.0000000000000000e+00 1.0000187399621593e+02 2.500e-05 3.403e+38 1048576 4.559e-05 2.060e+00 0.000 401.958 34.680 20.294 341.329 1205.562 575.866 0.000 5844.026 1180.492 0.000 0.000 0.000 0.000 7519.337 7597.638 441.967 372.490 12.402 8619.873 12910.939
1 2.500000e-05 1.0002538861035461e+02 2.3514614138683398e-02 1.0000187399621593e+02 7.629e-10 3.403e+38 1048576 8.902e-10 5.000e-05 0.000 15.503 21.077 25.171 0.000 666.936 596.229 0.000 1369.539 1171.289 0.000 0.000 0.000 0.000 0.000 18.020 481.456 425.109 14.255 2192.233 3298.383
[007] engine_redistribute: node 7 now has 52898 parts in 792 cells.
[006] engine_redistribute: node 6 now has 43509 parts in 636 cells.
[008] engine_redistribute: node 8 now has 41836 parts in 639 cells.
[011] engine_redistribute: node 11 now has 0 parts in 0 cells.
[010] engine_redistribute: node 10 now has 69160 parts in 1036 cells.
[009] engine_redistribute: node 9 now has 78731 parts in 1160 cells.
[002] engine_redistribute: node 2 now has 13792 parts in 212 cells.
[005] engine_redistribute: node 5 now has 75666 parts in 1144 cells.
[004] engine_redistribute: node 4 now has 32610 parts in 504 cells.
[003] engine_redistribute: node 3 now has 14550 parts in 198 cells.
[001] engine_redistribute: node 1 now has 62509 parts in 924 cells.
[000] engine_redistribute: node 0 now has 563315 parts in 1103 cells.
[000] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[001] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[002] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[003] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[004] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[005] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[006] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[007] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[008] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[009] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[010] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
[011] space_regrid: h_max is 8.793e-02 (cell_max=0.000e+00).
==58982== AddressSanitizer: while reporting a bug found another one.Ignoring.
=================================================================
==58982== ERROR: AddressSanitizer: heap-buffer-overflow on address 0x601200008fb4 at pc 0x417a59 bp 0x7fffffff9250 sp 0x7fffffff9248
READ of size 4 at 0x601200008fb4 thread T0
    #0 0x417a58 in space_split /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/space.c:950
    #1 0x41b115 in space_rebuild._omp_fn.2 /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/space.c:456
    #2 0x41627c in space_rebuild /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/space.c:450
    #3 0x4aa5d9 in engine_rebuild /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:1345
    #4 0x4aad9f in engine_prepare /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:1419
    #5 0x4acc30 in engine_step /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:1736
    #6 0x40f663 in main /gpfs/data/pdraper/swift-tests/swiftsim-gcc/examples/test.c:847
    #7 0x3efa61ed5c in __libc_start_main (/lib64/libc.so.6+0x3efa61ed5c)
    #8 0x4032d8 in _start (/gpfs/data/pdraper/swift-tests/swiftsim-gcc/examples/test_mindt_mpi+0x4032d8)
0x601200008fb4 is located 179 bytes to the right of 1-byte region [0x601200008f00,0x601200008f01)
allocated by thread T0 here:
[000] engine.c:engine_exchange_strays():842: Do not have a proxy for the requested nodeID.
    #0 0x2aaaaaac3839 in __interceptor_posix_memalign /cosma/local/software/gcc/build/4.8.1/build/x86_64-unknown-linux-gnu/libsanitizer/asan/../../../../gcc-4.8.1/libsanitizer/asan/asan_malloc_linux.cc:128
    #1 0x49e8e9 in engine_redistribute /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:201
    #2 0x4a2172 in engine_repartition /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:566
    #3 0x4acc21 in engine_step /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/engine.c:1733
    #4 0x40f663 in main /gpfs/data/pdraper/swift-tests/swiftsim-gcc/examples/test.c:847
    #5 0x3efa61ed5c in __libc_start_main (/lib64/libc.so.6+0x3efa61ed5c)
SUMMARY: AddressSanitizer: heap-buffer-overflow /gpfs/data/pdraper/swift-tests/swiftsim-gcc/src/space.c:950 space_split
Shadow bytes around the buggy address:
  0x0c02bfff91a0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff91b0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff91c0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff91d0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff91e0: 01 fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
=>0x0c02bfff91f0: 01 fa fa fa fa fa[fa]fa fa fa fa fa fa fa fa fa
  0x0c02bfff9200: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff9210: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff9220: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff9230: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c02bfff9240: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
Shadow byte legend (one shadow byte represents 8 application bytes):
  Addressable:           00
  Partially addressable: 01 02 03 04 05 06 07 
  Heap left redzone:     fa
  Heap righ redzone:     fb
  Freed Heap region:     fd
  Stack left redzone:    f1
  Stack mid redzone:     f2
  Stack right redzone:   f3
  Stack partial redzone: f4
  Stack after return:    f5
  Stack use after scope: f8
  Global redzone:        f9
  Global init order:     f6
  Poisoned by user:      f7
  ASan internal:         fe
==58982== ABORTING
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 0
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information