Smoothing length failed to converge in Eagle 50 run
One of the Eagle 50Mpc boxes on Irene crashed with the following message on stderr:
[0011] [54683.8] runner_ghost.c:runner_do_stars_ghost():457: Smoothing length failed to converge on 1 particles.
The last few lines of stdout look like this:
[0011] [54683.8] runner_do_gas_swallow: BH 4778872227143 swallowing gas particle 4771408481365
[0011] [54683.8] runner_do_gas_swallow: BH 4778872227143 removing gas particle 4771408481365
[0011] [54683.8] runner_do_stars_ghost: Smoothing length convergence problem: iter=22 p->id=6206653907019 h_init=2.87584914e-03 h_old=4.74792253e-03 h_new=5.41309454e-02 f=-1.557518 f_prime=31.539547 n_sum=2.03936398e-02 n_target=1.57791173e+00 left=5.75169828e-03 right=2.87584914e-03
[0011] [54683.8] runner_do_stars_ghost: Smoothing length convergence problem: iter=24 p->id=6206653907019 h_init=2.87584914e-03 h_old=4.74792253e-03 h_new=5.41309454e-02 f=-1.557518 f_prime=31.539547 n_sum=2.03936398e-02 n_target=1.57791173e+00 left=5.75169828e-03 right=2.87584914e-03
[0011] [54683.8] runner_do_stars_ghost: Smoothing length convergence problem: iter=26 p->id=6206653907019 h_init=2.87584914e-03 h_old=4.74792253e-03 h_new=5.41309454e-02 f=-1.557518 f_prime=31.539547 n_sum=2.03936398e-02 n_target=1.57791173e+00 left=5.75169828e-03 right=2.87584914e-03
[0011] [54683.8] runner_do_stars_ghost: Smoothing length convergence problem: iter=28 p->id=6206653907019 h_init=2.87584914e-03 h_old=4.74792253e-03 h_new=5.41309454e-02 f=-1.557518 f_prime=31.539547 n_sum=2.03936398e-02 n_target=1.57791173e+00 left=5.75169828e-03 right=2.87584914e-03
[0013] [54684.0] runner_iact_nonsym_bh_gas_swallow: BH 937980653585 wants to swallow gas particle 937851903965
Here's the full log file: eagle_50_logs.tar.bz. I ran this using the limiter_mpi branch commit 5ebce90a but with the fix for the segfault on cleaning up at exit and the extra sync point after dumping restart files merged in.